3975 Commits

Author SHA1 Message Date
Harshal Sheth
31eae24300
fix(ingest): support mssql encryption via ODBC (#2657) 2021-06-04 18:19:11 -07:00
Harshal Sheth
7f0c6bb5c9
fix(build): don't purge ingestion codegen files on gradle clean (#2645) 2021-06-03 20:33:25 -07:00
John Joyce
97e9660037
feat: No Code Metadata Modeling (#2629)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
Harshal Sheth
a0ad590b3f
fix(ingest): improve redshift ingestion performance (#2635) 2021-06-03 11:14:34 -07:00
Harshal Sheth
6b9d0d0129
fix(ingest): include urn as key for kafka emitter (#2634) 2021-06-03 11:04:40 -07:00
Thomas Larsson
b512920022
fix(ingestion): improve robustness of glue ingestion source (#2626)
fixes: #2625

Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-06-01 11:02:52 -07:00
Harshal Sheth
acef397ece
fix(ingest): fail gracefully when lookml used on old python versions (#2614) 2021-05-26 17:16:17 -07:00
Harshal Sheth
958fe8ea83
feat(ingest): populate inputDatajobs field in airflow integration (#2606) 2021-05-25 22:47:00 -07:00
Remi
6aa133f99c
fix(ingest): fix lineage after dbt metadata ingestion when tables name and identifier differ (#2596) 2021-05-25 18:59:35 -07:00
Harshal Sheth
dbe42e07f6
feat(ingest): update bigquery demo data (#2607) 2021-05-25 18:52:10 -07:00
Fredrik Sannholm
1e0b67ce56
feat(ingestion): Fix looker test (#2601) 2021-05-25 11:15:47 -07:00
Albert Franzi
4ad6d30509
fix(ingest): incorrect implementation of the allow pattern in looker dashboards (#2585) 2021-05-24 22:10:13 -07:00
Kevin Hu
48d2b94203
fix(ingest): default values for env (#2598) 2021-05-24 14:09:55 -07:00
Harshal Sheth
deca4a5073
docs(ingest): add a guide for writing sources (#2575) 2021-05-24 12:23:03 -07:00
Brian
27c4607a56
feat(react): add nativeDataType with tooltip over icon in schema (#2594) 2021-05-21 13:33:06 -07:00
Brian
aa8ba1b8e9
feat(dataflow): update dataflow to have datajobs in new tab (#2579) 2021-05-18 21:25:42 -07:00
John Bodley
227c52f29b
fix(docs): Fix Superset typo in README (#2584) 2021-05-18 21:22:17 -07:00
Harshal Sheth
2c2575c6a6
build(ingest): show diff upon lint failures (#2582) 2021-05-18 14:46:11 -07:00
taufiqibrahim
db78373427
feat(ingest): kafka connect metadata ingestion (#2516) 2021-05-18 14:45:38 -07:00
Harshal Sheth
1d4bcbe4fb
feat(ingest): add dataset tag transformer (#2580) 2021-05-18 14:43:43 -07:00
Harshal Sheth
f310ff9a4a
test(ingest): use different mysql test port (#2573) 2021-05-17 19:45:34 -07:00
Harshal Sheth
6d875b8241
test(ingest): ensure transformer registry works for aliases (#2572) 2021-05-17 15:08:49 -07:00
Harshal Sheth
7af1a13138
fix(ingest): better active directory LDAP support (#2571) 2021-05-17 14:42:54 -07:00
Gary Lucas
af4f3b9683
fix(dbt): set target platform and load schema (#2483) 2021-05-17 12:22:52 -07:00
Albert Franzi
38e3f6d4d0
feat(ingest): add AWS IAM Roles Support to the Glue Source (#2563) 2021-05-17 12:19:34 -07:00
David Koenitzer
4958febed5
docs: Add Sphinx Docstrings to Airflow Modules (#2562) 2021-05-17 12:10:35 -07:00
Harshal Sheth
ebe7409897
fix(cli): prevent click from suppressing errors (#2560) 2021-05-17 11:50:38 -07:00
Harshal Sheth
f590f11ff3
fix(ingest): check mypy types for test helpers (#2561) 2021-05-17 11:42:12 -07:00
Harshal Sheth
3dfe3d375b
feat(ingest): add options for Airflow lineage backend (#2557) 2021-05-13 20:02:47 -07:00
Kevin Hu
5ab1cbbbb2
feat(ingest): MongoDB schema inference (#2546) 2021-05-13 19:44:33 -07:00
Fredrik Sannholm
133577557c
feat(ingest): Looker view and dashboard ingestion (#2493) 2021-05-13 11:42:53 -07:00
Harshal Sheth
e3c190e772
fix(ingest): register custom Hive types (#2543) 2021-05-12 17:54:59 -07:00
Harshal Sheth
8d910b9e39
docs(ingest): improve kafka schema registry config docs (#2544) 2021-05-12 17:54:33 -07:00
Harshal Sheth
a671001824
refactor(ingest): move Airflow into datahub_provider module (#2521) 2021-05-12 15:01:11 -07:00
Albert Franzi
7fce505ffb
feat(ingest): define Redshift as a Postgres Source (#2540) 2021-05-12 10:00:34 -07:00
Harshal Sheth
a47400f18e
build(ingest): use gradle in commands + docs (#2531) 2021-05-11 19:03:20 -07:00
Harshal Sheth
a2755cd00d
fix(ingest): remove mce.json file from root (#2536) 2021-05-11 18:51:51 -07:00
Brian
d7d8870008
feat(usergroup): implement corpgroup in graphql, refactor avatars and ownership in react (#2519) 2021-05-11 17:55:45 -07:00
Harshal Sheth
2811d23e45
feat(ingest): add a transformer for adding ownership (#2532) 2021-05-11 17:46:39 -07:00
Harshal Sheth
36922c1746
docs: enable better syntax highlighting (#2529) 2021-05-11 15:16:12 -07:00
Harshal Sheth
35841d2d85
feat(ingest): check in generated schema files (#2503) 2021-05-10 19:36:23 -07:00
Harshal Sheth
4b2a6bd46a
fix(ingest): generate Airflow tags correctly (#2522) 2021-05-10 19:26:55 -07:00
Harshal Sheth
0ddf0ab262
fix(ingest): add support for custom postgres types (#2524) 2021-05-10 18:06:56 -07:00
shakti-garg
8ed14a62e2
feat(business_glossary): add new entity business term and its relationship with dataset and its fields (#2228)
Co-authored-by: shubham.garg <shubham.garg@thoughtworks.com>
2021-05-10 13:20:23 -07:00
Harshal Sheth
fe3ec3dee8
fix(build): only check for src/ and tests/ directories for lint checks (#2520) 2021-05-10 13:17:43 -07:00
Harshal Sheth
cd588baccb
build(ingest): include package data in sdist (#2513) 2021-05-07 15:21:43 -07:00
Harshal Sheth
d0ca3191c9
build(ingest): add metadata-ingestion to gradle build (#2510) 2021-05-06 22:10:49 -07:00
Harshal Sheth
50ea58c32d
docs: improve airflow explanations and examples (#2509) 2021-05-06 19:12:19 -07:00
Harshal Sheth
0e8b3d97ab
fix(ingest): remove double edges from Airflow lineage backend (#2508) 2021-05-06 19:08:02 -07:00
Vincenzo Lavorini
3132910707
docs: fixed MCE file recipe example (#2505) 2021-05-06 19:05:57 -07:00