845 Commits

Author SHA1 Message Date
Harshal Sheth
9c09b78147
feat(ingest): support profiling tables in parallel (#3369) 2021-10-19 22:24:20 -07:00
mayurinehate
f5d37c0621
feat(ingest): add complex types support in hive and trino source (#3375) 2021-10-18 22:53:51 -07:00
Harshal Sheth
6e5d1fe42f
fix(ingest): switch to avro from deprecated avro-python3 (#3412) 2021-10-18 15:35:27 -07:00
John Joyce
c6a657939a
docs(ingest): add required permissions to Azure AD source doc (#3414) 2021-10-18 09:09:11 -07:00
varunbharill
e717d6a937
feat(bigquery): Ingest lineage metadata from GCP logs. (#3389) 2021-10-18 08:48:04 -07:00
Rukesh Kapuluru
aa52d98994
fix(ingest): set athena dataset name with 2 parts in redash (#3406) 2021-10-17 08:50:17 -07:00
varunbharill
73bd7657aa
fix(test): Fixing lookml integration test. (#3405) 2021-10-14 18:09:32 -07:00
Swaroop Jagadish
0cf157e991
fix(ingest): lookml view file resolution and looker spurious aspect issues (#3397) 2021-10-14 01:16:35 -07:00
Swaroop Jagadish
37e7141989
feat(ingest): teaching lookml source that athena has 2 parts in its names (#3393) 2021-10-13 19:33:04 -07:00
aseembansal-gogo
ebe0b3f7c1
feat(ingest): add mariadb as possible source (#3245) 2021-10-12 23:27:47 -07:00
Harshal Sheth
b43945ce55
test(airflow): remove unneeded execution_date parameter from test (#3368) 2021-10-12 23:25:27 -07:00
Swaroop Jagadish
146e79b9c3
fix(ingest): fixing support for kafka key schemas when only key schemas are present (#3379) 2021-10-12 18:50:39 -07:00
John Joyce
d7a6ca5423
feat(subtypes): support visualization for "view" subtypes (#3376) 2021-10-12 15:47:29 -07:00
Tamas Nemeth
4c8105e710
fix(ingest): redshift usage properly counting sqls (#3370) 2021-10-12 15:41:54 -07:00
aseembansal-gogo
2c901f7cf9
fix(docs): fix docs for developing on metadata ingestion (#3353) 2021-10-11 22:49:00 -07:00
aseembansal-gogo
558aba9917
feat(ingest): allow disabling sample values in profiling (#3355) 2021-10-11 22:46:15 -07:00
varunbharill
3c3e31262b
fix(bigquery_usage): gracefully fail while parsing GCP log events (#3367) 2021-10-11 22:36:24 -07:00
Swaroop Jagadish
7dab06519d
fix(ci): fix task instance constructor in airflow tests (#3366) 2021-10-11 20:58:37 -07:00
Dexter Lee
2580f71474
fix(gitignore): move metadata-ingestion ignores to its own folder (#3365) 2021-10-11 15:30:52 -07:00
Gabe Lyons
ac06666ebd
fix(ui): fix url encoding issues (#3359) 2021-10-11 15:19:41 -07:00
Vincenzo Lavorini
f39b8682a6
fix(ingestion): deleted alias function call in mce_builder (#3356) 2021-10-11 12:54:57 -07:00
mayurinehate
9590c29ea3
docs(ingest): fix trino doc (#3339) 2021-10-08 12:04:12 -07:00
Gabe Lyons
03bbfd0b2a
fix(react): primary key rendering and small autocomplete issues (#3347) 2021-10-08 11:53:01 -07:00
John Joyce
ed01b59a00
feat(users & groups): User & Groups Management GraphQL APIs + UI (#3318) 2021-10-07 16:14:35 -07:00
Swaroop Jagadish
0d2454bfb1
feat: add support for specialization of models through subtypes with looker integration (#3338) 2021-10-06 23:39:52 -07:00
Harshal Sheth
bd5e3b174a
feat(ingestion): support Airflow cluster config (#3336) 2021-10-06 15:01:59 -07:00
mayurinehate
d22d1c2795
feat(ingest): add trino source to datahub (#3307) 2021-10-06 11:57:06 -07:00
Remi
3d8e22ea34
fix(ingest): make dbt tag prefix configurable (#3334) 2021-10-06 11:55:59 -07:00
Dexter Lee
4c038d7cfe
fix(git-ignore): Git ignore generated python and avro artifacts (#3320) 2021-10-06 11:54:30 -07:00
Swaroop Jagadish
cfc97107e8
feat(ingest): add support for github and looker links in looker views and explores (#3332) 2021-10-06 07:13:38 -07:00
taufiqibrahim
ed38168f54
feat(ingest): add support for parsing lineage for redash connector (#3267)
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
2021-10-05 23:08:02 -07:00
Vincenzo Lavorini
9cb71d974e
feat(ingest): support user group filtering for Azure AD (#3312) 2021-10-05 23:03:30 -07:00
Ravindra Lanka
b4c0e20c68
feat(ingest): add lineage support to snowflake connector (#3331) 2021-10-05 22:58:07 -07:00
AndreasTA-AW
61ba3cf578
feat(ingest): added tags and owner from dbt (#3270)
Co-authored-by: Andreas Törnström Andersson <andreas.tornstrom-andersson@forefront.se>
2021-10-05 07:31:58 -07:00
aseembansal-gogo
e8502022cf
fix(ingest): glue ingestion should not fail when there are no partition keys (#3328) 2021-10-04 22:38:58 -07:00
Swaroop Jagadish
6580a453c8
fix(ingest): more robust error handling in lookml sql parsing (#3325) 2021-10-03 20:04:26 -07:00
Seref Acet
fe531b9537
docs: Fix topic_pattern typo in kafka ingestion docs (#3317) 2021-10-03 17:52:25 -07:00
varunbharill
6791311741
feat(ingest): added ability to extract external schema from Redshift spectrum (#3321) 2021-10-03 14:54:34 -07:00
Sergio Gómez Villamor
696ad2ccc4
feat(ingest): adds replace_existing config to browse path transformer (#3313) 2021-10-01 12:35:16 -07:00
Swaroop Jagadish
df0b4f258b
feat(ingest): support for primary and foreign key extraction from sql sources (#3316) 2021-09-30 23:04:47 -07:00
aseembansal-gogo
dd1f6fbc5e
feat(ingest): add -f option to skip confirmations for automation en… (#3256) 2021-09-28 22:49:34 -07:00
Gabe Lyons
08e18868dc
feat(react): show primary keys & foreign keys in the schema (#3298) 2021-09-28 22:47:00 -07:00
John Joyce
33f4d2ede0
fix(upgrade): Improving NoCodeUpgrade logic to account for Bootstrap logic (#3301) 2021-09-28 16:30:49 -07:00
Swaroop Jagadish
9dd7303bad
feat(build): adding support for python codegen for all aspects, not just the snapshot ones (#3299) 2021-09-26 17:22:58 -07:00
Swaroop Jagadish
2142157590
fix(ingest): looker explores with joins, parsing failures on lateral flatten (#3294) 2021-09-23 15:30:49 -07:00
Chinmay Bhat
5a239905df
feat(ingest): add redshift usage source (#3277) 2021-09-23 13:39:33 -07:00
adriaanslechten
185f7e2f5f
feat(ingest): optional custom headers REST emitter (#3290)
Co-authored-by: Adriaan Slechten <adriaan.slechten@klarna.com>
2021-09-23 12:53:39 -07:00
Chinmay Bhat
ab270a98ee
fix(build): update tox.ini to allow new dependencies to be installed (#3293) 2021-09-23 12:02:45 -07:00
Gabe Lyons
507d1e7658
fix(ingest): update generated files (#3292) 2021-09-23 12:02:01 -07:00
Swaroop Jagadish
bc50c8a779
fix(ingest): fix typo in looker tag generation (#3287) 2021-09-22 12:33:20 -07:00