3904 Commits

Author SHA1 Message Date
varunbharill
7e27355837
fix(ingest): Add gcp logging dependency for bigquery source. (#3451)
fixes #3450
2021-10-25 17:50:07 -07:00
Kevin Hu
3fe5ef7812
fix(ingest): lineage for Airflow subdags (#3351) 2021-10-25 16:34:45 -07:00
Harshal Sheth
dccef30daf
perf(ingest): lazy load ingestion plugins (#3430) 2021-10-25 14:10:24 -07:00
Remi
91d20e41c0
fix(ingest): fix lookml derived tables parsing (#3443) 2021-10-25 14:08:30 -07:00
Gabe Lyons
1fa49e2b79
feat(ingestion): support custom properties to be ingested via business glossary yaml (#3438) 2021-10-21 22:21:23 -07:00
Swaroop Jagadish
6704765d41
feat(ingest): add parallelism to looker source and datahub rest sink (#3431) 2021-10-21 11:27:27 -07:00
Harshal Sheth
a121aff6eb
refactor(ingest): resolve click-default-group deprecation warning (#3427) 2021-10-20 22:46:48 -07:00
varunbharill
328a204d44
fix(ingest): fix error when extracting lineage in bigquery is turned off. (#3428) 2021-10-20 14:42:07 -07:00
aseembansal-gogo
9dff1b7a1c
fix(ingest): allow database alias, remove extra removal from connect_… (#3352) 2021-10-19 22:29:38 -07:00
Harshal Sheth
9c09b78147
feat(ingest): support profiling tables in parallel (#3369) 2021-10-19 22:24:20 -07:00
mayurinehate
f5d37c0621
feat(ingest): add complex types support in hive and trino source (#3375) 2021-10-18 22:53:51 -07:00
Harshal Sheth
6e5d1fe42f
fix(ingest): switch to avro from deprecated avro-python3 (#3412) 2021-10-18 15:35:27 -07:00
John Joyce
c6a657939a
docs(ingest): add required permissions to Azure AD source doc (#3414) 2021-10-18 09:09:11 -07:00
varunbharill
e717d6a937
feat(bigquery): Ingest lineage metadata from GCP logs. (#3389) 2021-10-18 08:48:04 -07:00
Rukesh Kapuluru
aa52d98994
fix(ingest): set athena dataset name with 2 parts in redash (#3406) 2021-10-17 08:50:17 -07:00
varunbharill
73bd7657aa
fix(test): Fixing lookml integration test. (#3405) 2021-10-14 18:09:32 -07:00
Swaroop Jagadish
0cf157e991
fix(ingest): lookml view file resolution and looker spurious aspect issues (#3397) 2021-10-14 01:16:35 -07:00
Swaroop Jagadish
37e7141989
feat(ingest): teaching lookml source that athena has 2 parts in its names (#3393) 2021-10-13 19:33:04 -07:00
aseembansal-gogo
ebe0b3f7c1
feat(ingest): add mariadb as possible source (#3245) 2021-10-12 23:27:47 -07:00
Harshal Sheth
b43945ce55
test(airflow): remove unneeded execution_date parameter from test (#3368) 2021-10-12 23:25:27 -07:00
Swaroop Jagadish
146e79b9c3
fix(ingest): fixing support for kafka key schemas when only key schemas are present (#3379) 2021-10-12 18:50:39 -07:00
John Joyce
d7a6ca5423
feat(subtypes): support visualization for "view" subtypes (#3376) 2021-10-12 15:47:29 -07:00
Tamas Nemeth
4c8105e710
fix(ingest): redshift usage properly counting sqls (#3370) 2021-10-12 15:41:54 -07:00
aseembansal-gogo
2c901f7cf9
fix(docs): fix docs for developing on metadata ingestion (#3353) 2021-10-11 22:49:00 -07:00
aseembansal-gogo
558aba9917
feat(ingest): allow disabling sample values in profiling (#3355) 2021-10-11 22:46:15 -07:00
varunbharill
3c3e31262b
fix(bigquery_usage): gracefully fail while parsing GCP log events (#3367) 2021-10-11 22:36:24 -07:00
Swaroop Jagadish
7dab06519d
fix(ci): fix task instance constructor in airflow tests (#3366) 2021-10-11 20:58:37 -07:00
Dexter Lee
2580f71474
fix(gitignore): move metadata-ingestion ignores to its own folder (#3365) 2021-10-11 15:30:52 -07:00
Gabe Lyons
ac06666ebd
fix(ui): fix url encoding issues (#3359) 2021-10-11 15:19:41 -07:00
Vincenzo Lavorini
f39b8682a6
fix(ingestion): deleted alias function call in mce_builder (#3356) 2021-10-11 12:54:57 -07:00
mayurinehate
9590c29ea3
docs(ingest): fix trino doc (#3339) 2021-10-08 12:04:12 -07:00
Gabe Lyons
03bbfd0b2a
fix(react): primary key rendering and small autocomplete issues (#3347) 2021-10-08 11:53:01 -07:00
John Joyce
ed01b59a00
feat(users & groups): User & Groups Management GraphQL APIs + UI (#3318) 2021-10-07 16:14:35 -07:00
Swaroop Jagadish
0d2454bfb1
feat: add support for specialization of models through subtypes with looker integration (#3338) 2021-10-06 23:39:52 -07:00
Harshal Sheth
bd5e3b174a
feat(ingestion): support Airflow cluster config (#3336) 2021-10-06 15:01:59 -07:00
mayurinehate
d22d1c2795
feat(ingest): add trino source to datahub (#3307) 2021-10-06 11:57:06 -07:00
Remi
3d8e22ea34
fix(ingest): make dbt tag prefix configurable (#3334) 2021-10-06 11:55:59 -07:00
Dexter Lee
4c038d7cfe
fix(git-ignore): Git ignore generated python and avro artifacts (#3320) 2021-10-06 11:54:30 -07:00
Swaroop Jagadish
cfc97107e8
feat(ingest): add support for github and looker links in looker views and explores (#3332) 2021-10-06 07:13:38 -07:00
taufiqibrahim
ed38168f54
feat(ingest): add support for parsing lineage for redash connector (#3267)
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
2021-10-05 23:08:02 -07:00
Vincenzo Lavorini
9cb71d974e
feat(ingest): support user group filtering for Azure AD (#3312) 2021-10-05 23:03:30 -07:00
Ravindra Lanka
b4c0e20c68
feat(ingest): add lineage support to snowflake connector (#3331) 2021-10-05 22:58:07 -07:00
AndreasTA-AW
61ba3cf578
feat(ingest): added tags and owner from dbt (#3270)
Co-authored-by: Andreas Törnström Andersson <andreas.tornstrom-andersson@forefront.se>
2021-10-05 07:31:58 -07:00
aseembansal-gogo
e8502022cf
fix(ingest): glue ingestion should not fail when there are no partition keys (#3328) 2021-10-04 22:38:58 -07:00
Swaroop Jagadish
6580a453c8
fix(ingest): more robust error handling in lookml sql parsing (#3325) 2021-10-03 20:04:26 -07:00
Seref Acet
fe531b9537
docs: Fix topic_pattern typo in kafka ingestion docs (#3317) 2021-10-03 17:52:25 -07:00
varunbharill
6791311741
feat(ingest): added ability to extract external schema from Redshift spectrum (#3321) 2021-10-03 14:54:34 -07:00
Sergio Gómez Villamor
696ad2ccc4
feat(ingest): adds replace_existing config to browse path transformer (#3313) 2021-10-01 12:35:16 -07:00
Swaroop Jagadish
df0b4f258b
feat(ingest): support for primary and foreign key extraction from sql sources (#3316) 2021-09-30 23:04:47 -07:00
aseembansal-gogo
dd1f6fbc5e
feat(ingest): add -f option to skip confirmations for automation en… (#3256) 2021-09-28 22:49:34 -07:00