927 Commits

Author SHA1 Message Date
Harshal Sheth
22cef5f897
refactor(test): replace CliRunner with run_datahub_cmd method (#3746) 2021-12-16 20:07:38 -08:00
Ravindra Lanka
bd69e736ba
feat(Stateful Ingestion-2/3): Client side changes for checkpointing a source job state. (#3763)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-12-16 20:06:33 -08:00
Sergio Gómez Villamor
c59c63e90d
feat: enables dbt metadata files to be loaded from URIs (#3739) 2021-12-15 09:11:39 -08:00
jawadqu
578590e795
feat(ingestion) : Add Metabase Source Connector (#3602)
Co-authored-by: Jawad Qureshi <jqureshi@petabloc.com>
2021-12-13 23:02:47 -08:00
Gabe Lyons
5d8c813684
fix(mode): support definitions in mode query (#3721)
Co-authored-by: Jawad Qureshi <jqureshi@petabloc.com>
2021-12-10 17:56:39 -08:00
Gabe Lyons
8394fc62b0
feat(mode): add mode analytics ingestion source (#3710) 2021-12-09 16:10:08 -08:00
mayurinehate
bd4ecbc7b9
fix(nifi): add env in nifi config, add unit tests, fix nifi doc (#3703) 2021-12-09 13:34:13 -08:00
mayurinehate
1d7ec8dba8
feat(ingest): add nifi source (#3681) 2021-12-08 14:56:31 -08:00
Swaroop Jagadish
a16c432a1b
feat(metadata-model): adding metadata model doc generation and upload… (#3667) 2021-12-05 12:22:17 -08:00
Harshal Sheth
1afcb661bd
feat(ingest): add --strict-warnings option (#3665) 2021-12-03 14:07:07 -08:00
varunbharill
a5ec05e2b2
fix(ingest): mongodb enable version check for document size filter. (#3644) 2021-11-30 11:33:33 -08:00
mayurinehate
637d05488b
fix(ingest): rectify platform urn in kafka connect source (#3624) 2021-11-26 14:38:53 -08:00
Tamas Nemeth
a36fefaa33
feat(ingest): Starburst Trino usage (#3558) 2021-11-18 09:56:24 -08:00
mayurinehate
69036acfca
feat(ingest): add bigquery sink connector lineage in kafka connect source (#3590) 2021-11-17 17:18:37 -08:00
Remi
a9754ebe83
fix(ingest): fix dbt source platform when disable_dbt_node_creation is False (#3592) 2021-11-17 16:49:48 -08:00
Zach Bluhm
42419ec9fa
feat(ingest): allow logs to be filtered in Bigquery Usage plugin (#3567) 2021-11-16 08:11:17 -08:00
Ravindra Lanka
87478a1658
fix(ingestion): redshift-usage should not append email domain to the username if already an email. (#3569) 2021-11-13 19:47:39 -08:00
Vincenzo Lavorini
6cd31b5bdc
feat(ingest): adding openapi ingestion (#2706) 2021-11-09 21:22:15 -08:00
Harshal Sheth
b0b275ee34
test(profiler): make profiling tests more comprehensive (#3513) 2021-11-07 18:53:53 -08:00
varunbharill
417b555fef
feat(dbt): dbt enhancements - dbt nodes, lineage, subtype, etc. (#3519) 2021-11-05 09:27:41 -07:00
mayurinehate
192f0d33a2
feat(ingest): kafka connect source improvements (#3481) 2021-11-03 15:03:05 -07:00
Gabe Lyons
cad9be6b1d
fix(ingest): fix whitespace in foreign key urns (#3486) 2021-10-28 23:14:42 -07:00
AndreasTA-AW
561c04bcf8
feat(dbt-ingestion): add ability to skip specific models (#3340) 2021-10-25 22:31:19 -07:00
mayurinehate
f5d37c0621
feat(ingest): add complex types support in hive and trino source (#3375) 2021-10-18 22:53:51 -07:00
varunbharill
73bd7657aa
fix(test): Fixing lookml integration test. (#3405) 2021-10-14 18:09:32 -07:00
Swaroop Jagadish
0cf157e991
fix(ingest): lookml view file resolution and looker spurious aspect issues (#3397) 2021-10-14 01:16:35 -07:00
Swaroop Jagadish
146e79b9c3
fix(ingest): fixing support for kafka key schemas when only key schemas are present (#3379) 2021-10-12 18:50:39 -07:00
John Joyce
d7a6ca5423
feat(subtypes): support visualization for "view" subtypes (#3376) 2021-10-12 15:47:29 -07:00
Tamas Nemeth
4c8105e710
fix(ingest): redshift usage properly counting sqls (#3370) 2021-10-12 15:41:54 -07:00
Swaroop Jagadish
0d2454bfb1
feat: add support for specialization of models through subtypes with looker integration (#3338) 2021-10-06 23:39:52 -07:00
mayurinehate
d22d1c2795
feat(ingest): add trino source to datahub (#3307) 2021-10-06 11:57:06 -07:00
Swaroop Jagadish
cfc97107e8
feat(ingest): add support for github and looker links in looker views and explores (#3332) 2021-10-06 07:13:38 -07:00
Vincenzo Lavorini
9cb71d974e
feat(ingest): support user group filtering for Azure AD (#3312) 2021-10-05 23:03:30 -07:00
AndreasTA-AW
61ba3cf578
feat(ingest): added tags and owner from dbt (#3270)
Co-authored-by: Andreas Törnström Andersson <andreas.tornstrom-andersson@forefront.se>
2021-10-05 07:31:58 -07:00
Swaroop Jagadish
6580a453c8
fix(ingest): more robust error handling in lookml sql parsing (#3325) 2021-10-03 20:04:26 -07:00
Swaroop Jagadish
df0b4f258b
feat(ingest): support for primary and foreign key extraction from sql sources (#3316) 2021-09-30 23:04:47 -07:00
John Joyce
33f4d2ede0
fix(upgrade): Improving NoCodeUpgrade logic to account for Bootstrap logic (#3301) 2021-09-28 16:30:49 -07:00
Chinmay Bhat
5a239905df
feat(ingest): add redshift usage source (#3277) 2021-09-23 13:39:33 -07:00
Swaroop Jagadish
bc50c8a779
fix(ingest): fix typo in looker tag generation (#3287) 2021-09-22 12:33:20 -07:00
Gabe Lyons
ff527f4bed
feat(foreign keys): add foreign key models (#3275) 2021-09-22 10:29:27 -07:00
Swaroop Jagadish
dea5ef7b09
fix(ingest): making lookml recursive and nested includes work (#3264) 2021-09-19 17:28:44 -07:00
Swaroop Jagadish
bb73c467da
fix(ingest): looker cascading derived tables should express lineage to view not underlying table (#3262) 2021-09-18 09:43:15 -07:00
Swaroop Jagadish
9db7a34cfa
feat(ingest): looker and lookml improvements - connection, explores, folders (#3255) 2021-09-16 23:09:45 -07:00
Swaroop Jagadish
28cbb2b4ef
fix(ingest): fixing snowflake and bigquery usage connectors to use real user urns (#3243) 2021-09-15 21:38:38 -07:00
rslanka
c418bc845c
feat(Analytics): Support for Timeseries Aggregated Statistics (#3207)
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Dexter Lee <dexter@acryl.io>
2021-09-14 18:35:10 -07:00
Chinmay Bhat
9014afd9ed
refactor(ingest): rename azure source to azure_ad (#3181) 2021-09-02 09:24:10 -07:00
Chinmay Bhat
bda881cbf2
feat(ingest): Adding Azure Source integration to ingest users, groups and group memberships (#3161) 2021-08-29 08:32:40 -07:00
Swaroop Jagadish
d1b57927a9
fix(frontend): replacing broken link for default avatar (#3156) 2021-08-24 21:40:39 -07:00
Swaroop Jagadish
88afec7f1c
feat(ingest): adding maxSchemaSize to mongodb source (#3153) 2021-08-24 12:15:40 -07:00
Sergio Gómez Villamor
dd7bead514
fix(profiles): prevent NoneType exception when profiling empty datasets (#3144)
Co-authored-by: Sergio Gómez <sergio.gomez.villamor@adevinta.com>
2021-08-23 13:49:51 -07:00