3089 Commits

Author SHA1 Message Date
Gabe Lyons
3fd3313544
Revert "feat(graph): Make Dgraph a proper Neo4j alternative (#3578)" (#3740) 2021-12-14 10:49:03 -08:00
Harshal Sheth
f24440eff3
fix(ingest): count profiled tables separately in report (#3731) 2021-12-13 23:06:49 -08:00
jawadqu
578590e795
feat(ingestion) : Add Metabase Source Connector (#3602)
Co-authored-by: Jawad Qureshi <jqureshi@petabloc.com>
2021-12-13 23:02:47 -08:00
Harshal Sheth
3b7fd24740
feat(ingest): cleanup deprecated datahub.integrations.airflow.* imports (#3732) 2021-12-13 21:34:09 -08:00
Enrico Minack
a6deaabfcf
feat(graph): Make Dgraph a proper Neo4j alternative (#3578) 2021-12-13 12:37:59 -08:00
Aseem Bansal
a20821dc4d
feat(cli): allow to nuke without deleting data in quickstart (#3655) 2021-12-13 12:04:32 -08:00
Serge Travin
83207b37af
fix(superset): handle dashboards without charts (#3713) (#3714) 2021-12-13 11:01:36 -08:00
varunbharill
e55cbd1a34
feat(ingest): adding utilities methods to DataHubGraph class. (#3729) 2021-12-13 10:53:02 -08:00
Luis Angel Vicente Sanchez
9e32776248
fix(ingest): add source.config.connection.schema_registry_config to SchemaRegistryClient creation (#3702)
Co-authored-by: Luis Vicente Sanchez <luis.vicentesanchez@aaqua.live>
2021-12-13 09:32:15 -08:00
Sergio Gómez Villamor
9aa370cef2
fix(ingestion): adds missing port to the connection bootstrap (#3706) 2021-12-13 09:28:04 -08:00
Tamas Nemeth
b9f67c5b65
feat(ingest): trim long sql queries in usage connector (#3725) 2021-12-13 09:16:24 -08:00
mayurinehate
ff3dd162ff
fix(ingest): update trino source get_table_comment to handle not found error (#3712) 2021-12-13 07:40:48 -08:00
Tamas Nemeth
76949ca62d
fix(ingest): get mysql geotypes properly (#3726) 2021-12-13 07:38:22 -08:00
Tamas Nemeth
b5c3015f83
fix(profiler): fix division by zero in pct_unique calculation (#3727) 2021-12-13 07:37:12 -08:00
Gabe Lyons
5d8c813684
fix(mode): support definitions in mode query (#3721)
Co-authored-by: Jawad Qureshi <jqureshi@petabloc.com>
2021-12-10 17:56:39 -08:00
Gabe Lyons
8394fc62b0
feat(mode): add mode analytics ingestion source (#3710) 2021-12-09 16:10:08 -08:00
mayurinehate
bd4ecbc7b9
fix(nifi): add env in nifi config, add unit tests, fix nifi doc (#3703) 2021-12-09 13:34:13 -08:00
Tamas Nemeth
b0ebc6b579
fix(ingest): disable query parser failure reporting to datahub in redshift lineage by default (#3699) 2021-12-08 23:56:52 -08:00
Gabe Lyons
0fdd3352bd
feat(ingestion): Add lineage support for Redshift source (#3697)
Co-authored-by: treff7es <treff7es@gmail.com>
2021-12-08 23:41:18 -08:00
Kevin Hu
15ed3aecf0
refactor(ingest): cli deletion function (#3694) 2021-12-08 16:09:04 -08:00
Gabe Lyons
3cc4e76748
feat(ingest): bigquery - support snapshot and partition tables during ingest & lineage (#3695) 2021-12-08 16:07:21 -08:00
mayurinehate
1d7ec8dba8
feat(ingest): add nifi source (#3681) 2021-12-08 14:56:31 -08:00
ecooklin
1a5121a5ae
feat(ingest): adds glossary terms transformer (#3657) 2021-12-07 21:54:15 -08:00
Harshal Sheth
a9ce255abf
feat(profiler): add query combiner report statistics (#3678) 2021-12-07 21:38:40 -08:00
Gabe Lyons
1c17ba76d2
fix(snowflake): support geo types (#3686)
* Mapping Snowflake's GEOPGRAPHY type to Nulltype as a workaround as SqlAlchemy does not know about it 

Co-authored-by: treff7es <treff7es@gmail.com>
2021-12-07 19:36:10 -08:00
Harshal Sheth
6dffe9b247
refactor(profiling): clean up SQL query analysis (#3674) 2021-12-07 17:43:03 -08:00
Gabe Lyons
98366cca1f
feat(delete): support deleting by search w/ tokens (#3684) 2021-12-07 14:31:52 -08:00
Kevin Hu
d3081f4807
feat(ingestion): anonymous usage stats (#3668) 2021-12-07 08:57:12 -08:00
Harshal Sheth
9577123802
fix(ingestion): black formatting (#3676) 2021-12-06 17:59:56 -08:00
Swaroop Jagadish
a16c432a1b
feat(metadata-model): adding metadata model doc generation and upload… (#3667) 2021-12-05 12:22:17 -08:00
Harshal Sheth
1afcb661bd
feat(ingest): add --strict-warnings option (#3665) 2021-12-03 14:07:07 -08:00
Aseem Bansal
fe1d6fe59a
fix(cli): fix response handling for deletion cli (#3653) 2021-12-02 07:51:07 -08:00
varunbharill
a5ec05e2b2
fix(ingest): mongodb enable version check for document size filter. (#3644) 2021-11-30 11:33:33 -08:00
Ravindra Lanka
314f877aeb
fix(ingest): enhance supported and unsupported base_objects_accessed for snowflake (#3608) 2021-11-29 23:54:35 -08:00
Ravindra Lanka
8008fe3ca4
fix(ingestion): Handling for special characters in snowflake databases and schemas. (#3635) 2021-11-29 18:57:25 -08:00
Harshal Sheth
7d5da17d88
fix(ingest): workaround great-expectations compatibility issue (#3634) 2021-11-29 17:14:19 -08:00
Dexter Lee
de0382784f
feat(ingest): add ca_certificate_path to rest sink (#3632) 2021-11-29 13:05:29 -08:00
John Joyce
3e284d8761
feat(ingest): Add configurable GCP log page size to bigquery sources (#3556) 2021-11-28 21:13:50 -08:00
Shirshanka Das
842c05980b
feat(metadata-service): support for custom model extensions without forks (#3630) 2021-11-28 21:06:27 -08:00
Dexter Lee
7f7eb83c9b
fix(delete): remove logic that adds an invalid filter for platform field (#3619) 2021-11-28 17:49:24 -08:00
mayurinehate
637d05488b
fix(ingest): rectify platform urn in kafka connect source (#3624) 2021-11-26 14:38:53 -08:00
Harshal Sheth
cb2a3e6927
feat(profiler): dynamically combine queries (#3572) 2021-11-24 10:19:03 -08:00
Swaroop Jagadish
9f9aaaac23
feat(cli): adding a put command and docs (#3614) 2021-11-24 00:21:44 -08:00
varunbharill
192cf65c4d
fix(bigquery-usage): fix filters and event joining logic. (#3610) 2021-11-23 15:40:11 -08:00
Tamas Nemeth
a36fefaa33
feat(ingest): Starburst Trino usage (#3558) 2021-11-18 09:56:24 -08:00
mayurinehate
69036acfca
feat(ingest): add bigquery sink connector lineage in kafka connect source (#3590) 2021-11-17 17:18:37 -08:00
Remi
a9754ebe83
fix(ingest): fix dbt source platform when disable_dbt_node_creation is False (#3592) 2021-11-17 16:49:48 -08:00
Ravindra Lanka
3a9ef61147
feat(ingestion): Adds --dry-run and --preview options to datahub ingest command. (#3584) 2021-11-17 09:24:58 -08:00
Zach Bluhm
42419ec9fa
feat(ingest): allow logs to be filtered in Bigquery Usage plugin (#3567) 2021-11-16 08:11:17 -08:00
Swaroop Jagadish
4b4c972e26
fix(cli): m1 check should not fail on windows machines (#3579) 2021-11-15 16:50:53 -08:00