3904 Commits

Author SHA1 Message Date
Enrico Minack
a6deaabfcf
feat(graph): Make Dgraph a proper Neo4j alternative (#3578) 2021-12-13 12:37:59 -08:00
Aseem Bansal
a20821dc4d
feat(cli): allow to nuke without deleting data in quickstart (#3655) 2021-12-13 12:04:32 -08:00
Serge Travin
83207b37af
fix(superset): handle dashboards without charts (#3713) (#3714) 2021-12-13 11:01:36 -08:00
varunbharill
e55cbd1a34
feat(ingest): adding utilities methods to DataHubGraph class. (#3729) 2021-12-13 10:53:02 -08:00
Luis Angel Vicente Sanchez
9e32776248
fix(ingest): add source.config.connection.schema_registry_config to SchemaRegistryClient creation (#3702)
Co-authored-by: Luis Vicente Sanchez <luis.vicentesanchez@aaqua.live>
2021-12-13 09:32:15 -08:00
Sergio Gómez Villamor
9aa370cef2
fix(ingestion): adds missing port to the connection bootstrap (#3706) 2021-12-13 09:28:04 -08:00
Tamas Nemeth
b9f67c5b65
feat(ingest): trim long sql queries in usage connector (#3725) 2021-12-13 09:16:24 -08:00
mayurinehate
ff3dd162ff
fix(ingest): update trino source get_table_comment to handle not found error (#3712) 2021-12-13 07:40:48 -08:00
Tamas Nemeth
76949ca62d
fix(ingest): get mysql geotypes properly (#3726) 2021-12-13 07:38:22 -08:00
Tamas Nemeth
b5c3015f83
fix(profiler): fix division by zero in pct_unique calculation (#3727) 2021-12-13 07:37:12 -08:00
Tamas Nemeth
0c8c29a6a2
docs(redshift): adding svv_table privilege requirement to redshift source (#3708) 2021-12-10 17:58:42 -08:00
Gabe Lyons
5d8c813684
fix(mode): support definitions in mode query (#3721)
Co-authored-by: Jawad Qureshi <jqureshi@petabloc.com>
2021-12-10 17:56:39 -08:00
Gabe Lyons
8394fc62b0
feat(mode): add mode analytics ingestion source (#3710) 2021-12-09 16:10:08 -08:00
mayurinehate
bd4ecbc7b9
fix(nifi): add env in nifi config, add unit tests, fix nifi doc (#3703) 2021-12-09 13:34:13 -08:00
Tamas Nemeth
eef26fe8ef
docs(redshift): Adding requirements for redshift permissions (#3707) 2021-12-09 13:32:15 -08:00
Tamas Nemeth
b0ebc6b579
fix(ingest): disable query parser failure reporting to datahub in redshift lineage by default (#3699) 2021-12-08 23:56:52 -08:00
Gabe Lyons
0fdd3352bd
feat(ingestion): Add lineage support for Redshift source (#3697)
Co-authored-by: treff7es <treff7es@gmail.com>
2021-12-08 23:41:18 -08:00
Gabe Lyons
46850324d2
fix(ingest): revert accidental change to example recipe file_to_datahub_rest.yml (#3698) 2021-12-08 16:56:08 -08:00
Kevin Hu
15ed3aecf0
refactor(ingest): cli deletion function (#3694) 2021-12-08 16:09:04 -08:00
Gabe Lyons
3cc4e76748
feat(ingest): bigquery - support snapshot and partition tables during ingest & lineage (#3695) 2021-12-08 16:07:21 -08:00
mayurinehate
1d7ec8dba8
feat(ingest): add nifi source (#3681) 2021-12-08 14:56:31 -08:00
ecooklin
1a5121a5ae
feat(ingest): adds glossary terms transformer (#3657) 2021-12-07 21:54:15 -08:00
Harshal Sheth
a9ce255abf
feat(profiler): add query combiner report statistics (#3678) 2021-12-07 21:38:40 -08:00
Gabe Lyons
1c17ba76d2
fix(snowflake): support geo types (#3686)
* Mapping Snowflake's GEOPGRAPHY type to Nulltype as a workaround as SqlAlchemy does not know about it 

Co-authored-by: treff7es <treff7es@gmail.com>
2021-12-07 19:36:10 -08:00
Harshal Sheth
6dffe9b247
refactor(profiling): clean up SQL query analysis (#3674) 2021-12-07 17:43:03 -08:00
Aseem Bansal
aba060a04c
docs(business glossary): fix specification of the file (#3679) 2021-12-07 17:14:27 -08:00
Gabe Lyons
98366cca1f
feat(delete): support deleting by search w/ tokens (#3684) 2021-12-07 14:31:52 -08:00
Aseem Bansal
b3ef5ee489
docs(scheduling): re-arrange docs related to scheduling, lineage, CLI (#3669) 2021-12-07 10:09:59 -08:00
Kevin Hu
d3081f4807
feat(ingestion): anonymous usage stats (#3668) 2021-12-07 08:57:12 -08:00
Gabe Lyons
b7a732d96b
fix(build): correcting m1 preflight check (#3677) 2021-12-06 21:49:08 -08:00
Harshal Sheth
9577123802
fix(ingestion): black formatting (#3676) 2021-12-06 17:59:56 -08:00
Swaroop Jagadish
a16c432a1b
feat(metadata-model): adding metadata model doc generation and upload… (#3667) 2021-12-05 12:22:17 -08:00
Harshal Sheth
1afcb661bd
feat(ingest): add --strict-warnings option (#3665) 2021-12-03 14:07:07 -08:00
Aseem Bansal
fe1d6fe59a
fix(cli): fix response handling for deletion cli (#3653) 2021-12-02 07:51:07 -08:00
Tamas Nemeth
f043b79f4c
feat(build): Preflight script for metadata ingestion on m1 (#3652) 2021-12-01 11:16:32 -08:00
Swaroop Jagadish
46861600fa
feat(build): add incremental builds for python (#3647) 2021-11-30 18:01:56 -08:00
varunbharill
a5ec05e2b2
fix(ingest): mongodb enable version check for document size filter. (#3644) 2021-11-30 11:33:33 -08:00
Ravindra Lanka
314f877aeb
fix(ingest): enhance supported and unsupported base_objects_accessed for snowflake (#3608) 2021-11-29 23:54:35 -08:00
Gabe Lyons
996b0491f6
docs(business glossary): document the business glossary file format (#3639) 2021-11-29 23:53:08 -08:00
Ravindra Lanka
8008fe3ca4
fix(ingestion): Handling for special characters in snowflake databases and schemas. (#3635) 2021-11-29 18:57:25 -08:00
Harshal Sheth
7d5da17d88
fix(ingest): workaround great-expectations compatibility issue (#3634) 2021-11-29 17:14:19 -08:00
Dexter Lee
de0382784f
feat(ingest): add ca_certificate_path to rest sink (#3632) 2021-11-29 13:05:29 -08:00
John Joyce
3e284d8761
feat(ingest): Add configurable GCP log page size to bigquery sources (#3556) 2021-11-28 21:13:50 -08:00
Adrian Garcia Badaracco
bd53f377ec
fix(tests): fix typo in test name (#3582)
* fix(tests): fix typo in test name

* find & replace function name
2021-11-28 21:09:42 -08:00
Shirshanka Das
842c05980b
feat(metadata-service): support for custom model extensions without forks (#3630) 2021-11-28 21:06:27 -08:00
Dexter Lee
7f7eb83c9b
fix(delete): remove logic that adds an invalid filter for platform field (#3619) 2021-11-28 17:49:24 -08:00
Swaroop Jagadish
2fd919cb4d
fix(ci): pin great expectations version (#3629) 2021-11-28 17:28:57 -08:00
varunbharill
c22192a3d4
fix(redshift-usage): Add docs for redshift usage ingestion. (#3617) 2021-11-28 16:04:14 -08:00
mayurinehate
637d05488b
fix(ingest): rectify platform urn in kafka connect source (#3624) 2021-11-26 14:38:53 -08:00
Harshal Sheth
cb2a3e6927
feat(profiler): dynamically combine queries (#3572) 2021-11-24 10:19:03 -08:00