5512 Commits

Author SHA1 Message Date
varunbharill
e55cbd1a34
feat(ingest): adding utilities methods to DataHubGraph class. (#3729) 2021-12-13 10:53:02 -08:00
Dexter Lee
d4d621800b
fix(docker): fix issues with base64 not working on some platforms (#3723) 2021-12-13 09:39:48 -08:00
Luis Angel Vicente Sanchez
9e32776248
fix(ingest): add source.config.connection.schema_registry_config to SchemaRegistryClient creation (#3702)
Co-authored-by: Luis Vicente Sanchez <luis.vicentesanchez@aaqua.live>
2021-12-13 09:32:15 -08:00
Sergio Gómez Villamor
9aa370cef2
fix(ingestion): adds missing port to the connection bootstrap (#3706) 2021-12-13 09:28:04 -08:00
Tamas Nemeth
b9f67c5b65
feat(ingest): trim long sql queries in usage connector (#3725) 2021-12-13 09:16:24 -08:00
mayurinehate
ff3dd162ff
fix(ingest): update trino source get_table_comment to handle not found error (#3712) 2021-12-13 07:40:48 -08:00
Tamas Nemeth
76949ca62d
fix(ingest): get mysql geotypes properly (#3726) 2021-12-13 07:38:22 -08:00
Tamas Nemeth
b5c3015f83
fix(profiler): fix division by zero in pct_unique calculation (#3727) 2021-12-13 07:37:12 -08:00
Tamas Nemeth
0c8c29a6a2
docs(redshift): adding svv_table privilege requirement to redshift source (#3708) 2021-12-10 17:58:42 -08:00
varunbharill
27f7603e9e
fix(docs): datahub cli docs have the wrong case for corpuser (#3717) 2021-12-10 17:57:44 -08:00
Gabe Lyons
5d8c813684
fix(mode): support definitions in mode query (#3721)
Co-authored-by: Jawad Qureshi <jqureshi@petabloc.com>
2021-12-10 17:56:39 -08:00
Gabe Lyons
36cf8351df
fix 0 artifact when there are no search recommendations (#3720) 2021-12-10 16:35:15 -08:00
Fredrik Sannholm
d651040c85
Fix vulnderability (#3716) v0.8.18 2021-12-10 10:07:55 -08:00
Dexter Lee
1f1467aac2
fix(home): Change docs count to not count removed datasets (#3711) 2021-12-09 22:51:06 -08:00
Aseem Bansal
1e97ac6cf7
docs(guide): add example for adding user in DataHub (#3682) 2021-12-09 21:32:09 -08:00
Dexter Lee
b00fe8426e
fix(datahub-upgrade): Fix Spring injection issue with datahub-upgrade (#3688) 2021-12-09 21:31:33 -08:00
Gabe Lyons
1056058543
encode square brackets (#3709) 2021-12-09 16:51:29 -08:00
Gabe Lyons
8394fc62b0
feat(mode): add mode analytics ingestion source (#3710) 2021-12-09 16:10:08 -08:00
mayurinehate
bd4ecbc7b9
fix(nifi): add env in nifi config, add unit tests, fix nifi doc (#3703) 2021-12-09 13:34:13 -08:00
Tamas Nemeth
eef26fe8ef
docs(redshift): Adding requirements for redshift permissions (#3707) 2021-12-09 13:32:15 -08:00
Aseem Bansal
cb37d87a9b
docs(airflow): add some troubleshooting for error (#3687) 2021-12-09 09:56:37 -08:00
Tamas Nemeth
b0ebc6b579
fix(ingest): disable query parser failure reporting to datahub in redshift lineage by default (#3699) 2021-12-08 23:56:52 -08:00
Gabe Lyons
0fdd3352bd
feat(ingestion): Add lineage support for Redshift source (#3697)
Co-authored-by: treff7es <treff7es@gmail.com>
2021-12-08 23:41:18 -08:00
Gabe Lyons
46850324d2
fix(ingest): revert accidental change to example recipe file_to_datahub_rest.yml (#3698) 2021-12-08 16:56:08 -08:00
Aseem Bansal
cb299161f3
fix(docker): fix for local docker compose for M1 (#3689) 2021-12-08 16:17:26 -08:00
Kevin Hu
15ed3aecf0
refactor(ingest): cli deletion function (#3694) 2021-12-08 16:09:04 -08:00
Gabe Lyons
3cc4e76748
feat(ingest): bigquery - support snapshot and partition tables during ingest & lineage (#3695) 2021-12-08 16:07:21 -08:00
mayurinehate
1d7ec8dba8
feat(ingest): add nifi source (#3681) 2021-12-08 14:56:31 -08:00
John Joyce
3bac7f7c43
fix(deletes): Fixing system metadata index deletes (#3693) 2021-12-08 14:03:24 -08:00
ecooklin
1a5121a5ae
feat(ingest): adds glossary terms transformer (#3657) 2021-12-07 21:54:15 -08:00
Harshal Sheth
a9ce255abf
feat(profiler): add query combiner report statistics (#3678) 2021-12-07 21:38:40 -08:00
Gabe Lyons
1c17ba76d2
fix(snowflake): support geo types (#3686)
* Mapping Snowflake's GEOPGRAPHY type to Nulltype as a workaround as SqlAlchemy does not know about it 

Co-authored-by: treff7es <treff7es@gmail.com>
2021-12-07 19:36:10 -08:00
Dexter Lee
0576b76eb3
fix(elasticsearch): Use auth tokens to authorize curl requests in dockerize (#3596) 2021-12-07 17:50:08 -08:00
John Joyce
44544dfa37
fix(auth): Tag Create Privileges were incorrectly using Dataset Create privileges (#3683) 2021-12-07 17:48:29 -08:00
Harshal Sheth
6dffe9b247
refactor(profiling): clean up SQL query analysis (#3674) 2021-12-07 17:43:03 -08:00
Aseem Bansal
aba060a04c
docs(business glossary): fix specification of the file (#3679) 2021-12-07 17:14:27 -08:00
Jeff Merrick
dc2db392fd
docs: change roadmap link in docs (#3685) 2021-12-07 17:11:22 -08:00
Gabe Lyons
98366cca1f
feat(delete): support deleting by search w/ tokens (#3684) 2021-12-07 14:31:52 -08:00
Aseem Bansal
b3ef5ee489
docs(scheduling): re-arrange docs related to scheduling, lineage, CLI (#3669) 2021-12-07 10:09:59 -08:00
Kevin Hu
d3081f4807
feat(ingestion): anonymous usage stats (#3668) 2021-12-07 08:57:12 -08:00
Dexter Lee
4a672c2dc5
fix(kafka): Add back changes to centralize kafka config (#3675) 2021-12-06 22:31:48 -08:00
Gabe Lyons
b7a732d96b
fix(build): correcting m1 preflight check (#3677) 2021-12-06 21:49:08 -08:00
Harshal Sheth
9577123802
fix(ingestion): black formatting (#3676) 2021-12-06 17:59:56 -08:00
Swaroop Jagadish
a16c432a1b
feat(metadata-model): adding metadata model doc generation and upload… (#3667) 2021-12-05 12:22:17 -08:00
Dexter Lee
999e9e5b49
fix(search): Improve search and recs performance (#3660) 2021-12-03 18:13:11 -08:00
Harshal Sheth
1afcb661bd
feat(ingest): add --strict-warnings option (#3665) 2021-12-03 14:07:07 -08:00
Aseem Bansal
d6ec5e7257
fix(docs): fix build on m1 (#3662) 2021-12-03 07:30:35 -08:00
Dexter Lee
8757543be8
refactor: remove unused PDL files (#3659) 2021-12-02 20:22:19 -08:00
Pedro Silva
d5eddf52ab
fix(test): Adds docker engine configuration checks before running docker-based tests for metadata-io (#3654) 2021-12-02 12:42:43 -08:00
Aseem Bansal
fe1d6fe59a
fix(cli): fix response handling for deletion cli (#3653) 2021-12-02 07:51:07 -08:00