362 Commits

Author SHA1 Message Date
naoki kuroda
26114dfeb2
docs: fix sample command for container logs (#9427) 2023-12-14 15:42:45 -05:00
david-leifker
9899aca499
docs(updating-datahub): update docs for v0.12.1 (#9441) 2023-12-12 12:16:27 -06:00
Andrew Sikowitz
27f23ecdd5
feat(ingest/unity): GE Profiling (#8951) 2023-12-06 13:59:23 -05:00
Harshal Sheth
f9fd9467ef
feat(ingest): clean up DataHubRestEmitter return type (#9286)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-11-30 21:00:43 -05:00
Harshal Sheth
a7dc9c9d22
feat(sdk): autogenerate urn types (#9257) 2023-11-30 18:11:36 -05:00
Mayuri Nehate
08fb730676
fix(ingest): drop deprecated database_alias from sql sources (#9299)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-28 15:49:49 -05:00
RyanHolstien
a62d52e6b1
feat(mysql): upgrade to version 8.2 for quickstart (#9241)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-22 13:54:12 -06:00
Harshal Sheth
9d41a8f9f0
fix(ingest): drop redshift-legacy and redshift-usage-legacy sources (#9244) 2023-11-16 13:33:35 -05:00
Andrew Sikowitz
78abeb9beb
feat(ingest/unity): Support specifying catalogs directly; pass env correctly (#9110) 2023-11-16 12:41:12 -05:00
Xuelei Li
179f103412
fix(metadata-io): in Neo4j service use proper algorithm to get lineage (#8687)
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-10 10:58:38 -06:00
Pedro Silva
300cea373d
docs: Update updating-datahub.md (#9131) 2023-10-30 13:50:42 -07:00
Andrew Sikowitz
6c932e8afe
feat(ingest/bigquery): Attempt to support raw dataset pattern (#9109) 2023-10-25 13:17:09 -07:00
siddiquebagwan-gslab
b612545220
feat(ingestion/redshift): support auto_incremental_lineage (#9010) 2023-10-25 15:26:06 +05:30
skrydal
fe18532b29
docs(update): Added info on breaking change for policies (#9093)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-10-24 15:58:56 -07:00
Andrew Sikowitz
edb82ad91f
docs(ingest/bigquery): Add docs for breaking change: match_fully_qualified_names (#9094) 2023-10-24 15:56:14 -07:00
RyanHolstien
60c1aab587
fix(frontend): update cookie module (#8862) 2023-10-17 15:50:32 -05:00
Sergio Gómez Villamor
245c5c0008
fix(ingest/looker): stop emitting tag owner (#8942) 2023-10-11 17:06:19 -07:00
Andrew Sikowitz
26bc039b96
fix(ingest/unity): Remove metastore from ingestion and urns; standardize platform instance; add notebook filter (#8943) 2023-10-05 23:23:15 -04:00
Sergio Gómez Villamor
165aa54d1e
doc: DataHubUpgradeHistory_v1 (#8918) 2023-10-04 12:24:04 -05:00
Harshal Sheth
a300b39f15
feat(ingest/airflow): airflow plugin v2 (#8853) 2023-10-04 16:23:15 +05:30
Aseem Bansal
ad313ad282
feat(transfomer): add transformer to get ownership from tags (#8748) 2023-10-04 14:06:03 +05:30
Hyejin Yoon
31abf383d1
ci: add markdown-link-check (#8771) 2023-09-14 11:34:21 +09:00
Mayuri Nehate
303a2d0863
build(ingest): upgrade to sqlalchemy 1.4, drop 1.3 support (#8810)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-09-12 11:30:24 -07:00
Indy Prentice
aee1e68f5d
docs(release): Update updating-datahub.md for 0.11.0 release (#8821)
Co-authored-by: Indy Prentice <indy@ip-192-168-3-10.us-west-2.compute.internal>
2023-09-11 15:33:03 -05:00
Harshal Sheth
5032af9123
feat(cli): support recursive deletes (#8709) 2023-08-30 12:07:41 -07:00
Harshal Sheth
97a77d8d0b
docs: add index pages for feature/deployment guides (#8723) 2023-08-29 16:48:54 -07:00
Hyejin Yoon
04ecf4f75a
docs(docs): add native versioning (#8714) 2023-08-25 14:10:13 -07:00
Andrew Sikowitz
22c35f1a23
fix(ingest/bigquery): Add config option to create DataPlatformInstance, default off (#8659) 2023-08-24 14:46:06 +05:30
alplatonov
11fdfcf956
Fix(ingestion/clickhouse) move to two tier sqlalchemy (#8300)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2023-08-11 16:11:40 -04:00
alplatonov
b58f9bb396
Feat(ingest/ldap)fix list index out of range error (#8525)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2023-08-09 13:13:27 -04:00
Maggie Hays
ab101bc49c
docs(updating): add details on Unified Search & Browse experience (#8568)
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2023-08-03 19:19:43 -07:00
mohdsiddique
6a36118b4f
feat(ingestion/snowflake): use user email-id in urn generation for top users stat (#8513)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
2023-08-03 08:30:50 +05:30
Indy Prentice
037ae14800
docs(release): Update updating-datahub.md for 0.10.5 release (#8557)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-08-03 08:30:12 +05:30
Harshal Sheth
eac003ccf4
feat(ingest): enable pipeline reporting by default (#8472) 2023-07-25 14:16:27 +05:30
Harshal Sheth
056d3619f0
feat(sdk): easily generate container urns (#8198)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-07-21 21:14:06 +00:00
Harshal Sheth
d733363bed
chore(ingest): drop bigquery-beta and snowflake-beta aliases (#8451) 2023-07-20 14:05:25 -04:00
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module (#8306) 2023-07-20 06:39:14 +05:30
Andrew Sikowitz
1f84bf5b2b
fix(ingest/sql-common): Fix profile_table_level_only (#8331)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-07 19:05:50 -04:00
Aseem Bansal
af6973ebe0
fix(ingest/okta): Set default of okta connector to match OIDC defaults (#8272) 2023-06-21 19:15:31 +05:30
Andrew Sikowitz
02bc71dd84
fix(ingest/okta): Set default of okta_profile_to_username_attr to email (#8263) 2023-06-21 13:38:59 +05:30
Shubham Jagtap
35a4434490
fix(sdk/dataflow): deprecate cluster and use env and platform_instance instead (#8201)
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-06-15 14:06:28 -07:00
Pedro Silva
b0f686b05f
chore(release): update datahub upgrade docs (#8228) 2023-06-15 16:38:01 +05:30
Yang Jiandan
5588a04bc5
feat(docker):Add the jattach tool to the docker container(#7538) (#8040)
Co-authored-by: yangjd33 <yangjd33@chinaunicom.cn>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-07 12:23:38 -05:00
Indy Prentice
e14d7edd8a
Update updating-datahub.md for v0.10.3 release (#8139) 2023-05-26 13:01:08 -05:00
Chris Collins
366f518901
docs(): Update updating-datahub.md with breaking changes (#7964) 2023-05-23 13:13:22 -07:00
Harshal Sheth
afd65e16fb
feat(cli): delete cli v2 (#8068) 2023-05-23 14:43:44 -05:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits (#8051)
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
2023-05-17 00:01:57 -04:00
Pedro Silva
6f491c00e9
feat(docs): Add example documentation for scrollAcrossEntities (#8014) 2023-05-11 12:54:41 -05:00
Pedro Silva
b30c621029
feat(docs): Add cli documentation on how to add custom platforms (#7993) 2023-05-10 09:12:40 -05:00
Harshal Sheth
bf86235e26
fix(ingest/unity): use fully qualified catalog/schema patterns (#7900) 2023-05-02 16:27:17 -07:00