199 Commits

Author SHA1 Message Date
Harshal Sheth
9d41a8f9f0
fix(ingest): drop redshift-legacy and redshift-usage-legacy sources (#9244) 2023-11-16 13:33:35 -05:00
Andrew Sikowitz
78abeb9beb
feat(ingest/unity): Support specifying catalogs directly; pass env correctly (#9110) 2023-11-16 12:41:12 -05:00
Xuelei Li
179f103412
fix(metadata-io): in Neo4j service use proper algorithm to get lineage (#8687)
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-10 10:58:38 -06:00
Pedro Silva
300cea373d
docs: Update updating-datahub.md (#9131) 2023-10-30 13:50:42 -07:00
Andrew Sikowitz
6c932e8afe
feat(ingest/bigquery): Attempt to support raw dataset pattern (#9109) 2023-10-25 13:17:09 -07:00
siddiquebagwan-gslab
b612545220
feat(ingestion/redshift): support auto_incremental_lineage (#9010) 2023-10-25 15:26:06 +05:30
skrydal
fe18532b29
docs(update): Added info on breaking change for policies (#9093)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-10-24 15:58:56 -07:00
Andrew Sikowitz
edb82ad91f
docs(ingest/bigquery): Add docs for breaking change: match_fully_qualified_names (#9094) 2023-10-24 15:56:14 -07:00
RyanHolstien
60c1aab587
fix(frontend): update cookie module (#8862) 2023-10-17 15:50:32 -05:00
Sergio Gómez Villamor
245c5c0008
fix(ingest/looker): stop emitting tag owner (#8942) 2023-10-11 17:06:19 -07:00
Andrew Sikowitz
26bc039b96
fix(ingest/unity): Remove metastore from ingestion and urns; standardize platform instance; add notebook filter (#8943) 2023-10-05 23:23:15 -04:00
Harshal Sheth
a300b39f15
feat(ingest/airflow): airflow plugin v2 (#8853) 2023-10-04 16:23:15 +05:30
Mayuri Nehate
303a2d0863
build(ingest): upgrade to sqlalchemy 1.4, drop 1.3 support (#8810)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-09-12 11:30:24 -07:00
Indy Prentice
aee1e68f5d
docs(release): Update updating-datahub.md for 0.11.0 release (#8821)
Co-authored-by: Indy Prentice <indy@ip-192-168-3-10.us-west-2.compute.internal>
2023-09-11 15:33:03 -05:00
Andrew Sikowitz
22c35f1a23
fix(ingest/bigquery): Add config option to create DataPlatformInstance, default off (#8659) 2023-08-24 14:46:06 +05:30
alplatonov
11fdfcf956
Fix(ingestion/clickhouse) move to two tier sqlalchemy (#8300)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2023-08-11 16:11:40 -04:00
alplatonov
b58f9bb396
Feat(ingest/ldap)fix list index out of range error (#8525)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2023-08-09 13:13:27 -04:00
Maggie Hays
ab101bc49c
docs(updating): add details on Unified Search & Browse experience (#8568)
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2023-08-03 19:19:43 -07:00
mohdsiddique
6a36118b4f
feat(ingestion/snowflake): use user email-id in urn generation for top users stat (#8513)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
2023-08-03 08:30:50 +05:30
Indy Prentice
037ae14800
docs(release): Update updating-datahub.md for 0.10.5 release (#8557)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-08-03 08:30:12 +05:30
Harshal Sheth
eac003ccf4
feat(ingest): enable pipeline reporting by default (#8472) 2023-07-25 14:16:27 +05:30
Harshal Sheth
056d3619f0
feat(sdk): easily generate container urns (#8198)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-07-21 21:14:06 +00:00
Harshal Sheth
d733363bed
chore(ingest): drop bigquery-beta and snowflake-beta aliases (#8451) 2023-07-20 14:05:25 -04:00
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module (#8306) 2023-07-20 06:39:14 +05:30
Andrew Sikowitz
1f84bf5b2b
fix(ingest/sql-common): Fix profile_table_level_only (#8331)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-07 19:05:50 -04:00
Aseem Bansal
af6973ebe0
fix(ingest/okta): Set default of okta connector to match OIDC defaults (#8272) 2023-06-21 19:15:31 +05:30
Andrew Sikowitz
02bc71dd84
fix(ingest/okta): Set default of okta_profile_to_username_attr to email (#8263) 2023-06-21 13:38:59 +05:30
Shubham Jagtap
35a4434490
fix(sdk/dataflow): deprecate cluster and use env and platform_instance instead (#8201)
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-06-15 14:06:28 -07:00
Pedro Silva
b0f686b05f
chore(release): update datahub upgrade docs (#8228) 2023-06-15 16:38:01 +05:30
Indy Prentice
e14d7edd8a
Update updating-datahub.md for v0.10.3 release (#8139) 2023-05-26 13:01:08 -05:00
Chris Collins
366f518901
docs(): Update updating-datahub.md with breaking changes (#7964) 2023-05-23 13:13:22 -07:00
Harshal Sheth
afd65e16fb
feat(cli): delete cli v2 (#8068) 2023-05-23 14:43:44 -05:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits (#8051)
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
2023-05-17 00:01:57 -04:00
Harshal Sheth
bf86235e26
fix(ingest/unity): use fully qualified catalog/schema patterns (#7900) 2023-05-02 16:27:17 -07:00
RyanHolstien
0d5873db2a
feat(patch): patch support for flow info and job info and refactor patchbuilders for java sdk (#7495)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: David Leifker <david.leifker@acryl.io>
2023-04-13 15:46:35 -05:00
david-leifker
9b14c1800b
chore(security): removing unmaintained es7 upgrade proces (#7790) 2023-04-13 10:00:58 -05:00
Tamas Nemeth
0cc12bcce7
feat(ingest): redshift - Redshift rework (#6906) 2023-04-12 19:15:43 +02:00
cburroughs
cc0772f8d8
feat(ingest): unbundle airflow plugin emitter dependencies (#7493)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 09:07:42 -08:00
서재권(Data Platform)
3068e7f0b1
fix(ingest/oracle) add database name to oracle urn name (#7016) 2023-02-21 13:50:24 -05:00
Aseem Bansal
24dcdd05c5
docs(delete): cleanup removed option (#7335) 2023-02-14 17:25:21 +01:00
david-leifker
ce91c9dddb
docs(release notes): add helm notes for managed datahub v0.2.0 (#7311) 2023-02-10 20:21:53 +05:30
david-leifker
212ae1de85
docs(release): updating docs per release process (#7281) 2023-02-09 10:41:11 -06:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
Pedro Silva
5db3a1f1f8
fix(kafka-setup): Make topic name consistent with other images (#7103) 2023-01-24 10:48:23 -08:00
Aseem Bansal
6332038bb2
docs: add warning about clearing cookies for login (#7084) 2023-01-19 20:59:35 +05:30
Harshal Sheth
432feaa16d
feat(ingest): mark database_alias and env as deprecated (#6901) 2023-01-09 19:58:19 +05:30
Tamas Nemeth
ead0074169
deprecate(ingest): bigquery - Removing bigquery-legacy source (#6851)
Co-authored-by: John Joyce <john@acryl.io>
2022-12-29 13:19:05 -08:00
Harshal Sheth
667ca8632d
feat(ingest): avoid embedding serialized json in metadata files (#6742) 2022-12-28 19:28:38 -05:00
John Joyce
cc0b6019fb
chore(0.9.5): Bump defaults for release v0.9.5 (#6856) 2022-12-26 15:40:26 +05:30
Tamas Nemeth
a1970d2dce
feat(ingest/bigquery): add option to enable/disable legacy sharded table support (#6822)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
2022-12-20 23:29:46 -05:00