Harshal Sheth
1498c36875
chore(cli): drop support for python 3.7 ( #9731 )
2024-01-29 10:50:47 -08:00
Mayuri Nehate
f2e78db92e
feat(ingest/databricks): ingest hive metastore by default, more docs ( #9601 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-18 14:26:33 -08:00
david-leifker
296e41dfed
feat(docker): docker compose profiles updates ( #9514 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-03 15:58:50 -06:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 ( #9458 )
2023-12-15 13:28:33 -06:00
david-leifker
9899aca499
docs(updating-datahub): update docs for v0.12.1 ( #9441 )
2023-12-12 12:16:27 -06:00
Andrew Sikowitz
27f23ecdd5
feat(ingest/unity): GE Profiling ( #8951 )
2023-12-06 13:59:23 -05:00
Harshal Sheth
f9fd9467ef
feat(ingest): clean up DataHubRestEmitter return type ( #9286 )
...
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-11-30 21:00:43 -05:00
Harshal Sheth
a7dc9c9d22
feat(sdk): autogenerate urn types ( #9257 )
2023-11-30 18:11:36 -05:00
Mayuri Nehate
08fb730676
fix(ingest): drop deprecated database_alias from sql sources ( #9299 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-28 15:49:49 -05:00
RyanHolstien
a62d52e6b1
feat(mysql): upgrade to version 8.2 for quickstart ( #9241 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-22 13:54:12 -06:00
Harshal Sheth
9d41a8f9f0
fix(ingest): drop redshift-legacy and redshift-usage-legacy sources ( #9244 )
2023-11-16 13:33:35 -05:00
Andrew Sikowitz
78abeb9beb
feat(ingest/unity): Support specifying catalogs directly; pass env correctly ( #9110 )
2023-11-16 12:41:12 -05:00
Xuelei Li
179f103412
fix(metadata-io): in Neo4j service use proper algorithm to get lineage ( #8687 )
...
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-10 10:58:38 -06:00
Pedro Silva
300cea373d
docs: Update updating-datahub.md ( #9131 )
2023-10-30 13:50:42 -07:00
Andrew Sikowitz
6c932e8afe
feat(ingest/bigquery): Attempt to support raw dataset pattern ( #9109 )
2023-10-25 13:17:09 -07:00
siddiquebagwan-gslab
b612545220
feat(ingestion/redshift): support auto_incremental_lineage ( #9010 )
2023-10-25 15:26:06 +05:30
skrydal
fe18532b29
docs(update): Added info on breaking change for policies ( #9093 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-10-24 15:58:56 -07:00
Andrew Sikowitz
edb82ad91f
docs(ingest/bigquery): Add docs for breaking change: match_fully_qualified_names ( #9094 )
2023-10-24 15:56:14 -07:00
RyanHolstien
60c1aab587
fix(frontend): update cookie module ( #8862 )
2023-10-17 15:50:32 -05:00
Sergio Gómez Villamor
245c5c0008
fix(ingest/looker): stop emitting tag owner ( #8942 )
2023-10-11 17:06:19 -07:00
Andrew Sikowitz
26bc039b96
fix(ingest/unity): Remove metastore from ingestion and urns; standardize platform instance; add notebook filter ( #8943 )
2023-10-05 23:23:15 -04:00
Harshal Sheth
a300b39f15
feat(ingest/airflow): airflow plugin v2 ( #8853 )
2023-10-04 16:23:15 +05:30
Mayuri Nehate
303a2d0863
build(ingest): upgrade to sqlalchemy 1.4, drop 1.3 support ( #8810 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-09-12 11:30:24 -07:00
Indy Prentice
aee1e68f5d
docs(release): Update updating-datahub.md for 0.11.0 release ( #8821 )
...
Co-authored-by: Indy Prentice <indy@ip-192-168-3-10.us-west-2.compute.internal>
2023-09-11 15:33:03 -05:00
Andrew Sikowitz
22c35f1a23
fix(ingest/bigquery): Add config option to create DataPlatformInstance, default off ( #8659 )
2023-08-24 14:46:06 +05:30
alplatonov
11fdfcf956
Fix(ingestion/clickhouse) move to two tier sqlalchemy ( #8300 )
...
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2023-08-11 16:11:40 -04:00
alplatonov
b58f9bb396
Feat(ingest/ldap)fix list index out of range error ( #8525 )
...
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2023-08-09 13:13:27 -04:00
Maggie Hays
ab101bc49c
docs(updating): add details on Unified Search & Browse experience ( #8568 )
...
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2023-08-03 19:19:43 -07:00
mohdsiddique
6a36118b4f
feat(ingestion/snowflake): use user email-id in urn generation for top users stat ( #8513 )
...
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
2023-08-03 08:30:50 +05:30
Indy Prentice
037ae14800
docs(release): Update updating-datahub.md for 0.10.5 release ( #8557 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-08-03 08:30:12 +05:30
Harshal Sheth
eac003ccf4
feat(ingest): enable pipeline reporting by default ( #8472 )
2023-07-25 14:16:27 +05:30
Harshal Sheth
056d3619f0
feat(sdk): easily generate container urns ( #8198 )
...
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-07-21 21:14:06 +00:00
Harshal Sheth
d733363bed
chore(ingest): drop bigquery-beta and snowflake-beta aliases ( #8451 )
2023-07-20 14:05:25 -04:00
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module ( #8306 )
2023-07-20 06:39:14 +05:30
Andrew Sikowitz
1f84bf5b2b
fix(ingest/sql-common): Fix profile_table_level_only ( #8331 )
...
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-07 19:05:50 -04:00
Aseem Bansal
af6973ebe0
fix(ingest/okta): Set default of okta connector to match OIDC defaults ( #8272 )
2023-06-21 19:15:31 +05:30
Andrew Sikowitz
02bc71dd84
fix(ingest/okta): Set default of okta_profile_to_username_attr to email ( #8263 )
2023-06-21 13:38:59 +05:30
Shubham Jagtap
35a4434490
fix(sdk/dataflow): deprecate cluster and use env and platform_instance instead ( #8201 )
...
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-06-15 14:06:28 -07:00
Pedro Silva
b0f686b05f
chore(release): update datahub upgrade docs ( #8228 )
2023-06-15 16:38:01 +05:30
Indy Prentice
e14d7edd8a
Update updating-datahub.md for v0.10.3 release ( #8139 )
2023-05-26 13:01:08 -05:00
Chris Collins
366f518901
docs(): Update updating-datahub.md with breaking changes ( #7964 )
2023-05-23 13:13:22 -07:00
Harshal Sheth
afd65e16fb
feat(cli): delete cli v2 ( #8068 )
2023-05-23 14:43:44 -05:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits ( #8051 )
...
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
2023-05-17 00:01:57 -04:00
Harshal Sheth
bf86235e26
fix(ingest/unity): use fully qualified catalog/schema patterns ( #7900 )
2023-05-02 16:27:17 -07:00
RyanHolstien
0d5873db2a
feat(patch): patch support for flow info and job info and refactor patchbuilders for java sdk ( #7495 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: David Leifker <david.leifker@acryl.io>
2023-04-13 15:46:35 -05:00
david-leifker
9b14c1800b
chore(security): removing unmaintained es7 upgrade proces ( #7790 )
2023-04-13 10:00:58 -05:00
Tamas Nemeth
0cc12bcce7
feat(ingest): redshift - Redshift rework ( #6906 )
2023-04-12 19:15:43 +02:00
cburroughs
cc0772f8d8
feat(ingest): unbundle airflow plugin emitter dependencies ( #7493 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-07 09:07:42 -08:00
서재권(Data Platform)
3068e7f0b1
fix(ingest/oracle) add database name to oracle urn name ( #7016 )
2023-02-21 13:50:24 -05:00
Aseem Bansal
24dcdd05c5
docs(delete): cleanup removed option ( #7335 )
2023-02-14 17:25:21 +01:00
