3904 Commits

Author SHA1 Message Date
Tamas Nemeth
3ee82590cd
fix(ingest/redshift): Identify materialized views properly + fix connection args support (#9368) 2023-12-05 17:42:29 +01:00
Tamas Nemeth
d123b61747
feat(ingest/athena): Enable Athena view ingestion and view lineage (#9354) 2023-12-05 17:16:35 +01:00
Harshal Sheth
7517c77ffd
fix(ingest): resolve issue with caplog and asyncio (#9377) 2023-12-04 20:00:11 -05:00
Harshal Sheth
4ec3208918
feat(ingest): support stdin in datahub put (#9359) 2023-12-04 14:31:58 -05:00
Andrew Sikowitz
c0ef728868
fix(ingest/powerbi): Allow old parser to parse [db].[schema].[table] table references (#9360) 2023-12-04 13:21:42 -05:00
Jacob Middag
f7f25bdf4f
fix(ingest/bigquery): Fix format arguments for table lineage test (#9340) (#9341) 2023-12-04 14:20:46 +05:30
Aseem Bansal
3142efcad5
fix(migrate): connect with token without dry-run (#9317) 2023-12-01 14:55:26 +05:30
Harshal Sheth
82f375ded6
docs(ingest/lookml): clarify that ssh key has no passphrase (#9348) 2023-12-01 14:33:20 +05:30
Harshal Sheth
4d9eb12cba
feat(ingest/dbt): support custom ownership types in dbt meta (#9332) 2023-12-01 14:33:10 +05:30
Harshal Sheth
f9fd9467ef
feat(ingest): clean up DataHubRestEmitter return type (#9286)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-11-30 21:00:43 -05:00
Harshal Sheth
a8476ee657
fix(airflow): support inlet datajobs correctly in v1 plugin (#9331) 2023-11-30 18:34:48 -05:00
Harshal Sheth
a7dc9c9d22
feat(sdk): autogenerate urn types (#9257) 2023-11-30 18:11:36 -05:00
Harshal Sheth
efaf21d571
docs(ingest/looker): mark platform instance as a supported capability (#9347) 2023-11-30 14:21:44 +05:30
Tamas Nemeth
dd09f5e68f
doc(ingest/teradata): Adding Teradata to list of Integrations (#9336) 2023-11-29 18:56:26 -05:00
Harshal Sheth
863894b80a
feat(ingest/ldap): make ingestion robust to string departmentId (#9258) 2023-11-29 16:25:48 -05:00
Andrew Sikowitz
5e52e31fc9
fix(ingest/browse): Re-emit browse path v2 aspects to avoid race condition (#9227) 2023-11-29 14:56:30 -05:00
Harshal Sheth
4dd6738ae7
fix(ingest): bump pyhive to fix headers issue (#9328) 2023-11-29 10:25:33 +01:00
terratrue-daniel
ab10e6bc58
feat(ingest/mssql): enable TLS encryption for SQLServer using pytds (#9256) 2023-11-29 13:32:26 +05:30
Harshal Sheth
2031bd4de1
docs(ingest): update docs on adding stateful ingestion (#9327) 2023-11-28 18:31:56 -05:00
Adriano Vega Llobell
3d7962cf17
fix(ingest/sql): improve handling of views with dots in their names (#9183) 2023-11-28 17:58:42 -05:00
Mayuri Nehate
08fb730676
fix(ingest): drop deprecated database_alias from sql sources (#9299)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-28 15:49:49 -05:00
terratrue-daniel
ff9876f5a2
fix(ingest/mssql): Add MONEY and SMALLMONEY data types as Number (#9313) 2023-11-28 14:43:52 -05:00
Mayuri Nehate
a34fdfd8b7
fix(ingest/lookml): emit all views with same name and different file path (#9279) 2023-11-24 17:59:24 -05:00
Aseem Bansal
298b9becb0
fix(dbt-cloud): do not pass macros to sorting nodes (#9302)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-24 17:49:34 -05:00
Tamas Nemeth
5ccb30e810
fix(ingest/teradata): Teradata speed up changes (#9059)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-11-24 16:31:37 +01:00
Tamas Nemeth
f794a90515
fix(ingest/snowflake): Apply email filter on all usage metrics (#9269) 2023-11-23 09:45:25 +01:00
RyanHolstien
a62d52e6b1
feat(mysql): upgrade to version 8.2 for quickstart (#9241)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-22 13:54:12 -06:00
Tim
01874808af
fix(ingest/athena): detect decimal type correctly (#9270) 2023-11-20 16:57:48 +01:00
Hyejin Yoon
1ad4f961aa
feat: add ingestion overview pages (#9210) 2023-11-20 18:02:49 +09:00
Andrew Sikowitz
b778def10a
build(ingest/hive): Update thrift pin (#8964)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-16 17:19:25 -05:00
Andrew Sikowitz
5cb04981b2
test(ingest/unity): Update goldens (#9254) 2023-11-16 17:18:17 -05:00
Adriano Vega Llobell
d0fa5de9f0
fix(sql-parser): convert platform instance to lowercase when building table urns (#9181) 2023-11-16 13:58:49 -05:00
Harshal Sheth
417ffb12d8
feat(ingest): support advanced configs for aws (#9237) 2023-11-16 13:34:18 -05:00
Harshal Sheth
9d41a8f9f0
fix(ingest): drop redshift-legacy and redshift-usage-legacy sources (#9244) 2023-11-16 13:33:35 -05:00
Andrew Sikowitz
78abeb9beb
feat(ingest/unity): Support specifying catalogs directly; pass env correctly (#9110) 2023-11-16 12:41:12 -05:00
Pierre Guivarch
8475fc92b4
docs(ingest): fix typo in snowflake ingestion docs (#9239) 2023-11-14 21:42:13 -05:00
Harshal Sheth
ec13847f54
feat(airflow): make RUN_IN_THREAD configurable (#9226) 2023-11-14 14:25:26 -05:00
Tony Ouyang
cfeecd799d
feat(ingest/mongodb): support AWS DocumentDB for MongoDB (#9201) 2023-11-14 12:12:39 -05:00
Harshal Sheth
906a5b91a8
chore(ingest): cleanup various methods (#9221) 2023-11-13 21:51:11 -05:00
Harshal Sheth
19aa215068
feat(ingest/dbt): dbt column-level lineage (#8991) 2023-11-13 19:00:30 -05:00
david-leifker
ebd2e2312b
fix(datahub-ingestion): remove old jars, sync pyspark version (#9217) 2023-11-10 22:10:00 -06:00
Shubham Jagtap
a187127ac5
feat(ingestion): file-based state checkpoint provider (#9029) 2023-11-10 14:36:00 -08:00
Harshal Sheth
89dff8f7bd
chore(ingest): start working on pydantic v2 support (#9220) 2023-11-10 09:34:08 -08:00
Teppo Naakka
107713846f
fix(ingest/powerbi): use dataset workspace id as key for parent container (#8994) 2023-11-09 16:48:06 -08:00
Andrew Sikowitz
f73ecfdcbb
style(ingest/tableau): Rename tableau_constant to c (#9207) 2023-11-08 18:17:49 -05:00
Shubham Jagtap
e73e926999
feat(integration/fivetran): Fivetran connector integration (#9018)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-07 23:02:41 -08:00
Andrew Sikowitz
2c58c63780
fix(ingest/datahub-source): Order by version in memory (#9185) 2023-11-06 15:58:57 -05:00
Harshal Sheth
86d2b08d2b
docs(ingest): inherit capabilities from superclasses (#9174) 2023-11-06 15:58:07 -05:00
Harshal Sheth
02156662b5
docs(ingest): clarify adding source guide (#9161) 2023-11-06 12:47:07 -08:00
Harshal Sheth
148ad1ad9f
feat(ingest/looker): support emitting unused explores (#9159) 2023-11-02 09:44:35 -07:00