3975 Commits

Author SHA1 Message Date
skrydal
a495d652e0
feat(ingestion): Add typeUrn handling to ownership transformers (#9370) 2023-12-13 14:34:20 -05:00
김가윤
a92230b321
docs(ingest/tableau): add token to sink config in sample recipe (#9411)
Co-authored-by: KaYunKIM <kayunkim@ENCR22N10075.local>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-12-13 12:30:18 -05:00
Harshal Sheth
02982ed886
feat(ingest): add retries for tableau (#9437) 2023-12-12 18:38:21 +01:00
Harshal Sheth
66f90c7ffd
fix(ingest): avoid git dependency in dbt (#9447) 2023-12-12 18:32:59 +01:00
Tamas Nemeth
ffccc65561
fix(ingest/profiling) Fixing profile eligibility check (#9446) 2023-12-12 18:31:58 +01:00
Aseem Bansal
abbc4cdc57
fix(json-schema): do not send invalid URLs (#9417) 2023-12-12 17:26:29 +05:30
RyanHolstien
8a1122049c
feat(patch): support fine grained lineage patches (#9408)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-12-11 16:25:43 -06:00
Andrew Sikowitz
e4d8dcbc02
docs(ingest/sql-queries): Rearrange sections (#9426) 2023-12-11 09:43:23 -05:00
Aseem Bansal
cff32e9c74
fix(ingest/transformer): correct registration (#9418) 2023-12-08 16:07:00 -08:00
Harshal Sheth
08a9b9b6de
fix(ingest): bug fixes and docs updates (#9422) 2023-12-08 16:18:34 -05:00
Harshal Sheth
d52f0305eb
fix(ingest): fix metadata for custom python packages (#9391) 2023-12-08 13:13:49 -05:00
Teppo Naakka
0e40d38f4c
fix(ingest/powerbi): fix powerbi chart input handling (#9415) 2023-12-08 13:02:03 +01:00
Harshal Sheth
f03c66ca1f
fix(ingest/lookml): make deploy key optional (#9378) 2023-12-07 17:18:16 -05:00
Andrew Sikowitz
e3e9904d21
fix(ingest/profiling): Add back db_name to sql_generic_profiler methods (#9407) 2023-12-07 16:01:23 -05:00
Andrew Sikowitz
a6726c12dd
docs(ingest/sql-queries): Add documentation (#9406) 2023-12-07 17:03:37 +01:00
Matthias De Geyter
1b48877abe
fix(ingest/json-schema): take into account environment (#9385)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-12-07 14:54:02 +01:00
Andrew Sikowitz
16fe22aafa
feat(ui/last-updated): Calculate last updated time as max(properties time, operation time) (#9242) 2023-12-06 15:21:56 -05:00
Andrew Sikowitz
27f23ecdd5
feat(ingest/unity): GE Profiling (#8951) 2023-12-06 13:59:23 -05:00
Tamas Nemeth
2eee3332ea
fix(ingest/redshift): Fix psycopg2 removal from Redshift Source (#9395) 2023-12-06 12:18:24 +01:00
Aseem Bansal
a9c5c3903c
fix(ingest/redshift): too many values unpack (#9394) 2023-12-06 15:58:20 +05:30
Andrew Sikowitz
806f09ae23
test(ingest/unity): Unity catalog data generation (#8949) 2023-12-05 12:33:00 -05:00
Tamas Nemeth
3ee82590cd
fix(ingest/redshift): Identify materialized views properly + fix connection args support (#9368) 2023-12-05 17:42:29 +01:00
Tamas Nemeth
d123b61747
feat(ingest/athena): Enable Athena view ingestion and view lineage (#9354) 2023-12-05 17:16:35 +01:00
Harshal Sheth
7517c77ffd
fix(ingest): resolve issue with caplog and asyncio (#9377) 2023-12-04 20:00:11 -05:00
Harshal Sheth
4ec3208918
feat(ingest): support stdin in datahub put (#9359) 2023-12-04 14:31:58 -05:00
Andrew Sikowitz
c0ef728868
fix(ingest/powerbi): Allow old parser to parse [db].[schema].[table] table references (#9360) 2023-12-04 13:21:42 -05:00
Jacob Middag
f7f25bdf4f
fix(ingest/bigquery): Fix format arguments for table lineage test (#9340) (#9341) 2023-12-04 14:20:46 +05:30
Aseem Bansal
3142efcad5
fix(migrate): connect with token without dry-run (#9317) 2023-12-01 14:55:26 +05:30
Harshal Sheth
82f375ded6
docs(ingest/lookml): clarify that ssh key has no passphrase (#9348) 2023-12-01 14:33:20 +05:30
Harshal Sheth
4d9eb12cba
feat(ingest/dbt): support custom ownership types in dbt meta (#9332) 2023-12-01 14:33:10 +05:30
Harshal Sheth
f9fd9467ef
feat(ingest): clean up DataHubRestEmitter return type (#9286)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-11-30 21:00:43 -05:00
Harshal Sheth
a8476ee657
fix(airflow): support inlet datajobs correctly in v1 plugin (#9331) 2023-11-30 18:34:48 -05:00
Harshal Sheth
a7dc9c9d22
feat(sdk): autogenerate urn types (#9257) 2023-11-30 18:11:36 -05:00
Harshal Sheth
efaf21d571
docs(ingest/looker): mark platform instance as a supported capability (#9347) 2023-11-30 14:21:44 +05:30
Tamas Nemeth
dd09f5e68f
doc(ingest/teradata): Adding Teradata to list of Integrations (#9336) 2023-11-29 18:56:26 -05:00
Harshal Sheth
863894b80a
feat(ingest/ldap): make ingestion robust to string departmentId (#9258) 2023-11-29 16:25:48 -05:00
Andrew Sikowitz
5e52e31fc9
fix(ingest/browse): Re-emit browse path v2 aspects to avoid race condition (#9227) 2023-11-29 14:56:30 -05:00
Harshal Sheth
4dd6738ae7
fix(ingest): bump pyhive to fix headers issue (#9328) 2023-11-29 10:25:33 +01:00
terratrue-daniel
ab10e6bc58
feat(ingest/mssql): enable TLS encryption for SQLServer using pytds (#9256) 2023-11-29 13:32:26 +05:30
Harshal Sheth
2031bd4de1
docs(ingest): update docs on adding stateful ingestion (#9327) 2023-11-28 18:31:56 -05:00
Adriano Vega Llobell
3d7962cf17
fix(ingest/sql): improve handling of views with dots in their names (#9183) 2023-11-28 17:58:42 -05:00
Mayuri Nehate
08fb730676
fix(ingest): drop deprecated database_alias from sql sources (#9299)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-28 15:49:49 -05:00
terratrue-daniel
ff9876f5a2
fix(ingest/mssql): Add MONEY and SMALLMONEY data types as Number (#9313) 2023-11-28 14:43:52 -05:00
Mayuri Nehate
a34fdfd8b7
fix(ingest/lookml): emit all views with same name and different file path (#9279) 2023-11-24 17:59:24 -05:00
Aseem Bansal
298b9becb0
fix(dbt-cloud): do not pass macros to sorting nodes (#9302)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-24 17:49:34 -05:00
Tamas Nemeth
5ccb30e810
fix(ingest/teradata): Teradata speed up changes (#9059)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-11-24 16:31:37 +01:00
Tamas Nemeth
f794a90515
fix(ingest/snowflake): Apply email filter on all usage metrics (#9269) 2023-11-23 09:45:25 +01:00
RyanHolstien
a62d52e6b1
feat(mysql): upgrade to version 8.2 for quickstart (#9241)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-22 13:54:12 -06:00
Tim
01874808af
fix(ingest/athena): detect decimal type correctly (#9270) 2023-11-20 16:57:48 +01:00
Hyejin Yoon
1ad4f961aa
feat: add ingestion overview pages (#9210) 2023-11-20 18:02:49 +09:00