3975 Commits

Author SHA1 Message Date
Davi Arnaut
52ac3143a4
fix(azure_ad): fix infinite loop on request error (#10679) 2024-06-11 13:41:36 -07:00
skrydal
b9e71a61b1
feat(ingest/glue): database parameters extraction (#10665) 2024-06-11 11:50:46 -07:00
Andrew Sikowitz
46dbb10940
docs(ingest): Rename csv / s3 / file source and sink (#10675) 2024-06-11 11:44:13 -07:00
Davi Arnaut
e123c25d82
fix(azure_ad): print request URL on error (#10677) 2024-06-11 10:19:04 -07:00
aabharti-visa
8a905774f7
feat(ingestion/kafka)-Add support for ingesting schemas from schema registry (#10612) 2024-06-11 14:00:12 +02:00
sid-acryl
2c3943d723
fix(doc): Fix doc typo in transformer (#10658) 2024-06-07 09:16:28 -07:00
Aseem Bansal
6fdf2f7354
fix(ingest/qlik): improve logging for debug (#10659) 2024-06-07 17:50:49 +05:30
Harshal Sheth
e62e4b18c0
fix(ingest/snowflake): avoid overfetching schemas from datahub (#10527) 2024-06-06 15:54:32 -07:00
John Joyce
eda1db081b
docs(): Adding API docs for incidents, operations, and assertions (#10522)
Co-authored-by: John Joyce <john@Johns-MacBook-Pro.local>
Co-authored-by: John Joyce <john@ip-10-0-0-48.us-west-2.compute.internal>
Co-authored-by: John Joyce <john@Johns-MBP-432.lan>
Co-authored-by: John Joyce <john@ip-192-168-1-200.us-west-2.compute.internal>
Co-authored-by: John Joyce <john@Johns-MBP.lan>
2024-06-06 14:05:44 -07:00
Aseem Bansal
3b8cda61e4
fix(ingest/trino): variable reference before define (#10646) 2024-06-06 21:16:43 +05:30
dushayntAW
12455f95d7
doc(ingestion/airflow-plugin): update for developers (#10633) 2024-06-06 14:31:39 +05:30
Harshal Sheth
e842161849
feat(ingest): add fast query fingerprinting (#10619) 2024-06-05 13:47:44 -07:00
Woong Seok Kang
5b4fc9612f
docs(ingest): remove trailing comma on athena permission (#10634) 2024-06-04 21:59:43 -07:00
Tamas Nemeth
d569ca17f1
feat(ingest/redshift): Adding way to filter s3 paths in Redshift Source (#10622) 2024-06-04 22:08:22 +02:00
Eric L (CCCS)
c04b3bc2e4
fix(ingest/iceberg): update iceberg source to support newer versions of pyiceberg at runtime (#10614) 2024-06-04 09:45:29 -07:00
Harshal Sheth
fcab544f17
feat(ingest): measure sink bottlenecking (#10628) 2024-06-04 09:06:48 -07:00
RyanHolstien
8f40229da2
feat(lineage): change query structure for explored hop limit (#10607) 2024-06-03 16:34:44 -05:00
k7ragav
6394beff97
feat(ingest/looker): add ownership info to independent looks (#10624) 2024-06-03 09:37:22 -07:00
Chris Collins
1cfcb80372
feat(cli) Delete form references when using delete CLI (#10629) 2024-06-03 10:40:28 -04:00
noggi
b542143901
Add support for runAssertion, runAssertions, and runAssertionsForAsset APIs (#10605) 2024-05-31 14:23:34 -07:00
Mayuri Nehate
81b655c82d
feat(open assertion spec): MVP for Snowflake DMF Assertions: update models, add assertions cli with snowflake integration (#10602) 2024-05-31 12:03:22 -07:00
Harshal Sheth
648fd459eb
fix(ingest): move status aspect fixer logic (#10591) 2024-05-29 17:27:39 -07:00
Harshal Sheth
012930a513
fix(ingest/snowflake): make test connection logs less noisy (#10587) 2024-05-29 17:22:52 -07:00
Harshal Sheth
db965d61ea
fix(ingest/dbt): only generate one subtype (#10615) 2024-05-29 17:11:34 -07:00
Harshal Sheth
37bc423b50
feat(ingest): enable stateful ingestion safety threshold (#10516) 2024-05-29 12:01:04 -07:00
Harshal Sheth
e873104b80
feat(ingest): fetch connections from the backend (#10511) 2024-05-29 10:32:29 -07:00
Harshal Sheth
81ddfa1032
fix(ingest/sagemaker): remove unsupported config (#10606) 2024-05-28 13:42:54 -07:00
John Claro
776e5c440f
fix(ingest/snowflake): handle column level lineage for dbt temporary tables (#10258)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-05-28 20:05:09 +05:30
Tony Ouyang
a5515c5d47
feat(ingestion/SageMaker): Remove deprecated apis and add stateful ingestion capability (#10573) 2024-05-28 12:16:28 +02:00
Paul Rogalinski-Pinter
1c1450e1d8
fix(ingest/metabase): Fix for query template expressions and invalid URNs for Text Cards (#10381)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-05-24 11:35:29 -07:00
Oleksandr Baltian
c308a6ff45
fix(ingest): DataProcessInstance.emit_process_end() ignored start_timestamp_millis (#10539) 2024-05-24 11:34:00 -07:00
Harshal Sheth
2e14f70864
test(ingest/sql): refactor CLL generator + add tests (#10580) 2024-05-23 18:11:22 -07:00
Tamas Nemeth
e79bdc0099
fix(ingest): Remove env deprecation message (#10581) 2024-05-23 15:12:40 -07:00
Harshal Sheth
1544a604b7
fix(ingest/slack): pull real names (#10565)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2024-05-23 12:10:27 -07:00
sid-acryl
e361d28309
feat(ingestion/looker): ingest explore tags into the DataHub (#10547) 2024-05-23 18:36:43 +05:30
dushayntAW
92780e607c
fix(ingest/unity-catalog) upstream lineage for hive_metastore external table with s3 location (#10546) 2024-05-23 18:34:56 +05:30
Harshal Sheth
7a519ac73c
fix(ingest/dbt): resolve more dbt ephemeral node lineage gaps (#10553) 2024-05-22 12:44:54 -07:00
sid-acryl
666de9e4e6
fix(ingestion/powerbi): Databricks support for table lineage (#10416) 2024-05-22 18:57:45 +05:30
Hyejin Yoon
ad3b8f9b09
docs: improve lineage docs (#10396) 2024-05-22 15:25:49 +09:00
Hyejin Yoon
aaeeaa7ff5
feat: update lineage feature guide (#10401) 2024-05-22 15:18:33 +09:00
Tamas Nemeth
f831518328
fix(ingest/mode): Adding Dashboards into containers (#10563) 2024-05-22 07:38:57 +02:00
Harshal Sheth
b8023a93a4
refactor(ingest): defer ctx.graph initialization (#10504) 2024-05-21 17:01:35 -07:00
Harshal Sheth
f2b5875632
feat(ingest): auto-fix duplicate schema fieldPaths (#10526) 2024-05-22 00:03:08 +02:00
Harshal Sheth
2b6c78b776
feat(ingest): bump acryl-sqlglot dep (#10554) 2024-05-21 23:52:33 +02:00
Harshal Sheth
187ef12182
fix(ingest/dbt): improve handling for CLL via ephemeral nodes (#10535) 2024-05-20 13:33:25 -07:00
sid-acryl
40d2ae3b78
fix(ingestion/powerbi): handle special character #(tab) in native query parsing (#10520) 2024-05-20 15:20:39 +05:30
Marcin Szymański
ebdcc25b72
fix(ingestion/snowflake): fix dataclass defaults for SnowflakeReport (#10529) 2024-05-17 12:07:35 -07:00
Sergio Gómez Villamor
0059960720
feat(ingestion/glue): delta schemas (#10299)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-05-17 14:21:35 +02:00
Harshal Sheth
3d5735cbc5
chore(ingest): run pyupgrade for python 3.8 (#10513) 2024-05-15 22:31:05 -07:00
Harshal Sheth
bc9250c904
fix(ingest): fix bug in incremental lineage (#10515) 2024-05-15 22:30:47 -07:00