3089 Commits

Author SHA1 Message Date
Aseem Bansal
e00d7f172d
feat(ingest/cli): optionally show server config (#10676) 2024-06-12 10:34:22 -07:00
Harshal Sheth
894e25680b
feat(ingest): add snowflake-summary source (#10642) 2024-06-12 10:04:22 -07:00
Harshal Sheth
3a72d92493
feat(ingest/dbt): include package_name in dbt custom props (#10652) 2024-06-12 15:07:42 +02:00
Harshal Sheth
5da77df75d
feat(ingest/airflow): fix materialize_iolets bug (#10613) 2024-06-12 15:07:00 +02:00
Aseem Bansal
9307ec0580
feat(cli/data product): add support for institutional memory (#10686) 2024-06-12 17:51:51 +05:30
Chris Collins
22fac3a811
feat(cli): add actors to forms yaml API (#10683) 2024-06-12 13:05:18 +05:30
Harshal Sheth
1d4977cbb7
feat(ingest): make query formatting more robust (#10678) 2024-06-12 12:27:36 +05:30
Shubham Jagtap
05aee03f3f
perf(ingestion/fivetran): Connector performance optimization (#10556) 2024-06-11 20:19:57 -07:00
Davi Arnaut
52ac3143a4
fix(azure_ad): fix infinite loop on request error (#10679) 2024-06-11 13:41:36 -07:00
skrydal
b9e71a61b1
feat(ingest/glue): database parameters extraction (#10665) 2024-06-11 11:50:46 -07:00
Andrew Sikowitz
46dbb10940
docs(ingest): Rename csv / s3 / file source and sink (#10675) 2024-06-11 11:44:13 -07:00
Davi Arnaut
e123c25d82
fix(azure_ad): print request URL on error (#10677) 2024-06-11 10:19:04 -07:00
aabharti-visa
8a905774f7
feat(ingestion/kafka)-Add support for ingesting schemas from schema registry (#10612) 2024-06-11 14:00:12 +02:00
Aseem Bansal
6fdf2f7354
fix(ingest/qlik): improve logging for debug (#10659) 2024-06-07 17:50:49 +05:30
Harshal Sheth
e62e4b18c0
fix(ingest/snowflake): avoid overfetching schemas from datahub (#10527) 2024-06-06 15:54:32 -07:00
Aseem Bansal
3b8cda61e4
fix(ingest/trino): variable reference before define (#10646) 2024-06-06 21:16:43 +05:30
Harshal Sheth
e842161849
feat(ingest): add fast query fingerprinting (#10619) 2024-06-05 13:47:44 -07:00
Tamas Nemeth
d569ca17f1
feat(ingest/redshift): Adding way to filter s3 paths in Redshift Source (#10622) 2024-06-04 22:08:22 +02:00
Eric L (CCCS)
c04b3bc2e4
fix(ingest/iceberg): update iceberg source to support newer versions of pyiceberg at runtime (#10614) 2024-06-04 09:45:29 -07:00
Harshal Sheth
fcab544f17
feat(ingest): measure sink bottlenecking (#10628) 2024-06-04 09:06:48 -07:00
k7ragav
6394beff97
feat(ingest/looker): add ownership info to independent looks (#10624) 2024-06-03 09:37:22 -07:00
Chris Collins
1cfcb80372
feat(cli) Delete form references when using delete CLI (#10629) 2024-06-03 10:40:28 -04:00
noggi
b542143901
Add support for runAssertion, runAssertions, and runAssertionsForAsset APIs (#10605) 2024-05-31 14:23:34 -07:00
Mayuri Nehate
81b655c82d
feat(open assertion spec): MVP for Snowflake DMF Assertions: update models, add assertions cli with snowflake integration (#10602) 2024-05-31 12:03:22 -07:00
Harshal Sheth
648fd459eb
fix(ingest): move status aspect fixer logic (#10591) 2024-05-29 17:27:39 -07:00
Harshal Sheth
012930a513
fix(ingest/snowflake): make test connection logs less noisy (#10587) 2024-05-29 17:22:52 -07:00
Harshal Sheth
db965d61ea
fix(ingest/dbt): only generate one subtype (#10615) 2024-05-29 17:11:34 -07:00
Harshal Sheth
37bc423b50
feat(ingest): enable stateful ingestion safety threshold (#10516) 2024-05-29 12:01:04 -07:00
Harshal Sheth
e873104b80
feat(ingest): fetch connections from the backend (#10511) 2024-05-29 10:32:29 -07:00
Harshal Sheth
81ddfa1032
fix(ingest/sagemaker): remove unsupported config (#10606) 2024-05-28 13:42:54 -07:00
John Claro
776e5c440f
fix(ingest/snowflake): handle column level lineage for dbt temporary tables (#10258)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-05-28 20:05:09 +05:30
Tony Ouyang
a5515c5d47
feat(ingestion/SageMaker): Remove deprecated apis and add stateful ingestion capability (#10573) 2024-05-28 12:16:28 +02:00
Paul Rogalinski-Pinter
1c1450e1d8
fix(ingest/metabase): Fix for query template expressions and invalid URNs for Text Cards (#10381)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-05-24 11:35:29 -07:00
Oleksandr Baltian
c308a6ff45
fix(ingest): DataProcessInstance.emit_process_end() ignored start_timestamp_millis (#10539) 2024-05-24 11:34:00 -07:00
Harshal Sheth
2e14f70864
test(ingest/sql): refactor CLL generator + add tests (#10580) 2024-05-23 18:11:22 -07:00
Tamas Nemeth
e79bdc0099
fix(ingest): Remove env deprecation message (#10581) 2024-05-23 15:12:40 -07:00
Harshal Sheth
1544a604b7
fix(ingest/slack): pull real names (#10565)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2024-05-23 12:10:27 -07:00
sid-acryl
e361d28309
feat(ingestion/looker): ingest explore tags into the DataHub (#10547) 2024-05-23 18:36:43 +05:30
dushayntAW
92780e607c
fix(ingest/unity-catalog) upstream lineage for hive_metastore external table with s3 location (#10546) 2024-05-23 18:34:56 +05:30
Harshal Sheth
7a519ac73c
fix(ingest/dbt): resolve more dbt ephemeral node lineage gaps (#10553) 2024-05-22 12:44:54 -07:00
sid-acryl
666de9e4e6
fix(ingestion/powerbi): Databricks support for table lineage (#10416) 2024-05-22 18:57:45 +05:30
Tamas Nemeth
f831518328
fix(ingest/mode): Adding Dashboards into containers (#10563) 2024-05-22 07:38:57 +02:00
Harshal Sheth
b8023a93a4
refactor(ingest): defer ctx.graph initialization (#10504) 2024-05-21 17:01:35 -07:00
Harshal Sheth
f2b5875632
feat(ingest): auto-fix duplicate schema fieldPaths (#10526) 2024-05-22 00:03:08 +02:00
Harshal Sheth
187ef12182
fix(ingest/dbt): improve handling for CLL via ephemeral nodes (#10535) 2024-05-20 13:33:25 -07:00
sid-acryl
40d2ae3b78
fix(ingestion/powerbi): handle special character #(tab) in native query parsing (#10520) 2024-05-20 15:20:39 +05:30
Marcin Szymański
ebdcc25b72
fix(ingestion/snowflake): fix dataclass defaults for SnowflakeReport (#10529) 2024-05-17 12:07:35 -07:00
Sergio Gómez Villamor
0059960720
feat(ingestion/glue): delta schemas (#10299)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-05-17 14:21:35 +02:00
Harshal Sheth
3d5735cbc5
chore(ingest): run pyupgrade for python 3.8 (#10513) 2024-05-15 22:31:05 -07:00
Harshal Sheth
bc9250c904
fix(ingest): fix bug in incremental lineage (#10515) 2024-05-15 22:30:47 -07:00