3985 Commits

Author SHA1 Message Date
Harshal Sheth
8fefa3f956
docs: update slack link (#12731) 2025-02-26 11:17:31 -08:00
Harshal Sheth
a5af1a8b7e
fix(ingest): bump avro dep (#12729) 2025-02-26 09:24:38 -08:00
Rasnar
5f5e395c90
Fix platform instance support on Druid ingestion (#12716)
Co-authored-by: rasnar <11248833+Rasnar@users.noreply.github.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-26 08:36:06 +01:00
david-leifker
2396f0e23d
fix(urn-validation): additional test cases for urn validation (#12727) 2025-02-25 15:57:17 -06:00
Sergio Gómez Villamor
c980cbd8f2
tests(druid): integration tests for druid ingestion (#12717)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-02-25 08:08:45 +01:00
cccs-cat001
cb67726ab4
fix(ingest): handle groups in pattern_cleanup_ownership transformer (#12536) 2025-02-24 14:47:46 -08:00
Harshal Sheth
8dfd8fbbaf
feat(ingest): migrate Cassandra source to new SDK (#12695) 2025-02-24 11:57:51 -08:00
Aseem Bansal
d1494c2252
dev: upgrade ruff, remove 2 ruff ignore rules (#12702) 2025-02-24 14:07:57 +05:30
Harshal Sheth
389a404bf1
chore(ingest): bump sqlglot version to latest (#12696) 2025-02-22 11:35:43 -08:00
Harshal Sheth
9759a58d04
docs(ingest): add more details on SQL parser limitations (#12669) 2025-02-21 16:16:07 -08:00
Harshal Sheth
407b188759
fix(ingest): prevent interleaved writes in dead letter queue (#12688) 2025-02-21 16:10:36 -08:00
Hyejin Yoon
0e9ac144c3
fix: skip browsePathv2 generation for entities that do not support it (#12687) 2025-02-21 10:13:05 +09:00
Harshal Sheth
b840788a60
fix(ingest): ensure proper cleanup on pipeline init failure (#12680) 2025-02-20 12:34:17 -08:00
Aseem Bansal
effd4825f3
dev: reduce log in gradle commands (#12677) 2025-02-20 13:47:48 +05:30
dougbot01
7c492bc22f
fix(ingestion/oracle): add option for thick mode and oracle client library (#12596) (#12644)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-20 08:34:47 +01:00
Mayuri Nehate
fbed37b374
fix(ingest/snowflake): update logic to identify hybrid tables (#12672) 2025-02-20 11:23:57 +05:30
Tamas Nemeth
bed7cfb298
chore(ingest): Add Stateful ingestion support for the missing sources (#12665) 2025-02-19 15:10:52 +01:00
david-leifker
c31470762b
feat(ingestion-cli): enable ingest mcps from s3 (#12649) 2025-02-19 07:02:22 -06:00
Sergio Gómez Villamor
48f82a49e6
feat(bigquery): fetch bigquery dataset (datahub container) description (#12620) 2025-02-19 09:44:34 +01:00
ttekampe
27e72782b9
fix(mssql): correctly split stored procs SQL (#12618)
Co-authored-by: Tobias Tekampe <tobias.tekampe@movingdots.com>
2025-02-18 12:09:06 -08:00
Pedro Silva
3f492279aa
feat(validation): Disallow deleting system users (#12641) 2025-02-18 14:55:31 +00:00
Gabe Lyons
401a1fb731
[BREAKING CHANGE] fix(openapi): fixing openapi nesting (#12580) 2025-02-18 06:05:54 -08:00
Harshal Sheth
dce21bac1e
feat(sdk): add/remove methods + other small improvements (#12646) 2025-02-17 18:27:46 -08:00
Aseem Bansal
2ecd3bbab8
feat(cli): add extra pip and debug flag (#12621) 2025-02-17 16:03:07 +05:30
Aseem Bansal
71d1092b2e
fix(ingest/unity): add exception handling (#12639) 2025-02-17 15:46:30 +05:30
mihai103
dcf1576c30
fix(tableau): skip ingesting filtered project assets (#12591)
Co-authored-by: Mihai Ciocirdel <mihai.ciocirdel@swisscom.com>
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-14 09:25:37 +01:00
Harshal Sheth
dc4ea8ae48
fix(ingest/mode): tweak lineage warning message (#12616) 2025-02-13 10:47:44 -08:00
Harshal Sheth
79f844b208
chore(py): add unused-noqa lint rule (#12615) 2025-02-13 08:28:48 -08:00
Sergio Gómez Villamor
b20211536c
feat(okta): adds ingest_groups_users config parameter (#12371)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-02-13 12:00:07 +01:00
Mayuri Nehate
e2a98d217e
fix(ingest): pick topics from config for sink connector (#12535) 2025-02-13 12:57:06 +05:30
Harshal Sheth
7472c535d3
feat(ci): add pytest hooks for updating golden files (#12581) 2025-02-12 15:32:31 -08:00
Harshal Sheth
fe173faf84
fix(ingest/snowflake): order queries for queries_v2 (#12551) 2025-02-12 15:10:58 -08:00
Serhii Dimchenko
20409fd702
feat(ingestion/dbt): Add include_database_name parameter for dbt core (#12411) 2025-02-11 10:42:14 +01:00
Mayuri Nehate
2323affde1
feat(ingest): add display name for dynamodb tables (#12534) 2025-02-10 17:54:56 +05:30
Chakru
704526b8fa
fix(iceberg): delete associated platform resources when deleting warehouse (#12564) 2025-02-10 13:49:56 +05:30
Harshal Sheth
32c62e5a8d
feat(ingest/mssql): improve stored procedure splitting (#12563) 2025-02-07 15:49:14 -08:00
Brock Griffey
45c81233c9
fix(ingestion/teradata): teradata profiling fix for pooling (#12507) 2025-02-07 11:07:08 -08:00
Harshal Sheth
390a672b52
fix(looker): sort user mapping for consistency (#12569) 2025-02-07 10:51:23 -08:00
Harshal Sheth
7c1954237f
fix(sdk): fix platform instance generation in the sdk (#12573) 2025-02-07 08:21:56 -08:00
Mayuri Nehate
180087f992
fix(ingest): remove duplicate mcps,more typing (#12557) 2025-02-07 14:21:31 +05:30
Harshal Sheth
4448fc24b7
feat(sdk): add scaffolding for sdk v2 (#12554) 2025-02-06 11:17:21 -08:00
Jaesung Ryu
06bee0d7c0
feat(ingest/mongodb) re-order aggregation logic (#12428)
Co-authored-by: Kade Ryu <kade@wrtn.io>
2025-02-05 11:25:09 -08:00
Austin SeungJun Park
5ed4b5bce9
feat(ingest/s3): ignore depth mismatched path (#12326) 2025-02-05 11:19:44 -08:00
Sergio Gómez Villamor
32b654ce20
feat(powerbi): Report to Dashboard lineage (#12451) 2025-02-05 11:27:48 +01:00
Brock Griffey
ac13f255e6
feat(ingestion/snowflake):adds streams as a new dataset with lineage and properties. (#12318)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2025-02-05 10:48:37 +05:30
Chakru
7f6e3995d3
docs(iceberg): add iceberg user guide (#12533) 2025-02-05 00:57:56 +05:30
Andrew Sikowitz
b51327e0be
feat(versioning): Add V2 UI; make backend more synchronous; add to component library (#12542) 2025-02-04 09:57:41 -08:00
Aseem Bansal
d1e8a0a145
fix(ingest): use lossy collections (#12523) 2025-02-04 19:42:11 +05:30
Mayuri Nehate
808447db27
fix(ingest/unity): add row count in table profile of delta tables (#12480)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-04 19:19:06 +05:30
Sergio Gómez Villamor
6cb51916ef
tests(kafka-connect): fixes integration tests setup (#12531) 2025-02-04 12:41:13 +01:00