3904 Commits

Author SHA1 Message Date
Sergio Gómez Villamor
85d3a9d31d
feat(okta): custom properties for okta user (#12773) 2025-03-05 15:53:01 +01:00
Sergio Gómez Villamor
a0319af7db
fix(ingestion): fixes producing some URNs with reserved characters (#12772) 2025-03-05 14:25:20 +01:00
Sergio Gómez Villamor
aed2433c4c
fix: fixes mypy complaints about pkgresources (#12790) 2025-03-05 12:41:03 +01:00
Kevin Karch
f32798125b
feat(ingest): allowdenypattern for dashboard, chart, dataset in superset (#12782) 2025-03-04 17:59:42 -05:00
Peter Wang
9e7f48278a
feat(ingestion/superset): ownership info for charts, dashboards and datasets (#12750) 2025-03-04 12:28:24 -08:00
Chakru
be42e11bd2
dataset cli - add support for schema, round-tripping to yaml (#12764) 2025-03-04 10:17:51 -08:00
Harshal Sheth
6097820c81
feat(sdk): add support for institutional memory links (#12770) 2025-03-04 08:45:01 -08:00
Harshal Sheth
12eb0cd1a7
feat(sdk): add search client (#12754) 2025-03-03 10:05:26 -08:00
Harshal Sheth
a19eddeeb5
fix(ingest): support pydantic v2 in file-based lineage (#12723) 2025-03-01 17:54:50 -08:00
skrydal
3e1b20c727
feat(ingestion/iceberg): Several improvements to iceberg connector (#12744) 2025-03-01 01:30:07 +01:00
Harshal Sheth
f3b17d4d4c
feat(ingest): improve error messages for unknown metadata objects (#12745) 2025-02-28 12:36:58 -08:00
Harshal Sheth
61d4992cc9
chore(ci): avoid dep on confluent-kafka 2.8.1 (#12753) 2025-02-28 10:14:07 -08:00
Peter Wang
fc26c1cfb5
feat(ingestion/superset): superset dataset lineage for metadata ingestion (#12679)
Co-authored-by: Shuixi Li <llance@users.noreply.github.com>
Co-authored-by: Gabe Lyons <gabe.lyons@acryl.io>
2025-02-28 07:29:25 -08:00
Austin SeungJun Park
e65f133667
refactor(ingest/s3): enhance readability (#12686) 2025-02-28 14:19:46 +01:00
Aseem Bansal
9c3bd34995
dev: enable ruff rule (#12749) 2025-02-28 17:49:52 +05:30
Rajat Goel
c4e5a9e9c3
feat(ingest/metabase): API key support in Metabase source (#12711) 2025-02-28 11:01:07 +05:30
Aseem Bansal
0fc074b50a
dev: enable ruff rule (#12742) 2025-02-28 10:59:06 +05:30
Aseem Bansal
2101a50e83
dev: immutable args remove (#12735) 2025-02-27 15:38:47 +05:30
Chakru
e67bc813f2
fix(iceberg-cli): add missing filter for iceberg dataplatform 2025-02-27 11:03:33 +05:30
Harshal Sheth
8fefa3f956
docs: update slack link (#12731) 2025-02-26 11:17:31 -08:00
Harshal Sheth
a5af1a8b7e
fix(ingest): bump avro dep (#12729) 2025-02-26 09:24:38 -08:00
Rasnar
5f5e395c90
Fix platform instance support on Druid ingestion (#12716)
Co-authored-by: rasnar <11248833+Rasnar@users.noreply.github.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-26 08:36:06 +01:00
david-leifker
2396f0e23d
fix(urn-validation): additional test cases for urn validation (#12727) 2025-02-25 15:57:17 -06:00
Sergio Gómez Villamor
c980cbd8f2
tests(druid): integration tests for druid ingestion (#12717)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-02-25 08:08:45 +01:00
cccs-cat001
cb67726ab4
fix(ingest): handle groups in pattern_cleanup_ownership transformer (#12536) 2025-02-24 14:47:46 -08:00
Harshal Sheth
8dfd8fbbaf
feat(ingest): migrate Cassandra source to new SDK (#12695) 2025-02-24 11:57:51 -08:00
Aseem Bansal
d1494c2252
dev: upgrade ruff, remove 2 ruff ignore rules (#12702) 2025-02-24 14:07:57 +05:30
Harshal Sheth
389a404bf1
chore(ingest): bump sqlglot version to latest (#12696) 2025-02-22 11:35:43 -08:00
Harshal Sheth
9759a58d04
docs(ingest): add more details on SQL parser limitations (#12669) 2025-02-21 16:16:07 -08:00
Harshal Sheth
407b188759
fix(ingest): prevent interleaved writes in dead letter queue (#12688) 2025-02-21 16:10:36 -08:00
Hyejin Yoon
0e9ac144c3
fix: skip browsePathv2 generation for entities that do not support it (#12687) 2025-02-21 10:13:05 +09:00
Harshal Sheth
b840788a60
fix(ingest): ensure proper cleanup on pipeline init failure (#12680) 2025-02-20 12:34:17 -08:00
Aseem Bansal
effd4825f3
dev: reduce log in gradle commands (#12677) 2025-02-20 13:47:48 +05:30
dougbot01
7c492bc22f
fix(ingestion/oracle): add option for thick mode and oracle client library (#12596) (#12644)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-20 08:34:47 +01:00
Mayuri Nehate
fbed37b374
fix(ingest/snowflake): update logic to identify hybrid tables (#12672) 2025-02-20 11:23:57 +05:30
Tamas Nemeth
bed7cfb298
chore(ingest): Add Stateful ingestion support for the missing sources (#12665) 2025-02-19 15:10:52 +01:00
david-leifker
c31470762b
feat(ingestion-cli): enable ingest mcps from s3 (#12649) 2025-02-19 07:02:22 -06:00
Sergio Gómez Villamor
48f82a49e6
feat(bigquery): fetch bigquery dataset (datahub container) description (#12620) 2025-02-19 09:44:34 +01:00
ttekampe
27e72782b9
fix(mssql): correctly split stored procs SQL (#12618)
Co-authored-by: Tobias Tekampe <tobias.tekampe@movingdots.com>
2025-02-18 12:09:06 -08:00
Pedro Silva
3f492279aa
feat(validation): Disallow deleting system users (#12641) 2025-02-18 14:55:31 +00:00
Gabe Lyons
401a1fb731
[BREAKING CHANGE] fix(openapi): fixing openapi nesting (#12580) 2025-02-18 06:05:54 -08:00
Harshal Sheth
dce21bac1e
feat(sdk): add/remove methods + other small improvements (#12646) 2025-02-17 18:27:46 -08:00
Aseem Bansal
2ecd3bbab8
feat(cli): add extra pip and debug flag (#12621) 2025-02-17 16:03:07 +05:30
Aseem Bansal
71d1092b2e
fix(ingest/unity): add exception handling (#12639) 2025-02-17 15:46:30 +05:30
mihai103
dcf1576c30
fix(tableau): skip ingesting filtered project assets (#12591)
Co-authored-by: Mihai Ciocirdel <mihai.ciocirdel@swisscom.com>
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-14 09:25:37 +01:00
Harshal Sheth
dc4ea8ae48
fix(ingest/mode): tweak lineage warning message (#12616) 2025-02-13 10:47:44 -08:00
Harshal Sheth
79f844b208
chore(py): add unused-noqa lint rule (#12615) 2025-02-13 08:28:48 -08:00
Sergio Gómez Villamor
b20211536c
feat(okta): adds ingest_groups_users config parameter (#12371)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-02-13 12:00:07 +01:00
Mayuri Nehate
e2a98d217e
fix(ingest): pick topics from config for sink connector (#12535) 2025-02-13 12:57:06 +05:30
Harshal Sheth
7472c535d3
feat(ci): add pytest hooks for updating golden files (#12581) 2025-02-12 15:32:31 -08:00