1604 Commits

Author SHA1 Message Date
Aseem Bansal
d1494c2252
dev: upgrade ruff, remove 2 ruff ignore rules (#12702) 2025-02-24 14:07:57 +05:30
Harshal Sheth
9759a58d04
docs(ingest): add more details on SQL parser limitations (#12669) 2025-02-21 16:16:07 -08:00
Mayuri Nehate
fbed37b374
fix(ingest/snowflake): update logic to identify hybrid tables (#12672) 2025-02-20 11:23:57 +05:30
ttekampe
27e72782b9
fix(mssql): correctly split stored procs SQL (#12618)
Co-authored-by: Tobias Tekampe <tobias.tekampe@movingdots.com>
2025-02-18 12:09:06 -08:00
Gabe Lyons
401a1fb731
[BREAKING CHANGE] fix(openapi): fixing openapi nesting (#12580) 2025-02-18 06:05:54 -08:00
Harshal Sheth
dce21bac1e
feat(sdk): add/remove methods + other small improvements (#12646) 2025-02-17 18:27:46 -08:00
Aseem Bansal
2ecd3bbab8
feat(cli): add extra pip and debug flag (#12621) 2025-02-17 16:03:07 +05:30
mihai103
dcf1576c30
fix(tableau): skip ingesting filtered project assets (#12591)
Co-authored-by: Mihai Ciocirdel <mihai.ciocirdel@swisscom.com>
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-02-14 09:25:37 +01:00
Harshal Sheth
79f844b208
chore(py): add unused-noqa lint rule (#12615) 2025-02-13 08:28:48 -08:00
Sergio Gómez Villamor
b20211536c
feat(okta): adds ingest_groups_users config parameter (#12371)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-02-13 12:00:07 +01:00
Mayuri Nehate
e2a98d217e
fix(ingest): pick topics from config for sink connector (#12535) 2025-02-13 12:57:06 +05:30
Harshal Sheth
7472c535d3
feat(ci): add pytest hooks for updating golden files (#12581) 2025-02-12 15:32:31 -08:00
Serhii Dimchenko
20409fd702
feat(ingestion/dbt): Add include_database_name parameter for dbt core (#12411) 2025-02-11 10:42:14 +01:00
Mayuri Nehate
2323affde1
feat(ingest): add display name for dynamodb tables (#12534) 2025-02-10 17:54:56 +05:30
Harshal Sheth
32c62e5a8d
feat(ingest/mssql): improve stored procedure splitting (#12563) 2025-02-07 15:49:14 -08:00
Harshal Sheth
7c1954237f
fix(sdk): fix platform instance generation in the sdk (#12573) 2025-02-07 08:21:56 -08:00
Mayuri Nehate
180087f992
fix(ingest): remove duplicate mcps,more typing (#12557) 2025-02-07 14:21:31 +05:30
Harshal Sheth
4448fc24b7
feat(sdk): add scaffolding for sdk v2 (#12554) 2025-02-06 11:17:21 -08:00
Jaesung Ryu
06bee0d7c0
feat(ingest/mongodb) re-order aggregation logic (#12428)
Co-authored-by: Kade Ryu <kade@wrtn.io>
2025-02-05 11:25:09 -08:00
Austin SeungJun Park
5ed4b5bce9
feat(ingest/s3): ignore depth mismatched path (#12326) 2025-02-05 11:19:44 -08:00
Sergio Gómez Villamor
32b654ce20
feat(powerbi): Report to Dashboard lineage (#12451) 2025-02-05 11:27:48 +01:00
Brock Griffey
ac13f255e6
feat(ingestion/snowflake):adds streams as a new dataset with lineage and properties. (#12318)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2025-02-05 10:48:37 +05:30
Sergio Gómez Villamor
6cb51916ef
tests(kafka-connect): fixes integration tests setup (#12531) 2025-02-04 12:41:13 +01:00
Sergio Gómez Villamor
64aaaf126f
fix(model): fixes DashboardContainsDashboard relationship in DashboardInfo aspect (#12433) 2025-02-03 11:33:25 +01:00
Sergio Gómez Villamor
a7598ca20e
fix(mssql): adds missing containers and browsepathsv2 for dataflow and datajob (#12483) 2025-01-31 09:52:26 +01:00
Tamas Nemeth
4dc9bfcde7
fix(ingest/snowflake): Create all structured propery templates before assignation (#12469) 2025-01-30 13:49:20 -08:00
Andrew Sikowitz
aaaa655c21
feat(dataProcessInstance): Support data process instance entity page and lineage (#12499) 2025-01-30 00:39:56 -08:00
Shirshanka Das
ffce018cea
feat(sdk): data process instance - container, subtype, dataplatformin… (#12476) 2025-01-29 17:53:34 -08:00
Tamas Nemeth
22e012a209
feat(ingestion/airflow): Add support for mutiple datahub emitter (#12398) 2025-01-29 16:44:31 +01:00
sagar-salvi-apptware
563656c4d5
feat(ingestion/lookml): resolve access notation for LookML Constant (#12277)
Co-authored-by: Siddique Bagwan <siddique.bagwan@acryl.io>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2025-01-28 12:25:45 +05:30
sagar-salvi-apptware
3e9e6e4fe0
fix(lookml/ingestion): Skip unreferenced or improperly loaded Lookml view files (#12351) 2025-01-27 15:37:31 +05:30
Harshal Sheth
a8d6c54965
feat(sdk): move version info to dedicated file (#12456) 2025-01-24 11:35:39 -08:00
Mayuri Nehate
0f538d8df2
fix(ingest): fix reporting for missing secure view lineage (#12430)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-01-24 14:51:52 +05:30
Sergio Gómez Villamor
3471857893
refactor(powerbi): dashboards, reports and independent_datasets accessed by id (#12431) 2025-01-23 08:41:46 +01:00
Harshal Sheth
282395dc4a
feat(sdk): support qualified urn names in simple urn constructors (#12426)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-01-22 13:46:24 -08:00
Harshal Sheth
aff3faed4f
feat(sdk): add ContainerKey.parent_key method (#12423) 2025-01-22 12:44:44 -08:00
Harshal Sheth
ac44f4a063
feat(ingest/mssql): populate dataTransformLogic aspect for stored procs (#12244) 2025-01-22 12:29:09 -08:00
Austin SeungJun Park
3668dfc22c
refactor(ingest/s3): use groupby_unsorted (#12412) 2025-01-21 21:53:09 -08:00
Sergio Gómez Villamor
4b79e7525f
fix(ingestion): groupby_unsorted (#12403) 2025-01-21 09:44:19 +01:00
josges
7ac6523b2d
fix(ingestion): fix stateful ingestion for GCS source (#11879) 2025-01-20 19:37:12 +05:30
Tamas Nemeth
7eab2eb8d9
fix(ingest/fivetran): Add way to not add schema to the destination/source urn. (#12314) 2025-01-20 13:38:12 +01:00
Aseem Bansal
262dd76518
dev: remove black in favor of ruff for formatting (#12378) 2025-01-18 15:06:20 +05:30
Harshal Sheth
f06ad1a1d5
fix(ingest): simplify + fix ruff config (#12382) 2025-01-18 05:58:12 +05:30
Harshal Sheth
d397b1368b
feat(ingest): add strict_env_syntax mode to config loader (#12380) 2025-01-17 14:26:00 -08:00
Aseem Bansal
76e46b89db
dev(ingest): move modules from isort,flake8 to ruff (#12373) 2025-01-17 21:38:29 +05:30
Sergio Gómez Villamor
b7b541ca7d
feat(tableau): fine-grained page size (#12354) 2025-01-16 16:43:46 +01:00
Tamas Nemeth
0392a22d9d
fix(ingest/tableau): Fix TableauUpstream create check (#12320) 2025-01-16 14:14:24 +01:00
Aseem Bansal
765bf80282
dev(ingest): move from isort to ruff (#12364) 2025-01-16 16:48:21 +05:30
Sergio Gómez Villamor
d99b97a413
chore(tableau): metrics to understand pagination in get_connection_objects queries (#12329) 2025-01-16 10:14:33 +01:00
Aseem Bansal
2226820ad1
dev(ingest): use ruff instead of flake8 (#12359) 2025-01-16 08:19:07 +05:30