935 Commits

Author SHA1 Message Date
Harshal Sheth
79f844b208
chore(py): add unused-noqa lint rule (#12615) 2025-02-13 08:28:48 -08:00
Harshal Sheth
7472c535d3
feat(ci): add pytest hooks for updating golden files (#12581) 2025-02-12 15:32:31 -08:00
Serhii Dimchenko
20409fd702
feat(ingestion/dbt): Add include_database_name parameter for dbt core (#12411) 2025-02-11 10:42:14 +01:00
Harshal Sheth
32c62e5a8d
feat(ingest/mssql): improve stored procedure splitting (#12563) 2025-02-07 15:49:14 -08:00
Harshal Sheth
7c1954237f
fix(sdk): fix platform instance generation in the sdk (#12573) 2025-02-07 08:21:56 -08:00
Harshal Sheth
4448fc24b7
feat(sdk): add scaffolding for sdk v2 (#12554) 2025-02-06 11:17:21 -08:00
Austin SeungJun Park
5ed4b5bce9
feat(ingest/s3): ignore depth mismatched path (#12326) 2025-02-05 11:19:44 -08:00
Sergio Gómez Villamor
64aaaf126f
fix(model): fixes DashboardContainsDashboard relationship in DashboardInfo aspect (#12433) 2025-02-03 11:33:25 +01:00
Shirshanka Das
ffce018cea
feat(sdk): data process instance - container, subtype, dataplatformin… (#12476) 2025-01-29 17:53:34 -08:00
Tamas Nemeth
22e012a209
feat(ingestion/airflow): Add support for mutiple datahub emitter (#12398) 2025-01-29 16:44:31 +01:00
Harshal Sheth
a8d6c54965
feat(sdk): move version info to dedicated file (#12456) 2025-01-24 11:35:39 -08:00
Harshal Sheth
282395dc4a
feat(sdk): support qualified urn names in simple urn constructors (#12426)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-01-22 13:46:24 -08:00
Harshal Sheth
aff3faed4f
feat(sdk): add ContainerKey.parent_key method (#12423) 2025-01-22 12:44:44 -08:00
Austin SeungJun Park
3668dfc22c
refactor(ingest/s3): use groupby_unsorted (#12412) 2025-01-21 21:53:09 -08:00
Sergio Gómez Villamor
4b79e7525f
fix(ingestion): groupby_unsorted (#12403) 2025-01-21 09:44:19 +01:00
josges
7ac6523b2d
fix(ingestion): fix stateful ingestion for GCS source (#11879) 2025-01-20 19:37:12 +05:30
Aseem Bansal
262dd76518
dev: remove black in favor of ruff for formatting (#12378) 2025-01-18 15:06:20 +05:30
Harshal Sheth
f06ad1a1d5
fix(ingest): simplify + fix ruff config (#12382) 2025-01-18 05:58:12 +05:30
Harshal Sheth
d397b1368b
feat(ingest): add strict_env_syntax mode to config loader (#12380) 2025-01-17 14:26:00 -08:00
Sergio Gómez Villamor
b7b541ca7d
feat(tableau): fine-grained page size (#12354) 2025-01-16 16:43:46 +01:00
Tamas Nemeth
0392a22d9d
fix(ingest/tableau): Fix TableauUpstream create check (#12320) 2025-01-16 14:14:24 +01:00
Aseem Bansal
765bf80282
dev(ingest): move from isort to ruff (#12364) 2025-01-16 16:48:21 +05:30
Aseem Bansal
2226820ad1
dev(ingest): use ruff instead of flake8 (#12359) 2025-01-16 08:19:07 +05:30
Harshal Sheth
32cbc7dd80
feat(sdk): support urn types in Urn.from_string (#12347) 2025-01-15 10:59:35 -08:00
kevinkarchacryl
e1d57e3f21
Super type dbt redshift (#12337) 2025-01-14 15:53:51 -05:00
Harshal Sheth
244f35de5c
fix(ingest): tighten Source.create type annotations (#12325) 2025-01-13 12:55:57 -08:00
Harshal Sheth
5f63f3fba9
feat(sdk): support urns in other urn constructors (#12311) 2025-01-10 09:45:31 -08:00
Austin SeungJun Park
d8e7cb25e0
fix(ingestion/s3): groupby group-splitting issue (#12254)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-01-10 09:41:28 +01:00
Sergio Gómez Villamor
9d9a368dea
chore(tableau): set ingestion stage report and perftimers (#12234) 2025-01-09 19:04:37 +01:00
Shirshanka Das
45450f19a0
feat(sdk): structured properties - add support for listing (#12283) 2025-01-09 07:32:22 -08:00
Andrew Sikowitz
92f013e6e1
fix(ingest/file-backed-collections): Properly set _use_sqlite_on_conflict (#12297) 2025-01-08 11:40:02 -08:00
Aseem Bansal
a4c47fa343
fix(cli): correct url ending with acryl.io:8080 (#12289) 2025-01-08 19:46:57 +05:30
Harshal Sheth
afa94a5887
fix(ingest): better correctness on the emitter -> graph conversion (#12272) 2025-01-07 14:00:13 -08:00
Mayuri Nehate
fba09966f3
fix(ingest): consistent fingerprint for sql parsing aggregator (#12239) 2025-01-03 10:49:42 -08:00
Aseem Bansal
f9e2c49391
fix(ingest/gc): logging and stopping fix (#12266) 2025-01-03 22:15:52 +05:30
Sergio Gómez Villamor
1190dd95b2
fix(tableau): fixes some aspects being emitted multiple times (#12258) 2025-01-03 09:15:53 +01:00
Aseem Bansal
ea249caee1
fix(ingest): json serializable fix (#12246) 2025-01-01 16:52:17 +05:30
Jonny Dixon
554a37a551
fix(ingest/aws_common): update tests execution on EC2 instance (#12252) 2025-01-01 14:49:27 +05:30
Harshal Sheth
d0423547ba
feat(ingest): add parse_ts_millis helper (#12231) 2024-12-27 10:50:28 -08:00
Andrew Sikowitz
756b199506
fix(ingest/glue): Add additional checks and logging when specifying catalog_id (#12168) 2024-12-24 14:56:35 -08:00
Mayuri Nehate
4d990b06bd
fix(ingest/snowflake): always ingest view and external table ddl lineage (#12191) 2024-12-24 18:14:51 +05:30
Mayuri Nehate
d06980f6f3
fix(ingest/snowflake): handle empty snowflake column upstreams (#12207) 2024-12-23 13:41:40 +00:00
Jonny Dixon
95b9d1b4c9
feat(ingest/aws-common): improved instance profile support (#12139)
for ec2, ecs, eks, lambda, beanstalk, app runner and cft roles
2024-12-21 12:08:59 +05:30
skrydal
e52a4deba8
fix(ingest/databricks): Fix profiling (#12060) 2024-12-20 22:11:18 +05:30
skrydal
e45f548910
feat(ingest/iceberg): Improve iceberg connector (#12163) 2024-12-19 15:25:59 +00:00
sagar-salvi-apptware
2e544614f1
feat(ingest): add looker meta extractor support in sql parsing (#12062)
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-19 12:41:40 +05:30
Andrew Sikowitz
da8f822197
feat(ingest/mlflow): Support configurable base_external_url (#12167) 2024-12-18 14:36:10 -08:00
Harshal Sheth
76cfac3700
fix(cli/properties): allow structured properties without a graph instance (#12144)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2024-12-18 09:04:51 +00:00
Andrew Sikowitz
ff385edbb1
build(ingest/sqlglot): Bump pin to support snowflake CREATE ... WITH TAG (#12003) 2024-12-17 03:49:47 -08:00
Andrew Sikowitz
6b8d21a2ab
feat(ingest/sqlite): Support sqlite < 3.24.0 (#12137) 2024-12-16 12:50:25 -08:00