3089 Commits

Author SHA1 Message Date
cccs-cat001
bc09b28a64
refactor(operation_config): change logging on is_profiling_enabled (#12416)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-01-29 21:56:35 -08:00
Shirshanka Das
ffce018cea
feat(sdk): data process instance - container, subtype, dataplatformin… (#12476) 2025-01-29 17:53:34 -08:00
Aseem Bansal
cc0d43f5a8
feat(ingest): add datahub apply source (#12482) 2025-01-29 21:37:17 +05:30
Tamas Nemeth
22e012a209
feat(ingestion/airflow): Add support for mutiple datahub emitter (#12398) 2025-01-29 16:44:31 +01:00
skrydal
79aa40f1e6
log(ingest/lookml): view file missing/parsing as warnings (#12448) 2025-01-28 17:36:24 +05:30
Sergio Gómez Villamor
7870b13490
feat(snowflake): set is_temp_table and is_allowed_table function for SqlParsingAggregator in SnowflakeV2Source (#12438) 2025-01-28 10:26:19 +01:00
sagar-salvi-apptware
563656c4d5
feat(ingestion/lookml): resolve access notation for LookML Constant (#12277)
Co-authored-by: Siddique Bagwan <siddique.bagwan@acryl.io>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2025-01-28 12:25:45 +05:30
Aseem Bansal
0c98cdce2e
fix(ingest/glue): add info in report (#12470) 2025-01-27 17:24:11 +05:30
sagar-salvi-apptware
3e9e6e4fe0
fix(lookml/ingestion): Skip unreferenced or improperly loaded Lookml view files (#12351) 2025-01-27 15:37:31 +05:30
Harshal Sheth
a8d6c54965
feat(sdk): move version info to dedicated file (#12456) 2025-01-24 11:35:39 -08:00
Mayuri Nehate
0f538d8df2
fix(ingest): fix reporting for missing secure view lineage (#12430)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-01-24 14:51:52 +05:30
Harshal Sheth
b701e0714e
fix(ingest/clickhouse): remove unused lineage_properties code path (#12442) 2025-01-24 14:12:48 +05:30
Harshal Sheth
f80d58d297
fix(cli): ignore prereleases when suggesting upgrades (#12424) 2025-01-24 14:12:33 +05:30
Aseem Bansal
f4c0927d11
fix(ingest/glue): add try catch (#12449) 2025-01-23 18:21:08 +05:30
Pedro Silva
3030f90aaf
fix(ingest/slack): Add retries (#12401) 2025-01-23 16:10:26 +05:30
Harshal Sheth
61ed94823b
fix(ingest): improve registry error message (#12440) 2025-01-23 14:45:32 +05:30
Aseem Bansal
8eda51eff0
feat(ingest(cli): add domain helper, add progressbar (#12436) 2025-01-23 14:29:25 +05:30
Sergio Gómez Villamor
3471857893
refactor(powerbi): dashboards, reports and independent_datasets accessed by id (#12431) 2025-01-23 08:41:46 +01:00
Harshal Sheth
5309ae0014
feat(sdk): improve docs + code clarity (#12422) 2025-01-22 16:21:46 -08:00
Harshal Sheth
aff3faed4f
feat(sdk): add ContainerKey.parent_key method (#12423) 2025-01-22 12:44:44 -08:00
Harshal Sheth
ac44f4a063
feat(ingest/mssql): populate dataTransformLogic aspect for stored procs (#12244) 2025-01-22 12:29:09 -08:00
Aseem Bansal
b75d3ed5dc
feat(cli): add container CLI to apply patches for tag, term, owner (#12418) 2025-01-22 20:41:00 +05:30
Sergio Gómez Villamor
96758e2eb6
fix(tableau): assert error on parent name (#12392)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-01-22 08:34:35 +01:00
Austin SeungJun Park
3668dfc22c
refactor(ingest/s3): use groupby_unsorted (#12412) 2025-01-21 21:53:09 -08:00
Sergio Gómez Villamor
4b79e7525f
fix(ingestion): groupby_unsorted (#12403) 2025-01-21 09:44:19 +01:00
Aseem Bansal
2109abdc1a
feat(cli/delete): add --urn-file option (#12247)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-01-20 22:32:43 +05:30
josges
7ac6523b2d
fix(ingestion): fix stateful ingestion for GCS source (#11879) 2025-01-20 19:37:12 +05:30
skrydal
68218768d3
fix(ingest/redshift): Fix query sequence duplication for serverless mode (#12353) 2025-01-20 14:43:12 +01:00
Tamas Nemeth
7eab2eb8d9
fix(ingest/fivetran): Add way to not add schema to the destination/source urn. (#12314) 2025-01-20 13:38:12 +01:00
Aseem Bansal
262dd76518
dev: remove black in favor of ruff for formatting (#12378) 2025-01-18 15:06:20 +05:30
Harshal Sheth
f06ad1a1d5
fix(ingest): simplify + fix ruff config (#12382) 2025-01-18 05:58:12 +05:30
Harshal Sheth
d397b1368b
feat(ingest): add strict_env_syntax mode to config loader (#12380) 2025-01-17 14:26:00 -08:00
Aseem Bansal
76e46b89db
dev(ingest): move modules from isort,flake8 to ruff (#12373) 2025-01-17 21:38:29 +05:30
Aseem Bansal
4de7f61d09
fix(ingest): log exception properly (#12372) 2025-01-17 21:38:16 +05:30
kevinkarchacryl
bfe975874d
fix(cli): list-source-runs added null checking (#12369) 2025-01-16 15:28:42 -05:00
Aseem Bansal
7eaadb03b6
fix(sdk): cleanup empty secret names (#12367) 2025-01-16 23:26:21 +05:30
Sergio Gómez Villamor
b7b541ca7d
feat(tableau): fine-grained page size (#12354) 2025-01-16 16:43:46 +01:00
Tamas Nemeth
0392a22d9d
fix(ingest/tableau): Fix TableauUpstream create check (#12320) 2025-01-16 14:14:24 +01:00
Aseem Bansal
18701b742c
feat(cli): for python > 3.11 log a warning (#12366) 2025-01-16 17:15:02 +05:30
Aseem Bansal
ad0fbd7835
fix(ingest/gc): infinite loop in getting soft deleted counts (#12363) 2025-01-16 16:49:23 +05:30
Aseem Bansal
35e8d310ba
fix(ingest/datahub): dataHubExecutionRequest default exclude (#12365) 2025-01-16 16:48:54 +05:30
Aseem Bansal
765bf80282
dev(ingest): move from isort to ruff (#12364) 2025-01-16 16:48:21 +05:30
Sergio Gómez Villamor
d99b97a413
chore(tableau): metrics to understand pagination in get_connection_objects queries (#12329) 2025-01-16 10:14:33 +01:00
Aseem Bansal
2226820ad1
dev(ingest): use ruff instead of flake8 (#12359) 2025-01-16 08:19:07 +05:30
Harshal Sheth
96cfa4662d
feat(ingest): add num_queries_used_in_lineage counter (#12336) 2025-01-15 14:58:47 -08:00
Harshal Sheth
32cbc7dd80
feat(sdk): support urn types in Urn.from_string (#12347) 2025-01-15 10:59:35 -08:00
Aseem Bansal
b015fd2024
fix(ingest/gc): fix logging (#12348) 2025-01-15 18:20:46 +05:30
kevinkarchacryl
e1d57e3f21
Super type dbt redshift (#12337) 2025-01-14 15:53:51 -05:00
Andrew Sikowitz
ebbadf65ad
feat(ingest/snowflake): Support ingesting snowflake tags as structured properties (#12285) 2025-01-14 01:50:14 -08:00
Harshal Sheth
e1532a7f51
fix(ingest): support async_flag properly in ingestProposalBatch (#12332) 2025-01-13 21:41:51 -08:00