1604 Commits

Author SHA1 Message Date
Harshal Sheth
32cbc7dd80
feat(sdk): support urn types in Urn.from_string (#12347) 2025-01-15 10:59:35 -08:00
kevinkarchacryl
e1d57e3f21
Super type dbt redshift (#12337) 2025-01-14 15:53:51 -05:00
Andrew Sikowitz
ebbadf65ad
feat(ingest/snowflake): Support ingesting snowflake tags as structured properties (#12285) 2025-01-14 01:50:14 -08:00
Harshal Sheth
244f35de5c
fix(ingest): tighten Source.create type annotations (#12325) 2025-01-13 12:55:57 -08:00
Harshal Sheth
5f63f3fba9
feat(sdk): support urns in other urn constructors (#12311) 2025-01-10 09:45:31 -08:00
Austin SeungJun Park
d8e7cb25e0
fix(ingestion/s3): groupby group-splitting issue (#12254)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-01-10 09:41:28 +01:00
Sergio Gómez Villamor
9d9a368dea
chore(tableau): set ingestion stage report and perftimers (#12234) 2025-01-09 19:04:37 +01:00
Shirshanka Das
45450f19a0
feat(sdk): structured properties - add support for listing (#12283) 2025-01-09 07:32:22 -08:00
Andrew Sikowitz
92f013e6e1
fix(ingest/file-backed-collections): Properly set _use_sqlite_on_conflict (#12297) 2025-01-08 11:40:02 -08:00
Aseem Bansal
a4c47fa343
fix(cli): correct url ending with acryl.io:8080 (#12289) 2025-01-08 19:46:57 +05:30
Harshal Sheth
afa94a5887
fix(ingest): better correctness on the emitter -> graph conversion (#12272) 2025-01-07 14:00:13 -08:00
Mayuri Nehate
b86bbf7262
fix(ingest/tableau): retry on auth error for special case (#12264) 2025-01-06 12:14:59 +05:30
Mayuri Nehate
fba09966f3
fix(ingest): consistent fingerprint for sql parsing aggregator (#12239) 2025-01-03 10:49:42 -08:00
Aseem Bansal
f9e2c49391
fix(ingest/gc): logging and stopping fix (#12266) 2025-01-03 22:15:52 +05:30
Sergio Gómez Villamor
1190dd95b2
fix(tableau): fixes some aspects being emitted multiple times (#12258) 2025-01-03 09:15:53 +01:00
sagar-salvi-apptware
7f64ffd2f7
test(ingest/athena): add connector integration tests (#12256) 2025-01-02 18:44:45 +05:30
sagar-salvi-apptware
a814cb389f
fix(ingest/bigquery): All View generation when queries_v2 is turned off (#12181)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2025-01-02 17:59:22 +05:30
Aseem Bansal
ea249caee1
fix(ingest): json serializable fix (#12246) 2025-01-01 16:52:17 +05:30
Jonny Dixon
554a37a551
fix(ingest/aws_common): update tests execution on EC2 instance (#12252) 2025-01-01 14:49:27 +05:30
sagar-salvi-apptware
b79857fd94
fix(ingest/sql-common): sql_common to use SqlParsingAggregator (#12220) 2024-12-29 18:52:05 +05:30
Harshal Sheth
d0423547ba
feat(ingest): add parse_ts_millis helper (#12231) 2024-12-27 10:50:28 -08:00
Harshal Sheth
ed8639e401
chore(python): test with python 3.11 (#11280)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-27 10:46:49 -08:00
Mayuri Nehate
3ca8d09100
feat(ingest/snowflake): support email_as_user_identifier for queries v2 (#12219) 2024-12-27 11:40:00 +05:30
Harshal Sheth
e1998dd371
chore(ingest): remove enable_logging helper (#12222) 2024-12-26 12:34:00 -08:00
Andrew Sikowitz
756b199506
fix(ingest/glue): Add additional checks and logging when specifying catalog_id (#12168) 2024-12-24 14:56:35 -08:00
Andrew Sikowitz
f4b33b59d1
fix(ingest/mode): Handle 204 response and invalid json (#12156)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-12-24 11:33:06 -08:00
Sergio Gómez Villamor
d88e6c9977
fix(tableau): fixes wrong argument when reauthenticating (#12216) 2024-12-24 16:03:36 +01:00
Mayuri Nehate
4d990b06bd
fix(ingest/snowflake): always ingest view and external table ddl lineage (#12191) 2024-12-24 18:14:51 +05:30
Andrew Sikowitz
09a9b6eef9
feat(ingest/looker): Do not emit usage for non-ingested dashboards and charts (#11647) 2024-12-23 22:39:57 -08:00
Harshal Sheth
21ddb5538d
fix(ingest/mode): move sql logic to view properties aspect (#12196) 2024-12-23 13:32:49 -08:00
Mayuri Nehate
d06980f6f3
fix(ingest/snowflake): handle empty snowflake column upstreams (#12207) 2024-12-23 13:41:40 +00:00
Aseem Bansal
ff262bc65e
Revert "fix(mssql): adds missing containers for dataflow and datajob entities, required for browse paths v2 generation" (#12201) 2024-12-22 12:54:18 +00:00
Sergio Gómez Villamor
494c522405
fix(ingest/mssql): add container dataflow/ datajob entities (#12194) 2024-12-22 17:51:41 +05:30
Jonny Dixon
95b9d1b4c9
feat(ingest/aws-common): improved instance profile support (#12139)
for ec2, ecs, eks, lambda, beanstalk, app runner and cft roles
2024-12-21 12:08:59 +05:30
sid-acryl
0b4d96e95c
fix(ingest/powerbi): support comments in m-query grammar (#12177) 2024-12-21 12:07:53 +05:30
sid-acryl
3c3d0322fe
test(ingest/tableau): add test for extract_project_hierarchy scenario (#12079) 2024-12-20 11:57:34 -08:00
sid-acryl
98c056d569
refactor(ingest/tableau): mark the fetch_size configuration as deprecated (#12126) 2024-12-20 11:06:57 -08:00
skrydal
e52a4deba8
fix(ingest/databricks): Fix profiling (#12060) 2024-12-20 22:11:18 +05:30
Sergio Gómez Villamor
45ace13fe2
feat(mssql): platform instance aspect for dataflow and datajob entities (#12180) 2024-12-19 19:20:42 +00:00
skrydal
e45f548910
feat(ingest/iceberg): Improve iceberg connector (#12163) 2024-12-19 15:25:59 +00:00
sagar-salvi-apptware
2e544614f1
feat(ingest): add looker meta extractor support in sql parsing (#12062)
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-19 12:41:40 +05:30
Andrew Sikowitz
da8f822197
feat(ingest/mlflow): Support configurable base_external_url (#12167) 2024-12-18 14:36:10 -08:00
Mayuri Nehate
01a2c0c779
fix(ingest/kafka): update dependency, tests (#12159) 2024-12-18 19:02:44 +05:30
Harshal Sheth
76cfac3700
fix(cli/properties): allow structured properties without a graph instance (#12144)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2024-12-18 09:04:51 +00:00
Harshal Sheth
d5ab001a97
feat(ingest/git): add subdir support to GitReference (#12131)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: harshal.sheth@acryl.io <harshal.sheth@acryl.io>
2024-12-17 10:54:37 -08:00
Andrew Sikowitz
ff385edbb1
build(ingest/sqlglot): Bump pin to support snowflake CREATE ... WITH TAG (#12003) 2024-12-17 03:49:47 -08:00
Andrew Sikowitz
6b8d21a2ab
feat(ingest/sqlite): Support sqlite < 3.24.0 (#12137) 2024-12-16 12:50:25 -08:00
sid-acryl
74927969aa
feat(ingest/tableau): verify role assignment to user in test_connection (#12042)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-16 11:55:58 -08:00
sid-acryl
c97fd1f8c0
fix(ingest/tableau): honor the key projectNameWithin in pagination (#12107) 2024-12-16 11:32:05 -08:00
Mayuri Nehate
d38427a773
feat(ingest/snowflake): secure view lineage without owner permissions (#12123) 2024-12-16 17:49:49 +05:30