3904 Commits

Author SHA1 Message Date
Harshal Sheth
5f63f3fba9
feat(sdk): support urns in other urn constructors (#12311) 2025-01-10 09:45:31 -08:00
Aseem Bansal
a4f5ab4443
fix(ingest/gc): add delete limit execution request (#12313) 2025-01-10 16:24:47 +05:30
Aseem Bansal
a92a10770e
docs(ingest/glue): add permissions for glue (#12290) 2025-01-10 16:24:29 +05:30
Austin SeungJun Park
d8e7cb25e0
fix(ingestion/s3): groupby group-splitting issue (#12254)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-01-10 09:41:28 +01:00
Harshal Sheth
0c31d9ae0d
feat(ingest/datahub): support dropping duplicate schema fields (#12308) 2025-01-09 15:55:56 -08:00
Sergio Gómez Villamor
9d9a368dea
chore(tableau): set ingestion stage report and perftimers (#12234) 2025-01-09 19:04:37 +01:00
Shirshanka Das
45450f19a0
feat(sdk): structured properties - add support for listing (#12283) 2025-01-09 07:32:22 -08:00
kevinkarchacryl
ea4d40e535
fix(doc): make folder_path_pattern usage more clear (#12298) 2025-01-08 17:51:51 -05:00
Andrew Sikowitz
92f013e6e1
fix(ingest/file-backed-collections): Properly set _use_sqlite_on_conflict (#12297) 2025-01-08 11:40:02 -08:00
Aseem Bansal
a4c47fa343
fix(cli): correct url ending with acryl.io:8080 (#12289) 2025-01-08 19:46:57 +05:30
Aseem Bansal
0fe4163332
fix(ingest/gc): also query data process instance (#12292) 2025-01-08 19:13:31 +05:30
Aseem Bansal
99c30f2b3c
fix(ingest/glue): don't fail on profile (#12288) 2025-01-08 19:04:19 +05:30
Harshal Sheth
cbb36bbe59
feat(ingest): configurable query generation in combined sources (#12284) 2025-01-07 19:23:58 -05:00
Harshal Sheth
afa94a5887
fix(ingest): better correctness on the emitter -> graph conversion (#12272) 2025-01-07 14:00:13 -08:00
Harshal Sheth
a06a229499
feat(ingest/datahub): use stream_results with mysql (#12278) 2025-01-06 15:29:51 -08:00
skrydal
30a77c022a
fix(ingestion/classifier): temporary measure to avoid deadlocks for classifier (#12261) 2025-01-06 22:12:56 +01:00
Harshal Sheth
ba8bf538ca
feat(ingest): enable EnsureAspectSizeProcessor for all sources (#12262) 2025-01-06 10:52:35 -08:00
Harshal Sheth
fb471f112e
docs(tableau): clarify docs around tableau permissions (#12270) 2025-01-06 10:32:46 -08:00
Mayuri Nehate
91c1c6bf77
fix(ingest/snowflake): use fast query fingerprint for lineage (#12275) 2025-01-06 08:18:56 -08:00
Aseem Bansal
842c8f94a5
fix(ingest/gc): infinite loop query entities (#12274) 2025-01-06 16:39:02 +05:30
Mayuri Nehate
b86bbf7262
fix(ingest/tableau): retry on auth error for special case (#12264) 2025-01-06 12:14:59 +05:30
Aseem Bansal
8093882d45
feat(ingest/gc): truncate query usage statistics aspect (#12268) 2025-01-05 12:40:58 +05:30
Gabe Lyons
d2b67cab6d
docs(queries_v2): set use_queries_v2 to true in snowflake_recipe.yml (#12269) 2025-01-03 11:57:34 -08:00
Mayuri Nehate
fba09966f3
fix(ingest): consistent fingerprint for sql parsing aggregator (#12239) 2025-01-03 10:49:42 -08:00
Aseem Bansal
f9e2c49391
fix(ingest/gc): logging and stopping fix (#12266) 2025-01-03 22:15:52 +05:30
skrydal
b76db335a2
fix(ingestion/redshift): Bumped redshift-connector dependency due to CVE-2024-12745 (#12265) 2025-01-03 13:33:45 +01:00
Sergio Gómez Villamor
1190dd95b2
fix(tableau): fixes some aspects being emitted multiple times (#12258) 2025-01-03 09:15:53 +01:00
Harshal Sheth
f396d8d87a
refactor(sdk/patch): improve patch implementation internals (#12253) 2025-01-02 12:36:07 -08:00
Pedro Silva
bdc34b7b35
fix(sample data): Update timestamps in bootstrap_mce.json to more recent (#12257) 2025-01-02 17:28:10 +00:00
Harshal Sheth
ccf5fc708f
chore(ingest): refactor common pytest args (#12240) 2025-01-02 08:53:31 -08:00
sagar-salvi-apptware
7f64ffd2f7
test(ingest/athena): add connector integration tests (#12256) 2025-01-02 18:44:45 +05:30
sagar-salvi-apptware
a814cb389f
fix(ingest/bigquery): All View generation when queries_v2 is turned off (#12181)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2025-01-02 17:59:22 +05:30
Aseem Bansal
67ef55efc7
fix(ingest/gc): soft deletion loop fix (#12255) 2025-01-02 15:11:35 +05:30
Aseem Bansal
ea249caee1
fix(ingest): json serializable fix (#12246) 2025-01-01 16:52:17 +05:30
Jonny Dixon
554a37a551
fix(ingest/aws_common): update tests execution on EC2 instance (#12252) 2025-01-01 14:49:27 +05:30
Aseem Bansal
3723a3e4bc
fix(ingest/gc): reduce logging, remove unnecessary sleeps (#12238) 2024-12-30 21:06:48 +05:30
sagar-salvi-apptware
b79857fd94
fix(ingest/sql-common): sql_common to use SqlParsingAggregator (#12220) 2024-12-29 18:52:05 +05:30
Harshal Sheth
4e3103e266
fix(ingest): use typing_extensions.Self (#12230) 2024-12-27 10:50:43 -08:00
Harshal Sheth
d0423547ba
feat(ingest): add parse_ts_millis helper (#12231) 2024-12-27 10:50:28 -08:00
Harshal Sheth
ed8639e401
chore(python): test with python 3.11 (#11280)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-27 10:46:49 -08:00
Sergio Gómez Villamor
ac8e539457
chore(tableau): adjust visibility of info message (#12235) 2024-12-27 16:14:32 +01:00
Sergio Gómez Villamor
29e4528ae5
fix(tableau): retry if 502 error code (#12233) 2024-12-27 11:12:40 +01:00
Mayuri Nehate
3ca8d09100
feat(ingest/snowflake): support email_as_user_identifier for queries v2 (#12219) 2024-12-27 11:40:00 +05:30
Harshal Sheth
172736a9b3
feat(ingest/dbt): support "Explore" page in dbt cloud (#12223) 2024-12-26 18:34:31 -08:00
Harshal Sheth
e1998dd371
chore(ingest): remove enable_logging helper (#12222) 2024-12-26 12:34:00 -08:00
Harshal Sheth
a920e9bec8
fix(ingest/lookml): emit warnings for resolution failures (#12215) 2024-12-26 12:33:39 -08:00
Aseem Bansal
16698da509
fix(ingest/gc): misc fixes in gc source (#12226) 2024-12-26 18:10:09 +05:30
Andrew Sikowitz
756b199506
fix(ingest/glue): Add additional checks and logging when specifying catalog_id (#12168) 2024-12-24 14:56:35 -08:00
Andrew Sikowitz
f4b33b59d1
fix(ingest/mode): Handle 204 response and invalid json (#12156)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-12-24 11:33:06 -08:00
sagar-salvi-apptware
48736a03dd
fix(ingest/looker): Add flag for Looker metadata extraction (#12205)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-24 11:27:27 -08:00