945 Commits

Author SHA1 Message Date
Aseem Bansal
76e46b89db
dev(ingest): move modules from isort,flake8 to ruff (#12373) 2025-01-17 21:38:29 +05:30
Sergio Gómez Villamor
b7b541ca7d
feat(tableau): fine-grained page size (#12354) 2025-01-16 16:43:46 +01:00
Sergio Gómez Villamor
d99b97a413
chore(tableau): metrics to understand pagination in get_connection_objects queries (#12329) 2025-01-16 10:14:33 +01:00
Andrew Sikowitz
ebbadf65ad
feat(ingest/snowflake): Support ingesting snowflake tags as structured properties (#12285) 2025-01-14 01:50:14 -08:00
Mayuri Nehate
b86bbf7262
fix(ingest/tableau): retry on auth error for special case (#12264) 2025-01-06 12:14:59 +05:30
sagar-salvi-apptware
7f64ffd2f7
test(ingest/athena): add connector integration tests (#12256) 2025-01-02 18:44:45 +05:30
sagar-salvi-apptware
a814cb389f
fix(ingest/bigquery): All View generation when queries_v2 is turned off (#12181)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2025-01-02 17:59:22 +05:30
sagar-salvi-apptware
b79857fd94
fix(ingest/sql-common): sql_common to use SqlParsingAggregator (#12220) 2024-12-29 18:52:05 +05:30
Harshal Sheth
d0423547ba
feat(ingest): add parse_ts_millis helper (#12231) 2024-12-27 10:50:28 -08:00
Harshal Sheth
ed8639e401
chore(python): test with python 3.11 (#11280)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-27 10:46:49 -08:00
Mayuri Nehate
3ca8d09100
feat(ingest/snowflake): support email_as_user_identifier for queries v2 (#12219) 2024-12-27 11:40:00 +05:30
Harshal Sheth
e1998dd371
chore(ingest): remove enable_logging helper (#12222) 2024-12-26 12:34:00 -08:00
Andrew Sikowitz
f4b33b59d1
fix(ingest/mode): Handle 204 response and invalid json (#12156)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-12-24 11:33:06 -08:00
Sergio Gómez Villamor
d88e6c9977
fix(tableau): fixes wrong argument when reauthenticating (#12216) 2024-12-24 16:03:36 +01:00
Mayuri Nehate
4d990b06bd
fix(ingest/snowflake): always ingest view and external table ddl lineage (#12191) 2024-12-24 18:14:51 +05:30
Andrew Sikowitz
09a9b6eef9
feat(ingest/looker): Do not emit usage for non-ingested dashboards and charts (#11647) 2024-12-23 22:39:57 -08:00
Harshal Sheth
21ddb5538d
fix(ingest/mode): move sql logic to view properties aspect (#12196) 2024-12-23 13:32:49 -08:00
Aseem Bansal
ff262bc65e
Revert "fix(mssql): adds missing containers for dataflow and datajob entities, required for browse paths v2 generation" (#12201) 2024-12-22 12:54:18 +00:00
Sergio Gómez Villamor
494c522405
fix(ingest/mssql): add container dataflow/ datajob entities (#12194) 2024-12-22 17:51:41 +05:30
sid-acryl
0b4d96e95c
fix(ingest/powerbi): support comments in m-query grammar (#12177) 2024-12-21 12:07:53 +05:30
sid-acryl
3c3d0322fe
test(ingest/tableau): add test for extract_project_hierarchy scenario (#12079) 2024-12-20 11:57:34 -08:00
sid-acryl
98c056d569
refactor(ingest/tableau): mark the fetch_size configuration as deprecated (#12126) 2024-12-20 11:06:57 -08:00
Sergio Gómez Villamor
45ace13fe2
feat(mssql): platform instance aspect for dataflow and datajob entities (#12180) 2024-12-19 19:20:42 +00:00
sagar-salvi-apptware
2e544614f1
feat(ingest): add looker meta extractor support in sql parsing (#12062)
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-19 12:41:40 +05:30
Mayuri Nehate
01a2c0c779
fix(ingest/kafka): update dependency, tests (#12159) 2024-12-18 19:02:44 +05:30
Harshal Sheth
d5ab001a97
feat(ingest/git): add subdir support to GitReference (#12131)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: harshal.sheth@acryl.io <harshal.sheth@acryl.io>
2024-12-17 10:54:37 -08:00
sid-acryl
74927969aa
feat(ingest/tableau): verify role assignment to user in test_connection (#12042)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-16 11:55:58 -08:00
sid-acryl
c97fd1f8c0
fix(ingest/tableau): honor the key projectNameWithin in pagination (#12107) 2024-12-16 11:32:05 -08:00
Mayuri Nehate
d38427a773
feat(ingest/snowflake): secure view lineage without owner permissions (#12123) 2024-12-16 17:49:49 +05:30
Jonny Dixon
06edf23a33
fix(ingestion/dremio): Ignore filtered containers in schema allowdeny pattern (#11959)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-13 14:55:31 +05:30
kevinkarchacryl
507087a070
feat(glossary): support multiple ownership types (#12050)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-12-12 08:13:08 -05:00
sid-acryl
2ec9cb0536
fix(ingestion/lookml): resolve CLL issue caused by column name casing. (#11876) 2024-12-12 15:32:56 +05:30
sid-acryl
47bd4464a3
fix(ingest/tableau): apply page_size regardless of object count (#12026) 2024-12-12 15:31:50 +05:30
Harshal Sheth
93c8ae2267
fix(ingest/snowflake): handle dots in snowflake table names (#12105) 2024-12-12 15:31:32 +05:30
skrydal
b091e4615d
feat(ingest/kafka): Flag for optional schemas ingestion (#12077) 2024-12-11 16:02:31 +00:00
Mayuri Nehate
355a7e69aa
feat(ingest/snowflake): allow option for incremental properties (#12080) 2024-12-11 16:08:39 +05:30
Shirshanka Das
e4ea993df1
fix(py-sdk): DataJobPatchBuilder handling timestamps, output edges (#12067)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-09 19:40:31 -05:00
haeniya
4811de1c1d
feat(ingestion/tableau): hidden asset handling (#11559)
Co-authored-by: Yanik Häni <Yanik.Haeni1@swisscom.com>
2024-12-09 14:29:11 +05:30
hwmarkcheng
46aa962bad
feat(ingest/superset): initial support for superset datasets (#11972) 2024-12-06 13:48:00 -08:00
Mayuri Nehate
2fe21329fa
fix(ingest): avoid shell entities during view lineage generation (#12044) 2024-12-06 12:43:05 +05:30
Mayuri Nehate
8d15df0c11
feat(ingest/kafka): additional validation for oauth_db signature (#11996) 2024-12-05 12:41:43 +05:30
Harshal Sheth
2b42b29d2f
fix(ingest/tableau): make sites.get_by_id call optional (#12024) 2024-12-04 14:37:09 +05:30
Tamas Nemeth
230bd2674b
fix(ingest/looker): Don't fail on unknown liquid filters (#12014) 2024-12-03 20:01:12 +01:00
sagar-salvi-apptware
b538d4bc73
fix(ingestion/dremio): Fixed lineage view for dremio EE (#11990) 2024-12-02 15:02:47 +05:30
Harshal Sheth
189f8cefa7
feat(ingest): standardize sql type mappings (#11982) 2024-11-28 14:53:46 -05:00
Mayuri Nehate
ecba2244f0
fix(ingest/kafka):add poll for admin client for oauth_cb (#11985)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-11-28 19:23:30 +05:30
Margarida Fernandes
f3eda31326
feat(ingestion): extend feast plugin to ingest tags and owners (#11784)
Co-authored-by: John Joyce <john@acryl.io>
2024-11-27 15:41:04 -08:00
sid-acryl
7bf7673735
refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924) 2024-11-27 09:32:24 -08:00
Mayuri Nehate
2e3b4294bb
feat(ingest/mssql): allow filtering by procedure_pattern (#11953) 2024-11-26 11:16:42 -05:00
sagar-salvi-apptware
b357f87f94
fix(ingest/sigma): migrate sigma workbooks from container to dashboard (#11939) 2024-11-26 18:56:30 +05:30