3904 Commits

Author SHA1 Message Date
Sergio Gómez Villamor
d88e6c9977
fix(tableau): fixes wrong argument when reauthenticating (#12216) 2024-12-24 16:03:36 +01:00
Mayuri Nehate
4d990b06bd
fix(ingest/snowflake): always ingest view and external table ddl lineage (#12191) 2024-12-24 18:14:51 +05:30
Sergio Gómez Villamor
87e7b58ac6
fix(tableau): retry on InternalServerError 504 (#12213) 2024-12-24 09:46:19 +00:00
Andrew Sikowitz
09a9b6eef9
feat(ingest/looker): Do not emit usage for non-ingested dashboards and charts (#11647) 2024-12-23 22:39:57 -08:00
Harshal Sheth
21ddb5538d
fix(ingest/mode): move sql logic to view properties aspect (#12196) 2024-12-23 13:32:49 -08:00
Harshal Sheth
b6ea974630
fix(ingest): preserve certs when converting emitter to graph (#12211) 2024-12-23 10:04:15 -08:00
Harshal Sheth
4c0b568887
feat(ingest): add sql parser trace mode (#12210) 2024-12-23 10:04:06 -08:00
Harshal Sheth
dc82251afe
fix(ingest): quote asset urns in patch path (#12212) 2024-12-23 10:03:52 -08:00
Mayuri Nehate
d06980f6f3
fix(ingest/snowflake): handle empty snowflake column upstreams (#12207) 2024-12-23 13:41:40 +00:00
Aseem Bansal
0562c7a190
fix(ingest): exclude aspect from migration (#12206) 2024-12-23 16:56:54 +05:30
Aseem Bansal
ff262bc65e
Revert "fix(mssql): adds missing containers for dataflow and datajob entities, required for browse paths v2 generation" (#12201) 2024-12-22 12:54:18 +00:00
Sergio Gómez Villamor
494c522405
fix(ingest/mssql): add container dataflow/ datajob entities (#12194) 2024-12-22 17:51:41 +05:30
Jonny Dixon
8350a4e03a
feat(ingest/hive): lineage from/to file storage (#11841)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-12-21 13:22:27 +05:30
Jonny Dixon
95b9d1b4c9
feat(ingest/aws-common): improved instance profile support (#12139)
for ec2, ecs, eks, lambda, beanstalk, app runner and cft roles
2024-12-21 12:08:59 +05:30
sid-acryl
0b4d96e95c
fix(ingest/powerbi): support comments in m-query grammar (#12177) 2024-12-21 12:07:53 +05:30
sid-acryl
3c3d0322fe
test(ingest/tableau): add test for extract_project_hierarchy scenario (#12079) 2024-12-20 11:57:34 -08:00
sid-acryl
98c056d569
refactor(ingest/tableau): mark the fetch_size configuration as deprecated (#12126) 2024-12-20 11:06:57 -08:00
skrydal
e52a4deba8
fix(ingest/databricks): Fix profiling (#12060) 2024-12-20 22:11:18 +05:30
Mayuri Nehate
f4f9bd3bca
feat(ingest/snowflake): include external table ddl lineage for queries… (#12179) 2024-12-20 17:45:43 +05:30
Sergio Gómez Villamor
eceb799e63
fix(tableau): restart server object when reauthenticating (#12182)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-20 08:37:21 +01:00
Sergio Gómez Villamor
acb76cd97c
fix(tableau): prevents warning in case of site admin creator role (#12175) 2024-12-19 19:26:58 +00:00
Sergio Gómez Villamor
45ace13fe2
feat(mssql): platform instance aspect for dataflow and datajob entities (#12180) 2024-12-19 19:20:42 +00:00
John Joyce
9031b49b23
fix(docs): Add improvements in examples for PATCH documentation (#12165)
Co-authored-by: John Joyce <john@Mac-1406.lan>
Co-authored-by: John Joyce <john@Johns-MacBook-Pro.local>
2024-12-19 09:07:59 -08:00
Harshal Sheth
08605a95a7
feat(python): split out temp wheel builds (#12157) 2024-12-19 08:02:37 -08:00
skrydal
e45f548910
feat(ingest/iceberg): Improve iceberg connector (#12163) 2024-12-19 15:25:59 +00:00
sagar-salvi-apptware
2e544614f1
feat(ingest): add looker meta extractor support in sql parsing (#12062)
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-19 12:41:40 +05:30
Mayuri Nehate
953893cf2e
refactor(ingest/kafka-connect): define interface for new connector impl (#12149) 2024-12-19 12:39:47 +05:30
Harshal Sheth
4392d72456
fix(cli/properties): fix data type validation (#12170) 2024-12-18 17:29:34 -08:00
Andrew Sikowitz
da8f822197
feat(ingest/mlflow): Support configurable base_external_url (#12167) 2024-12-18 14:36:10 -08:00
Mayuri Nehate
01a2c0c779
fix(ingest/kafka): update dependency, tests (#12159) 2024-12-18 19:02:44 +05:30
Aseem Bansal
2285436a62
fix(ingest/gc): more logging, error handling, explicit flag (#12124) 2024-12-18 17:50:38 +05:30
Harshal Sheth
76cfac3700
fix(cli/properties): allow structured properties without a graph instance (#12144)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2024-12-18 09:04:51 +00:00
Alice-sky
5946558c01
fix(ingest/pulsar): handle Avro schema with missing namespace or name (#12058)
Co-authored-by: Alice <spongebob2023123@163.com>
Co-authored-by: Shirshanka Das <shirshanka+github@gmail.com>
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-18 07:21:41 +00:00
Harshal Sheth
826437612e
fix(ingest/snowflake): improve lineage parse failure logging (#12153) 2024-12-17 20:21:05 -08:00
Harshal Sheth
d5ab001a97
feat(ingest/git): add subdir support to GitReference (#12131)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: harshal.sheth@acryl.io <harshal.sheth@acryl.io>
2024-12-17 10:54:37 -08:00
Andrew Sikowitz
ff385edbb1
build(ingest/sqlglot): Bump pin to support snowflake CREATE ... WITH TAG (#12003) 2024-12-17 03:49:47 -08:00
Harshal Sheth
d2359e259a
feat(ingest/datahub): report progress on db ingestion (#12117) 2024-12-17 09:58:47 +01:00
Austin SeungJun Park
8f9659fadf
fix(ingest/s3): incorrectly parsing path in s3_uri (#12135) 2024-12-17 09:57:03 +01:00
kevinkarchacryl
d0b4f7a7d3
feat(cli): added cli option for ingestion source (#11980) 2024-12-16 16:03:11 -05:00
Andrew Sikowitz
6b8d21a2ab
feat(ingest/sqlite): Support sqlite < 3.24.0 (#12137) 2024-12-16 12:50:25 -08:00
kousiknandy
ca6f435d03
docs(ingest): fix sink recipe to correct config parameter (#12132) 2024-12-16 12:08:21 -08:00
sid-acryl
74927969aa
feat(ingest/tableau): verify role assignment to user in test_connection (#12042)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-12-16 11:55:58 -08:00
Tamas Nemeth
0ea2e36226
fix(ingest/datahub): Use server side cursor instead of local one (#12129) 2024-12-16 20:38:24 +01:00
sid-acryl
c97fd1f8c0
fix(ingest/tableau): honor the key projectNameWithin in pagination (#12107) 2024-12-16 11:32:05 -08:00
Mayuri Nehate
d38427a773
feat(ingest/snowflake): secure view lineage without owner permissions (#12123) 2024-12-16 17:49:49 +05:30
Harshal Sheth
05ba40355d
refactor(ingest): cleanup structured properties validation (#12115) 2024-12-14 07:12:53 -08:00
Harshal Sheth
f9ca305600
feat(ingest): additional limits on ingestProposalBatch (#12130) 2024-12-14 07:09:04 -08:00
Aseem Bansal
0689c4de32
fix(ingest/snowflake): improve warn message (#12125)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-13 23:09:30 +05:30
Mayuri Nehate
d5e05131d5
fix(ingest/kafka-connect): update connection test url, handle api failures (#12082) 2024-12-13 16:39:29 +05:30
Jonny Dixon
06edf23a33
fix(ingestion/dremio): Ignore filtered containers in schema allowdeny pattern (#11959)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-13 14:55:31 +05:30