1661 Commits

Author SHA1 Message Date
sid-acryl
c55c12c918
fix(ingestion/looker): deduplicate the view field (#10482)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2024-05-15 11:25:07 -07:00
richenc
8e5f17b131
feat(ingest/tableau): support platform instance mapping based off database server hostname (#10254)
Co-authored-by: Richie Chen <richie.chen@hulu.com>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2024-05-15 08:23:49 -07:00
dushayntAW
a164b70e1d
chore(ingest/presto-on-hive) Set enable_properties_merge to True by default (#10469) 2024-05-15 18:57:13 +05:30
sagar-salvi-apptware
5fbf781558
fix(ingest/transformer): Add dataset domains based on tags using transformer (#10458) 2024-05-15 14:13:03 +05:30
dushayntAW
bfd3c4bf1c
fix(ingestion/kafka-connect): failure on multiple env substitutes (#10443) 2024-05-09 17:59:55 +05:30
Egemen Berk Galatalı
b1b7cedd8d
feat(ingest/tableau): Fetch Upstreams From Columns (#9874) 2024-05-08 14:21:07 -07:00
dushayntAW
96061be564
fix(ingestion/salesforce): handle the label with none value scenario (#10446) 2024-05-08 14:11:50 +05:30
Tamas Nemeth
897e648eae
fix(ingest/mode): Improve query lineage (#10284)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-05-07 22:02:37 -07:00
Mayuri Nehate
f6627efe71
fix(ingest/snowflake): add more reporting for usage aggregation, handle lineage errors (#10279)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-05-07 08:42:39 -07:00
Shubham Jagtap
ae3f0fd5ee
feat(ingestion): Copy urns from previous checkpoint state on ingestion failure (#10347) 2024-05-07 17:36:40 +05:30
Shubham Jagtap
ddb38e7448
fix(ingestion/tableau): Fix tableau custom sql lineage gap (#10359) 2024-05-07 13:47:56 +05:30
Harshal Sheth
1dae37a8ed
fix(ingest/bigquery): remove last modified timestamp fallback (#10431) 2024-05-06 16:30:04 -07:00
dushayntAW
c00ddb2a0d
fix(ingest/transformer): new transformer to clean user URN for datasetUsageStatistics aspect (#10398) 2024-05-03 13:24:48 +05:30
Ellie O'Neil
d82750b891
DynamoDB IAM auth (#10419) 2024-05-02 16:02:40 -07:00
Pablo Osinaga
0b99145797
feat(metabase): add stateful ingestion (#10360) 2024-05-02 12:04:18 -07:00
sid-acryl
0e795a6614
fix(ingestion/looker): fix lineage for dimension group column (#10382) 2024-05-02 11:48:11 -07:00
Shubham Jagtap
77045f9a7f
perf(ingestion/fivetran): Connector performance optimization (#10346) 2024-04-30 09:44:14 -07:00
Harshal Sheth
3ab4ec9b44
feat(ingest/dbt): support a datahub section in meta mappings (#10371) 2024-04-26 09:41:03 -07:00
Tamas Nemeth
7e69247a7f
fix(ingest/profiling): Filter tables early based on profile pattern filter (#10378) 2024-04-26 17:35:03 +02:00
Shubham Jagtap
ca2a10e36f
fix(ingestion/qlik): Unable to ingest more than ten spaces (#10228)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-23 16:04:20 -07:00
dushayntAW
b9a34fe90b
fix(ingest/salesforce): escape markdown char for multiline description (#10351) 2024-04-23 17:05:55 +05:30
Shubham Jagtap
934ab03d16
test(ingestion/sigma): Add integration test cases (#10356) 2024-04-22 16:19:01 -07:00
Harshal Sheth
08731055ba
feat(ingest): bump acryl-sqlglot dep (#10343) 2024-04-20 08:37:22 +02:00
Pablo Osinaga
62c7ac706b
feat(ingest/metabase): add ability to exclude other users collections (#10330) 2024-04-19 12:53:17 -07:00
Harshal Sheth
7d31420b69
feat(ingest): materialize terms produced by ingestion (#10249) 2024-04-18 10:48:16 -07:00
Mayuri Nehate
529710ab9d
fix(ingest/databricks): handle and report config parse failure, updat… (#10261) 2024-04-17 12:14:16 -07:00
Mayuri Nehate
0613234d2a
fix(ingest/tableau): handle very large filter queries (#10295) 2024-04-17 12:14:02 -07:00
Tamas Nemeth
d463a16b49
chore(ingest/presto-on-hive): Renaming presto-on-hive to hive-metastore source (#10278) 2024-04-16 23:35:16 +02:00
dushayntAW
20e2cc7eca
fix(ingest/csv): add support multiple ownership type for the same dataset (#10287) 2024-04-15 20:15:08 +05:30
dushayntAW
f860f7907d
fix(ingest/transformer): replace externalUrl in dataset properties (#10281) 2024-04-15 20:14:42 +05:30
Mayuri Nehate
8b79461bd5
feat(ingest/looker): browse path followups (#10217) 2024-04-12 10:21:06 -07:00
dushayntAW
5497393096
fix(ingest/powerbi): patch lineage for powerbi report (#10270) 2024-04-12 15:21:06 +05:30
Tamas Nemeth
8ed87d6a90
feat(ingest/mode): Mode improvements (#10273) 2024-04-12 09:01:16 +02:00
Shubham Jagtap
d4120ce3f7
feat(ingest/fivetran): use emails in owner user urns (#10229) 2024-04-09 18:40:12 -07:00
Dotan Mor
fa0c1b3fa9
feat(ingest/cockroachdb): add cockroachdb ingestion (#10226) 2024-04-09 18:36:51 -07:00
Mayuri Nehate
6997abd42e
feat(ingest/nifi): ingest process group as browse path v2, incremental lineage (#10202)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-09 17:44:20 +05:30
Tamas Nemeth
00a890f84f
fix(ingest/bigquery): fix lineage if multiple sql expression passed in and destination table set (#10212)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-09 11:54:02 +02:00
Harshal Sheth
bdf2c9a5c1
feat(ingest/sql): normalize bigquery partitioned tables when parsing (#10224) 2024-04-07 17:17:28 +02:00
Harshal Sheth
e74347812b
fix(ingest/dbt): better dbt timestamp parsing (#10223) 2024-04-05 16:13:18 -07:00
ACHRAF BOUAOUDA
b5615fac54
feat(ingest/great_expectations): support in-memory (Pandas) data assets (#9811)
Co-authored-by: Achraf BOUAOUDA <achraf_bouada@carrefour.com>
2024-04-04 12:46:59 -07:00
Shubham Jagtap
fa139a582e
feat(ingestion/transformer): Handle overlapping while mapping in extract ownership from tags transformer (#10201) 2024-04-04 12:19:11 -07:00
dushayntAW
3c7c3ec904
fix(ingestion/glue): fix to ingest the comment for partition key as description (#10189) 2024-04-03 17:34:02 +05:30
Tamas Nemeth
5c06f7a245
fix(ingest/bigquery): Supporting lineage extraction in case the select query result's target table is set on job (#10191)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-02 22:13:05 +02:00
dushayntAW
2873736eac
fix(ingestion/salesforce): fixed the issue by escaping the markdown string (#10157) 2024-04-02 23:05:47 +05:30
Harshal Sheth
c9b9afc530
feat(ingest/dbt): enable model performance and compiled code by default (#10164) 2024-04-02 09:29:27 -05:00
RyanHolstien
ef637ccb37
fix(docker): fix versioning for compose file post release (#10176) 2024-04-01 15:01:09 -05:00
Shubham Jagtap
9f2c5d36f3
feat(ingestion/bigquery): BigQuery Owner Label to Datahub Ownership (#10047) 2024-03-28 15:50:25 -07:00
Mayuri Nehate
4e328c38a7
feat(ingest/looker): update browse paths to align with looker UI (#10147) 2024-03-28 11:57:43 -07:00
Harshal Sheth
25d9d6656c
feat(ingest): fix validators (#10115)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-03-27 15:20:55 -07:00
Mayuri Nehate
0361f2463d
feat(ingest/dynamodb): add support for classification (#10138) 2024-03-27 11:28:58 -07:00