3975 Commits

Author SHA1 Message Date
Harshal Sheth
334f431119
feat(sdk): add DataHubGraph.get_timeseries_values() method (#10501) 2024-05-15 22:15:02 +02:00
Harshal Sheth
56054e8b14
fix(ingest/snowflake): use block sampling more conservatively (#10494) 2024-05-15 22:11:48 +02:00
Harshal Sheth
047bfcc412
fix(ingest): avoid using _inner_dict in urn iterator (#10492) 2024-05-15 22:08:27 +02:00
sid-acryl
c55c12c918
fix(ingestion/looker): deduplicate the view field (#10482)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2024-05-15 11:25:07 -07:00
richenc
8e5f17b131
feat(ingest/tableau): support platform instance mapping based off database server hostname (#10254)
Co-authored-by: Richie Chen <richie.chen@hulu.com>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2024-05-15 08:23:49 -07:00
dushayntAW
a164b70e1d
chore(ingest/presto-on-hive) Set enable_properties_merge to True by default (#10469) 2024-05-15 18:57:13 +05:30
sagar-salvi-apptware
5fbf781558
fix(ingest/transformer): Add dataset domains based on tags using transformer (#10458) 2024-05-15 14:13:03 +05:30
Hyejin Yoon
10cbbd7619
docs: fix docs utms & slack footer (#10481) 2024-05-12 16:39:33 -07:00
Andrew Sikowitz
786fe457d0
feat(ingest/slack): Support profile ingestion using users:info (#10410)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2024-05-12 16:31:53 -07:00
david-leifker
e7c7015981
feat(structured-properties): immutable flag (#10461)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-05-09 13:55:25 -05:00
Harshal Sheth
96c605df71
feat(ingest/redshift): add timers for lineage v2 (#10460) 2024-05-09 18:18:26 +02:00
Davi Arnaut
94d424b7d4
fix(docs): adjust new requirements for DynamoDB ingestion (#10470) 2024-05-09 10:22:33 -05:00
Tamas Nemeth
27d0b925cd
fix(ingest/dbt): Adding fix if dbt data type is null (#10471) 2024-05-09 19:46:41 +05:30
Aseem Bansal
e2e8434561
feat(ingest/cli): add sample URNs per aspect for easier debugging (#10468)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-05-09 19:46:16 +05:30
dushayntAW
bfd3c4bf1c
fix(ingestion/kafka-connect): failure on multiple env substitutes (#10443) 2024-05-09 17:59:55 +05:30
Aseem Bansal
3755a1e27d
fix(ingest/dbt): failures due to API change (#10467) 2024-05-09 17:06:35 +05:30
Sergio Gómez Villamor
af4b4e89a4
fix(ingest/tableau): catch exception during sign out (#10459) 2024-05-09 14:51:01 +05:30
Guy Rapaport
232b98968c
docs(ingest): fix typos and clarify ingestion recipe docs (#10405) 2024-05-08 14:53:27 -07:00
Egemen Berk Galatalı
b1b7cedd8d
feat(ingest/tableau): Fetch Upstreams From Columns (#9874) 2024-05-08 14:21:07 -07:00
Harshal Sheth
6b3eb86948
perf(ingest): speed up urn encode happy path (#10451) 2024-05-08 14:07:44 -07:00
skrydal
9debbdd4a9
fix(ingestion): Explicitly set requirement on snowflake-connector-python to be newer or equal to 3.4.0 (#10445)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-05-08 14:12:30 +05:30
dushayntAW
96061be564
fix(ingestion/salesforce): handle the label with none value scenario (#10446) 2024-05-08 14:11:50 +05:30
Tamas Nemeth
897e648eae
fix(ingest/mode): Improve query lineage (#10284)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-05-07 22:02:37 -07:00
Mayuri Nehate
f6627efe71
fix(ingest/snowflake): add more reporting for usage aggregation, handle lineage errors (#10279)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-05-07 08:42:39 -07:00
Shubham Jagtap
ae3f0fd5ee
feat(ingestion): Copy urns from previous checkpoint state on ingestion failure (#10347) 2024-05-07 17:36:40 +05:30
Shubham Jagtap
ddb38e7448
fix(ingestion/tableau): Fix tableau custom sql lineage gap (#10359) 2024-05-07 13:47:56 +05:30
Harshal Sheth
0e8fc5129f
feat(cli): cache sql parsing intermediates (#10399) 2024-05-06 16:59:00 -07:00
Harshal Sheth
1dae37a8ed
fix(ingest/bigquery): remove last modified timestamp fallback (#10431) 2024-05-06 16:30:04 -07:00
Harshal Sheth
6a24ed2743
feat(ingest/snowflake): use system sampling on very large tables (#10430) 2024-05-06 22:00:18 +02:00
Gabe Lyons
bda609b000
docs(ingest): update datahub sink doc to include an acryl example (#10411) 2024-05-03 08:47:57 -07:00
dushayntAW
c00ddb2a0d
fix(ingest/transformer): new transformer to clean user URN for datasetUsageStatistics aspect (#10398) 2024-05-03 13:24:48 +05:30
Tamas Nemeth
4e47933e55
fix(ingest/bigquery): Fixing double sanitization of urns (#10386) 2024-05-02 21:24:53 -07:00
Ellie O'Neil
d82750b891
DynamoDB IAM auth (#10419) 2024-05-02 16:02:40 -07:00
Pablo Osinaga
0b99145797
feat(metabase): add stateful ingestion (#10360) 2024-05-02 12:04:18 -07:00
sid-acryl
0e795a6614
fix(ingestion/looker): fix lineage for dimension group column (#10382) 2024-05-02 11:48:11 -07:00
Harshal Sheth
8bebf63e3d
fix(ingest): map bigquery nested types properly (#10409) 2024-05-02 12:27:35 +02:00
Shubham Jagtap
77045f9a7f
perf(ingestion/fivetran): Connector performance optimization (#10346) 2024-04-30 09:44:14 -07:00
Hyejin Yoon
704ca650ad
docs: add slack utm component in docs (#10214) 2024-04-30 12:54:54 +09:00
Hyejin Yoon
e3f27c8b91
feat: add keywords for SEO (#10358) 2024-04-30 08:12:32 +09:00
Harshal Sheth
3ab4ec9b44
feat(ingest/dbt): support a datahub section in meta mappings (#10371) 2024-04-26 09:41:03 -07:00
Tamas Nemeth
7e69247a7f
fix(ingest/profiling): Filter tables early based on profile pattern filter (#10378) 2024-04-26 17:35:03 +02:00
Harshal Sheth
4add9b157d
feat(ingest/dbt): use columns from manifest as a fallback (#10374) 2024-04-25 22:29:51 +02:00
Harshal Sheth
4c40a24d76
fix(ingest/bigquery): map date types correctly (#10383) 2024-04-25 22:22:37 +02:00
Harshal Sheth
e64229b036
feat(ingest/dbt): handle complex dbt sql + improve docs (#10323) 2024-04-24 11:13:32 -07:00
mrjefflewis
e4cf4de3e0
feat(ingest/mssql): improve docs on using odbc (#10370)
Co-authored-by: Jeff Lewis <jeff.lewis@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-24 13:00:45 -05:00
Camilo Gutierrez
cb6d744ae7
feat(ingestion/bigquery): support for table clones (#10274)
Co-authored-by: Equipo DataOps <cagutierra@unal.edu.co>
2024-04-24 18:04:02 +05:30
Shubham Jagtap
ca2a10e36f
fix(ingestion/qlik): Unable to ingest more than ten spaces (#10228)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-23 16:04:20 -07:00
dushayntAW
b9a34fe90b
fix(ingest/salesforce): escape markdown char for multiline description (#10351) 2024-04-23 17:05:55 +05:30
Shubham Jagtap
934ab03d16
test(ingestion/sigma): Add integration test cases (#10356) 2024-04-22 16:19:01 -07:00
Sergio
725c85815b
fix(ingest/starburst): parse create_time datetime format (#10345) 2024-04-22 09:12:41 -07:00