3089 Commits

Author SHA1 Message Date
Harshal Sheth
5937472998
feat(ingest): add DataHubGraph.emit_all method (#10002) 2024-03-11 16:36:18 -07:00
Harshal Sheth
7e2076e852
feat(ingest): add query formatting to sql aggregator (#10025) 2024-03-11 15:34:44 -07:00
Harshal Sheth
92a3ac6f11
fix(ingest): use contextvar for cooperative timeout (#10021) 2024-03-11 14:14:39 -07:00
Harshal Sheth
bcae7acc51
fix(ingest/slack): tweak docs for slack source (#10007) 2024-03-11 14:14:25 -07:00
ethan-cartwright
7540e642a5
fix(ingest/redshift): patch instead of replace redshift custom properties (#9293)
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-03-11 11:16:44 -07:00
LePuppy
ae3443bcb7
feat(ingest/superset): map awsathena platform name to athena (#10005) 2024-03-11 15:23:42 +01:00
Harshal Sheth
b6956f9a5c
feat(ingest): update sqlglot fork (#10022) 2024-03-11 15:22:30 +01:00
Harshal Sheth
6227754720
feat(ingest/redshift): make query generation configurable (#10000) 2024-03-07 10:19:01 -08:00
dushayntAW
e963047dd0
fix(ingest/unity): creating group urn in case of group (#9951) 2024-03-07 14:44:06 +05:30
Mayuri Nehate
8047d0b514
feat(ingest/snowflake): generate query nodes for snowflake (#9966)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-06 15:11:37 -08:00
dushayntAW
68a26b47b2
fix(ingest/delta-lake): support parsing nested types correctly (#9862) 2024-03-06 19:22:01 +05:30
Harshal Sheth
4fbe8146a4
fix(ingest/redshift): fix stl scan lineage for lineage v2 (#9986) 2024-03-06 09:15:53 +01:00
Harshal Sheth
ab12385cd8
fix(ingest): only import PathSpec when necessary (#9989) 2024-03-05 14:59:07 -08:00
Tamas Nemeth
f597800953
feat(ingestion/cli): Adding check option to validate allow/deny and path_specs (#9983) 2024-03-05 20:29:08 +01:00
Shubham Jagtap
fda5eb89f7
feat(ingest): enable stateful_ingestion by default for DataHub rest sink (#9934) 2024-03-05 11:18:03 -08:00
Harshal Sheth
4189ca9532
feat(ingest/dbt): generate CLL for all node types (#9964) 2024-03-05 10:07:03 -08:00
Shubham Jagtap
4d053f1ad3
fix(ingestion/fivetran): Fix fivetran get connector jobs bug (#9975) 2024-03-05 17:31:28 +01:00
AvaniSiddhapuraAPT
782d33db99
fix(ingest/bigquery): escape special characters for table descriptions (#9932) 2024-03-05 21:00:09 +05:30
Harshal Sheth
5bee25fa20
feat(ingest): add Looks subtype + stop reemitting browsePathV2 (#9978) 2024-03-05 14:27:41 +01:00
Hyejin Yoon
67406aa218
docs: archive old version before 0.12.0 & fix broken links (#9957)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-05 16:05:26 +09:00
Harshal Sheth
70adf73081
fix(ingest/redshift): fix bug in lineage v2 table renames (#9967) 2024-03-04 13:31:11 +01:00
AvaniSiddhapuraAPT
1b4f31bcfe
fix(ingest/json-schema): adding support descriptions for array (#9757) 2024-03-01 13:03:47 -08:00
Harshal Sheth
29274c1be4
feat(ingest/sql-parser): add alias for mariadb (#9956) 2024-02-29 12:11:57 -08:00
david-leifker
ed10a8d8cc
feat(search): search access controls (#9892)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-02-28 16:57:26 -06:00
Harshal Sheth
1736edf8f5
feat(ingest): fix bugs in SqlParsingAggregator (#9926) 2024-02-28 15:06:33 +01:00
Aditya Malik
92b1cfa194
feat(ingest): Support for JSONL in s3 source with max_rows support (#9921)
Co-authored-by: Aditya <aditya.malik@quillbot.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-28 15:05:30 +01:00
Harshal Sheth
f399a872ad
feat(ingest/patch): add helper for auto-quoting (#9938) 2024-02-28 15:03:09 +01:00
Tamas Nemeth
f561efee83
fix(ingest/mysql): Adding support for bit type (#9950) 2024-02-28 15:00:14 +01:00
RyanHolstien
ddf0b7d2cd
feat(patch): refactor cll patch (#9922)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-27 12:00:44 -06:00
Aseem Bansal
336d0543c1
feat(ingest/csv-enricher): add support for ownership type urn (#9935) 2024-02-27 17:47:04 +00:00
Aseem Bansal
7ee86bbb84
feat(ingest/slack): add option to ingest slack channels (#9884) 2024-02-27 16:31:52 +05:30
Tamas Nemeth
d2d9661a1e
fix(ingest/patch): Adding proper json patch path quoting (#9872) 2024-02-26 18:46:21 -08:00
Harshal Sheth
ca613ba0e2
feat(ingest/tableau): add non-embedded custom sql to project container (#9875) 2024-02-26 15:08:17 -08:00
Shubham Jagtap
a1f2216da7
feat(ingest/qlik): Qlik cloud connector integration (#9682)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-26 11:27:37 -08:00
Shubham Jagtap
5921a334d3
feat(ingestion/trino): Add sibling support in ingestion (#9853) 2024-02-26 13:55:11 +05:30
Harshal Sheth
392158809d
feat(ingest/redshift): redshift lineage v2 (#9904) 2024-02-23 16:32:51 -08:00
Steven Ayers
def4b24bb7
fix(cli): add-sibling preserve existing siblings (#9907) 2024-02-23 11:30:17 -08:00
Harshal Sheth
b01416c11b
feat(ingest): add timeout to sqlglot parser (#9868) 2024-02-23 11:11:02 -08:00
Harshal Sheth
60e4b2de2e
feat(ingest/snowflake): speed up snowflake usage query (#9899) 2024-02-21 15:44:56 -08:00
Tony Ouyang
943edc3462
feat(ingest/mongodb): improve sorting when downsampling collection schema (#9856) 2024-02-21 15:25:29 -08:00
Harshal Sheth
ef3a8148ec
fix(ingest): bump sqlglot + add some debug info to tests (#9867) 2024-02-21 13:07:59 -08:00
Harshal Sheth
b15b352a00
fix(ingest): better logging line attribution (#9876) 2024-02-21 11:37:57 -08:00
Harshal Sheth
f13ae77966
feat(ingest): add escape hatch methods to SqlParsingAggregator (#9860) 2024-02-21 11:33:05 -08:00
Andrew Jones
66871cb81d
fix(ingest/redash): Limit size of RedashSourceReport (#9873) 2024-02-20 17:48:43 -08:00
Jay Feldman
cda34b50fc
fix(ingest/looker): update for Looker query API breaking change (#9865) 2024-02-15 16:08:01 -08:00
Tony Ouyang
ae1806fefa
feat(ingest/dynamoDB): flatten struct fields (#9852)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-02-15 13:40:03 -08:00
Harshal Sheth
29ca570f29
feat(ingest): clean up reporting methods (#9848) 2024-02-15 02:28:05 -05:00
Harshal Sheth
045c76a0e4
feat(ingest): reporting logging tweaks (#9835) 2024-02-14 11:06:03 -08:00
Chris Collins
8f89ec7f67
fix(forms) Prevent schema field prompts from being required (#9831) 2024-02-14 10:01:00 -05:00
Tamas Nemeth
89018e26fd
fix(ingest/profiling): ignore limit/offset when counting table row count in profiling (#9635) 2024-02-12 16:06:29 -08:00