11753 Commits

Author SHA1 Message Date
Harshal Sheth
6c3834b38c
feat(ingest/dbt): add option to skip sources (#10077) 2024-03-21 09:10:24 +01:00
Ellie O'Neil
87169baf96
Clean up logic for dataset.py yaml loader (#10089) 2024-03-20 14:41:49 -07:00
Chris Collins
5a3df32bb5
feat(properties) Add upsertStructuredProperties graphql endpoint for assets (#9906) 2024-03-20 15:25:36 -04:00
poorvi767
c1f6efae67
feat(models) : Joins (Datasets) schema, resolvers and UI (#8325)
Co-authored-by: Raj Tekal <rtekal@gmail.com>
Co-authored-by: Raj Tekal <rtekal@users.noreply.github.com>
Co-authored-by: Raj Tekal <varadaraj_tekal@optum.com>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-03-20 10:26:25 -04:00
Sergio Gómez Villamor
70ab759cea
feat(redshift): adds flag to skip all external tables (#10040) 2024-03-20 11:04:17 +01:00
siladitya
43ac405c57
fix(metadata-ingestion)glue connector failure when Optional field Type of PartitionKey is absent for a Table (#10052) 2024-03-20 11:02:28 +01:00
Ellie O'Neil
446fbe5784
fix(ingest/slack): add rate limiting to more places in slack source (#10082) 2024-03-20 13:56:06 +05:30
Ellie O'Neil
cc0552ac80
Add owners, tags, glossary terms to dataset yaml loader (#9859) 2024-03-19 17:27:04 -07:00
david-leifker
60a12918fc
fix(lineage): fix array out of bounds error (#10081) 2024-03-19 16:50:26 -05:00
dependabot[bot]
a676aa6369
build(deps): bump es5-ext from 0.10.62 to 0.10.63 in /docs-website (#9927)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-19 14:06:17 -07:00
dependabot[bot]
49de01b3bd
build(deps): bump follow-redirects from 1.15.4 to 1.15.6 in /docs-website (#10060)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-19 14:05:59 -07:00
skrydal
9aa099f4b0
fix(ingestion): Handle Redshift string length limit in Serverless mode (#10051) 2024-03-19 18:54:41 +01:00
Ellie O'Neil
59a26a6543
Update domains docs to include nested domains (#9890)
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2024-03-19 16:17:10 +00:00
gaurav2733
11f6ab64c5
feat(ui/ingest): ingestion form for Okta and AzureAD (#9829) 2024-03-19 20:50:46 +05:30
Harshal Sheth
64cb5d1cb2
feat(dbt): show source and compiled code in the UI (#10028) 2024-03-18 18:16:49 -07:00
Harshal Sheth
1f9ce9d7d8
feat(ingest/dbt): point dbt assertions at dbt nodes (#10055) 2024-03-18 18:13:01 -07:00
Harshal Sheth
11eda4bc84
feat(ingest): refactor LineageConfig class (#10074) 2024-03-18 17:34:53 -07:00
Harshal Sheth
f4d4e791b0
feat(ingest): add sql formatter utility (#10064) 2024-03-18 17:28:32 -07:00
Harshal Sheth
630f2a13f6
feat(ingest): check for private import path usages (#10059) 2024-03-18 14:59:18 -07:00
Gabe Lyons
1248635b5a
docs(sdk): Update API guide with example for Acryl (#10072) 2024-03-18 14:55:58 -07:00
Harshal Sheth
656f94b63c
feat(ingest): better rest emitter error message (#10073) 2024-03-18 14:27:43 -07:00
Harshal Sheth
05930560cc
feat(ingest/s3): set default spark version (#10057) 2024-03-18 14:27:01 -07:00
Harshal Sheth
104e78776d
fix(ingest): only auto-enable stateful ingestion if pipeline name is set (#10075) 2024-03-18 13:59:01 -07:00
dushayntAW
3a4bdef44a
fix(ingest/unity): generate sibling and lineage (#9894) 2024-03-18 20:22:17 +05:30
Aseem Bansal
ad4da5747d
docs(acryl-cloud): notes for 0.2.16 (#10069) 2024-03-18 19:21:08 +05:30
RyanHolstien
84bdf812da
feat(lineage): add priority to via node (#10034) 2024-03-15 21:05:32 -05:00
Davi Arnaut
ecfab6b03b
chore(aws-msk-iam-auth): bump dependency version (#10063) 2024-03-15 15:02:54 -07:00
Harshal Sheth
d4d175da1a
fix(ingest/redshift): tweak lineage v2 queries (#10045) 2024-03-15 12:16:18 -07:00
Hyejin Yoon
3f858969d7
docs: improve versiondropdown design & set docs main to /features (#9994) 2024-03-15 17:43:23 +09:00
Mayuri Nehate
d3b0450e09
feat(ci): exempt more names from community (#10039) 2024-03-14 20:34:51 -07:00
gaurav2733
0f2b15c93e
fix(ui/lineage): show data is too large error when limitation exceeds (#10038) 2024-03-14 14:43:28 +05:30
Mayuri Nehate
77c72dad01
feat(ingest): add classification to bigquery, redshift (#10031) 2024-03-13 22:45:28 -07:00
Harshal Sheth
239ae31202
feat(gms): add aspect name to siblings hook log (#10044) 2024-03-13 17:01:29 -07:00
Hyejin Yoon
729090bf02
docs: add missing api sample docs (#9869)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-13 12:28:01 -07:00
Harshal Sheth
b0163c4885
feat(ingest): utilities for query logs (#10036) 2024-03-12 23:20:46 -07:00
Tamas Nemeth
4535f2adfd
fix(ingest/redshift): Temp table lineage fix (#10008)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-12 14:31:00 -07:00
Harshal Sheth
4155a621a6
feat(ingest/dbt): capture both raw and compiled code (#10026) 2024-03-12 12:54:03 -07:00
Dimitri Kopriwa
3fcc372893
docs(monitoring): add health check endpoint (#10033) 2024-03-12 09:59:01 -07:00
Mayuri Nehate
2de0e62ac4
feat(ingest): add classification for sql sources (#10013)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-12 09:23:20 -07:00
Tamas Nemeth
28f16aabb3
fix(ingest/teradata): small teradata improvements (#9953) 2024-03-12 14:22:17 +01:00
skrydal
2265ae9257
feat(ingestion): Support for Server-less Redshift (#9998)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-03-12 09:32:20 +01:00
Harshal Sheth
5937472998
feat(ingest): add DataHubGraph.emit_all method (#10002) 2024-03-11 16:36:18 -07:00
Harshal Sheth
7e2076e852
feat(ingest): add query formatting to sql aggregator (#10025) 2024-03-11 15:34:44 -07:00
Harshal Sheth
2fe3583826
feat(docs): build website using swc-loader instead of babel (#9977) 2024-03-11 15:06:39 -07:00
Harshal Sheth
20e15ffc58
feat(ingest): improve custom package metadata (#9985) 2024-03-11 14:14:59 -07:00
Harshal Sheth
92a3ac6f11
fix(ingest): use contextvar for cooperative timeout (#10021) 2024-03-11 14:14:39 -07:00
Harshal Sheth
bcae7acc51
fix(ingest/slack): tweak docs for slack source (#10007) 2024-03-11 14:14:25 -07:00
ethan-cartwright
7540e642a5
fix(ingest/redshift): patch instead of replace redshift custom properties (#9293)
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-03-11 11:16:44 -07:00
LePuppy
ae3443bcb7
feat(ingest/superset): map awsathena platform name to athena (#10005) 2024-03-11 15:23:42 +01:00
Harshal Sheth
b6956f9a5c
feat(ingest): update sqlglot fork (#10022) 2024-03-11 15:22:30 +01:00