10338 Commits

Author SHA1 Message Date
Harshal Sheth
1f9ce9d7d8
feat(ingest/dbt): point dbt assertions at dbt nodes (#10055) 2024-03-18 18:13:01 -07:00
Harshal Sheth
11eda4bc84
feat(ingest): refactor LineageConfig class (#10074) 2024-03-18 17:34:53 -07:00
Harshal Sheth
f4d4e791b0
feat(ingest): add sql formatter utility (#10064) 2024-03-18 17:28:32 -07:00
Harshal Sheth
630f2a13f6
feat(ingest): check for private import path usages (#10059) 2024-03-18 14:59:18 -07:00
Gabe Lyons
1248635b5a
docs(sdk): Update API guide with example for Acryl (#10072) 2024-03-18 14:55:58 -07:00
Harshal Sheth
656f94b63c
feat(ingest): better rest emitter error message (#10073) 2024-03-18 14:27:43 -07:00
Harshal Sheth
05930560cc
feat(ingest/s3): set default spark version (#10057) 2024-03-18 14:27:01 -07:00
Harshal Sheth
104e78776d
fix(ingest): only auto-enable stateful ingestion if pipeline name is set (#10075) 2024-03-18 13:59:01 -07:00
dushayntAW
3a4bdef44a
fix(ingest/unity): generate sibling and lineage (#9894) 2024-03-18 20:22:17 +05:30
Aseem Bansal
ad4da5747d
docs(acryl-cloud): notes for 0.2.16 (#10069) 2024-03-18 19:21:08 +05:30
RyanHolstien
84bdf812da
feat(lineage): add priority to via node (#10034) 2024-03-15 21:05:32 -05:00
Davi Arnaut
ecfab6b03b
chore(aws-msk-iam-auth): bump dependency version (#10063) 2024-03-15 15:02:54 -07:00
Harshal Sheth
d4d175da1a
fix(ingest/redshift): tweak lineage v2 queries (#10045) 2024-03-15 12:16:18 -07:00
Hyejin Yoon
3f858969d7
docs: improve versiondropdown design & set docs main to /features (#9994) 2024-03-15 17:43:23 +09:00
Mayuri Nehate
d3b0450e09
feat(ci): exempt more names from community (#10039) 2024-03-14 20:34:51 -07:00
gaurav2733
0f2b15c93e
fix(ui/lineage): show data is too large error when limitation exceeds (#10038) 2024-03-14 14:43:28 +05:30
Mayuri Nehate
77c72dad01
feat(ingest): add classification to bigquery, redshift (#10031) 2024-03-13 22:45:28 -07:00
Harshal Sheth
239ae31202
feat(gms): add aspect name to siblings hook log (#10044) 2024-03-13 17:01:29 -07:00
Hyejin Yoon
729090bf02
docs: add missing api sample docs (#9869)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-13 12:28:01 -07:00
Harshal Sheth
b0163c4885
feat(ingest): utilities for query logs (#10036) 2024-03-12 23:20:46 -07:00
Tamas Nemeth
4535f2adfd
fix(ingest/redshift): Temp table lineage fix (#10008)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-12 14:31:00 -07:00
Harshal Sheth
4155a621a6
feat(ingest/dbt): capture both raw and compiled code (#10026) 2024-03-12 12:54:03 -07:00
Dimitri Kopriwa
3fcc372893
docs(monitoring): add health check endpoint (#10033) 2024-03-12 09:59:01 -07:00
Mayuri Nehate
2de0e62ac4
feat(ingest): add classification for sql sources (#10013)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-12 09:23:20 -07:00
Tamas Nemeth
28f16aabb3
fix(ingest/teradata): small teradata improvements (#9953) 2024-03-12 14:22:17 +01:00
skrydal
2265ae9257
feat(ingestion): Support for Server-less Redshift (#9998)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-03-12 09:32:20 +01:00
Harshal Sheth
5937472998
feat(ingest): add DataHubGraph.emit_all method (#10002) 2024-03-11 16:36:18 -07:00
Harshal Sheth
7e2076e852
feat(ingest): add query formatting to sql aggregator (#10025) 2024-03-11 15:34:44 -07:00
Harshal Sheth
2fe3583826
feat(docs): build website using swc-loader instead of babel (#9977) 2024-03-11 15:06:39 -07:00
Harshal Sheth
20e15ffc58
feat(ingest): improve custom package metadata (#9985) 2024-03-11 14:14:59 -07:00
Harshal Sheth
92a3ac6f11
fix(ingest): use contextvar for cooperative timeout (#10021) 2024-03-11 14:14:39 -07:00
Harshal Sheth
bcae7acc51
fix(ingest/slack): tweak docs for slack source (#10007) 2024-03-11 14:14:25 -07:00
ethan-cartwright
7540e642a5
fix(ingest/redshift): patch instead of replace redshift custom properties (#9293)
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-03-11 11:16:44 -07:00
LePuppy
ae3443bcb7
feat(ingest/superset): map awsathena platform name to athena (#10005) 2024-03-11 15:23:42 +01:00
Harshal Sheth
b6956f9a5c
feat(ingest): update sqlglot fork (#10022) 2024-03-11 15:22:30 +01:00
david-leifker
4dddd7f448
fix(openapi): fix openapi openlineage endpoint (#10019) 2024-03-08 14:38:54 -06:00
Andrew Sikowitz
28b11d4276
refactor(react): Provide option to skip importing theme in CustomThemeProvider; rearrange toplevel components (#9940) 2024-03-08 12:16:53 -08:00
Davi Arnaut
927775d2fa
feat(opensearch): support for updating ISM policy used for usage events (#10018) 2024-03-08 10:28:45 -08:00
david-leifker
e1c4f61890
fix(policy-backfull): fix policy backfill job (#10016) 2024-03-08 11:52:33 -06:00
gaurav2733
937f58be45
fix(ui/ingest): trim leading and trailing whitespaces from the text (#10012) 2024-03-08 19:33:38 +05:30
Sumit Patil
6e8a2eb1dd
ci(react): Update package.json to enable lint check (#10011) 2024-03-07 19:29:34 -08:00
david-leifker
03a677af93
chore(java): bump java dependency versions (#10009) 2024-03-07 14:15:22 -06:00
Davi Arnaut
c4a453204c
fix(opensearch): Rollover usage events at a file size rather than time-based manner (#10006) 2024-03-07 10:32:16 -08:00
Harshal Sheth
6227754720
feat(ingest/redshift): make query generation configurable (#10000) 2024-03-07 10:19:01 -08:00
gaurav2733
7d105477bc
fix(ui/browse): hide data products option in left side bar (#10001) 2024-03-07 14:46:26 +05:30
dushayntAW
e963047dd0
fix(ingest/unity): creating group urn in case of group (#9951) 2024-03-07 14:44:06 +05:30
Mayuri Nehate
8047d0b514
feat(ingest/snowflake): generate query nodes for snowflake (#9966)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-06 15:11:37 -08:00
Harshal Sheth
7de517c363
fix(ci): refactor build-and-test command (#9999) 2024-03-06 13:43:05 -06:00
david-leifker
1b3bbf8234
fix(test): nested domains (#9993) 2024-03-06 09:21:42 -06:00
dushayntAW
68a26b47b2
fix(ingest/delta-lake): support parsing nested types correctly (#9862) 2024-03-06 19:22:01 +05:30