12076 Commits

Author SHA1 Message Date
Kos Korchak
75108ceb2f
Download Lineage Results Cypress Test (#9017) 2023-10-17 14:13:31 -04:00
ethan-cartwright
ae5fd90c73
add create dataproduct example (#9009) 2023-10-17 20:25:07 +05:30
ethan-cartwright
e7c662a0ac
add dependency level to scrollAcrossLineage search results (#9016) 2023-10-17 20:24:07 +05:30
Tamas Nemeth
10eb205cb8
fix(ingest) - Fix file backed collection temp directory removal (#9027) 2023-10-17 10:16:25 -04:00
Andrew Sikowitz
9fec6024fb
feat(ingest/unity-catalog): Support external S3 lineage (#9025) 2023-10-17 09:58:38 -04:00
Andrew Sikowitz
6366b63e48
feat(ingest/teradata): Add option to not use file backed dict for view definitions (#9024) 2023-10-16 19:13:23 -04:00
Andrew Sikowitz
9ccd1d4f5d
build(ingest/redshift): Add sqlglot dependency (#9021) 2023-10-16 14:34:15 -04:00
Mayuri Nehate
c81a339bfc
build(ingest): remove ratelimiter dependency (#9008) 2023-10-16 09:27:57 -07:00
Indy Prentice
78b342f441
feat(graphql): support filtering based on greater than/less than criteria (#9001)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-10-13 19:04:44 -03:00
Tamas Nemeth
c2e8041d77
Adding missing sqlparser libs to setup.py (#9015) 2023-10-13 20:59:18 +00:00
Tamas Nemeth
1007204cda
feat(ingest/teradata): view parsing (#9005) 2023-10-13 15:07:19 -04:00
Andrew Sikowitz
6bc7425353
feat(cli/datacontract): Add data quality assertion support (#8968)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-10-13 12:36:18 -04:00
Aseem Bansal
c02cbb31e2
docs(Acryl DataHub): release notes for 0.2.12 (#9006) 2023-10-13 17:52:53 +05:30
Aseem Bansal
71c9bd3a49
ci(ingest): update base requirements (#8995) 2023-10-13 11:48:22 +05:30
Tamas Nemeth
a8f0080c08
feat(ingest/teradata): Teradata source (#8977) 2023-10-12 15:14:45 -07:00
Kos Korchak
d04d25bf42
smoke test(): Query plus filter search test (#8993) 2023-10-12 12:50:20 -07:00
Amanda Hernando
c564abcbf0
feat(auth): add group membership field resolver provider (#8846)
Co-authored-by: Adrián Pertíñez <khurzak92@gmail.com>
Co-authored-by: Adrián Pertíñez <adrian.pertinez@thoughtworks.com>
2023-10-12 11:38:42 -07:00
Pedro Silva
f6e1312063
feat(ingestion): Adds support for memory profiling (#8856)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-10-12 18:43:14 +01:00
Harshal Sheth
8813ae2fb1
feat(ingest/s3): support .gzip and fix decompression bug (#8990) 2023-10-12 13:58:10 +02:00
Tamas Nemeth
c381806110
feat(ingestion): Adding config option to auto lowercase dataset urns (#8928) 2023-10-12 13:56:30 +02:00
Tamas Nemeth
dd418de76d
fix(ingest/bigquery): Fix shard regexp to match without underscore as well (#8934) 2023-10-12 13:10:59 +02:00
Harshal Sheth
84bba4dc44
feat(ingest): add output schema inference for sql parser (#8989) 2023-10-11 22:31:17 -07:00
Sergio Gómez Villamor
245c5c0008
fix(ingest/looker): stop emitting tag owner (#8942) 2023-10-11 17:06:19 -07:00
jayasimhankv
245284ec6c
fix(): Display generic not found page for corp groups that do not exist (#8880)
Co-authored-by: Jay Kadambi <jayasimhan_venkatadri@optum.com>
2023-10-11 22:40:20 +00:00
Mayuri Nehate
1b06c6a30c
fix(ingest/snowflake): fix sample fraction for very large tables (#8988) 2023-10-11 12:01:42 -07:00
Harshal Sheth
932fbcddbf
refactor(ingest/dbt): move dbt tests logic to dedicated file (#8984) 2023-10-11 11:17:02 -07:00
Harsha Mandadi
4b6b941a2a
fix(ingest): Fix postgres lineage within views (#8906)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Maggie Hays <maggiem.hays@gmail.com>
2023-10-11 14:01:46 -04:00
siddiquebagwan-gslab
10a190470e
feat(ingestion/redshift): CLL support in redshift (#8921) 2023-10-10 20:24:08 -07:00
Sergio Gómez Villamor
dfcea2441e
feat(config): configurable bootstrap policies file (#8812)
Co-authored-by: John Joyce <john@acryl.io>
2023-10-11 01:04:44 +00:00
siladitya
a17db676e3
feat(graphql): Added datafetcher for DataPlatformInstance entity (#8935)
Co-authored-by: si-chakraborty <si.chakraborty@adevinta.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-10-11 00:43:36 +00:00
Amanda Hernando
e2988017c2
feat(auth): add data platform instance field resolver provider (#8828)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
Co-authored-by: Adrián Pertíñez <khurzak92@gmail.com>
2023-10-10 16:36:01 -07:00
Andrew Sikowitz
1a72fa499c
feat(ingest/tableau): Allow parsing of database name from fullName (#8981) 2023-10-10 17:34:06 -04:00
Aseem Bansal
6ecdeda5ff
fix(setup): drop older table if exists (#8979) 2023-10-10 16:28:40 +05:30
Aseem Bansal
bb39d5418f
fix(lint): run black, isort (#8978) 2023-10-10 16:08:34 +05:30
Mayuri Nehate
57f855ecd1
feat(ingest): refactor + simplify incremental lineage helper (#8976) 2023-10-09 23:48:21 -07:00
Mayuri Nehate
8d175ef7ef
feat(ingest): incremental lineage source helper (#8941)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-10-09 13:34:25 -07:00
Andrew Sikowitz
93958302d5
feat(models/assertion): Add SQL Assertions (#8969) 2023-10-08 13:26:48 -04:00
Kos Korchak
b191abbc5b
test(): Nested domains cypress test (#8879) 2023-10-06 14:11:57 -07:00
Kos Korchak
c0feceb76f
test(): Manage Access Tokens Cypress test (#8936) 2023-10-06 14:10:24 -07:00
Mayuri Nehate
8e7f286e71
feat(ingest/snowflake): support profiling with sampling (#8902)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-10-06 10:42:39 -04:00
Andrew Sikowitz
c80da8f949
feat(ingest/unity): Use ThreadPoolExecutor for CLL (#8952) 2023-10-06 10:06:36 -04:00
Hyejin Yoon
ea87febd2b
fix: add retry for fetch_url (#8958) 2023-10-06 14:36:32 +09:00
Andrew Sikowitz
26bc039b96
fix(ingest/unity): Remove metastore from ingestion and urns; standardize platform instance; add notebook filter (#8943) 2023-10-05 23:23:15 -04:00
Patrick Franco Braz
debac3cf5c
refactor(boot): increases wait timeout for servlets initialization (#8947)
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2023-10-05 15:47:10 -05:00
Harshal Sheth
3cede10ab3
feat(ingest/dbt): support use_compiled_code and test_warnings_are_errors (#8956) 2023-10-05 10:29:47 -07:00
Shirshanka Das
c9309ff157
feat(ci): enable ci to run on PR-s targeting all branches (#8933) 2023-10-05 09:07:12 -07:00
Jinlin Yang
6310e51eb0
feat(ingestion/dynamodb): implement pagination for list_tables (#8910) 2023-10-05 09:33:31 +05:30
Mayuri Nehate
2fcced6db9
docs(ingest): add permissions required for athena ingestion (#8948) 2023-10-05 09:31:57 +05:30
Aseem Bansal
2bc685d3b9
ci: tweak ci to decrease wait time of devs (#8945) 2023-10-05 09:31:32 +05:30
Harshal Sheth
817c371fbf
feat: data contracts models + CLI (#8923)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: John Joyce <john@acryl.io>
2023-10-04 20:11:06 -07:00