11753 Commits

Author SHA1 Message Date
Mayuri Nehate
60b9623675
fix(ingest/tableau): graceful handling of get all datasources failure (#8406) 2023-07-13 12:58:19 +05:30
Andrew Sikowitz
6ce157d0ff
docs(ingest): Add warning for Python 3.7 deprecation (#8411) 2023-07-13 12:57:52 +05:30
Andrew Sikowitz
851c5bab9e
test(ingest/minio): Configure delta lake minio tests for arm64 (#8364)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-07-13 02:41:07 -04:00
Đặng Minh Dũng
64bcc132a3
feat(ingest/airflow): able to set platform_instance in Dataset (#8313)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-07-12 19:37:36 -04:00
Indy Prentice
61a1f5775c
feat(openapi): Add openapi endpoint for getting task status (#8391)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-12 17:29:03 -03:00
Tamas Nemeth
54c7aef1bc
feat(ingest/presto-on-hive): Extracting all the table properties from Hive Metastore (#8348)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-12 15:56:13 -03:00
Indy Prentice
a884cf3f90
feat(elasticsearch): optimization to reindex instead of deleteByQuery (#8352) 2023-07-12 17:12:23 +05:30
Mayuri Nehate
a2fc02294c
fix(ingest/snowflake): fix azure cloud region ids in external url (#8376)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-12 17:11:33 +05:30
Harshal Sheth
ae7e3c2080
feat(ingest/dbt-cloud): reduce graphql query complexity (#8390) 2023-07-12 17:11:13 +05:30
Andrew Sikowitz
ea3e119210
test(ingest/kafka-connect): Attempt to fix flaky test (#8404) 2023-07-12 00:46:10 -04:00
Sheerapthinath
e53d220961
feat(ingest): datamodel to ingest organisation role metadata for a dataset (#8267)
Co-authored-by: John Joyce <john@acryl.io>
2023-07-11 20:17:57 -07:00
Harshal Sheth
ffd14eebf1
fix(ingest/bigquery): skip self-references when generating lineage (#8403) 2023-07-11 21:30:57 -04:00
Andrew Sikowitz
71f80b6207
test(ingest/testing-utils): Add back delta info ignore path (#8402) 2023-07-11 20:57:29 -04:00
sudhakara
779d692cdc
refactor(ui): uniform ordering of items on the entities sidebar section (#8365)
Co-authored-by: sudhakara.st <sst@zynga.com>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: Joshua Eilers <josh.eilers@acryl.io>
2023-07-11 14:09:54 -07:00
Andrew Sikowitz
75b79e160a
build(ingest): Inline import testing utils for check cli (#8400) 2023-07-11 16:40:20 -04:00
Harshal Sheth
d4135d57b7
feat(ingest/bigquery): support column-level lineage (#8382) 2023-07-11 11:12:51 -07:00
Andrew Sikowitz
759d0c86af
test(ingest/airflow): Fix test for airflow 2.6.3 (#8393) 2023-07-11 12:55:32 -04:00
Andrew Sikowitz
2261531e31
test(ingest): Aspect level golden file comparison (#8310) 2023-07-11 10:39:47 -04:00
Chris Collins
18c1f12436
feat(ui) Allow a configurable default tab for domain entity profile page (#8316) 2023-07-11 10:30:47 -04:00
Shirshanka Das
b97e9b5b53
refactor(graphql): make graphql engine extensible (#8394) 2023-07-10 23:53:14 -07:00
Segun Sogunle
d8888cf0b7
feat(ingest): Add disable flag for TopicRecordNameStrategy (#8224)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-10 11:51:48 -07:00
Tamas Nemeth
e4736d7b46
fix(ingest/s3): Deequ import rearragement (#8389) 2023-07-10 14:40:06 -04:00
Felix Lüdin
64697eb5a0
fix(ui): fix a too much recursion error when column lineage is highlighted (#8207)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-07-10 13:47:46 -04:00
Andrew Sikowitz
d92cbe99e0
test(ingest/kafka): Configure kafka connect tests for arm64 (#8362) 2023-07-10 12:27:29 -04:00
Chris Collins
12543bca33
fix(config) Set search and browse flags default off (#8378) 2023-07-10 11:57:35 -04:00
Harshal Sheth
3e47b3d228
feat(ingest): schema-aware SQL parsing for column-level lineage (#8334) 2023-07-07 16:24:35 -07:00
Andrew Sikowitz
1f84bf5b2b
fix(ingest/sql-common): Fix profile_table_level_only (#8331)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-07 19:05:50 -04:00
Andrew Sikowitz
8617e072fa
build(ingest): Pin pydeequ to unblock CI (#8381) 2023-07-07 16:18:52 -04:00
Andrew Sikowitz
74301ecb60
test(ingest/nifi): Configure nifi tests for arm64 (#8363)
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2023-07-07 12:43:01 -04:00
Harshal Sheth
4daee108c2
chore(ingest/delta-lake): cleanup import error handling (#8230)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-07-06 16:53:03 -04:00
Andrew Sikowitz
3a21c27f06
feat(ingest): Turn on browse path v2 creation (#8342)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-06 16:43:42 -04:00
Segun Sogunle
b8f5074763
fix(cli): local variable reference before assignment (#8222)
Co-authored-by: John Joyce <john@acryl.io>
2023-07-06 13:16:46 -07:00
Mayuri Nehate
8cf778dc9b
fix(ingest): update pydantic helpers to address unique name issue (#8324)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-07-06 13:16:07 -07:00
Dmitry Bryazgin
294857ab8d
feat(ingest): Add advanced configuration for LDAP manager ingestion (#7784)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-06 13:15:16 -07:00
Chris Collins
5d3c6a8a00
fix(java) Add try catch block when backfilling browse v2 (#8377) 2023-07-06 15:41:38 -04:00
david-leifker
217151ea55
fix(schema-registry): fix internal schema reg with custom duhe topic … (#8371) 2023-07-06 14:15:58 -05:00
Joshua Eilers
c57037eb86
feat(stats): show size in bytes and scale at y=min (#8375) 2023-07-06 17:19:40 +00:00
david-leifker
91ebb0706a
chore(smoke-test): use a more recent ingestion cli version in tests (#8374) 2023-07-06 10:42:47 -05:00
david-leifker
a5f420ffd4
feat(browsepathv2): enable incremental update browsepath (#8354) 2023-07-06 10:42:07 -05:00
Harshal Sheth
393b5a3039
ci(docs): add missing deps for lxml package for vercel (#8372) 2023-07-05 15:21:27 -07:00
Joshua Eilers
3207e732da
fix(browse): filter entities by whether they might exist in the instance (#8355) 2023-07-05 20:39:00 +00:00
Andrew Sikowitz
afbd52bdf0
test(ingest/mysql): Configure sql_server tests for arm64 (#8360)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-07-05 13:41:24 -04:00
Chris Collins
0f2a21df4e
fix(ui) Update copy of the demo site acryl banner (#8370) 2023-07-05 13:11:44 -04:00
Francesco Macagno
5901e94ee0
fix(ingest/airflow): Remove info log on import (#8246)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-07-05 11:56:59 +02:00
Tamas Nemeth
74ab1bea06
fix(ingest/s3): Fix for flaky s3 test - uploading s3 files in consistent order (#8367) 2023-07-04 19:19:39 +02:00
skrydal
cfa864e418
feat(auth): Fine grained ownership policies (#7499)
Co-authored-by: davidlacedonia <davidlacedonia@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-07-03 09:44:22 -07:00
RyanHolstien
10e5ecf6d2
fix(async): submit additional default aspects only when not in async mode (#8320) 2023-06-30 15:56:12 -05:00
Ellie O'Neil
ac4af259f2
docs(lineage): add read lineage example (#8322) 2023-06-30 08:48:05 -07:00
Indy Prentice
52c9eb9370
fix(restli): Add docs for get task status, and fix hostname regex (#8341)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-30 17:53:58 +05:30
Andrew Sikowitz
72a41ef9f6
test(ingest/trino): xfail test to unblock CI (#8340) 2023-06-30 17:51:50 +05:30