8209 Commits

Author SHA1 Message Date
Tamas Nemeth
a91c78cf31
fix(ingest/s3): fix test flakiness (#8416) 2023-07-14 00:42:00 +02:00
Ellie O'Neil
83ebeb207d
docs(perf-test) Update README (#8410) 2023-07-13 17:34:26 +05:30
mohdsiddique
cbbe083731
fix(ingestion/powerbi): increment msal version (#8385)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
2023-07-13 17:33:19 +05:30
Mayuri Nehate
a488557962
feat(ingest/kafka-connect): allow setting platform_instance for kafka… (#8299) 2023-07-13 16:00:42 +05:30
Aseem Bansal
a8d822d874
chore(stats): change default stats lookback (#8408) 2023-07-13 13:23:47 +05:30
Pedro Silva
e32d552039
fix(owner): Corrects ownership aspect generation during update operations (#8399) 2023-07-13 12:58:43 +05:30
Mayuri Nehate
60b9623675
fix(ingest/tableau): graceful handling of get all datasources failure (#8406) 2023-07-13 12:58:19 +05:30
Andrew Sikowitz
6ce157d0ff
docs(ingest): Add warning for Python 3.7 deprecation (#8411) 2023-07-13 12:57:52 +05:30
Andrew Sikowitz
851c5bab9e
test(ingest/minio): Configure delta lake minio tests for arm64 (#8364)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-07-13 02:41:07 -04:00
Đặng Minh Dũng
64bcc132a3
feat(ingest/airflow): able to set platform_instance in Dataset (#8313)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-07-12 19:37:36 -04:00
Indy Prentice
61a1f5775c
feat(openapi): Add openapi endpoint for getting task status (#8391)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-12 17:29:03 -03:00
Tamas Nemeth
54c7aef1bc
feat(ingest/presto-on-hive): Extracting all the table properties from Hive Metastore (#8348)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-12 15:56:13 -03:00
Indy Prentice
a884cf3f90
feat(elasticsearch): optimization to reindex instead of deleteByQuery (#8352) 2023-07-12 17:12:23 +05:30
Mayuri Nehate
a2fc02294c
fix(ingest/snowflake): fix azure cloud region ids in external url (#8376)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-12 17:11:33 +05:30
Harshal Sheth
ae7e3c2080
feat(ingest/dbt-cloud): reduce graphql query complexity (#8390) 2023-07-12 17:11:13 +05:30
Andrew Sikowitz
ea3e119210
test(ingest/kafka-connect): Attempt to fix flaky test (#8404) 2023-07-12 00:46:10 -04:00
Sheerapthinath
e53d220961
feat(ingest): datamodel to ingest organisation role metadata for a dataset (#8267)
Co-authored-by: John Joyce <john@acryl.io>
2023-07-11 20:17:57 -07:00
Harshal Sheth
ffd14eebf1
fix(ingest/bigquery): skip self-references when generating lineage (#8403) 2023-07-11 21:30:57 -04:00
Andrew Sikowitz
71f80b6207
test(ingest/testing-utils): Add back delta info ignore path (#8402) 2023-07-11 20:57:29 -04:00
sudhakara
779d692cdc
refactor(ui): uniform ordering of items on the entities sidebar section (#8365)
Co-authored-by: sudhakara.st <sst@zynga.com>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: Joshua Eilers <josh.eilers@acryl.io>
2023-07-11 14:09:54 -07:00
Andrew Sikowitz
75b79e160a
build(ingest): Inline import testing utils for check cli (#8400) 2023-07-11 16:40:20 -04:00
Harshal Sheth
d4135d57b7
feat(ingest/bigquery): support column-level lineage (#8382) 2023-07-11 11:12:51 -07:00
Andrew Sikowitz
759d0c86af
test(ingest/airflow): Fix test for airflow 2.6.3 (#8393) 2023-07-11 12:55:32 -04:00
Andrew Sikowitz
2261531e31
test(ingest): Aspect level golden file comparison (#8310) 2023-07-11 10:39:47 -04:00
Chris Collins
18c1f12436
feat(ui) Allow a configurable default tab for domain entity profile page (#8316) 2023-07-11 10:30:47 -04:00
Shirshanka Das
b97e9b5b53
refactor(graphql): make graphql engine extensible (#8394) 2023-07-10 23:53:14 -07:00
Segun Sogunle
d8888cf0b7
feat(ingest): Add disable flag for TopicRecordNameStrategy (#8224)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-10 11:51:48 -07:00
Tamas Nemeth
e4736d7b46
fix(ingest/s3): Deequ import rearragement (#8389) 2023-07-10 14:40:06 -04:00
Felix Lüdin
64697eb5a0
fix(ui): fix a too much recursion error when column lineage is highlighted (#8207)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-07-10 13:47:46 -04:00
Andrew Sikowitz
d92cbe99e0
test(ingest/kafka): Configure kafka connect tests for arm64 (#8362) 2023-07-10 12:27:29 -04:00
Chris Collins
12543bca33
fix(config) Set search and browse flags default off (#8378) 2023-07-10 11:57:35 -04:00
Harshal Sheth
3e47b3d228
feat(ingest): schema-aware SQL parsing for column-level lineage (#8334) 2023-07-07 16:24:35 -07:00
Andrew Sikowitz
1f84bf5b2b
fix(ingest/sql-common): Fix profile_table_level_only (#8331)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-07 19:05:50 -04:00
Andrew Sikowitz
8617e072fa
build(ingest): Pin pydeequ to unblock CI (#8381) 2023-07-07 16:18:52 -04:00
Andrew Sikowitz
74301ecb60
test(ingest/nifi): Configure nifi tests for arm64 (#8363)
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2023-07-07 12:43:01 -04:00
Harshal Sheth
4daee108c2
chore(ingest/delta-lake): cleanup import error handling (#8230)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-07-06 16:53:03 -04:00
Andrew Sikowitz
3a21c27f06
feat(ingest): Turn on browse path v2 creation (#8342)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-06 16:43:42 -04:00
Segun Sogunle
b8f5074763
fix(cli): local variable reference before assignment (#8222)
Co-authored-by: John Joyce <john@acryl.io>
2023-07-06 13:16:46 -07:00
Mayuri Nehate
8cf778dc9b
fix(ingest): update pydantic helpers to address unique name issue (#8324)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-07-06 13:16:07 -07:00
Dmitry Bryazgin
294857ab8d
feat(ingest): Add advanced configuration for LDAP manager ingestion (#7784)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-06 13:15:16 -07:00
Chris Collins
5d3c6a8a00
fix(java) Add try catch block when backfilling browse v2 (#8377) 2023-07-06 15:41:38 -04:00
david-leifker
217151ea55
fix(schema-registry): fix internal schema reg with custom duhe topic … (#8371) 2023-07-06 14:15:58 -05:00
Joshua Eilers
c57037eb86
feat(stats): show size in bytes and scale at y=min (#8375) 2023-07-06 17:19:40 +00:00
david-leifker
91ebb0706a
chore(smoke-test): use a more recent ingestion cli version in tests (#8374) 2023-07-06 10:42:47 -05:00
david-leifker
a5f420ffd4
feat(browsepathv2): enable incremental update browsepath (#8354) 2023-07-06 10:42:07 -05:00
Harshal Sheth
393b5a3039
ci(docs): add missing deps for lxml package for vercel (#8372) 2023-07-05 15:21:27 -07:00
Joshua Eilers
3207e732da
fix(browse): filter entities by whether they might exist in the instance (#8355) 2023-07-05 20:39:00 +00:00
Andrew Sikowitz
afbd52bdf0
test(ingest/mysql): Configure sql_server tests for arm64 (#8360)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-07-05 13:41:24 -04:00
Chris Collins
0f2a21df4e
fix(ui) Update copy of the demo site acryl banner (#8370) 2023-07-05 13:11:44 -04:00
Francesco Macagno
5901e94ee0
fix(ingest/airflow): Remove info log on import (#8246)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-07-05 11:56:59 +02:00