852 Commits

Author SHA1 Message Date
Aditya Radhakrishnan
0ff7bea043
fix(smoke-test): fix native user and access token tests (#7628) 2023-03-20 16:04:42 -05:00
Aseem Bansal
2ef26e8b74
fix(policies): add missing policies, add check to prevent problems (#7586)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-16 09:49:55 +05:30
Aseem Bansal
b039ad1176
refactor: misc fixes logging, annotations (#7579)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-16 09:49:35 +05:30
Aseem Bansal
776806d348
fix(gms): convert obj to string, fix wrong setup (#7582) 2023-03-15 03:02:30 +05:30
Indy Prentice
7914e15ed4
fix(logging): increase log level for system-upgrade job to complete before starting (#7566)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-03-14 11:38:04 -05:00
Aseem Bansal
39f7f74329
chore(ci): add daylight savings timezone for tests, fix daylight saving bug in analytics charts (#7484) 2023-03-14 16:12:29 +05:30
david-leifker
72198f98c0
feat(search): searchAcrossEntities/Lineage improvements (#7550)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-12 18:18:51 -07:00
Shirshanka Das
9a3d3b40ef
feat(openapi): add relationships endpoint (#7547) 2023-03-11 17:25:50 -08:00
John Joyce
947990ac8b
fix(): Fix Query Detail Modal Scroll + add misc log messages (#7530) 2023-03-09 18:02:13 -08:00
RyanHolstien
4e250cbd51
feat(elasticsearch): support searchAfter (#7235) 2023-02-22 19:03:14 -06:00
RyanHolstien
98f3f93442
feat(auth): REST API authorization (#6614) 2023-02-22 15:45:45 -06:00
Pedro Silva
4f8a5c3800
feat(timeBasedLineage): add feature flag for always producing MCL (#7407) 2023-02-22 15:52:51 +00:00
david-leifker
ebec860bce
fix(search): fix search filters, handle detection of keyword subfield (#7372) 2023-02-20 19:27:10 -06:00
John Joyce
92cd2b2c1b
fix(lineage): Fix Upstream + Downstream Count in presence of Soft-Deleted / Non-Existent references (#7374) 2023-02-20 14:00:14 -08:00
John Joyce
08a215951c
feat(queries): Overhaul Queries Tab (#7366) 2023-02-20 11:10:18 -08:00
RyanHolstien
31ee8aacec
fix(search): support searchFlags for GraphQL (#7346)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-16 13:26:21 -06:00
david-leifker
267472ccbb
gradle(development): add additional commands for development (#7321) 2023-02-16 10:41:42 -06:00
RyanHolstien
bc61d1e446
fix(homepage): make entity counts execute in parallel and make cache configurable (#7249) 2023-02-14 07:42:39 -06:00
John Joyce
21d9cb62d8
fix(tracking): Remove 'title' field from tracking (#7328) 2023-02-13 13:47:05 -08:00
Felix Lüdin
da2b0c9e1b
fix(docs): sort sources by display name in doc's sidebar (#7322) 2023-02-13 12:39:54 -08:00
Aseem Bansal
a60d27b40f
fix(bootstrap): do not re-run retention policy ingestion (#7295) 2023-02-10 20:56:19 +05:30
david-leifker
b4b3a39829
fix(system-update): fixes system-update with more than 1 partition (#7302) 2023-02-09 18:54:20 -06:00
vojtechneradatos
c72d0105c8
feat(api): Timeline API supports Glossary Terms now (#7229)
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-02-08 14:52:29 -06:00
Aseem Bansal
0f8f186bd0
chore(logs): clean logs scanning location (#7261) 2023-02-07 16:41:39 +05:30
Peter Szalai
36b6fce46c
feat(monitoring): add graphql error and call metrics at startup time (#7226) 2023-02-06 20:08:35 +05:30
RainerGa
981810a009
Update data_platforms.json (#7244) 2023-02-03 13:08:10 -08:00
Aseem Bansal
aa4c6fcc05
chore(log/docs): improve error log, docs (#7239) 2023-02-03 17:43:53 +05:30
Aditya Radhakrishnan
c13e7e09f8
feat(lineage): add time filtering for lineage edges (#7159) 2023-02-02 15:30:49 -08:00
Dmitry Bryazgin
1a1f2906db
feat(ingest): Add custom properties to the ldap ingestion (#7125)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-02-01 16:37:14 -08:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
Aseem Bansal
36afdec394
fix(log): logging timestamp in ISO8601 format instead of time (#7188) 2023-01-31 15:06:17 +05:30
Aditya Radhakrishnan
1378ae40ed
docs(gms): clarify behavior of soft deletion in UI (#7117) 2023-01-24 10:42:50 -08:00
Peter Szalai
5cb0a8ddaa
fix(graphql): Return with appropriate status code instead of stacktrace (#7086) 2023-01-19 15:12:14 -06:00
RyanHolstien
8323128437
feat(cache): add hazelcast distributed cache option (#6645)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-01-19 09:03:08 -08:00
david-leifker
6d9da9b5e9
fix(secret-service): fix default encrypt key (#7074) 2023-01-18 17:56:45 -06:00
Aditya Radhakrishnan
84f429cc13
fix(bootstrap): add EDIT_LINEAGE privilege to some default policies (#7060) 2023-01-17 16:32:45 -08:00
Rajasekhar-Vuppala
cd9fc26a25
feat(ingest/vertica): Adding Vertica as source in Datahub UI (#7010)
Co-authored-by: Vishal <vishal.k@simplify3x.com>
Co-authored-by: VISHAL KUMAR <110387730+vishalkSimplify@users.noreply.github.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-01-13 13:23:32 -08:00
david-leifker
6a0c96ac26
fix(config): adding quotes (#7040) 2023-01-13 13:55:10 -06:00
david-leifker
55a5e68c9a
fix(config): adding quotes (#7038) 2023-01-13 12:43:45 -06:00
Gabe Lyons
5cecc3c48e
feat(queries): [Experimental] Allow customization of # of queries in Query tab via env var (#6964) 2023-01-06 10:54:45 -08:00
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location (#6881) 2022-12-29 15:08:36 +05:30
david-leifker
d8af0b43bd
fix(runid): always update runid, except when queued (#6876) 2022-12-28 13:09:30 -06:00
david-leifker
cb6314c51d
fix(elasticsearch): fixes out of order runId writes (#6845)
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-27 17:50:11 -06:00
Aseem Bansal
bef87abd6c
refactor(graphql): make graphqlengine easier to use (#6865) 2022-12-27 22:58:12 +05:30
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
djordje-mijatovic
e6c48e5f19
feat(kafka): expose default kafka producer mechanism (#6381)
* Expose Kafka Sender Retry Parameters

* Implement KafkaHealthChecker

* feat(kafka): expose default kafka producer mechanism
2022-12-20 14:41:24 -06:00
Chris Collins
f559dcc282
feat(lineage) Adds ability to edit lineage manually from the UI (#6816) 2022-12-20 10:54:08 -05:00
Aditya Radhakrishnan
2475d2bbec
fix(policies): resolve the associated domain for a domain as the domain itself (#6812) 2022-12-20 07:13:30 -08:00
Aditya Radhakrishnan
80041d7586
fix(posts): add deletePost GraphQL endpoint (#6813) 2022-12-20 07:08:34 -08:00
RyanHolstien
f85fd157e9
fix(elasticsearch): build in resilience against IO exceptions on httpclient (#6680)
* fix(elasticsearch): build in resilience against IO exceptions on http client
2022-12-13 18:11:02 -06:00