166 Commits

Author SHA1 Message Date
Shubham Jagtap
a1f2216da7
feat(ingest/qlik): Qlik cloud connector integration (#9682)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-26 11:27:37 -08:00
Andrew Sikowitz
bbd818a64e
feat(ui): Add and update platform logos (#9849) 2024-02-15 10:06:19 -08:00
RyanHolstien
2c9fdcdad4
feat(operations): add explain endpoint for search (#9832) 2024-02-14 15:30:20 -06:00
John Joyce
0328f854e8
feat(): Adding supports for data incidents for datasets, dashboards, charts, data jobs, data flows (#9710)
Co-authored-by: John Joyce <john@ip-192-168-1-149.us-west-2.compute.internal>
Co-authored-by: John Joyce <john@Johns-MBP.attlocal.net>
Co-authored-by: John Joyce <john@Johns-MacBook-Pro.local>
2024-02-14 09:06:21 -08:00
Aseem Bansal
d3736a0526
doc(policies): consistent descriptions for root user policies (#9823) 2024-02-14 17:00:51 +05:30
Davi Arnaut
1af9b87326
chore(gms): allow adjusting the log level for gms debug log file (#9743) 2024-01-30 08:16:31 -06:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
RyanHolstien
7a788240c1
feat(spring): update spring to version 6 and spring boot to version 3 (#9567) 2024-01-11 13:44:06 -06:00
purnimagarg1
f9b24e0724
feat: Support CSV ingestion through the UI (#9280)
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2023-12-04 09:28:41 -08:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
ff90fb633d
fix(datahub-ingestion): prevent transitive deps, bump addtional pyspa… (#9233) 2023-11-13 16:26:53 -06:00
RyanHolstien
582eebe739
feat(policies): reduce default access for all users (#9067)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-13 10:57:49 -06:00
Shubham Jagtap
e73e926999
feat(integration/fivetran): Fivetran connector integration (#9018)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-07 23:02:41 -08:00
david-leifker
c2bc41d15e
fix(health): fix health check url authentication (#9117) 2023-11-03 12:29:31 -05:00
Aseem Bansal
2e8954f33a
fix(policies): remove non-existent policies, fix name (#9150) 2023-10-31 22:25:48 +05:30
Tony Ouyang
12f6fe0f90
fix(ingest): Fix roll back failure when REST_API_AUTHORIZATION_ENABLED is set to true (#9092) 2023-10-26 17:07:36 -05:00
david-leifker
b81e818e47
feat(openapi): openapi v2 updates (#8927) 2023-10-02 11:08:37 -06:00
hariishaa
622816dcb8
feat(metadata-ingestion): implement mlflow source (#7971)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-09-26 13:51:30 -04:00
Tony Ouyang
f4da93988e
feat(ingestion/dynamodb): Add DynamoDB as new metadata ingestion source (#8768)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2023-09-15 13:26:17 -07:00
david-leifker
56c00f5586
feat(openapi): entity endpoints & analytics raw (#8537) 2023-09-07 17:09:52 -05:00
david-leifker
1b79142d9e
feat(EntityService): batched transactions and ebean updates (#8456) 2023-09-02 19:25:44 -05:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update (#8745) 2023-09-01 19:36:01 +05:30
Chris Collins
e12d910648
feat(ui) Create page for managing home page posts (#8707) 2023-08-23 21:30:27 -04:00
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images (#8515) 2023-08-17 10:40:17 +05:30
Gabe Lyons
a97ac52481
fix(presto-on-hive): update presto-on-hive URN in data_platforms.json (#8484) 2023-07-23 17:10:22 +05:30
Indy Prentice
6b8c4c83bc
feat(elasticsearch): Add rest.li endpoint that does truncation cleanup of a timeseries index (#8277)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Indy Prentice <indy@ip-172-16-225-44.us-west-2.compute.internal>
2023-06-28 17:06:51 -05:00
Indy Prentice
3a0b2ed0e9
feat(elasticsearch): Add endpoint for getting the size of timeseries indices (#8265)
enabling auto-merge as flaky tests succeeded on the first run
2023-06-21 16:47:13 +00:00
david-leifker
81fdf9df55
fix(vulnerabilities)/vulnerabilities_fixes_datahub (#8075) (#8189)
Co-authored-by: Sejal-NucleusTeq <109514187+Sejal-NucleusTeq@users.noreply.github.com>
2023-06-07 18:42:19 -05:00
Pedro Silva
ea92b86e6a
feat(custom ownership): Adds Custom ownership types as a top level entity (#8045)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-26 17:54:09 +01:00
Shirshanka Das
b3c790aab6
feat: Add support for Data Products (#8039)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-05-17 07:17:25 +00:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry (#7930)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
RyanHolstien
7fcb6aacbe
fix(platforms): fix json parse exception for data platforms (#7918) 2023-04-27 20:13:45 -05:00
Mayuri Nehate
a0c4e0dd46
feat(ingest): add GCS ingestion source (#7903)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-04-27 19:03:41 +02:00
david-leifker
2ffa39f009
Logging and test models fixes (#7884) 2023-04-21 15:45:20 -05:00
Indy Prentice
3bd637843f
feat(elasticsearch): Add servlet which provides an endpoint for a healthcheck on the ES cl… (#7799)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-04-20 11:12:00 -05:00
david-leifker
1831b89a86
servlet(config): add search configuration endpoint (#7641) 2023-04-13 14:35:08 -05:00
Aditya Radhakrishnan
0ff7bea043
fix(smoke-test): fix native user and access token tests (#7628) 2023-03-20 16:04:42 -05:00
Aseem Bansal
2ef26e8b74
fix(policies): add missing policies, add check to prevent problems (#7586)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-16 09:49:55 +05:30
RyanHolstien
98f3f93442
feat(auth): REST API authorization (#6614) 2023-02-22 15:45:45 -06:00
John Joyce
08a215951c
feat(queries): Overhaul Queries Tab (#7366) 2023-02-20 11:10:18 -08:00
david-leifker
267472ccbb
gradle(development): add additional commands for development (#7321) 2023-02-16 10:41:42 -06:00
Felix Lüdin
da2b0c9e1b
fix(docs): sort sources by display name in doc's sidebar (#7322) 2023-02-13 12:39:54 -08:00
Aseem Bansal
0f8f186bd0
chore(logs): clean logs scanning location (#7261) 2023-02-07 16:41:39 +05:30
RainerGa
981810a009
Update data_platforms.json (#7244) 2023-02-03 13:08:10 -08:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
Aseem Bansal
36afdec394
fix(log): logging timestamp in ISO8601 format instead of time (#7188) 2023-01-31 15:06:17 +05:30
Aditya Radhakrishnan
84f429cc13
fix(bootstrap): add EDIT_LINEAGE privilege to some default policies (#7060) 2023-01-17 16:32:45 -08:00
Rajasekhar-Vuppala
cd9fc26a25
feat(ingest/vertica): Adding Vertica as source in Datahub UI (#7010)
Co-authored-by: Vishal <vishal.k@simplify3x.com>
Co-authored-by: VISHAL KUMAR <110387730+vishalkSimplify@users.noreply.github.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-01-13 13:23:32 -08:00
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location (#6881) 2022-12-29 15:08:36 +05:30
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00