172 Commits

Author SHA1 Message Date
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
Aseem Bansal
36afdec394
fix(log): logging timestamp in ISO8601 format instead of time (#7188) 2023-01-31 15:06:17 +05:30
Aditya Radhakrishnan
84f429cc13
fix(bootstrap): add EDIT_LINEAGE privilege to some default policies (#7060) 2023-01-17 16:32:45 -08:00
Rajasekhar-Vuppala
cd9fc26a25
feat(ingest/vertica): Adding Vertica as source in Datahub UI (#7010)
Co-authored-by: Vishal <vishal.k@simplify3x.com>
Co-authored-by: VISHAL KUMAR <110387730+vishalkSimplify@users.noreply.github.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-01-13 13:23:32 -08:00
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location (#6881) 2022-12-29 15:08:36 +05:30
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
John Joyce
54230a8d81
feat(): Views Feature Milestone 1 (#6666) 2022-12-12 12:30:09 -08:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework (#6634) 2022-12-06 10:22:41 -08:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible (#6616) 2022-12-04 19:57:47 -08:00
Oleksandr
0a0cf70b6f
feat(ingest): power-bi - add support for on-prem PowerBI Report Server (#5369) 2022-11-01 16:05:42 -07:00
Tamas Nemeth
0dc2d6af25
feat(ingest): databricks - Unity catalog source (#6292)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-29 21:44:41 -07:00
Aseem Bansal
79575b2815
feat(retention): change default policy, add API to apply retention (#6088) 2022-09-30 16:11:39 +05:30
Aditya Radhakrishnan
325b959ea6
feat(roles): add ability to invite users into a role (#6015) 2022-09-23 16:48:23 -07:00
atul-chegg
d53cbbb9bf
fix(platform): Add aws-secretsmanager-jdbc driver in dependencies (#5968) 2022-09-22 22:23:45 -07:00
John Joyce
ca29f8b679
fix(bootstrap): Creating dedicated thread pool for executing async bootstrap steps + misc fixes (#5798) 2022-08-31 19:34:17 -07:00
Aditya Radhakrishnan
73cd2f995d
feat(roles): add roles feature to DataHub (#5767) 2022-08-30 18:31:34 -07:00
Chris Collins
d64cca5c6b
feat(retention) Enable retention and set max versions for executionRequests (#5704) 2022-08-23 16:25:18 -07:00
Mayuri Nehate
4b515e022b
feat(ingest): salesforce - add connector (#5104)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
2022-07-06 10:01:16 -07:00
Pedro Silva
14f769e0d5
fix(tokens) Adds non-admin tests for access tokens (#5174) 2022-07-05 18:57:23 -07:00
John Joyce
fdee7a787b
feat(GraphQL): Support for Deleting Domains, Tags via GraphQL API (#5272) 2022-06-28 14:57:22 -07:00
Mugdha Hardikar
5455122267
feat(ingest): delta-lake: adding support for delta lake (#5259)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-06-27 16:16:33 -07:00
John Joyce
57b983ef1d
feat(boot): Make Glossary Term Upgrade Async (#5164) 2022-06-14 14:24:59 -07:00
Aditya Radhakrishnan
fdf4e48495
feat(users): add ability to add native users from the UI (#5097)
Co-authored-by: John Joyce <john@acryl.io>
2022-06-08 18:13:22 -07:00
Felix Lüdin
2a373c21e5
fix(docs): hana - rename SAP HANA source and data platform (#5043) 2022-05-31 14:44:16 -07:00
Chris Collins
43deb7080a
feat(glossary) Business Glossary updates (#5026) 2022-05-29 21:26:07 -07:00
Ravindra Lanka
108b492ed1
feat(ingestion): Add Iceberg source (#5010)
Co-authored-by: cccs-eric <eric.ladouceur@cyber.gc.ca>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-05-26 08:05:57 -07:00
buggythepirate
92338c7912
feat(ingest): Added new ingestion source SAP HANA (#4376)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-26 03:42:50 -07:00
John Joyce
944be9a1da
feat(Tests): Metadata Tests Models + APIs + UI (Part 1) (#4989) 2022-05-25 08:55:08 -07:00
Pedro Silva
bbe79170fc
feat(graphql) Add new Revokable Token API (#4970) 2022-05-24 10:44:31 -07:00
liyuhui666
d78f1d64b2
fix(data platforms): Update data_platforms.json (#4966)
Fixed clickHouse data source icon not being displayed after DataHub startup because there is no network
2022-05-19 20:52:24 -07:00
RyanHolstien
c3cfaf8e3c
feat(telemetry): add server side telemetry (#4925)
Co-authored-by: Kevin Hu <kevinhuwest@gmail.com>
2022-05-17 11:37:45 -07:00
RyanHolstien
d70df06c21
chore(jetty): upgrade jetty to 9.4.46 for CVE (#4857) 2022-05-06 14:18:20 -07:00
RyanHolstien
f1151cb478
Revert "fix(jetty): upgrade jetty dependency for CVE (#4838)" (#4844)
This reverts commit 1697bd0641bac248a72ed289bbbcf17c20b2f5a4.
2022-05-05 20:01:50 -07:00
RyanHolstien
1697bd0641
fix(jetty): upgrade jetty dependency for CVE (#4838) 2022-05-05 18:01:02 -07:00
vanmeete
74d6d35881
feat(ingestion): add Pulsar source (#4721) 2022-04-29 15:57:02 +05:30
Dexter Lee
b9a0f3c60e
Add more platforms (#4676) 2022-04-15 09:54:40 -07:00
jchen0824
524d183d93
feat: add presto-on-hive metadata ingestion source (#4625)
* feat(metadata ingestion source): add presto-on-hive metadata ingestion source

Co-authored-by: Houren Chen <houren.chen@grabtaxi.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-11 17:46:44 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557)
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
2022-04-04 14:39:30 -05:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies (#4516)
* Add domain based policy and view based policy

* Add new files

* Fix issue

* Fix comment on markdown

* Fix to John's comments

* Update policies.md

* Remove comments

* Fix to John's comments

* Fix policy details page

* Add back notebook privileges

* Fix graphql

Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
John Joyce
870407b8f9
fix(ui): Supporting unknown data platform type (#4361) 2022-03-09 20:06:02 -08:00
John Joyce
902929293d
fix(ui) Misc UI fixes & styling improvements. (#4311) 2022-03-04 12:19:37 -08:00
John Joyce
9f1c5a8f75
feat(assertions): Adding Assertions Entity & Great Expectations BETA (#4305) 2022-03-04 11:51:31 -08:00
Aseem Bansal
9a9a5c3084
fix: revert changes to OpenApi casing (#4291) 2022-03-04 10:35:44 -08:00
mohdsiddique
e2f8db7926
feat: powerbi - add new source (#4201) 2022-02-28 17:37:22 -08:00
Ravindra Lanka
1ac20ee764
feat(platform): add timeline api for dataset entity (#4252) 2022-02-24 19:40:55 -08:00
Alexander Chashnikov
c2065bd7fe
feat(ingest): clickhouse - add initial support (#4057)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-21 07:36:08 -08:00
John Joyce
93befda8cf
feat(groups): Adding editable group properties in the backend (#4166) 2022-02-17 22:47:59 -08:00
Amanda Ng
d17f2bf014
feat(ui): Host platform images on datahub-web-react (#4118)
* feat(react-images): host platform images on datahub-web-react

* feat(react-images): update data_platforms logoUrl

* feat(react-images): add explanation for CopyWebpackPlugin

Co-authored-by: Amanda Ng <amanda.ng@grabtaxi.com>
2022-02-16 11:28:06 -08:00
John Joyce
8002fd8eb6
feat(deprecation): Entity Deprecation Backend (#4073) 2022-02-08 15:28:32 -08:00