117 Commits

Author SHA1 Message Date
Indy Prentice
6b8c4c83bc
feat(elasticsearch): Add rest.li endpoint that does truncation cleanup of a timeseries index (#8277)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Indy Prentice <indy@ip-172-16-225-44.us-west-2.compute.internal>
2023-06-28 17:06:51 -05:00
Indy Prentice
3a0b2ed0e9
feat(elasticsearch): Add endpoint for getting the size of timeseries indices (#8265)
enabling auto-merge as flaky tests succeeded on the first run
2023-06-21 16:47:13 +00:00
Chris Collins
ed2159bc36
feat(ui) Update Search & Browse to be a unified experience (#8235)
Co-authored-by: Josh Eilers <josh.eilers@acryl.io>
2023-06-21 13:40:07 +05:30
RyanHolstien
6ce0a248fd
feat(ui): create fast path for immediate processing of ui sourced changes (#8200)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-15 16:47:13 +05:30
Pedro Silva
ea92b86e6a
feat(custom ownership): Adds Custom ownership types as a top level entity (#8045)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-26 17:54:09 +01:00
Indy Prentice
d35490941f
fix(ci): Fix checkstyle violations to turn master green (#8099) 2023-05-22 12:18:06 -07:00
Indy Prentice
da33e27784
feat(search): Add AggregateAcrossEntities endpoint (#8000) 2023-05-19 21:26:50 +00:00
Shirshanka Das
b3c790aab6
feat: Add support for Data Products (#8039)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-05-17 07:17:25 +00:00
Indy Prentice
44a8536ef6
fix(elasticsearch): make indexNameMapping in IndexConventionImpl threadsafe (#7565)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-03-17 11:28:32 -05:00
Shirshanka Das
9a3d3b40ef
feat(openapi): add relationships endpoint (#7547) 2023-03-11 17:25:50 -08:00
RyanHolstien
98f3f93442
feat(auth): REST API authorization (#6614) 2023-02-22 15:45:45 -06:00
John Joyce
08a215951c
feat(queries): Overhaul Queries Tab (#7366) 2023-02-20 11:10:18 -08:00
RyanHolstien
bc61d1e446
fix(homepage): make entity counts execute in parallel and make cache configurable (#7249) 2023-02-14 07:42:39 -06:00
Aseem Bansal
0f8f186bd0
chore(logs): clean logs scanning location (#7261) 2023-02-07 16:41:39 +05:30
Meenakshi Kamalaseshan Radha
d3754ba309
feat(privileges) - Create a privilege to manage glossary children recursively (#6731)
Co-authored-by: Kamalaseshan Radha <mkamalas@LAMU02DN212MD6R.uhc.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-01-09 16:05:39 -08:00
Aseem Bansal
192aac4271
chore: misc fixes (#6966) 2023-01-09 14:12:36 +05:30
John Joyce
22ee828236
feat(backend): Supporting Embeddable Previews for Dashboards, Charts, Datasets (#6875) 2023-01-03 15:40:39 -08:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Chris Collins
2ef2ad05d0
fix(ingestion) Inject pipeline_name into recipes at runtime (#6833) 2022-12-22 13:16:51 -08:00
Chris Collins
f559dcc282
feat(lineage) Adds ability to edit lineage manually from the UI (#6816) 2022-12-20 10:54:08 -05:00
John Joyce
54230a8d81
feat(): Views Feature Milestone 1 (#6666) 2022-12-12 12:30:09 -08:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible (#6616) 2022-12-04 19:57:47 -08:00
david-leifker
4ca3327d89
fix(security): update ranger commons & dependencies for security vulns (#6577)
* fix(security): update ranger commons & dependencies for security vulns
2022-11-30 17:05:01 -06:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests (#6269) 2022-11-15 18:03:11 -08:00
Chris Collins
8c783dac62
feat(privileges) Create privileges to allow for managing children of entities (#6346)
Co-authored-by: Chris Collins <chriscollins@Chriss-MBP-2-634.lan>
Co-authored-by: Chris Collins <chriscollins@Chriss-MBP-2-666.lan>
2022-11-03 13:06:40 -07:00
Aditya Radhakrishnan
873b100a47
refactor(change-events): refactor AspectDiffers to EntityChangeEventGenerators (#6320)
* refactor(change-events): refactor AspectDiffers to EntityChangeEventGenerators

* feat(change-event): add change events for AssertionRunEvent

* feat(change-event): add change events for DataProcessInstanceRunEvent
2022-11-01 09:53:43 -07:00
Gabe Lyons
228c10de43
fix(adv search): two advanced search fixes (#6252)
* two advanced search fixes

* another approach

* adding unit tests

* fixing checkstyle issue
2022-10-26 11:31:38 -07:00
Aditya Radhakrishnan
ee1a1ef45b
feat(posts): add posts feature to DataHub (#6110) 2022-10-04 15:37:28 -07:00
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs (#5901)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
Parham Ghazanfari
2712dd1903
fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism. (#5936)
* fix(patch-entity-registry): Remove exception for entities with key aspects.

* test(patch-entity-registry): Fix failing unit test for entities with key aspect

* test(patch-entity-registry): Fix checkstyle for PatchEntityRegistryTest.java

* fix(patch-entity-registry): Remove duplicate semicolon.

* fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism.

* fix(patch-entity-registry): Fixed incorrect merge conflict resolution in BrowsePathUtils.java

* fix(patch-entity-registry): Remove extraneous import from BrowsePathUtils.java

Co-authored-by: Parham Ghazanfari <pghazanfari53@yahoo.com>
2022-09-19 10:47:20 -05:00
Chris Collins
b0fc67b926
fix(privileges) Add Term Groups as targetable entities for privileges (#5806) 2022-09-01 09:08:41 -07:00
Gabe Lyons
5bf5fc2d66
feat(previews): add previews for glossary terms, tags, and domains (#5784)
* add graphql for chart glossary terms

* add placeholder tab component

* continued progress

* finished rendering of other tooltips

* fix tests

* add null check

* force more clicks

* fix analytics test
2022-08-31 20:48:32 -07:00
Aditya Radhakrishnan
73cd2f995d
feat(roles): add roles feature to DataHub (#5767) 2022-08-30 18:31:34 -07:00
Gabe Lyons
47aa32a8a5
feat(simplified homepage): adding option to show limited entity types on homepage (#5678) 2022-08-30 09:17:11 -07:00
John Joyce
e9494f503f
feat(search): Sticky search filters + misc bug fixes & improvements (#5601) 2022-08-10 15:12:53 -07:00
John Joyce
737543900e
feat(ui): Support batch deleting from ui (#5582) 2022-08-08 13:41:59 -07:00
John Joyce
f8697ba54f
feat(ui): Partial support for Chart usage (#5473) 2022-07-22 15:19:04 -07:00
Aditya Radhakrishnan
eec5eae0ab
feat(groups): add native groups concept to DataHub (#5443) 2022-07-20 16:55:10 -07:00
Mayuri Nehate
2c48329810
feat(model): dashboard usage model, is_null condition added (#5397) 2022-07-15 15:37:06 +05:30
John Joyce
fdee7a787b
feat(GraphQL): Support for Deleting Domains, Tags via GraphQL API (#5272) 2022-06-28 14:57:22 -07:00
Gabe Lyons
baf3f3f33c
feat(dbt): add sibling association logic to associate dbt elements with their target systems (#5190) 2022-06-22 08:31:18 -07:00
Aditya Radhakrishnan
fdf4e48495
feat(users): add ability to add native users from the UI (#5097)
Co-authored-by: John Joyce <john@acryl.io>
2022-06-08 18:13:22 -07:00
Chris Collins
d22180eb0e
feat(upgrades) Create new DataHubUpgrade + Restore Glossary Entities Bootstrap step (#5099) 2022-06-06 16:34:03 -07:00
Chris Collins
43deb7080a
feat(glossary) Business Glossary updates (#5026) 2022-05-29 21:26:07 -07:00
John Joyce
1e428aacd8
feat(DataHub Operations): Adding GraphQL mutation for reporting Dataset operations (#4988) 2022-05-25 13:27:46 -07:00
John Joyce
944be9a1da
feat(Tests): Metadata Tests Models + APIs + UI (Part 1) (#4989) 2022-05-25 08:55:08 -07:00
Pedro Silva
bbe79170fc
feat(graphql) Add new Revokable Token API (#4970) 2022-05-24 10:44:31 -07:00
Chris Collins
e32f22f6bf
feat(dataPlatformInstance) - Resolve and display dataPlatformInstance on entities (#4867)
Co-authored-by: Chris Collins <chriscollins@Chriss-MBP.lan>
2022-05-09 14:28:50 -07:00
John Joyce
f7d598336a
fix(ui ingest): Unschedule all sources on ingestion source refresh, fix delete not being enforced (#4792) 2022-04-29 14:34:01 -07:00
John Joyce
f387901ca8
feat(gms): Entity change events v1 (Platform Event) (#4687) 2022-04-19 20:04:14 -07:00