81 Commits

Author SHA1 Message Date
david-leifker
3dd1c4cd41
feat(entity-client): restli batchGetV2 batchSize fix and concurrency (#10630) 2024-06-06 15:38:54 -05:00
david-leifker
b8b7928dd4
fix(misc): misc fixes for OSS release (#10493) 2024-05-13 14:37:36 -05:00
ksrinath
91e3dc829e
feat(views): apply views to homepage entity counts & recommendations (#10283)
Co-authored-by: gaurav2733 <gaurav.wagh@apptware.com>
2024-04-18 13:50:37 +05:30
david-leifker
731c29e675
feat(graph-retriever): implement graph retriever (#10241) 2024-04-16 10:12:48 -05:00
Pedro Silva
35ec7dfe14
fix(graphQL): Ignore soft-deleted assertions in UI calls (#10148) 2024-03-27 22:55:27 +00:00
david-leifker
2e8936dd20
fix(entity-client): fix entity client cache and test (#10149) 2024-03-27 14:34:20 -05:00
RyanHolstien
2657c8f68b
feat(lineage): add a parameter to allow limiting the per hop exploration of lineage search (#10062) 2024-03-26 11:48:39 -05:00
david-leifker
f9e64d03cc
feat(auth): view authorization (#10066) 2024-03-23 06:15:36 -05:00
david-leifker
ed10a8d8cc
feat(search): search access controls (#9892)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-02-28 16:57:26 -06:00
david-leifker
62f2789724
feat(structured-properties): soft delete (#9812) 2024-02-21 18:16:42 -06:00
david-leifker
e0276cf123
refactor(graphql): consolidate cache for stats (#9826) 2024-02-13 10:55:03 -06:00
RyanHolstien
20b9050732
fix(browsev2): align browse and aggregate queries (#9790) 2024-02-07 10:37:55 -06:00
Shirshanka Das
1d06d38b68
feat(platform): add support for via nodes (#9733) 2024-01-29 16:03:27 -08:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
david-leifker
8415fc214b
feat(entity-registry): entity registry plugins (#9538) 2024-01-08 14:20:03 -06:00
John Joyce
7b067822bd
feat(gms): Add support for platform-based browse (#9376)
Co-authored-by: John Joyce <john@Johns-MBP.attlocal.net>
2023-12-18 18:35:02 -08:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint (#9373) 2023-12-06 11:02:42 +05:30
david-leifker
b03515fbc7
feat(usageclient): updates for usageclient (#9255) 2023-11-16 18:39:36 -06:00
david-leifker
23c98ecf7a
feat(policy): enable support for 10k+ policies (#9177)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-11-07 14:40:48 -06:00
david-leifker
b61c38ab05
refactor(misc): testngJava fix, systemrestli client, cache key fix, e… (#8926) 2023-09-30 22:47:59 -05:00
david-leifker
aef49b8fb2
feat(entity-client): enable client side cache for entity-client and usage-client (#8877) 2023-09-21 22:00:14 -05:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update (#8745) 2023-09-01 19:36:01 +05:30
Chris Collins
265e2a4e42
feat(ui/graphql) Add ability to sort search results from search results page (#8595) 2023-08-09 16:51:06 -04:00
Chris Collins
ed2159bc36
feat(ui) Update Search & Browse to be a unified experience (#8235)
Co-authored-by: Josh Eilers <josh.eilers@acryl.io>
2023-06-21 13:40:07 +05:30
david-leifker
57c5d2fb47
fix(restli): update base client retry logic (#8172) 2023-06-06 09:50:08 -05:00
Indy Prentice
da33e27784
feat(search): Add AggregateAcrossEntities endpoint (#8000) 2023-05-19 21:26:50 +00:00
John Joyce
b46822399c
feat(timeseries): Support sorting timeseries aspects by non-timestampMillis field + fix operations resolver (#7840) 2023-04-18 09:10:04 -07:00
Chris Collins
ba6426ef61
feat(ui) Update auto-complete functionality and design (#7515)
Adds in new styles for auto-complete as well as the new functionality around quick filters.
2023-03-27 12:45:38 -04:00
Aseem Bansal
b039ad1176
refactor: misc fixes logging, annotations (#7579)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-16 09:49:35 +05:30
david-leifker
72198f98c0
feat(search): searchAcrossEntities/Lineage improvements (#7550)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-12 18:18:51 -07:00
RyanHolstien
4e250cbd51
feat(elasticsearch): support searchAfter (#7235) 2023-02-22 19:03:14 -06:00
RyanHolstien
31ee8aacec
fix(search): support searchFlags for GraphQL (#7346)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-16 13:26:21 -06:00
Aditya Radhakrishnan
c13e7e09f8
feat(lineage): add time filtering for lineage edges (#7159) 2023-02-02 15:30:49 -08:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
david-leifker
cb6314c51d
fix(elasticsearch): fixes out of order runId writes (#6845)
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-27 17:50:11 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Aditya Radhakrishnan
f0f0355a83
feat(onboarding): adds framework and some steps for onboarding steps UI (#6462)
* feat(onboarding): adds models and API for onboarding steps feature

* feat(onboarding): adds backend for onboarding steps feature

* feat(onboarding): adds framework and some steps for onboarding steps UI
2022-12-07 16:21:55 -08:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework (#6634) 2022-12-06 10:22:41 -08:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible (#6616) 2022-12-04 19:57:47 -08:00
RyanHolstien
848574dbff
fix(platform): patch for entity creation, honor async flag on request (#6504) 2022-11-22 11:05:09 -08:00
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint (#6097)
* feat(ingest): add async option to ingest proposal endpoint

* small tweak to validate before write to K, also keep existing path for timeseries aspects

* avoid double convert

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
John Joyce
450fb2effb
refactor(gms): Refactoring util + entity client class locations (#5902) 2022-09-12 12:11:28 -07:00
John Joyce
ca29f8b679
fix(bootstrap): Creating dedicated thread pool for executing async bootstrap steps + misc fixes (#5798) 2022-08-31 19:34:17 -07:00
Chris Collins
951bca096a
fix(audit logs) Set actor urn on audit stamp through Java Entity Client (#5788) 2022-08-31 10:26:47 -07:00
Aditya Radhakrishnan
89238408b9
fix(search): validate entities exist before returning search results in EntityClient (#5751) 2022-08-29 13:40:02 -07:00
Chris Collins
33754d41f5
feat(ingestion) Add ability to rollback ingestion from UI - BE PR (#5739) 2022-08-29 13:09:15 -07:00
John Joyce
57b7ade1f0
feat(ui): Add rich UI ingestion run summary (#5577) 2022-08-08 14:33:57 -07:00
John Joyce
b02c7f5952
perf(search): Improve search default performance (#5311) 2022-07-01 10:40:51 -07:00
John Joyce
11356e37ba
feat(ui) Adding support for deleting Tags and Domains via the UI (#5280)
* Adding support for deleting tags and domains via the UI

* Fixing tests
2022-06-29 19:41:41 -07:00