599 Commits

Author SHA1 Message Date
Corentin
fbcfcfc147
feat(recommendations): add last edited entities (#6329) 2022-11-14 22:15:48 -08:00
John Joyce
0b9a30bd8d
refactor(ui): Refactor the Glossary Related Entities, Tag Profiles to use search filters instead of query API. (#6352) 2022-11-03 15:32:25 -07:00
Gabe Lyons
fbd285e9b8
fix(search): fixing typo in es utils (#6348) 2022-11-02 16:27:35 -07:00
Aditya Radhakrishnan
873b100a47
refactor(change-events): refactor AspectDiffers to EntityChangeEventGenerators (#6320)
* refactor(change-events): refactor AspectDiffers to EntityChangeEventGenerators

* feat(change-event): add change events for AssertionRunEvent

* feat(change-event): add change events for DataProcessInstanceRunEvent
2022-11-01 09:53:43 -07:00
djordje-mijatovic
faddcbb404
feat(cassandra): Atomic updates in cassandra aspect dao (#6144) 2022-10-31 13:48:24 -07:00
Chris Collins
cd1331fffe
feat(lineage) Add column-level impact analysis feature (#6272) 2022-10-26 16:43:39 -04:00
Gabe Lyons
228c10de43
fix(adv search): two advanced search fixes (#6252)
* two advanced search fixes

* another approach

* adding unit tests

* fixing checkstyle issue
2022-10-26 11:31:38 -07:00
Chris Collins
31f90a4b52
fix(ui) Fix two lineage visualization bugs (#6278) 2022-10-26 13:56:32 -04:00
david-leifker
7cdc9f7fcf
test(neo4j): Improve test performance (#6142)
Reuse neo4j graph service in test for performance improvements.
2022-10-24 08:49:06 -07:00
RyanHolstien
762c9031e8
feat(metrics): add metrics around search caching (#6255) 2022-10-23 20:55:43 -07:00
Chris Collins
2f285b7470
fix(lineage) Fix batching to ES for impact analysis (#6149) 2022-10-07 15:16:23 -04:00
Gabe Lyons
ce90310dd0
feat(advanced-search): Complete Advanced Search: backend changes & tying UI together (#6068)
* stashing progress

* adding remove option

* more progress

* editing

* further in

* additional rendering improvements

* stashing adv search progress

* stashing more progress

* propagating not filters back to UI

* more frontend progress

* more filters working

* getting ready for data platform selector

* add platform select functionality

* locking out switching btwn advanced and standard filters

* final polish

* remove unneeded code

* added unit and cypress tests

* resolutions after merge

* adding documentation

* cleaning up & refactoring

* removing console.log

* minor ui fix & removing unneeded code

* fixing lineage search

* fixing lints

* fix display of degree

* fixing test

* fixing lint

* responding to comments

* fixing tests

* fix smoke tests

* fixing cypress

* fixing cypress test

* responding to comments
2022-10-04 10:20:04 -07:00
John Joyce
e2c5d2a4ce
feat(ui): bump max recommendations for Platforms (#6113) 2022-10-04 18:35:04 +05:30
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint (#6097)
* feat(ingest): add async option to ingest proposal endpoint

* small tweak to validate before write to K, also keep existing path for timeseries aspects

* avoid double convert

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
Shirshanka Das
e688dd554a
chore(deps): upgrade neo4j to 4.4.x (#6101) 2022-10-02 23:16:45 -07:00
Aseem Bansal
79575b2815
feat(retention): change default policy, add API to apply retention (#6088) 2022-09-30 16:11:39 +05:30
John Joyce
09dec1acec
fix(): Attempting to test paypal optimizations (#6073) 2022-09-28 09:40:19 -07:00
Shirshanka Das
1d45b81748
fix(deps): metadata-io - remove parquet dependency (#6046) 2022-09-26 18:08:53 -07:00
Aditya Radhakrishnan
325b959ea6
feat(roles): add ability to invite users into a role (#6015) 2022-09-23 16:48:23 -07:00
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs (#5901)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
Amanda Ng
63ef9c04f9
fix(ownership-differ): standardise ownership change event payload (#5967)
* fix(ownership-differ): standardise ownership change event payload

* fix(ownership-differ): update test case

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: John Joyce <john@acryl.io>
2022-09-22 15:06:17 -07:00
RyanHolstien
2c659214ab
feat(gms): Write back lineage search results to in-memory cache bound to feature flag (#6006)
Co-authored-by: Piyush Narang <piyushn@stripe.com>
2022-09-22 15:01:24 -07:00
Parham Ghazanfari
2712dd1903
fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism. (#5936)
* fix(patch-entity-registry): Remove exception for entities with key aspects.

* test(patch-entity-registry): Fix failing unit test for entities with key aspect

* test(patch-entity-registry): Fix checkstyle for PatchEntityRegistryTest.java

* fix(patch-entity-registry): Remove duplicate semicolon.

* fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism.

* fix(patch-entity-registry): Fixed incorrect merge conflict resolution in BrowsePathUtils.java

* fix(patch-entity-registry): Remove extraneous import from BrowsePathUtils.java

Co-authored-by: Parham Ghazanfari <pghazanfari53@yahoo.com>
2022-09-19 10:47:20 -05:00
John Joyce
38f111117c
refactor(gms): Adding Java Entity Services (#5931) 2022-09-14 10:19:13 -07:00
Justin Marozas
133b5e0348
feat(search): Add support for Elasticsearch object field type (#5891)
* object-type searchable field WIP

* elasticsearch object-type field WIP

* talk about the object fieldType in the docs
2022-09-14 11:50:19 -05:00
John Joyce
450fb2effb
refactor(gms): Refactoring util + entity client class locations (#5902) 2022-09-12 12:11:28 -07:00
Ravindra Lanka
386719f15a
feat(platform): timeseries - Server & Client side changes to support timeseries aspect deletion & rollback. (#4756) 2022-09-11 11:27:46 -07:00
Gabe Lyons
86979e43ca
improving perf of filter query (#5858) 2022-09-07 16:39:33 -07:00
John Joyce
d15518f0d9
fix(browse): Fixing browse path to remove requirement for simple name suffix (#5634) 2022-09-07 13:32:38 -07:00
Aseem Bansal
b643b34d30
feat(restore-indices): add endpoint for restore indices, add basic check for graph (#5805) 2022-09-02 15:24:40 +05:30
Gabe Lyons
d75b2e8c9f
power favicon via env var (#5810) 2022-09-01 17:06:30 -07:00
Gabe Lyons
2e332d8c09
fix(graph service): only query for entities that should have lineage [Breaking Change] (#5539)
* allow filtering multiple entity types in graph service

* fixing up tests

* fixing imports

* lint fix

* another lint fix

* fixing another lint

* responding to comments

* fixing entity registry test

* always fetch yourself
2022-08-11 13:15:38 -07:00
John Joyce
e9494f503f
feat(search): Sticky search filters + misc bug fixes & improvements (#5601) 2022-08-10 15:12:53 -07:00
John Joyce
57b7ade1f0
feat(ui): Add rich UI ingestion run summary (#5577) 2022-08-08 14:33:57 -07:00
Mayuri Nehate
2c48329810
feat(model): dashboard usage model, is_null condition added (#5397) 2022-07-15 15:37:06 +05:30
Gabe Lyons
cd147685c7
feat(siblings): allow viewing siblings separately (#5390)
* allow pulling back curtain for siblings

* sibling pullback working for lineage + property merge

* propagating provinence to ui

* fixups from merge & some renames

* fix styling & add tooltip

* adding cypress tests

* fix lint

* updating mocks

* updating smoke test

* fixing domains smoke test

* responding to comments
2022-07-14 14:23:12 -07:00
Justin Marozas
414252351a
fix(cassandra): fix Cassandra queries used by IngestDataPlatformInstancesStep (#5199) 2022-07-07 22:20:57 -07:00
Chris Collins
68fb0d8f06
feat(schema) Show last observed timestamp in the schema tab (#5348) 2022-07-07 12:31:01 -07:00
Pedro Silva
bb3208d734
fix(gms) Remove auto-creating status aspects if not present when ingesting metadata (#5315) 2022-07-01 15:45:09 -07:00
John Joyce
b02c7f5952
perf(search): Improve search default performance (#5311) 2022-07-01 10:40:51 -07:00
John Joyce
11356e37ba
feat(ui) Adding support for deleting Tags and Domains via the UI (#5280)
* Adding support for deleting tags and domains via the UI

* Fixing tests
2022-06-29 19:41:41 -07:00
John Joyce
234d27a642
fix(ui): Support deleting references to glossary terms / nodes, users, assertions, and groups (#5248)
* Adding referential integrity to deletes API

* Updating comments

* Fix build

* fix checkstyle

* Fixing Delete Entity utils Test
2022-06-27 14:31:40 -07:00
Gabe Lyons
baf3f3f33c
feat(dbt): add sibling association logic to associate dbt elements with their target systems (#5190) 2022-06-22 08:31:18 -07:00
RyanHolstien
ba21efc7dd
feat(bootstrap): add bootstrap step to clear out unknown aspect rows from the database (#5148) 2022-06-21 16:00:16 -07:00
Chris Collins
2841f32b8e
feat(lineage) Update Lineage tab and Impact Analysis feature (#5121) 2022-06-21 07:30:40 -07:00
John Joyce
0c619ff393
fix(recommendations): Check whether an entity exists before recommending (#5163) 2022-06-14 10:51:06 -07:00
John Joyce
96c0746aff
refactor(graphql): Migrate Visual Config into the Configuration Provider (#4780) 2022-06-06 16:36:05 -07:00
RyanHolstien
9af78cf83d
fix(timelineAPI): fix issue with semantic versioning (#5033) 2022-05-27 17:17:57 -07:00
RyanHolstien
2a2fd05345
feat: telemetry improvements (#5029) 2022-05-27 17:04:45 -07:00
John Joyce
b6773e4637
feat(Tests): Make DataHub Tests Feature configurable via env variable (#5020) 2022-05-26 12:29:20 -07:00