633 Commits

Author SHA1 Message Date
david-leifker
d557fd65ff
fix(elasticsearch): fix orphan index clean up pattern, consistent top… (#7242) 2023-02-03 07:09:19 -06:00
Aditya Radhakrishnan
c13e7e09f8
feat(lineage): add time filtering for lineage edges (#7159) 2023-02-02 15:30:49 -08:00
Pedro Silva
4732694780
fix(gms): Corrects MCP generation in async mode (#7214)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-02 11:45:44 -08:00
Pedro Silva
050f0c4f84
fix(gms): Fixes delete references for single relationship aspects (#7211)
Deleting Container references were broken. This PR fixes that.

Root cause is #5248 which changed the MCP change type to DELETE for cases where an aspect after getting the reference removed was no longer valid. We do not support DELETE operations for MCPs.

The solution is then to execute EntityService#deleteAspect rather than emit a sync MCP.

A regression test was made to prevent this from happening again.

Co-authored-by: John Joyce <john@acryl.io>
2023-02-02 19:05:03 +00:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
david-leifker
07c5d4f6af
fix(misc): NPE and GraphQL case fixes (#7149) 2023-01-26 15:41:15 -08:00
Aseem Bansal
db968497cc
fix(analytics): add missing usage events causing warning in logs (#7109) 2023-01-24 17:15:14 +05:30
RyanHolstien
8323128437
feat(cache): add hazelcast distributed cache option (#6645)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-01-19 09:03:08 -08:00
Gabe Lyons
5cecc3c48e
feat(queries): [Experimental] Allow customization of # of queries in Query tab via env var (#6964) 2023-01-06 10:54:45 -08:00
david-leifker
c845866521
test(misc): misc test updates (#6890) 2022-12-29 11:26:42 -06:00
david-leifker
d8af0b43bd
fix(runid): always update runid, except when queued (#6876) 2022-12-28 13:09:30 -06:00
david-leifker
cb6314c51d
fix(elasticsearch): fixes out of order runId writes (#6845)
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-27 17:50:11 -06:00
Chris Collins
517688d050
fix(lineage) Fix lineage viz with multiple siblings (#6826) 2022-12-21 14:36:09 -05:00
Chris Collins
f559dcc282
feat(lineage) Adds ability to edit lineage manually from the UI (#6816) 2022-12-20 10:54:08 -05:00
John Joyce
54230a8d81
feat(): Views Feature Milestone 1 (#6666) 2022-12-12 12:30:09 -08:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework (#6634) 2022-12-06 10:22:41 -08:00
Chris Collins
b6887d23bb
feat(graph) Add createdOn, createdActor, updatedOn, updatedActor to graph edges (#6615) 2022-12-05 16:56:28 -05:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible (#6616) 2022-12-04 19:57:47 -08:00
david-leifker
83b21b021c
fix(security): security version updates (#6602) 2022-12-01 16:43:15 -06:00
david-leifker
4ca3327d89
fix(security): update ranger commons & dependencies for security vulns (#6577)
* fix(security): update ranger commons & dependencies for security vulns
2022-11-30 17:05:01 -06:00
John Joyce
73671de7e7
refactor(recommendations): Filtering for specific entity types in recommendations (#6538) 2022-11-23 13:33:35 -08:00
RyanHolstien
848574dbff
fix(platform): patch for entity creation, honor async flag on request (#6504) 2022-11-22 11:05:09 -08:00
Chris Collins
970e9f0aa7
fix(ui) Fix lineage graph rendering with duplicate nodes (#6480) 2022-11-18 12:28:30 -05:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests (#6269) 2022-11-15 18:03:11 -08:00
djordje-mijatovic
ca67e79b3b
feat(neo4j): Neo4j multihop support (#6104) 2022-11-15 09:14:01 -08:00
Corentin
fbcfcfc147
feat(recommendations): add last edited entities (#6329) 2022-11-14 22:15:48 -08:00
John Joyce
0b9a30bd8d
refactor(ui): Refactor the Glossary Related Entities, Tag Profiles to use search filters instead of query API. (#6352) 2022-11-03 15:32:25 -07:00
Gabe Lyons
fbd285e9b8
fix(search): fixing typo in es utils (#6348) 2022-11-02 16:27:35 -07:00
Aditya Radhakrishnan
873b100a47
refactor(change-events): refactor AspectDiffers to EntityChangeEventGenerators (#6320)
* refactor(change-events): refactor AspectDiffers to EntityChangeEventGenerators

* feat(change-event): add change events for AssertionRunEvent

* feat(change-event): add change events for DataProcessInstanceRunEvent
2022-11-01 09:53:43 -07:00
djordje-mijatovic
faddcbb404
feat(cassandra): Atomic updates in cassandra aspect dao (#6144) 2022-10-31 13:48:24 -07:00
Chris Collins
cd1331fffe
feat(lineage) Add column-level impact analysis feature (#6272) 2022-10-26 16:43:39 -04:00
Gabe Lyons
228c10de43
fix(adv search): two advanced search fixes (#6252)
* two advanced search fixes

* another approach

* adding unit tests

* fixing checkstyle issue
2022-10-26 11:31:38 -07:00
Chris Collins
31f90a4b52
fix(ui) Fix two lineage visualization bugs (#6278) 2022-10-26 13:56:32 -04:00
david-leifker
7cdc9f7fcf
test(neo4j): Improve test performance (#6142)
Reuse neo4j graph service in test for performance improvements.
2022-10-24 08:49:06 -07:00
RyanHolstien
762c9031e8
feat(metrics): add metrics around search caching (#6255) 2022-10-23 20:55:43 -07:00
Chris Collins
2f285b7470
fix(lineage) Fix batching to ES for impact analysis (#6149) 2022-10-07 15:16:23 -04:00
david-leifker
928f29438a
build: Update JNA for M1 Mac (#6116) 2022-10-05 14:53:38 -07:00
Gabe Lyons
ce90310dd0
feat(advanced-search): Complete Advanced Search: backend changes & tying UI together (#6068)
* stashing progress

* adding remove option

* more progress

* editing

* further in

* additional rendering improvements

* stashing adv search progress

* stashing more progress

* propagating not filters back to UI

* more frontend progress

* more filters working

* getting ready for data platform selector

* add platform select functionality

* locking out switching btwn advanced and standard filters

* final polish

* remove unneeded code

* added unit and cypress tests

* resolutions after merge

* adding documentation

* cleaning up & refactoring

* removing console.log

* minor ui fix & removing unneeded code

* fixing lineage search

* fixing lints

* fix display of degree

* fixing test

* fixing lint

* responding to comments

* fixing tests

* fix smoke tests

* fixing cypress

* fixing cypress test

* responding to comments
2022-10-04 10:20:04 -07:00
John Joyce
e2c5d2a4ce
feat(ui): bump max recommendations for Platforms (#6113) 2022-10-04 18:35:04 +05:30
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint (#6097)
* feat(ingest): add async option to ingest proposal endpoint

* small tweak to validate before write to K, also keep existing path for timeseries aspects

* avoid double convert

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
Shirshanka Das
e688dd554a
chore(deps): upgrade neo4j to 4.4.x (#6101) 2022-10-02 23:16:45 -07:00
Aseem Bansal
79575b2815
feat(retention): change default policy, add API to apply retention (#6088) 2022-09-30 16:11:39 +05:30
John Joyce
09dec1acec
fix(): Attempting to test paypal optimizations (#6073) 2022-09-28 09:40:19 -07:00
Shirshanka Das
1d45b81748
fix(deps): metadata-io - remove parquet dependency (#6046) 2022-09-26 18:08:53 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Aditya Radhakrishnan
325b959ea6
feat(roles): add ability to invite users into a role (#6015) 2022-09-23 16:48:23 -07:00
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs (#5901)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
Amanda Ng
63ef9c04f9
fix(ownership-differ): standardise ownership change event payload (#5967)
* fix(ownership-differ): standardise ownership change event payload

* fix(ownership-differ): update test case

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: John Joyce <john@acryl.io>
2022-09-22 15:06:17 -07:00
RyanHolstien
2c659214ab
feat(gms): Write back lineage search results to in-memory cache bound to feature flag (#6006)
Co-authored-by: Piyush Narang <piyushn@stripe.com>
2022-09-22 15:01:24 -07:00
Parham Ghazanfari
2712dd1903
fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism. (#5936)
* fix(patch-entity-registry): Remove exception for entities with key aspects.

* test(patch-entity-registry): Fix failing unit test for entities with key aspect

* test(patch-entity-registry): Fix checkstyle for PatchEntityRegistryTest.java

* fix(patch-entity-registry): Remove duplicate semicolon.

* fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism.

* fix(patch-entity-registry): Fixed incorrect merge conflict resolution in BrowsePathUtils.java

* fix(patch-entity-registry): Remove extraneous import from BrowsePathUtils.java

Co-authored-by: Parham Ghazanfari <pghazanfari53@yahoo.com>
2022-09-19 10:47:20 -05:00