* fix(patch-entity-registry): Remove exception for entities with key aspects.
* test(patch-entity-registry): Fix failing unit test for entities with key aspect
* test(patch-entity-registry): Fix checkstyle for PatchEntityRegistryTest.java
* fix(patch-entity-registry): Remove duplicate semicolon.
* fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism.
* fix(patch-entity-registry): Fixed incorrect merge conflict resolution in BrowsePathUtils.java
* fix(patch-entity-registry): Remove extraneous import from BrowsePathUtils.java
Co-authored-by: Parham Ghazanfari <pghazanfari53@yahoo.com>
* backend ml changes
* updating ml model UI
* more work on the UI
* ml primary key joining the party
* more progress on UI
* making progress on lineage
* finalizing UI experience
* remove irrelevant test
* fixing lint
* fixups
* add tests and fix what the issues they discovered
* internal > core
* Initial model for dataprocess instance to model datajob/jobflow runs
* Fixing typos
* Removing dataprocessinstance from entity registry
* Add dataprocessinstance to entity registry
Adding DataprocessInstancekey aspect
* Fixing relationships
* Updating the model
* Removing EditableDataProcessInstanceProperties
* Makint try number optional
* Updating model
* Fixing typo
* visualizing job runs for a task
* add pagination
* show utc time on hover
* add dataset side
* dataprocessinstance > dataprocessinst
* add cypress test
* Removing jobs from DataFlowInfo.pdl as it should be part of another change if we really want it
* Adding missing files
* Fix moved import
* Remove duplicate import
* fixing yarn test
* Update DatasetRunsResolver.java
* Update TaskRunsResolver.java
* Update DatasetRunsResolver.java
* responding to comments
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
