* backend ml changes
* updating ml model UI
* more work on the UI
* ml primary key joining the party
* more progress on UI
* making progress on lineage
* finalizing UI experience
* remove irrelevant test
* fixing lint
* fixups
* add tests and fix what the issues they discovered
* internal > core
* Initial model for dataprocess instance to model datajob/jobflow runs
* Fixing typos
* Removing dataprocessinstance from entity registry
* Add dataprocessinstance to entity registry
Adding DataprocessInstancekey aspect
* Fixing relationships
* Updating the model
* Removing EditableDataProcessInstanceProperties
* Makint try number optional
* Updating model
* Fixing typo
* visualizing job runs for a task
* add pagination
* show utc time on hover
* add dataset side
* dataprocessinstance > dataprocessinst
* add cypress test
* Removing jobs from DataFlowInfo.pdl as it should be part of another change if we really want it
* Adding missing files
* Fix moved import
* Remove duplicate import
* fixing yarn test
* Update DatasetRunsResolver.java
* Update TaskRunsResolver.java
* Update DatasetRunsResolver.java
* responding to comments
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
* bug(glossaryTermLabels): fix glossary term labels missing and add cypress test
* review comment
* fix cypress test
Co-authored-by: Ryan Holstien <ryan@acryl.io>
* fix detached from dom issue in modal clicks
* warm up ES cache
* warm up ES cache
* trying to connect cypress w/ dashboard
* fix spacing
* record the run
* reverting cypress cli stuff
