mirror of
https://github.com/datahub-project/datahub.git
synced 2025-12-30 11:24:56 +00:00
e8f6c4cabd
* Changes rollback behaviour to apply soft deletes by default Summary: Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back. Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete. Another PR will follow to perform garbage collection on these soft deleted entities. To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added. * Adds restli specs * Fixes deleteAspect endpoint & adds support for nested transactions * Enable regression test & fix docker-compose for local development * Add generated quickstart * Fix quickstart generation script * Adds missing var env to docker-compose-without-neo4j * Sets status removed=true when ingesting resources * Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands * Makes elastic search consistent * Update tests with new behaviour * apply review comments * apply review comment * Forces Elastic search to add documents with status removed false when ingesting * Reset gradle properties to default * Fix tests
15 lines
403 B
JSON
15 lines
403 B
JSON
[
|
|
{
|
|
"auditHeader": null,
|
|
"entityType": "dataset",
|
|
"entityUrn": "urn:li:dataset:(urn:li:dataPlatform:kafka,test-rollback,PROD)",
|
|
"entityKeyAspect": null,
|
|
"changeType": "UPSERT",
|
|
"aspectName": "editableDatasetProperties",
|
|
"aspect": {
|
|
"value": "{\"description\": \"Some Documentation\" }",
|
|
"contentType": "application/json"
|
|
},
|
|
"systemMetadata": null
|
|
}
|
|
] |