8 Commits

Author SHA1 Message Date
Shirshanka Das
4876fdd084
feat(quickstart): add support for env vars for Slack, Teams actions (#6591) 2022-12-03 23:00:50 -08:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358)
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
07b74b652e
fix(docker): fix volume mounts (#3341) 2021-10-08 15:46:18 -07:00
Dexter Lee
02dc74e916
fix(quickstart): remove mem_limit for datahub containers (#3064) 2021-08-09 19:11:38 -07:00
Harshal Sheth
8c3d266cf5
fix(quickstart): update compose spec version (#2873)
Also update the defaults to point at the head tag instead of latest.
2021-07-13 12:02:05 -07:00
John Joyce
c7ce817bb3
fix(quickstart): Fixing manual mysql quickstart (#2811) 2021-06-30 15:45:02 -07:00
John Joyce
5a4d194bad
feat(docker): reduce quickstart footprint (#2744) 2021-06-23 12:59:49 -07:00
John Joyce
7591c8994a
feat(datahub cli): DataHub CLI Quickstart (#2689) 2021-06-14 17:15:24 -07:00