* Add Datasource as variable in dashboard
(cherry picked from commit e75b3f7333dd9436f7434eefa76ab9fbfb1babab)
* Update datahub_dashboard.json
(cherry picked from commit 701592697702a99ddf33f75d57826282df999c82)
* Bump docker compose version to 3.8
(cherry picked from commit ff6a97b1692ac21368eacc83a0daed30b0364d5d)
* Update grafana image tag from latest to 9.1.4
(cherry picked from commit 2c88e2a3041b9ddfa70bb92d13e80ca15be0ead2)
* Update old metric name in datahub_dashboard.json
(cherry picked from commit 21b502e25392f37c5053dcf00161fc5c7d35c94d)
* Add panel for new metrics
(cherry picked from commit 194452778bc825820dda87ab2e159b7064a360ef)
Co-authored-by: Peter Szalai <szalaipeti.vagyok@gmail.com>
* fix(standalone-consumers) Removes Solr from spring boot application config
* Adds standalone consumer option to datahub quickstart cli
* Rename files
* Make dockerize platform agnostic & change docker compose utility to work with M1
* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers
* Fix identation
* Use master code
* Adds ARM image publishing for consumers
* Fix linter
* Fix lint
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests