25 Commits

Author SHA1 Message Date
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier (#13220) 2025-04-16 16:55:51 -07:00
Gabe Lyons
539f521388
docs(delete): Document un-soft-delete commands in delete-metadata.md (#12251) 2025-01-02 18:56:54 -05:00
kevinkarchacryl
d0b4f7a7d3
feat(cli): added cli option for ingestion source (#11980) 2024-12-16 16:03:11 -05:00
Harshal Sheth
5032af9123
feat(cli): support recursive deletes (#8709) 2023-08-30 12:07:41 -07:00
Harshal Sheth
afd65e16fb
feat(cli): delete cli v2 (#8068) 2023-05-23 14:43:44 -05:00
John Joyce
cbfe887609
fix(docs): Fixing timeseries delete doc until code path is fixed (#7711) 2023-03-29 14:33:17 -07:00
Aseem Bansal
24dcdd05c5
docs(delete): cleanup removed option (#7335) 2023-02-14 17:25:21 +01:00
Paul Logan
f085ec225b
Docs fixes week of 12 22 (#6963)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-06 16:14:49 -08:00
Ravindra Lanka
386719f15a
feat(platform): timeseries - Server & Client side changes to support timeseries aspect deletion & rollback. (#4756) 2022-09-11 11:27:46 -07:00
Aseem Bansal
9b5afcce51
feat(cli): delete - add --only-soft-deleted option, perf improvements (#5485) 2022-07-27 11:22:24 -07:00
Aseem Bansal
1fd5549ae3
fix(cli): don't use env for container, add example (#5012) 2022-05-29 08:26:45 -07:00
Aseem Bansal
71dc78eae3
doc(delete): add example for dataflow and datajob (#4994)
* doc(delete): add example for dataflow and datajob
2022-05-25 22:43:48 +02:00
Pedro Silva
78c3ca039e
feat(gms): Add support for deleting reference pointers when deleting by urn (#4791) 2022-05-12 19:02:13 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks (#4482)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
Pedro Silva
aa593c32d8
Flexible search on soft delete (#4405)
* Adds filter logic to correct DB

* Fix build

* Adds documentation & fixes flag typo

* apply review comments

* Adds test for filtered search

* Adds warning log for redundant parameter combo
2022-03-16 16:35:04 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358)
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
2022-03-15 12:05:52 -07:00
Aseem Bansal
137afa5c9d
docs(delete): add curl request example to delete entity (#3928) 2022-01-25 18:54:19 -08:00
Aseem Bansal
b3ef5ee489
docs(scheduling): re-arrange docs related to scheduling, lineage, CLI (#3669) 2021-12-07 10:09:59 -08:00
Swaroop Jagadish
9f9aaaac23
feat(cli): adding a put command and docs (#3614) 2021-11-24 00:21:44 -08:00
aseembansal-gogo
658fa81406
fix(docs): Add docs on accessing datahub CLI (#3589) 2021-11-18 08:57:05 -08:00
Swaroop Jagadish
3984506f51
feat(cli): add support for deletion based on filters, soft deletes an… (#3527) 2021-11-07 22:13:50 -08:00
aseembansal-gogo
dd1f6fbc5e
feat(ingest): add -f option to skip confirmations for automation en… (#3256) 2021-09-28 22:49:34 -07:00
aseembansal-gogo
97bed71e1c
feat(ingest): support for env variable in cli (#3215) 2021-09-16 23:18:42 -07:00
Gabe Lyons
4e15c7adbb
feat(cli): datahub init & docs for it (#3062) 2021-08-09 22:30:48 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest (#2960) 2021-07-29 20:04:40 -07:00