132 Commits

Author SHA1 Message Date
neojunjie
5bb7fe3691
feat(ingest) - add audit actor urn to auditStamp (#5264) 2022-07-08 09:21:16 -07:00
John Joyce
11356e37ba
feat(ui) Adding support for deleting Tags and Domains via the UI (#5280)
* Adding support for deleting tags and domains via the UI

* Fixing tests
2022-06-29 19:41:41 -07:00
Gabe Lyons
9e58cd6ff1
fix(Siblings): Have sibling hook use entity client (#5279)
* fixing dbt platform issues

* have sibling hook use entity client over entity service

* switching search service as well

* lint

* more lint

* more specific exceptions
2022-06-29 10:02:45 -07:00
John Joyce
234d27a642
fix(ui): Support deleting references to glossary terms / nodes, users, assertions, and groups (#5248)
* Adding referential integrity to deletes API

* Updating comments

* Fix build

* fix checkstyle

* Fixing Delete Entity utils Test
2022-06-27 14:31:40 -07:00
Chris Collins
2841f32b8e
feat(lineage) Update Lineage tab and Impact Analysis feature (#5121) 2022-06-21 07:30:40 -07:00
Dexter Lee
669160a677
feat(run): Create a describe run endpoint for fetching aspects created by the ingestion run (#4964) 2022-05-24 14:46:36 -07:00
Pedro Silva
78c3ca039e
feat(gms): Add support for deleting reference pointers when deleting by urn (#4791) 2022-05-12 19:02:13 -07:00
Shirshanka Das
0341a4c159
refactor(metadata-service): remove redundant file (#4836) 2022-05-05 11:53:01 -07:00
RyanHolstien
65fb49f4b4
feat(versionedDataset): adds a versionStamp to timeline response & adds versionStamp param to dataset graphql (#4727) 2022-04-29 12:04:38 -07:00
Dexter Lee
32324a6476
fix(search): Make sure home page and search pages are consistent (#4588)
* Centralize entity count cache

* Fix to John's comment

* Fix test

* Fix tests
2022-04-06 22:06:55 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557)
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
2022-04-04 14:39:30 -05:00
Pedro Silva
152041b4c2
fix(rollback) Removes status & key aspects from affected aspects count during rollback (#4551) 2022-03-31 12:59:24 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks (#4482)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies (#4516)
* Add domain based policy and view based policy

* Add new files

* Fix issue

* Fix comment on markdown

* Fix to John's comments

* Update policies.md

* Remove comments

* Fix to John's comments

* Fix policy details page

* Add back notebook privileges

* Fix graphql

Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358)
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
ab0b5162af
fix(lineage): Move lineage registry to entity-registry module (#4412)
* Move lineage registry

* Fix test
2022-03-15 11:59:59 -07:00
Dexter Lee
18dd5b6c13
feat(Impact Analysis): Support impact analysis to check all downstreams of given entity (#4322) 2022-03-04 16:10:25 -08:00
mohdsiddique
e2f8db7926
feat: powerbi - add new source (#4201) 2022-02-28 17:37:22 -08:00
Dexter Lee
ae6f5a8dfa
Fix logging (#4136) 2022-02-14 13:52:21 -08:00
Dexter Lee
beab5ac977
fix(analytics): fix NPE in aggregate api (#4095) 2022-02-08 23:23:18 -08:00
RyanHolstien
34c27f076b
feat(removeGMA): remove all dependencies on gma libraries (#3835) 2022-01-05 17:32:31 -08:00
Dexter Lee
76f9423581
feat(nocode): Add get entities v2 endpoint that can get without snapshot (#3738) 2022-01-03 07:19:46 -08:00
xiphl
8cd1e91072
Upgrade to 3rd Apache patch for log4j (#3772) 2021-12-20 06:55:22 -08:00
John Joyce
5b5135be0b
fix(vuln): log4j vulnerability - bumping to 2.16.0 (#3755) 2021-12-15 11:07:45 -08:00
Ravindra Lanka
4b81ad6262
feat(Stateful Ingestion): 1/3 Stateful ingestion server changes (#3749) 2021-12-15 10:32:58 -08:00
Dexter Lee
8e4769f40c
feat(retention): Add retention to Local DB (#3715) 2021-12-13 18:18:02 -08:00
Fredrik Sannholm
d651040c85
Fix vulnderability (#3716) 2021-12-10 10:07:55 -08:00
Dexter Lee
4a672c2dc5
fix(kafka): Add back changes to centralize kafka config (#3675) 2021-12-06 22:31:48 -08:00
Shirshanka Das
842c05980b
feat(metadata-service): support for custom model extensions without forks (#3630) 2021-11-28 21:06:27 -08:00
Dexter Lee
025202a634
fix(search): Fix issue when query is empty (#3620) 2021-11-28 16:03:40 -08:00
John Joyce
f49666a230
feat(auth): Metadata Service Authentication! (#3598) 2021-11-22 16:33:14 -08:00