63 Commits

Author SHA1 Message Date
Gabe Lyons
ce90310dd0
feat(advanced-search): Complete Advanced Search: backend changes & tying UI together (#6068)
* stashing progress

* adding remove option

* more progress

* editing

* further in

* additional rendering improvements

* stashing adv search progress

* stashing more progress

* propagating not filters back to UI

* more frontend progress

* more filters working

* getting ready for data platform selector

* add platform select functionality

* locking out switching btwn advanced and standard filters

* final polish

* remove unneeded code

* added unit and cypress tests

* resolutions after merge

* adding documentation

* cleaning up & refactoring

* removing console.log

* minor ui fix & removing unneeded code

* fixing lineage search

* fixing lints

* fix display of degree

* fixing test

* fixing lint

* responding to comments

* fixing tests

* fix smoke tests

* fixing cypress

* fixing cypress test

* responding to comments
2022-10-04 10:20:04 -07:00
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint (#6097)
* feat(ingest): add async option to ingest proposal endpoint

* small tweak to validate before write to K, also keep existing path for timeseries aspects

* avoid double convert

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
Aseem Bansal
79575b2815
feat(retention): change default policy, add API to apply retention (#6088) 2022-09-30 16:11:39 +05:30
Ravindra Lanka
386719f15a
feat(platform): timeseries - Server & Client side changes to support timeseries aspect deletion & rollback. (#4756) 2022-09-11 11:27:46 -07:00
Aseem Bansal
b643b34d30
feat(restore-indices): add endpoint for restore indices, add basic check for graph (#5805) 2022-09-02 15:24:40 +05:30
Aditya Radhakrishnan
73cd2f995d
feat(roles): add roles feature to DataHub (#5767) 2022-08-30 18:31:34 -07:00
Gabe Lyons
d9b2a45c5f
feat(looker): index looker charts and dashboards by business term (#5649) 2022-08-24 08:01:56 -07:00
John Joyce
be22455ebb
feat(ui): Adding slack handle to corp group info (#5645) 2022-08-15 14:35:57 -07:00
Gabe Lyons
c41f92c8d0
feat(model): Add optional message field to auditstamp (#5611)
* adding messge to audit stamp

* Update AuditStamp.pdl

* Update AuditStamp.pdl
2022-08-11 13:48:49 -07:00
Mayuri Nehate
2c48329810
feat(model): dashboard usage model, is_null condition added (#5397) 2022-07-15 15:37:06 +05:30
Felix Lüdin
a0303448ba
feat(dashboards): add datasets field to DashboardInfo aspect (#5188)
Co-authored-by: John Joyce <john@acryl.io>
2022-07-14 09:54:02 -07:00
Chris Collins
68fb0d8f06
feat(schema) Show last observed timestamp in the schema tab (#5348) 2022-07-07 12:31:01 -07:00
Gabe Lyons
9e58cd6ff1
fix(Siblings): Have sibling hook use entity client (#5279)
* fixing dbt platform issues

* have sibling hook use entity client over entity service

* switching search service as well

* lint

* more lint

* more specific exceptions
2022-06-29 10:02:45 -07:00
Chris Collins
2841f32b8e
feat(lineage) Update Lineage tab and Impact Analysis feature (#5121) 2022-06-21 07:30:40 -07:00
Dexter Lee
92f81189eb
feat(model): Add optional context field to tag/term association (#5085) 2022-06-06 08:46:32 -07:00
Aseem Bansal
2dd826626d
feat(model): new chart types (#5017) 2022-06-01 18:14:36 +05:30
John Joyce
1a31f7888a
fix(restore): Add RESTATE ChangeType to MCL / MCP to permit restore indices (#5022) 2022-05-30 10:04:51 -07:00
Chris Collins
43deb7080a
feat(glossary) Business Glossary updates (#5026) 2022-05-29 21:26:07 -07:00
mayurinehate
65cf0053a3
feat(model): add created, lastModified auditstamps to SchemaField (#4943) 2022-05-24 22:51:26 -07:00
Dexter Lee
669160a677
feat(run): Create a describe run endpoint for fetching aspects created by the ingestion run (#4964) 2022-05-24 14:46:36 -07:00
John Joyce
25b89b318c
refactor(API): Add "Filter" support for Assertion Run Events, Dataset Profiles, Dataset Operations (#4869) 2022-05-12 22:10:02 -07:00
Pedro Silva
78c3ca039e
feat(gms): Add support for deleting reference pointers when deleting by urn (#4791) 2022-05-12 19:02:13 -07:00
RyanHolstien
65fb49f4b4
feat(versionedDataset): adds a versionStamp to timeline response & adds versionStamp param to dataset graphql (#4727) 2022-04-29 12:04:38 -07:00
Dexter Lee
980c0550de
fix(policies): Re-revert the policies fix + ingest documents directly to search (#4733) 2022-04-25 18:45:01 -07:00
Dexter Lee
3584d64f1c
Revert "fix(policy): Use search to fetch all policies (#4713)" (#4725)
This reverts commit 8185ba441cf9266c3c811f2d0b13cdd38b7df6ba.
2022-04-22 10:05:41 -07:00
Dexter Lee
8185ba441c
fix(policy): Use search to fetch all policies (#4713)
* fix(policy): Use search to fetch all policies

* Add updated timestamp

* Change refetching logic and add timeout

* Increase wait on smoke test
2022-04-21 22:15:11 -07:00
Dexter Lee
55f0412a33
feat(search): Add SearchScore annotation to use fields for search ranking (#4596)
* Add SearchScore annotation

* Add back test-model

* Remove search features

* Fix to John's comments

* simplify ranker

* Fix checkstyle
2022-04-07 11:07:27 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557)
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
2022-04-04 14:39:30 -05:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks (#4482)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
David Haglund
cd6a712896
fix(doc): Change to forward slash-separated strings, as in the example (#4528) 2022-03-30 09:10:23 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies (#4516)
* Add domain based policy and view based policy

* Add new files

* Fix issue

* Fix comment on markdown

* Fix to John's comments

* Update policies.md

* Remove comments

* Fix to John's comments

* Fix policy details page

* Add back notebook privileges

* Fix graphql

Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358)
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
2022-03-15 12:05:52 -07:00
John Joyce
a453ebf02d
feat(autocomplete): Show recent searches + improved autocomplete (#4400) 2022-03-14 14:07:49 -07:00
John Joyce
ecd263b0d2
feat(*): Support setting owner type when assigning ownership (#4354) 2022-03-14 11:14:32 -07:00
Dexter Lee
18dd5b6c13
feat(Impact Analysis): Support impact analysis to check all downstreams of given entity (#4322) 2022-03-04 16:10:25 -08:00
mayurinehate
92b0e1c7c7
feat(tableau): emit workbook as container entity in tableau source, some minor fixes in tableau source (#4261) 2022-03-04 11:52:04 -08:00
Sergio Gómez Villamor
a2a939d406
feat(model): adds PRE in the FabricType enum (#4226) 2022-03-01 16:45:41 -08:00
Ravindra Lanka
232f7c5b21
feat(model): Column level lineage model (#4248)
co-authored-by: ksrinath <k.srinath@gmail.com>
2022-02-24 14:36:19 -08:00
John Joyce
f2f5443d04
feat(Tags/Terms): Backend support for tag & term mutations (#4096) 2022-02-11 07:00:46 -08:00
John Joyce
0f56bc5d48
Adding extra properties to corp user editable info (#4097) 2022-02-09 08:58:40 -08:00
John Joyce
8002fd8eb6
feat(deprecation): Entity Deprecation Backend (#4073) 2022-02-08 15:28:32 -08:00
Gabe Lyons
94b6cb9ae9
feat(users): adding user graphql mutation (#4033) 2022-02-02 16:46:10 -08:00
Lal Rishav
ff367c0410
feat(ui): business glossary - add tabular schema and move to new UI components (#3813) 2022-01-31 11:21:06 -08:00
Aditya Radhakrishnan
b5ff558f03
feat(model) - Update FabricType enum to represent more fabrics (#3997)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-30 18:19:03 -06:00
Swaroop Jagadish
9a9f448ebf
feat(ingest): platform-instance - changes to support platform instances in sources (#3996) 2022-01-27 15:31:25 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) (#3975) 2022-01-27 10:33:12 -08:00
RyanHolstien
34c27f076b
feat(removeGMA): remove all dependencies on gma libraries (#3835) 2022-01-05 17:32:31 -08:00
Dexter Lee
76f9423581
feat(nocode): Add get entities v2 endpoint that can get without snapshot (#3738) 2022-01-03 07:19:46 -08:00
Ravindra Lanka
4b81ad6262
feat(Stateful Ingestion): 1/3 Stateful ingestion server changes (#3749) 2021-12-15 10:32:58 -08:00