1367 Commits

Author SHA1 Message Date
RyanHolstien
d311067384
fix(cli): delete - handle case insensitive entity types (#4492) 2022-03-30 20:37:14 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks (#4482)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
Aseem Bansal
4db91e440d
doc: clarify CLI releases (#4533) 2022-03-30 10:07:09 -07:00
David Haglund
9881d75696
fix(docs): Minor fixes to pip install commands (#4315)
Add closing quote where it was missing.
2022-03-30 07:29:09 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies (#4516)
* Add domain based policy and view based policy

* Add new files

* Fix issue

* Fix comment on markdown

* Fix to John's comments

* Update policies.md

* Remove comments

* Fix to John's comments

* Fix policy details page

* Add back notebook privileges

* Fix graphql

Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Aseem Bansal
13cc9ccfe2
doc: update instructions for updating DataHub on quickstart (#4401) 2022-03-28 09:37:37 -07:00
Pedro Silva
db35aca869
feat(frontend) Adds multiple group claim support (#4450) 2022-03-21 13:33:53 -07:00
Aseem Bansal
dc9228fa9b
doc: add guide for ui tabs (#4333)
* doc: add guide for ui tabs

* docs: add details on properties tab

* add validation tab

* change arrangement
2022-03-21 07:28:42 -07:00
Xu Wang
89a8fa05eb
(docs) add RFC file to introduce Notebook entity data model (#4237)
* add RFC file to introduce DataDoc entity

* add PR link

* Model Notebook instead of DataDoc

DataDoc could be viewed as a subset of Notebook. We could model Notebook
instead and make DataDoc a subtype of Notebook

* update picture file name

* Put rfc number and resolve pr comments

Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-03-18 14:43:08 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Pedro Silva
aa593c32d8
Flexible search on soft delete (#4405)
* Adds filter logic to correct DB

* Fix build

* Adds documentation & fixes flag typo

* apply review comments

* Adds test for filtered search

* Adds warning log for redundant parameter combo
2022-03-16 16:35:04 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358)
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
2022-03-15 12:05:52 -07:00
Ravindra Lanka
30ed5f2a2f
feat(ingestion): cli - Add the ability to query the latest timeseries aspect value via the get command. (#4395) 2022-03-14 19:03:56 -07:00
cccs-eric
cb9b99f0ba
fix(ingest) Azure AD: support nested groups (#4367) (#4368)
LGTM - Thanks!
2022-03-14 08:59:04 -07:00
RyanHolstien
63a333928b
docs(model): update docs on extending metadata model, remove inaccurate faq (#4393) 2022-03-12 15:16:14 -08:00
John Joyce
c713b60810
fix(oidc): Update group membership each login (and make group extraction disabled by default) (#4380) 2022-03-11 08:49:31 -08:00
Dexter Lee
128148e5e9
ADd docs on attaching policies (#4334) 2022-03-07 12:07:07 -08:00
Dexter Lee
e748a70da0
fix(doc): add warning on using AWS glue schema registry (#4306) 2022-03-03 20:56:07 -08:00
John Joyce
acf6eaaf1c
refactor(ui): Simplify process of adding user.props (w/ docs) (#4296) 2022-03-03 19:22:35 -08:00
John Joyce
29490e16c4
Small change (#4293) 2022-03-02 11:33:19 -08:00
Sergio Gómez Villamor
a2a939d406
feat(model): adds PRE in the FabricType enum (#4226) 2022-03-01 16:45:41 -08:00
Aseem Bansal
5f35620581
docs: add details to update users when using helm (#4268) 2022-03-01 16:41:37 -08:00
mohdsiddique
e2f8db7926
feat: powerbi - add new source (#4201) 2022-02-28 17:37:22 -08:00
Aseem Bansal
c8a3e68202
fix(docs): doc build failing (#4267) 2022-02-28 10:53:22 -08:00
John Joyce
bcabff85d5
docs(ui): Adding guide for adding users to DataHub. (#4262) 2022-02-25 16:49:57 -08:00
ksrinath
60c12d04be
docs(lineage): add fine-grained lineage docs and examples (#4260) 2022-02-25 07:35:48 -08:00
Aseem Bansal
4b4c7d593b
chore(docs): cleanup location of guide, gitignore generated from git (#4256) 2022-02-24 22:58:14 -08:00
Ravindra Lanka
1ac20ee764
feat(platform): add timeline api for dataset entity (#4252) 2022-02-24 19:40:55 -08:00
Edward Vaisman
6ff551cbcd
feat(ingest): lineage-file - add ability to provide lineage manually through a file (#4116) 2022-02-24 17:02:38 -08:00
Bumsoo Kim
f17c033d51
fix(docs): fix reference to the credential step in okta guide (#4243) 2022-02-24 16:39:02 -08:00
Maggie Hays
975b356c91
docs: Add Udemy & Adevinta logos (#4247) 2022-02-24 12:39:50 -08:00
Kevin Hu
46701319dc
feat(ingest): switch telemetry endpoint to Mixpanel (#4238) 2022-02-24 12:35:48 -08:00
Aseem Bansal
e6ff6000ec
fix(docs): add mention of list-runs command in CLI page (#4210) 2022-02-22 22:13:24 -08:00
xiphl
a6ab32675f
docs: search - Tips on advanced searching in the search bar (#4200) 2022-02-20 14:04:58 -08:00
Swaroop Jagadish
eaf7b02b2a
docs(model): auto-generated docs and hand-written docs for the metadata model (#4189) 2022-02-18 09:45:45 -08:00
buggythepirate
292dcf34e4
Update querying-entities.md (#4157) 2022-02-16 16:08:29 -08:00
Aseem Bansal
c6c71ac8bf
fix(cli): add timeout for telemetry calls (#4135) 2022-02-15 14:39:46 -08:00
Satyam Krishna
0dd2a7b753
docs : markdown fixes for db retention table (#4148) 2022-02-15 07:17:40 -08:00
Satyam Krishna
ecfe8a2649
Fix the markdown for tables (#4133) 2022-02-14 22:03:22 -08:00
David Haglund
6c214add36
fix(docs) Fix doc on modelDocUpload (#4112)
Update the doc to use the same environment variable as the script
to configure which Datahub server to upload the model doc to.
2022-02-11 13:43:59 -08:00
Aseem Bansal
7fcc71ed81
fix(docs): make intro to metadata ingestion easier for beginners (#4039)
* fix(docs): fix sidebar titles for clarity

* re-arrange docs to make Intro to Metadata ingestion easier for beginners

* minor changes for readability

* add heading

* docs: add note for common question
2022-02-11 09:03:01 -08:00
Aseem Bansal
25a426a06f
docs(backup): add doc for taking backup (#3917)
* docs(backup): add doc for taking backup

* change file name
2022-02-11 08:57:05 -08:00
Swaroop Jagadish
d1a14abb53
fix(docs): fixing metadata model doc generation script and updating png (#4120) 2022-02-10 22:56:28 -08:00
John Joyce
a800c796b1
docs(ingest): Adding UI ingestion guide (#4048) 2022-02-03 12:46:38 -08:00
John Joyce
78d35f95cf
docs(domains): Adding a User Guide for Domains (#4038) 2022-02-02 09:07:51 -08:00
John Joyce
15db308568
Adding Initiate login uri to okta docs (#4030) 2022-02-01 11:38:00 -08:00
RyanHolstien
498e28ad18
docs(platform): improve docs for remote deploy and auto render (#4020)
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2022-02-01 00:14:37 -08:00
John Joyce
3c2a4fe39d
Refining docs (#4001) 2022-01-28 15:00:35 -08:00
John Joyce
ca2d625529
docs(metadata-model): Adding to Metadata model docs (#3998)
* Adding better metadata model docs

* Final changes
2022-01-27 16:44:59 -08:00
Swaroop Jagadish
9a9f448ebf
feat(ingest): platform-instance - changes to support platform instances in sources (#3996) 2022-01-27 15:31:25 -08:00