152 Commits

Author SHA1 Message Date
Shirshanka Das
941770f3bc
feat(cli): quickstart - experimental support for backup restore (#5418) 2022-07-24 23:52:25 -07:00
Aseem Bansal
acb9879eb4
feat(cli,build): remove deprecated variables GMS_HOST/_PORT (#5451) 2022-07-20 20:54:43 +05:30
Mugdha Hardikar
a6dc669891
docs(bigquery): add changelog and unittest for profiling limits (#5407) 2022-07-19 09:39:09 +05:30
Aseem Bansal
36f3ab3fa3
feat(quickstart,docs): updates for v0.8.41 (#5409) 2022-07-15 21:32:32 +05:30
John Joyce
b927c0d219
refactor(ui): Use createTag mutation for creating new tags from the UI (#5359) 2022-07-08 09:18:33 -07:00
Aditya Radhakrishnan
fc8e59387d
feat(ingest): update CSV source to support description and ownership type (#5346) 2022-07-06 21:29:29 +05:30
Pedro Silva
4c94a7c30a
feat(docs) Add documentation on authorization & authentication (#5265) 2022-07-01 12:35:55 -07:00
Aseem Bansal
40452b3cc1
fix(docs,quickstart): release related changes for 0.8.40 (#5299) 2022-06-30 17:21:12 +05:30
Aseem Bansal
32e598df2b
feat(ingest): working with multiple bigquery projects (#5240) 2022-06-27 14:21:54 +05:30
Aseem Bansal
1adcc994f3
feat(ingest): remove need for sink block in UI based ingestion (#5208) 2022-06-23 15:22:40 +05:30
John Joyce
6b82a0b0b6
refactor(UI): Refactor Dataset Health Status (#5222) 2022-06-22 12:21:34 -07:00
Chris Collins
77f94cd349
feat(docs) Add and update docs for the new Glossary experience (#5211) 2022-06-21 15:55:20 -07:00
John Joyce
e2f1da00ff
refactor(configs): Simplify Kafka Topic name configurations + docs (#5198) 2022-06-17 12:15:51 -07:00
John Joyce
6bc29e6323
refactor(docs): Update Metadata Events Docs (#5173) 2022-06-17 06:29:50 -07:00
mayurinehate
7b143b06fc
feat(ingest): snowflake profile tables only if they have been updates since N days (#5132) 2022-06-13 14:59:16 +05:30
John Joyce
c4650356fa
Chore: Bump Default UI Ingestion Version (#5145) 2022-06-10 09:05:24 +05:30
Aditya Radhakrishnan
fdf4e48495
feat(users): add ability to add native users from the UI (#5097)
Co-authored-by: John Joyce <john@acryl.io>
2022-06-08 18:13:22 -07:00
Chris Collins
4120b12ab8
fix(docs): Update docs to alert users to restore indices for their Glossary (#5082) 2022-06-03 12:52:51 -07:00
Aseem Bansal
1fd5549ae3
fix(cli): don't use env for container, add example (#5012) 2022-05-29 08:26:45 -07:00
Aseem Bansal
71dc78eae3
doc(delete): add example for dataflow and datajob (#4994)
* doc(delete): add example for dataflow and datajob
2022-05-25 22:43:48 +02:00
Aseem Bansal
2260118232
feat(bigquery): reduce logging (#4961)
* feat(bigquery): reduce logging

* doc: add entry for behaviour change
2022-05-20 09:42:55 -07:00
RyanHolstien
8fbc61577c
feat: updates for 0.8.35 (#4960) 2022-05-19 22:55:56 +05:30
Aseem Bansal
15438f62f1
fix(doc): update doc url to generated docs (#4860) 2022-05-13 10:19:46 +05:30
Pedro Silva
78c3ca039e
feat(gms): Add support for deleting reference pointers when deleting by urn (#4791) 2022-05-12 19:02:13 -07:00
Aseem Bansal
44c153dd60
doc(ingestion): add note for UI ingestion & custom sources (#4902) 2022-05-11 13:03:35 -07:00
Shirshanka Das
8d281fc013
fix(ingest): lookml - add view definitions for all views (#4875) 2022-05-10 10:48:36 -07:00
Aseem Bansal
58fbf9fc89
feat: updates for 0.8.34 (#4829) 2022-05-05 12:57:06 +02:00
Shirshanka Das
a9ad138172
feat(ingest): docs - overhaul source connector docs to make it code driven (#4798)
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
2022-05-02 00:18:15 -07:00
Aseem Bansal
ee6413f0ab
feat(snowflake): add option to disable checking role grants (#4760)
* feat(ingest): add option to disable checking role grants
2022-04-29 10:14:05 +02:00
David Haglund
4b913f674c
fix(docs): fix links (#4703) 2022-04-26 14:02:02 -07:00
Aseem Bansal
6cab90e103
docs: add missing PR numbers (#4742)
* docs: add missing PR numbers & specific version where deprecation was done
2022-04-26 10:18:24 -07:00
Aseem Bansal
c66ef7c1fe
fix(snowflake): deprecate config, update examples (#4644)
* fix(snowflake): deprecate config, update examples

Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-20 15:21:09 -07:00
Aseem Bansal
bb0a87ae74
fix(snowflake): remove extra lineage edges in reports, change badly named config variable (#4595)
* fix(snowflake): remove extra lineage edges in reports
2022-04-20 07:03:54 -07:00
John Joyce
7db6b0a03f
fix(docs): improve the add users doc (#4679) 2022-04-15 10:33:01 -07:00
Aseem Bansal
25de224a3f
doc: add page for handling deprecations, breaking changes etc. (#4590) 2022-04-07 09:48:47 -07:00
Pedro Silva
a20012fd6c
feat(docs) Improves docs around developing datahub, removes deprecated docs on building metadata service (#4552) 2022-04-04 19:15:21 -07:00
RyanHolstien
d311067384
fix(cli): delete - handle case insensitive entity types (#4492) 2022-03-30 20:37:14 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks (#4482)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
Pedro Silva
db35aca869
feat(frontend) Adds multiple group claim support (#4450) 2022-03-21 13:33:53 -07:00
Aseem Bansal
dc9228fa9b
doc: add guide for ui tabs (#4333)
* doc: add guide for ui tabs

* docs: add details on properties tab

* add validation tab

* change arrangement
2022-03-21 07:28:42 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Pedro Silva
aa593c32d8
Flexible search on soft delete (#4405)
* Adds filter logic to correct DB

* Fix build

* Adds documentation & fixes flag typo

* apply review comments

* Adds test for filtered search

* Adds warning log for redundant parameter combo
2022-03-16 16:35:04 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358)
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
2022-03-15 12:05:52 -07:00
cccs-eric
cb9b99f0ba
fix(ingest) Azure AD: support nested groups (#4367) (#4368)
LGTM - Thanks!
2022-03-14 08:59:04 -07:00
John Joyce
c713b60810
fix(oidc): Update group membership each login (and make group extraction disabled by default) (#4380) 2022-03-11 08:49:31 -08:00
John Joyce
acf6eaaf1c
refactor(ui): Simplify process of adding user.props (w/ docs) (#4296) 2022-03-03 19:22:35 -08:00
John Joyce
29490e16c4
Small change (#4293) 2022-03-02 11:33:19 -08:00
Aseem Bansal
5f35620581
docs: add details to update users when using helm (#4268) 2022-03-01 16:41:37 -08:00
Aseem Bansal
c8a3e68202
fix(docs): doc build failing (#4267) 2022-02-28 10:53:22 -08:00
John Joyce
bcabff85d5
docs(ui): Adding guide for adding users to DataHub. (#4262) 2022-02-25 16:49:57 -08:00