yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-07 17:23:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
12,004 Commits 190 Branches 118 Tags
Commit Graph

1355 Commits

Author SHA1 Message Date
Pedro Silva
bbe79170fc
feat(graphql) Add new Revokable Token API (#4970) 2022-05-24 10:44:31 -07:00
Maggie Hays
39fb7e5eb3
docs(townhall): update invite links and townhall history (#4977) 2022-05-23 13:45:17 -07:00
RyanHolstien
79f369c01a
doc(telemetry): fix telemetry doc (#4969) 2022-05-20 15:51:23 -07:00
Aseem Bansal
2260118232
feat(bigquery): reduce logging (#4961) 
* feat(bigquery): reduce logging

* doc: add entry for behaviour change
 2022-05-20 09:42:55 -07:00
RyanHolstien
8fbc61577c
feat: updates for 0.8.35 (#4960) 2022-05-19 22:55:56 +05:30
RyanHolstien
c3cfaf8e3c
feat(telemetry): add server side telemetry (#4925) 
Co-authored-by: Kevin Hu <kevinhuwest@gmail.com>
 2022-05-17 11:37:45 -07:00
Aseem Bansal
15438f62f1
fix(doc): update doc url to generated docs (#4860) 2022-05-13 10:19:46 +05:30
Pedro Silva
78c3ca039e
feat(gms): Add support for deleting reference pointers when deleting by urn (#4791) 2022-05-12 19:02:13 -07:00
RyanHolstien
a7bf5cde8b
docs(frontend): update build command for partial build (#4911) 2022-05-12 15:06:30 -07:00
Aseem Bansal
44c153dd60
doc(ingestion): add note for UI ingestion & custom sources (#4902) 2022-05-11 13:03:35 -07:00
Shirshanka Das
8d281fc013
fix(ingest): lookml - add view definitions for all views (#4875) 2022-05-10 10:48:36 -07:00
Aditya Radhakrishnan
34155ca4ad
docs(schema-history): add usage guide for schema history (#4817) 2022-05-05 13:41:47 -07:00
Pedro Silva
cfa61e1e34
fix(docs): Adds access policy documentation (#4813) 2022-05-05 10:01:02 -07:00
Aseem Bansal
58fbf9fc89
feat: updates for 0.8.34 (#4829) 2022-05-05 12:57:06 +02:00
Ronald Angel
8652de1aac
fix(docs): fix the metadata service auth documentation and frontend clarifications (#4722) 2022-05-04 15:33:33 -07:00
RyanHolstien
23f657ed76
feat(platform): openapi - initial post, get, and delete endpoints for entities (#4775) 2022-05-03 17:38:05 -07:00
John Joyce
1afbc4972d
fix(docs): Fixing outdated language in policies doc (#4799) 2022-05-02 13:30:37 -07:00
Shirshanka Das
a9ad138172
feat(ingest): docs - overhaul source connector docs to make it code driven (#4798) 
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
 2022-05-02 00:18:15 -07:00
Aseem Bansal
ee6413f0ab
feat(snowflake): add option to disable checking role grants (#4760) 
* feat(ingest): add option to disable checking role grants
 2022-04-29 10:14:05 +02:00
Aseem Bansal
4986be0d24
docs(dev): add warning for JDK (#4761) 2022-04-27 15:08:09 -07:00
Danilo Peixoto
d2a6bc06dc
feat(ingest): feast - add support for Feast 0.18, deprecate older integration (#4094) 2022-04-26 14:35:02 -07:00
David Haglund
4b913f674c
fix(docs): fix links (#4703) 2022-04-26 14:02:02 -07:00
Aseem Bansal
6cab90e103
docs: add missing PR numbers (#4742) 
* docs: add missing PR numbers & specific version where deprecation was done
 2022-04-26 10:18:24 -07:00
Shirshanka Das
a518e3d13e
feat(cli): improve error reporting, make sink config optional (#4718) 2022-04-24 17:12:21 -07:00
Aseem Bansal
c66ef7c1fe
fix(snowflake): deprecate config, update examples (#4644) 
* fix(snowflake): deprecate config, update examples

Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
 2022-04-20 15:21:09 -07:00
Aseem Bansal
bb0a87ae74
fix(snowflake): remove extra lineage edges in reports, change badly named config variable (#4595) 
* fix(snowflake): remove extra lineage edges in reports
 2022-04-20 07:03:54 -07:00
John Joyce
f387901ca8
feat(gms): Entity change events v1 (Platform Event) (#4687) 2022-04-19 20:04:14 -07:00
Felix Bechstein
d78b634e1b
fix(docs): elasticsearch secret reference (#4314) 2022-04-18 13:03:28 -07:00
John Joyce
7db6b0a03f
fix(docs): improve the add users doc (#4679) 2022-04-15 10:33:01 -07:00
Aditya Radhakrishnan
30b5b4c632
docs(tags): add tags usage guide (#4677) 2022-04-15 10:25:51 -07:00
Tamas Nemeth
f99d27fd8c
feat(ingest): airflow - add support to capture airflow executions, add high level dataflow jobs api to python sdk (#4615) 
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
 2022-04-12 23:19:39 -07:00
Aseem Bansal
04fd8fcbe8
doc(cli): add env variables and options for ingest command (#4598) 2022-04-11 09:18:51 +02:00
Aseem Bansal
25de224a3f
doc: add page for handling deprecations, breaking changes etc. (#4590) 2022-04-07 09:48:47 -07:00
Aditya Radhakrishnan
8610c29e49
feat(search) - add DATETIME FieldType (#4407) 
* feat(search) - add DATETIME FieldType
 2022-04-05 14:41:54 -07:00
Pedro Silva
a20012fd6c
feat(docs) Improves docs around developing datahub, removes deprecated docs on building metadata service (#4552) 2022-04-04 19:15:21 -07:00
Aseem Bansal
55308327f1
doc: make note prominent on quickstart (#4558) 2022-04-04 17:49:50 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557) 
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
 2022-04-04 14:39:30 -05:00
Mark H. Wilkinson
c8105945c3
docs: Fix PostgreSQL typo in features.md (#4560) 2022-04-01 13:16:48 -05:00
RyanHolstien
d311067384
fix(cli): delete - handle case insensitive entity types (#4492) 2022-03-30 20:37:14 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks (#4482) 
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
 2022-03-30 17:33:35 -07:00
Aseem Bansal
4db91e440d
doc: clarify CLI releases (#4533) 2022-03-30 10:07:09 -07:00
David Haglund
9881d75696
fix(docs): Minor fixes to pip install commands (#4315) 
Add closing quote where it was missing.
 2022-03-30 07:29:09 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies (#4516) 
* Add domain based policy and view based policy

* Add new files

* Fix issue

* Fix comment on markdown

* Fix to John's comments

* Update policies.md

* Remove comments

* Fix to John's comments

* Fix policy details page

* Add back notebook privileges

* Fix graphql

Co-authored-by: John Joyce <john@acryl.io>
 2022-03-29 12:02:22 -07:00
Aseem Bansal
13cc9ccfe2
doc: update instructions for updating DataHub on quickstart (#4401) 2022-03-28 09:37:37 -07:00
Pedro Silva
db35aca869
feat(frontend) Adds multiple group claim support (#4450) 2022-03-21 13:33:53 -07:00
Aseem Bansal
dc9228fa9b
doc: add guide for ui tabs (#4333) 
* doc: add guide for ui tabs

* docs: add details on properties tab

* add validation tab

* change arrangement
 2022-03-21 07:28:42 -07:00
Xu Wang
89a8fa05eb
(docs) add RFC file to introduce Notebook entity data model (#4237) 
* add RFC file to introduce DataDoc entity

* add PR link

* Model Notebook instead of DataDoc

DataDoc could be viewed as a subset of Notebook. We could model Notebook
instead and make DataDoc a subtype of Notebook

* update picture file name

* Put rfc number and resolve pr comments

Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
 2022-03-18 14:43:08 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Pedro Silva
aa593c32d8
Flexible search on soft delete (#4405) 
* Adds filter logic to correct DB

* Fix build

* Adds documentation & fixes flag typo

* apply review comments

* Adds test for filtered search

* Adds warning log for redundant parameter combo
 2022-03-16 16:35:04 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358) 
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
 2022-03-15 12:05:52 -07:00