421 Commits

Author SHA1 Message Date
Aditya Radhakrishnan
58b456c27d
feat(analytics): display glossary term percentage coverage (#4782) 2022-04-29 12:02:57 -07:00
David Haglund
4b913f674c
fix(docs): fix links (#4703) 2022-04-26 14:02:02 -07:00
Dexter Lee
980c0550de
fix(policies): Re-revert the policies fix + ingest documents directly to search (#4733) 2022-04-25 18:45:01 -07:00
John Joyce
325c9b0f08
Adding new models to python codegen (#4726) 2022-04-22 10:12:58 -07:00
Dexter Lee
3584d64f1c
Revert "fix(policy): Use search to fetch all policies (#4713)" (#4725)
This reverts commit 8185ba441cf9266c3c811f2d0b13cdd38b7df6ba.
2022-04-22 10:05:41 -07:00
Dexter Lee
8185ba441c
fix(policy): Use search to fetch all policies (#4713)
* fix(policy): Use search to fetch all policies

* Add updated timestamp

* Change refetching logic and add timeout

* Increase wait on smoke test
2022-04-21 22:15:11 -07:00
John Joyce
f387901ca8
feat(gms): Entity change events v1 (Platform Event) (#4687) 2022-04-19 20:04:14 -07:00
Gabe Lyons
c92990d32b
feat(ml): bringing ml screens up to date w/ the modern ui layout & improving ml lineage (#4651)
* backend ml changes

* updating ml model UI

* more work on the UI

* ml primary key joining the party

* more progress on UI

* making progress on lineage

* finalizing UI experience

* remove irrelevant test

* fixing lint

* fixups

* add tests and fix what the issues they discovered

* internal > core
2022-04-12 22:42:12 -07:00
Tamas Nemeth
902f525307
[model]: Dataprocess instance entity to model datajob/jobflow runs (#4459)
* Initial model for dataprocess instance to model datajob/jobflow runs

* Fixing typos

* Removing dataprocessinstance from entity registry

* Add dataprocessinstance to entity registry
Adding DataprocessInstancekey aspect

* Fixing relationships

* Updating the model

* Removing EditableDataProcessInstanceProperties

* Makint try number optional

* Updating model

* Fixing typo

* visualizing job runs for a task

* add pagination

* show utc time on hover

* add dataset side

* dataprocessinstance > dataprocessinst

* add cypress test

* Removing jobs from DataFlowInfo.pdl as it should be part of another change if we really want it

* Adding missing files

* Fix moved import

* Remove duplicate import

* fixing yarn test

* Update DatasetRunsResolver.java

* Update TaskRunsResolver.java

* Update DatasetRunsResolver.java

* responding to comments

Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
2022-04-12 08:52:07 +02:00
Dexter Lee
55f0412a33
feat(search): Add SearchScore annotation to use fields for search ranking (#4596)
* Add SearchScore annotation

* Add back test-model

* Remove search features

* Fix to John's comments

* simplify ranker

* Fix checkstyle
2022-04-07 11:07:27 -07:00
David Haglund
3a5cf8eded
fix(doc): try to fix broken link (#4593) 2022-04-06 10:38:39 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557)
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
2022-04-04 14:39:30 -05:00
RyanHolstien
a10a4ac62c
fix(dataPlatformInstance): add data platform instance to entity registry (#4537) 2022-03-30 22:55:31 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks (#4482)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
David Haglund
cd6a712896
fix(doc): Change to forward slash-separated strings, as in the example (#4528) 2022-03-30 09:10:23 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
John Joyce
0e4e32a317
Adding has container (#4526) 2022-03-29 18:26:28 -07:00
RyanHolstien
b843014c5e
Oss/urn validation (#4511) 2022-03-29 16:44:58 -07:00
mayurinehate
e2723bc981
feat(assertion): update python example, assertion entity doc (#4507) 2022-03-29 13:25:51 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies (#4516)
* Add domain based policy and view based policy

* Add new files

* Fix issue

* Fix comment on markdown

* Fix to John's comments

* Update policies.md

* Remove comments

* Fix to John's comments

* Fix policy details page

* Add back notebook privileges

* Fix graphql

Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Xu Wang
277ed43109
feat(notebook): add data models for Notebook entity (#4223)
* add Notebook data model

* resolve PR comments

1. add glossaryTerms aspect
2. make text in TextCell not searchable

* add dataPlatformInstance aspect and make notebookTool non-searchable

* make data doc cell title optional

* mark Notebook related aspects and entity as in BETA version

* add comments in entry-registry.yml for notebook entity

Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-03-21 14:10:52 -07:00
John Joyce
a453ebf02d
feat(autocomplete): Show recent searches + improved autocomplete (#4400) 2022-03-14 14:07:49 -07:00
John Joyce
ecd263b0d2
feat(*): Support setting owner type when assigning ownership (#4354) 2022-03-14 11:14:32 -07:00
Dexter Lee
18dd5b6c13
feat(Impact Analysis): Support impact analysis to check all downstreams of given entity (#4322) 2022-03-04 16:10:25 -08:00
mayurinehate
92b0e1c7c7
feat(tableau): emit workbook as container entity in tableau source, some minor fixes in tableau source (#4261) 2022-03-04 11:52:04 -08:00
John Joyce
9f1c5a8f75
feat(assertions): Adding Assertions Entity & Great Expectations BETA (#4305) 2022-03-04 11:51:31 -08:00
John Joyce
5cb02319c6
feat(ui): Introducing New group profile (#4308) 2022-03-03 18:04:48 -08:00
ksrinath
88d1c96fff
fix(doc) fix spelling mistake in dataset doc (#4264) 2022-02-28 10:53:45 -08:00
ksrinath
60c12d04be
docs(lineage): add fine-grained lineage docs and examples (#4260) 2022-02-25 07:35:48 -08:00
Dexter Lee
c2f3fe182f
feat(model): add searchable annotation for features in feature table (#4216) 2022-02-24 19:44:42 -08:00
Ravindra Lanka
232f7c5b21
feat(model): Column level lineage model (#4248)
co-authored-by: ksrinath <k.srinath@gmail.com>
2022-02-24 14:36:19 -08:00
Swaroop Jagadish
eaf7b02b2a
docs(model): auto-generated docs and hand-written docs for the metadata model (#4189) 2022-02-18 09:45:45 -08:00
John Joyce
93befda8cf
feat(groups): Adding editable group properties in the backend (#4166) 2022-02-17 22:47:59 -08:00
John Joyce
74ebbbf94f
fixes(ui): Misc UI fixes + Adding Owners to Search Filters (#4175) 2022-02-17 18:48:29 -08:00
John Joyce
da74943485
feat(ui): Edit glossary term descriptions via UI (#4156) 2022-02-16 15:01:22 -08:00
John Joyce
f2f5443d04
feat(Tags/Terms): Backend support for tag & term mutations (#4096) 2022-02-11 07:00:46 -08:00
John Joyce
0f56bc5d48
Adding extra properties to corp user editable info (#4097) 2022-02-09 08:58:40 -08:00
John Joyce
8002fd8eb6
feat(deprecation): Entity Deprecation Backend (#4073) 2022-02-08 15:28:32 -08:00
John Joyce
d19241740e
refactor(model): refactor new Assertion models (#4064) 2022-02-06 14:30:40 -08:00
John Joyce
c8922b39d6
feat(container): Add domains aspect to container. (#4059) 2022-02-04 10:18:53 -08:00
ksrinath
4c24f386a6
feat(model): data quality model (#3787)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
2022-02-02 22:56:08 -08:00
Gabe Lyons
94b6cb9ae9
feat(users): adding user graphql mutation (#4033) 2022-02-02 16:46:10 -08:00
John Joyce
7fef9a514a
feat(containers): Backend for Asset Containers (as demo'd in townhall) (#4019) 2022-02-01 11:07:34 -08:00
John Joyce
697eda7cee
feat(model): business-glossary - index glossary node custom properties (#3960) 2022-01-31 14:58:27 -08:00
Lal Rishav
ff367c0410
feat(ui): business glossary - add tabular schema and move to new UI components (#3813) 2022-01-31 11:21:06 -08:00
Swaroop Jagadish
9a9f448ebf
feat(ingest): platform-instance - changes to support platform instances in sources (#3996) 2022-01-27 15:31:25 -08:00
John Joyce
282851eeed
feat(domains): Adding backend for Asset Domains (p1) (#3952) 2022-01-27 13:07:11 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) (#3975) 2022-01-27 10:33:12 -08:00
Ravindra Lanka
a44b48a6b8
feat(ingest): elasticsearch - add Elasticsearch Source (#3893)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-14 13:10:12 -08:00
Aditya Radhakrishnan
c3e98645a2
feat(ingest): operational stats - show last updated for sql usage sources (#3845) 2022-01-07 17:27:09 -08:00