867 Commits

Author SHA1 Message Date
RyanHolstien
cbda3f5f29
feat(release): update CLI version (#4962)
* feat(release): update CLI version

* add typscript
2022-05-19 18:13:13 -07:00
RyanHolstien
8fbc61577c
feat: updates for 0.8.35 (#4960) 2022-05-19 22:55:56 +05:30
RyanHolstien
c3cfaf8e3c
feat(telemetry): add server side telemetry (#4925)
Co-authored-by: Kevin Hu <kevinhuwest@gmail.com>
2022-05-17 11:37:45 -07:00
John Joyce
f18f619a2c
feat(ui): Adding Search Bar to all List Views (groups, users, domains, policies, ingestion) (#4919) 2022-05-16 13:24:56 -07:00
John Joyce
25b89b318c
refactor(API): Add "Filter" support for Assertion Run Events, Dataset Profiles, Dataset Operations (#4869) 2022-05-12 22:10:02 -07:00
Pedro Silva
78c3ca039e
feat(gms): Add support for deleting reference pointers when deleting by urn (#4791) 2022-05-12 19:02:13 -07:00
RyanHolstien
d70df06c21
chore(jetty): upgrade jetty to 9.4.46 for CVE (#4857) 2022-05-06 14:18:20 -07:00
RyanHolstien
f1151cb478
Revert "fix(jetty): upgrade jetty dependency for CVE (#4838)" (#4844)
This reverts commit 1697bd0641bac248a72ed289bbbcf17c20b2f5a4.
2022-05-05 20:01:50 -07:00
RyanHolstien
1697bd0641
fix(jetty): upgrade jetty dependency for CVE (#4838) 2022-05-05 18:01:02 -07:00
RyanHolstien
e5a9a52ee4
fix(policies): change order of operations for policies bootstrap step to update index after database (#4841) 2022-05-05 16:35:35 -07:00
Shirshanka Das
0341a4c159
refactor(metadata-service): remove redundant file (#4836) 2022-05-05 11:53:01 -07:00
Aseem Bansal
58fbf9fc89
feat: updates for 0.8.34 (#4829) 2022-05-05 12:57:06 +02:00
RyanHolstien
23f657ed76
feat(platform): openapi - initial post, get, and delete endpoints for entities (#4775) 2022-05-03 17:38:05 -07:00
Aditya Radhakrishnan
b09e61eedb
feat(blame) - add schema history blame UI (#4793) 2022-05-02 17:28:47 -07:00
Chris Collins
0a0db02ae8
feat(tracking) Configure whether mixpanel is enabled with env variable (#4768) 2022-04-29 14:37:19 -07:00
John Joyce
f7d598336a
fix(ui ingest): Unschedule all sources on ingestion source refresh, fix delete not being enforced (#4792) 2022-04-29 14:34:01 -07:00
RyanHolstien
65fb49f4b4
feat(versionedDataset): adds a versionStamp to timeline response & adds versionStamp param to dataset graphql (#4727) 2022-04-29 12:04:38 -07:00
vanmeete
74d6d35881
feat(ingestion): add Pulsar source (#4721) 2022-04-29 15:57:02 +05:30
Dexter Lee
b02d8577eb
feat(ebeans): Add metrics to track connection pool (#4755) 2022-04-26 23:50:34 -07:00
Dexter Lee
980c0550de
fix(policies): Re-revert the policies fix + ingest documents directly to search (#4733) 2022-04-25 18:45:01 -07:00
Eddie (Xiao Di) Li
01a5b13a7a
feat(Cassandra): Add Cassandra implementation of EntityService (#3286) 2022-04-25 17:29:24 -07:00
John Joyce
b38d14fa67
fix(ui): Display warning in UI when metadata service auth is disabled. (#4728) 2022-04-22 12:09:05 -07:00
Dexter Lee
3584d64f1c
Revert "fix(policy): Use search to fetch all policies (#4713)" (#4725)
This reverts commit 8185ba441cf9266c3c811f2d0b13cdd38b7df6ba.
2022-04-22 10:05:41 -07:00
Dexter Lee
8185ba441c
fix(policy): Use search to fetch all policies (#4713)
* fix(policy): Use search to fetch all policies

* Add updated timestamp

* Change refetching logic and add timeout

* Increase wait on smoke test
2022-04-21 22:15:11 -07:00
John Joyce
f387901ca8
feat(gms): Entity change events v1 (Platform Event) (#4687) 2022-04-19 20:04:14 -07:00
Dexter Lee
0f669d5622
refactor(authorization): Add authorizedActor function to Authorizer interface (#4678) 2022-04-15 10:24:59 -07:00
Dexter Lee
b9a0f3c60e
Add more platforms (#4676) 2022-04-15 09:54:40 -07:00
Gabe Lyons
0c61dee07b
set custom logo without rebuilding (#4674) 2022-04-15 09:37:08 -07:00
Ravindra Lanka
9226e3e27f
Enable lower-casing of the name part of dataset urn via an environment vairable. (#4649) 2022-04-12 12:54:22 -07:00
Javier Sotelo
fa4cc3ad31
fix(metadata-service): stop overriding kafka registry props with empty values (#4604)
Co-authored-by: jsotelo <javier.sotelo@viasat.com>
2022-04-11 22:02:47 -07:00
jchen0824
524d183d93
feat: add presto-on-hive metadata ingestion source (#4625)
* feat(metadata ingestion source): add presto-on-hive metadata ingestion source

Co-authored-by: Houren Chen <houren.chen@grabtaxi.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-11 17:46:44 -07:00
Dexter Lee
55f0412a33
feat(search): Add SearchScore annotation to use fields for search ranking (#4596)
* Add SearchScore annotation

* Add back test-model

* Remove search features

* Fix to John's comments

* simplify ranker

* Fix checkstyle
2022-04-07 11:07:27 -07:00
Dexter Lee
32324a6476
fix(search): Make sure home page and search pages are consistent (#4588)
* Centralize entity count cache

* Fix to John's comment

* Fix test

* Fix tests
2022-04-06 22:06:55 -07:00
John Joyce
7080798825
feat(metadata-service): Supporting a configurable Authorizer Chain (#4584) 2022-04-06 19:13:39 -07:00
Aseem Bansal
32349bf405
chore: update default cli for managed ingestion (#4581) 2022-04-05 15:33:13 -07:00
Dexter Lee
cea318ac8e
Renaming producer (#4573) 2022-04-04 16:46:32 -07:00
John Joyce
95d6bcd1a0
exposing kafka consumer concurrency (#4536) 2022-04-04 14:57:34 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557)
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
2022-04-04 14:39:30 -05:00
Pedro Silva
152041b4c2
fix(rollback) Removes status & key aspects from affected aspects count during rollback (#4551) 2022-03-31 12:59:24 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks (#4482)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
David Haglund
cd6a712896
fix(doc): Change to forward slash-separated strings, as in the example (#4528) 2022-03-30 09:10:23 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies (#4516)
* Add domain based policy and view based policy

* Add new files

* Fix issue

* Fix comment on markdown

* Fix to John's comments

* Update policies.md

* Remove comments

* Fix to John's comments

* Fix policy details page

* Add back notebook privileges

* Fix graphql

Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358)
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
ab0b5162af
fix(lineage): Move lineage registry to entity-registry module (#4412)
* Move lineage registry

* Fix test
2022-03-15 11:59:59 -07:00
Dexter Lee
a12c9d2a30
Add flag to enable cache (#4335) 2022-03-14 16:40:10 -07:00
John Joyce
a453ebf02d
feat(autocomplete): Show recent searches + improved autocomplete (#4400) 2022-03-14 14:07:49 -07:00
John Joyce
ecd263b0d2
feat(*): Support setting owner type when assigning ownership (#4354) 2022-03-14 11:14:32 -07:00
Aseem Bansal
4bcc2b3d12
feat(ingestion): improve logging, docs for bigquery, snowflake, redshift (#4344) 2022-03-14 08:50:29 -07:00