John Joyce
f7d598336a
fix(ui ingest): Unschedule all sources on ingestion source refresh, fix delete not being enforced ( #4792 )
2022-04-29 14:34:01 -07:00
RyanHolstien
65fb49f4b4
feat(versionedDataset): adds a versionStamp to timeline response & adds versionStamp param to dataset graphql ( #4727 )
2022-04-29 12:04:38 -07:00
vanmeete
74d6d35881
feat(ingestion): add Pulsar source ( #4721 )
2022-04-29 15:57:02 +05:30
Dexter Lee
b02d8577eb
feat(ebeans): Add metrics to track connection pool ( #4755 )
2022-04-26 23:50:34 -07:00
Dexter Lee
980c0550de
fix(policies): Re-revert the policies fix + ingest documents directly to search ( #4733 )
2022-04-25 18:45:01 -07:00
Eddie (Xiao Di) Li
01a5b13a7a
feat(Cassandra): Add Cassandra implementation of EntityService ( #3286 )
2022-04-25 17:29:24 -07:00
John Joyce
b38d14fa67
fix(ui): Display warning in UI when metadata service auth is disabled. ( #4728 )
2022-04-22 12:09:05 -07:00
Dexter Lee
3584d64f1c
Revert "fix(policy): Use search to fetch all policies ( #4713 )" ( #4725 )
...
This reverts commit 8185ba441cf9266c3c811f2d0b13cdd38b7df6ba.
2022-04-22 10:05:41 -07:00
Dexter Lee
8185ba441c
fix(policy): Use search to fetch all policies ( #4713 )
...
* fix(policy): Use search to fetch all policies
* Add updated timestamp
* Change refetching logic and add timeout
* Increase wait on smoke test
2022-04-21 22:15:11 -07:00
John Joyce
f387901ca8
feat(gms): Entity change events v1 (Platform Event) ( #4687 )
2022-04-19 20:04:14 -07:00
Dexter Lee
0f669d5622
refactor(authorization): Add authorizedActor function to Authorizer interface ( #4678 )
2022-04-15 10:24:59 -07:00
Dexter Lee
b9a0f3c60e
Add more platforms ( #4676 )
2022-04-15 09:54:40 -07:00
Gabe Lyons
0c61dee07b
set custom logo without rebuilding ( #4674 )
2022-04-15 09:37:08 -07:00
Ravindra Lanka
9226e3e27f
Enable lower-casing of the name part of dataset urn via an environment vairable. ( #4649 )
2022-04-12 12:54:22 -07:00
Javier Sotelo
fa4cc3ad31
fix(metadata-service): stop overriding kafka registry props with empty values ( #4604 )
...
Co-authored-by: jsotelo <javier.sotelo@viasat.com>
2022-04-11 22:02:47 -07:00
jchen0824
524d183d93
feat: add presto-on-hive metadata ingestion source ( #4625 )
...
* feat(metadata ingestion source): add presto-on-hive metadata ingestion source
Co-authored-by: Houren Chen <houren.chen@grabtaxi.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-11 17:46:44 -07:00
Dexter Lee
55f0412a33
feat(search): Add SearchScore annotation to use fields for search ranking ( #4596 )
...
* Add SearchScore annotation
* Add back test-model
* Remove search features
* Fix to John's comments
* simplify ranker
* Fix checkstyle
2022-04-07 11:07:27 -07:00
Dexter Lee
32324a6476
fix(search): Make sure home page and search pages are consistent ( #4588 )
...
* Centralize entity count cache
* Fix to John's comment
* Fix test
* Fix tests
2022-04-06 22:06:55 -07:00
John Joyce
7080798825
feat(metadata-service): Supporting a configurable Authorizer Chain ( #4584 )
2022-04-06 19:13:39 -07:00
Aseem Bansal
32349bf405
chore: update default cli for managed ingestion ( #4581 )
2022-04-05 15:33:13 -07:00
Dexter Lee
cea318ac8e
Renaming producer ( #4573 )
2022-04-04 16:46:32 -07:00
John Joyce
95d6bcd1a0
exposing kafka consumer concurrency ( #4536 )
2022-04-04 14:57:34 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project ( #4557 )
...
* Update links for github-related links to use datahub-project:
- https://github.com
- https://img.shields.io/github/ ...
- https://raw.githubusercontent.com/ ...
* Also replace references for github repo linkedin/datahub with
datahub-project/datahub.
2022-04-04 14:39:30 -05:00
Pedro Silva
152041b4c2
fix(rollback) Removes status & key aspects from affected aspects count during rollback ( #4551 )
2022-03-31 12:59:24 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks ( #4482 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
David Haglund
cd6a712896
fix(doc): Change to forward slash-separated strings, as in the example ( #4528 )
2022-03-30 09:10:23 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies ( #4516 )
...
* Add domain based policy and view based policy
* Add new files
* Fix issue
* Fix comment on markdown
* Fix to John's comments
* Update policies.md
* Remove comments
* Fix to John's comments
* Fix policy details page
* Add back notebook privileges
* Fix graphql
Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link ( #4446 )
2022-03-18 14:12:19 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
ab0b5162af
fix(lineage): Move lineage registry to entity-registry module ( #4412 )
...
* Move lineage registry
* Fix test
2022-03-15 11:59:59 -07:00
Dexter Lee
a12c9d2a30
Add flag to enable cache ( #4335 )
2022-03-14 16:40:10 -07:00
John Joyce
a453ebf02d
feat(autocomplete): Show recent searches + improved autocomplete ( #4400 )
2022-03-14 14:07:49 -07:00
John Joyce
ecd263b0d2
feat(*): Support setting owner type when assigning ownership ( #4354 )
2022-03-14 11:14:32 -07:00
Aseem Bansal
4bcc2b3d12
feat(ingestion): improve logging, docs for bigquery, snowflake, redshift ( #4344 )
2022-03-14 08:50:29 -07:00
Dexter Lee
fab9c23aa5
fix(removed): Make sure removed entities do not appear on recommendations ( #4353 )
2022-03-10 18:45:08 -08:00
John Joyce
870407b8f9
fix(ui): Supporting unknown data platform type ( #4361 )
2022-03-09 20:06:02 -08:00
Dexter Lee
18dd5b6c13
feat(Impact Analysis): Support impact analysis to check all downstreams of given entity ( #4322 )
2022-03-04 16:10:25 -08:00
John Joyce
902929293d
fix(ui) Misc UI fixes & styling improvements. ( #4311 )
2022-03-04 12:19:37 -08:00
mayurinehate
92b0e1c7c7
feat(tableau): emit workbook as container entity in tableau source, some minor fixes in tableau source ( #4261 )
2022-03-04 11:52:04 -08:00
John Joyce
9f1c5a8f75
feat(assertions): Adding Assertions Entity & Great Expectations BETA ( #4305 )
2022-03-04 11:51:31 -08:00
Aseem Bansal
9a9a5c3084
fix: revert changes to OpenApi casing ( #4291 )
2022-03-04 10:35:44 -08:00
John Joyce
e64e71ee72
docs(readmes): Update module READMEs to reflect the current state of the world ( #4294 )
2022-03-03 14:20:35 -08:00
Sergio Gómez Villamor
a2a939d406
feat(model): adds PRE in the FabricType enum ( #4226 )
2022-03-01 16:45:41 -08:00
mohdsiddique
e2f8db7926
feat: powerbi - add new source ( #4201 )
2022-02-28 17:37:22 -08:00
Aseem Bansal
ec86e71edc
chore(managed ingestion): add variables for default val, update vals ( #4186 )
2022-02-25 16:33:59 -08:00
Ravindra Lanka
1ac20ee764
feat(platform): add timeline api for dataset entity ( #4252 )
2022-02-24 19:40:55 -08:00
HuYueeer
3a0fe44344
feat(search): supporting chinese glossaryterm full text retrieval( #3914 ) ( #3956 )
...
* feat(search): supporting chinese glossaryterm full text retrieval(#3914 )
* refactor(search): modify mainTokenizer to appropriate position(#3914 )
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-24 17:11:43 -08:00
Ravindra Lanka
232f7c5b21
feat(model): Column level lineage model ( #4248 )
...
co-authored-by: ksrinath <k.srinath@gmail.com>
2022-02-24 14:36:19 -08:00
Alexander Chashnikov
c2065bd7fe
feat(ingest): clickhouse - add initial support ( #4057 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-21 07:36:08 -08:00
