RyanHolstien
b843014c5e
Oss/urn validation ( #4511 )
2022-03-29 16:44:58 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies ( #4516 )
...
* Add domain based policy and view based policy
* Add new files
* Fix issue
* Fix comment on markdown
* Fix to John's comments
* Update policies.md
* Remove comments
* Fix to John's comments
* Fix policy details page
* Add back notebook privileges
* Fix graphql
Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Dexter Lee
a1ebc6be86
Add recent searches filtering ( #4476 )
2022-03-23 16:24:19 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link ( #4446 )
2022-03-18 14:12:19 -07:00
Pedro Silva
693aedc8b9
Adds elasticsearch mapping ( #4444 )
2022-03-17 13:15:18 -07:00
Pedro Silva
aa593c32d8
Flexible search on soft delete ( #4405 )
...
* Adds filter logic to correct DB
* Fix build
* Adds documentation & fixes flag typo
* apply review comments
* Adds test for filtered search
* Adds warning log for redundant parameter combo
2022-03-16 16:35:04 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
ab0b5162af
fix(lineage): Move lineage registry to entity-registry module ( #4412 )
...
* Move lineage registry
* Fix test
2022-03-15 11:59:59 -07:00
Dexter Lee
a12c9d2a30
Add flag to enable cache ( #4335 )
2022-03-14 16:40:10 -07:00
John Joyce
a453ebf02d
feat(autocomplete): Show recent searches + improved autocomplete ( #4400 )
2022-03-14 14:07:49 -07:00
Aseem Bansal
4bcc2b3d12
feat(ingestion): improve logging, docs for bigquery, snowflake, redshift ( #4344 )
2022-03-14 08:50:29 -07:00
Dexter Lee
fab9c23aa5
fix(removed): Make sure removed entities do not appear on recommendations ( #4353 )
2022-03-10 18:45:08 -08:00
leifker
8bd1db8c1f
feat(build): upgrade to gradle 6 for toolchain to support java 11 ( #4340 )
2022-03-09 13:31:16 -08:00
Dexter Lee
424d357cfd
Fix lineage ( #4326 )
2022-03-07 09:36:49 -08:00
Dexter Lee
18dd5b6c13
feat(Impact Analysis): Support impact analysis to check all downstreams of given entity ( #4322 )
2022-03-04 16:10:25 -08:00
John Joyce
9f1c5a8f75
feat(assertions): Adding Assertions Entity & Great Expectations BETA ( #4305 )
2022-03-04 11:51:31 -08:00
Dexter Lee
daab31d6ef
refactor(extractor): Move extractors to entity-registry ( #4307 )
...
* Move extractors to entity-registry
* Fix test
* Fix checkstyle
2022-03-03 16:57:32 -08:00
Dexter Lee
5d26c86a30
fix(search): Update urn tokenizer to tokenize on periods and slashes ( #4085 )
...
* Add period
* Update urn tokenizer
* Add tests
2022-03-03 10:37:10 -08:00
RyanHolstien
77a27359f2
fix(platform): timeline - fix semantic version ordering in API response and cli improvements ( #4271 )
2022-02-28 15:14:13 -08:00
Ravindra Lanka
1ac20ee764
feat(platform): add timeline api for dataset entity ( #4252 )
2022-02-24 19:40:55 -08:00
HuYueeer
3a0fe44344
feat(search): supporting chinese glossaryterm full text retrieval( #3914 ) ( #3956 )
...
* feat(search): supporting chinese glossaryterm full text retrieval(#3914 )
* refactor(search): modify mainTokenizer to appropriate position(#3914 )
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-24 17:11:43 -08:00
John Joyce
f9436c8efd
fix(delete): fixing NPE on delete urns path ( #4197 )
2022-02-19 18:19:41 -08:00
John Joyce
71c2b664de
WARN on 400 from elasticsearch ( #4193 )
2022-02-18 12:48:43 -08:00
John Joyce
74ebbbf94f
fixes(ui): Misc UI fixes + Adding Owners to Search Filters ( #4175 )
2022-02-17 18:48:29 -08:00
stephenp-gr
fb80e6b7bc
Common ElasticsearchContainer creation ( #4152 )
2022-02-16 16:10:10 -08:00
RyanHolstien
f37bdad78e
bug(seedData): adds a key to the root user seed data and fixes corner case check for missing key aspects ( #4162 )
...
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2022-02-16 14:23:20 -08:00
RyanHolstien
a251d589ed
Feature/oss/update to v2 endpoints ( #4128 )
2022-02-15 14:37:05 -08:00
Dexter Lee
beab5ac977
fix(analytics): fix NPE in aggregate api ( #4095 )
2022-02-08 23:23:18 -08:00
RyanHolstien
d46c55733e
fix(platform): prevent invalid urns during ingestion ( #4045 )
...
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2022-02-02 22:58:44 -08:00
ksrinath
4c24f386a6
feat(model): data quality model ( #3787 )
...
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
2022-02-02 22:56:08 -08:00
John Joyce
7fef9a514a
feat(containers): Backend for Asset Containers (as demo'd in townhall) ( #4019 )
2022-02-01 11:07:34 -08:00
John Joyce
282851eeed
feat(domains): Adding backend for Asset Domains (p1) ( #3952 )
2022-01-27 13:07:11 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) ( #3975 )
2022-01-27 10:33:12 -08:00
Aseem Bansal
ac0734d28e
fix(logging): fix log levels and formats ( #3943 )
2022-01-21 07:39:38 -08:00
senni0418
80c46f24ac
refactor(search): refactor NUM_RETRIES in esindexbuilder to be configurable ( #3870 )
2022-01-17 15:35:59 -08:00
Dexter Lee
b58609269d
fix(search): Fix issue with filters and autocomplete ( #3868 )
2022-01-12 13:01:36 -08:00
Dexter Lee
2b54475c16
feat(api): Add git-based server version to the UI and config endpoint ( #3866 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-11 15:00:57 -08:00
Aseem Bansal
a56f0661d5
perf(ingest): changes to improve ingest performance a bit ( #3837 )
2022-01-06 08:07:16 -08:00
RyanHolstien
34c27f076b
feat(removeGMA): remove all dependencies on gma libraries ( #3835 )
2022-01-05 17:32:31 -08:00
RyanHolstien
9a237e9c92
fix(test): fix bug on verification for EbeanEntityService ( #3829 )
...
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2022-01-05 14:05:54 -08:00
Dexter Lee
9d04aa1255
feat(mae/mcl): Make ingestAspect produce both MCLs and MAEs ( #3737 )
2022-01-04 18:24:30 -08:00
Dexter Lee
76f9423581
feat(nocode): Add get entities v2 endpoint that can get without snapshot ( #3738 )
2022-01-03 07:19:46 -08:00
Gabe Lyons
e7b93796b0
fix(elastic): allow more time for re-indexing tasks ( #3794 )
2021-12-27 10:02:28 -08:00
xiphl
8cd1e91072
Upgrade to 3rd Apache patch for log4j ( #3772 )
2021-12-20 06:55:22 -08:00
John Joyce
5b5135be0b
fix(vuln): log4j vulnerability - bumping to 2.16.0 ( #3755 )
2021-12-15 11:07:45 -08:00
Ravindra Lanka
4b81ad6262
feat(Stateful Ingestion): 1/3 Stateful ingestion server changes ( #3749 )
2021-12-15 10:32:58 -08:00
Gabe Lyons
3fd3313544
Revert "feat(graph): Make Dgraph a proper Neo4j alternative ( #3578 )" ( #3740 )
2021-12-14 10:49:03 -08:00
Dexter Lee
8e4769f40c
feat(retention): Add retention to Local DB ( #3715 )
2021-12-13 18:18:02 -08:00
Enrico Minack
a6deaabfcf
feat(graph): Make Dgraph a proper Neo4j alternative ( #3578 )
2021-12-13 12:37:59 -08:00
Fredrik Sannholm
d651040c85
Fix vulnderability ( #3716 )
2021-12-10 10:07:55 -08:00
