Gabe Lyons
cd147685c7
feat(siblings): allow viewing siblings separately ( #5390 )
...
* allow pulling back curtain for siblings
* sibling pullback working for lineage + property merge
* propagating provinence to ui
* fixups from merge & some renames
* fix styling & add tooltip
* adding cypress tests
* fix lint
* updating mocks
* updating smoke test
* fixing domains smoke test
* responding to comments
2022-07-14 14:23:12 -07:00
Justin Marozas
414252351a
fix(cassandra): fix Cassandra queries used by IngestDataPlatformInstancesStep ( #5199 )
2022-07-07 22:20:57 -07:00
Chris Collins
68fb0d8f06
feat(schema) Show last observed timestamp in the schema tab ( #5348 )
2022-07-07 12:31:01 -07:00
Pedro Silva
bb3208d734
fix(gms) Remove auto-creating status aspects if not present when ingesting metadata ( #5315 )
2022-07-01 15:45:09 -07:00
John Joyce
b02c7f5952
perf(search): Improve search default performance ( #5311 )
2022-07-01 10:40:51 -07:00
John Joyce
11356e37ba
feat(ui) Adding support for deleting Tags and Domains via the UI ( #5280 )
...
* Adding support for deleting tags and domains via the UI
* Fixing tests
2022-06-29 19:41:41 -07:00
John Joyce
234d27a642
fix(ui): Support deleting references to glossary terms / nodes, users, assertions, and groups ( #5248 )
...
* Adding referential integrity to deletes API
* Updating comments
* Fix build
* fix checkstyle
* Fixing Delete Entity utils Test
2022-06-27 14:31:40 -07:00
Gabe Lyons
baf3f3f33c
feat(dbt): add sibling association logic to associate dbt elements with their target systems ( #5190 )
2022-06-22 08:31:18 -07:00
RyanHolstien
ba21efc7dd
feat(bootstrap): add bootstrap step to clear out unknown aspect rows from the database ( #5148 )
2022-06-21 16:00:16 -07:00
Chris Collins
2841f32b8e
feat(lineage) Update Lineage tab and Impact Analysis feature ( #5121 )
2022-06-21 07:30:40 -07:00
John Joyce
0c619ff393
fix(recommendations): Check whether an entity exists before recommending ( #5163 )
2022-06-14 10:51:06 -07:00
John Joyce
96c0746aff
refactor(graphql): Migrate Visual Config into the Configuration Provider ( #4780 )
2022-06-06 16:36:05 -07:00
RyanHolstien
9af78cf83d
fix(timelineAPI): fix issue with semantic versioning ( #5033 )
2022-05-27 17:17:57 -07:00
RyanHolstien
2a2fd05345
feat: telemetry improvements ( #5029 )
2022-05-27 17:04:45 -07:00
John Joyce
b6773e4637
feat(Tests): Make DataHub Tests Feature configurable via env variable ( #5020 )
2022-05-26 12:29:20 -07:00
Dexter Lee
669160a677
feat(run): Create a describe run endpoint for fetching aspects created by the ingestion run ( #4964 )
2022-05-24 14:46:36 -07:00
Justin Marozas
97bce80fc9
refactor(metadata-io): introduce a storage-independent in-memory entity aspect model ( #4957 )
2022-05-24 12:40:42 -07:00
RyanHolstien
71c7dc455f
fix(metadata-service): telemetry - fix hardcoded aspect name, suppress errors when producing MAE ( #4981 )
2022-05-24 09:18:20 -07:00
RyanHolstien
1de2e2c85f
fix(metadata-service): timeline - ignore platform and schema changes ( #4952 )
2022-05-18 22:11:10 -07:00
RyanHolstien
c3cfaf8e3c
feat(telemetry): add server side telemetry ( #4925 )
...
Co-authored-by: Kevin Hu <kevinhuwest@gmail.com>
2022-05-17 11:37:45 -07:00
Pedro Silva
78c3ca039e
feat(gms): Add support for deleting reference pointers when deleting by urn ( #4791 )
2022-05-12 19:02:13 -07:00
Pedro Silva
f0b79cbddf
Use ingest proposal to submit status updates ( #4600 )
2022-05-09 09:22:24 -07:00
RyanHolstien
50f9d3d02e
chore(deps): move from velocity 1.7 to 2.3 ( #4837 )
2022-05-05 14:52:16 -07:00
RyanHolstien
23f657ed76
feat(platform): openapi - initial post, get, and delete endpoints for entities ( #4775 )
2022-05-03 17:38:05 -07:00
Chris Collins
0a0db02ae8
feat(tracking) Configure whether mixpanel is enabled with env variable ( #4768 )
2022-04-29 14:37:19 -07:00
RyanHolstien
65fb49f4b4
feat(versionedDataset): adds a versionStamp to timeline response & adds versionStamp param to dataset graphql ( #4727 )
2022-04-29 12:04:38 -07:00
Dexter Lee
980c0550de
fix(policies): Re-revert the policies fix + ingest documents directly to search ( #4733 )
2022-04-25 18:45:01 -07:00
Eddie (Xiao Di) Li
01a5b13a7a
feat(Cassandra): Add Cassandra implementation of EntityService ( #3286 )
2022-04-25 17:29:24 -07:00
John Joyce
f387901ca8
feat(gms): Entity change events v1 (Platform Event) ( #4687 )
2022-04-19 20:04:14 -07:00
John Joyce
6a721e059b
Make the order by explicit ( #4699 )
2022-04-19 20:03:56 -07:00
Arun Vasudevan
bc259afa93
fix(gms): Ensure Ordering by version when fetching next version ( #4696 )
2022-04-19 14:49:47 -07:00
RyanHolstien
15474cdad5
fix(timeline): enhance schema field name change and removal support ( #4603 )
2022-04-15 15:36:04 -07:00
Dexter Lee
46c15ef0a7
fix(search): Fix urn component settings ( #4672 )
...
* Fix urn component settings
* Add keyword subfield to all fields
* Fix tests
2022-04-14 15:40:03 -07:00
Dexter Lee
c9f2c453d2
Fix issue where browse cards are missing ( #4652 )
2022-04-12 16:19:05 -07:00
Dexter Lee
90bc00c697
feat(search): Only reindex if the mappings for an existing field changed ( #4629 )
...
* Just update mappings as much as possible
* Fix checkstyle
2022-04-11 16:06:41 -07:00
Dexter Lee
55f0412a33
feat(search): Add SearchScore annotation to use fields for search ranking ( #4596 )
...
* Add SearchScore annotation
* Add back test-model
* Remove search features
* Fix to John's comments
* simplify ranker
* Fix checkstyle
2022-04-07 11:07:27 -07:00
Dexter Lee
12f9cc2575
Reduce browse aggregation size ( #4601 )
2022-04-06 22:07:08 -07:00
Dexter Lee
32324a6476
fix(search): Make sure home page and search pages are consistent ( #4588 )
...
* Centralize entity count cache
* Fix to John's comment
* Fix test
* Fix tests
2022-04-06 22:06:55 -07:00
Aditya Radhakrishnan
8610c29e49
feat(search) - add DATETIME FieldType ( #4407 )
...
* feat(search) - add DATETIME FieldType
2022-04-05 14:41:54 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks ( #4482 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
RyanHolstien
b843014c5e
Oss/urn validation ( #4511 )
2022-03-29 16:44:58 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies ( #4516 )
...
* Add domain based policy and view based policy
* Add new files
* Fix issue
* Fix comment on markdown
* Fix to John's comments
* Update policies.md
* Remove comments
* Fix to John's comments
* Fix policy details page
* Add back notebook privileges
* Fix graphql
Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Dexter Lee
a1ebc6be86
Add recent searches filtering ( #4476 )
2022-03-23 16:24:19 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link ( #4446 )
2022-03-18 14:12:19 -07:00
Pedro Silva
693aedc8b9
Adds elasticsearch mapping ( #4444 )
2022-03-17 13:15:18 -07:00
Pedro Silva
aa593c32d8
Flexible search on soft delete ( #4405 )
...
* Adds filter logic to correct DB
* Fix build
* Adds documentation & fixes flag typo
* apply review comments
* Adds test for filtered search
* Adds warning log for redundant parameter combo
2022-03-16 16:35:04 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
ab0b5162af
fix(lineage): Move lineage registry to entity-registry module ( #4412 )
...
* Move lineage registry
* Fix test
2022-03-15 11:59:59 -07:00
Dexter Lee
a12c9d2a30
Add flag to enable cache ( #4335 )
2022-03-14 16:40:10 -07:00