John Joyce
1a31f7888a
fix(restore): Add RESTATE ChangeType to MCL / MCP to permit restore indices ( #5022 )
2022-05-30 10:04:51 -07:00
RyanHolstien
a39a8b26a2
fix(telemetry): exclude configuration from standalone apps ( #5034 )
2022-05-27 17:16:53 -07:00
Pedro Silva
78c3ca039e
feat(gms): Add support for deleting reference pointers when deleting by urn ( #4791 )
2022-05-12 19:02:13 -07:00
Justin Marozas
b94dc088ec
fix(mxe-consumer): exclude CassandraAutoConfiguration from consumer boot ( #4890 )
2022-05-11 09:24:57 -07:00
John Joyce
f7d598336a
fix(ui ingest): Unschedule all sources on ingestion source refresh, fix delete not being enforced ( #4792 )
2022-04-29 14:34:01 -07:00
Pedro Silva
fe19aff1dd
fix(gms): Fixes delete logic in MAE consumer ( #4790 )
2022-04-29 09:58:05 -07:00
Dexter Lee
980c0550de
fix(policies): Re-revert the policies fix + ingest documents directly to search ( #4733 )
2022-04-25 18:45:01 -07:00
John Joyce
f387901ca8
feat(gms): Entity change events v1 (Platform Event) ( #4687 )
2022-04-19 20:04:14 -07:00
Dexter Lee
b8cdc7ebed
feat(vulnerability): Upgrade spring libraries to latest version ( #4698 )
2022-04-19 16:42:41 -07:00
Dexter Lee
0a13ee4744
Remove log infos ( #4686 )
2022-04-18 13:03:57 -07:00
Dexter Lee
cea318ac8e
Renaming producer ( #4573 )
2022-04-04 16:46:32 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
RyanHolstien
6da3e28c33
fix(metadata-jobs): fix root context for springboot ( #4366 )
2022-03-09 14:47:47 -08:00
Dexter Lee
daab31d6ef
refactor(extractor): Move extractors to entity-registry ( #4307 )
...
* Move extractors to entity-registry
* Fix test
* Fix checkstyle
2022-03-03 16:57:32 -08:00
zhoxie-cisco
0146d47487
fix(mae-consumer): usage event transformer was using wrong aspect name. ( #4249 )
...
Co-authored-by: zhoxie-cisco <xiezhongjie1109@gmail.com>
2022-02-24 19:41:38 -08:00
RyanHolstien
a251d589ed
Feature/oss/update to v2 endpoints ( #4128 )
2022-02-15 14:37:05 -08:00
Dexter Lee
0e5811fd68
fix(mae-consumer-docker): Fix condition for skipping elasticsearch check ( #4052 )
2022-02-03 18:58:04 -08:00
Dexter Lee
e8cc991378
fix(platform): add metrics for mcl hooks ( #4008 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-30 18:15:22 -06:00
RyanHolstien
c5ff486435
fix(platform): graph-service - remove thread spawning that can cause race conditions ( #4007 )
...
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2022-01-30 11:44:15 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) ( #3975 )
2022-01-27 10:33:12 -08:00
Aseem Bansal
ac0734d28e
fix(logging): fix log levels and formats ( #3943 )
2022-01-21 07:39:38 -08:00
Arun Vasudevan
9d1de5fbf6
feat(platform): add AWS MSK iam Auth Jar to platform components ( #3872 )
2022-01-12 21:49:34 -08:00
Dexter Lee
2b54475c16
feat(api): Add git-based server version to the UI and config endpoint ( #3866 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-11 15:00:57 -08:00
RyanHolstien
34c27f076b
feat(removeGMA): remove all dependencies on gma libraries ( #3835 )
2022-01-05 17:32:31 -08:00
Dexter Lee
9d04aa1255
feat(mae/mcl): Make ingestAspect produce both MCLs and MAEs ( #3737 )
2022-01-04 18:24:30 -08:00
Ravindra Lanka
4b81ad6262
feat(Stateful Ingestion): 1/3 Stateful ingestion server changes ( #3749 )
2021-12-15 10:32:58 -08:00
Aseem Bansal
a4ac79db48
feat(perf-test): changes for perf testing ( #3728 )
2021-12-13 23:07:57 -08:00
John Joyce
3bac7f7c43
fix(deletes): Fixing system metadata index deletes ( #3693 )
2021-12-08 14:03:24 -08:00
Dexter Lee
4a672c2dc5
fix(kafka): Add back changes to centralize kafka config ( #3675 )
2021-12-06 22:31:48 -08:00
Dexter Lee
999e9e5b49
fix(search): Improve search and recs performance ( #3660 )
2021-12-03 18:13:11 -08:00
Shirshanka Das
842c05980b
feat(metadata-service): support for custom model extensions without forks ( #3630 )
2021-11-28 21:06:27 -08:00
John Joyce
5886e63e5c
doc(components): Adding DataHub components overview ( #3606 )
2021-11-24 12:41:07 -08:00
John Joyce
f49666a230
feat(auth): Metadata Service Authentication! ( #3598 )
2021-11-22 16:33:14 -08:00
Dexter Lee
09f3b812f3
Revert "feat(git-version): Encode the latest release included in the build ( #3535 )" ( #3539 )
...
This reverts commit e01be7bb3d760c03883c9f18700b99b82375bb6f.
2021-11-09 11:07:13 -08:00
Dexter Lee
e01be7bb3d
feat(git-version): Encode the latest release included in the build ( #3535 )
2021-11-09 08:56:27 -08:00
Gabe Lyons
b87efa43b5
feat(deletes): support deletion of non-snapshot aspects ( #3518 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
2021-11-08 16:22:24 -08:00
John Joyce
a92ab66a3a
refactor(nocode): Final part of No-Code cleanup ( #3477 )
2021-10-31 22:06:36 -07:00
John Joyce
2f03ad854b
feat(recommendations): Recommendations infra P1 ( #3455 )
2021-10-26 21:23:08 -07:00
Gabe Lyons
a74ce1961d
fix(deletes): ensure hard deletion removes lineage ( #3423 )
2021-10-19 22:10:07 -07:00
John Joyce
8ef273423c
feat(metadata-service): Introducing EntityClient interface to avoid unnecessary HTTP calls. ( #3421 )
2021-10-19 15:53:48 -07:00
Gabe Lyons
377c501735
fix(graph service): fix case where certain mcps can incorrectly delete graph edges ( #3418 )
2021-10-18 22:52:10 -07:00
John Joyce
61bd7fd080
feat(search): support Boolean OR Filters in Rest.li APIs ( #3344 )
2021-10-14 12:34:29 -07:00
John Joyce
ed01b59a00
feat(users & groups): User & Groups Management GraphQL APIs + UI ( #3318 )
2021-10-07 16:14:35 -07:00
Dexter Lee
d0548408b4
feat(search): redesign search page - left filter pane ( #3337 )
2021-10-07 11:41:29 -07:00
Enrico Minack
0a25d7acea
refactor(dao/utils): Move general createRelationshipFilter from Neo4jUtil to QueryUtils ( #3010 )
2021-09-16 17:13:01 -07:00
rslanka
c418bc845c
feat(Analytics): Support for Timeseries Aggregated Statistics ( #3207 )
...
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Dexter Lee <dexter@acryl.io>
2021-09-14 18:35:10 -07:00
Dexter Lee
8747fbe43c
feat(perf): Add perf testing and monitoring framework ( #3195 )
2021-09-07 23:06:15 -07:00
John Joyce
ccb09a6966
feat(access control): Fine-Grained Access Control M1 ( #3182 )
2021-09-02 19:05:13 -07:00
Dexter Lee
a6402f685c
fix(kafka): Change consumer id of mae/mce processor ( #3135 )
2021-08-21 13:36:30 -07:00
