david-leifker
1df806d177
chore(versions): bump versions ( #7358 )
2023-02-20 11:32:05 +05:30
david-leifker
267472ccbb
gradle(development): add additional commands for development ( #7321 )
2023-02-16 10:41:42 -06:00
John Joyce
32b55e7caa
refactor(upgrade): Trim upgrade name before executing ( #7343 )
2023-02-15 08:59:06 -08:00
david-leifker
2e339fe008
fix(datahub-upgrade): allow registry override ( #7258 )
2023-02-10 21:09:09 +05:30
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements ( #6894 )
2023-01-31 18:44:37 -06:00
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location ( #6881 )
2022-12-29 15:08:36 +05:30
david-leifker
a5b5abf270
fix(kafka): datahub-upgrade job ( #6864 )
2022-12-27 12:35:48 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) ( #6744 )
...
* fix(security): commons-text in frontend
* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint
* testing docker build
* Add retry configuration options for entity client
* Kafka debugging
* fix(kafka-setup): parallelize topic creation
* Adjust docker build
* Docker build updates
* WIP
* fix(lint): metadata-ingestion lint
* fix(gradle-docker): fix docker frontend dep
* fix(elastic): fix race condition between gms and mae for index creation
* Revert "fix(elastic): fix race condition between gms and mae for index creation"
This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.
* fix(test): fix datahub frontend test for clean/test cycle
* fix(test): datahub-frontend missing assets in test
* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer
* gitingore update
* fix(docker): remove platform on docker base image, set by buildx
* refactor(kafka-producer): update kafka producer tracking/logging
* updates per PR feedback
* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
david-leifker
1e5d434501
fix(security): commons-text in frontend, hadoop-commons in datahub-upgrade ( #6723 )
2022-12-09 14:11:12 -06:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible ( #6616 )
2022-12-04 19:57:47 -08:00
Pedro Silva
5fd5866a03
feat(upgrade): Make restore from backup logic generic ( #6536 )
2022-11-24 21:49:24 +05:30
Parham Ghazanfari
497c5eee74
feat(datahub-upgrade): Added msk IAM auth as a build dependency. ( #6439 )
2022-11-22 15:36:53 -06:00
John Joyce
d15518f0d9
fix(browse): Fixing browse path to remove requirement for simple name suffix ( #5634 )
2022-09-07 13:32:38 -07:00
Aseem Bansal
b643b34d30
feat(restore-indices): add endpoint for restore indices, add basic check for graph ( #5805 )
2022-09-02 15:24:40 +05:30
Aseem Bansal
157363586e
feat(restore-indices): add timing info ( #5773 )
2022-08-30 17:38:20 +05:30
Aseem Bansal
b477047b3b
feat(restore-indices): add urn like filter ( #5770 )
...
* feat(restore-indices): add urn like filter
* change logging
2022-08-30 15:16:48 +05:30
Aseem Bansal
67a68b9705
feat(restore-indices): add multithreading and add aspectName, urn filter ( #5712 )
...
* feat(upgrade): improve logging to get idea of progress
* division by zero check
* division by zero fix
* wip
* temp work
* feat(datahub-upgrade): add multi-threading and aspect filter
* revert change on local
* fix bugs
* add back batchDelayMs
* remove redundant format
* report stats finally, shutdown executor
* Add time metrics
* clarify logging
* improve logging
2022-08-29 11:43:39 -05:00
RyanHolstien
ba21efc7dd
feat(bootstrap): add bootstrap step to clear out unknown aspect rows from the database ( #5148 )
2022-06-21 16:00:16 -07:00
RyanHolstien
92d6b043e1
fix(upgrade): fix upgrade when s3 path has = ( #5220 )
2022-06-21 15:25:46 -07:00
Dexter Lee
b890ba0d12
fix(restore-indices): Do not fail on MAE row count diff ( #5165 )
2022-06-14 10:12:10 -07:00
Dexter Lee
59d33ca28b
fix(restore-indices): Do not fail while working with each row ( #5084 )
2022-06-03 14:11:12 -07:00
RyanHolstien
259a63ab6f
fix(datahub-upgrade): exclude unnecessary configuration from standalone applications ( #5047 )
2022-05-31 22:59:31 -07:00
John Joyce
1a31f7888a
fix(restore): Add RESTATE ChangeType to MCL / MCP to permit restore indices ( #5022 )
2022-05-30 10:04:51 -07:00
RyanHolstien
a39a8b26a2
fix(telemetry): exclude configuration from standalone apps ( #5034 )
2022-05-27 17:16:53 -07:00
Justin Marozas
97bce80fc9
refactor(metadata-io): introduce a storage-independent in-memory entity aspect model ( #4957 )
2022-05-24 12:40:42 -07:00
Eddie (Xiao Di) Li
01a5b13a7a
feat(Cassandra): Add Cassandra implementation of EntityService ( #3286 )
2022-04-25 17:29:24 -07:00
John Joyce
f387901ca8
feat(gms): Entity change events v1 (Platform Event) ( #4687 )
2022-04-19 20:04:14 -07:00
Dexter Lee
b8cdc7ebed
feat(vulnerability): Upgrade spring libraries to latest version ( #4698 )
2022-04-19 16:42:41 -07:00
Dexter Lee
18dd5b6c13
feat(Impact Analysis): Support impact analysis to check all downstreams of given entity ( #4322 )
2022-03-04 16:10:25 -08:00
Aseem Bansal
a56f0661d5
perf(ingest): changes to improve ingest performance a bit ( #3837 )
2022-01-06 08:07:16 -08:00
RyanHolstien
34c27f076b
feat(removeGMA): remove all dependencies on gma libraries ( #3835 )
2022-01-05 17:32:31 -08:00
Dexter Lee
b00fe8426e
fix(datahub-upgrade): Fix Spring injection issue with datahub-upgrade ( #3688 )
2021-12-09 21:31:33 -08:00
John Joyce
f49666a230
feat(auth): Metadata Service Authentication! ( #3598 )
2021-11-22 16:33:14 -08:00
John Joyce
27a5f6dc3b
feat(gms): Adding yaml configuration for metadata-service ( #3514 )
2021-11-09 12:16:15 -08:00
Gabe Lyons
b87efa43b5
feat(deletes): support deletion of non-snapshot aspects ( #3518 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
2021-11-08 16:22:24 -08:00
John Joyce
a92ab66a3a
refactor(nocode): Final part of No-Code cleanup ( #3477 )
2021-10-31 22:06:36 -07:00
Dexter Lee
87d344faa3
fix(backup-restore): fix backup restore jobs usage of system-metadata ( #3445 )
2021-10-25 14:43:04 -07:00
John Joyce
8ef273423c
feat(metadata-service): Introducing EntityClient interface to avoid unnecessary HTTP calls. ( #3421 )
2021-10-19 15:53:48 -07:00
Dexter Lee
9b54242a6e
fix(datahub-upgrade): Update datahub upgrade to use MCL instead of MAE ( #3411 )
2021-10-18 22:52:48 -07:00
Dexter Lee
d0548408b4
feat(search): redesign search page - left filter pane ( #3337 )
2021-10-07 11:41:29 -07:00
John Joyce
33f4d2ede0
fix(upgrade): Improving NoCodeUpgrade logic to account for Bootstrap logic ( #3301 )
2021-09-28 16:30:49 -07:00
John Joyce
ccb09a6966
feat(access control): Fine-Grained Access Control M1 ( #3182 )
2021-09-02 19:05:13 -07:00
John Joyce
2c5edd88ab
feat(graphql): migrating GraphQL API to metadata-service (nee GMS) ( #3131 )
2021-08-20 10:58:07 -07:00
Dexter Lee
872215dc7d
fix(upgrade): Fix MAE consumer and upgrade's dependency issue ( #3096 )
2021-08-13 10:12:57 -07:00
Gabe Lyons
2fc71da58d
fix(restore-indices): add system metadata restoration to restore-indices ( #3029 )
2021-08-04 11:44:22 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest ( #2960 )
2021-07-29 20:04:40 -07:00
Dexter Lee
ad081138f7
fix(datahub-upgrade): fix vulnerabilities ( #2813 )
2021-06-30 22:57:39 -07:00
Dexter Lee
8f0f322279
feat(backup): Add restore indices and restore backup tasks ( #2779 )
2021-06-30 16:49:02 -07:00
John Joyce
69d9cf46de
fix(datahub-upgrade): add runtime dependency on logbackClassic ( #2799 )
2021-06-29 17:52:11 -07:00
John Joyce
c74c20af29
fix(datahub-upgrade): removing the CleanupStep from datahub upgrade ( #2728 )
2021-06-24 23:02:20 -07:00
