david-leifker
d234f5580a
fix(config): fix mcp batch configuration ( #13598 )
2025-05-22 15:54:48 -05:00
david-leifker
978d7b1afa
fix(mcp-processor): prevent exception in mcp processor ( #13513 )
2025-05-14 13:55:40 -05:00
david-leifker
effc5e2f4d
fix(config): fix mcp consumer batch property ( #13504 )
2025-05-13 14:46:37 -05:00
david-leifker
96c92fda71
fix(mce-consumer): prevent too large SQL statements ( #13392 )
2025-05-02 10:21:45 -05:00
Esteban Gutierrez
9b6960ac8e
feat(azure): include azure-identity-extensions for Microsoft Entra Workload Identity connections ( #13395 )
2025-05-01 20:22:47 -05:00
Shirshanka Das
894655622d
fix(gms): class collision in mcp/mcl consumers ( #13345 )
...
Co-authored-by: David Leifker <david.leifker@acryl.io>
2025-04-27 22:50:28 -07:00
Rafael Sousa
c1f6bd171e
fix(opentelemetry): Resolve type mismatch in metrics exporter ( #13053 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2025-04-04 15:51:10 +01:00
Chakru
7c1ed744f4
fix(build): build improvements to help with incremental builds ( #12823 )
2025-03-10 22:43:31 +05:30
david-leifker
41b0629e70
feat(api): URN, Entity, and Aspect name Async Validation ( #12797 )
2025-03-06 12:49:22 -06:00
david-leifker
412600a163
feat(telemetry): cross-component async write tracing ( #12405 )
2025-01-29 11:30:44 -06:00
david-leifker
462de489d8
refactor(GMS): migrate GMS to Spring boot ( #12389 )
2025-01-23 10:45:40 -06:00
david-leifker
02815259e0
feat(mcp): add kafka batch processing mode option ( #4449 ) ( #12021 )
...
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-12-04 09:28:40 -06:00
Chakru
85b42e3ea5
build(coverage): enable code coverage for java and python ( #11992 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-12-02 19:27:43 -06:00
david-leifker
a1c783ba3a
refactor(kafka): reconfigure consumers to allow different config ( #11869 )
2024-11-19 10:58:18 -06:00
RyanHolstien
971aae076d
feat(logs): add change event details to log context and improve some logs in MCL/MCP ( #11690 )
2024-10-23 15:29:00 -05:00
david-leifker
dea17d475b
chore(cleanup): remove legacy bootstrap step ( #11494 )
2024-09-30 14:28:30 -05:00
david-leifker
738eaed6f1
feat(throttle): extend throttling to API requests ( #11325 )
2024-09-12 09:52:20 -05:00
david-leifker
dfa9bd2779
feat(consumers): mce-consumer throttling based on mae-consumer lag ( #10626 )
2024-05-31 15:53:02 -05:00
david-leifker
f36a597b17
fix(spring): refactor spring configuration ( #10290 )
2024-04-16 13:50:41 -05:00
david-leifker
731c29e675
feat(graph-retriever): implement graph retriever ( #10241 )
2024-04-16 10:12:48 -05:00
david-leifker
77c4629ccf
refactor(docker): move to acryldata repo for all images ( #9459 )
2024-04-02 09:36:44 -05:00
Davi Arnaut
c3257d81c8
feat(metadata-jobs): improve consumer logging ( #10173 )
2024-03-31 08:07:58 -07:00
RyanHolstien
2657c8f68b
feat(lineage): add a parameter to allow limiting the per hop exploration of lineage search ( #10062 )
2024-03-26 11:48:39 -05:00
david-leifker
f9e64d03cc
feat(auth): view authorization ( #10066 )
2024-03-23 06:15:36 -05:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms ( #9626 )
...
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
Aseem Bansal
862e826614
feat(monitoring): add metrics for kafka consumers ( #9643 )
2024-01-18 16:18:17 +05:30
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 ( #9458 )
2023-12-15 13:28:33 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint ( #9373 )
2023-12-06 11:02:42 +05:30
RyanHolstien
1b737243b2
feat(avro): upgrade avro to 1.11 ( #9031 )
2023-10-18 13:45:46 -05:00
david-leifker
aef49b8fb2
feat(entity-client): enable client side cache for entity-client and usage-client ( #8877 )
2023-09-21 22:00:14 -05:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update ( #8745 )
2023-09-01 19:36:01 +05:30
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default ( #8053 )
2023-05-23 11:38:58 -05:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry ( #7930 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
david-leifker
b4b3a39829
fix(system-update): fixes system-update with more than 1 partition ( #7302 )
2023-02-09 18:54:20 -06:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements ( #6894 )
2023-01-31 18:44:37 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) ( #6744 )
...
* fix(security): commons-text in frontend
* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint
* testing docker build
* Add retry configuration options for entity client
* Kafka debugging
* fix(kafka-setup): parallelize topic creation
* Adjust docker build
* Docker build updates
* WIP
* fix(lint): metadata-ingestion lint
* fix(gradle-docker): fix docker frontend dep
* fix(elastic): fix race condition between gms and mae for index creation
* Revert "fix(elastic): fix race condition between gms and mae for index creation"
This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.
* fix(test): fix datahub frontend test for clean/test cycle
* fix(test): datahub-frontend missing assets in test
* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer
* gitingore update
* fix(docker): remove platform on docker base image, set by buildx
* refactor(kafka-producer): update kafka producer tracking/logging
* updates per PR feedback
* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible ( #6616 )
2022-12-04 19:57:47 -08:00
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint ( #6097 )
...
* feat(ingest): add async option to ingest proposal endpoint
* small tweak to validate before write to K, also keep existing path for timeseries aspects
* avoid double convert
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
John Joyce
e2f1da00ff
refactor(configs): Simplify Kafka Topic name configurations + docs ( #5198 )
2022-06-17 12:15:51 -07:00
Dexter Lee
cea318ac8e
Renaming producer ( #4573 )
2022-04-04 16:46:32 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
Aseem Bansal
ac0734d28e
fix(logging): fix log levels and formats ( #3943 )
2022-01-21 07:39:38 -08:00
Arun Vasudevan
9d1de5fbf6
feat(platform): add AWS MSK iam Auth Jar to platform components ( #3872 )
2022-01-12 21:49:34 -08:00
Dexter Lee
2b54475c16
feat(api): Add git-based server version to the UI and config endpoint ( #3866 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-11 15:00:57 -08:00
Dexter Lee
4a672c2dc5
fix(kafka): Add back changes to centralize kafka config ( #3675 )
2021-12-06 22:31:48 -08:00
John Joyce
f49666a230
feat(auth): Metadata Service Authentication! ( #3598 )
2021-11-22 16:33:14 -08:00
Dexter Lee
09f3b812f3
Revert "feat(git-version): Encode the latest release included in the build ( #3535 )" ( #3539 )
...
This reverts commit e01be7bb3d760c03883c9f18700b99b82375bb6f.
2021-11-09 11:07:13 -08:00
Dexter Lee
e01be7bb3d
feat(git-version): Encode the latest release included in the build ( #3535 )
2021-11-09 08:56:27 -08:00
John Joyce
a92ab66a3a
refactor(nocode): Final part of No-Code cleanup ( #3477 )
2021-10-31 22:06:36 -07:00
John Joyce
8ef273423c
feat(metadata-service): Introducing EntityClient interface to avoid unnecessary HTTP calls. ( #3421 )
2021-10-19 15:53:48 -07:00
