292 Commits

Author SHA1 Message Date
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update (#8745) 2023-09-01 19:36:01 +05:30
david-leifker
6bfd94c713
chore(jackson): update to released version of jackson (#8674) 2023-08-25 23:42:26 -05:00
david-leifker
a8dc8f7f9d
chore(hazelcast): update hazelcast version (#8633) 2023-08-17 12:28:52 +05:30
david-leifker
749c3e85cb
chore(snappy): fix snappy version constraint (#8629) 2023-08-17 10:56:28 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images (#8515) 2023-08-17 10:40:17 +05:30
david-leifker
1576eb46b5
chore(spring): upgrade minor versions of spring components (#8627) 2023-08-17 10:37:16 +05:30
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module (#8306) 2023-07-20 06:39:14 +05:30
david-leifker
81fdf9df55
fix(vulnerabilities)/vulnerabilities_fixes_datahub (#8075) (#8189)
Co-authored-by: Sejal-NucleusTeq <109514187+Sejal-NucleusTeq@users.noreply.github.com>
2023-06-07 18:42:19 -05:00
RyanHolstien
b42f518255
chore(json): fix json vulnerability (#8150) 2023-05-30 18:50:40 -05:00
david-leifker
b97e7a03e8
feat(system-update): remove datahub-update requirement on schema reg (#7999) 2023-05-17 10:32:23 -05:00
RyanHolstien
bb28b64940
chore(security): update org json json dependency - cve-2022-45688 (#7991) 2023-05-10 11:58:48 -05:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry (#7930)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
david-leifker
2ffa39f009
Logging and test models fixes (#7884) 2023-04-21 15:45:20 -05:00
Indy Prentice
fa260fc6c8
Remove usages of commons-text library lower than 1.10.0 (#7850)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: David Leifker <david.leifker@acryl.io>
2023-04-21 12:30:23 -05:00
RyanHolstien
cbf0809c4c
chore(snakeyaml): upgrade to snakeyaml 2 (#7786)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-04-13 12:01:51 -05:00
Indy Prentice
1bbb87bad1
build: Upgrade jettison dependency to 1.5.4 (#7794)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-04-11 14:50:04 -05:00
Indy Prentice
77c5e8d3af
(build) Upgrade json-smart dependency to 2.4.9 (#7788)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-04-11 11:55:26 -05:00
david-leifker
697e8e2647
fix(misc): misc fixes (#7633) 2023-03-21 19:42:50 +05:30
david-leifker
eea95be4fc
chore(bump): bump hadoop client and fix exclusion name (#7386) 2023-02-20 19:53:59 -06:00
david-leifker
bd11575d5f
chore(version): additional version bumps & suppressions (#7382) 2023-02-20 14:39:27 -06:00
david-leifker
1df806d177
chore(versions): bump versions (#7358) 2023-02-20 11:32:05 +05:30
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
Jan Hicken
6c44fae85e
chore(deps): bump Netty from 4.1.85.Final to 4.1.86.Final (#7191) 2023-01-31 14:11:26 -06:00
RyanHolstien
8323128437
feat(cache): add hazelcast distributed cache option (#6645)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2023-01-19 09:03:08 -08:00
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location (#6881) 2022-12-29 15:08:36 +05:30
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Chris Collins
2ef2ad05d0
fix(ingestion) Inject pipeline_name into recipes at runtime (#6833) 2022-12-22 13:16:51 -08:00
david-leifker
27ea3bf125
fix(security): play framework upgrade (#6626)
* fix(security): play framework upgrade
2022-12-08 20:27:51 -06:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework (#6634) 2022-12-06 10:22:41 -08:00
syedzoherer
ffea9302d9
Add AWS Postgres Iam Auth jar to GMS (#6371)
* Add AWS Postgres Iam Auth jar to GMS

* Added IAM support for Postgres

* Setting IAM support for Postgres as false by default

* format fix

Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-12-05 13:07:26 -06:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible (#6616) 2022-12-04 19:57:47 -08:00
david-leifker
83b21b021c
fix(security): security version updates (#6602) 2022-12-01 16:43:15 -06:00
david-leifker
4ca3327d89
fix(security): update ranger commons & dependencies for security vulns (#6577)
* fix(security): update ranger commons & dependencies for security vulns
2022-11-30 17:05:01 -06:00
david-leifker
ef9a280ba4
fix(verions): Update opentelemetry and updates from pr-5239 (#6563) 2022-11-29 10:59:38 -06:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests (#6269) 2022-11-15 18:03:11 -08:00
Harshal Sheth
9be00e9ba1
build: use acryl's gradle-avro-plugin (#6390) 2022-11-09 11:39:05 +01:00
david-leifker
928f29438a
build: Update JNA for M1 Mac (#6116) 2022-10-05 14:53:38 -07:00
Shirshanka Das
bea5a0751e
chore(deps): upgrade opentelemetry dependencies (#6100)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-10-03 22:38:09 -07:00
Shirshanka Das
e688dd554a
chore(deps): upgrade neo4j to 4.4.x (#6101) 2022-10-02 23:16:45 -07:00
Shirshanka Das
bab5acc5e3
chore(deps): upgrade graphql-java deps to 19.0 (#6099) 2022-10-02 19:35:10 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs (#5901)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
atul-chegg
d53cbbb9bf
fix(platform): Add aws-secretsmanager-jdbc driver in dependencies (#5968) 2022-09-22 22:23:45 -07:00
Shirshanka Das
41746690fd
feat(protobuf): support for custom platform, subtypes, misc improvements (#5973) 2022-09-18 18:04:47 -07:00
Shirshanka Das
fe30f54689
feat(datahub-protobuf): add support for shadow jar, publish (#5882) 2022-09-08 22:10:36 -07:00
neojunjie
8d4b7cf8a1
fix(PlayCookie) PLAY_TOKEN cookie rejected because userprofile exceeds 4096 chars (#5114) 2022-07-14 09:52:51 -07:00
Mugdha Hardikar
8358ea8e3e
feat(datahub-client): add java kafka emitter (#5074) 2022-06-20 17:32:57 -07:00
Pedro Silva
8c2ca72fab
chore(deps): Bump spring to 5.3.20 for vuln fix (#5110) 2022-06-07 12:12:31 -07:00
RyanHolstien
031b10c793
chore(akka): upgrade akka http for vuln (#5100) 2022-06-06 17:25:24 -07:00
RyanHolstien
ce149aed45
chore(dep): upgrade json-smart (#5081) 2022-06-03 15:32:54 -07:00