187 Commits

Author SHA1 Message Date
david-leifker
2973da553f
feat(sql-setup): system-update replacement for mysql/postgres setup (#15044) 2025-10-21 15:07:52 -05:00
Abe
604e5df446
chore(docker): upgrade OpenSearch from 2.17.0 to 2.19.3 (#15047)
Upgrade local quickstart OpenSearch version to align with production version (2.19).

Changes:
- docker/profiles/docker-compose.prerequisites.yml: Update default DATAHUB_SEARCH_TAG from 2.17.0 to 2.19.3
- docker/quickstart/docker-compose.quickstart-profile.yml: Update hardcoded image version from 2.17.0 to 2.19.3

This brings the local development environment in sync with the production OpenSearch version.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-19 06:48:11 -07:00
Aseem Bansal
3b0c34f84d
refactor(test): refactor smoke test (#15010) 2025-10-16 10:36:38 +05:30
RyanHolstien
3eac7fab5b
feat(search): implement multi-client search engine shim for ES8 support (#14904)
Co-authored-by: Esteban Gutierrez <esteban.gutierrez@acryl.io>
2025-10-06 18:40:00 +00:00
Aseem Bansal
c88a4a5a48
config(gms): enable some features by default (#14889) 2025-10-03 20:31:23 +05:30
Alex
f7ea7f033d
chore(devenv): upgrade of opensearch to 2.17 and stability improvements (#14895) 2025-10-01 22:38:09 -07:00
Chakru
660a4efa5f
MCL Generation via CDC (#14824)
Co-authored-by: David Leifker <david.leifker@acryl.io>
2025-10-01 18:23:31 -05:00
david-leifker
04d0a50118
feat(): Basepath support (#14866)
Co-authored-by: Esteban Gutierrez <esteban.gutierrez@acryl.io>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2025-10-01 11:08:38 -05:00
Alex
acd7236290
fixes to improve stability of the ci build (#14752) 2025-09-15 09:44:42 -05:00
david-leifker
fa0904b6e4
fix(ci): restore workflow and quickstart env (#14654) 2025-09-03 12:17:26 -05:00
Chakru
cbb5f9a9b6
feat(kafka): refactor kafka topic mgmt and move setup to system-update (#14564) 2025-08-27 17:03:56 +05:30
david-leifker
b97afaf4b8
feat(docker-gradle): localstack debug (#14238) 2025-07-26 10:09:02 -05:00
Chakru
6f791b3d4e
feat(quickstart): bump default version to v1.2.0 (#14154) 2025-07-21 22:47:55 +05:30
Chakru
21726bc334
feat(quickstart): migrate to compose profile and other improv. (#13566) 2025-07-11 20:12:10 +05:30
Chakru
aac98c7d12
fix(quickstart): use kafka version that supports zookeeper (#13879) 2025-06-27 12:58:59 +05:30
Chakru
02fa0ac77f
fix(quickstart): use latest zookeeper version (#13871) 2025-06-26 07:37:50 -05:00
david-leifker
cbd97186e2
feat(kafka): bump confluent kafka (#13767) 2025-06-15 10:52:16 -05:00
david-leifker
799a9f2e31
feat(search): lineage search performance (#13545) 2025-06-04 13:54:45 -05:00
david-leifker
1194f910bd
bump(): upgrade Kafka 7.9.1 (#13667) 2025-05-30 21:51:36 -05:00
Pedro Silva
4f41832ca8
fix(quickstart): Enable V2 UI by default (#13664) 2025-05-30 11:31:05 -05:00
david-leifker
0b2e0ef100
fix(): docker mysql env (#13274) 2025-04-22 12:37:24 -05:00
Tamas Nemeth
a1291faad9
feat(actions): Moving datahub-actions into oss datahub (#13120) 2025-04-16 12:23:29 +02:00
david-leifker
8618d08230
config(): Enable V2 UI in quickstart by default (#12692) 2025-02-20 13:42:11 -06:00
Aseem Bansal
867007f209
chore: remove obsolete attribute from docker (#11573) 2024-10-09 20:52:50 +05:30
david-leifker
4296373c5f
config(rest-api): enable authentication and api authorization by default (#11484) 2024-09-27 11:31:25 -05:00
david-leifker
edb9a87b84
fix(elasticsearch): refactor idHashAlgo setting (#11193) 2024-08-16 14:41:44 -05:00
Pinaki Bhattacharjee
a5a33f074b
feat(config): support alternate hashing algorithm for doc id (#10423)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: John Joyce <john@acryl.io>
2024-08-06 13:50:38 -05:00
Brandon Brown
9c5bea34cd
feat(docker/quickstart): Adding in support for overriding the conflue… (#10533) 2024-07-01 16:11:50 +00:00
Davi Arnaut
995af4e980
fix(quickstart): remove unneeded init.sql (#10266) 2024-04-10 09:05:20 -07:00
david-leifker
77c4629ccf
refactor(docker): move to acryldata repo for all images (#9459) 2024-04-02 09:36:44 -05:00
RyanHolstien
ef637ccb37
fix(docker): fix versioning for compose file post release (#10176) 2024-04-01 15:01:09 -05:00
Harshal Sheth
5793467e29
feat(quickstart): remove container_name from compose files (#9809) 2024-02-09 20:45:30 -05:00
RyanHolstien
131c8f878c
feat(kafka): add health indicator for kafka (#9662) 2024-01-19 13:44:48 -06:00
RyanHolstien
55cb56821c
fix(kafka): fix infinite deserialization logging (#9494) 2023-12-21 10:33:25 -06:00
david-leifker
3777730d78
fix(quickstart): force strings for mysql version (#9485) 2023-12-19 15:30:47 -06:00
david-leifker
3a840371cc
fix(docker): docker compose health checks port fix (#9326) 2023-11-28 21:21:15 -06:00
RyanHolstien
a62d52e6b1
feat(mysql): upgrade to version 8.2 for quickstart (#9241)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-22 13:54:12 -06:00
Xuelei Li
179f103412
fix(metadata-io): in Neo4j service use proper algorithm to get lineage (#8687)
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-10 10:58:38 -06:00
deepgarg-visa
399e032dfa
feat(neo4j): Allow datahub to connect to specific neo4j database (#9179)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-08 11:02:13 -06:00
david-leifker
353584c10a
feat(browsepathv2): Allow system-update to reprocess browse paths v2 (#9200) 2023-11-07 18:22:18 -06:00
Harshal Sheth
b565a657d2
feat(quickstart): fix broker InconsistentClusterIdException issues (#9148) 2023-10-30 23:35:12 -07:00
david-leifker
3f4ab44a91
feat(kafka): increase kafka message size and enable compression (#9038)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-10-29 16:26:05 -05:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x (#8852) 2023-09-21 13:01:55 -05:00
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images (#8515) 2023-08-17 10:40:17 +05:30
Harshal Sheth
b8681a7129
feat(quickstart): bump quickstart start periods more (#8573) 2023-08-04 15:17:16 +05:30
RyanHolstien
9f791a3b6e
feat(browseV2): add browseV2 logic to system update (#8506)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-08-01 12:48:02 -05:00
david-leifker
3640291493
config(ebean): add ebean retry configuration (#8500) 2023-07-28 14:09:44 -05:00
Harshal Sheth
2a3f6c42d4
ci: workarounds for pyyaml installation (#8435) 2023-07-17 15:26:43 -07:00
Harshal Sheth
e5f9ee178c
fix(cli/quickstart): handle docker hangs gracefully (#8211)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-06-13 14:34:06 -05:00
Jinlin Yang
166dc90896
Upgrade kafka and its dependencies to 3.4 in docker compose (#8161)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-06-13 13:57:54 +01:00