713 Commits

Author SHA1 Message Date
david-leifker
edcc8bca76
feat(elasticsearch-setup): system-update replacement for elasticsearch-setup (#15058) 2025-10-21 15:57:36 -05:00
david-leifker
2973da553f
feat(sql-setup): system-update replacement for mysql/postgres setup (#15044) 2025-10-21 15:07:52 -05:00
Abe
604e5df446
chore(docker): upgrade OpenSearch from 2.17.0 to 2.19.3 (#15047)
Upgrade local quickstart OpenSearch version to align with production version (2.19).

Changes:
- docker/profiles/docker-compose.prerequisites.yml: Update default DATAHUB_SEARCH_TAG from 2.17.0 to 2.19.3
- docker/quickstart/docker-compose.quickstart-profile.yml: Update hardcoded image version from 2.17.0 to 2.19.3

This brings the local development environment in sync with the production OpenSearch version.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-19 06:48:11 -07:00
Esteban Gutierrez
ceafe2083b
fix(security): Update dependencies to address multiple CVEs (addendum) (#15049) 2025-10-18 21:07:42 -05:00
Chris Collins
6fc68b6c6b
feat(gms) Add new REST endpoint for retrieving files from S3 (#15048) 2025-10-17 22:36:35 -04:00
Aseem Bansal
3b0c34f84d
refactor(test): refactor smoke test (#15010) 2025-10-16 10:36:38 +05:30
Chakru
2b9d250c29
fix(build): add ability to specificy constraints for bundled-venvs (#14999)
pydantic v2.41.3 released on oct 7th seems to have uploaded a corrupt whl. pydantic/pydantic-core#1841
Adding the ability to specify constraints to exclude this and in future, any other package that we may need to skip for bundled_venvs.
2025-10-14 10:43:37 +00:00
Chakru
b0581dfe5a
quickstart Reload improvements (#14982)
Adds two tasks reload and reloadEnv which work with any debug quickstart profile. They automatically detect the running profile to restart the correct set of services based on the running profile. The earlier profile specific tasks DebugReload[Env] are no longer needed (but still present, they now just delegate the call to these new tasks.

This also now handles ReloadEnv correctly for services that support hot-reloading. Some of the python service container names were not consistent across profiles, so this now detects the names based on the prefix as part of the auto-detection of running profile and services.
2025-10-13 21:25:01 +05:30
Chakru
ed4d3680a9
build(actions): optimize docker layer caching for bundled-venvs (#14945) 2025-10-13 21:24:14 +05:30
trialiya
b45d606062
fix(authentication): fix PlayCacheSessionStore (#14754)
Co-authored-by: trialiya <trialiya@gmail.com>
Co-authored-by: Deepak Garg <deepak.garg@datahub.com>
2025-10-11 14:29:34 +00:00
Chakru
5d28c2fd14
fix(smoke-tests): smoke test fixes for postgres profile (#14940) 2025-10-07 20:13:56 +05:30
Peter Wang
5d007f04c4
fix(build): fix "grep: invalid option -- P" error in quickstart (#14916) 2025-10-07 02:47:08 +00:00
RyanHolstien
3eac7fab5b
feat(search): implement multi-client search engine shim for ES8 support (#14904)
Co-authored-by: Esteban Gutierrez <esteban.gutierrez@acryl.io>
2025-10-06 18:40:00 +00:00
Aseem Bansal
c88a4a5a48
config(gms): enable some features by default (#14889) 2025-10-03 20:31:23 +05:30
Alex
f7ea7f033d
chore(devenv): upgrade of opensearch to 2.17 and stability improvements (#14895) 2025-10-01 22:38:09 -07:00
Chakru
660a4efa5f
MCL Generation via CDC (#14824)
Co-authored-by: David Leifker <david.leifker@acryl.io>
2025-10-01 18:23:31 -05:00
david-leifker
04d0a50118
feat(): Basepath support (#14866)
Co-authored-by: Esteban Gutierrez <esteban.gutierrez@acryl.io>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2025-10-01 11:08:38 -05:00
John Joyce
c075d1407c
fix(): Fix bundled venv (#14660)
Co-authored-by: John Joyce <john@Mac.lan>
2025-09-17 09:50:12 -07:00
Alex
acd7236290
fixes to improve stability of the ci build (#14752) 2025-09-15 09:44:42 -05:00
Harshal Sheth
2a1b7c4229
chore(docker): use prebuilt dockerize v0.24 (#14668) 2025-09-05 11:04:08 -05:00
david-leifker
fa0904b6e4
fix(ci): restore workflow and quickstart env (#14654) 2025-09-03 12:17:26 -05:00
david-leifker
6f4a109790
feat: impact lineage graph traversal improvements (#14609) 2025-09-03 07:53:12 -05:00
Chakru
06747d6543
feat(build): make :docker:build default to buildAllImages (#14634) 2025-09-02 22:49:14 +05:30
simoncjl
de2eedc8fa
fix(elasticsearch): version for security reason (#14574) 2025-08-29 12:19:06 -07:00
david-leifker
d8281bfb41
chore(): bump kubectl version (#14585) 2025-08-28 21:13:38 -05:00
Chakru
cbb5f9a9b6
feat(kafka): refactor kafka topic mgmt and move setup to system-update (#14564) 2025-08-27 17:03:56 +05:30
Harshal Sheth
0e141255ad
chore(ingest): bump datahub-actions python version to 3.11 (#14546) 2025-08-25 10:32:58 +02:00
Chakru
85fa97623b
fix(build): add kubectl to datahub-upgrade image (#14527) 2025-08-22 09:30:33 -05:00
John Joyce
8ad96399dc
feat(): Add support for generating default venvs in datahub-actions (based on recent version of CLI) (#14491)
Co-authored-by: John Joyce <john@ip-192-168-1-63.us-west-2.compute.internal>
2025-08-19 10:12:55 -07:00
david-leifker
6c6abca29e
feat(development): per project quickstart nuke (#14473)
Co-authored-by: Esteban Gutierrez <esteban.gutierrez@acryl.io>
2025-08-15 13:14:27 -05:00
v-tarasevich-blitz-brain
dcd6454e45
feat(statsTabV2): bring stats tab v2 to OSS (#13431)
Co-authored-by: Victor Tarasevich <v.tarasevitch@invento.by>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2025-08-11 12:13:49 -04:00
david-leifker
1bc58d6b40
dev(cypress): gradle command quickstartCypress (#14404) 2025-08-08 21:45:09 -05:00
Harshal Sheth
a77f71fe11
fix(ingest): ensure docker image has all required deps (#14350) 2025-08-06 13:49:17 -07:00
Chakru
f04244fd69
fix(build): incorrect tag for full variant of datahub-ingestion image (#14344) 2025-08-06 09:04:01 -05:00
david-leifker
e558e51d14
chore(kafka-setup): migrate from confluent image to alpine (#14317) 2025-08-04 17:27:01 -05:00
hector-stratebi
ac12ccbf89
fix(oracle): create libaio.so.1 symbolic link (#14191) 2025-08-04 15:31:16 +09:00
david-leifker
8708ae0dd7
chore(): bump alpine base image 3.22 (#14303) 2025-08-01 11:21:23 -05:00
david-leifker
9b7168a3d8
chore(): bump base alpine image (#14291) 2025-07-31 15:48:44 -05:00
david-leifker
b97afaf4b8
feat(docker-gradle): localstack debug (#14238) 2025-07-26 10:09:02 -05:00
Chakru
6f791b3d4e
feat(quickstart): bump default version to v1.2.0 (#14154) 2025-07-21 22:47:55 +05:30
Chakru
fe56b0f41e
fix(tests): disable auth for spark test via env var instead of env file (#14148) 2025-07-19 21:50:03 +05:30
Chakru
d1ff75db51
chore(deps): bump commons-beanutils - one more location (#14116) 2025-07-17 03:25:47 +05:30
Chakru
b51f0069fb
build(actions): optimize docker layer caching (#14114) 2025-07-17 02:01:45 +05:30
Chakru
37db4a50be
chore(deps): bump commons-beanutils (#14110) 2025-07-16 14:17:54 -05:00
Chakru
be645ead6b
chore(deps): bump kafka in kafka-setup (#14094) 2025-07-16 09:31:52 -05:00
Chakru
244b2c4003
chore(kafka-setup): bump aws-msk-iam-auth (#14085) 2025-07-15 20:51:30 +05:30
Chakru
21726bc334
feat(quickstart): migrate to compose profile and other improv. (#13566) 2025-07-11 20:12:10 +05:30
Chakru
4d63c404df
build(docker): use root as build context (#13968) 2025-07-08 14:30:50 +05:30
Chakru
aac98c7d12
fix(quickstart): use kafka version that supports zookeeper (#13879) 2025-06-27 12:58:59 +05:30
Chakru
933e75f5e1
fix(quickstart): restore kafka version (#13873) 2025-06-26 21:08:04 +05:30