125 Commits

Author SHA1 Message Date
Shirshanka Das
2bdf4933e2
ci: ensure smoke-tests run on python 3.11 (#13344)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-04-27 20:48:14 -07:00
Chakru
25a78d4960
ci: fix publish and scan tasks and schedule (#13332) 2025-04-25 20:48:08 +05:30
Chakru
51863325a5
build: use versioning in gradle consistent with ci (#13259)
Enable use of gradle for all image builds for publishing, eliminating the per-image build action in docker-unified.yml that duplicated what was in gradle but used slightly different mechanisms to determine what is the tag. Enabled gradle build to consume tags provided by the workflow and produce tags same as earlier.

Use bake matrix builds to build slim/full versions of datahub-ingestion, datahub-actions.

Publish images and scan relies on gradle to get the list of images, via depot.

Image publish and scans run once a day on schedule or on manual triggers only.
Pending work: Separate the publish and scans into a separate workflow that runs on a schedule and could also run other tests.
2025-04-24 23:00:03 +05:30
Chakru
294d77446b
ci: increase runner size for smoke tests (#13301) 2025-04-23 21:59:37 +05:30
dependabot[bot]
9f91edc724
build(deps): bump aquasecurity/trivy-action from 0.29.0 to 0.30.0 (#13271)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-21 09:18:07 -05:00
dependabot[bot]
210dcdc557
build(deps): bump aquasecurity/trivy-action from 0.29.0 to 0.30.0 (#12892)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-18 11:15:01 -05:00
Harshal Sheth
b75dbaa3a1
feat(ci): make datahub-actions docker build standalone (#13241) 2025-04-17 08:51:46 +02:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier (#13220) 2025-04-16 16:55:51 -07:00
Tamas Nemeth
a1291faad9
feat(actions): Moving datahub-actions into oss datahub (#13120) 2025-04-16 12:23:29 +02:00
Chakru
912fac3eb5
fix(ci): fix image publish task, python-docker version (#13206) 2025-04-15 08:44:09 -07:00
Chakru
5b1e194a3c
build: use docker bake to build all images in a single step (#13191) 2025-04-15 09:48:11 +05:30
Harshal Sheth
8df235a40c
fix: more Python dockerfile refactoring (#13180) 2025-04-11 14:57:49 -07:00
Harshal Sheth
dd3aff90a0
fix(ci): enforce docker snippet validation in CI (#13163) 2025-04-09 22:49:59 -07:00
Harshal Sheth
275535d4d3
feat: start removing ingestion-base image (#13146) 2025-04-09 11:53:34 -07:00
Chakru
d664b9f4ff
fix(ci): make depot remote container builder optional (#13105) 2025-04-07 23:21:03 +05:30
Chakru
cf40116680
CI speedup (#13057) 2025-04-07 10:13:07 +05:30
Chakru
40106be208
build: optimizations for incremental builds and faster CI (#13033)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-02 11:51:10 +05:30
Harshal Sheth
1cb916550e
ci(smoke): report smoke test results to codecov (#12556) 2025-02-05 10:50:31 -08:00
Chakru
696386389b
fix(ci): run smoke tests on release (#12518) 2025-01-31 22:16:16 +05:30
david-leifker
dbd57c972f
fix(ci): fix datahub-ingestion release/tag publishing (#12466) 2025-01-28 15:59:01 -06:00
Harshal Sheth
b4e23c5f82
fix(ci): reduce parallelism (#12441)
Co-authored-by: Chakravarthy Racharla <chakru.racharla@acryl.io>
2025-01-22 15:57:13 -06:00
dependabot[bot]
654728eec6
build(deps): bump gradle/actions from 3 to 4 (#12387)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2025-01-18 08:19:15 +05:30
dependabot[bot]
e5d61698c6
build(deps): bump aquasecurity/trivy-action from 0.26.0 to 0.29.0 (#12384)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-18 07:22:39 +05:30
dependabot[bot]
94e966506d
build(deps): bump github/codeql-action from 2 to 3 (#12383)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-01-18 05:56:24 +05:30
Aseem Bansal
124e2006e1
ci: fix shellcheck warnings, update actions (#12281) 2025-01-07 16:42:08 +05:30
david-leifker
7198f711dc
fix(ci): further consolidate NODE_OPTIONS (#12217) 2024-12-31 08:50:44 -06:00
Chakru
fe43f076da
Parallelize smoke test (#12225) 2024-12-26 21:22:16 +05:30
david-leifker
73dce9e418
chore(bump): bump node version long term support release (build time … (#12199) 2024-12-22 10:28:19 -06:00
david-leifker
327c6f911a
chore(bump): bump alpine and dockerize (#12184) 2024-12-20 15:59:07 -06:00
david-leifker
a908573265
fix(ci): additional disk clean (#11835) 2024-11-12 10:21:35 -06:00
david-leifker
d8ede691f0
fix(ci): ensure py 3.10 (#11626) 2024-10-15 09:34:30 -05:00
david-leifker
2205920aaa
fix(trivy): also add alternative java db (#11591) 2024-10-10 18:07:17 -05:00
david-leifker
9ffd2dc8ca
fix(trivy): multi-repo, bump trivy version (#11590) 2024-10-10 17:57:23 -05:00
RyanHolstien
86d394c1e1
feat(scan): add scanning to setup images (#11563) 2024-10-08 13:51:27 -05:00
david-leifker
81d86d3d6d
chore(ci): bump trivy action version (#11555) 2024-10-07 19:28:32 -07:00
david-leifker
68b188a011
build(gradle): Update gradle.properties (#11458) 2024-09-23 17:38:20 -05:00
Harshal Sheth
c5112af573
chore: use unique docker log artifact names (#11445) 2024-09-20 13:22:40 -07:00
david-leifker
97e02299f9
fix(XServiceProvider): fix ebean framework race condition (#11378) 2024-09-16 13:33:48 -05:00
david-leifker
ede9520b87
feat(schemaField): populate schemaFields with side effects (#10928) 2024-09-04 15:36:12 -05:00
Harshal Sheth
c4bc34f9ff
feat(build): remove base-requirements.txt (#11238)
Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-08-29 22:34:00 -05:00
david-leifker
f9cd29f6a3
ci(flavor): reintroduce flavor suffix (#11265) 2024-08-29 09:07:49 -05:00
Aseem Bansal
efc42df3d9
ci: update outdated actions for java and python setup (#11261) 2024-08-29 14:27:35 +05:30
david-leifker
2066f1f625
feat(ingestion-base): convert to ubuntu image (#11263) 2024-08-28 17:18:41 -05:00
Aseem Bansal
15c1cfc386
ci(build): update outdated action & pin deepdiff lib (#11260) 2024-08-28 19:53:42 +05:30
david-leifker
437569ab0e
ci(smoke-test): allow smoke-test only PRs (#11194) 2024-08-16 14:12:04 -05:00
david-leifker
5fa48d7f25
fix(ci): additional ci and smoke-test updates (#11183) 2024-08-15 10:14:13 -05:00
david-leifker
18ce10448f
feat(actions): updates to gha workflows (#11150) 2024-08-13 19:14:40 -05:00
david-leifker
b13d990f07
chore(ci): revert update deprecated github actions (#10977) (#11062) 2024-07-31 15:30:30 -05:00
Aseem Bansal
347ac1aeb7
chore(ci): update deprecated github actions (#10977) 2024-07-31 11:49:39 -05:00
Aseem Bansal
542f6c1ab8
feat(ci): update outdated action (#10899) 2024-07-12 11:03:17 -07:00