Chakru
51863325a5
build: use versioning in gradle consistent with ci ( #13259 )
...
Enable use of gradle for all image builds for publishing, eliminating the per-image build action in docker-unified.yml that duplicated what was in gradle but used slightly different mechanisms to determine what is the tag. Enabled gradle build to consume tags provided by the workflow and produce tags same as earlier.
Use bake matrix builds to build slim/full versions of datahub-ingestion, datahub-actions.
Publish images and scan relies on gradle to get the list of images, via depot.
Image publish and scans run once a day on schedule or on manual triggers only.
Pending work: Separate the publish and scans into a separate workflow that runs on a schedule and could also run other tests.
2025-04-24 23:00:03 +05:30
Esteban Gutierrez
8a17ba14d6
fix(): Fixes multiple minor security vulnerabilities ( #13222 )
...
bug(snappy): Make sure right snappy version is installed
fix(docker): update Dockerize to version v0.9.3
fix(gms): fixes dgraph4j netty deps
fix(docker): remove SGID on /home/datahub and /home/datahub-integration
fix(datahub-actions): bump setuptools and wheel version
fix(docker): update c-ares version
fix(docker): datahub-actions addendum
2025-04-21 16:39:26 -05:00
Harshal Sheth
b75dbaa3a1
feat(ci): make datahub-actions docker build standalone ( #13241 )
2025-04-17 08:51:46 +02:00
Andrew Sikowitz
d138a64a6a
ci(graphql,workflows): Format .md, .graphql, and workflow .yml files via prettier ( #13220 )
2025-04-16 16:55:51 -07:00
Chakru
912fac3eb5
fix(ci): fix image publish task, python-docker version ( #13206 )
2025-04-15 08:44:09 -07:00
david-leifker
5ee0b66920
feat(spring): upgrade to SpringBoot 3.4 ( #13186 )
2025-04-12 15:34:17 -05:00
Harshal Sheth
8df235a40c
fix: more Python dockerfile refactoring ( #13180 )
2025-04-11 14:57:49 -07:00
Harshal Sheth
dd3aff90a0
fix(ci): enforce docker snippet validation in CI ( #13163 )
2025-04-09 22:49:59 -07:00
Harshal Sheth
275535d4d3
feat: start removing ingestion-base image ( #13146 )
2025-04-09 11:53:34 -07:00
Chakru
cf40116680
CI speedup ( #13057 )
2025-04-07 10:13:07 +05:30
david-leifker
287fda19c7
fix(docker): also rename group to datahub ( #13094 )
2025-04-04 18:30:26 -05:00
david-leifker
046c59bdb5
chore(): bump base ubuntu image 22.04 -> 24.04 ( #13072 )
2025-04-03 14:39:41 -05:00
Chakru
40106be208
build: optimizations for incremental builds and faster CI ( #13033 )
...
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-02 11:51:10 +05:30
david-leifker
dbd57c972f
fix(ci): fix datahub-ingestion release/tag publishing ( #12466 )
2025-01-28 15:59:01 -06:00
Harshal Sheth
a8d6c54965
feat(sdk): move version info to dedicated file ( #12456 )
2025-01-24 11:35:39 -08:00
david-leifker
9762c46702
chore(bump): ingestion-base & actions ( #12171 )
2024-12-19 12:41:44 -06:00
Harshal Sheth
c4bc34f9ff
feat(build): remove base-requirements.txt ( #11238 )
...
Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-08-29 22:34:00 -05:00
david-leifker
f9cd29f6a3
ci(flavor): reintroduce flavor suffix ( #11265 )
2024-08-29 09:07:49 -05:00
david-leifker
2066f1f625
feat(ingestion-base): convert to ubuntu image ( #11263 )
2024-08-28 17:18:41 -05:00
Aseem Bansal
082ef5b351
build: fix docker warnings ( #11163 )
2024-08-14 14:23:11 +05:30
Renan F. Lima
2336207a2a
fix(ingest): fix oracle cronjob ingestion ( #11001 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-07-31 15:06:19 -05:00
david-leifker
edc8fd409d
chore(ingestion-base): bump base image packages ( #11053 )
2024-07-31 12:39:07 -05:00
skrydal
67b67f77b7
feat(ingestion): Add -e flag to uv command in ingestion Dockerfiles ( #10114 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-09 18:42:44 -07:00
david-leifker
4bda3d87dc
build(docker): prefix pr on pr sha tags ( #10171 )
2024-03-29 17:27:57 -05:00
Harshal Sheth
05593f443e
feat(docker): respect pip mirrors with uv ( #9963 )
2024-02-29 18:05:14 -08:00
Harshal Sheth
02f41b74b6
feat(ingest): use uv for python package installs ( #9885 )
2024-02-26 15:02:47 -08:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms ( #9626 )
...
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
noggi
193d1464a6
Fix downstream CI issue ( #9479 )
2023-12-18 14:06:17 -08:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 ( #9458 )
2023-12-15 13:28:33 -06:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers ( #9230 )
...
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
ff90fb633d
fix(datahub-ingestion): prevent transitive deps, bump addtional pyspa… ( #9233 )
2023-11-13 16:26:53 -06:00
david-leifker
ebd2e2312b
fix(datahub-ingestion): remove old jars, sync pyspark version ( #9217 )
2023-11-10 22:10:00 -06:00
david-leifker
4d9a7ce7c9
ci: Docker slim tag fix ( #8925 )
2023-09-29 23:07:45 -05:00
david-leifker
b45b7f7d2a
fix(docker): slim tags ( #8922 )
2023-09-29 17:49:36 -05:00
david-leifker
d33a85314d
fix(docker): move base image to -base tag, full image to head ( #8919 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-09-28 21:21:04 -05:00
Harshal Sheth
ed1d35c79b
fix(build): run codegen when building datahub-ingestion image ( #8869 )
2023-09-25 23:10:49 -05:00
Harshal Sheth
f7fee743bf
fix(ingest): use epoch 1 for dev build versions ( #8824 )
2023-09-12 13:11:01 -07:00
david-leifker
68ae3bfc26
fix(spark-test): upgrade gradle and fix spark smoke test ( #8777 )
2023-09-07 20:17:50 -05:00
david-leifker
655914841b
fix(docker): misc docker fixes ( #8677 )
2023-08-22 10:38:08 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images ( #8515 )
2023-08-17 10:40:17 +05:30
david-leifker
0a9dc73402
build(docker): metadata-ingestion images build and add slim version ( #7412 )
2023-03-20 18:06:35 -05:00
Aseem Bansal
b2ecd7f968
chore(ci): update dependencies, fix smoke image build ( #7580 )
2023-03-15 21:07:30 +05:30
Aseem Bansal
555bafff1e
chore(ci): exclude duckdb from smoke test ( #7458 )
2023-03-01 19:29:02 +05:30
Aseem Bansal
324fc8ee9f
chore(ci): update base dependencies ( #7390 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-21 16:07:51 -06:00
Aseem Bansal
b0d9d218c7
chore(ci): cleanup build to remove dependencies duckdb, dev ( #7267 )
2023-02-07 18:12:17 -08:00
Aseem Bansal
da85e73d94
chore(ci): update base image dependencies ( #7248 )
2023-02-06 15:57:05 +05:30
Peter Szalai
732c837e67
fix(htrace): remove htrace jar ( #7126 )
2023-01-24 19:43:34 -08:00
Harshal Sheth
62a2aa94f6
feat: remove jq requirement + tweak modeldocgen args ( #6904 )
...
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-12-30 14:02:57 -05:00
Harshal Sheth
8e0f4078b8
chore(ingest): loosen additional requirements ( #6868 )
2022-12-28 12:08:53 +01:00
Harshal Sheth
d851140048
chore(ingest): loosen requirements file ( #6867 )
2022-12-27 22:39:12 +01:00
