73 Commits

Author SHA1 Message Date
Harshal Sheth
275535d4d3
feat: start removing ingestion-base image (#13146) 2025-04-09 11:53:34 -07:00
Chakru
cf40116680
CI speedup (#13057) 2025-04-07 10:13:07 +05:30
david-leifker
287fda19c7
fix(docker): also rename group to datahub (#13094) 2025-04-04 18:30:26 -05:00
david-leifker
046c59bdb5
chore(): bump base ubuntu image 22.04 -> 24.04 (#13072) 2025-04-03 14:39:41 -05:00
Chakru
40106be208
build: optimizations for incremental builds and faster CI (#13033)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-02 11:51:10 +05:30
david-leifker
dbd57c972f
fix(ci): fix datahub-ingestion release/tag publishing (#12466) 2025-01-28 15:59:01 -06:00
Harshal Sheth
a8d6c54965
feat(sdk): move version info to dedicated file (#12456) 2025-01-24 11:35:39 -08:00
david-leifker
9762c46702
chore(bump): ingestion-base & actions (#12171) 2024-12-19 12:41:44 -06:00
Harshal Sheth
c4bc34f9ff
feat(build): remove base-requirements.txt (#11238)
Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-08-29 22:34:00 -05:00
david-leifker
f9cd29f6a3
ci(flavor): reintroduce flavor suffix (#11265) 2024-08-29 09:07:49 -05:00
david-leifker
2066f1f625
feat(ingestion-base): convert to ubuntu image (#11263) 2024-08-28 17:18:41 -05:00
Aseem Bansal
082ef5b351
build: fix docker warnings (#11163) 2024-08-14 14:23:11 +05:30
Renan F. Lima
2336207a2a
fix(ingest): fix oracle cronjob ingestion (#11001)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-07-31 15:06:19 -05:00
david-leifker
edc8fd409d
chore(ingestion-base): bump base image packages (#11053) 2024-07-31 12:39:07 -05:00
skrydal
67b67f77b7
feat(ingestion): Add -e flag to uv command in ingestion Dockerfiles (#10114)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-09 18:42:44 -07:00
david-leifker
4bda3d87dc
build(docker): prefix pr on pr sha tags (#10171) 2024-03-29 17:27:57 -05:00
Harshal Sheth
05593f443e
feat(docker): respect pip mirrors with uv (#9963) 2024-02-29 18:05:14 -08:00
Harshal Sheth
02f41b74b6
feat(ingest): use uv for python package installs (#9885) 2024-02-26 15:02:47 -08:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
noggi
193d1464a6
Fix downstream CI issue (#9479) 2023-12-18 14:06:17 -08:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
ff90fb633d
fix(datahub-ingestion): prevent transitive deps, bump addtional pyspa… (#9233) 2023-11-13 16:26:53 -06:00
david-leifker
ebd2e2312b
fix(datahub-ingestion): remove old jars, sync pyspark version (#9217) 2023-11-10 22:10:00 -06:00
david-leifker
4d9a7ce7c9
ci: Docker slim tag fix (#8925) 2023-09-29 23:07:45 -05:00
david-leifker
b45b7f7d2a
fix(docker): slim tags (#8922) 2023-09-29 17:49:36 -05:00
david-leifker
d33a85314d
fix(docker): move base image to -base tag, full image to head (#8919)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-09-28 21:21:04 -05:00
Harshal Sheth
ed1d35c79b
fix(build): run codegen when building datahub-ingestion image (#8869) 2023-09-25 23:10:49 -05:00
Harshal Sheth
f7fee743bf
fix(ingest): use epoch 1 for dev build versions (#8824) 2023-09-12 13:11:01 -07:00
david-leifker
68ae3bfc26
fix(spark-test): upgrade gradle and fix spark smoke test (#8777) 2023-09-07 20:17:50 -05:00
david-leifker
655914841b
fix(docker): misc docker fixes (#8677) 2023-08-22 10:38:08 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images (#8515) 2023-08-17 10:40:17 +05:30
david-leifker
0a9dc73402
build(docker): metadata-ingestion images build and add slim version (#7412) 2023-03-20 18:06:35 -05:00
Aseem Bansal
b2ecd7f968
chore(ci): update dependencies, fix smoke image build (#7580) 2023-03-15 21:07:30 +05:30
Aseem Bansal
555bafff1e
chore(ci): exclude duckdb from smoke test (#7458) 2023-03-01 19:29:02 +05:30
Aseem Bansal
324fc8ee9f
chore(ci): update base dependencies (#7390)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-21 16:07:51 -06:00
Aseem Bansal
b0d9d218c7
chore(ci): cleanup build to remove dependencies duckdb, dev (#7267) 2023-02-07 18:12:17 -08:00
Aseem Bansal
da85e73d94
chore(ci): update base image dependencies (#7248) 2023-02-06 15:57:05 +05:30
Peter Szalai
732c837e67
fix(htrace): remove htrace jar (#7126) 2023-01-24 19:43:34 -08:00
Harshal Sheth
62a2aa94f6
feat: remove jq requirement + tweak modeldocgen args (#6904)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-12-30 14:02:57 -05:00
Harshal Sheth
8e0f4078b8
chore(ingest): loosen additional requirements (#6868) 2022-12-28 12:08:53 +01:00
Harshal Sheth
d851140048
chore(ingest): loosen requirements file (#6867) 2022-12-27 22:39:12 +01:00
raysaka
fcb3242983
chore(ingest): bump python package dependencies to resolve vulns (#6384)
Co-authored-by: John Joyce <john@acryl.io>
2022-12-19 18:12:56 -05:00
Harshal Sheth
8c14dfc617
ci: fix ingestion gradle retry (#6752) 2022-12-13 20:16:59 -05:00
Harshal Sheth
ab24379def
build: add retries to gradle wrapper download in ingestion docker (#6704) 2022-12-08 22:37:29 -05:00
david-leifker
691f802a13
fix(security): version bump to latest minor python image (#6694) 2022-12-08 13:54:21 -05:00
Aseem Bansal
96150cfb10
fix(ci): revert confluent kafka in base image (#6690) 2022-12-08 13:54:13 -05:00
Aseem Bansal
a087a9fbb9
chore(ci): update base ingestion image requirements file (#6687) 2022-12-08 09:59:19 +05:30
Harshal Sheth
2cb1e6576d
fix(ingest): add alias for bigquery-beta (#6521) 2022-11-22 14:15:20 -05:00
Fredrik Sannholm
9e86c6f953
fix(docker): install openjdk 11 in base ingest image (#6365) 2022-11-04 20:43:18 +05:30