65 Commits

Author SHA1 Message Date
Harshal Sheth
c4bc34f9ff
feat(build): remove base-requirements.txt (#11238)
Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-08-29 22:34:00 -05:00
david-leifker
f9cd29f6a3
ci(flavor): reintroduce flavor suffix (#11265) 2024-08-29 09:07:49 -05:00
david-leifker
2066f1f625
feat(ingestion-base): convert to ubuntu image (#11263) 2024-08-28 17:18:41 -05:00
Aseem Bansal
082ef5b351
build: fix docker warnings (#11163) 2024-08-14 14:23:11 +05:30
Renan F. Lima
2336207a2a
fix(ingest): fix oracle cronjob ingestion (#11001)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-07-31 15:06:19 -05:00
david-leifker
edc8fd409d
chore(ingestion-base): bump base image packages (#11053) 2024-07-31 12:39:07 -05:00
skrydal
67b67f77b7
feat(ingestion): Add -e flag to uv command in ingestion Dockerfiles (#10114)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-09 18:42:44 -07:00
david-leifker
4bda3d87dc
build(docker): prefix pr on pr sha tags (#10171) 2024-03-29 17:27:57 -05:00
Harshal Sheth
05593f443e
feat(docker): respect pip mirrors with uv (#9963) 2024-02-29 18:05:14 -08:00
Harshal Sheth
02f41b74b6
feat(ingest): use uv for python package installs (#9885) 2024-02-26 15:02:47 -08:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
noggi
193d1464a6
Fix downstream CI issue (#9479) 2023-12-18 14:06:17 -08:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
ff90fb633d
fix(datahub-ingestion): prevent transitive deps, bump addtional pyspa… (#9233) 2023-11-13 16:26:53 -06:00
david-leifker
ebd2e2312b
fix(datahub-ingestion): remove old jars, sync pyspark version (#9217) 2023-11-10 22:10:00 -06:00
david-leifker
4d9a7ce7c9
ci: Docker slim tag fix (#8925) 2023-09-29 23:07:45 -05:00
david-leifker
b45b7f7d2a
fix(docker): slim tags (#8922) 2023-09-29 17:49:36 -05:00
david-leifker
d33a85314d
fix(docker): move base image to -base tag, full image to head (#8919)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-09-28 21:21:04 -05:00
Harshal Sheth
ed1d35c79b
fix(build): run codegen when building datahub-ingestion image (#8869) 2023-09-25 23:10:49 -05:00
Harshal Sheth
f7fee743bf
fix(ingest): use epoch 1 for dev build versions (#8824) 2023-09-12 13:11:01 -07:00
david-leifker
68ae3bfc26
fix(spark-test): upgrade gradle and fix spark smoke test (#8777) 2023-09-07 20:17:50 -05:00
david-leifker
655914841b
fix(docker): misc docker fixes (#8677) 2023-08-22 10:38:08 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images (#8515) 2023-08-17 10:40:17 +05:30
david-leifker
0a9dc73402
build(docker): metadata-ingestion images build and add slim version (#7412) 2023-03-20 18:06:35 -05:00
Aseem Bansal
b2ecd7f968
chore(ci): update dependencies, fix smoke image build (#7580) 2023-03-15 21:07:30 +05:30
Aseem Bansal
555bafff1e
chore(ci): exclude duckdb from smoke test (#7458) 2023-03-01 19:29:02 +05:30
Aseem Bansal
324fc8ee9f
chore(ci): update base dependencies (#7390)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-21 16:07:51 -06:00
Aseem Bansal
b0d9d218c7
chore(ci): cleanup build to remove dependencies duckdb, dev (#7267) 2023-02-07 18:12:17 -08:00
Aseem Bansal
da85e73d94
chore(ci): update base image dependencies (#7248) 2023-02-06 15:57:05 +05:30
Peter Szalai
732c837e67
fix(htrace): remove htrace jar (#7126) 2023-01-24 19:43:34 -08:00
Harshal Sheth
62a2aa94f6
feat: remove jq requirement + tweak modeldocgen args (#6904)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-12-30 14:02:57 -05:00
Harshal Sheth
8e0f4078b8
chore(ingest): loosen additional requirements (#6868) 2022-12-28 12:08:53 +01:00
Harshal Sheth
d851140048
chore(ingest): loosen requirements file (#6867) 2022-12-27 22:39:12 +01:00
raysaka
fcb3242983
chore(ingest): bump python package dependencies to resolve vulns (#6384)
Co-authored-by: John Joyce <john@acryl.io>
2022-12-19 18:12:56 -05:00
Harshal Sheth
8c14dfc617
ci: fix ingestion gradle retry (#6752) 2022-12-13 20:16:59 -05:00
Harshal Sheth
ab24379def
build: add retries to gradle wrapper download in ingestion docker (#6704) 2022-12-08 22:37:29 -05:00
david-leifker
691f802a13
fix(security): version bump to latest minor python image (#6694) 2022-12-08 13:54:21 -05:00
Aseem Bansal
96150cfb10
fix(ci): revert confluent kafka in base image (#6690) 2022-12-08 13:54:13 -05:00
Aseem Bansal
a087a9fbb9
chore(ci): update base ingestion image requirements file (#6687) 2022-12-08 09:59:19 +05:30
Harshal Sheth
2cb1e6576d
fix(ingest): add alias for bigquery-beta (#6521) 2022-11-22 14:15:20 -05:00
Fredrik Sannholm
9e86c6f953
fix(docker): install openjdk 11 in base ingest image (#6365) 2022-11-04 20:43:18 +05:30
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Harshal Sheth
aa93a34678
fix(docker): skip zoneinfo backport on newer python versions (#5912) 2022-09-13 11:37:55 -07:00
Harshal Sheth
6f09f1025e
ci(ingest): test with python 3.10 (#5863) 2022-09-07 17:08:49 -07:00
Pedro Silva
42a847c8d1
feat(docker) Adds Sasl support to base ingestion image (#5855)
* feat(docker) Adds Sasl support to base ingestion image

* Add oracle changes
2022-09-07 22:21:06 +05:30
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker (#5819) 2022-09-04 22:39:08 -07:00
dependabot[bot]
12a1bd20de
build(deps): bump nbconvert in /docker/datahub-ingestion (#5716)
Bumps [nbconvert](https://github.com/jupyter/nbconvert) from 6.5.0 to 6.5.1.
- [Release notes](https://github.com/jupyter/nbconvert/releases)
- [Commits](https://github.com/jupyter/nbconvert/compare/6.5...6.5.1)

---
updated-dependencies:
- dependency-name: nbconvert
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-23 21:46:45 -07:00
Aseem Bansal
d20071ad91
fix(ci): smoke test less flaky, add src, dev dep in smoke image (#5594) 2022-08-09 19:07:12 +05:30
Aseem Bansal
935b423452
fix(docs,build): remove base image not needed, cleanup docs (#5469) 2022-07-22 19:43:48 +05:30