IceS2
a05eba91a5
MINOR: Fix Ingestion Dockerfile Compatibility by changing IF syntax ( #18098 )
...
* Fix Ingestion Dockerfile Compatibility by changing IF syntax
* Increased shell compatibility by using only one '='
2024-10-04 02:52:48 +05:30
IceS2
48b43900b6
Install db2 dependency on amd64 architectures ( #17495 )
2024-08-20 09:24:38 +02:00
IceS2
5e32c2aa78
Install DB2 odbc driver on x86_64 architectures and update docs ( #17425 )
2024-08-13 13:16:19 +02:00
Pere Miquel Brull
4cddee89ad
FIX - Ingestion Airflow Image constraints ( #17296 )
...
* FIX - Ingestion constraints
* FIX - Ingestion constraints
* FIX - Ingestion constraints
2024-08-06 06:44:27 +02:00
Ayush Shah
1962ffad52
Fixes #17221 : Setuptools Version Fix, Resolve Ingestion Setup Failure ( #17216 )
2024-07-29 15:29:25 +05:30
Pere Miquel Brull
d8e2187980
#15243 - Pydantic V2 & Airflow 2.9 ( #16480 )
...
* pydantic v2
* pydanticv2
* fix parser
* fix annotated
* fix model dumping
* mysql ingestion
* clean root models
* clean root models
* bump airflow
* bump airflow
* bump airflow
* optionals
* optionals
* optionals
* jdk
* airflow migrate
* fab provider
* fab provider
* fab provider
* some more fixes
* fixing tests and imports
* model_dump and model_validate
* model_dump and model_validate
* model_dump and model_validate
* union
* pylint
* pylint
* integration tests
* fix CostAnalysisReportData
* integration tests
* tests
* missing defaults
* missing defaults
2024-06-05 21:18:37 +02:00
Imri Paran
aade838020
Fixes #15388 : Use native backup tools ( #15393 )
...
* feat: use native backup tools
1. added mysqldump 8.3 to the ingestion container.
2. documented how to use native tools to back up and restore.
3. added deprecated message on the cli backup and restore.
* added deprecation notice for 1.3 backup
* removed 1.3.x deprecation notice
* added another backup page in 1.3 introducing SQL dump tools
* added --set-gtid-purged=OFF to the mysql dump process
2024-03-12 06:23:05 +01:00
Akash Jain
7a90de2e9e
fix(docker): K8s requires apache-airflow-providers-cncf-kubernetes pip package ( #14989 )
2024-02-01 18:20:45 +05:30
Mayur Singal
c3903b3f45
Minor: Fix IBM DB2 Depenency Installation Issue ( #14613 )
2024-01-08 10:18:04 +05:30
Pere Miquel Brull
0e92a975e3
#14425 - Create ingestion-base-slim image ( #14426 )
...
* #14425 - Create ingestion-base-slim image
* Format
* Bump airflow
* Bump constraints
2023-12-19 11:09:38 +01:00
Pere Miquel Brull
6d046f7e3b
Revert "Update Dockerfile.ci file to use new MySQL Keys ( #14400 )" ( #14416 )
...
This reverts commit 33f2fdd49cae50c93cbf1f8544402bda41070a01.
2023-12-16 16:46:33 +01:00
Preet Shah
33f2fdd49c
Update Dockerfile.ci file to use new MySQL Keys ( #14400 )
...
* Update Dockerfile.ci file to use new MySQL Keys
* Update ingestion Dockerfiles files to use new MySQL Keys
* Update ingestion Dockerfiles files
* Update Dockerfiles to not hardcode the new keys
* Update comments
2023-12-15 15:46:30 +05:30
Pere Miquel Brull
8c6777f820
Fix #12406 - Ingestion image with python 3.10 ( #13949 )
2023-11-13 15:08:06 +05:30
Nguyen Huu Loc
7ff6738527
Fix looker missing git execution on container image ( #13457 )
...
* - Add git execution to ingestion Dockerfile
- [Looker] Update missing function
* Fix pylint
* Add git execution to Dockerfile
* Remove log
---------
Co-authored-by: Loc Nguyen <loc.nguyenhuu@xendit.co>
2023-10-06 06:51:07 +02:00
Anuj359
e5489912ea
Upgrade: airflow base image from 2.5.3 to 2.6.3 ( #13151 )
2023-09-12 20:04:25 +05:30
Akash Jain
fd0b1b9fed
fix: Align Docker Base Image to use airflow 2.5.3 ( #12737 )
2023-08-04 12:08:58 +05:30
Matias Puerta
e203ece20c
[CHORE] Reduce docker image size by removing pip cache ( #12708 )
...
* [CHORE] Reduce docker image size by removing pip cache
* [CHORE] Reduce image size for ingestion/operators as well
* [CHORE] Reduce image size for CI
2023-08-02 14:36:27 +02:00
Pere Miquel Brull
a3bff293a4
Fix #12190 - Bring support for Airflow 2.6 & Use Airflow 2.6.3 as the new ingestion base ( #12398 )
...
* Bump Airflow version
* Support Airflow 2.6
* Lint
* Bump airflow version
* Fix airflow 2.6 lineage
* Fix airflow 2.6 lineage
2023-07-13 06:41:59 +02:00
Onkar Ravgan
23b153991b
fixed mysqlclient dep ( #12087 )
2023-06-22 15:18:39 +05:30
Mayur Singal
d867a3ab40
remove mac arch from dockerfile ( #11876 )
2023-06-05 19:10:22 +05:30
Akash Jain
ce9a10dd32
fix: CI Snyk Reports ( #11874 )
2023-06-05 10:43:52 +05:30
Pere Miquel Brull
7ff00d399e
Install ibm-db-sa if not ARM ( #11798 )
2023-05-30 10:36:48 +05:30
Pere Miquel Brull
c0ea11a477
Add libsasl deps ( #11613 )
2023-05-16 14:32:48 +02:00
Pere Miquel Brull
aaf92a9ae8
Bump python-daemon ( #11477 )
2023-05-08 09:59:57 +02:00
Pere Miquel Brull
e453593760
Rel to #10805 - Ingestion docs glue & Kerberos Dep ( #11157 )
...
* Glue
* Add kerberos system dep
2023-04-20 10:56:46 +02:00
Pere Miquel Brull
b0058bdb65
Fix #9707 - Install instantclient and enable thick mode ( #9761 )
...
* Install instantclient
* Prep instant client
* Update docs
* Amend comments
2023-01-19 08:08:56 +01:00
Nahuel
a2b34dd0f4
Fix: Update Ingestion docker images and fix python libraries dependencies ( #9342 )
...
* Update Ingestion docker images and fix python libraries dependencies
* Install also apache-airlfow-providers-http
2022-12-16 14:46:25 +00:00
Pere Miquel Brull
ff028a6eb0
Fix Mysql bigint ( #8665 )
...
* Fix mysql bigint cast
* Remove upgrade from dockerfiles
2022-11-11 10:12:23 +01:00
Pere Miquel Brull
600aecbdf8
Bump bind9 bullseye version for ingestion container ( #8619 )
...
* Bump bind9 bullseye version
* Remove bind9 fixed version
2022-11-09 21:17:20 -08:00
Pere Miquel Brull
f4c20ded32
Ingestion Image - Remove expat version release and CI ( #8447 )
...
* Remove expat version
* Remove expat version
2022-10-31 10:01:05 +01:00
Nahuel
3ed6ad8456
Update GID used in ingestion docker images ( #8434 )
2022-10-29 13:03:37 -07:00
Pere Miquel Brull
f834b28198
patch ingestion image ( #8385 )
2022-10-27 15:10:04 +02:00
Akash Jain
fc8312c5fb
feat: Refactor openmetadata/ingestion docker image ( #7456 )
...
* centralize openmetadata/ingestion docker image
* update volume mappings; fix ingestion tag!
* fix PR comments
* fix cypress mysql tests!
2022-09-19 09:20:54 +05:30
