90 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
9004434c18
Fix #9752: docker openmetadata_ingestion should only depend on db (#9753)
* Fix #9752: docker openmetadata_ingestion should only depend on db

* Fix the typo

* Adding service_started for local docker

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
2023-01-18 08:45:15 +01:00
Pere Miquel Brull
e3ae3a8a33
[WIP] - Add Scarf gateway (#9652)
* Update ingestion Readme with scarf

* Test scarf docker

* Update ingestion Readme with scarf

* Test scarf docker

* Add docker domain
2023-01-11 09:33:09 +01:00
Nahuel
2c43ebba6f
Fix#9448: Add ES volumes (#9506)
* Add ES volumes

* Fix run_local_docker script

* Fix error run_local_docker script

* Update Es volumes in docker-compose files
2022-12-23 17:33:30 +01:00
Pere Miquel Brull
8806244348
Removing ES volumes (#9503)
* Fix ES volumes permissions

* Remove ES volumes
2022-12-22 18:02:09 +01:00
Vj-L
f3855a1909
Added the default volumes for ElasticSearch (#9452)
* Added the default volumes for ElasticSearch

* Added docs for ES Volumes

* Updated as per the comments

* Updated as per the comments

* Added the docs for bare-metal upgrade

* Apply suggestions from code review

* Update docker/local-metadata/docker-compose.yml

* Pylint check addressed

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: Nahuel <nahuel@getcollate.io>
2022-12-21 18:29:49 +00:00
Pere Miquel Brull
ddf2adf52c
Add port mapping for MySQL (#9436) 2022-12-20 11:13:17 -08:00
Nahuel
a2b34dd0f4
Fix: Update Ingestion docker images and fix python libraries dependencies (#9342)
* Update Ingestion docker images and fix python libraries dependencies

* Install also apache-airlfow-providers-http
2022-12-16 14:46:25 +00:00
Nahuel
e998ecc407
Deprecate configurations for auth provider configuration on Airflow (#8896)
* Deprecate configurations for auth provider configuration on Airflow

* Fix code after merging

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2022-12-15 12:28:46 -08:00
Vj-L
0a570c8585
Fixed the mounting of volumes (#8963)
* Fixed the mounting of volumes

* Update docker/local-metadata/docker-compose-postgres.yml

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* Update docker/metadata/docker-compose-postgres.yml

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* Added permission step

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
2022-11-23 14:37:53 +05:30
Vj-L
2c055641be
Added host volumes for Database service (#8722)
* Added host volumes for Database service

* Formated the python file

* Done changes according to the comments on PR

* Changes done as per the comments on Draft PR

* Fix PyLint

* Changes done as per the comments on Draft PR

* Updated the path of volume for Database

* Added cleanup state in workflows

* Added cleanup state in workflows

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-11-18 14:05:33 +01:00
Vj-L
e1b4229074
Fix/env variable (#8199)
* Updated env variable for heap

* Updated env variable for heap

* Updated the env variables

* Updated the env variables

* Updated the env variables

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-10-19 11:00:11 +05:30
Sam Firke
58b86a24bc
Remove inconsistent space in docker-compose files (#8138)
* remove extra space for consistency
2022-10-13 15:33:22 -07:00
Sriharsha Chintalapani
65ee573a7d
Fix HEAP OPTS param (#8094) 2022-10-11 16:30:09 -07:00
Vj-L
0926c754aa
Updated env variable for heap (#8067)
* Updated env variable for heap

* Updated env variable for heap

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-10-11 19:29:22 +05:30
kmalki
69ddc7081c
Add environment variables in docker compose for elasticsearch (#8026) 2022-10-08 23:51:59 +05:30
Akash Jain
1e31245bbe
fix: Remove Lineage Backend Configs (#7836) 2022-10-01 11:23:24 +05:30
Akash Jain
c4b0bb0538
fix path for airflow volumes (#7827) 2022-09-30 18:20:38 +05:30
Vj-L
489d506e3a
Removed the volume for Database (#7798)
* Removed the volume for Database

* Removed the volume for Database

* Added named volume

* Added named volume

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-09-29 21:44:12 +05:30
Vj-L
6cfd16925a
Added default volumes (#7741)
* Added default volumes

* Ran make py_format for formatting

* Added sample data in mount directories

* Updated as per the comments

* Done changes for --ingest_sample_data flag

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-09-29 14:53:55 +05:30
Akash Jain
b3d340e403
Fix: env variables with basic auth changes for docker compose (#7693) 2022-09-23 23:52:28 +05:30
Akash Jain
fc8312c5fb
feat: Refactor openmetadata/ingestion docker image (#7456)
* centralize openmetadata/ingestion docker image

* update volume mappings; fix ingestion tag!

* fix PR comments

* fix cypress mysql tests!
2022-09-19 09:20:54 +05:30
Pere Miquel Brull
6700f169ab
Fix #7165 - Handle SSL certificates on ometa client (#7502)
Fix #7165 - Handle SSL certificates on ometa client (#7502)
2022-09-16 09:39:27 +02:00
Sriharsha Chintalapani
656b50dd3a
Fix #7469: Refactor OpenMetadata code modules (#7474) 2022-09-14 23:14:02 -07:00
Vivek Ratnavel Subramanian
027f317725
Add port mapping for postgres container (#7354)
* Add port mapping for postgres container

* Fix DB_SCHEME
2022-09-08 17:24:47 -07:00
Akash Jain
f2fc45ea41
feat: prepare-for-next-release-0-13-0 (#7348) 2022-09-09 01:25:41 +05:30
Nahuel
7601181052
Fix docker-compose files (#7218) 2022-09-05 11:46:00 +02:00
Nahuel
ed58c27f76
Remove unused property extra_hosts from docker-compose files (#7096)
* Remove unused properties from docker-compose files

* Minor fix in run_local_docker script
2022-08-31 21:30:24 +02:00
Nahuel
235117c28c
Add missing healthcheck to docker-compose-postgres (#7080) 2022-08-31 08:40:17 +02:00
Nahuel
db41be4c4a
Fix#6929: docker-compose services should wait until OpenMetadata DB is created (#7025)
* Added the docker compose for postgres

* Added changes as per the comments on PR

* Airflow Connectivity to Postgres

* Changes are done as per the comments

* Replocate changes to local dockerfile

* Fixed Airflow Dockerfile

* docker-compose services should wait until OpenMetadata DB is created

* remove unnecesary wait for db service

* Add dependencies to airflow image

* Add missing dependencies to airflow Dockerfile

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-08-30 23:55:46 +02:00
Vj-L
8bf34fcdc1
Fix/airflow dag issue (#6759)
* Added the correct path for dags volume

* Updated the dags volume path

* Removed the library from the Dockerfile of ingestion

* Removed the libmxl2 library from Docker file

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-08-25 18:49:46 +05:30
Akash Jain
e987cb878e
feat: Prepare metadata docker cli with 0.11.5 release (#6900) 2022-08-24 16:43:14 +05:30
Vj-L
3728fa635b
Added docker-compose file for postgressql (#6695)
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-08-11 12:12:14 +05:30
Akash Jain
cac59328d0
feat: prepare metadata docker cli with 0.11.4 (#6490) 2022-08-02 00:57:09 +05:30
Vj-L
c4e88b69fa
Updated the image tag to 0.11.3 in docker compose file (#6388)
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-07-30 09:48:07 -07:00
Kirill Popov
b32b11982e
Replaced wget with nc in entrypoint to support PostgreSQL (#6403)
Co-authored-by: Kirill Popov <kirill.popov@sbermarket.ru>
2022-07-30 09:42:01 -07:00
Akash Jain
fa5105191b
Fix/issue-5883 (#5958) 2022-07-12 19:55:38 +05:30
Vj-L
011651f078
"Updated the tags with latest tag" (#5962)
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-07-08 16:43:39 +05:30
Vivek Ratnavel Subramanian
da93e7c925
Fix Authentication Public Keys env variable in docker compose (#5948) 2022-07-07 12:19:16 -07:00
Sriharsha Chintalapani
7e14dfa0d0
Update docker-compose.yml
Add 0.11.0 as image tag
2022-07-04 09:58:07 -07:00
mohitdeuex
be18feb928
[Backend] Websocket implementation added (#5440)
* [Backend] Websocket implementation added

* [Backend] Websocket implementation added [google formatter fix]

* [backend] Updated Reiew Comments

* [backend] Updated CheckStyle
2022-06-15 10:14:47 +05:30
Akash Jain
a9167cdcf9
feat: Bump Docker Images to Release 0.10.2 (#5276) 2022-06-03 15:29:35 +05:30
Vivek Ratnavel Subramanian
059acfc529
Backend: Enforce principal domain in the JWT filter (#5155) 2022-06-01 10:07:12 -07:00
Sriharsha Chintalapani
cf3d4314dd
Fix #1607 Operational metrics for OpenMetadata system observability (#4386)
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2022-05-27 15:39:13 +05:30
Sriharsha Chintalapani
2e9774dfe0
Update docker-compose.yml (#5023)
Update to latest release version
2022-05-18 08:32:57 -07:00
Vj-L
2c7a327c6b
Issue #3094 (#4500)
* Added the named volumes for improvement

* Mapped the named volumes

* Updated the Named Volumes

* Updated the Volumes on top level

* Added the named volumes
2022-05-03 14:19:31 +05:30
Akash Jain
0f63a4063e
Enable custom oidc provider name env override. (#4642) 2022-05-02 22:38:11 -07:00
Ayush Shah
9cb9792b7e
Fix Docker and revert openmetadata-start.sh changes (#4518)
* Fix Docker and revert openmetadata-start.sh changes

* Fix Docker - added error handling

* Fix Docker - added error handling

* Added time.sleep

* Resolve Code smell
2022-04-27 14:20:09 +05:30
Akash Jain
55e1be9ca4
feat: Prepare 0.11.0-snapshot version changes (#4505)
* updated version to 0.11.0-SNAPSHOT

* updated version to 0.11.0.dev* for ingestion

* docker version updates for metadata docker cli

* OM Server Env Variables from #4197 #4261 #4473
2022-04-27 00:41:17 +05:30
Ayush Shah
777e9e8097
Update docker-compose.yml (#4370) 2022-04-22 21:21:56 +05:30
Ayush Shah
c863fd9d90
Modified snowflake, utils (#4364) 2022-04-22 16:43:11 +05:30