34 Commits

Author SHA1 Message Date
Vivek Ratnavel Subramanian
059acfc529
Backend: Enforce principal domain in the JWT filter (#5155) 2022-06-01 10:07:12 -07:00
Sriharsha Chintalapani
cf3d4314dd
Fix #1607 Operational metrics for OpenMetadata system observability (#4386)
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2022-05-27 15:39:13 +05:30
Vj-L
2c7a327c6b
Issue #3094 (#4500)
* Added the named volumes for improvement

* Mapped the named volumes

* Updated the Named Volumes

* Updated the Volumes on top level

* Added the named volumes
2022-05-03 14:19:31 +05:30
Akash Jain
0f63a4063e
Enable custom oidc provider name env override. (#4642) 2022-05-02 22:38:11 -07:00
Akash Jain
792c67a8f1
Arguments to provide ingestion depenedency. defaults to 'all' (#4613) 2022-05-02 16:09:44 +05:30
Vivek Ratnavel Subramanian
12a4936671
Fix ingestion bot principals in docker-compose (#4507) 2022-04-26 15:33:16 -07:00
Akash Jain
0beeef3f97
pluralize list input environment varialbles (#4473) 2022-04-25 17:11:02 +05:30
Akash Jain
54162b7c6d
fix: List Configuration from Environment Variable for Authorizer and Authentication Configuration (#4305)
* ability to provide list from env in yaml config

* remove security config file as we do not maintain
2022-04-21 11:29:26 +05:30
Akash Jain
018cd0aec6
fix: Google SSO Audience default value (#4285)
* Update openmetadata.yaml

* updated audience default value
2022-04-20 15:48:13 +02:00
Akash Jain
7958e81918
server host api url env for airflow configuration (#4261) 2022-04-19 23:24:48 -07:00
Akash Jain
ff26b6d93e
fix: OpenMetadata Airflow config with SSO (#4197) 2022-04-19 10:39:50 -07:00
Ayush Shah
351db56687
Added fix for Sample_Usage not being ingested in Local docker (#3650) 2022-03-27 22:38:13 -07:00
Vivek Ratnavel Subramanian
f0927ecebb
Fix #3236: Add support for secure docker compose with an env file (#3241)
* Fix #3236: Add support for secure docker compose with an env file
2022-03-08 07:05:31 -08:00
Pere Miquel Brull
76f4ccd590
Fix #2735 - Simplify Airflow properties extraction (#2749)
* Simplify lineage properties extraction

* Add network name

* Format
2022-02-14 16:53:42 +01:00
Akash Jain
48c1ad63c4
fix: ElasticSearch and Ingestion connectivity from openmetadata post soft link (#2470)
* soft linked openmetadata.yaml

* quick fix for ingestion and elasticsearch connect from server
2022-01-27 13:55:54 +05:30
Pere Miquel Brull
94ecb1e030
Map ports to localhost (#2078) 2022-01-06 14:32:31 +01:00
Akash Jain
0bbb283e70
fix: update base image to alpine linux and refactor dockerflie instructions (#2050)
* +alpine img and refactor dockerflie instructions

* local-metadata server image with alpine linux

* correcting rm openmetadata-*.tar.gz

* fix COPY destination folder ref
2022-01-05 10:11:24 -08:00
Pere Miquel Brull
2ec32017bb
[issue-1698] - Airflow DockerOperator setup (#1730)
* Fix typo

* Clean setup

* Update ingestion local image to be barebone on connector dependencies

* Prepare ingestion connectors base image

* Add system dependencies

* Prepare docker CLI

* Add docker provider

* Prepare entrypoint for the image

* Remove DBT pipeline as per Issue 1658

* Add TODO for ingestion build

* Bind docker socket

* Update comment

* Update README

* Use DockerOperator in sample data

* Build images with latest tag

* Prepare symlink to pass the volume to the DockerOperator

* Update README

* Prepare Base image for CI

* COPY multiple files into dir

* COPY multiple files into dir

* Remove DBT source as is now part of table ingestion

* Build docker base in run_local_docker
2021-12-18 16:41:38 +01:00
Akash Jain
d0d3fce332
fix: add container_name to docker-compose (#1639)
* adding container_name

* fixed typo --run to --start

* updated container_name prefixing openmetadata_

* updated container_name to prefix openmetadata_
2021-12-10 08:01:08 -08:00
Ayush Shah
777afd1d3f
Openmetadata.yaml for docker updated (#1606)
* Dockerfiles changed - updated elasticsearch, openmetadata.yaml

* Added blue color to docker info
2021-12-07 11:27:16 -08:00
parthp2107
a9e70e6a89
License header update (#1498)
* updated liscense header

* updated license header

* updated license header

* updated license header

* addressing stylecheck findings
2021-12-01 12:46:28 +05:30
Ayush Shah
267a3d7aa2 Removed Platform from docker-compose.yml files, emulation fix 2021-11-26 18:10:27 +01:00
Akash Jain
74a10382a2
Fix: Docker Image to use new Dist Location while running locally (#1381)
* fix path for dist folder

* updated docs wrt new dist folder
2021-11-25 12:33:20 +05:30
Ayush Shah
2111f6c938
Docker Commands Modified (#1199)
* Docker ingestion modified

* Command line commands updated
2021-11-16 00:25:40 -08:00
Akash Jain
58cf1b012f
feat: Docker Image Push Workflow (#1191)
* copy command use path from root folder

* Add workflows for docker release to github
2021-11-15 09:36:57 -08:00
Akash Jain
b2d1d0ca34
fix:Airflow configurations to match docker-compose (#1157)
Airflow configurations to match docker-compose yaml values
2021-11-11 19:23:24 +05:30
Ayush Shah
dd7bb5a79f
airflow config added to openmetadata conf file (#1155) 2021-11-11 18:31:53 +05:30
Ayush Shah
c95f1542eb
Docker fix (#1101)
* Docker Fix, User Ingestion Fix

* Docker file optimized

* ES docker version rolledback

* Healthcheck removed - incompatible with 3.9

* Docker & Airflow Config files updated with - resolved comments

* Openmetadata managed Airflow apis support added

* Dockerfile updated

* Docker file Updated with release package

* Elasticsearch allocated memory increased
2021-11-10 21:22:32 -08:00
Akash Jain
06b2f70e3e
kubernetes docker image compatibility for #1026 (#1042) 2021-11-03 08:18:52 -07:00
Ayush Shah
93921814af
Docker fix - latest release changes (#983)
* Docker fix - Architecture, MySQL

* Docker Airflow API Dagrun support

* Docker latest changes modified
2021-10-30 09:05:30 -07:00
Ayush Shah
759574a8de
Ingestion Optimization - Sample Users, Dockerfiles, Removal of Pandas (#935)
* Sample Profile Data for Sample Tables (#815)

* Sample Profile Data for Sample Tables

* Disabling Profile as Default

* Added Sample Profile Data to 3 additional sample tables

* Sample Tables fixed (#850)

* Pydantic fix, Docker update (#860)

* Setup.py Modified with openmetadata-airflow package, docker update

* Setup.py Modified

* Update setup.py

* Removed Pandas from Sample Data

* Sample Users added under sample data

* Sample User Standalone pipelines and modules removed

* Docker release package updated

* Dockerfile updated, removed redundant files

* Setup.py removed from ingestion src directory

* User Resource failing check resolved

* Modifying Usage Columns Datatype
2021-10-26 09:14:24 -07:00
vijaypm
b8863648d6
Issue 898 (#905)
* ISSUE-898: additional information in the prerequisities for building and running code

* ISSUE-898: removed unreachable old doc

* ISSUE-898: added new docker compose to expose MySQL and ES ports to host machines

* ISSUE-898: changed jdbc connect url to allow Public Key Retrieval

* ISSUE-898: fixed log name to openmetadata.log

Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
2021-10-22 19:35:12 -07:00
Ayush Shah
85b6b72848
Airflow docker (#762)
* Airflow Docker implementation - Ingestion

* Dockerfiles modified
2021-10-14 07:46:24 -07:00
Ayush Shah
319f7a795c
Docker local (#723)
* added docker file for local build and ingestion

* Docker Modified for local setup

* Ingestion script optimized

* Added script to directly run Local Docker

Co-authored-by: Parth Panchal <parthpanchal@Parths-MacBook-Air.local>
2021-10-09 10:58:33 -07:00