25 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
cf3d4314dd
Fix #1607 Operational metrics for OpenMetadata system observability (#4386)
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2022-05-27 15:39:13 +05:30
Vj-L
2c7a327c6b
Issue #3094 (#4500)
* Added the named volumes for improvement

* Mapped the named volumes

* Updated the Named Volumes

* Updated the Volumes on top level

* Added the named volumes
2022-05-03 14:19:31 +05:30
Akash Jain
0f63a4063e
Enable custom oidc provider name env override. (#4642) 2022-05-02 22:38:11 -07:00
Akash Jain
792c67a8f1
Arguments to provide ingestion depenedency. defaults to 'all' (#4613) 2022-05-02 16:09:44 +05:30
Vivek Ratnavel Subramanian
12a4936671
Fix ingestion bot principals in docker-compose (#4507) 2022-04-26 15:33:16 -07:00
Akash Jain
0beeef3f97
pluralize list input environment varialbles (#4473) 2022-04-25 17:11:02 +05:30
Akash Jain
54162b7c6d
fix: List Configuration from Environment Variable for Authorizer and Authentication Configuration (#4305)
* ability to provide list from env in yaml config

* remove security config file as we do not maintain
2022-04-21 11:29:26 +05:30
Akash Jain
018cd0aec6
fix: Google SSO Audience default value (#4285)
* Update openmetadata.yaml

* updated audience default value
2022-04-20 15:48:13 +02:00
Akash Jain
7958e81918
server host api url env for airflow configuration (#4261) 2022-04-19 23:24:48 -07:00
Akash Jain
ff26b6d93e
fix: OpenMetadata Airflow config with SSO (#4197) 2022-04-19 10:39:50 -07:00
Ayush Shah
351db56687
Added fix for Sample_Usage not being ingested in Local docker (#3650) 2022-03-27 22:38:13 -07:00
Vivek Ratnavel Subramanian
f0927ecebb
Fix #3236: Add support for secure docker compose with an env file (#3241)
* Fix #3236: Add support for secure docker compose with an env file
2022-03-08 07:05:31 -08:00
Pere Miquel Brull
76f4ccd590
Fix #2735 - Simplify Airflow properties extraction (#2749)
* Simplify lineage properties extraction

* Add network name

* Format
2022-02-14 16:53:42 +01:00
Akash Jain
48c1ad63c4
fix: ElasticSearch and Ingestion connectivity from openmetadata post soft link (#2470)
* soft linked openmetadata.yaml

* quick fix for ingestion and elasticsearch connect from server
2022-01-27 13:55:54 +05:30
Pere Miquel Brull
94ecb1e030
Map ports to localhost (#2078) 2022-01-06 14:32:31 +01:00
Pere Miquel Brull
2ec32017bb
[issue-1698] - Airflow DockerOperator setup (#1730)
* Fix typo

* Clean setup

* Update ingestion local image to be barebone on connector dependencies

* Prepare ingestion connectors base image

* Add system dependencies

* Prepare docker CLI

* Add docker provider

* Prepare entrypoint for the image

* Remove DBT pipeline as per Issue 1658

* Add TODO for ingestion build

* Bind docker socket

* Update comment

* Update README

* Use DockerOperator in sample data

* Build images with latest tag

* Prepare symlink to pass the volume to the DockerOperator

* Update README

* Prepare Base image for CI

* COPY multiple files into dir

* COPY multiple files into dir

* Remove DBT source as is now part of table ingestion

* Build docker base in run_local_docker
2021-12-18 16:41:38 +01:00
Akash Jain
d0d3fce332
fix: add container_name to docker-compose (#1639)
* adding container_name

* fixed typo --run to --start

* updated container_name prefixing openmetadata_

* updated container_name to prefix openmetadata_
2021-12-10 08:01:08 -08:00
parthp2107
a9e70e6a89
License header update (#1498)
* updated liscense header

* updated license header

* updated license header

* updated license header

* addressing stylecheck findings
2021-12-01 12:46:28 +05:30
Ayush Shah
2111f6c938
Docker Commands Modified (#1199)
* Docker ingestion modified

* Command line commands updated
2021-11-16 00:25:40 -08:00
Ayush Shah
c95f1542eb
Docker fix (#1101)
* Docker Fix, User Ingestion Fix

* Docker file optimized

* ES docker version rolledback

* Healthcheck removed - incompatible with 3.9

* Docker & Airflow Config files updated with - resolved comments

* Openmetadata managed Airflow apis support added

* Dockerfile updated

* Docker file Updated with release package

* Elasticsearch allocated memory increased
2021-11-10 21:22:32 -08:00
Akash Jain
06b2f70e3e
kubernetes docker image compatibility for #1026 (#1042) 2021-11-03 08:18:52 -07:00
Ayush Shah
93921814af
Docker fix - latest release changes (#983)
* Docker fix - Architecture, MySQL

* Docker Airflow API Dagrun support

* Docker latest changes modified
2021-10-30 09:05:30 -07:00
Ayush Shah
759574a8de
Ingestion Optimization - Sample Users, Dockerfiles, Removal of Pandas (#935)
* Sample Profile Data for Sample Tables (#815)

* Sample Profile Data for Sample Tables

* Disabling Profile as Default

* Added Sample Profile Data to 3 additional sample tables

* Sample Tables fixed (#850)

* Pydantic fix, Docker update (#860)

* Setup.py Modified with openmetadata-airflow package, docker update

* Setup.py Modified

* Update setup.py

* Removed Pandas from Sample Data

* Sample Users added under sample data

* Sample User Standalone pipelines and modules removed

* Docker release package updated

* Dockerfile updated, removed redundant files

* Setup.py removed from ingestion src directory

* User Resource failing check resolved

* Modifying Usage Columns Datatype
2021-10-26 09:14:24 -07:00
Ayush Shah
85b6b72848
Airflow docker (#762)
* Airflow Docker implementation - Ingestion

* Dockerfiles modified
2021-10-14 07:46:24 -07:00
Ayush Shah
319f7a795c
Docker local (#723)
* added docker file for local build and ingestion

* Docker Modified for local setup

* Ingestion script optimized

* Added script to directly run Local Docker

Co-authored-by: Parth Panchal <parthpanchal@Parths-MacBook-Air.local>
2021-10-09 10:58:33 -07:00