yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-24 09:50:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/docs/install/metadata-ingestion/ingest-sample-data.md
parthp2107 55d7cb41bf
changed catalog to openmetadata in all the docs (#52) 
* changed catalog to openmetadata in all the docs

* changed README.md

Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
2021-08-05 19:56:33 +05:30

1.1 KiB
Raw Blame History

description
This guide will help you to ingest sample data

Ingest Sample Data

Sample Data

{% hint style="info" %} Prerequisites

OpenMetadata is built using Java, DropWizard, Jetty, and MySQL.

  1. Python 3.7 or above

  2. Create and activate python env

    python3 -m venv env
source env/bin/activate

{% endhint %}

Build from source or PyPI

{% tabs %} {% tab title="Build from source " %}

# checkout OpenMetadata
git clone https://github.com/open-metadata/OpenMetadata.git
cd OpenMetadata/ingestion

{% endtab %}

{% tab title="Install Using PyPI" %}

{% endtab %} {% endtabs %}

Ingest sample tables and users

pip install '.[sample-tables]'
metadata ingest -c ./pipelines/sample_tables.json
metadata ingest -c ./pipelines/sample_users.json

Index Sample Data into ElasticSearch

Start Elastic Search Docker:

docker run -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" docker.elastic.co/elasticsearch/elasticsearch:7.10.2

Index sample data in ElasticSearch:

pip install '.[elasticsearch]'
metadata ingest -c ./pipelines/metadata_to_es.json