2021-08-01 14:27:44 -07:00

1.1 KiB

description
This guide will help you to ingest sample data

Ingest Sample Data

Sample Data

{% hint style="info" %} Prerequisites

OpenMetadata is built using Java, DropWizard, Jetty, and MySQL.

  1. Python 3.7 or above

  2. Create and activate python env

    python3 -m venv env
    source env/bin/activate
    

{% endhint %}

Build from source or PyPI

{% tabs %} {% tab title="Build from source " %}

# checkout OpenMetadata
git clone https://github.com/StreamlineData/catalog
cd catalog/ingestion

{% endtab %}

{% tab title="Install Using PyPI" %}

{% endtab %} {% endtabs %}

Ingest sample tables and users

pip install '.[sample-tables]'
metadata ingest -c ./pipelines/sample_tables.json
metadata ingest -c ./pipelines/sample_users.json

Index Sample Data into ElasticSearch

Start Elastic Search Docker:

docker run -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" docker.elastic.co/elasticsearch/elasticsearch:7.10.2

Index sample data in ElasticSearch:

pip install '.[elasticsearch]'
metadata ingest -c ./pipelines/metadata_to_es.json