2021-08-18 19:30:55 +00:00

1.5 KiB

description
This guide will help install Simple Scheduler and schedule connectors for ingestion.

Scheduler

{% hint style="info" %} Prerequisites

OpenMetadata is built using Java, DropWizard, Jetty, and MySQL.

  1. Python 3.7 or above

  2. Create an env

    python3 -m venv env
    
  3. Activating the environment

    source env/bin/activate
    

{% endhint %}

Install dependencies

cd ingestion
python3 -m venv env
source env/bin/activate
pip install '.[scheduler]'
python ingestion_scheduler/scheduler.py

{% hint style="warning" %} Note:

Different Connectors require different dependencies, please go through Connectors Documentation install dependencies as needed. {% endhint %}

Scheduler UI

Main Page

Loads all the Json connectors inside the pipeline directory as cron jobs.

Custom run a job

  • Click on the Custom Run button under the Action column of the jobs.
  • Click on Run.
  • The Job will start running the ingestion.

After Clicking 'Custom Run' Button

Status of an executed job

  • Click on the Executions tab under Navigation Bar.

Status of the executions