yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-08 17:50:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/openmetadata-docs/content/v1.8.x-SNAPSHOT/connectors/pipeline/dagster/index.md
Rounak Dhillon f696227ead
Doc: SEO Title Updation (#21842) 
* Doc: SEO Title Updation

* Doc: Data Discovery Gif Updation

* Doc: SEO title updation

* Doc: SEO Title Updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
2025-06-20 07:16:38 -07:00

2.6 KiB
Raw Permalink Blame History

title slug
Dagster Connector | OpenMetadata Pipeline Integration /connectors/pipeline/dagster

{% connectorDetailsHeader name="Dagster" stage="PROD" platform="OpenMetadata" availableFeatures=["Pipelines", "Pipeline Status", "Tags", "Usage"] unavailableFeatures=["Owners", "Lineage"] / %}

In this section, we provide guides and references to use the Dagster connector.

Configure and schedule Dagster metadata and profiler workflows from the OpenMetadata UI:

{% partial file="/v1.8/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/dagster/yaml"} /%}

Requirements

Dagster Versions

OpenMetadata is integrated with dagster up to version 1.0.13 and will continue to work for future dagster versions.

The ingestion framework uses dagster graphql python client to connect to the dagster instance and perform the API calls

Metadata Ingestion

{% partial file="/v1.8/connectors/metadata-ingestion-ui.md" variables={ connector: "Dagster", selectServicePath: "/images/v1.8/connectors/dagster/select-service.png", addNewServicePath: "/images/v1.8/connectors/dagster/add-new-service.png", serviceConnectionPath: "/images/v1.8/connectors/dagster/service-connection.png", } /%}

{% stepsContainer %} {% extraContent parentTagName="stepsContainer" %}

Connection Details

  • Host: Host of the dagster eg.https://localhost:300 or https://127.0.0.1:3000 or https://<yourorghere>.dagster.cloud/prod
  • Token : Need pass token if connecting to dagster cloud instance
    • Log in to your Dagster account.
    • Click on the "Settings" link in the top navigation bar.
    • Click on the "API Keys" tab.
    • Click on the "Create a New API Key" button.
    • Give your API key a name and click on the "Create API Key" button.
    • Copy the generated API key to your clipboard and paste it in the field.

{% /extraContent %}

{% partial file="/v1.8/connectors/test-connection.md" /%}

{% partial file="/v1.8/connectors/pipeline/configure-ingestion.md" /%}

{% partial file="/v1.8/connectors/ingestion-schedule-and-deploy.md" /%}

{% /stepsContainer %}