2023-07-14 14:12:27 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								---
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								title: Dagster
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								slug: /connectors/pipeline/dagster
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								---
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								# Dagster
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								In this section, we provide guides and references to use the Dagster connector.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								Configure and schedule Dagster metadata and profiler workflows from the OpenMetadata UI:
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								-  [Dagster ](#dagster ) 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  -  [Requirements ](#requirements )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								    -  [Dagster Versions ](#dagster-versions )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  -  [Metadata Ingestion ](#metadata-ingestion )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								      -  [Service Name ](#service-name )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								      -  [Connection Options ](#connection-options )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								      -  [Metadata Ingestion Options ](#metadata-ingestion-options )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  -  [Troubleshooting ](#troubleshooting )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								    -  [Workflow Deployment Error ](#workflow-deployment-error )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2023-09-12 12:22:40 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								{% partial file="/v1.1/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/pipeline/dagster/yaml"} /%}
							 
						 
					
						
							
								
									
										
										
										
											2023-07-14 14:12:27 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								## Requirements
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								### Dagster Versions
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2023-08-20 20:08:30 -07:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								OpenMetadata is integrated with dagster up to version [1.0.13 ](https://docs.dagster.io/getting-started ) and will continue to work for future dagster versions.
							 
						 
					
						
							
								
									
										
										
										
											2023-07-14 14:12:27 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								The ingestion framework uses [dagster graphql python client ](https://docs.dagster.io/_apidocs/libraries/dagster-graphql#dagster_graphql.DagsterGraphQLClient ) to connect to the dagster instance and perform the API calls
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								## Metadata Ingestion
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								{% partial 
							 
						 
					
						
							
								
									
										
										
										
											2023-09-12 12:22:40 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								  file="/v1.1/connectors/metadata-ingestion-ui.md" 
							 
						 
					
						
							
								
									
										
										
										
											2023-07-14 14:12:27 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								  variables={
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								    connector: "Dagster", 
							 
						 
					
						
							
								
									
										
										
										
											2023-09-12 12:22:40 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								    selectServicePath: "/images/v1.1/connectors/dagster/select-service.png",
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								    addNewServicePath: "/images/v1.1/connectors/dagster/add-new-service.png",
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								    serviceConnectionPath: "/images/v1.1/connectors/dagster/service-connection.png",
							 
						 
					
						
							
								
									
										
										
										
											2023-07-14 14:12:27 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								} 
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								/%}
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								{% stepsContainer %}
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								{% extraContent parentTagName="stepsContainer" %}
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								#### Connection Details
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								-  **Host**: Host of the dagster eg.`https://localhost:300`  or `https://127.0.0.1:3000`  or `https://<yourorghere>.dagster.cloud/prod`  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								-  **Token** : Need pass token if connecting to `dagster cloud`  instance 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  -  Log in to your Dagster account.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  -  Click on the "Settings" link in the top navigation bar.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  -  Click on the "API Keys" tab.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  -  Click on the "Create a New API Key" button.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  -  Give your API key a name and click on the "Create API Key" button.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  -  Copy the generated API key to your clipboard and paste it in the field.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								{% /extraContent %}
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2023-09-12 12:22:40 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								{% partial file="/v1.1/connectors/test-connection.md" /%}
							 
						 
					
						
							
								
									
										
										
										
											2023-07-14 14:12:27 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2023-09-12 12:22:40 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								{% partial file="/v1.1/connectors/pipeline/configure-ingestion.md" /%}
							 
						 
					
						
							
								
									
										
										
										
											2023-07-14 14:12:27 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2023-09-12 12:22:40 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								{% partial file="/v1.1/connectors/ingestion-schedule-and-deploy.md" /%}
							 
						 
					
						
							
								
									
										
										
										
											2023-07-14 14:12:27 +02:00 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								{% /stepsContainer %}
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2023-09-12 12:22:40 +02:00 
										
									 
								 
							 
							
								
									
										 
								
							 
							
								 
							
							
								{% partial file="/v1.1/connectors/troubleshooting.md" /%}