
* DOCS - Prepare 1.7 Release and 1.8 SNAPSHOT * DOCS - Prepare 1.7 Release and 1.8 SNAPSHOT
3.5 KiB
title | slug |
---|---|
Run the SAS Connector Externally | /connectors/database/sas/yaml |
{% connectorDetailsHeader name="SAS" stage="BETA" platform="OpenMetadata" availableFeatures=["Metadata"] unavailableFeatures=["Query Usage", "Data Profiler", "Data Quality", "Lineage", "Column-level Lineage", "dbt", "Stored Procedures", "Owners", "Tags", "Sample Data"] / %}
In this section, we provide guides and references to use the SAS connector.
Configure and schedule SAS metadata workflows from the OpenMetadata UI:
{% partial file="/v1.8/connectors/external-ingestion-deployment.md" /%}
Requirements
{%inlineCallout icon="description" bold="OpenMetadata 1.3.0 or later" href="/deployment"%} To deploy OpenMetadata, check the Deployment guides. {%/inlineCallout%}
Python Requirements
{% partial file="/v1.8/connectors/python-requirements.md" /%}
To run the SAS ingestion, you will need to install:
pip3 install "openmetadata-ingestion[sas]"
Metadata Ingestion
All connectors are defined as JSON Schemas. Here you can find the structure to create a connection to SAS.
In order to create and run a Metadata Ingestion workflow, we will follow the steps to create a YAML configuration able to connect to the source, process the Entities if needed, and reach the OpenMetadata server.
The workflow is modeled around the following JSON Schema
1. Define the YAML Config
{% codePreview %}
{% codeInfoContainer %}
Source Configuration - Service Connection
{% codeInfo srNumber=12 %}
serverHost: Host and port of the SAS Viya deployment.
{% /codeInfo %}
{% codeInfo srNumber=13 %}
username: Username to connect to SAS Viya. This user should have privileges to read all the metadata in SAS Information Catalog.
{% /codeInfo %}
{% codeInfo srNumber=14 %}
password: Password to connect to SAS Viya.
{% /codeInfo %}
{% codeInfo srNumber=15 %}
filter: A filter expression specifying items for import. For more information see
{% /codeInfo %}
Sink Configuration
{% codeInfo srNumber=18 %}
To send the metadata to OpenMetadata, it needs to be specified as type: metadata-rest
.
{% /codeInfo %}
{% partial file="/v1.8/connectors/yaml/workflow-config-def.md" /%} {% /codeInfoContainer %}
{% codeBlock fileName="filename.yaml" %}
source:
type: SAS
serviceName: local_sas
serviceConnection:
config:
type: SAS
serverHost: http://localhost:10000
username: username
password: password
datatables: True
dataTablesCustomFilter: None
reports: False
reportsCustomFilter: None
dataflows: False
dataflowsCustomFilter: None
sourceConfig:
config:
type: DatabaseMetadata
sink:
type: metadata-rest
config: {}
{% partial file="/v1.8/connectors/yaml/workflow-config.md" /%}
{% /codeBlock %}
{% /codePreview %}
{% partial file="/v1.8/connectors/yaml/ingestion-cli.md" /%}