diff --git a/openmetadata-docs-v1/images/v1.1.0/connectors/spline/add-new-service.png b/openmetadata-docs-v1/images/v1.1.0/connectors/spline/add-new-service.png deleted file mode 100644 index 27c5b62ddfd..00000000000 Binary files a/openmetadata-docs-v1/images/v1.1.0/connectors/spline/add-new-service.png and /dev/null differ diff --git a/openmetadata-docs-v1/images/v1.1.0/connectors/spline/select-service.png b/openmetadata-docs-v1/images/v1.1.0/connectors/spline/select-service.png deleted file mode 100644 index f8808045c6d..00000000000 Binary files a/openmetadata-docs-v1/images/v1.1.0/connectors/spline/select-service.png and /dev/null differ diff --git a/openmetadata-docs-v1/images/v1.1.0/connectors/spline/service-connection.png b/openmetadata-docs-v1/images/v1.1.0/connectors/spline/service-connection.png deleted file mode 100644 index df33e969bee..00000000000 Binary files a/openmetadata-docs-v1/images/v1.1.0/connectors/spline/service-connection.png and /dev/null differ diff --git a/openmetadata-docs/content/v1.1.0-snapshot/connectors/index.md b/openmetadata-docs/content/v1.1.0-snapshot/connectors/index.md index 75f286da6b2..a48eada4d0e 100644 --- a/openmetadata-docs/content/v1.1.0-snapshot/connectors/index.md +++ b/openmetadata-docs/content/v1.1.0-snapshot/connectors/index.md @@ -64,6 +64,7 @@ OpenMetadata can extract metadata from the following list of 55 connectors: - [Glue](/connectors/pipeline/glue-pipeline) - [Domo Pipeline](/connectors/pipeline/domo-pipeline) - [NiFi](/connectors/pipeline/nifi) +- [Spline](/connectors/pipeline/spline) ## ML Model Services diff --git a/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/index.md b/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/index.md index 15dc9d1ac8a..bc9042009e9 100644 --- a/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/index.md +++ b/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/index.md @@ -15,6 +15,7 @@ This is the supported list of connectors for Pipeline Services: - [Domo Pipeline](/connectors/pipeline/domo-pipeline) - [Databricks Pipeline](/connectors/pipeline/databricks-pipeline) - [NiFi](/connectors/pipeline/nifi) +- [Spline](/connectors/pipeline/spline) If you have a request for a new connector, don't hesitate to reach out in [Slack](https://slack.open-metadata.org/) or open a [feature request](https://github.com/open-metadata/OpenMetadata/issues/new/choose) in our GitHub repo. diff --git a/openmetadata-docs-v1/content/v1.1.0/connectors/pipeline/spline/airflow.md b/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/spline/airflow.md similarity index 93% rename from openmetadata-docs-v1/content/v1.1.0/connectors/pipeline/spline/airflow.md rename to openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/spline/airflow.md index 5a76065757c..29b43e5fd8e 100644 --- a/openmetadata-docs-v1/content/v1.1.0/connectors/pipeline/spline/airflow.md +++ b/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/spline/airflow.md @@ -21,6 +21,17 @@ To deploy OpenMetadata, check the Deployment guides. To run the Ingestion via the UI you'll need to use the OpenMetadata Ingestion Container, which comes shipped with custom Airflow plugins to handle the workflow deployment. +The Spline connector support lineage of data source of type `jdbc` or `dbfs` i.e. The spline connector would be able to extract lineage if the data source is either a jdbc connection or the data source is databricks instance. + +{% note %} + +Currently we do not support data source of type aws s3 or any other cloud storage, which also means that the lineage for external tables from databricks will not be extracted. + +{% /note %} + +You can refer [this](https://github.com/AbsaOSS/spline-getting-started/tree/main/spline-on-databricks) documentation on how to configure databricks with spline. + + ### Python Requirements To run the Spline ingestion, you will need to install: diff --git a/openmetadata-docs-v1/content/v1.1.0/connectors/pipeline/spline/cli.md b/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/spline/cli.md similarity index 90% rename from openmetadata-docs-v1/content/v1.1.0/connectors/pipeline/spline/cli.md rename to openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/spline/cli.md index c2a2f2d414f..02a0c017e63 100644 --- a/openmetadata-docs-v1/content/v1.1.0/connectors/pipeline/spline/cli.md +++ b/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/spline/cli.md @@ -21,6 +21,17 @@ To deploy OpenMetadata, check the Deployment guides. To run the Ingestion via the UI you'll need to use the OpenMetadata Ingestion Container, which comes shipped with custom Airflow plugins to handle the workflow deployment. +The Spline connector support lineage of data source of type `jdbc` or `dbfs` i.e. The spline connector would be able to extract lineage if the data source is either a jdbc connection or the data source is databricks instance. + +{% note %} + +Currently we do not support data source of type aws s3 or any other cloud storage, which also means that the lineage for external tables from databricks will not be extracted. + +{% /note %} + +You can refer [this](https://github.com/AbsaOSS/spline-getting-started/tree/main/spline-on-databricks) documentation on how to configure databricks with spline. + + ### Python Requirements To run the Spline ingestion, you will need to install: diff --git a/openmetadata-docs-v1/content/v1.1.0/connectors/pipeline/spline/index.md b/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/spline/index.md similarity index 93% rename from openmetadata-docs-v1/content/v1.1.0/connectors/pipeline/spline/index.md rename to openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/spline/index.md index 0cc048a227c..1b921bf1b80 100644 --- a/openmetadata-docs-v1/content/v1.1.0/connectors/pipeline/spline/index.md +++ b/openmetadata-docs/content/v1.1.0-snapshot/connectors/pipeline/spline/index.md @@ -38,6 +38,17 @@ To deploy OpenMetadata, check the Deployment guides. To run the Ingestion via the UI you'll need to use the OpenMetadata Ingestion Container, which comes shipped with custom Airflow plugins to handle the workflow deployment. +The Spline connector support lineage of data source of type `jdbc` or `dbfs` i.e. The spline connector would be able to extract lineage if the data source is either a jdbc connection or the data source is databricks instance. + +{% note %} + +Currently we do not support data source of type aws s3 or any other cloud storage, which also means that the lineage for external tables from databricks will not be extracted. + +{% /note %} + +You can refer [this](https://github.com/AbsaOSS/spline-getting-started/tree/main/spline-on-databricks) documentation on how to configure databricks with spline. + + ## Metadata Ingestion {% stepsContainer %} diff --git a/openmetadata-docs/content/v1.1.0-snapshot/menu.md b/openmetadata-docs/content/v1.1.0-snapshot/menu.md index 73dca0e6e35..2470b01b90a 100644 --- a/openmetadata-docs/content/v1.1.0-snapshot/menu.md +++ b/openmetadata-docs/content/v1.1.0-snapshot/menu.md @@ -525,6 +525,12 @@ site_menu: url: /connectors/pipeline/domo-pipeline/airflow - category: Connectors / Pipeline / Domo Pipeline / CLI url: /connectors/pipeline/domo-pipeline/cli + - category: Connectors / Pipeline / Spline + url: /connectors/pipeline/spline + - category: Connectors / Pipeline / Spline / Airflow + url: /connectors/pipeline/spline/airflow + - category: Connectors / Pipeline / Spline / CLI + url: /connectors/pipeline/spline/cli - category: Connectors / ML Model url: /connectors/ml-model diff --git a/openmetadata-docs/images/v1.1.0/connectors/spline/add-new-service.png b/openmetadata-docs/images/v1.1.0/connectors/spline/add-new-service.png new file mode 100644 index 00000000000..7c4915ff39e Binary files /dev/null and b/openmetadata-docs/images/v1.1.0/connectors/spline/add-new-service.png differ diff --git a/openmetadata-docs/images/v1.1.0/connectors/spline/select-service.png b/openmetadata-docs/images/v1.1.0/connectors/spline/select-service.png new file mode 100644 index 00000000000..07738309cf4 Binary files /dev/null and b/openmetadata-docs/images/v1.1.0/connectors/spline/select-service.png differ diff --git a/openmetadata-docs/images/v1.1.0/connectors/spline/service-connection.png b/openmetadata-docs/images/v1.1.0/connectors/spline/service-connection.png new file mode 100644 index 00000000000..dabcb2cbd57 Binary files /dev/null and b/openmetadata-docs/images/v1.1.0/connectors/spline/service-connection.png differ