From aa5dea4a86c7e28ec14cc08cb0d30c1be28a92ae Mon Sep 17 00:00:00 2001 From: Shilpa V Date: Mon, 14 Mar 2022 16:13:06 +0000 Subject: [PATCH] GitBook: [#93] New Changes --- docs/README.md | 38 +++++++++---------- docs/SUMMARY.md | 6 +-- docs/integrations/connectors/README.md | 10 +++-- .../{ => bigquery}/bigquery-usage.md | 6 +-- .../{ => redshift}/redshift-usage.md | 6 +-- .../{ => snowflake}/snowflake-usage.md | 6 +-- 6 files changed, 38 insertions(+), 34 deletions(-) rename docs/integrations/connectors/{ => bigquery}/bigquery-usage.md (99%) rename docs/integrations/connectors/{ => redshift}/redshift-usage.md (99%) rename docs/integrations/connectors/{ => snowflake}/snowflake-usage.md (99%) diff --git a/docs/README.md b/docs/README.md index 3cdd696c6c2..21aad865618 100644 --- a/docs/README.md +++ b/docs/README.md @@ -10,25 +10,25 @@ OpenMetadata enables metadata management end-to-end, giving you the ability to u OpenMetadata provides connectors that enable you to perform metadata ingestion from a number of common database, dashboard, messaging, and pipeline services. With each release, we add additional connectors and the ingestion framework provides a structured and straightforward method for creating your own connectors. See the table below for a list of supported connectors. -| A-H | I-M | N-R | S-Z | -| ---------------------------------------------------------------------------------------------- | ----------------------------------------------- | ----------------------------------------------------------- | ------------------------------------------------------------- | -| [Airflow](integrations/connectors/airflow/airflow.md) | [IBM Db2](integrations/connectors/ibm-db2.md) | [Oracle](integrations/connectors/oracle.md) | [Salesforce](integrations/connectors/salesforce.md) | -| Amundsen | [Kafka](integrations/connectors/kafka.md) | [Postgres](integrations/connectors/postgres/) | [SingleStore](integrations/connectors/singlestore.md) | -| Apache Atlas | LDAP | Power BI | [Snowflake](integrations/connectors/snowflake/) | -| Apache Druid | [Looker](integrations/connectors/looker.md) | Prefect | [Snowflake Usage](integrations/connectors/snowflake-usage.md) | -| [Athena](integrations/connectors/athena.md) | [MariaDB](integrations/connectors/mariadb.md) | [Presto](integrations/connectors/presto.md) | [Superset](integrations/connectors/superset.md) | -| [Azure SQL](integrations/connectors/azure-sql.md) | [Metabase](integrations/connectors/metabase.md) | [Redash](integrations/connectors/redash.md) | [Tableau](integrations/connectors/tableau.md) | -| [BigQuery](integrations/connectors/bigquery/) | [MLflow](integrations/connectors/mlflow/) | [Redshift](integrations/connectors/redshift/) | [Trino](integrations/connectors/trino.md) | -| [BigQuery Usage](integrations/connectors/bigquery-usage.md) | [MSSQL](integrations/connectors/mssql/) | [Redshift Usage](integrations/connectors/redshift-usage.md) | [Vertica](integrations/connectors/vertica.md) | -| ClickHouse | MSSQL Usage | | | -| ClickHouse Usage | [MySQL](integrations/connectors/mysql/mysql.md) | | | -| [Databricks](integrations/connectors/databricks.md) | | | | -| [DBT](https://github.com/open-metadata/OpenMetadata/blob/main/docs/broken-reference/README.md) | | | | -| [Delta Lake](integrations/connectors/delta-lake.md) | | | | -| [DynamoDB](integrations/connectors/dynamodb.md) | | | | -| [Elasticsearch](integrations/connectors/elastic-search.md) | | | | -| [Glue Catalog](integrations/connectors/glue-catalog/) | | | | -| [Hive](integrations/connectors/hive.md) | | | | +| A-H | I-M | N-R | S-Z | +| ---------------------------------------------------------------------------------------------- | ----------------------------------------------- | -------------------------------------------------------------------- | ----------------------------------------------------------------------- | +| [Airflow](integrations/connectors/airflow/airflow.md) | [IBM Db2](integrations/connectors/ibm-db2.md) | [Oracle](integrations/connectors/oracle.md) | [Salesforce](integrations/connectors/salesforce.md) | +| Amundsen | [Kafka](integrations/connectors/kafka.md) | [Postgres](integrations/connectors/postgres/) | [SingleStore](integrations/connectors/singlestore.md) | +| Apache Atlas | LDAP | Power BI | [Snowflake](integrations/connectors/snowflake/) | +| Apache Druid | [Looker](integrations/connectors/looker.md) | Prefect | [Snowflake Usage](integrations/connectors/snowflake/snowflake-usage.md) | +| [Athena](integrations/connectors/athena.md) | [MariaDB](integrations/connectors/mariadb.md) | [Presto](integrations/connectors/presto.md) | [Superset](integrations/connectors/superset.md) | +| [Azure SQL](integrations/connectors/azure-sql.md) | [Metabase](integrations/connectors/metabase.md) | [Redash](integrations/connectors/redash.md) | [Tableau](integrations/connectors/tableau.md) | +| [BigQuery](integrations/connectors/bigquery/) | [MLflow](integrations/connectors/mlflow/) | [Redshift](integrations/connectors/redshift/) | [Trino](integrations/connectors/trino.md) | +| [BigQuery Usage](integrations/connectors/bigquery/bigquery-usage.md) | [MSSQL](integrations/connectors/mssql/) | [Redshift Usage](integrations/connectors/redshift/redshift-usage.md) | [Vertica](integrations/connectors/vertica.md) | +| ClickHouse | MSSQL Usage | | | +| ClickHouse Usage | [MySQL](integrations/connectors/mysql/mysql.md) | | | +| [Databricks](integrations/connectors/databricks.md) | | | | +| [DBT](https://github.com/open-metadata/OpenMetadata/blob/main/docs/broken-reference/README.md) | | | | +| [Delta Lake](integrations/connectors/delta-lake.md) | | | | +| [DynamoDB](integrations/connectors/dynamodb.md) | | | | +| [Elasticsearch](integrations/connectors/elastic-search.md) | | | | +| [Glue Catalog](integrations/connectors/glue-catalog/) | | | | +| [Hive](integrations/connectors/hive.md) | | | | ## OpenMetadata Components diff --git a/docs/SUMMARY.md b/docs/SUMMARY.md index 1a3587c9b6d..d534f0fea2d 100644 --- a/docs/SUMMARY.md +++ b/docs/SUMMARY.md @@ -20,7 +20,7 @@ * [Azure SQL](integrations/connectors/azure-sql.md) * [BigQuery](integrations/connectors/bigquery/README.md) * [BigQuery Metadata Extraction](integrations/connectors/bigquery/bigquery-metadata-extraction.md) - * [BigQuery Usage](integrations/connectors/bigquery-usage.md) + * [BigQuery Usage](integrations/connectors/bigquery/bigquery-usage.md) * [Databricks](integrations/connectors/databricks.md) * [Delta Lake](integrations/connectors/delta-lake.md) * [DynamoDB](integrations/connectors/dynamodb.md) @@ -46,12 +46,12 @@ * [Redash](integrations/connectors/redash.md) * [Redshift](integrations/connectors/redshift/README.md) * [Redshift Metadata Extraction](integrations/connectors/redshift/redshift-metadata-extraction.md) - * [Redshift Usage](integrations/connectors/redshift-usage.md) + * [Redshift Usage](integrations/connectors/redshift/redshift-usage.md) * [Salesforce](integrations/connectors/salesforce.md) * [SingleStore](integrations/connectors/singlestore.md) * [Snowflake](integrations/connectors/snowflake/README.md) * [Snowflake Metadata Extraction](integrations/connectors/snowflake/snowflake-metadata-extraction.md) - * [Snowflake Usage](integrations/connectors/snowflake-usage.md) + * [Snowflake Usage](integrations/connectors/snowflake/snowflake-usage.md) * [Superset](integrations/connectors/superset.md) * [Tableau](integrations/connectors/tableau.md) * [Trino](integrations/connectors/trino.md) diff --git a/docs/integrations/connectors/README.md b/docs/integrations/connectors/README.md index 4197ddeccab..362ab022122 100644 --- a/docs/integrations/connectors/README.md +++ b/docs/integrations/connectors/README.md @@ -4,10 +4,13 @@ OpenMetadata supports connectors to some popular services. We will continue as a #### Database Services +* Apache Druid * [Athena](athena.md) * [Azure SQL](azure-sql.md) * [BigQuery](bigquery/) -* [BigQuery Usage](bigquery-usage.md) +* [BigQuery Usage](bigquery/bigquery-usage.md) +* ClickHouse +* ClickHouse Usage * [Databricks](databricks.md) * [Delta Lake](delta-lake.md) * [DynamoDB](dynamodb.md) @@ -22,11 +25,11 @@ OpenMetadata supports connectors to some popular services. We will continue as a * [Postgres](postgres/) * [Presto](presto.md) * [Redshift](redshift/) -* [Redshift Usage](redshift-usage.md) +* [Redshift Usage](redshift/redshift-usage.md) * [Salesforce](salesforce.md) * [SingleStore](singlestore.md) * [Snowflake](snowflake/) -* [Snowflake Usage](snowflake-usage.md) +* [Snowflake Usage](snowflake/snowflake-usage.md) * [Trino](trino.md) * [Vertica](vertica.md) @@ -34,6 +37,7 @@ OpenMetadata supports connectors to some popular services. We will continue as a * [Looker](looker.md) * [Metabase](metabase.md) +* Power BI * [Redash](redash.md) * [Superset](superset.md) * [Tableau](tableau.md) diff --git a/docs/integrations/connectors/bigquery-usage.md b/docs/integrations/connectors/bigquery/bigquery-usage.md similarity index 99% rename from docs/integrations/connectors/bigquery-usage.md rename to docs/integrations/connectors/bigquery/bigquery-usage.md index 7d1780d2f21..7ffb220e083 100644 --- a/docs/integrations/connectors/bigquery-usage.md +++ b/docs/integrations/connectors/bigquery/bigquery-usage.md @@ -356,7 +356,7 @@ The syntax and semantics for `schema_filter_pattern` are the same as for [`table Use the `source.config.generate_sample_data` field to control whether or not to generate sample data to include in table views in the OpenMetadata user interface. The image below provides an example. -![](../../.gitbook/assets/generate\_sample\_data.png) +![](../../../.gitbook/assets/generate\_sample\_data.png) Explicitly include sample data by adding the following key-value pair in the `source.config` field of your configuration file. @@ -380,7 +380,7 @@ You can exclude the collection of sample data by adding the following key-value DBT provides transformation logic that creates tables and views from raw data. OpenMetadata’s integration for DBT enables you to view the models used to generate a table from that table's details page in the OpenMetadata UI. The image below provides an example. -![](../../.gitbook/assets/configure\_dbt.png) +![](../../../.gitbook/assets/configure\_dbt.png) To include DBT models and metadata in your ingestion workflows, specify the location of the DBT manifest and catalog files as fields in your configuration file. @@ -441,7 +441,7 @@ metadata ingest -c ./bigquery_usage.json As the ingestion workflow runs, you may observe progress both from the command line and from the OpenMetadata user interface. To view the metadata ingested from BigQuery Usage, visit [http://localhost:8585/explore/tables](http://localhost:8585/explore/tables). Select the BigQuery Usage service to filter for the data you’ve ingested using the workflow you configured and ran following this guide. The image below provides an example. -![](<../../.gitbook/assets/next\_steps (1).png>) +![](<../../../.gitbook/assets/next\_steps (1).png>) ## **Troubleshooting** diff --git a/docs/integrations/connectors/redshift-usage.md b/docs/integrations/connectors/redshift/redshift-usage.md similarity index 99% rename from docs/integrations/connectors/redshift-usage.md rename to docs/integrations/connectors/redshift/redshift-usage.md index 5ded867e1b3..570ae184511 100644 --- a/docs/integrations/connectors/redshift-usage.md +++ b/docs/integrations/connectors/redshift/redshift-usage.md @@ -324,7 +324,7 @@ The syntax and semantics for `schema_filter_pattern` are the same as for [`table Use the `source.config.generate_sample_data` field to control whether or not to generate sample data to include in table views in the OpenMetadata user interface. The image below provides an example. -![](../../.gitbook/assets/generate\_sample\_data.png) +![](../../../.gitbook/assets/generate\_sample\_data.png) Explicitly include sample data by adding the following key-value pair in the `source.config` field of your configuration file. @@ -348,7 +348,7 @@ You can exclude the collection of sample data by adding the following key-value DBT provides transformation logic that creates tables and views from raw data. OpenMetadata’s integration for DBT enables you to view the models used to generate a table from that table's details page in the OpenMetadata UI. The image below provides an example. -![](../../.gitbook/assets/configure\_dbt.png) +![](../../../.gitbook/assets/configure\_dbt.png) To include DBT models and metadata in your ingestion workflows, specify the location of the DBT manifest and catalog files as fields in your configuration file. @@ -409,7 +409,7 @@ metadata ingest -c ./redshift_usage.json As the ingestion workflow runs, you may observe progress both from the command line and from the OpenMetadata user interface. To view the metadata ingested from Redshift Usage, visit [http://localhost:8585/explore/tables](http://localhost:8585/explore/tables). Select the Redshift Usage service to filter for the data you’ve ingested using the workflow you configured and ran following this guide. The image below provides an example. -![](<../../.gitbook/assets/next\_steps (1).png>) +![](<../../../.gitbook/assets/next\_steps (1).png>) ## **Troubleshooting** diff --git a/docs/integrations/connectors/snowflake-usage.md b/docs/integrations/connectors/snowflake/snowflake-usage.md similarity index 99% rename from docs/integrations/connectors/snowflake-usage.md rename to docs/integrations/connectors/snowflake/snowflake-usage.md index 423acb71795..5e635591605 100644 --- a/docs/integrations/connectors/snowflake-usage.md +++ b/docs/integrations/connectors/snowflake/snowflake-usage.md @@ -324,7 +324,7 @@ The syntax and semantics for `schema_filter_pattern` are the same as for [`table Use the `source.config.generate_sample_data` field to control whether or not to generate sample data to include in table views in the OpenMetadata user interface. The image below provides an example. -![](../../.gitbook/assets/generate\_sample\_data.png) +![](../../../.gitbook/assets/generate\_sample\_data.png) Explicitly include sample data by adding the following key-value pair in the `source.config` field of your configuration file. @@ -348,7 +348,7 @@ You can exclude the collection of sample data by adding the following key-value DBT provides transformation logic that creates tables and views from raw data. OpenMetadata’s integration for DBT enables you to view the models used to generate a table from that table's details page in the OpenMetadata UI. The image below provides an example. -![](../../.gitbook/assets/configure\_dbt.png) +![](../../../.gitbook/assets/configure\_dbt.png) To include DBT models and metadata in your ingestion workflows, specify the location of the DBT manifest and catalog files as fields in your configuration file. @@ -409,7 +409,7 @@ metadata ingest -c ./snowflake_usage.json As the ingestion workflow runs, you may observe progress both from the command line and from the OpenMetadata user interface. To view the metadata ingested from Snowflake Usage, visit [http://localhost:8585/explore/tables](http://localhost:8585/explore/tables). Select the Snowflake Usage service to filter for the data you’ve ingested using the workflow you configured and ran following this guide. The image below provides an example. -![](<../../.gitbook/assets/next\_steps (1).png>) +![](<../../../.gitbook/assets/next\_steps (1).png>) ## **Troubleshooting**