mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-08-10 18:17:29 +00:00
97b58c65f5
* updated metadata to work with the impala query engine. Uses the describe function to grab column names, data types, and comments. * added the ordinalPosition data point into the Column constructor. * renamed variable to better describe its usage. * updated profile errors. Hive connections now comment columns by default. * removed print statements * Cleaned up code by pulling check into its own function * Updated median function to return null when it is being used for first and third quartiles. * updated metadata to work with the impala query engine. Uses the describe function to grab column names, data types, and comments. * added the ordinalPosition data point into the Column constructor. * renamed variable to better describe its usage. * updated profile errors. Hive connections now comment columns by default. * removed print statements * Cleaned up code by pulling check into its own function * Updated median function to return null when it is being used for first and third quartiles. * removed print statements and ran make py_format * updated to fix some pylint errors. imported Dialects to remove string compare to "impala" engine * moved huge comment into function docstring. This comment shows us the sql to get quartiles in Impala * added cast to decimal for column when running average in mean.py * fixed lint error * fixed ui ordering of precision and scale. Precision should be ordred in front of scale since the precision is set first in decimal data types * first pass for impala connector * updated default auth_mechanism to be one of the enum values. * updated UI documentation to match fields for the impalaconneciton. refined impalaConnection to bring use_ssl to a boolean instead or relying on an extra connection option being manually added. Removed reference to hive for type mapping added impala to the pip setup * py_format updates * removed print statement * Lints and fixes * Updated database documentation to follow new style * Flag as BETA * Remove tests --------- Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com> Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
97 lines
2.6 KiB
Markdown
97 lines
2.6 KiB
Markdown
---
|
|
title: Connectors
|
|
slug: /connectors
|
|
---
|
|
|
|
# Connectors
|
|
|
|
OpenMetadata can extract metadata from the following list of 55 connectors:
|
|
|
|
## Database / DataWarehouse Services
|
|
|
|
- [Athena](/connectors/database/athena)
|
|
- [AzureSQL](/connectors/database/azuresql)
|
|
- [BigQuery](/connectors/database/bigquery)
|
|
- Bigquery Metadata
|
|
- Bigquery Usage
|
|
- [Clickhouse](/connectors/database/clickhouse)
|
|
- Clickhouse Metadata
|
|
- Clickhouse Usage
|
|
- [Databricks SQL](/connectors/database/databricks)
|
|
- Databricks Metadata
|
|
- Databricks Usage
|
|
- [Data lake](/connectors/database/datalake)
|
|
- Azure Data Lake
|
|
- S3 Data Lake
|
|
- Google Cloud Service Data Lake
|
|
- [DB2](/connectors/database/db2)
|
|
- dbt
|
|
- [Delta Lake](/connectors/database/deltalake)
|
|
- [Druid](/connectors/database/druid)
|
|
- [DynamoDB](/connectors/database/dynamodb)
|
|
- [Glue](/connectors/database/glue)
|
|
- Glue Metadata
|
|
- Glue Catalog
|
|
- [Hive](/connectors/database/hive)
|
|
- [Impala](/connectors/database/impala)
|
|
- [MariaDB](/connectors/database/mariadb)
|
|
- [MSSQL](/connectors/database/mssql)
|
|
- MSSQL Metadata
|
|
- MSSQL Usage
|
|
- [MySQL](/connectors/database/mysql)
|
|
- [Oracle](/connectors/database/oracle)
|
|
- [Postgres](/connectors/database/postgres)
|
|
- Postgres Metadata
|
|
- Postgres Usage
|
|
- [Presto](/connectors/database/presto)
|
|
- [Redshift](/connectors/database/redshift)
|
|
- Redshift Metadata
|
|
- Redshift Usage
|
|
- [Salesforce](/connectors/database/salesforce)
|
|
- [SingleStore](/connectors/database/singlestore)
|
|
- [Snowflake](/connectors/database/snowflake)
|
|
- Snowflake Metadata
|
|
- Snowflake Usage
|
|
- SQLAlchemy
|
|
- SQL Profiles (SQL based systems)
|
|
- [Trino](/connectors/database/trino)
|
|
- [Vertica](/connectors/database/vertica)
|
|
- [Domo Database](/connectors/database/domo-database)
|
|
|
|
## Dashboard Services
|
|
|
|
- [Looker](/connectors/dashboard/looker)
|
|
- [Metabase](/connectors/dashboard/metabase)
|
|
- [Mode](/connectors/dashboard/mode)
|
|
- [PowerBI](/connectors/dashboard/powerbi)
|
|
- [Redash](/connectors/dashboard/redash)
|
|
- [Superset](/connectors/dashboard/superset)
|
|
- [Tableau](/connectors/dashboard/tableau)
|
|
- [Domo Dashboard](/connectors/dashboard/domo-dashboard)
|
|
|
|
## Messaging Services
|
|
|
|
- [Kafka](/connectors/messaging/kafka)
|
|
- Pulsar
|
|
- [Redpanda](/connectors/messaging/redpanda)
|
|
|
|
|
|
## Pipeline Services
|
|
|
|
- [Airbyte](/connectors/pipeline/airbyte)
|
|
- [Airflow](/connectors/pipeline/airflow)
|
|
- [Dagster](/connectors/pipeline/dagster)
|
|
- [Fivetran](/connectors/pipeline/fivetran)
|
|
- [Glue](/connectors/pipeline/glue-pipeline)
|
|
- [Domo Pipeline](/connectors/pipeline/domo-pipeline)
|
|
- NiFi
|
|
|
|
## ML Model Services
|
|
|
|
- [Mlflow](/connectors/ml-model/mlflow)
|
|
|
|
## Metadata Services
|
|
|
|
- [Amundsen](/connectors/metadata/amundsen)
|
|
- [Atlas](/connectors/metadata/atlas)
|