Introduction

OpenMetadata is an open standard with a centralized metadata store and ingestion framework supporting connectors for a wide range of services. The metadata ingestion framework enables you to customize or add support for any service. REST APIs enable you to integrate OpenMetadata with existing tool chains. Using the OpenMetadata user interface (UI), data consumers can discover the right data to use in decision making and data producers can assess usage and consumer experience in order to plan improvements and prioritize bug fixes.

OpenMetadata enables metadata management end-to-end, giving you the ability to unlock the value of data assets in the common use cases of data discovery and governance, but also in emerging use cases related to data quality, observability, and people collaboration.

{% embed url="https://youtu.be/3xaHf3A2PgU" %}

Connectors

OpenMetadata provides connectors that enable you to perform metadata ingestion from a number of common database, dashboard, messaging, and pipeline services. With each release, we add additional connectors and the ingestion framework provides a structured and straightforward method for creating your own connectors. See the table below for a list of supported connectors.

Database Dashboard Pipeline Messaging Modeling ML Models
Athena Looker Airflow Kafka DBT MlFlow
BigQuery Redash Prefect Pulsar (WIP)
BigQuery Usage Superset Glue
Elasticsearch Tableau
Glue Catalog
Hive
MariaDB
MSSQL
MySQL
Oracle
Postgres
Presto
Redshift
Redshift Usage
Salesforce
Snowflake
Snowflake Usage
Trino
Vertica

OpenMetadata Components

The key components of OpenMetadata include the following:

  • OpenMetadata User Interface (UI) - a central place for users to discover and collaborate on all data. See Features for an overview of the OpenMetadata UI.
  • Ingestion framework - a pluggable framework for integrating tools and ingesting metadata to the metadata store. The ingestion framework already supports well-known data warehouses. See the Connectors section for a complete list and documentation on supported services.
  • Metadata APIs - for producing and consuming metadata built on schemas for User Interfaces and for Integrating tools, systems, and services. See the API Overview for details.
  • Metadata store - stores a metadata graph that connects data assets and user and tool generated metadata.
  • Metadata schemas - defines core abstractions and vocabulary for metadata with schemas for Types, Entities, and Relationships between entities. This is the foundation of the Open Metadata Standard. See the Schema Concepts section to learn more about metadata schemas.

License

OpenMetadata is released under Apache License, Version 2.0