yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-03 23:26:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/docs/roadmap.md
parthp2107 e2578d6be3
Added documentation changes done in 0.5.0 branch to main (#1168) 
* GitBook: [#177] Documentation Update - Airflow

* GitBook: [#195] Removing Cron from databaseServices

* GitBook: [#196] Added trino

* GitBook: [#197] removed cron from config

* GitBook: [#198] Added Redash Documentation

* GitBook: [#199] Added Bigquery Usage Documentation

* GitBook: [#200] Added page link for presto

* GitBook: [#201] Added Local Docker documentation

* GitBook: [#202] Added Documentation for Local Docker Setup

* GitBook: [#203] Added Git Command to clone Openmetadata in docs

* GitBook: [#207] links update

* GitBook: [#208] Updating Airflow Documentation

* GitBook: [#210] Adding Python installation package under Airflow Lineage config

* GitBook: [#211] Change the links to 0.5..0

* GitBook: [#213] Move buried connectors page up

* GitBook: [#214] Update to connectors page

* GitBook: [#215] Removed sub-categories

* GitBook: [#212] Adding Discovery tutorial

* GitBook: [#220] Updated steps to H2s.

* GitBook: [#230] Complex queries

* GitBook: [#231] Add lineage to feature overview

* GitBook: [#232] Make feature overview headers verbs instead of nouns

* GitBook: [#233] Add data reliability to features overview

* GitBook: [#234] Add complex data types to feature overview

* GitBook: [#235] Simplify and further distinguish discovery feature headers

* GitBook: [#236] Add data importance to feature overview

* GitBook: [#237] Break Connectors into its own section

* GitBook: [#238] Reorganize first section of docs.

* GitBook: [#239] Add connectors to feature overview

* GitBook: [#240] Organize layout of feature overview into feature categories as agreed with Harsha.

* GitBook: [#242] Make overview paragraph more descriptive.

* GitBook: [#243] Create a link to Connectors section from feature overview.

* GitBook: [#244] Add "discover data through association" to feature overview.

* GitBook: [#245] Update importance and owners gifs

* GitBook: [#246] Include a little more descriptive documentation for key features.

* GitBook: [#248] Small tweaks to intro paragraph.

* GitBook: [#249] Clean up data profiler paragraph.

* GitBook: [#250] Promote Complex Data Types to its own feature.

* GitBook: [#251] Update to advanced search

* GitBook: [#252] Update Roadmap

* GitBook: [#254] Remove old features page (text and screenshot based).

* GitBook: [#255] Remove references to removed page.

* GitBook: [#256] Add Descriptions and Tags section to feature overview.

* GitBook: [#257] Update title for "Know Your Data"

Co-authored-by: Ayush Shah <ayush.shah@deuexsolutions.com>
Co-authored-by: Suresh Srinivas <suresh@getcollate.io>
Co-authored-by: Shannon Bradshaw <shannon.bradshaw@arrikto.com>
Co-authored-by: OpenMetadata <github@harsha.io>
2021-11-13 09:33:20 -08:00

3.4 KiB
Raw Permalink Blame History

Roadmap

Here is the OpenMetadata Roadmap for the next 3 releases.

We are doing a monthly release and we are going to evolve fast and adapt to community needs. Below roadmap is subject to change based on community needs and feedback. our roadmap yet, please file an Issue Github or ping us on Slack

If you would like to prioritize any feature or would like to add a new feature that is not in our roadmap yet, please file an Issue on Github or ping us on Slack.

0.4 Release - Sep 20th, 2021

Theme: Topics, Dashboards, and Data Profiler

Support for Kafka (and Pulsar WIP)

  • Support for Message Service and Topic entities in schemas, APIs, and UI
  • Kafka connector and ingestion support for Confluent Schema Registry

Support for Dashboards

  • Support for Dashboard services, Dashboards, and Charts entities in schemas, APIs, and UI
  • Looker, Superset, Tableau connector, and ingestion support

User Interface

  • Sort search results based on Usage, Relevance, and Last updated time
  • Search string highlighted in search results
  • Support for Kafka and Dashboards from Looker, SuperSet, and Tableau

Other features

  • Pluggable SSO integration - Auth0 support
  • Support for Presto

Work in progress

  • Salesforce CRM connector
  • Data profiler to profile tables in ingestion framework and show it table details page

0.5 Release - Oct 19th, 2021

Theme: Data quality and Lineage

Support for Lineage

  • Lineage related schemas and APIs
  • Lineage metadata integration from AirFlow for tables
  • UI changes to show lineage information to the users

Data Reliability

  • Improvements to Data Profiler
  • UI integration with Data Profiler to show how the table profile looks over the period of time

Complex Types

  • Support complex types such as Struct, Array with nested fields
  • UI support to add expand complex types and tag , add description for nested fields

Connectors

  • Trino
  • Redash

Other features

  • Pipeline Entities are supported
  • Integration with Airflow to extract Pipeline details

0.6 Release - Nov 17th, 2021

Theme: Metadata Versioning & Eventing

Metadata Versioning and Eventing Framework

  • Capture changes to Entity Metadata from source and user interactions as versions
  • Versioned changes will be published as events for clients to consume to take actions on

Data Reliability

  • Improvements to Data Reliablity library
  • Capture custom measurements through user provided SQL

Airflow APIs

  • Airflow APIs to deploy DAGS and manage them
  • UI integration to deploy ingestion workflows

0.7 Release - Dec 15th, 2021

Support for User Collaboration

  • Allow users to ask questions, suggest changes, request new features for data assets
  • Activity feeds for User and Data assets
  • Tracking activity feeds as tasks

Lineage new features

  • Allow users to add lineage information manually for table and column levels
  • Tier propagation to upstream datasets using lineage
  • Propagating column level tags and descriptions using lineage (Work in progress)

Other features

  • Metadata Change Event integration into Slack and framework for integration into other services such as Kafka or other Notification frameworks
  • Delta Lake support, Databricks, Iceberg