From 3c5762420af82eb0116f6ca613b5efe0062bf8d2 Mon Sep 17 00:00:00 2001 From: Sriharsha Chintalapani Date: Tue, 7 Sep 2021 13:01:45 -0700 Subject: [PATCH 1/2] Fix #429: Publish Roadmap for next 3 releases --- README.md | 1 + docs/SUMMARY.md | 2 ++ docs/roadmap.md | 81 +++++++++++++++++++++++++++++++++++++++++++++++++ roadmap.md | 81 +++++++++++++++++++++++++++++++++++++++++++++++++ 4 files changed, 165 insertions(+) create mode 100644 docs/roadmap.md create mode 100644 roadmap.md diff --git a/README.md b/README.md index 55b3a03d588..cc7ae44a05a 100644 --- a/README.md +++ b/README.md @@ -13,6 +13,7 @@ - [What is OpenMetadata?](#what-is-openmetadata ) - [Try our Sandbox](#try-our-sandbox) - [Install & Run](#install-and-run-openmetadata) +- [Roadmap](docs/roadmap.md) - [Documentation and support](#documentation-and-support) - [Contributors](#contributors) - [License](#license) diff --git a/docs/SUMMARY.md b/docs/SUMMARY.md index d3ea4104526..786a724d05d 100644 --- a/docs/SUMMARY.md +++ b/docs/SUMMARY.md @@ -2,6 +2,7 @@ * [Introduction](README.md) * [Try OpenMetadata](take-it-for-a-spin.md) +* [Roadmap](roadmap.md) ## OpenMetadata APIs @@ -38,6 +39,7 @@ * [Overview](openmetadata-apis/apis/overview.md) * [API Organization](openmetadata-apis/apis/api-organization.md) * [Implementation notes](openmetadata-apis/apis/implementation-notes.md) + ## Install diff --git a/docs/roadmap.md b/docs/roadmap.md new file mode 100644 index 00000000000..d92b00d8cc7 --- /dev/null +++ b/docs/roadmap.md @@ -0,0 +1,81 @@ +#OpenMetadata Roadmap + +Here is the OpenMetadata Roadmap for the next 3 releases. + +We are doing a monthly release and we are going to evolve fast and adopt to community needs. +Below roadmap is subject to change based on community needs and feedback. + +If you would like to prioitize any feature or would like to add a new feature thats not in +our roadmap yet, please file an Issue [Github](https://github.com/open-metadata/OpenMetadata/issues) or ping us on [Slack](https://openmetadata.slack.com/) + + +## 0.4 Release - Sep 20th, 2021 + +####Theme: Topics, Dashboards, and Data Profiler + +### Support for Kafka (and Pulsar WIP) +* Support for Message Service and Topic entities in schemas, APIs, and UI +* Kafka connector and ingestion support for Confluent Schema Registry + +### Support for Dashboards +* Support for Dashboard services, Dashboards, and Charts entities in schemas, APIs, and UI +* Looker, Superset, Tableau connector, and ingestion support + + +#### User Interface +* Sort search results based on Usage, Relevance, and Last updated time +* Search string highlighted in search results +* Support for Kafka and Dashboards from Looker, SuperSet, and Tableau + +### Other features +* Pluggable SSO integration - Auth0 support +* Support for Presto + +#### Work in progress +* Salesforce CRM connector +* Data profiler to profile tables in ingestion framework and show it table details page + + + +## 0.5 Release - Oct 19th, 2021 + +#### Theme: Data quality and Lineage + + +###Support for Lineage +* Lineage related schemas and APIs +* Lineage metadata integration from AirFlow for tables +* Lineage metadata integration from Looker, and Superset for Dashboards +* Extra lineage from queries for BigQuery, Hive, Redshift, and Snowflake +* UI changes to show lineage information to the users + +### Eventing & Notification framework +* Design for eventing framework for both internal and external applications +* Schema change event +* Schema change notification + +### Other features +* Data quality - Data profiler integration work in progress +* Schema versioning + + +## 0.6 Release - Nov 17th, 2021 + +#### Theme: User collaboration features + +### Support for User Collaboration +* Allow users to ask questions, suggest changes, request new features for data assets +* Activity feeds for User and Data assets +* Tracking activity feeds as tasks + +### Lineage new features +* Allow users to add lineage information manually for table and column levels +* Tier propagation to upstream datasets using lineage +* Propagating column level tags and descriptions using lineage (Work in progress) + +### Other features +* Metadata Change Event integration into Slack and framework for integration into other services such as Kafka or other Notification frameworks +* Data Health Report +* Delta Lake support, Databricks, Iceberg + + diff --git a/roadmap.md b/roadmap.md new file mode 100644 index 00000000000..d92b00d8cc7 --- /dev/null +++ b/roadmap.md @@ -0,0 +1,81 @@ +#OpenMetadata Roadmap + +Here is the OpenMetadata Roadmap for the next 3 releases. + +We are doing a monthly release and we are going to evolve fast and adopt to community needs. +Below roadmap is subject to change based on community needs and feedback. + +If you would like to prioitize any feature or would like to add a new feature thats not in +our roadmap yet, please file an Issue [Github](https://github.com/open-metadata/OpenMetadata/issues) or ping us on [Slack](https://openmetadata.slack.com/) + + +## 0.4 Release - Sep 20th, 2021 + +####Theme: Topics, Dashboards, and Data Profiler + +### Support for Kafka (and Pulsar WIP) +* Support for Message Service and Topic entities in schemas, APIs, and UI +* Kafka connector and ingestion support for Confluent Schema Registry + +### Support for Dashboards +* Support for Dashboard services, Dashboards, and Charts entities in schemas, APIs, and UI +* Looker, Superset, Tableau connector, and ingestion support + + +#### User Interface +* Sort search results based on Usage, Relevance, and Last updated time +* Search string highlighted in search results +* Support for Kafka and Dashboards from Looker, SuperSet, and Tableau + +### Other features +* Pluggable SSO integration - Auth0 support +* Support for Presto + +#### Work in progress +* Salesforce CRM connector +* Data profiler to profile tables in ingestion framework and show it table details page + + + +## 0.5 Release - Oct 19th, 2021 + +#### Theme: Data quality and Lineage + + +###Support for Lineage +* Lineage related schemas and APIs +* Lineage metadata integration from AirFlow for tables +* Lineage metadata integration from Looker, and Superset for Dashboards +* Extra lineage from queries for BigQuery, Hive, Redshift, and Snowflake +* UI changes to show lineage information to the users + +### Eventing & Notification framework +* Design for eventing framework for both internal and external applications +* Schema change event +* Schema change notification + +### Other features +* Data quality - Data profiler integration work in progress +* Schema versioning + + +## 0.6 Release - Nov 17th, 2021 + +#### Theme: User collaboration features + +### Support for User Collaboration +* Allow users to ask questions, suggest changes, request new features for data assets +* Activity feeds for User and Data assets +* Tracking activity feeds as tasks + +### Lineage new features +* Allow users to add lineage information manually for table and column levels +* Tier propagation to upstream datasets using lineage +* Propagating column level tags and descriptions using lineage (Work in progress) + +### Other features +* Metadata Change Event integration into Slack and framework for integration into other services such as Kafka or other Notification frameworks +* Data Health Report +* Delta Lake support, Databricks, Iceberg + + From 5607350d38dc18e78a3ccb1e881f911fcec461c9 Mon Sep 17 00:00:00 2001 From: Sriharsha Chintalapani Date: Tue, 7 Sep 2021 13:34:34 -0700 Subject: [PATCH 2/2] Fix #429: Publish Roadmap for next 3 releases --- roadmap.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/roadmap.md b/roadmap.md index d92b00d8cc7..52c2acbe26e 100644 --- a/roadmap.md +++ b/roadmap.md @@ -1,4 +1,4 @@ -#OpenMetadata Roadmap +# OpenMetadata Roadmap Here is the OpenMetadata Roadmap for the next 3 releases. @@ -6,7 +6,7 @@ We are doing a monthly release and we are going to evolve fast and adopt to comm Below roadmap is subject to change based on community needs and feedback. If you would like to prioitize any feature or would like to add a new feature thats not in -our roadmap yet, please file an Issue [Github](https://github.com/open-metadata/OpenMetadata/issues) or ping us on [Slack](https://openmetadata.slack.com/) +our roadmap yet, please file an Issue [Github](https://github.com/open-metadata/OpenMetadata/issues) or ping us on [Slack](https://openmetadata.slack.com/archives/C02DZK3QH8Q) ## 0.4 Release - Sep 20th, 2021 @@ -22,7 +22,7 @@ our roadmap yet, please file an Issue [Github](https://github.com/open-metadata/ * Looker, Superset, Tableau connector, and ingestion support -#### User Interface +### User Interface * Sort search results based on Usage, Relevance, and Last updated time * Search string highlighted in search results * Support for Kafka and Dashboards from Looker, SuperSet, and Tableau @@ -31,7 +31,7 @@ our roadmap yet, please file an Issue [Github](https://github.com/open-metadata/ * Pluggable SSO integration - Auth0 support * Support for Presto -#### Work in progress +### Work in progress * Salesforce CRM connector * Data profiler to profile tables in ingestion framework and show it table details page @@ -42,7 +42,7 @@ our roadmap yet, please file an Issue [Github](https://github.com/open-metadata/ #### Theme: Data quality and Lineage -###Support for Lineage +### Support for Lineage * Lineage related schemas and APIs * Lineage metadata integration from AirFlow for tables * Lineage metadata integration from Looker, and Superset for Dashboards