mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-08-31 20:51:26 +00:00
Fix Roadmap page (#11233)
This commit is contained in:
Milan Bariya
GitHub
parent
d1996d4260
commit
72f354b8f7
@ -11,191 +11,143 @@ and adapt to the community needs.
|
|||||||
The below roadmap is subject to change based on community needs and feedback. Please file an Issue on [GitHub](https://github.com/open-metadata/OpenMetadata/issues)
|
The below roadmap is subject to change based on community needs and feedback. Please file an Issue on [GitHub](https://github.com/open-metadata/OpenMetadata/issues)
|
||||||
or ping us on [Slack](https://slack.open-metadata.org/) If you would like to prioritize any feature or would like to add a new feature.
|
or ping us on [Slack](https://slack.open-metadata.org/) If you would like to prioritize any feature or would like to add a new feature.
|
||||||
|
|
||||||
<br></br>
|
|
||||||
|
|
||||||
You can check the latest release [here](/overview/releases).
|
You can check the latest release [here](/overview/releases).
|
||||||
|
|
||||||
## 0.13.1 Release - Dec 22nd, 2022
|
## 0.13.1 Release - Dec 22nd, 2022
|
||||||
|
|
||||||
<TileContainer>
|
{% tilesContainer %}
|
||||||
<Tile
|
|
||||||
title="Lineage"
|
|
||||||
text=""
|
|
||||||
background="purple-70"
|
|
||||||
bordercolor="purple-70"
|
|
||||||
link=""
|
|
||||||
size="half"
|
|
||||||
>
|
|
||||||
<li>UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example</li>
|
|
||||||
</Tile>
|
|
||||||
<Tile
|
|
||||||
title="Data Quality"
|
|
||||||
text=""
|
|
||||||
background="yellow-70"
|
|
||||||
bordercolor="blue-70"
|
|
||||||
>
|
|
||||||
<li>Freshness based on the partition key</li>
|
|
||||||
<li>TestCase versioning and results applying to a specific version so that UI can show the results as per the test case version</li>
|
|
||||||
</Tile>
|
|
||||||
<Tile
|
|
||||||
title="Notifications"
|
|
||||||
text=""
|
|
||||||
background="green-70"
|
|
||||||
bordercolor="green-70"
|
|
||||||
link="https://github.com/open-metadata/OpenMetadata/issues/5803"
|
|
||||||
size="half"
|
|
||||||
>
|
|
||||||
<li>Improved workflow to build Alerts and filtering mechanisms</li>
|
|
||||||
<li>Admins can now configure email templates. </li>
|
|
||||||
<li>Admins can set up an email notification for an event, such as a schema change notification, etc..</li>
|
|
||||||
</Tile>
|
|
||||||
<Tile
|
|
||||||
title="Glossary"
|
|
||||||
text=""
|
|
||||||
background="purple-70"
|
|
||||||
bordercolor="purple-70"
|
|
||||||
link=""
|
|
||||||
size="half"
|
|
||||||
>
|
|
||||||
<li>Bulk upload of Glossary Terms</li>
|
|
||||||
<li>Glossary Review Workflow. Owners and Reviewers can approve or deny a Glossary Term to be used. When a user adds a GlossaryTerm, it will open a task and assign it to the owner and reviewers.</li>
|
|
||||||
<li>Propagate tags at the root of glossary terms to its children</li>
|
|
||||||
<li>Propagate tags/glossary by tagging at the database/schema level and applying them to all the schemas/tables underneath them.</li>
|
|
||||||
</Tile>
|
|
||||||
<Tile
|
|
||||||
title="Messaging - Kafka & Redpanda"
|
|
||||||
text=""
|
|
||||||
background="purple-70"
|
|
||||||
bordercolor="blue-70"
|
|
||||||
>
|
|
||||||
<li>AVRO/Protobuf schema parsing and showing them in the topic entity view; currently, we show it as one payload</li>
|
|
||||||
<li>Users will be able to add descriptions/tags at the field level</li>
|
|
||||||
<li>Users can search based on fields in a schema of a topic.</li>
|
|
||||||
</Tile>
|
|
||||||
|
|
||||||
</TileContainer>
|
{% tile title="Lineage" %}
|
||||||
|
- UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example
|
||||||
|
{% /tile %}
|
||||||
|
|
||||||
|
{% tile title="Data Quality" %}
|
||||||
|
- Freshness based on the partition key
|
||||||
|
- TestCase versioning and results applying to a specific version so that UI can show the results as per the test case version
|
||||||
|
{% /tile %}
|
||||||
|
|
||||||
|
{% tile title="Notifications" %}
|
||||||
|
- Improved workflow to build Alerts and filtering mechanisms
|
||||||
|
- Admins can now configure email templates.
|
||||||
|
- Admins can set up an email notification for an event, such as a schema change notification, etc..
|
||||||
|
{% /tile %}
|
||||||
|
|
||||||
|
{% tile title="Glossary" %}
|
||||||
|
- Bulk upload of Glossary Terms
|
||||||
|
- Glossary Review Workflow. Owners and Reviewers can approve or deny a Glossary Term to be used. When a user adds a GlossaryTerm, it will open a task and assign it to the owner and reviewers.
|
||||||
|
- Propagate tags at the root of glossary terms to its children
|
||||||
|
- Propagate tags/glossary by tagging at the database/schema level and applying them to all the schemas/tables underneath them.
|
||||||
|
{% /tile %}
|
||||||
|
|
||||||
|
{% tile title="Messaging - Kafka & Redpanda" %}
|
||||||
|
- AVRO/Protobuf schema parsing and showing them in the topic entity view; currently, we show it as one payload
|
||||||
|
- Users will be able to add descriptions/tags at the field level
|
||||||
|
- Users can search based on fields in a schema of a topic.
|
||||||
|
{% /tile %}
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
{% /tilesContainer %}
|
||||||
|
|
||||||
|
|
||||||
## 1.0 Release - March 14th, 2023
|
## 1.0 Release - March 14th, 2023
|
||||||
|
|
||||||
<TileContainer>
|
{% tilesContainer %}
|
||||||
<Tile
|
|
||||||
title="APIs & Schemas"
|
{% tile title="APIs & Schemas" %}
|
||||||
text=""
|
- Entity Schema specification versioning
|
||||||
background="yellow-70"
|
- Defining API backward compatability
|
||||||
bordercolor="yellow-70"
|
{% /tile %}
|
||||||
link=""
|
|
||||||
>
|
{% tile title="Lineage" %}
|
||||||
<li>Entity Schema specification versioning</li>
|
- Overhaul of lineage query parsing and improved new library
|
||||||
<li>Defining API backward compatability</li>
|
- UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example
|
||||||
</Tile>
|
{% /tile %}
|
||||||
<Tile
|
|
||||||
title="Lineage"
|
{% tile title="Collaboration" %}
|
||||||
text=""
|
- Improvements Task & Activity Feed
|
||||||
background="purple-70"
|
{% /tile %}
|
||||||
bordercolor="purple-70"
|
|
||||||
link=""
|
{% tile title="Entities" %}
|
||||||
size="half"
|
- Add support for NoSQL/Json-based documents as entities. This will help integrate Cassandra/ElasticSearch etc.. services.
|
||||||
>
|
- Storage Services such as S3 and showcase buckets as independent entities
|
||||||
<li>Overhaul of lineage query parsing and improved new library</li>
|
{% /tile %}
|
||||||
<li>UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example</li>
|
|
||||||
</Tile>
|
{% tile title="Data Quality" %}
|
||||||
<Tile
|
- Complex types
|
||||||
title="Collaboration"
|
- Add support for computing completeness
|
||||||
text=""
|
- Improvements to Auto Classification of entities by ML
|
||||||
background="pink-70"
|
{% /tile %}
|
||||||
bordercolor="pink-70"
|
|
||||||
>
|
{% tile title="Security" %}
|
||||||
<li>Improvements Task & Activity Feed</li>
|
- Search results integration for roles and policies
|
||||||
</Tile>
|
- Domain based restriction and domain only view
|
||||||
<Tile
|
- Policy improvements based on community feedback
|
||||||
title="Entities"
|
{% /tile %}
|
||||||
text=""
|
|
||||||
background="green-70"
|
|
||||||
bordercolor="green-70"
|
{% /tilesContainer %}
|
||||||
>
|
|
||||||
<li> Add support for NoSQL/Json-based documents as entities. This will help integrate Cassandra/ElasticSearch etc.. services.</li>
|
|
||||||
<li>Storage Services such as S3 and showcase buckets as independent entities</li>
|
|
||||||
</Tile>
|
## 1.1 Release - May 18th 2023
|
||||||
<Tile
|
|
||||||
title="Data Quality"
|
{% tilesContainer %}
|
||||||
text=""
|
|
||||||
background="yellow-70"
|
{% tile title="Automation" %}
|
||||||
bordercolor="yellow-70"
|
- Automation framework to listen change events to run automated workflows
|
||||||
link="https://github.com/open-metadata/OpenMetadata/issues/4652"
|
{% /tile %}
|
||||||
>
|
|
||||||
<li>Complex types</li>
|
{% tile title="Lineage" %}
|
||||||
<li>Add support for computing completeness</li>
|
- Propagation of tags and descriptions through the column-level lineage
|
||||||
<li>Improvements to Auto Classification of entities by ML</li>
|
{% /tile %}
|
||||||
</Tile>
|
|
||||||
<Tile
|
{% tile title="Data Observability" %}
|
||||||
title="Security"
|
- Notifications will be grouped into Activity vs. Alert type notifications
|
||||||
text=""
|
- Data SLAs
|
||||||
background="purple-70"
|
- Impact Analysis
|
||||||
bordercolor="purple-70"
|
{% /tile %}
|
||||||
>
|
|
||||||
<li>Search results integration for roles and policies</li>
|
{% tile title="Entities" %}
|
||||||
<li>Domain based restriction and domain only view</li>
|
- Add support for Notebook Entity
|
||||||
<li>Policy improvements based on community feedback</li>
|
- Add support for Report Entity
|
||||||
</Tile>
|
{% /tile %}
|
||||||
</TileContainer>
|
|
||||||
|
{% /tilesContainer %}
|
||||||
|
|
||||||
|
|
||||||
## 1.1 Release - April 18th 2023
|
## 1.1 Release - April 18th 2023
|
||||||
|
|
||||||
<TileContainer>
|
{% tilesContainer %}
|
||||||
<Tile
|
|
||||||
title="Automation"
|
|
||||||
text=""
|
|
||||||
background="yellow-70"
|
|
||||||
bordercolor="yellow-70"
|
|
||||||
>
|
|
||||||
<li>Automation framework to listen change events to run automated workflows</li>
|
|
||||||
</Tile>
|
|
||||||
<Tile
|
|
||||||
title="Lineage"
|
|
||||||
text=""
|
|
||||||
background="purple-70"
|
|
||||||
bordercolor="purple-70"
|
|
||||||
link=""
|
|
||||||
size="half"
|
|
||||||
>
|
|
||||||
<li>Propagation of tags and descriptions through the column-level lineage</li>
|
|
||||||
</Tile>
|
|
||||||
|
|
||||||
<Tile
|
{% tile title="Automation" %}
|
||||||
title="Data Observability"
|
- Automation framework to listen change events to run automated workflows
|
||||||
text=""
|
{% /tile %}
|
||||||
background="purple-70"
|
|
||||||
bordercolor="purple-70"
|
{% tile title="Lineage" %}
|
||||||
>
|
- Propagation of tags and descriptions through the column-level lineage
|
||||||
<li>Notifications will be grouped into Activity vs. Alert type notifications</li>
|
{% /tile %}
|
||||||
<li>Data SLAs</li>
|
|
||||||
<li>Impact Analysis</li>
|
|
||||||
</Tile>
|
{% tile title="Data Observability" %}
|
||||||
<Tile
|
- Notifications will be grouped into Activity vs. Alert type notifications
|
||||||
title="Data Insights"
|
- Data SLAs
|
||||||
text=""
|
- Impact Analysis
|
||||||
background="pink-70"
|
{% /tile %}
|
||||||
bordercolor="pink-70"
|
|
||||||
>
|
{% tile title="Data Insights" %}
|
||||||
<li>Cost analysis report</li>
|
- Cost analysis report
|
||||||
<li>Data Deletion Report</li>
|
- Data Deletion Report
|
||||||
</Tile>
|
{% /tile %}
|
||||||
<Tile
|
|
||||||
title="Entities"
|
|
||||||
text=""
|
{% tile title="Entities" %}
|
||||||
background="green-70"
|
- Add support for Notebook Entity
|
||||||
bordercolor="green-70"
|
- Add support for Report Entity
|
||||||
>
|
{% /tile %}
|
||||||
<li> Add support for Notebook Entity </li>
|
|
||||||
<li> Add support for Report Entity </li>
|
{% tile title="Reverse Metadata **beta**" %}
|
||||||
</Tile>
|
{% /tile %}
|
||||||
<Tile
|
|
||||||
title="Reverse Metadata **beta**"
|
{% /tilesContainer %}
|
||||||
text=""
|
|
||||||
background="yellow-70"
|
|
||||||
bordercolor="blue-70"
|
|
||||||
>
|
|
||||||
</Tile>
|
|
||||||
</TileContainer>
|
|
||||||
|
|||||||
@ -11,145 +11,88 @@ and adapt to the community needs.
|
|||||||
The below roadmap is subject to change based on community needs and feedback. Please file an Issue on [GitHub](https://github.com/open-metadata/OpenMetadata/issues)
|
The below roadmap is subject to change based on community needs and feedback. Please file an Issue on [GitHub](https://github.com/open-metadata/OpenMetadata/issues)
|
||||||
or ping us on [Slack](https://slack.open-metadata.org/) If you would like to prioritize any feature or would like to add a new feature.
|
or ping us on [Slack](https://slack.open-metadata.org/) If you would like to prioritize any feature or would like to add a new feature.
|
||||||
|
|
||||||
<br></br>
|
|
||||||
|
|
||||||
You can check the latest release [here](/overview/releases).
|
You can check the latest release [here](/overview/releases).
|
||||||
|
|
||||||
|
|
||||||
## 1.0 Release - April 17th, 2023
|
## 1.0 Release - April 17th, 2023
|
||||||
|
|
||||||
<TileContainer>
|
{% tilesContainer %}
|
||||||
<Tile
|
|
||||||
title="APIs & Schema"
|
|
||||||
text=""
|
|
||||||
background="yellow-70"
|
|
||||||
bordercolor="yellow-70"
|
|
||||||
link=""
|
|
||||||
>
|
|
||||||
<li>Stabilization and Improvements to Schemas and APIs</li>
|
|
||||||
<li>Backward compatability of the APIs </li>
|
|
||||||
</Tile>
|
|
||||||
<Tile
|
|
||||||
title="Ingestion"
|
|
||||||
text=""
|
|
||||||
background="green-70"
|
|
||||||
bordercolor="green-70"
|
|
||||||
>
|
|
||||||
<li> Improved UI/UX for Connector Deployment</li>
|
|
||||||
<li> Test Connection will provide clear status on what are all the required permissions we need to extract metadat, lineage, profiler etc.. </li>
|
|
||||||
<li> Performance Improvements in fetching description, tags </li>
|
|
||||||
<li> finite control over the ingesting ownership, tags </li>
|
|
||||||
<li> dbt performance improvements </li>
|
|
||||||
<li> Support for Tableau & Looker data models </li>
|
|
||||||
<li> SSO Service accounts for ingestion will be deprecated. JWT token based authentication will be preferred </li>
|
|
||||||
</Tile>
|
|
||||||
|
|
||||||
<Tile
|
{% tile title="APIs & Schema" %}
|
||||||
title="Entities"
|
- Stabilization and Improvements to Schemas and APIs
|
||||||
text=""
|
- Backward compatability of the APIs
|
||||||
background="purple-70"
|
{% /tile %}
|
||||||
bordercolor="purple-70"
|
|
||||||
link=""
|
{% tile title="Ingestion" %}
|
||||||
>
|
- Improved UI/UX for Connector Deployment
|
||||||
<li>Object Store service, to extract the objects from storage services such as S3</li>
|
- Test Connection will provide clear status on what are all the required permissions we need to extract metadat, lineage, profiler etc..
|
||||||
<li>ElasticSearch Connector</li>
|
- Performance Improvements in fetching description, tags
|
||||||
<li>Query as Entity, Overhaul of queries UI</li>
|
- finite control over the ingesting ownership, tags
|
||||||
<li>Support for Long Entity Names such as S3 paths</li>
|
- dbt performance improvements
|
||||||
<li>Import/Export support at all entities </li>
|
- Support for Tableau & Looker data models
|
||||||
<li>Tag Propgation using Import/Export </li>
|
- SSO Service accounts for ingestion will be deprecated. JWT token based authentication will be preferred
|
||||||
<li>Data Models for Dashboards </li>
|
{% /tile %}
|
||||||
</Tile>
|
|
||||||
<Tile
|
{% tile title="Entities" %}
|
||||||
title="Glossary"
|
- Object Store service, to extract the objects from storage services such as S3
|
||||||
text=""
|
- ElasticSearch Connector
|
||||||
background="green-70"
|
- Query as Entity, Overhaul of queries UI
|
||||||
bordercolor="green-70"
|
- Support for Long Entity Names such as S3 paths
|
||||||
>
|
- Import/Export support at all entities
|
||||||
<li> Glossary & Tags Search enabled at global search</li>
|
- Tag Propgation using Import/Export
|
||||||
<li> Drag & Drop, Glossary Terms with-in Glossary and Across Glossaries </li>
|
- Data Models for Dashboards
|
||||||
<li> Add Assets to a Glossary Term from Glossary Term page </li>
|
{% /tile %}
|
||||||
</Tile>
|
|
||||||
|
{% tile title="Glossary" %}
|
||||||
<Tile
|
- Glossary & Tags Search enabled at global search
|
||||||
title="Security"
|
- Drag & Drop, Glossary Terms with-in Glossary and Across Glossaries
|
||||||
text=""
|
- Add Assets to a Glossary Term from Glossary Term page
|
||||||
background="red-70"
|
{% /tile %}
|
||||||
bordercolor="red-70"
|
|
||||||
link=""
|
{% tile title="Security" %}
|
||||||
>
|
- SAML support
|
||||||
<li>SAML support</li>
|
- User Personal Access Token to access APIs as a user
|
||||||
<li>User Personal Access Token to access APIs as a user</li>
|
{% /tile %}
|
||||||
</Tile>
|
|
||||||
<Tile
|
{% tile title="Lineage" %}
|
||||||
title="Lineage"
|
- Support for displaying large no.of nodes(1000+) in Lineage UI
|
||||||
text=""
|
- Improved Lineage UI to navigate
|
||||||
background="green-70"
|
- Continued improvements to SQL Parser to handle queries
|
||||||
bordercolor="green-70"
|
{% /tile %}
|
||||||
>
|
|
||||||
<li> Support for displaying large no.of nodes(1000+) in Lineage UI</li>
|
{% tile title="Auto Classification" %}
|
||||||
<li> Improved Lineage UI to navigate </li>
|
- PII auto classifcation using ML and NLP.
|
||||||
<li> Continued improvements to SQL Parser to handle queries </li>
|
{% /tile %}
|
||||||
</Tile>
|
|
||||||
|
{% tile title="Localization" %}
|
||||||
|
- Full support for localization in the UI
|
||||||
|
- Support for English, French, Spanish and Chinese
|
||||||
|
{% /tile %}
|
||||||
|
|
||||||
|
{% /tilesContainer %}
|
||||||
|
|
||||||
<Tile
|
|
||||||
title="Auto Classification"
|
|
||||||
text=""
|
|
||||||
background="yellow-70"
|
|
||||||
bordercolor="yellow-70"
|
|
||||||
>
|
|
||||||
<li>PII auto classifcation using ML and NLP.</li>
|
|
||||||
</Tile>
|
|
||||||
<Tile
|
|
||||||
title="Localization"
|
|
||||||
text=""
|
|
||||||
background="purple-70"
|
|
||||||
bordercolor="purple-70"
|
|
||||||
>
|
|
||||||
<li>Full support for localization in the UI</li>
|
|
||||||
<li>Support for English, French, Spanish and Chinese</li>
|
|
||||||
</Tile>
|
|
||||||
</TileContainer>
|
|
||||||
|
|
||||||
## 1.1 Release - May 18th 2023
|
## 1.1 Release - May 18th 2023
|
||||||
|
|
||||||
<TileContainer>
|
{% tilesContainer %}
|
||||||
<Tile
|
|
||||||
title="Automation"
|
|
||||||
text=""
|
|
||||||
background="yellow-70"
|
|
||||||
bordercolor="yellow-70"
|
|
||||||
>
|
|
||||||
<li>Automation framework to listen change events to run automated workflows</li>
|
|
||||||
</Tile>
|
|
||||||
<Tile
|
|
||||||
title="Lineage"
|
|
||||||
text=""
|
|
||||||
background="purple-70"
|
|
||||||
bordercolor="purple-70"
|
|
||||||
link=""
|
|
||||||
size="half"
|
|
||||||
>
|
|
||||||
<li>Propagation of tags and descriptions through the column-level lineage</li>
|
|
||||||
</Tile>
|
|
||||||
|
|
||||||
<Tile
|
{% tile title="Automation" %}
|
||||||
title="Data Observability"
|
- Automation framework to listen change events to run automated workflows
|
||||||
text=""
|
{% /tile %}
|
||||||
background="purple-70"
|
|
||||||
bordercolor="purple-70"
|
|
||||||
>
|
|
||||||
<li>Notifications will be grouped into Activity vs. Alert type notifications</li>
|
|
||||||
<li>Data SLAs</li>
|
|
||||||
<li>Impact Analysis</li>
|
|
||||||
</Tile>
|
|
||||||
|
|
||||||
<Tile
|
{% tile title="Lineage" %}
|
||||||
title="Entities"
|
- Propagation of tags and descriptions through the column-level lineage
|
||||||
text=""
|
{% /tile %}
|
||||||
background="green-70"
|
|
||||||
bordercolor="green-70"
|
{% tile title="Data Observability" %}
|
||||||
>
|
- Notifications will be grouped into Activity vs. Alert type notifications
|
||||||
<li> Add support for Notebook Entity </li>
|
- Data SLAs
|
||||||
<li> Add support for Report Entity </li>
|
- Impact Analysis
|
||||||
</Tile>
|
{% /tile %}
|
||||||
</TileContainer>
|
|
||||||
|
{% tile title="Entities" %}
|
||||||
|
- Add support for Notebook Entity
|
||||||
|
- Add support for Report Entity
|
||||||
|
{% /tile %}
|
||||||
|
|
||||||
|
{% /tilesContainer %}
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user