mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-08-30 20:06:19 +00:00
Fix Roadmap page (#11233)
This commit is contained in:
Milan Bariya
GitHub
parent
d1996d4260
commit
72f354b8f7
@ -11,191 +11,143 @@ and adapt to the community needs.
|
||||
The below roadmap is subject to change based on community needs and feedback. Please file an Issue on [GitHub](https://github.com/open-metadata/OpenMetadata/issues)
|
||||
or ping us on [Slack](https://slack.open-metadata.org/) If you would like to prioritize any feature or would like to add a new feature.
|
||||
|
||||
<br></br>
|
||||
|
||||
You can check the latest release [here](/overview/releases).
|
||||
|
||||
## 0.13.1 Release - Dec 22nd, 2022
|
||||
|
||||
<TileContainer>
|
||||
<Tile
|
||||
title="Lineage"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
size="half"
|
||||
>
|
||||
<li>UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Data Quality"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="blue-70"
|
||||
>
|
||||
<li>Freshness based on the partition key</li>
|
||||
<li>TestCase versioning and results applying to a specific version so that UI can show the results as per the test case version</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Notifications"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
link="https://github.com/open-metadata/OpenMetadata/issues/5803"
|
||||
size="half"
|
||||
>
|
||||
<li>Improved workflow to build Alerts and filtering mechanisms</li>
|
||||
<li>Admins can now configure email templates. </li>
|
||||
<li>Admins can set up an email notification for an event, such as a schema change notification, etc..</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Glossary"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
size="half"
|
||||
>
|
||||
<li>Bulk upload of Glossary Terms</li>
|
||||
<li>Glossary Review Workflow. Owners and Reviewers can approve or deny a Glossary Term to be used. When a user adds a GlossaryTerm, it will open a task and assign it to the owner and reviewers.</li>
|
||||
<li>Propagate tags at the root of glossary terms to its children</li>
|
||||
<li>Propagate tags/glossary by tagging at the database/schema level and applying them to all the schemas/tables underneath them.</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Messaging - Kafka & Redpanda"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="blue-70"
|
||||
>
|
||||
<li>AVRO/Protobuf schema parsing and showing them in the topic entity view; currently, we show it as one payload</li>
|
||||
<li>Users will be able to add descriptions/tags at the field level</li>
|
||||
<li>Users can search based on fields in a schema of a topic.</li>
|
||||
</Tile>
|
||||
{% tilesContainer %}
|
||||
|
||||
</TileContainer>
|
||||
{% tile title="Lineage" %}
|
||||
- UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Data Quality" %}
|
||||
- Freshness based on the partition key
|
||||
- TestCase versioning and results applying to a specific version so that UI can show the results as per the test case version
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Notifications" %}
|
||||
- Improved workflow to build Alerts and filtering mechanisms
|
||||
- Admins can now configure email templates.
|
||||
- Admins can set up an email notification for an event, such as a schema change notification, etc..
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Glossary" %}
|
||||
- Bulk upload of Glossary Terms
|
||||
- Glossary Review Workflow. Owners and Reviewers can approve or deny a Glossary Term to be used. When a user adds a GlossaryTerm, it will open a task and assign it to the owner and reviewers.
|
||||
- Propagate tags at the root of glossary terms to its children
|
||||
- Propagate tags/glossary by tagging at the database/schema level and applying them to all the schemas/tables underneath them.
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Messaging - Kafka & Redpanda" %}
|
||||
- AVRO/Protobuf schema parsing and showing them in the topic entity view; currently, we show it as one payload
|
||||
- Users will be able to add descriptions/tags at the field level
|
||||
- Users can search based on fields in a schema of a topic.
|
||||
{% /tile %}
|
||||
|
||||
|
||||
|
||||
{% /tilesContainer %}
|
||||
|
||||
|
||||
## 1.0 Release - March 14th, 2023
|
||||
|
||||
<TileContainer>
|
||||
<Tile
|
||||
title="APIs & Schemas"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="yellow-70"
|
||||
link=""
|
||||
>
|
||||
<li>Entity Schema specification versioning</li>
|
||||
<li>Defining API backward compatability</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Lineage"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
size="half"
|
||||
>
|
||||
<li>Overhaul of lineage query parsing and improved new library</li>
|
||||
<li>UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Collaboration"
|
||||
text=""
|
||||
background="pink-70"
|
||||
bordercolor="pink-70"
|
||||
>
|
||||
<li>Improvements Task & Activity Feed</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Entities"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
>
|
||||
<li> Add support for NoSQL/Json-based documents as entities. This will help integrate Cassandra/ElasticSearch etc.. services.</li>
|
||||
<li>Storage Services such as S3 and showcase buckets as independent entities</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Data Quality"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="yellow-70"
|
||||
link="https://github.com/open-metadata/OpenMetadata/issues/4652"
|
||||
>
|
||||
<li>Complex types</li>
|
||||
<li>Add support for computing completeness</li>
|
||||
<li>Improvements to Auto Classification of entities by ML</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Security"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
>
|
||||
<li>Search results integration for roles and policies</li>
|
||||
<li>Domain based restriction and domain only view</li>
|
||||
<li>Policy improvements based on community feedback</li>
|
||||
</Tile>
|
||||
</TileContainer>
|
||||
{% tilesContainer %}
|
||||
|
||||
{% tile title="APIs & Schemas" %}
|
||||
- Entity Schema specification versioning
|
||||
- Defining API backward compatability
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Lineage" %}
|
||||
- Overhaul of lineage query parsing and improved new library
|
||||
- UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Collaboration" %}
|
||||
- Improvements Task & Activity Feed
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Entities" %}
|
||||
- Add support for NoSQL/Json-based documents as entities. This will help integrate Cassandra/ElasticSearch etc.. services.
|
||||
- Storage Services such as S3 and showcase buckets as independent entities
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Data Quality" %}
|
||||
- Complex types
|
||||
- Add support for computing completeness
|
||||
- Improvements to Auto Classification of entities by ML
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Security" %}
|
||||
- Search results integration for roles and policies
|
||||
- Domain based restriction and domain only view
|
||||
- Policy improvements based on community feedback
|
||||
{% /tile %}
|
||||
|
||||
|
||||
{% /tilesContainer %}
|
||||
|
||||
|
||||
|
||||
## 1.1 Release - May 18th 2023
|
||||
|
||||
{% tilesContainer %}
|
||||
|
||||
{% tile title="Automation" %}
|
||||
- Automation framework to listen change events to run automated workflows
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Lineage" %}
|
||||
- Propagation of tags and descriptions through the column-level lineage
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Data Observability" %}
|
||||
- Notifications will be grouped into Activity vs. Alert type notifications
|
||||
- Data SLAs
|
||||
- Impact Analysis
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Entities" %}
|
||||
- Add support for Notebook Entity
|
||||
- Add support for Report Entity
|
||||
{% /tile %}
|
||||
|
||||
{% /tilesContainer %}
|
||||
|
||||
|
||||
## 1.1 Release - April 18th 2023
|
||||
|
||||
<TileContainer>
|
||||
<Tile
|
||||
title="Automation"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="yellow-70"
|
||||
>
|
||||
<li>Automation framework to listen change events to run automated workflows</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Lineage"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
size="half"
|
||||
>
|
||||
<li>Propagation of tags and descriptions through the column-level lineage</li>
|
||||
</Tile>
|
||||
{% tilesContainer %}
|
||||
|
||||
<Tile
|
||||
title="Data Observability"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
>
|
||||
<li>Notifications will be grouped into Activity vs. Alert type notifications</li>
|
||||
<li>Data SLAs</li>
|
||||
<li>Impact Analysis</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Data Insights"
|
||||
text=""
|
||||
background="pink-70"
|
||||
bordercolor="pink-70"
|
||||
>
|
||||
<li>Cost analysis report</li>
|
||||
<li>Data Deletion Report</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Entities"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
>
|
||||
<li> Add support for Notebook Entity </li>
|
||||
<li> Add support for Report Entity </li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Reverse Metadata **beta**"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="blue-70"
|
||||
>
|
||||
</Tile>
|
||||
</TileContainer>
|
||||
{% tile title="Automation" %}
|
||||
- Automation framework to listen change events to run automated workflows
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Lineage" %}
|
||||
- Propagation of tags and descriptions through the column-level lineage
|
||||
{% /tile %}
|
||||
|
||||
|
||||
{% tile title="Data Observability" %}
|
||||
- Notifications will be grouped into Activity vs. Alert type notifications
|
||||
- Data SLAs
|
||||
- Impact Analysis
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Data Insights" %}
|
||||
- Cost analysis report
|
||||
- Data Deletion Report
|
||||
{% /tile %}
|
||||
|
||||
|
||||
{% tile title="Entities" %}
|
||||
- Add support for Notebook Entity
|
||||
- Add support for Report Entity
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Reverse Metadata **beta**" %}
|
||||
{% /tile %}
|
||||
|
||||
{% /tilesContainer %}
|
||||
|
||||
@ -11,145 +11,88 @@ and adapt to the community needs.
|
||||
The below roadmap is subject to change based on community needs and feedback. Please file an Issue on [GitHub](https://github.com/open-metadata/OpenMetadata/issues)
|
||||
or ping us on [Slack](https://slack.open-metadata.org/) If you would like to prioritize any feature or would like to add a new feature.
|
||||
|
||||
<br></br>
|
||||
|
||||
You can check the latest release [here](/overview/releases).
|
||||
|
||||
|
||||
## 1.0 Release - April 17th, 2023
|
||||
|
||||
<TileContainer>
|
||||
<Tile
|
||||
title="APIs & Schema"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="yellow-70"
|
||||
link=""
|
||||
>
|
||||
<li>Stabilization and Improvements to Schemas and APIs</li>
|
||||
<li>Backward compatability of the APIs </li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Ingestion"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
>
|
||||
<li> Improved UI/UX for Connector Deployment</li>
|
||||
<li> Test Connection will provide clear status on what are all the required permissions we need to extract metadat, lineage, profiler etc.. </li>
|
||||
<li> Performance Improvements in fetching description, tags </li>
|
||||
<li> finite control over the ingesting ownership, tags </li>
|
||||
<li> dbt performance improvements </li>
|
||||
<li> Support for Tableau & Looker data models </li>
|
||||
<li> SSO Service accounts for ingestion will be deprecated. JWT token based authentication will be preferred </li>
|
||||
</Tile>
|
||||
{% tilesContainer %}
|
||||
|
||||
<Tile
|
||||
title="Entities"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
>
|
||||
<li>Object Store service, to extract the objects from storage services such as S3</li>
|
||||
<li>ElasticSearch Connector</li>
|
||||
<li>Query as Entity, Overhaul of queries UI</li>
|
||||
<li>Support for Long Entity Names such as S3 paths</li>
|
||||
<li>Import/Export support at all entities </li>
|
||||
<li>Tag Propgation using Import/Export </li>
|
||||
<li>Data Models for Dashboards </li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Glossary"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
>
|
||||
<li> Glossary & Tags Search enabled at global search</li>
|
||||
<li> Drag & Drop, Glossary Terms with-in Glossary and Across Glossaries </li>
|
||||
<li> Add Assets to a Glossary Term from Glossary Term page </li>
|
||||
</Tile>
|
||||
|
||||
<Tile
|
||||
title="Security"
|
||||
text=""
|
||||
background="red-70"
|
||||
bordercolor="red-70"
|
||||
link=""
|
||||
>
|
||||
<li>SAML support</li>
|
||||
<li>User Personal Access Token to access APIs as a user</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Lineage"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
>
|
||||
<li> Support for displaying large no.of nodes(1000+) in Lineage UI</li>
|
||||
<li> Improved Lineage UI to navigate </li>
|
||||
<li> Continued improvements to SQL Parser to handle queries </li>
|
||||
</Tile>
|
||||
{% tile title="APIs & Schema" %}
|
||||
- Stabilization and Improvements to Schemas and APIs
|
||||
- Backward compatability of the APIs
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Ingestion" %}
|
||||
- Improved UI/UX for Connector Deployment
|
||||
- Test Connection will provide clear status on what are all the required permissions we need to extract metadat, lineage, profiler etc..
|
||||
- Performance Improvements in fetching description, tags
|
||||
- finite control over the ingesting ownership, tags
|
||||
- dbt performance improvements
|
||||
- Support for Tableau & Looker data models
|
||||
- SSO Service accounts for ingestion will be deprecated. JWT token based authentication will be preferred
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Entities" %}
|
||||
- Object Store service, to extract the objects from storage services such as S3
|
||||
- ElasticSearch Connector
|
||||
- Query as Entity, Overhaul of queries UI
|
||||
- Support for Long Entity Names such as S3 paths
|
||||
- Import/Export support at all entities
|
||||
- Tag Propgation using Import/Export
|
||||
- Data Models for Dashboards
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Glossary" %}
|
||||
- Glossary & Tags Search enabled at global search
|
||||
- Drag & Drop, Glossary Terms with-in Glossary and Across Glossaries
|
||||
- Add Assets to a Glossary Term from Glossary Term page
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Security" %}
|
||||
- SAML support
|
||||
- User Personal Access Token to access APIs as a user
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Lineage" %}
|
||||
- Support for displaying large no.of nodes(1000+) in Lineage UI
|
||||
- Improved Lineage UI to navigate
|
||||
- Continued improvements to SQL Parser to handle queries
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Auto Classification" %}
|
||||
- PII auto classifcation using ML and NLP.
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Localization" %}
|
||||
- Full support for localization in the UI
|
||||
- Support for English, French, Spanish and Chinese
|
||||
{% /tile %}
|
||||
|
||||
{% /tilesContainer %}
|
||||
|
||||
<Tile
|
||||
title="Auto Classification"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="yellow-70"
|
||||
>
|
||||
<li>PII auto classifcation using ML and NLP.</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Localization"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
>
|
||||
<li>Full support for localization in the UI</li>
|
||||
<li>Support for English, French, Spanish and Chinese</li>
|
||||
</Tile>
|
||||
</TileContainer>
|
||||
|
||||
## 1.1 Release - May 18th 2023
|
||||
|
||||
<TileContainer>
|
||||
<Tile
|
||||
title="Automation"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="yellow-70"
|
||||
>
|
||||
<li>Automation framework to listen change events to run automated workflows</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Lineage"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
size="half"
|
||||
>
|
||||
<li>Propagation of tags and descriptions through the column-level lineage</li>
|
||||
</Tile>
|
||||
{% tilesContainer %}
|
||||
|
||||
<Tile
|
||||
title="Data Observability"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
>
|
||||
<li>Notifications will be grouped into Activity vs. Alert type notifications</li>
|
||||
<li>Data SLAs</li>
|
||||
<li>Impact Analysis</li>
|
||||
</Tile>
|
||||
{% tile title="Automation" %}
|
||||
- Automation framework to listen change events to run automated workflows
|
||||
{% /tile %}
|
||||
|
||||
<Tile
|
||||
title="Entities"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
>
|
||||
<li> Add support for Notebook Entity </li>
|
||||
<li> Add support for Report Entity </li>
|
||||
</Tile>
|
||||
</TileContainer>
|
||||
{% tile title="Lineage" %}
|
||||
- Propagation of tags and descriptions through the column-level lineage
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Data Observability" %}
|
||||
- Notifications will be grouped into Activity vs. Alert type notifications
|
||||
- Data SLAs
|
||||
- Impact Analysis
|
||||
{% /tile %}
|
||||
|
||||
{% tile title="Entities" %}
|
||||
- Add support for Notebook Entity
|
||||
- Add support for Report Entity
|
||||
{% /tile %}
|
||||
|
||||
{% /tilesContainer %}
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user