mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-08-31 12:39:01 +00:00
Update Roadmap (#10426)
* Update Roadmap * Update Roadmap * Update Roadmap
This commit is contained in:
Sriharsha Chintalapani
GitHub
parent
783219495f
commit
e6aa672072
@ -12,7 +12,41 @@ version. To see what's coming in next releases, please check our [Roadmap](/over
|
||||
|
||||
</Note>
|
||||
|
||||
# **[0.13.1 Release](https://github.com/open-metadata/OpenMetadata/releases/tag/0.13.1-release) - Latest - Dec 20th 2022** 🎉
|
||||
# [0.13.2 Release](https://github.com/open-metadata/OpenMetadata/releases/tag/0.13.2-release) - Latest - Jan 30th 2022 🎉
|
||||
|
||||
## Improved SQL Lineage
|
||||
- We have collaborated with the [sqllineage](https://github.com/reata/sqllineage) and [sqlfluff](https://www.sqlfluff.com/) communities
|
||||
to improve the parsing capabilities of `sqllineage`. We'll continue to collaborate to ship further improvements in new releases.
|
||||
|
||||
## New Glossary UI
|
||||
- Moved from a tree view in the left panel to an easy to navigate list of the terms sorted alphabetically.
|
||||
- The term list shows the tags and descriptions in the cards.
|
||||
|
||||
## Glossary Import & Export
|
||||
- You can now export your Glossary data as a CSV file.
|
||||
- In the same way, you can now bulk upload terms to a Glossary by adding their details in a CSV file.
|
||||
- The import utility will validate the file and show you a preview of the elements that are going to be imported to OpenMetadata.
|
||||
|
||||
## Unified Tag Category API
|
||||
- Renamed Tag Categories to Classification, a more widely used term.
|
||||
- Updated the API to conform with the rest of the specification. More info [here](https://github.com/open-metadata/OpenMetadata/issues/9259).
|
||||
|
||||
## Mutually Exclusive Tags
|
||||
- When creating a Classification or a Glossary term, you can now make the tags to be mutually exclusive.
|
||||
- If tags are set to be mutually exclusive, you won't be able to set multiple tags from the same category in the same asset.
|
||||
|
||||
## EntityName
|
||||
- Special characters
|
||||
|
||||
## Ingestion Framework
|
||||
- Performance Improvements: We are now getting descriptions in batch, making connectors such as Redshift or Snowflake way faster!
|
||||
- The Oracle connector now ships with the Thick mode enabled.
|
||||
- AWS QuickSight fixes
|
||||
- DB2 constraints and profiler improvements
|
||||
- Added support for Postgres Foreign Tables
|
||||
- Added support for Datalake profiler row-based sampling
|
||||
|
||||
# [0.13.1 Release](https://github.com/open-metadata/OpenMetadata/releases/tag/0.13.1-release) - Dec 20th 2022** 🎉
|
||||
## Profiler and Data Quality
|
||||
- Freshness Metric has been introduced. Data freshness shows DML operations performed against a table and the number of rows affected. All this is displayed within the data profiler with filterable graphs. This is currently supported for BigQuery, Snowflake, and Redshift.
|
||||
- Support has been added for data quality tests on Data Lake.
|
||||
|
||||
@ -15,133 +15,101 @@ or ping us on [Slack](https://slack.open-metadata.org/) If you would like to pri
|
||||
|
||||
You can check the latest release [here](/overview/releases).
|
||||
|
||||
## 0.13.1 Release - Dec 22nd, 2022
|
||||
|
||||
## 1.0 Release - April 6th, 2023
|
||||
|
||||
<TileContainer>
|
||||
<Tile
|
||||
title="Lineage"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
size="half"
|
||||
>
|
||||
<li>UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Data Quality"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="blue-70"
|
||||
>
|
||||
<li>Freshness based on the partition key</li>
|
||||
<li>TestCase versioning and results applying to a specific version so that UI can show the results as per the test case version</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Notifications"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
link="https://github.com/open-metadata/OpenMetadata/issues/5803"
|
||||
size="half"
|
||||
>
|
||||
<li>Improved workflow to build Alerts and filtering mechanisms</li>
|
||||
<li>Admins can now configure email templates. </li>
|
||||
<li>Admins can set up an email notification for an event, such as a schema change notification, etc..</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Glossary"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
size="half"
|
||||
>
|
||||
<li>Bulk upload of Glossary Terms</li>
|
||||
<li>Glossary Review Workflow. Owners and Reviewers can approve or deny a Glossary Term to be used. When a user adds a GlossaryTerm, it will open a task and assign it to the owner and reviewers.</li>
|
||||
<li>Propagate tags at the root of glossary terms to its children</li>
|
||||
<li>Propagate tags/glossary by tagging at the database/schema level and applying them to all the schemas/tables underneath them.</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Messaging - Kafka & Redpanda"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="blue-70"
|
||||
>
|
||||
<li>AVRO/Protobuf schema parsing and showing them in the topic entity view; currently, we show it as one payload</li>
|
||||
<li>Users will be able to add descriptions/tags at the field level</li>
|
||||
<li>Users can search based on fields in a schema of a topic.</li>
|
||||
</Tile>
|
||||
|
||||
</TileContainer>
|
||||
|
||||
|
||||
|
||||
## 1.0 Release - March 14th, 2023
|
||||
|
||||
<TileContainer>
|
||||
<Tile
|
||||
title="APIs & Schemas"
|
||||
title="APIs & Schema"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="yellow-70"
|
||||
link=""
|
||||
>
|
||||
<li>Entity Schema specification versioning</li>
|
||||
<li>Defining API backward compatability</li>
|
||||
<li>Stabilization and Improvements to Schemas and APIs</li>
|
||||
<li>Backward compatability of the APIs </li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Lineage"
|
||||
<Tile
|
||||
title="Ingestion"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
size="half"
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
>
|
||||
<li>Overhaul of lineage query parsing and improved new library</li>
|
||||
<li>UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Collaboration"
|
||||
text=""
|
||||
background="pink-70"
|
||||
bordercolor="pink-70"
|
||||
>
|
||||
<li>Improvements Task & Activity Feed</li>
|
||||
<li> Improved UI/UX for Connector Deployment</li>
|
||||
<li> Test Connection will provide clear status on what are all the required permissions we need to extract metadat, lineage, profiler etc.. </li>
|
||||
<li> Performance Improvements in fetching description, tags </li>
|
||||
<li> finite control over the ingesting ownership, tags </li>
|
||||
<li> dbt performance improvements </li>
|
||||
<li> Support for Tableau & PowerBI data models </li>
|
||||
<li> SSO Service accounts for ingestion will be deprecated. JWT token based authentication will be preferred </li>
|
||||
</Tile>
|
||||
|
||||
<Tile
|
||||
title="Entities"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
link=""
|
||||
>
|
||||
<li>Object Store service, to extract the objects from storage services such as S3</li>
|
||||
<li>ElasticSearch Connector</li>
|
||||
<li>Query as Entity, Overhaul of queries UI</li>
|
||||
<li>Support for Long Entity Names such as S3 paths</li>
|
||||
<li>Import/Export support at all entities </li>
|
||||
<li>Tag Propgation using Import/Export </li>
|
||||
<li>Data Models for Dashboards </li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Glossary"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
>
|
||||
<li> Add support for NoSQL/Json-based documents as entities. This will help integrate Cassandra/ElasticSearch etc.. services.</li>
|
||||
<li>Storage Services such as S3 and showcase buckets as independent entities</li>
|
||||
<li> Glossary & Tags Search enabled at global search</li>
|
||||
<li> Drag & Drop, Glossary Terms with-in Glossary and Across Glossaries </li>
|
||||
<li> Add Assets to a Glossary Term from Glossary Term page </li>
|
||||
</Tile>
|
||||
|
||||
<Tile
|
||||
title="Data Quality"
|
||||
title="Security"
|
||||
text=""
|
||||
background="red-70"
|
||||
bordercolor="red-70"
|
||||
link=""
|
||||
>
|
||||
<li>SAML support</li>
|
||||
<li>User Personal Access Token to access APIs as a user</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Glossary"
|
||||
text=""
|
||||
background="green-70"
|
||||
bordercolor="green-70"
|
||||
>
|
||||
<li> Glossary Import & Export</li>
|
||||
<li> Improved Glossary UI </li>
|
||||
</Tile>
|
||||
|
||||
<Tile
|
||||
title="Auto Classification"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="yellow-70"
|
||||
link="https://github.com/open-metadata/OpenMetadata/issues/4652"
|
||||
>
|
||||
<li>Complex types</li>
|
||||
<li>Add support for computing completeness</li>
|
||||
<li>Improvements to Auto Classification of entities by ML</li>
|
||||
<li>PII auto classifcation using ML and NLP.</li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Security"
|
||||
title="Localization"
|
||||
text=""
|
||||
background="purple-70"
|
||||
bordercolor="purple-70"
|
||||
>
|
||||
<li>Search results integration for roles and policies</li>
|
||||
<li>Domain based restriction and domain only view</li>
|
||||
<li>Policy improvements based on community feedback</li>
|
||||
<li>Full support for localization in the UI</li>
|
||||
<li>Support for English, French, Spanish and Chinese</li>
|
||||
</Tile>
|
||||
</TileContainer>
|
||||
|
||||
## 1.1 Release - April 18th 2023
|
||||
## 1.1 Release - May 18th 2023
|
||||
|
||||
<TileContainer>
|
||||
<Tile
|
||||
@ -191,11 +159,4 @@ You can check the latest release [here](/overview/releases).
|
||||
<li> Add support for Notebook Entity </li>
|
||||
<li> Add support for Report Entity </li>
|
||||
</Tile>
|
||||
<Tile
|
||||
title="Reverse Metadata **beta**"
|
||||
text=""
|
||||
background="yellow-70"
|
||||
bordercolor="blue-70"
|
||||
>
|
||||
</Tile>
|
||||
</TileContainer>
|
||||
</TileContainer>
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user