From e6aa672072b3371ee3661c9bbf21d76ea8d51445 Mon Sep 17 00:00:00 2001 From: Sriharsha Chintalapani Date: Fri, 3 Mar 2023 11:58:13 -0800 Subject: [PATCH] Update Roadmap (#10426) * Update Roadmap * Update Roadmap * Update Roadmap --- .../content/overview/releases/index.md | 36 +++- .../content/overview/roadmap/index.md | 165 +++++++----------- 2 files changed, 98 insertions(+), 103 deletions(-) diff --git a/openmetadata-docs/content/overview/releases/index.md b/openmetadata-docs/content/overview/releases/index.md index 4633ae27655..6f332094ede 100644 --- a/openmetadata-docs/content/overview/releases/index.md +++ b/openmetadata-docs/content/overview/releases/index.md @@ -12,7 +12,41 @@ version. To see what's coming in next releases, please check our [Roadmap](/over -# **[0.13.1 Release](https://github.com/open-metadata/OpenMetadata/releases/tag/0.13.1-release) - Latest - Dec 20th 2022** 🎉 +# [0.13.2 Release](https://github.com/open-metadata/OpenMetadata/releases/tag/0.13.2-release) - Latest - Jan 30th 2022 🎉 + +## Improved SQL Lineage +- We have collaborated with the [sqllineage](https://github.com/reata/sqllineage) and [sqlfluff](https://www.sqlfluff.com/) communities + to improve the parsing capabilities of `sqllineage`. We'll continue to collaborate to ship further improvements in new releases. + +## New Glossary UI +- Moved from a tree view in the left panel to an easy to navigate list of the terms sorted alphabetically. +- The term list shows the tags and descriptions in the cards. + +## Glossary Import & Export +- You can now export your Glossary data as a CSV file. +- In the same way, you can now bulk upload terms to a Glossary by adding their details in a CSV file. +- The import utility will validate the file and show you a preview of the elements that are going to be imported to OpenMetadata. + +## Unified Tag Category API +- Renamed Tag Categories to Classification, a more widely used term. +- Updated the API to conform with the rest of the specification. More info [here](https://github.com/open-metadata/OpenMetadata/issues/9259). + +## Mutually Exclusive Tags +- When creating a Classification or a Glossary term, you can now make the tags to be mutually exclusive. +- If tags are set to be mutually exclusive, you won't be able to set multiple tags from the same category in the same asset. + +## EntityName +- Special characters + +## Ingestion Framework +- Performance Improvements: We are now getting descriptions in batch, making connectors such as Redshift or Snowflake way faster! +- The Oracle connector now ships with the Thick mode enabled. +- AWS QuickSight fixes +- DB2 constraints and profiler improvements +- Added support for Postgres Foreign Tables +- Added support for Datalake profiler row-based sampling + +# [0.13.1 Release](https://github.com/open-metadata/OpenMetadata/releases/tag/0.13.1-release) - Dec 20th 2022** 🎉 ## Profiler and Data Quality - Freshness Metric has been introduced. Data freshness shows DML operations performed against a table and the number of rows affected. All this is displayed within the data profiler with filterable graphs. This is currently supported for BigQuery, Snowflake, and Redshift. - Support has been added for data quality tests on Data Lake. diff --git a/openmetadata-docs/content/overview/roadmap/index.md b/openmetadata-docs/content/overview/roadmap/index.md index 163edc596b1..5d7432e816b 100644 --- a/openmetadata-docs/content/overview/roadmap/index.md +++ b/openmetadata-docs/content/overview/roadmap/index.md @@ -15,133 +15,101 @@ or ping us on [Slack](https://slack.open-metadata.org/) If you would like to pri You can check the latest release [here](/overview/releases). -## 0.13.1 Release - Dec 22nd, 2022 + +## 1.0 Release - April 6th, 2023 - -
  • UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example
    • -     - -
  • Freshness based on the partition key
    • -
  • TestCase versioning and results applying to a specific version so that UI can show the results as per the test case version
    • -     -
  • Improved workflow to build Alerts and filtering mechanisms
    • -
  • Admins can now configure email templates.
    • -
  • Admins can set up an email notification for an event, such as a schema change notification, etc..
    • -     - -
  • Bulk upload of Glossary Terms
    • -
  • Glossary Review Workflow. Owners and Reviewers can approve or deny a Glossary Term to be used. When a user adds a GlossaryTerm, it will open a task and assign it to the owner and reviewers.
    • -
  • Propagate tags at the root of glossary terms to its children
    • -
  • Propagate tags/glossary by tagging at the database/schema level and applying them to all the schemas/tables underneath them.
    • -     - -
  • AVRO/Protobuf schema parsing and showing them in the topic entity view; currently, we show it as one payload
    • -
  • Users will be able to add descriptions/tags at the field level
    • -
  • Users can search based on fields in a schema of a topic.
    • -     - -     - - - -## 1.0 Release - March 14th, 2023 - - - -
  • Entity Schema specification versioning
    • -
  • Defining API backward compatability
    • +
  • Stabilization and Improvements to Schemas and APIs
    • +
  • Backward compatability of the APIs
    • - -
  • Overhaul of lineage query parsing and improved new library
    • -
  • UI Improvements to the queries collected and attached to a table. Allow users upvote a query to show as an example
    • -     - -
  • Improvements Task & Activity Feed
    • +
  • Improved UI/UX for Connector Deployment
    • +
  • Test Connection will provide clear status on what are all the required permissions we need to extract metadat, lineage, profiler etc..
    • +
  • Performance Improvements in fetching description, tags
    • +
  • finite control over the ingesting ownership, tags
    • +
  • dbt performance improvements
    • +
  • Support for Tableau & PowerBI data models
    • +
  • SSO Service accounts for ingestion will be deprecated. JWT token based authentication will be preferred
    • + +
  • Object Store service, to extract the objects from storage services such as S3
    • +
  • ElasticSearch Connector
    • +
  • Query as Entity, Overhaul of queries UI
    • +
  • Support for Long Entity Names such as S3 paths
    • +
  • Import/Export support at all entities
    • +
  • Tag Propgation using Import/Export
    • +
  • Data Models for Dashboards
    • +     + -
  • Add support for NoSQL/Json-based documents as entities. This will help integrate Cassandra/ElasticSearch etc.. services.
    • -
  • Storage Services such as S3 and showcase buckets as independent entities
    • +
  • Glossary & Tags Search enabled at global search
    • +
  • Drag & Drop, Glossary Terms with-in Glossary and Across Glossaries
    • +
  • Add Assets to a Glossary Term from Glossary Term page
    • + +
  • SAML support
    • +
  • User Personal Access Token to access APIs as a user
    • +     + +
  • Glossary Import & Export
    • +
  • Improved Glossary UI
    • +     + + -
  • Complex types
    • -
  • Add support for computing completeness
    • -
  • Improvements to Auto Classification of entities by ML
    • +
  • PII auto classifcation using ML and NLP.
    •  -
  • Search results integration for roles and policies
    • -
  • Domain based restriction and domain only view
    • -
  • Policy improvements based on community feedback
    • +
  • Full support for localization in the UI
    • +
  • Support for English, French, Spanish and Chinese
    •      -## 1.1 Release - April 18th 2023 +## 1.1 Release - May 18th 2023 Add support for Notebook Entity
  • Add support for Report Entity
    • - - -     +