yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-31 20:51:26 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Docs] - Update release information for 1.1.1 (#12748)

Browse Source
This commit is contained in:
Pere Miquel Brull 2023-08-04 09:58:38 +02:00 committed by GitHub
parent 59844c3cf6
commit e7650f133d
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
5 changed files with 91 additions and 76 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

56
openmetadata-docs/content/v1.1.1-SNAPSHOT/releases/index.md
View File

@ -3,7 +3,7 @@ title: Releases
slug: /releases slug: /releases
--- ---
# 1.1 Release 🎉 # 1.1.1 Release 🎉
{% inlineCalloutContainer %} {% inlineCalloutContainer %}
{% inlineCallout {% inlineCallout
@ -11,50 +11,36 @@ color="violet-70"
icon="celebration" icon="celebration"
bold="Upgrade OpenMetadata" bold="Upgrade OpenMetadata"
href="/deployment/upgrade" %} href="/deployment/upgrade" %}
Learn how to upgrade your OpenMetadata instance to 1.1! Learn how to upgrade your OpenMetadata instance to 1.1.1!
{% /inlineCallout %} {% /inlineCallout %}
{% /inlineCalloutContainer %} {% /inlineCalloutContainer %}
## UI Improvements ## UI Improvements
- Simplified Landing Page to make the adoption easier for new users. We’ll keep iterating on improving UX for first-time users. - User profile page UI / UX improvements
- Simplified Explore view with improved asset details section. The filtering left panel is now part of the filtering selection at the top. - Superset Connection fixes for Basic and IAM auth type
- Lineage View now supports column pagination and filtering. - Fix task flow bugs
- Views show their DDL on the Table details page. - UI / UX improvements for Service, Database, and Schema pages.
- Support custom cron for schedule ingestion
## Data Quality ## Data Quality
- Fix BigQuery, MSSQL, and Clickhouse profiling errors
- Redesigned [Data Quality Tests](https://github.com/open-metadata/OpenMetadata/issues/11592) to improve the end-user experience and prevent unnecessary duplication of tests.
- Data Quality Tests now have a **Resolution** Field. Users can acknowledge any errors, and once failures are resolved, they can document the resolution directly in the OpenMetadata UI.
- Fixed a large number of connections being opened by the profiler workflow.
- Improved Customer SQL test to allow users to set a threshold for the expected number of rows to be returned
- Allow multi project for BigQuery profiler
- Fetch table metrics from system tables when information is available
- Improved Snowflake Profiling performance of System Metrics.
## Ingestion ## Ingestion
- Fixed Airflow lineage extraction.
- Improved [SQL Lineage Parsing](https://github.com/open-metadata/OpenMetadata/issues/7427). We continue to share the OSS love by contributing to [sqllineage](https://github.com/reata/sqllineage) and [sqlfluff](https://sqlfluff.com/), the base libraries for our lineage features. - Added support for Databricks complex columns comments.
- Improved LookML metadata ingestion, with added support for projects based on Bitbucket. - Fixed Athena lineage and usage parameter validation.
- dbt bug fixes, added support for database, schema and table filtering and lineage management for ephemeral models. - Airflow Managed APIs now support Airflow 2.6
- PowerBI metadata ingestion now supports Reports and Dataset lineage from multiple workspaces.
- Improved Tableau Data Models ingestion now ingests Data Sources.
- Improved Snowflake Profiling performance of System Metrics.
- AWS Glue support for Partition Column Details.
- New Oracle lineage and usage workflows based on the query history.
- IAM role-based authentication for MySQL and Postgres RDS databases.
- Fixed dashboard description wrongly reported description as completed in the Data Insight
## Connectors ## Connectors
- New [Qliksense](qlik.com) Connector.
- New [Spline](https://absaoss.github.io/spline/) Connector to extract metadata and lineage from Spark jobs. Regardless of where the Spark execution happens, if you have configured the Spline Agent, we can send Spark metadata to OpenMetadata. - Hive supports extracting metadata directly from the metastore to speed up the execution. Users whose metastore is not exposed can still run the extraction pointing to Hive.
- New [SAP Hana](https://www.sap.com/products/technology-platform/hana/what-is-sap-hana.html) Connector, our first integration to the SAP ecosystem. - Added Usage & Lineage connector for Trino.
- New [MongoDB](https://www.mongodb.com/) Connector, extracting Collections as Tables. - Impala scheme has been deprecated from Hive connector. Users can use the Impala connector instead.
- Added support for [Databricks Unity Catalog](https://www.databricks.com/product/unity-catalog) for metadata and lineage extraction. If your Databricks instance supports the Unity Catalog, you can enable it in the Connection Details section to use this metadata extraction method instead of getting metadata out of the metastore and history APIs. - Snowflake can now ingest TRANSIENT tables.
- Added support for JSON fields in SingleStore.
## Backend ## Backend
- Bumped table and column names length
- PII masking of Sample data for Tables and Topics, Profiler Metrics, Test Cases, and Queries for users that are not admins or owners of the assets. In 1.2, we’ll iterate on this logic to add Roles & Policies support for masking PII data. - Aggregation Improvements for Search
- Name and FQN hashing of data in the database. This reduces the length of the data being stored and indexed, allowing us for longer FQNs in the Metadata Standard. - Test Suite Improvements
- Improved monitoring of the Pipeline Service Client health. Any status errors between the OpenMetadata server and the Pipeline Service Client are now surfaced in a Prometheus metric `pipelineServiceClientStatus_counter_total`
- Added AWS OpenSearch client-specific support. This allows us to update the Elasticsearch version support up to 7.16.

43
openmetadata-docs/content/v1.1.1-SNAPSHOT/releases/releases/index.md
View File

@ -12,6 +12,49 @@ version. To see what's coming in next releases, please check our [Roadmap](/rele
{% /note %} {% /note %}
# 1.1.1 Release 🎉
{% inlineCalloutContainer %}
{% inlineCallout
color="violet-70"
icon="celebration"
bold="Upgrade OpenMetadata"
href="/deployment/upgrade" %}
Learn how to upgrade your OpenMetadata instance to 1.1.1!
{% /inlineCallout %}
{% /inlineCalloutContainer %}
## UI Improvements
- User profile page UI / UX improvements
- Superset Connection fixes for Basic and IAM auth type
- Fix task flow bugs
- UI / UX improvements for Service, Database, and Schema pages.
- Support custom cron for schedule ingestion
## Data Quality
- Fix BigQuery, MSSQL, and Clickhouse profiling errors
## Ingestion
- Fixed Airflow lineage extraction.
- Added support for Databricks complex columns comments.
- Fixed Athena lineage and usage parameter validation.
- Airflow Managed APIs now support Airflow 2.6
## Connectors
- New [Qliksense](qlik.com) Connector.
- Hive supports extracting metadata directly from the metastore to speed up the execution. Users whose metastore is not exposed can still run the extraction pointing to Hive.
- Added Usage & Lineage connector for Trino.
- Impala scheme has been deprecated from Hive connector. Users can use the Impala connector instead.
- Snowflake can now ingest TRANSIENT tables.
- Added support for JSON fields in SingleStore.
## Backend
- Bumped table and column names length
- Aggregation Improvements for Search
- Test Suite Improvements
# 1.1 Release 🎉 # 1.1 Release 🎉
{% inlineCalloutContainer %} {% inlineCalloutContainer %}

56
openmetadata-docs/content/v1.1.1-SNAPSHOT/releases/releases/latest.md
View File

@ -3,7 +3,7 @@ title: Latest Release
slug: /releases/latest-release slug: /releases/latest-release
--- ---
# 1.1 Release 🎉 # 1.1.1 Release 🎉
{% inlineCalloutContainer %} {% inlineCalloutContainer %}
{% inlineCallout {% inlineCallout
@ -11,50 +11,36 @@ color="violet-70"
icon="celebration" icon="celebration"
bold="Upgrade OpenMetadata" bold="Upgrade OpenMetadata"
href="/deployment/upgrade" %} href="/deployment/upgrade" %}
Learn how to upgrade your OpenMetadata instance to 1.1! Learn how to upgrade your OpenMetadata instance to 1.1.1!
{% /inlineCallout %} {% /inlineCallout %}
{% /inlineCalloutContainer %} {% /inlineCalloutContainer %}
## UI Improvements ## UI Improvements
- Simplified Landing Page to make the adoption easier for new users. We’ll keep iterating on improving UX for first-time users. - User profile page UI / UX improvements
- Simplified Explore view with improved asset details section. The filtering left panel is now part of the filtering selection at the top. - Superset Connection fixes for Basic and IAM auth type
- Lineage View now supports column pagination and filtering. - Fix task flow bugs
- Views show their DDL on the Table details page. - UI / UX improvements for Service, Database, and Schema pages.
- Support custom cron for schedule ingestion
## Data Quality ## Data Quality
- Fix BigQuery, MSSQL, and Clickhouse profiling errors
- Redesigned [Data Quality Tests](https://github.com/open-metadata/OpenMetadata/issues/11592) to improve the end-user experience and prevent unnecessary duplication of tests.
- Data Quality Tests now have a **Resolution** Field. Users can acknowledge any errors, and once failures are resolved, they can document the resolution directly in the OpenMetadata UI.
- Fixed a large number of connections being opened by the profiler workflow.
- Improved Customer SQL test to allow users to set a threshold for the expected number of rows to be returned
- Allow multi project for BigQuery profiler
- Fetch table metrics from system tables when information is available
- Improved Snowflake Profiling performance of System Metrics.
## Ingestion ## Ingestion
- Fixed Airflow lineage extraction.
- Improved [SQL Lineage Parsing](https://github.com/open-metadata/OpenMetadata/issues/7427). We continue to share the OSS love by contributing to [sqllineage](https://github.com/reata/sqllineage) and [sqlfluff](https://sqlfluff.com/), the base libraries for our lineage features. - Added support for Databricks complex columns comments.
- Improved LookML metadata ingestion, with added support for projects based on Bitbucket. - Fixed Athena lineage and usage parameter validation.
- dbt bug fixes, added support for database, schema and table filtering and lineage management for ephemeral models. - Airflow Managed APIs now support Airflow 2.6
- PowerBI metadata ingestion now supports Reports and Dataset lineage from multiple workspaces.
- Improved Tableau Data Models ingestion now ingests Data Sources.
- Improved Snowflake Profiling performance of System Metrics.
- AWS Glue support for Partition Column Details.
- New Oracle lineage and usage workflows based on the query history.
- IAM role-based authentication for MySQL and Postgres RDS databases.
- Fixed dashboard description wrongly reported description as completed in the Data Insight
## Connectors ## Connectors
- New [Qliksense](qlik.com) Connector.
- New [Spline](https://absaoss.github.io/spline/) Connector to extract metadata and lineage from Spark jobs. Regardless of where the Spark execution happens, if you have configured the Spline Agent, we can send Spark metadata to OpenMetadata. - Hive supports extracting metadata directly from the metastore to speed up the execution. Users whose metastore is not exposed can still run the extraction pointing to Hive.
- New [SAP Hana](https://www.sap.com/products/technology-platform/hana/what-is-sap-hana.html) Connector, our first integration to the SAP ecosystem. - Added Usage & Lineage connector for Trino.
- New [MongoDB](https://www.mongodb.com/) Connector, extracting Collections as Tables. - Impala scheme has been deprecated from Hive connector. Users can use the Impala connector instead.
- Added support for [Databricks Unity Catalog](https://www.databricks.com/product/unity-catalog) for metadata and lineage extraction. If your Databricks instance supports the Unity Catalog, you can enable it in the Connection Details section to use this metadata extraction method instead of getting metadata out of the metastore and history APIs. - Snowflake can now ingest TRANSIENT tables.
- Added support for JSON fields in SingleStore.
## Backend ## Backend
- Bumped table and column names length
- PII masking of Sample data for Tables and Topics, Profiler Metrics, Test Cases, and Queries for users that are not admins or owners of the assets. In 1.2, we’ll iterate on this logic to add Roles & Policies support for masking PII data. - Aggregation Improvements for Search
- Name and FQN hashing of data in the database. This reduces the length of the data being stored and indexed, allowing us for longer FQNs in the Metadata Standard. - Test Suite Improvements
- Improved monitoring of the Pipeline Service Client health. Any status errors between the OpenMetadata server and the Pipeline Service Client are now surfaced in a Prometheus metric `pipelineServiceClientStatus_counter_total`
- Added AWS OpenSearch client-specific support. This allows us to update the Elasticsearch version support up to 7.16.

10
openmetadata-docs/content/v1.1.1-SNAPSHOT/releases/releases/supported.md
View File

@ -8,8 +8,8 @@ slug: /releases/supported
Find here a list of the supported releases from OpenMetadata. We will support the last minor version from the last three Find here a list of the supported releases from OpenMetadata. We will support the last minor version from the last three
major releases. major releases.
| Release | Release Date | | Release | Release Date |
|:-------------------|:-------------| |:--------|:-------------|
| 1.1.0 | 2023/07/04 | | 1.1.1 | 2023/07/04 |
| 1.0.5 | 2023/06/22 | | 1.0.5 | 2023/06/22 |
| 0.13.4 | 2023/05/15 | | 0.13.4 | 2023/05/15 |

2
openmetadata-docs/content/v1.1.1-SNAPSHOT/releases/roadmap/index.md
View File

@ -76,7 +76,7 @@ You can check the latest release [here](/releases/all-releases).
{% /tilesContainer %} {% /tilesContainer %}
## 1.2 Release - Aug 9th 2023 ## 1.2 Release - Oct 13th 2023
{% tilesContainer %} {% tilesContainer %}