OpenMetadata/openmetadata-docs/content/partials/v1.8/releases/1.3.0.md

1.3.0 Release

{% note noteType="Tip" %} 2024, February 5th

OpenMetadata 1.3 Release - Intuitive Lineage UI, Data Observability Alerts, Data Quality Incident Manager, Custom Metrics for Profiler, Knowledge Center Improvements, and lots more {% /note %}

You can find the GitHub release here.

{% youtube videoId="cVYP1HFXeRM" start="0:00" end="4:49" width="800px" height="450px" /%}

Lineage

{% youtube videoId="grwhvTWylbw" start="0:00" end="1:43" width="800px" height="450px" /%}

• Revamped the lineage UI for an intuitive and comprehensive view of data flow and transformations.
• Organized nodes for better visibility with pagination support.
• Improved the display of circular dependencies.
• Nodes display the service icons, highlight dbt models, and show Data Quality results.
• Lineage can be filtered to search by Ownership, Domain, Service, Service Type, Tier, and Classification Tags.
• Supports search by Column and traces lineage even when the columns are renamed.
• Enhanced user control with collapsible sub-graphs.
• Supports editing the SQL queries for lineage edges from the UI.
• Performance improvements for faster load of large graphs.

Data Observability Alerts

{% youtube videoId="qc-3sZ_eU5Y" start="0:00" end="2:04" width="800px" height="450px" /%}

• Data observability alerts have been distinguished from other general-purpose notifications, making it easy to get to the crucial alerts quickly.
• Sends alerts for schema changes and test case failures for the data assets that you follow.
• The overall flow has been simplified to let you easily create alerts for schema changes in your data.
• You can now get Data Quality alerts for specific Test Suites.
• Users will be alerted for all the changes to the data assets that they own.

Incident Manager

{% youtube videoId="wz5vc1Al-b8" start="0:00" end="2:19" width="800px" height="450px" /%}

• Introduced Incidents Manager to improve the data quality resolution flow.
• Incidents Manager summarizes all the test case results with information about the failure severity and resolution flow.
• Supports assigning a resolution task to the users in OpenMetadata.
• Tasks are created when a data quality test has been assigned to an Assignee or a Reviewer.
• Resolved test failure also displays the comments posted on the resolution.
• The Resolved Tab displays information on the Test case name, Execution date, Reason, Comments, and information on who Resolved the issue.

Knowledge Center (Collate)

{% youtube videoId="atwTGm1hixg" start="0:00" end="1:22" width="800px" height="450px" /%}

• Supports hierarchical pages to structure the articles.
• You can easily associate knowledge articles with data assets.
• The data assets page displays the related articles.
• The block editor supports callouts to add notes, warnings, tables, and task lists.
• Quicklinks are no longer separate pages; they redirect to external links.
• Data assets can be associated with Quicklinks.
• Added Search support for Knowledge articles to filter by Owner or Tags.
• Supports preview for articles and Quicklinks.

Custom Metrics for Profiler

{% youtube videoId="1sx5aQKMSBI" start="0:00" end="1:52" width="800px" height="450px" /%}

• Supports custom metrics for the data profiler with custom SQL to keep track of your business metrics.
• Custom metrics can be created at Table and Column levels.

Profiler and Data Quality

• The Profiler has been improved to support sample data ingestion without computing other metrics.
• Admins can configure the profiler to fetch up to 10,000 rows of sample data.
• Sample data can be stored in S3 buckets.
• Refined the default time range on the test case results page, adjusting it from the Last 3 days to the Last 30 days for a more encompassing view.

Connectors

• New Google Cloud Storage for storage services. (Collate)
• New Alation connector to migrate metadata into Collate. (Collate)
• New Iceberg, SAS Viya, and Doris connectors.
• Introduced the Spark Lineage Agent to extract metadata and end-to-end lineage from Spark jobs.
• MSSQL and Oracle now support Stored Procedures.
• We now exclude system indices from the Elasticsearch connector by default.
• Added support for DB2 IBM I Series.
• Pipeline services now get owner information.
• Performance improvements for the Tableau Connector.
• We now support metadata tag extraction from Databricks.
• Supports the attribute Table Owner for metadata ingestion from Postgres.
• We now extract table descriptions when ingesting metadata from Salesforce.

Glossary

• Supports soft delete for the default glossaries in OpenMetadata.
• Supports the creation of tasks to request tags or a description.
• Only the Owner can edit the Glossary term.
• Version history displays the Username instead of the User ID.

Localization

{% youtube videoId="MCjK6fZg3pw" start="0:00" end="0:36" width="800px" height="450px" /%}

• Now supports RTL UI for the Hebrew language.
• New Dutch language translation.

Settings UI

{% youtube videoId="qE07HNFXyu8" start="0:00" end="0:48" width="800px" height="450px" /%}

• The Settings page UI has been revamped.

Data Insights

• Cost Analysis expanded to support BigQuery & Redshift. (Collate)
• Improved the Data Insights Report sent via email.

Other Changes

• Announcements can be notified over email, Slack, or Teams.
• Alerts are sent to a user when they are mentioned in a task or activity feed.
• We have improved the display of search results for column matches. When searching for columns, the matched results will be displayed and highlighted in the Preview pane.
• Table Type filter has been added in the Advanced Search, so that users can exclude the temporary or staging tables from search.
• Now it is easy to filter the Data assets without a Owner.
• Database and Schema were added to the Explore menu to enhance data discovery.
• Custom properties are displayed on the right of the data asset details page.
• We now display the Domain on the Users page.
• Supports the sorting of data assets by popularity based on the number of followers and thumbs up as signals.
• OpenMetadata can now handle metric history for ML models.
• When configuring the Email settings, the Username and Password fields can be left blank.
• We now support a test email button on the Email SMTP page.