4.5 KiB
| title | slug |
|---|---|
| Profiler Tab | OpenMetadata Data Profiling Interface | /how-to-guides/data-quality-observability/profiler/tab |
Profiler Tab
The Data Observability tab is displayed only for Tables. It has three sub-tabs for Table Profile, Column Profile, and Data Quality.
Table Profile Tab
The table profile helps to monitor and understand the table structure. It displays the number of rows and columns in the table. You can view these details over a timeframe to understand how the table has been evolving. It displays the profile sample either as an absolute number or as a percentage of data. You also get details on the size of the data as well as when the table was created.
{% image src="/images/v1.7/how-to-guides/quality/tp.png" alt="Table Profile" caption="Table Profile" /%}
The Table Profile tab also displays timeseries graphs on Data Volume, Table Updates, and Volume Change.
Data Volume
The Data Volume chart gives an overview on how the data is evolving across a time period.
{% image src="/images/v1.7/how-to-guides/quality/dv.png" alt="Table Profile: Data Volume" caption="Table Profile: Data Volume" /%}
Table Updates
In Table Updates chart, users can view the changes that happened in the table in terms of data inserts, updates, and deletes.
{% image src="/images/v1.7/how-to-guides/quality/tu.png" alt="Table Profile: Table Updates" caption="Table Profile: Table Updates" /%}
Volume Change
In Volume Change chart, users can view the changes that happened in the table in terms of data volume for inserts, updates, and deletes.
{% image src="/images/v1.7/how-to-guides/quality/vc.png" alt="Table Profile: Volume Change" caption="Table Profile: Volume Change" /%}
Column Profile Tab
The Column Profile tab provides a summary of table metrics similar to the Table Profile tab. It displays the number of rows and columns over a period of time. It displays the profile sample either as an absolute number or as a percentage of data. You also get details on the size of the data as well as when the table was created.
The column profile helps to monitor and understand the column structure with a summary of metrics for every column. You can view the type of each column, the value count, null value %, distinct value %, unique %, the tests run as well as the test status.
{% image src="/images/v1.7/how-to-guides/quality/cp.png" alt="Column Profile of a Table" caption="Column Profile of a Table" /%}
By clicking on any column, you can view more detailed reports about that column.
{% image src="/images/v1.7/how-to-guides/quality/cp1.png" alt="Column Profile of a Column" caption="Column Profile of a Column" /%}
The Column Profile for a particular column also displays timeseries graphs on Data Counts, Data Proportions, Data Range, Data Aggregate, Data Quartiles, and Data Distribution. Based on the type of column you are viewing, you can verify the accuracy of the data values.
Data Counts
The data counts chart provides information on the Distinct Count, Null Count, Unique Count, and Values Count.
{% image src="/images/v1.7/how-to-guides/quality/dc.png" alt="Column Profile: Data Counts" caption="Column Profile: Data Counts" /%}
Data Proportions
The data proportions chart displays the Distinct, Null, and Unique Proportions.
{% image src="/images/v1.7/how-to-guides/quality/dp.png" alt="Column Profile: Data Proportions" caption="Column Profile: Data Proportions" /%}
Data Range
The length of the string that are stored in the database is profiled. The data range displays the Minimum, Maximum, and Mean values, which can be helpful for users who are doing an NLP or Text analysis.
{% image src="/images/v1.7/how-to-guides/quality/dr.png" alt="Column Profile: Data Range" caption="Column Profile: Data Range" /%}
Data Aggregate
{% image src="/images/v1.7/how-to-guides/quality/da.png" alt="Column Profile: Data Aggregate" caption="Column Profile: Data Aggregate" /%}
Data Quartiles
This chart displays the First Quartile, Median, Inter Quartile Range, and the Third Quartile.
{% image src="/images/v1.7/how-to-guides/quality/dq.png" alt="Column Profile: Data Quartiles" caption="Column Profile: Data Quartiles" /%}
Data Distribution
The distribution of the character length inside the column is displayed to help you get a sense of the structure of your data.
{% image src="/images/v1.7/how-to-guides/quality/dd.png" alt="Column Profile: Data Distribution" caption="Column Profile: Data Distribution" /%}