yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-15 02:38:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

doc: updated test cases documentation (#15325)

Browse Source
This commit is contained in:
Teddy 2024-02-23 09:22:23 +01:00 committed by GitHub
parent 6ec468def7
commit 358316917f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 167 additions and 47 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

120
openmetadata-docs/content/v1.3.x/connectors/ingestion/workflows/data-quality/tests.md
View File

@ -39,6 +39,8 @@ Validate the total row count in the table is equal to the given value.
**YAML Config**
```yaml
- name: myTestName
description: test description
testDefinitionName: tableRowCountToEqual
parameterValues:
- name: value
@ -49,6 +51,8 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"testDefinitionName": "tableRowCountToEqual",
"parameterValues": [
{
@ -79,6 +83,8 @@ Any of those two need to be informed.
**YAML Config**
```yaml
- name: myTestName
description: test description
testDefinitionName: tableRowCountToBeBetween
parameterValues:
- name: minValue
@ -91,6 +97,8 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"testDefinitionName": "tableRowCountToBeBetween",
"parameterValues": [
{
@ -122,6 +130,8 @@ Validate that the number of columns in a table is equal to a given value.
**YAML Config**
```yaml
- name: myTestName
description: test description
testDefinitionName: tableColumnCountToEqual
parameterValues:
- name: columnCount
@ -132,6 +142,8 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"testDefinitionName": "tableColumnCountToEqual",
"parameterValues": [
{
@ -160,6 +172,8 @@ Validate the number of columns in a table is between the given value
**YAML Config**
```yaml
- name: myTestName
description: test description
testDefinitionName: tableColumnCountToBeBetween
parameterValues:
- name: minColValue
@ -172,6 +186,8 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"testDefinitionName": "tableColumnCountToBeBetween",
"parameterValues": [
{
@ -203,6 +219,8 @@ Validate a column name is present in the table
**YAML Config**
```yaml
- name: myTestName
description: test description
testDefinitionName: tableColumnNameToExist
parameterValues:
- name: columnName
@ -213,6 +231,7 @@ parameterValues:
```json
{
"myTestName": "myTestName",
"testDefinitionName": "tableColumnNameToExist",
"parameterValues": [
{
@ -243,6 +262,8 @@ Validate a list of table column name matches an expected set of columns
**YAML Config**
```yaml
- name: myTestName
description: test description
testDefinitionName: tableColumnToMatchSet
parameterValues:
- name: columnNames
@ -255,6 +276,7 @@ parameterValues:
```json
{
"myTestName": "myTestName",
"testDefinitionName": "tableColumnToMatchSet",
"parameterValues": [
{
@ -303,6 +325,8 @@ WHERE lifetime_value < 0;
**YAML Config**
```yaml
- name: myTestName
description: test description
testDefinitionName: tableCustomSQLQuery
parameterValues:
- name: sqlExpression
@ -317,6 +341,8 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"testDefinitionName": "tableCustomSQLQuery",
"parameterValues": [
{
@ -354,6 +380,8 @@ The Table Row Inserted Count To Be Between cannot be executed against tables tha
**YAML Config**
```yaml
- name: myTestName
description: test description
testDefinitionName: tableRowInsertedCountToBeBetween
parameterValues:
- name: min
@ -372,6 +400,8 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"testDefinitionName": "tableRowInsertedCountToBeBetween",
"parameterValues": [
{
@ -433,6 +463,9 @@ Makes sure that there are no duplicate values in a given column.
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValuesToBeUnique
parameterValues:
- name: columnNames
@ -443,6 +476,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValuesToBeUnique",
"parameterValues": [
{
@ -470,6 +506,9 @@ Validates that there are no null values in the column.
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValuesToBeNotNull
parameterValues:
- name: columnValuesToBeNotNull
@ -480,6 +519,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValuesToBeNotNull",
"parameterValues": [
{
@ -517,6 +559,9 @@ The other databases will fall back to the `LIKE` expression
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValuesToMatchRegex
parameterValues:
- name: regex
@ -527,6 +572,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValuesToMatchRegex",
"parameterValues": [
{
@ -564,6 +612,9 @@ The other databases will fall back to the `LIKE` expression
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValuesToMatchRegex
parameterValues:
- name: forbiddenRegex
@ -574,6 +625,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValuesToMatchRegex",
"parameterValues": [
{
@ -611,6 +665,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValuesToBeInSet",
"parameterValues": [
{
@ -641,6 +698,9 @@ Validate that there are no values in a column in a set of forbidden values.
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValuesToBeNotInSet
parameterValues:
- name: forbiddenValues
@ -651,6 +711,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValuesToBeNotInSet",
"parameterValues": [
{
@ -689,6 +752,9 @@ Any of those two need to be informed.
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValuesToBeBetween
parameterValues:
- name: minValue
@ -699,6 +765,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValuesToBeBetween",
"parameterValues": [
{
@ -730,6 +799,9 @@ Validates that the number of missing values matches a given number. Missing valu
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValuesMissingCountToBeEqual
parameterValues:
- name: missingValueMatch
@ -742,6 +814,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValuesMissingCountToBeEqual",
"parameterValues": [
{
@ -763,6 +838,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValuesMissingCountToBeEqual",
"parameterValues": [
{
@ -805,6 +883,9 @@ Any of those two need to be informed.
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValueLengthsToBeBetween
parameterValues:
- name: minLength
@ -817,6 +898,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValueLengthsToBeBetween",
"parameterValues": [
{
@ -854,6 +938,9 @@ Validate the maximum value of a column is between a specific range
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValueMaxToBeBetween
parameterValues:
- name: minValueForMaxInCol
@ -866,6 +953,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValueMaxToBeBetween",
"parameterValues": [
{
@ -903,6 +993,9 @@ Validate the minimum value of a column is between a specific range
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValueMinToBeBetween
parameterValues:
- name: minValueForMinInCol
@ -915,6 +1008,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValueMinToBeBetween",
"parameterValues": [
{
@ -952,6 +1048,9 @@ Validate the mean of a column is between a specific range
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValueMeanToBeBetween
parameterValues:
- name: minValueForMeanInCol
@ -964,6 +1063,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValueMeanToBeBetween",
"parameterValues": [
{
@ -1001,6 +1103,9 @@ Validate the median of a column is between a specific range
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValueMedianToBeBetween
parameterValues:
- name: minValueForMedianInCol
@ -1013,6 +1118,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValueMedianToBeBetween",
"parameterValues": [
{
@ -1050,6 +1158,9 @@ Validate the sum of a column is between a specific range
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValueMedianToBeBetween
parameterValues:
- name: minValueForMedianInCol
@ -1062,6 +1173,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValueMedianToBeBetween",
"parameterValues": [
{
@ -1099,6 +1213,9 @@ Validate the standard deviation of a column is between a specific range
**YAML Config**
```yaml
- name: myTestName
description: test description
columnName: columnName
testDefinitionName: columnValueStdDevToBeBetween
parameterValues:
- name: minValueForStdDevInCol
@ -1111,6 +1228,9 @@ parameterValues:
```json
{
"name": "myTestName",
"description": "test description",
"columnName": "columnName",
"testDefinitionName": "columnValueStdDevToBeBetween",
"parameterValues": [
{