OpenMetadata/openmetadata-docs/content/openmetadata/data-quality/tests.md

---
title: Tests
slug: /openmetadata/data-quality/tests
---

# Tests
Here you can see all the supported tests and how to configure them.

A **Test Case** adds logic to the Metrics results. A Metric is neither good nor wrong, so we need the Test definitions to map results into Success or Failures.

In this section, you will learn what tests we currently support and how to configure them.

## UI Configuration
You can navigate in the UI to a Table Entity and **Add Tests** from there. The form will help you select the type of test, the column, and its configurations.

From the **Data Quality** Tab you can create both Table and Column Tests:

<Image
    src={"/images/openmetadata/data-quality/tests/write-your-first-tests.png"}
    alt="Write your first test"
    caption="Write your first test"
/>  

<Image
    src={"/images/openmetadata/data-quality/tests/sample-form-to-create-test.png"}
    alt="Sample form to create a column test"
    caption="Sample form to create a column test"
/>  

Directly from the **Profiler** tab, you can create a Column Test in the column of your choice:

<Image
    src={"/images/openmetadata/data-quality/tests/create-test-from-profiler-tab.png"}
    alt="Create a column test from the profiler tab"
    caption="Create a column test from the profiler tab"
/>  

If you'd rather configure the tests directly in the Workflow JSON, we'll show examples for each of them below.

## Table Tests
Tests applied on top of Table Metrics.

### Table Row Count to Equal
Validate that the `rowCount` metric is equal to a given value.

**Properties**:

* `value`: Expected number of rows.

**JSON Config**

```json
"testCase": {
    "config": {
        "value": 100
    },
    "tableTestType": "tableRowCountToEqual"
}
```

### Table Row Count to be Between
Validate that the `rowCount` metric is within a given range of values.

**Properties**:

* `minValue`: Lower bound of the interval. If informed, the number of rows should be bigger than this number.
* `maxValue`: Upper bound of the interval. If informed, the number of rows should be lower than this number.

Any of those two need to be informed.

**JSON Config**

```json
"testCase": {
    "config": {
        "minValue": 10,
        "maxValue": 100
    },
    "tableTestType": "tableRowCountToBeBetween"
}
```

### Table Column Count to Equal
Validate that the number of columns in a table is equal to a given value.

**Properties**

* `columnCount`: Expected number of columns.

**JSON Config**

```json
"testCase": {
    "config": {
        "columnCount": 7
    },
    "tableTestType": "tableColumnCountToEqual"
}
```

### Table Column Count to be Between
Validate the number of colum in a table is between the given value

**Properties**

* `minColValue`: lower bound
* `maxColValue`: upper bound

**JSON Config**

```json
"testCase": {
    "config": {
        "minColValue": 1,
        "maxColValue": 10
    },
    "tableTestType": "tableColumnCountToBeBetween"
}
```

### Table Column Name to Exist
Validate a column name is present in the table

**Properties**

* `columnName`: the name of the column to check for

**JSON Config**

```json
"testCase": {
    "config": {
        "columnName": 1
    },
    "tableTestType": "tableColumnNameToExist"
}
```

### Table Column to Match Set
Validate a list of table column name matches an expected set of column

**Properties**

* `columnNames`: comma separated string of column name
* `ordered`: whether the test should check for column ordering. Default to False

**JSON Config**

```json
"testCase": {
    "config": {
        "columnNames": "col1, col2, col3",
        "ordered": true
    },
    "tableTestType": "tableColumnToMatchSet"
}
```

## Column Tests
Tests applied on top of Column metrics.

### Column Values to Be Unique
Makes sure that there are no duplicates in a given column.

**Properties**

* `columnValuesToBeUnique`: To be set as `true`. This is required for proper JSON parsing in the profiler module.

**JSON Config**

```json
"testCase": {
    "config": {
        "columnValuesToBeUnique": true
    },
    "columnTestType": "columnValuesToBeUnique"
}
```

### Column Values to Be Not Null
Validates that there are no null values in the column.

**Properties**

* `columnValuesToBeNotNull`: To be set as `true`. This is required for proper JSON parsing in the profiler module.

**JSON Config**

```json
"testCase": {
    "config": {
        "columnValuesToBeNotNull": true
    },
    "columnTestType": "columnValuesToBeNotNull"
}
```

### Column Values to Match Regex
This test allows us to specify how many values in a column we expect that will match a certain SQL `LIKE` expression.

**Properties**

* `regex`: SQL `LIKE` expression to match. E.g., `%something%`.

**JSON Config**

```json
"testCase": {
    "config": {
        "regex": "%something%"
    },
    "columnTestType": "columnValuesToMatchRegex"
}
```

### Column Values to not Match Regex
This test allows us to specify values in a column we expect that will not match a certain SQL `LIKE` expression. If the test find values matching the `forbiddenRegex` the test will fail.

**Properties**

* `forbiddenRegex`: SQL LIKE expression to match. E.g., `%something%`.

**JSON Config**

```json
"testCase": {
    "config": {
        "forbiddenRegex": "%something%"
    },
    "columnTestType": "columnValuesToNotMatchRegex"
}
```

### Column Values to Be in Set
Validate values form a set are present in a column.

**Properties**

* `allowedValues`: List of allowed strings or numbers.

**JSON Config**

```json
"testCase": {
    "config": {
        "allowedValues": ["forbidden1", "forbidden2"]
    },
    "columnTestType": "columnValuesToBeInSet"
}
```

### Column Values to Be Not In Set
Validate that there are no values in a column in a set of forbidden values.

**Properties**

* `forbiddenValues`: List of forbidden strings or numbers.

**JSON Config**

```json
"testCase": {
    "config": {
        "forbiddenValues": ["forbidden1", "forbidden2"]
    },
    "columnTestType": "columnValuesToBeNotInSet"
}
```

### Column Values to Be Between
Validate that the values of a column are within a given range.
> Only supports numerical types.

**Properties**

* `minValue`: Lower bound of the interval. If informed, the column values should be bigger than this number.
* `maxValue`: Upper bound of the interval. If informed, the column values should be lower than this number.

Any of those two need to be informed.

**JSON Config**

```json
"testCase": {
    "config": {
        "minValue": 10,
        "maxValue": 100
    },
    "columnTestType": "columnValuesToBeBetween"
}
```

### Column Values Missing Count to Be Equal
Validates that the number of missing values matches a given number. Missing values are the sum of nulls, plus the sum of values in a given list which we need to consider as missing data. A clear example of that would be `NA` or `N/A`.

**Properties**

* `missingCountValue`: The number of missing values needs to be equal to this. This field is mandatory.
* `missingValueMatch`: A list of strings to consider as missing values. Optional.

**JSON Config**

```json
"testCase": {
    "config": {
        "missingCountValue": 100,
        "missingValueMatch": ["NA", "N/A"]
    },
    "columnTestType": "columnValuesMissingCountToBeEqual"
}
```

### Column Values Lengths to Be Between
Validates that the lengths of the strings in a column are within a given range.
> Only supports concatenable types.

**Properties**

* `minLength`: Lower bound of the interval. If informed, the string length should be bigger than this number.
* `maxLength`: Upper bound of the interval. If informed, the string length should be lower than this number.

Any of those two need to be informed.

**JSON Config**

```json
"testCase": {
    "config": {
        "minLength": 4,
        "maxLength": 18
    },
    "columnTestType": "columnValueLengthsToBeBetween"
}
```

### Column Value Max to Be Between
Validate the maximum value of a column is between a specific range
> Only supports numerical types.

**Properties**

* `minValueForMaxInCol`: lower bound
* `maxValueForMaxInCol`: upper bound

**JSON Config**

```json
"testCase": {
    "config": {
        "minValueForMaxInCol": 10,
        "maxValueForMaxInCol": 50
    },
    "columnTestType": "columnValueMaxToBeBetween"
}
```

### Column Value Min to Be Between
Validate the minimum value of a column is between a specific range
> Only supports numerical types.

**Properties**

* `minValueForMinInCol`: lower bound
* `maxValueForMinInCol`: upper bound

**JSON Config**

```json
"testCase": {
    "config": {
        "minValueForMinInCol": 10,
        "maxValueForMinInCol": 50
    },
    "columnTestType": "columnValueMinToBeBetween"
}
```

### Column Value Mean to Be Between
Validate the mean of a column is between a specific range
> Only supports numerical types.

**Properties**

* `minValueForMeanInCol`: lower bound
* `maxValueForMeanInCol`: upper bound

**JSON Config**

```json
"testCase": {
    "config": {
        "minValueForMeanInCol": 10,
        "maxValueForMeanInCol": 50
    },
    "columnTestType": "columnValueMeanToBeBetween"
}
```

### Column Value Median to Be Between
Validate the median of a column is between a specific range
> Only supports numerical types.

**Properties**

* `minValueForMedianInCol`: lower bound
* `maxValueForMedianInCol`: upper bound

**JSON Config**

```json
"testCase": {
    "config": {
        "minValueForMedianInCol": 10,
        "maxValueForMedianInCol": 50
    },
    "columnTestType": "columnValueMedianToBeBetween"
}
```

### Column Values Sum to Be Between
Validate the sum of a column is between a specific range
> Only supports numerical types.

**Properties**

* `minValueForColSum`: lower bound
* `maxValueForColSum`: upper bound

**JSON Config**

```json
"testCase": {
    "config": {
        "minValueForColSum": 10,
        "maxValueForColSum": 50
    },
    "columnTestType": "columnValuesSumToBeBetween"
}
```

### Column Values Standard Deviation to Be Between
Validate the standard deviation of a column is between a specific range
> Only supports numerical types.

**Properties**

* `minValueForStdDevInCol`: lower bound
* `minValueForStdDevInCol`: upper bound

**JSON Config**

```json
"testCase": {
    "config": {
        "minValueForStdDevInCol": 10,
        "maxValueForStdDevInCol": 50
    },
    "columnTestType": "columnValueStdDevToBeBetween"
}
```