Last updated: July 22, 2025
List of column level nulls data quality checks
This is a list of nulls column data quality checks supported by DQOps and a brief description of what data quality issued they detect.
column-level nulls checks
Checks for the presence of null or missing values in a column.
nulls count
Detects incomplete columns that contain any null values. Counts the number of rows having a null value. Raises a data quality issue when the count of null values is above a max_count threshold.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_nulls_count |
Maximum count of rows containing null values (incomplete column) | profiling | Detects incomplete columns that contain any null values. Counts the number of rows having a null value. Raises a data quality issue when the count of null values is above a max_count threshold. | |
daily_nulls_count |
Maximum count of rows containing null values (incomplete column) | monitoring | Detects incomplete columns that contain any null values. Counts the number of rows having a null value. Raises a data quality issue when the count of null values is above a max_count threshold. Stores the most recent captured value for each day when the data quality check was evaluated. | |
monthly_nulls_count |
Maximum count of rows containing null values (incomplete column) | monitoring | Detects incomplete columns that contain any null values. Counts the number of rows having a null value. Raises a data quality issue when the count of null values is above a max_count threshold.. Stores the most recent count check result for each month when the data quality check was evaluated. | |
daily_partition_nulls_count |
Maximum count of rows containing null values (incomplete column) | partitioned | Detects incomplete columns that contain any null values. Counts the number of rows having a null value. Raises a data quality issue when the count of null values is above a max_count threshold. Stores a separate data quality check result for each daily partition. | |
monthly_partition_nulls_count |
Maximum count of rows containing null values (incomplete column) | partitioned | Detects incomplete columns that contain any null values. Counts the number of rows having a null value. Raises a data quality issue when the count of null values is above a max_count threshold. Stores a separate data quality check result for each monthly partition. |
nulls percent
Detects incomplete columns that contain any null values. Measures the percentage of rows having a null value. Raises a data quality issue when the percentage of null values is above a max_percent threshold. Configure this check to accept a given percentage of null values by setting the max_percent parameter.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_nulls_percent |
Maximum percentage of rows containing null values (incomplete column) | profiling | Detects incomplete columns that contain any null values. Measures the percentage of rows having a null value. Raises a data quality issue when the percentage of null values is above a max_percent threshold. | |
daily_nulls_percent |
Maximum percentage of rows containing null values (incomplete column) | monitoring | Detects incomplete columns that contain any null values. Measures the percentage of rows having a null value. Raises a data quality issue when the percentage of null values is above a max_percent threshold. Stores the most recent captured value for each day when the data quality check was evaluated. | |
monthly_nulls_percent |
Maximum percentage of rows containing null values (incomplete column) | monitoring | Detects incomplete columns that contain any null values. Measures the percentage of rows having a null value. Raises a data quality issue when the percentage of null values is above a max_percent threshold. Stores the most recent check result for each month when the data quality check was evaluated. | |
daily_partition_nulls_percent |
Maximum percentage of rows containing null values (incomplete column) | partitioned | Detects incomplete columns that contain any null values. Measures the percentage of rows having a null value. Raises a data quality issue when the percentage of null values is above a max_percent threshold. Stores a separate data quality check result for each daily partition. | |
monthly_partition_nulls_percent |
Maximum percentage of rows containing null values (incomplete column) | partitioned | Detects incomplete columns that contain any null values. Measures the percentage of rows having a null value. Raises a data quality issue when the percentage of null values is above a max_percent threshold. Stores a separate data quality check result for each monthly partition. |
nulls percent anomaly
Detects day-to-day anomalies in the percentage of null values. Measures the percentage of rows having a null value. Raises a data quality issue when the rate of null values increases or decreases too much.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_nulls_percent_anomaly |
Abnormal change in percentage of null values. Measured as a percentile of anomalous measures. | profiling | Detects day-to-day anomalies in the percentage of null values. Raises a data quality issue when the rate of null values increases or decreases too much during the last 90 days. | |
daily_nulls_percent_anomaly |
Abnormal change in percentage of null values. Measured as a percentile of anomalous measures. | monitoring | Detects day-to-day anomalies in the percentage of null values. Raises a data quality issue when the rate of null values increases or decreases too much during the last 90 days. | |
daily_partition_nulls_percent_anomaly |
Abnormal change in percentage of null values. Measured as a percentile of anomalous measures. | partitioned | Detects day-to-day anomalies in the percentage of null values. Raises a data quality issue when the rate of null values increases or decreases too much during the last 90 days. |
not nulls count
Verifies that a column contains a minimum number of non-null values. The default value of the min_count parameter is 1 to detect at least one value in a monitored column.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_not_nulls_count |
Minimum count of rows containing non-null values | profiling | Verifies that a column contains a minimum number of non-null values. The default value of the min_count parameter is 1 to detect at least one value in a monitored column. Raises a data quality issue when the count of non-null values is below min_count. | |
daily_not_nulls_count |
Minimum count of rows containing non-null values | monitoring | Verifies that a column contains a minimum number of non-null values. The default value of the min_count parameter is 1 to detect at least one value in a monitored column. Raises a data quality issue when the count of non-null values is below min_count. Stores the most recent captured value for each day when the data quality check was evaluated. | |
monthly_not_nulls_count |
Minimum count of rows containing non-null values | monitoring | Verifies that a column contains a minimum number of non-null values. The default value of the min_count parameter is 1 to detect at least one value in a monitored column. Raises a data quality issue when the count of non-null values is below min_count. Stores the most recent check result for each month when the data quality check was evaluated. | |
daily_partition_not_nulls_count |
Minimum count of rows containing non-null values | partitioned | Verifies that a column contains a minimum number of non-null values. The default value of the min_count parameter is 1 to detect at least one value in a monitored column. Raises a data quality issue when the count of non-null values is below min_count. Stores a separate data quality check result for each daily partition. | |
monthly_partition_not_nulls_count |
Minimum count of rows containing non-null values | partitioned | Verifies that a column contains a minimum number of non-null values. The default value of the min_count parameter is 1 to detect at least one value in a monitored column. Raises a data quality issue when the count of non-null values is below min_count. Stores a separate data quality check result for each monthly partition. |
not nulls percent
Verifies that a column contains some null values by measuring the maximum percentage of rows that have non-null values. Raises a data quality issue when the percentage of non-null values is above max_percentage, which means that a column that is expected to have null values is The default value of the max_percentage parameter is 0.0, but DQOps supports setting a higher value to verify that the percentage of null values is not above a threshold.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_not_nulls_percent |
Maximum percentage of rows containing non-null values | profiling | Detects columns that contain too many non-null values. Measures the percentage of rows that have non-null values. Raises a data quality issue when the percentage of non-null values is above max_percentage. | |
daily_not_nulls_percent |
Maximum percentage of rows containing non-null values | monitoring | Detects columns that contain too many non-null values. Measures the percentage of rows that have non-null values. Raises a data quality issue when the percentage of non-null values is above max_percentage. | |
monthly_not_nulls_percent |
Maximum percentage of rows containing non-null values | monitoring | Detects columns that contain too many non-null values. Measures the percentage of rows that have non-null values. Raises a data quality issue when the percentage of non-null values is above max_percentage. Stores the most recent check result for each month when the data quality check was evaluated. | |
daily_partition_not_nulls_percent |
Maximum percentage of rows containing non-null values | partitioned | Detects columns that contain too many non-null values. Measures the percentage of rows that have non-null values. Raises a data quality issue when the percentage of non-null values is above max_percentage. Stores a separate data quality check result for each daily partition. | |
monthly_partition_not_nulls_percent |
Maximum percentage of rows containing non-null values | partitioned | Detects columns that contain too many non-null values. Measures the percentage of rows that have non-null values. Raises a data quality issue when the percentage of non-null values is above max_percentage. Stores a separate data quality check result for each monthly partition. |
empty column found
Detects empty columns that contain only null values. Counts the number of rows that have non-null values. Raises a data quality issue when the count of non-null values is below min_count. The default value of the min_count parameter is 1, but DQOps supports setting a higher number to assert that a column has at least that many non-null values.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_empty_column_found |
Find an empty column | profiling | Detects empty columns that contain only null values. Counts the number of rows that have non-null values. Raises a data quality issue when the column is empty. | |
daily_empty_column_found |
Find an empty column | monitoring | Detects empty columns that contain only null values. Counts the number of rows that have non-null values. Raises a data quality issue when the column is empty. Stores the most recent captured value for each day when the data quality check was evaluated. | |
monthly_empty_column_found |
Find an empty column | monitoring | Detects empty columns that contain only null values. Counts the number of rows that have non-null values. Raises a data quality issue when the column is empty. Stores the most recent check result for each month when the data quality check was evaluated. | |
daily_partition_empty_column_found |
Find an empty column | partitioned | Detects empty columns that contain only null values. Counts the number of rows that have non-null values. Raises a data quality issue when the column is empty. Stores a separate data quality check result for each daily partition. | |
monthly_partition_empty_column_found |
Find an empty column | partitioned | Detects empty columns that contain only null values. Counts the number of rows that have non-null values. Raises a data quality issue when the column is empty. Stores a separate data quality check result for each monthly partition. |
nulls percent change
Detects relative increases or decreases in the percentage of null values since the last measured percentage. Measures the percentage of null values for each day. Raises a data quality issue when the change in the percentage of null values is above max_percent of the previous percentage.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_nulls_percent_change |
Maximum percentage of change in the count of null values | profiling | Verifies that the null percent value in a column changed in a fixed rate since last readout. | |
daily_nulls_percent_change |
Maximum percentage of change in the count of null values | monitoring | Verifies that the null percent value in a column changed in a fixed rate since the last readout. | |
daily_partition_nulls_percent_change |
Maximum percentage of change in the count of null values | partitioned | Verifies that the null percent value in a column changed in a fixed rate since last readout. |
nulls percent change 1 day
Detects relative increases or decreases in the percentage of null values since the previous day. Measures the percentage of null values for each day. Raises a data quality issue when the change in the percentage of null values is above max_percent of the previous percentage.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_nulls_percent_change_1_day |
Maximum percentage of change in the count of null values vs 1 day ago | profiling | Verifies that the null percent value in a column changed in a fixed rate since last readout from yesterday. | |
daily_nulls_percent_change_1_day |
Maximum percentage of change in the count of null values vs 1 day ago | monitoring | Verifies that the null percent value in a column changed in a fixed rate since the last readout from yesterday. | |
daily_partition_nulls_percent_change_1_day |
Maximum percentage of change in the count of null values vs 1 day ago | partitioned | Verifies that the null percent value in a column changed in a fixed rate since the last readout from yesterday. |
nulls percent change 7 days
Detects relative increases or decreases in the percentage of null values since the last week (seven days ago). Measures the percentage of null values for each day. Raises a data quality issue when the change in the percentage of null values is above max_percent of the previous percentage.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_nulls_percent_change_7_days |
Maximum percentage of change in the count of null values vs 7 day ago | profiling | Verifies that the null percent value in a column changed in a fixed rate since last readout from last week. | |
daily_nulls_percent_change_7_days |
Maximum percentage of change in the count of null values vs 7 day ago | monitoring | Verifies that the null percent value in a column changed in a fixed rate since the last readout from the last week. | |
daily_partition_nulls_percent_change_7_days |
Maximum percentage of change in the count of null values vs 7 day ago | partitioned | Verifies that the null percent value in a column changed in a fixed rate since the last readout from the last week. |
nulls percent change 30 days
Detects relative increases or decreases in the percentage of null values since the last month (30 days ago). Measures the percentage of null values for each day. Raises a data quality issue when the change in the percentage of null values is above max_percent of the previous percentage.
| Data quality check name | Friendly name | Check type | Description | Standard |
|---|---|---|---|---|
profile_nulls_percent_change_30_days |
Maximum percentage of change in the count of null values vs 30 day ago | profiling | Verifies that the null percent value in a column changed in a fixed rate since last readout from last month. | |
daily_nulls_percent_change_30_days |
Maximum percentage of change in the count of null values vs 30 day ago | monitoring | Verifies that the null percent value in a column changed in a fixed rate since the last readout from the last month. | |
daily_partition_nulls_percent_change_30_days |
Maximum percentage of change in the count of null values vs 30 day ago | partitioned | Verifies that the null percent value in a column changed in a fixed rate since the last readout from the last month. |