Last updated: July 22, 2025
List of column level schema data quality checks
This is a list of schema column data quality checks supported by DQOps and a brief description of what data quality issued they detect.
column-level schema checks
Detects schema drifts such as a column is missing or the data type has changed.
column exists
A column-level check that reads the metadata of the monitored table and verifies if the column still exists in the data source. The data quality sensor returns a value of 1.0 when the column is found or 0.0 when the column is not found.
Data quality check name | Friendly name | Check type | Description | Standard |
---|---|---|---|---|
profile_column_exists |
Verify if the column exists | profiling | Checks the metadata of the monitored table and verifies if the column exists. | |
daily_column_exists |
Verify if the column exists | monitoring | Checks the metadata of the monitored table and verifies if the column exists. Stores the most recent value for each day when the data quality check was evaluated. | |
monthly_column_exists |
Verify if the column exists | monitoring | Checks the metadata of the monitored table and verifies if the column exists. Stores the most recent value for each month when the data quality check was evaluated. |
column type changed
A column-level check that detects if the data type of the column has changed since the last retrieval. This check calculates the hash of all the components of the column's data type: the data type name, length, scale, precision and nullability. A data quality issue will be detected if the hash of the column's data types has changed.
Data quality check name | Friendly name | Check type | Description | Standard |
---|---|---|---|---|
profile_column_type_changed |
Verify if the column data type has changed | profiling | Checks the metadata of the monitored column and detects if the data type (including the length, precision, scale, nullability) has changed. | |
daily_column_type_changed |
Verify if the column data type has changed | monitoring | Checks the metadata of the monitored column and detects if the data type (including the length, precision, scale, nullability) has changed since the last day. Stores the most recent hash for each day when the data quality check was evaluated. | |
monthly_column_type_changed |
Verify if the column data type has changed | monitoring | Checks the metadata of the monitored column and detects if the data type (including the length, precision, scale, nullability) has changed since the last month. Stores the most recent hash for each month when the data quality check was evaluated. |