Last updated: July 22, 2025

List of column level integrity data quality checks

This is a list of integrity column data quality checks supported by DQOps and a brief description of what data quality issued they detect.

column-level integrity checks

Checks the referential integrity of a column against a column in another table.

lookup key not found

This check detects invalid values that are not present in a dictionary table. The lookup uses an outer join query within the same database. This check counts the number of values not found in the dictionary table. It raises a data quality issue when too many missing keys are discovered.

Data quality check name	Friendly name	Check type	Description	Standard
profile_lookup_key_not_found	Maximum count of rows containing values not found in a reference table (foreign key lookup)	profiling	Detects invalid values that are not present in a dictionary table using an outer join query. Counts the number of invalid keys.
daily_lookup_key_not_found	Maximum count of rows containing values not found in a reference table (foreign key lookup)	monitoring	Detects invalid values that are not present in a dictionary table using an outer join query. Counts the number of invalid keys. Stores the most recent captured value for each day when the data quality check was evaluated.
monthly_lookup_key_not_found	Maximum count of rows containing values not found in a reference table (foreign key lookup)	monitoring	Detects invalid values that are not present in a dictionary table using an outer join query. Counts the number of invalid keys. Stores the most recent check result for each month when the data quality check was evaluated.
daily_partition_lookup_key_not_found	Maximum count of rows containing values not found in a reference table (foreign key lookup)	partitioned	Detects invalid values that are not present in a dictionary table using an outer join query. Counts the number of invalid keys. Stores a separate data quality check result for each daily partition.
monthly_partition_lookup_key_not_found	Maximum count of rows containing values not found in a reference table (foreign key lookup)	partitioned	Detects invalid values that are not present in a dictionary table using an outer join query. Counts the number of invalid keys. Stores a separate data quality check result for each monthly partition.

lookup key found percent

This check detects invalid values that are not present in a dictionary table. The lookup uses an outer join query within the same database. This check measures the percentage of valid keys found in the dictionary table. It raises a data quality issue when a percentage of valid keys is below a minimum accepted threshold.

Data quality check name	Friendly name	Check type	Description	Standard
profile_lookup_key_found_percent	Minimum percentage of rows containing values not found in a reference table (foreign key lookup)	profiling	Measures the percentage of valid values that are present in a dictionary table. Joins this table to a dictionary table using an outer join.
daily_lookup_key_found_percent	Minimum percentage of rows containing values not found in a reference table (foreign key lookup)	monitoring	Measures the percentage of valid values that are present in a dictionary table. Joins this table to a dictionary table using an outer join. Stores the most recent captured value for each day when the data quality check was evaluated.
monthly_lookup_key_found_percent	Minimum percentage of rows containing values not found in a reference table (foreign key lookup)	monitoring	Measures the percentage of valid values that are present in a dictionary table. Joins this table to a dictionary table using an outer join. Stores the most recent check result for each month when the data quality check was evaluated.
daily_partition_lookup_key_found_percent	Minimum percentage of rows containing values not found in a reference table (foreign key lookup)	partitioned	Measures the percentage of valid values that are present in a dictionary table. Joins this table to a dictionary table using an outer join. Stores a separate data quality check result for each daily partition.
monthly_partition_lookup_key_found_percent	Minimum percentage of rows containing values not found in a reference table (foreign key lookup)	partitioned	Measures the percentage of valid values that are present in a dictionary table. Joins this table to a dictionary table using an outer join. Stores a separate data quality check result for each monthly partition.