Last updated: July 22, 2025
List of table level uniqueness data quality checks
This is a list of uniqueness table data quality checks supported by DQOps and a brief description of what data quality issued they detect.
table-level uniqueness checks
duplicate record count
This check counts duplicate records values. It raises a data quality issue when the number of duplicates is above a minimum accepted value. The default configuration detects duplicate rows by enforcing that the min_count of duplicates is zero.
Data quality check name | Friendly name | Check type | Description | Standard |
---|---|---|---|---|
profile_duplicate_record_count |
Maximum count of duplicate records | profiling | Verifies that the number of duplicate record values in a table does not exceed the maximum accepted count. | |
daily_duplicate_record_count |
Maximum count of duplicate records | monitoring | Verifies that the number of duplicate record values in a table does not exceed the maximum accepted count. | |
monthly_duplicate_record_count |
Maximum count of duplicate records | monitoring | Verifies that the number of duplicate record values in a table does not exceed the maximum accepted count. | |
daily_partition_duplicate_record_count |
Maximum count of duplicate records | partitioned | Verifies that the number of duplicate record values in a table does not exceed the maximum accepted count. | |
monthly_partition_duplicate_record_count |
Maximum count of duplicate records | partitioned | Verifies that the number of duplicate record values in a table does not exceed the maximum accepted count. |
duplicate record percent
This check measures the percentage of duplicate records values. It raises a data quality issue when the percentage of duplicates is above a minimum accepted value. The default threshold is 0% duplicate values.
Data quality check name | Friendly name | Check type | Description | Standard |
---|---|---|---|---|
profile_duplicate_record_percent |
Maximum percentage of duplicate records | profiling | Verifies that the percentage of duplicate record values in a table does not exceed the maximum accepted percentage. | |
daily_duplicate_record_percent |
Maximum percentage of duplicate records | monitoring | Verifies that the percentage of duplicate record values in a table does not exceed the maximum accepted percentage. | |
monthly_duplicate_record_percent |
Maximum percentage of duplicate records | monitoring | Verifies that the percentage of duplicate record values in a table does not exceed the maximum accepted percentage. | |
daily_partition_duplicate_record_percent |
Maximum percentage of duplicate records | partitioned | Verifies that the percentage of duplicate record values in a table does not exceed the maximum accepted percentage. | |
monthly_partition_duplicate_record_percent |
Maximum percentage of duplicate records | partitioned | Verifies that the percentage of duplicate record values in a table does not exceed the maximum accepted percentage. |