column daily recurring checks

ColumnDailyRecurringCheckCategoriesSpec

Container of column level daily recurring checks. Contains categories of daily recurring checks.

The structure of this object is described below

Property name	Description	Data type
nulls	Daily recurring checks of nulls in the column	ColumnNullsDailyRecurringChecksSpec
numeric	Daily recurring checks of numeric in the column	ColumnNumericDailyRecurringChecksSpec
strings	Daily recurring checks of strings in the column	ColumnStringsDailyRecurringChecksSpec
uniqueness	Daily recurring checks of uniqueness in the column	ColumnUniquenessDailyRecurringChecksSpec
datetime	Daily recurring checks of datetime in the column	ColumnDatetimeDailyRecurringChecksSpec
pii	Daily recurring checks of Personal Identifiable Information (PII) in the column	ColumnPiiDailyRecurringChecksSpec
sql	Daily recurring checks of custom SQL checks in the column	ColumnSqlDailyRecurringChecksSpec
bool	Daily recurring checks of booleans in the column	ColumnBoolDailyRecurringChecksSpec
integrity	Daily recurring checks of integrity in the column	ColumnIntegrityDailyRecurringChecksSpec
accuracy	Daily recurring checks of accuracy in the column	ColumnAccuracyDailyRecurringChecksSpec
datatype	Daily recurring checks of datatype in the column	ColumnDatatypeDailyRecurringChecksSpec
anomaly	Daily recurring checks of anomaly in the column	ColumnAnomalyDailyRecurringChecksSpec
schema	Daily recurring column schema checks	ColumnSchemaDailyRecurringChecksSpec
comparisons	Dictionary of configuration of checks for table comparisons at a column level. The key that identifies each comparison must match the name of a data comparison that is configured on the parent table.	ColumnComparisonDailyRecurringChecksSpecMap
custom	Dictionary of custom checks. The keys are check names.	CustomCheckSpecMap

ColumnDatetimeDailyRecurringChecksSpec

Container of date-time data quality recurring checks on a column level that are checking at a daily level.

The structure of this object is described below

Property name	Description	Data type	Enum values	Default value	Sample values
daily_date_values_in_future_percent	Verifies that the percentage of date values in future in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnDateValuesInFuturePercentCheckSpec
daily_datetime_value_in_range_date_percent	Verifies that the percentage of date values in the range defined by the user in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnDatetimeValueInRangeDatePercentCheckSpec

ColumnNumericDailyRecurringChecksSpec

Container of built-in preconfigured data quality recurring on a column level that are checking numeric values at a daily level.

The structure of this object is described below

Property name	Description	Data type
daily_negative_count	Verifies that the number of negative values in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnNegativeCountCheckSpec
daily_negative_percent	Verifies that the percentage of negative values in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnNegativePercentCheckSpec
daily_non_negative_count	Verifies that the number of non-negative values in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnNonNegativeCountCheckSpec
daily_non_negative_percent	Verifies that the percentage of non-negative values in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnNonNegativePercentCheckSpec
daily_expected_numbers_in_use_count	Verifies that the expected numeric values were found in the column. Raises a data quality issue when too many expected values were not found (were missing). Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnExpectedNumbersInUseCountCheckSpec
daily_number_value_in_set_percent	The check measures the percentage of rows whose value in a tested column is one of values from a list of expected values or the column value is null. Verifies that the percentage of rows having a valid column value does not exceed the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnNumberValueInSetPercentCheckSpec
daily_values_in_range_numeric_percent	Verifies that the percentage of values from range in a column does not exceed the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnValuesInRangeNumericPercentCheckSpec
daily_values_in_range_integers_percent	Verifies that the percentage of values from range in a column does not exceed the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnValuesInRangeIntegersPercentCheckSpec
daily_value_below_min_value_count	The check counts the number of values in the column that is below the value defined by the user as a parameter. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnValueBelowMinValueCountCheckSpec
daily_value_below_min_value_percent	The check counts the percentage of values in the column that is below the value defined by the user as a parameter. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnValueBelowMinValuePercentCheckSpec
daily_value_above_max_value_count	The check counts the number of values in the column that is above the value defined by the user as a parameter. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnValueAboveMaxValueCountCheckSpec
daily_value_above_max_value_percent	The check counts the percentage of values in the column that is above the value defined by the user as a parameter. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnValueAboveMaxValuePercentCheckSpec
daily_max_in_range	Verifies that the maximal value in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnMaxInRangeCheckSpec
daily_min_in_range	Verifies that the minimal value in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnMinInRangeCheckSpec
daily_mean_in_range	Verifies that the average (mean) of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnMeanInRangeCheckSpec
daily_percentile_in_range	Verifies that the percentile of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPercentileInRangeCheckSpec
daily_median_in_range	Verifies that the median of all values in a column is not outside the set range. Stores the most recent row count for each month when the data quality check was evaluated.	ColumnMedianInRangeCheckSpec
daily_percentile_10_in_range	Verifies that the percentile 10 of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPercentile10InRangeCheckSpec
daily_percentile_25_in_range	Verifies that the percentile 25 of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPercentile25InRangeCheckSpec
daily_percentile_75_in_range	Verifies that the percentile 75 of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPercentile75InRangeCheckSpec
daily_percentile_90_in_range	Verifies that the percentile 90 of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPercentile90InRangeCheckSpec
daily_sample_stddev_in_range	Verifies that the sample standard deviation of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnSampleStddevInRangeCheckSpec
daily_population_stddev_in_range	Verifies that the population standard deviation of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPopulationStddevInRangeCheckSpec
daily_sample_variance_in_range	Verifies that the sample variance of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnSampleVarianceInRangeCheckSpec
daily_population_variance_in_range	Verifies that the population variance of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPopulationVarianceInRangeCheckSpec
daily_sum_in_range	Verifies that the sum of all values in a column is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnSumInRangeCheckSpec
daily_invalid_latitude_count	Verifies that the number of invalid latitude values in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnInvalidLatitudeCountCheckSpec
daily_valid_latitude_percent	Verifies that the percentage of valid latitude values in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnValidLatitudePercentCheckSpec
daily_invalid_longitude_count	Verifies that the number of invalid longitude values in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnInvalidLongitudeCountCheckSpec
daily_valid_longitude_percent	Verifies that the percentage of valid longitude values in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnValidLongitudePercentCheckSpec

ColumnUniquenessDailyRecurringChecksSpec

Container of uniqueness data quality recurring checks on a column level that are checking at a daily level.

The structure of this object is described below

Property name	Description	Data type
daily_distinct_count	Verifies that the number of distinct values in a column does not fall below the minimum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnDistinctCountCheckSpec
daily_distinct_percent	Verifies that the percentage of distinct values in a column does not fall below the minimum accepted percent. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnDistinctPercentCheckSpec
daily_duplicate_count	Verifies that the number of duplicate values in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnDuplicateCountCheckSpec
daily_duplicate_percent	Verifies that the percentage of duplicate values in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnDuplicatePercentCheckSpec

ColumnPiiDailyRecurringChecksSpec

Container of PII data quality recurring checks on a column level that are checking at a daily level.

The structure of this object is described below

Property name	Description	Data type
daily_valid_usa_phone_percent	Verifies that the percentage of valid USA phone values in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiValidUsaPhonePercentCheckSpec
daily_contains_usa_phone_percent	Verifies that the percentage of rows that contains a USA phone number in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiContainsUsaPhonePercentCheckSpec
daily_valid_usa_zipcode_percent	Verifies that the percentage of valid USA zip code values in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiValidUsaZipcodePercentCheckSpec
daily_contains_usa_zipcode_percent	Verifies that the percentage of rows that contains a USA zip code in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiContainsUsaZipcodePercentCheckSpec
daily_valid_email_percent	Verifies that the percentage of valid emails values in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiValidEmailPercentCheckSpec
daily_contains_email_percent	Verifies that the percentage of rows that contains emails in a column does not exceed the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiContainsEmailPercentCheckSpec
daily_valid_ip4_address_percent	Verifies that the percentage of valid IP4 address values in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiValidIp4AddressPercentCheckSpec
daily_contains_ip4_percent	Verifies that the percentage of rows that contains IP4 address values in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiContainsIp4PercentCheckSpec
daily_valid_ip6_address_percent	Verifies that the percentage of valid IP6 address values in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiValidIp6AddressPercentCheckSpec
daily_contains_ip6_percent	Verifies that the percentage of rows that contains valid IP6 address values in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnPiiContainsIp6PercentCheckSpec

ColumnAnomalyDailyRecurringChecksSpec

Container of built-in preconfigured data quality checks on a column level for detecting anomalies.

The structure of this object is described below

Property name	Description	Data type
daily_mean_anomaly_stationary_30_days	Verifies that the mean value in a column changes in a rate within a percentile boundary during last 30 days.	ColumnAnomalyStationaryMean30DaysCheckSpec
daily_mean_anomaly_stationary	Verifies that the mean value in a column changes in a rate within a percentile boundary during last 90 days.	ColumnAnomalyStationaryMeanCheckSpec
daily_median_anomaly_stationary_30_days	Verifies that the median in a column changes in a rate within a percentile boundary during last 30 days.	ColumnAnomalyStationaryMedian30DaysCheckSpec
daily_median_anomaly_stationary	Verifies that the median in a column changes in a rate within a percentile boundary during last 90 days.	ColumnAnomalyStationaryMedianCheckSpec
daily_sum_anomaly_differencing_30_days	Verifies that the sum in a column changes in a rate within a percentile boundary during last 30 days.	ColumnAnomalyDifferencingSum30DaysCheckSpec
daily_sum_anomaly_differencing	Verifies that the sum in a column changes in a rate within a percentile boundary during last 90 days.	ColumnAnomalyDifferencingSumCheckSpec
daily_mean_change	Verifies that the mean value in a column changed in a fixed rate since last readout.	ColumnChangeMeanCheckSpec
daily_mean_change_yesterday	Verifies that the mean value in a column changed in a fixed rate since last readout from yesterday.	ColumnChangeMeanSinceYesterdayCheckSpec
daily_mean_change_7_days	Verifies that the mean value in a column changed in a fixed rate since last readout from last week.	ColumnChangeMeanSince7DaysCheckSpec
daily_mean_change_30_days	Verifies that the mean value in a column changed in a fixed rate since last readout from last month.	ColumnChangeMeanSince30DaysCheckSpec
daily_median_change	Verifies that the median in a column changed in a fixed rate since last readout.	ColumnChangeMedianCheckSpec
daily_median_change_yesterday	Verifies that the median in a column changed in a fixed rate since last readout from yesterday.	ColumnChangeMedianSinceYesterdayCheckSpec
daily_median_change_7_days	Verifies that the median in a column changed in a fixed rate since last readout from last week.	ColumnChangeMedianSince7DaysCheckSpec
daily_median_change_30_days	Verifies that the median in a column changed in a fixed rate since last readout from last month.	ColumnChangeMedianSince30DaysCheckSpec
daily_sum_change	Verifies that the sum in a column changed in a fixed rate since last readout.	ColumnChangeSumCheckSpec
daily_sum_change_yesterday	Verifies that the sum in a column changed in a fixed rate since last readout from yesterday.	ColumnChangeSumSinceYesterdayCheckSpec
daily_sum_change_7_days	Verifies that the sum in a column changed in a fixed rate since last readout from last week.	ColumnChangeSumSince7DaysCheckSpec
daily_sum_change_30_days	Verifies that the sum in a column changed in a fixed rate since last readout from last month.	ColumnChangeSumSince30DaysCheckSpec

ColumnNullsDailyRecurringChecksSpec

Container of nulls data quality recurring checks on a column level that are checking at a daily level.

The structure of this object is described below

Property name	Description	Data type
daily_nulls_count	Verifies that the number of null values in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnNullsCountCheckSpec
daily_nulls_percent	Verifies that the percentage of nulls in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnNullsPercentCheckSpec
daily_nulls_percent_anomaly_stationary_30_days	Verifies that the null percent value in a column changes in a rate within a percentile boundary during last 30 days.	ColumnAnomalyStationaryNullPercent30DaysCheckSpec
daily_nulls_percent_anomaly_stationary	Verifies that the null percent value in a column changes in a rate within a percentile boundary during last 90 days.	ColumnAnomalyStationaryNullPercentCheckSpec
daily_nulls_percent_change	Verifies that the null percent value in a column changed in a fixed rate since last readout.	ColumnChangeNullPercentCheckSpec
daily_nulls_percent_change_yesterday	Verifies that the null percent value in a column changed in a fixed rate since last readout from yesterday.	ColumnChangeNullPercentSinceYesterdayCheckSpec
daily_nulls_percent_change_7_days	Verifies that the null percent value in a column changed in a fixed rate since last readout from last week.	ColumnChangeNullPercentSince7DaysCheckSpec
daily_nulls_percent_change_30_days	Verifies that the null percent value in a column changed in a fixed rate since last readout from last month.	ColumnChangeNullPercentSince30DaysCheckSpec
daily_not_nulls_count	Verifies that the number of not null values in a column does not fall below the minimum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnNotNullsCountCheckSpec
daily_not_nulls_percent	Verifies that the percentage of not nulls in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnNotNullsPercentCheckSpec

ColumnAccuracyDailyRecurringChecksSpec

Container of accuracy data quality recurring checks on a column level that are checking at a daily level.

The structure of this object is described below

Property name	Description	Data type
daily_total_sum_match_percent	Verifies that the percentage of difference in total sum of a column in a table and total sum of a column of another table does not exceed the set number. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnAccuracyTotalSumMatchPercentCheckSpec
daily_total_min_match_percent	Verifies that the percentage of difference in total min of a column in a table and total min of a column of another table does not exceed the set number. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnAccuracyTotalMinMatchPercentCheckSpec
daily_total_max_match_percent	Verifies that the percentage of difference in total max of a column in a table and total max of a column of another table does not exceed the set number. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnAccuracyTotalMaxMatchPercentCheckSpec
daily_total_average_match_percent	Verifies that the percentage of difference in total average of a column in a table and total average of a column of another table does not exceed the set number. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnAccuracyTotalAverageMatchPercentCheckSpec
daily_total_not_null_count_match_percent	Verifies that the percentage of difference in total not null count of a column in a table and total not null count of a column of another table does not exceed the set number. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnAccuracyTotalNotNullCountMatchPercentCheckSpec

ColumnStringsDailyRecurringChecksSpec

Container of strings data quality recurring checks on a column level that are checking at a daily level.

The structure of this object is described below

Property name	Description	Data type
daily_string_max_length	Verifies that the length of string in a column does not exceed the maximum accepted length. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringMaxLengthCheckSpec
daily_string_min_length	Verifies that the length of string in a column does not fall below the minimum accepted length. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringMinLengthCheckSpec
daily_string_mean_length	Verifies that the length of string in a column does not exceed the mean accepted length. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringMeanLengthCheckSpec
daily_string_length_below_min_length_count	The check counts the number of strings in the column that is below the length defined by the user as a parameter. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringLengthBelowMinLengthCountCheckSpec
daily_string_length_below_min_length_percent	The check counts the percentage of strings in the column that is below the length defined by the user as a parameter. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringLengthBelowMinLengthPercentCheckSpec
daily_string_length_above_max_length_count	The check counts the number of strings in the column that is above the length defined by the user as a parameter. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringLengthAboveMaxLengthCountCheckSpec
daily_string_length_above_max_length_percent	The check counts the percentage of strings in the column that is above the length defined by the user as a parameter. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringLengthAboveMaxLengthPercentCheckSpec
daily_string_length_in_range_percent	The check counts the percentage of those strings with length in the range provided by the user in the column. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringLengthInRangePercentCheckSpec
daily_string_empty_count	Verifies that the number of empty strings in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringEmptyCountCheckSpec
daily_string_empty_percent	Verifies that the percentage of empty strings in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringEmptyPercentCheckSpec
daily_string_whitespace_count	Verifies that the number of whitespace strings in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringWhitespaceCountCheckSpec
daily_string_whitespace_percent	Verifies that the percentage of whitespace strings in a column does not exceed the maximum accepted percent. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringWhitespacePercentCheckSpec
daily_string_surrounded_by_whitespace_count	Verifies that the number of strings surrounded by whitespace in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringSurroundedByWhitespaceCountCheckSpec
daily_string_surrounded_by_whitespace_percent	Verifies that the percentage of strings surrounded by whitespace in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringSurroundedByWhitespacePercentCheckSpec
daily_string_null_placeholder_count	Verifies that the number of null placeholders in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringNullPlaceholderCountCheckSpec
daily_string_null_placeholder_percent	Verifies that the percentage of null placeholders in a column does not exceed the maximum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringNullPlaceholderPercentCheckSpec
daily_string_boolean_placeholder_percent	Verifies that the percentage of boolean placeholder for strings in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringBooleanPlaceholderPercentCheckSpec
daily_string_parsable_to_integer_percent	Verifies that the percentage of parsable to integer string in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringParsableToIntegerPercentCheckSpec
daily_string_parsable_to_float_percent	Verifies that the percentage of parsable to float string in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringParsableToFloatPercentCheckSpec
daily_expected_strings_in_use_count	Verifies that the expected string values were found in the column. Raises a data quality issue when too many expected values were not found (were missing). Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnExpectedStringsInUseCountCheckSpec
daily_string_value_in_set_percent	The check measures the percentage of rows whose value in a tested column is one of values from a list of expected values or the column value is null. Verifies that the percentage of rows having a valid column value does not exceed the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringValueInSetPercentCheckSpec
daily_string_valid_dates_percent	Verifies that the percentage of valid dates in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringValidDatesPercentCheckSpec
daily_string_valid_country_code_percent	Verifies that the percentage of valid country code in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringValidCountryCodePercentCheckSpec
daily_string_valid_currency_code_percent	Verifies that the percentage of valid currency code in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringValidCurrencyCodePercentCheckSpec
daily_string_invalid_email_count	Verifies that the number of invalid emails in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringInvalidEmailCountCheckSpec
daily_string_invalid_uuid_count	Verifies that the number of invalid UUID in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringInvalidUuidCountCheckSpec
daily_string_valid_uuid_percent	Verifies that the percentage of valid UUID in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringValidUuidPercentCheckSpec
daily_string_invalid_ip4_address_count	Verifies that the number of invalid IP4 address in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringInvalidIp4AddressCountCheckSpec
daily_string_invalid_ip6_address_count	Verifies that the number of invalid IP6 address in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringInvalidIp6AddressCountCheckSpec
daily_string_not_match_regex_count	Verifies that the number of strings not matching the custom regex in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringNotMatchRegexCountCheckSpec
daily_string_match_regex_percent	Verifies that the percentage of strings matching the custom regex in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringMatchRegexPercentCheckSpec
daily_string_not_match_date_regex_count	Verifies that the number of strings not matching the date format regex in a column does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringNotMatchDateRegexCountCheckSpec
daily_string_match_date_regex_percent	Verifies that the percentage of strings matching the date format regex in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringMatchDateRegexPercentCheckSpec
daily_string_match_name_regex_percent	Verifies that the percentage of strings matching the name format regex in a column does not fall below the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringMatchNameRegexPercentCheckSpec
daily_expected_strings_in_top_values_count	Verifies that the top X most popular column values contain all values from a list of expected values. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnExpectedStringsInTopValuesCountCheckSpec
daily_string_datatype_detected	Detects the data type of text values stored in the column. The sensor returns the code of the detected data type of a column: 1 - integers, 2 - floats, 3 - dates, 4 - timestamps, 5 - booleans, 6 - strings, 7 - mixed data types. Raises a data quality issue when the detected data type does not match the expected data type. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnStringDatatypeDetectedCheckSpec

ColumnSqlDailyRecurringChecksSpec

Container of built-in preconfigured data quality checks on a column level that are using custom SQL expressions (conditions).

The structure of this object is described below

Property name	Description	Data type
daily_sql_condition_passed_percent_on_column	Verifies that a minimum percentage of rows passed a custom SQL condition (expression). Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnSqlConditionPassedPercentCheckSpec
daily_sql_condition_failed_count_on_column	Verifies that a number of rows failed a custom SQL condition(expression) does not exceed the maximum accepted count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnSqlConditionFailedCountCheckSpec
daily_sql_aggregate_expr_column	Verifies that a custom aggregated SQL expression (MIN, MAX, etc.) is not outside the set range. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnSqlAggregateExprCheckSpec

ColumnBoolDailyRecurringChecksSpec

Container of boolean data quality recurring checks on a column level that are checking at a daily level.

The structure of this object is described below

Property name	Description	Data type	Enum values	Default value	Sample values
daily_true_percent	Verifies that the percentage of true values in a column does not exceed the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnTruePercentCheckSpec
daily_false_percent	Verifies that the percentage of false values in a column does not exceed the minimum accepted percentage. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnFalsePercentCheckSpec

ColumnComparisonDailyRecurringChecksSpec

Container of built-in preconfigured column level comparison checks that compare min/max/sum/mean/nulls measures between the column in the tested (parent) table and a matching reference column in the reference table (the source of truth). This is the configuration for daily recurring checks that are counted in KPIs.

The structure of this object is described below

Property name	Description	Data type
daily_sum_match	Verifies that percentage of the difference between the sum of values in a tested column in a parent table and the sum of a values in a column in the reference table. The difference must be below defined percentage thresholds. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnComparisonSumMatchCheckSpec
daily_min_match	Verifies that percentage of the difference between the minimum value in a tested column in a parent table and the minimum value in a column in the reference table. The difference must be below defined percentage thresholds. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnComparisonMinMatchCheckSpec
daily_max_match	Verifies that percentage of the difference between the maximum value in a tested column in a parent table and the maximum value in a column in the reference table. The difference must be below defined percentage thresholds. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnComparisonMaxMatchCheckSpec
daily_mean_match	Verifies that percentage of the difference between the mean (average) value in a tested column in a parent table and the mean (average) value in a column in the reference table. The difference must be below defined percentage thresholds. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnComparisonMeanMatchCheckSpec
daily_not_null_count_match	Verifies that percentage of the difference between the count of not null values in a tested column in a parent table and the count of not null values in a column in the reference table. The difference must be below defined percentage thresholds. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnComparisonNotNullCountMatchCheckSpec
daily_null_count_match	Verifies that percentage of the difference between the count of null values in a tested column in a parent table and the count of null values in a column in the reference table. The difference must be below defined percentage thresholds. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnComparisonNullCountMatchCheckSpec
reference_column	The name of the reference column name in the reference table. It is the column to which the current column is compared to.	string

ColumnIntegrityDailyRecurringChecksSpec

Container of integrity data quality recurring checks on a column level that are checking at a daily level.

The structure of this object is described below

Property name	Description	Data type	Enum values	Default value	Sample values
daily_foreign_key_not_match_count	Verifies that the number of values in a column that does not match values in another table column does not exceed the set count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnIntegrityForeignKeyNotMatchCountCheckSpec
daily_foreign_key_match_percent	Verifies that the percentage of values in a column that matches values in another table column does not exceed the set count. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnIntegrityForeignKeyMatchPercentCheckSpec

ColumnSchemaDailyRecurringChecksSpec

Container of built-in preconfigured data quality checks on a column level that are checking the column schema at a daily level.

The structure of this object is described below

Property name	Description	Data type	Enum values	Default value	Sample values
daily_column_exists	Checks the metadata of the monitored table and verifies if the column exists. Stores the most recent value for each day when the data quality check was evaluated.	ColumnSchemaColumnExistsCheckSpec
daily_column_type_changed	Checks the metadata of the monitored column and detects if the data type (including the length, precision, scale, nullability) has changed since the last day. Stores the most recent hash for each day when the data quality check was evaluated.	ColumnSchemaTypeChangedCheckSpec

ColumnComparisonDailyRecurringChecksSpecMap

Container of comparison checks for each defined data comparison. The name of the key in this dictionary must match a name of a table comparison that is defined on the parent table. Contains configuration of column level comparison checks. Each column level check container also defines the name of the reference column name to which we are comparing.

The structure of this object is described below

Property name	Description	Data type	Enum values	Default value	Sample values
access_order		boolean
size		integer
mod_count		integer
threshold		integer

ColumnDatatypeDailyRecurringChecksSpec

Container of datatype data quality recurring checks on a column level that are checking at a daily level.

The structure of this object is described below

Property name	Description	Data type	Enum values	Default value	Sample values
daily_date_match_format_percent	Verifies that the percentage of date values matching the given format in a column does not exceed the maximum accepted percentage. Creates a separate data quality check (and an alert) for each daily recurring.	ColumnDatatypeDateMatchFormatPercentCheckSpec
daily_string_datatype_changed	Detects that the data type of texts stored in a text column has changed since the last verification. The sensor returns the detected data type of a column: 1 - integers, 2 - floats, 3 - dates, 4 - timestamps, 5 - booleans, 6 - strings, 7 - mixed data types. Stores the most recent captured value for each day when the data quality check was evaluated.	ColumnDatatypeStringDatatypeChangedCheckSpec