table daily partitioned checks

TableDailyPartitionedCheckCategoriesSpec

Container of table level daily partitioned checks. Contains categories of daily partitioned checks.

The structure of this object is described below

Property name	Description	Data type
volume	Volume daily partitioned data quality checks that verify the quality of every day of data separately	TableVolumeDailyPartitionedChecksSpec
timeliness	Daily partitioned timeliness checks	TableTimelinessDailyPartitionedChecksSpec
sql	Custom SQL daily partitioned data quality checks that verify the quality of every day of data separately	TableSqlDailyPartitionedChecksSpec
comparisons	Dictionary of configuration of checks for table comparisons. The key that identifies each comparison must match the name of a data comparison that is configured on the parent table.	TableComparisonDailyPartitionedChecksSpecMap
custom	Dictionary of custom checks. The keys are check names.	CustomCheckSpecMap

TableTimelinessDailyPartitionedChecksSpec

Container of table level date partitioned timeliness data quality checks.

The structure of this object is described below

Property name	Description	Data type
daily_partition_data_freshness	Daily partitioned check calculating the number of days since the most recent event timestamp (freshness)	TableDataFreshnessCheckSpec
daily_partition_data_staleness	Daily partitioned check calculating the time difference in days between the current date and the most recent data ingestion timestamp (staleness)	TableDataStalenessCheckSpec
daily_partition_data_ingestion_delay	Daily partitioned check calculating the time difference in days between the most recent event timestamp and the most recent ingestion timestamp	TableDataIngestionDelayCheckSpec
daily_partition_reload_lag	Daily partitioned check calculating the longest time a row waited to be load	TablePartitionReloadLagCheckSpec

TableSqlDailyPartitionedChecksSpec

Container of built-in preconfigured data quality checks on a table level that are using custom SQL expressions (conditions).

The structure of this object is described below

Property name	Description	Data type
daily_partition_sql_condition_passed_percent_on_table	Verifies that a set percentage of rows passed a custom SQL condition (expression). Creates a separate data quality check (and an alert) for each daily partition.	TableSqlConditionPassedPercentCheckSpec
daily_partition_sql_condition_failed_count_on_table	Verifies that a set number of rows failed a custom SQL condition (expression). Creates a separate data quality check (and an alert) for each daily partition.	TableSqlConditionFailedCountCheckSpec
daily_partition_sql_aggregate_expr_table	Verifies that a custom aggregated SQL expression (MIN, MAX, etc.) is not outside the set range. Creates a separate data quality check (and an alert) for each daily partition.	TableSqlAggregateExprCheckSpec

TableComparisonDailyPartitionedChecksSpec

Container of built-in comparison (accuracy) checks on a table level that are using a defined comparison to identify the reference table and the data grouping configuration. Contains the daily partitioned comparison checks.

The structure of this object is described below

Property name	Description	Data type	Enum values	Default value	Sample values
daily_partition_row_count_match	Verifies that the row count of the tested (parent) table matches the row count of the reference table. Compares each group of data with a GROUP BY clause on the time period (the daily partition) and all other data grouping columns. Stores the most recent captured value for each daily partition that was analyzed.	TableComparisonRowCountMatchCheckSpec

TableComparisonDailyPartitionedChecksSpecMap

Container of comparison checks for each defined data comparison. The name of the key in this dictionary must match a name of a table comparison that is defined on the parent table. Contains the daily partitioned comparison checks for each configured reference table.

The structure of this object is described below

Property name	Description	Data type	Enum values	Default value	Sample values
access_order		boolean
size		integer
mod_count		integer
threshold		integer

TableVolumeDailyPartitionedChecksSpec

Container of table level date partitioned volume data quality checks.

The structure of this object is described below

Property name	Description	Data type
daily_partition_row_count	Verifies that the number of rows in a table does not exceed the minimum accepted count. Creates a separate data quality check (and an alert) for each daily partition.	TableRowCountCheckSpec
daily_partition_row_count_anomaly_stationary_30_days	Verifies that the total row count of the tested table is within a percentile from measurements made during the last 30 days.	TableAnomalyStationaryPartitionRowCount30DaysCheckSpec
daily_partition_row_count_anomaly_stationary	Verifies that the total row count of the tested table is within a percentile from measurements made during the last 90 days.	TableAnomalyStationaryPartitionRowCountCheckSpec
daily_partition_row_count_change	Verifies that the total row count of the tested table has changed by a fixed rate since the last readout.	TableChangeRowCountCheckSpec
daily_partition_row_count_change_yesterday	Verifies that the total row count of the tested table has changed by a fixed rate since the last readout from yesterday. Allows for exact match to readouts from yesterday or past readouts lookup.	TableChangeRowCountSinceYesterdayCheckSpec
daily_partition_row_count_change_7_days	Verifies that the total row count of the tested table has changed by a fixed rate since the last readout from last week. Allows for exact match to readouts from 7 days ago or past readouts lookup.	TableChangeRowCountSince7DaysCheckSpec
daily_partition_row_count_change_30_days	Verifies that the total row count of the tested table has changed by a fixed rate since the last readout from last month. Allows for exact match to readouts from 30 days ago or past readouts lookup.	TableChangeRowCountSince30DaysCheckSpec