DefaultObservabilityChecksYaml
DefaultObservabilityChecksSpec
The default configuration of checks that are enabled as data observability checks that will be detecting anomalies for all columns and tables that are imported. This configuration of checks is copied to the list of enabled checks on all tables and columns that are imported.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
profiling | Default configuration of profiling checks that are enabled on tables and columns that are imported into DQOps. | DefaultProfilingObservabilityCheckSettingsSpec | |||
monitoring_daily | Default configuration of daily monitoring checks (executed once a day, storing or overriding one result per day) that are enabled on tables and columns that are imported into DQOps. | DefaultDailyMonitoringObservabilityCheckSettingsSpec | |||
monitoring_monthly | Default configuration of daily monitoring checks (executed once a day, storing or overriding one result per month) that are enabled on tables and columns that are imported into DQOps. | DefaultMonthlyMonitoringObservabilityCheckSettingsSpec |
DefaultMonthlyMonitoringTableObservabilityCheckSettingsSpec
The default configuration of checks that are enabled as data observability monthly monitoring checks that will be detecting anomalies for all tables that are imported. This configuration of checks is copied to the list of enabled table level checks on all tables that are imported, for monthly monitoring checks only.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
volume | The default configuration of volume data quality checks on a table level. | TableVolumeMonthlyMonitoringChecksSpec | |||
availability | The default configuration of the table availability data quality checks on a table level. | TableAvailabilityMonthlyMonitoringChecksSpec | |||
schema | The default configuration of schema (column count and schema) data quality checks on a table level. | TableSchemaMonthlyMonitoringChecksSpec | |||
custom | Dictionary of custom checks. The keys are check names within this category. | CustomCheckSpecMap |
DefaultObservabilityChecksYaml
The configuration of default data quality checks that are activated for all imported tables and columns. The default observability checks are stored in the $DQO_USER_HOME/settings/defaultchecks.dqochecks.yaml file in the DQOps user's home folder.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
api_version | string | ||||
kind | enum | default_schedules settings default_notifications rule sensor source check dashboards default_checks table provider_sensor file_index |
|||
spec | DefaultObservabilityChecksSpec |
DefaultProfilingColumnObservabilityCheckSettingsSpec
The default configuration of checks that are enabled as data observability profiling checks that will be detecting anomalies for all columns that are imported. This configuration of checks is copied to the list of enabled column level checks on all columns that are imported, for profiling checks only.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
nulls | The default configuration of column level checks that verify nulls and blanks. | ColumnNullsProfilingChecksSpec | |||
numeric | The default configuration of column level checks that verify negative values. | ColumnNumericProfilingChecksSpec | |||
strings | The default configuration of strings checks on a column level. | ColumnStringsProfilingChecksSpec | |||
uniqueness | The default configuration of uniqueness checks on a column level. | ColumnUniquenessProfilingChecksSpec | |||
datetime | The default configuration of datetime checks on a column level. | ColumnDatetimeProfilingChecksSpec | |||
pii | The default configuration of Personal Identifiable Information (PII) checks on a column level. | ColumnPiiProfilingChecksSpec | |||
bool | The default configuration of booleans checks on a column level. | ColumnBoolProfilingChecksSpec | |||
datatype | The default configuration of datatype checks on a column level. | ColumnDatatypeProfilingChecksSpec | |||
anomaly | The default configuration of anomaly checks on a column level. | ColumnAnomalyProfilingChecksSpec | |||
schema | The default configuration of schema checks on a column level. | ColumnSchemaProfilingChecksSpec | |||
custom | Dictionary of custom checks. The keys are check names within this category. | CustomCheckSpecMap |
DefaultDailyMonitoringColumnObservabilityCheckSettingsSpec
The default configuration of checks that are enabled as data observability daily monitoring checks that will be detecting anomalies for all columns that are imported. This configuration of checks is copied to the list of enabled column level checks on all columns that are imported, for daily monitoring checks only.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
nulls | The default configuration of column level checks that verify nulls and blanks. | ColumnNullsDailyMonitoringChecksSpec | |||
numeric | The default configuration of column level checks that verify negative values. | ColumnNumericDailyMonitoringChecksSpec | |||
strings | The default configuration of strings checks on a column level. | ColumnStringsDailyMonitoringChecksSpec | |||
uniqueness | The default configuration of uniqueness checks on a column level. | ColumnUniquenessDailyMonitoringChecksSpec | |||
datetime | The default configuration of datetime checks on a column level. | ColumnDatetimeDailyMonitoringChecksSpec | |||
pii | The default configuration of Personal Identifiable Information (PII) checks on a column level. | ColumnPiiDailyMonitoringChecksSpec | |||
bool | The default configuration of booleans checks on a column level. | ColumnBoolDailyMonitoringChecksSpec | |||
datatype | The default configuration of datatype checks on a column level. | ColumnDatatypeDailyMonitoringChecksSpec | |||
anomaly | The default configuration of anomaly checks on a column level. | ColumnAnomalyDailyMonitoringChecksSpec | |||
schema | The default configuration of schema checks on a column level. | ColumnSchemaDailyMonitoringChecksSpec | |||
custom | Dictionary of custom checks. The keys are check names within this category. | CustomCheckSpecMap |
DefaultProfilingTableObservabilityCheckSettingsSpec
The default configuration of checks that are enabled as data observability profiling checks that will be detecting anomalies for all tables that are imported. This configuration of checks is copied to the list of enabled table level checks on all tables that are imported, for profiling checks only.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
volume | The default configuration of volume data quality checks on a table level. | TableVolumeProfilingChecksSpec | |||
availability | The default configuration of the table availability data quality checks on a table level. | TableAvailabilityProfilingChecksSpec | |||
schema | The default configuration of schema (column count and schema) data quality checks on a table level. | TableSchemaProfilingChecksSpec | |||
custom | Dictionary of custom checks. The keys are check names within this category. | CustomCheckSpecMap |
DefaultMonthlyMonitoringColumnObservabilityCheckSettingsSpec
The default configuration of checks that are enabled as data observability monthly monitoring checks that will be detecting anomalies for all columns that are imported. This configuration of checks is copied to the list of enabled column level checks on all columns that are imported, for monthly monitoring checks only.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
nulls | The default configuration of column level checks that verify nulls and blanks. | ColumnNullsMonthlyMonitoringChecksSpec | |||
numeric | The default configuration of column level checks that verify negative values. | ColumnNumericMonthlyMonitoringChecksSpec | |||
strings | The default configuration of strings checks on a column level. | ColumnStringsMonthlyMonitoringChecksSpec | |||
uniqueness | The default configuration of uniqueness checks on a column level. | ColumnUniquenessMonthlyMonitoringChecksSpec | |||
datetime | The default configuration of datetime checks on a column level. | ColumnDatetimeMonthlyMonitoringChecksSpec | |||
pii | The default configuration of Personal Identifiable Information (PII) checks on a column level. | ColumnPiiMonthlyMonitoringChecksSpec | |||
bool | The default configuration of booleans checks on a column level. | ColumnBoolMonthlyMonitoringChecksSpec | |||
datatype | The default configuration of datatype checks on a column level. | ColumnDatatypeMonthlyMonitoringChecksSpec | |||
anomaly | The default configuration of anomaly checks on a column level. | ColumnAnomalyMonthlyMonitoringChecksSpec | |||
schema | The default configuration of schema checks on a column level. | ColumnSchemaMonthlyMonitoringChecksSpec | |||
custom | Dictionary of custom checks. The keys are check names within this category. | CustomCheckSpecMap |
DefaultDailyMonitoringTableObservabilityCheckSettingsSpec
The default configuration of checks that are enabled as data observability daily monitoring checks that will be detecting anomalies for all tables that are imported. This configuration of checks is copied to the list of enabled table level checks on all tables that are imported, for daily monitoring checks only.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
volume | The default configuration of volume data quality checks on a table level. | TableVolumeDailyMonitoringChecksSpec | |||
availability | The default configuration of the table availability data quality checks on a table level. | TableAvailabilityDailyMonitoringChecksSpec | |||
schema | The default configuration of schema (column count and schema) data quality checks on a table level. | TableSchemaDailyMonitoringChecksSpec | |||
custom | Dictionary of custom checks. The keys are check names within this category. | CustomCheckSpecMap |
DefaultDailyMonitoringObservabilityCheckSettingsSpec
The default configuration of checks that are enabled as data observability daily monitoring checks that will be detecting anomalies for all columns and tables that are imported. This configuration of checks is copied to the list of enabled checks on all tables and columns that are imported, for daily monitoring checks only.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
table | The default configuration of daily monitoring checks on a table level. | DefaultDailyMonitoringTableObservabilityCheckSettingsSpec | |||
column | The default configuration of daily monitoring checks on a column level. | DefaultDailyMonitoringColumnObservabilityCheckSettingsSpec |
DefaultMonthlyMonitoringObservabilityCheckSettingsSpec
The default configuration of checks that are enabled as data observability monthly monitoring checks that will be detecting anomalies for all columns and tables that are imported. This configuration of checks is copied to the list of enabled checks on all tables and columns that are imported, for monthly profiling checks only.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
table | The default configuration of monthly monitoring checks on a table level. | DefaultMonthlyMonitoringTableObservabilityCheckSettingsSpec | |||
column | The default configuration of monthly monitoring checks on a column level. | DefaultMonthlyMonitoringColumnObservabilityCheckSettingsSpec |
DefaultProfilingObservabilityCheckSettingsSpec
The default configuration of checks that are enabled as data observability profiling checks that will be detecting anomalies for all columns and tables that are imported. This configuration of checks is copied to the list of enabled checks on all tables and columns that are imported, for profiling checks only.
The structure of this object is described below
Property name | Description | Data type | Enum values | Default value | Sample values |
---|---|---|---|---|---|
table | The default configuration of profiling checks on a table level. | DefaultProfilingTableObservabilityCheckSettingsSpec | |||
column | The default configuration of profiling checks on a column level. | DefaultProfilingColumnObservabilityCheckSettingsSpec |