Skip to content

Last updated: July 22, 2025

DQOps YAML file definitions

The definition of YAML files used by DQOps to configure the data sources, monitored tables, and the configuration of activated data quality checks.

SensorDefinitionYaml

Data quality sensor definition YAML schema for a data quality sensor specification.

The structure of this object is described below

 Property name   Description                       Data type   Enum values   Default value   Sample values 
api_version DQOps YAML schema version string dqo/v1
kind File type enum source
table
sensor
provider_sensor
rule
check
settings
file_index
connection_similarity_index
dashboards
default_schedules
default_checks
default_table_checks
default_column_checks
default_notifications
sensor
spec Custom data quality sensor specification object with definition of a custom sensor SensorDefinitionSpec

SensorDefinitionSpec

Data Quality sensor definition specification. Provides the configuration for a data quality sensor definition, sensor's parameters, etc.

The structure of this object is described below

 Property name   Description                       Data type   Enum values   Default value   Sample values 
fields List of fields that are parameters of a custom sensor. Those fields are used by the DQOps UI to display the data quality check editing screens with proper UI controls for all required fields. ParameterDefinitionsListSpec
requires_event_timestamp The data quality sensor depends on the configuration of the event timestamp column name on the analyzed table. When true, the name of the column that stores the event (transaction, etc.) timestamp must be specified in the timestamp_columns.event_timestamp_column field on the table. boolean
requires_ingestion_timestamp The data quality sensor depends on the configuration of the ingestion timestamp column name on the analyzed table. When true, the name of the column that stores the ingestion (created_at, loaded_at, etc.) timestamp must be specified in the timestamp_columns.ingestion_timestamp_column field on the table. boolean
default_value Default value that is used when the sensor returns no rows. A row count sensor may return no rows when a GROUP BY condition is added to capture the database server's local time zone. In order to always return a value, a sensor may have a default value configured. double
parameters Additional sensor definition parameters Dict[string, string]

ParameterDefinitionsListSpec

List of parameter definitions - the parameters for custom sensors or custom rules.

The structure of this object is described below

 Property name   Description                       Data type   Enum values   Default value   Sample values 
self List[ParameterDefinitionSpec]

ParameterDefinitionSpec

Defines a single field that is a sensor parameter or a rule parameter.

The structure of this object is described below

 Property name   Description                       Data type   Enum values   Default value   Sample values 
field_name Field name that matches the field name (snake_case) used in the YAML specification. string
display_name Field display name that should be shown as a label for the control. string
help_text Help text (full description) that will be shown to the user as a hint when the cursor is moved over the control. string
data_type Parameter data type. enum string
boolean
integer
long
double
date
datetime
column_name
enum
string_list
integer_list
object
display_hint UI control display hint. enum textarea
column_names
requires_paid_version
required True when the value for the parameter must be provided. boolean
allowed_values List of allowed values for a field that is of an enum type. List[string]
default_value The default value for a parameter in a custom check or a custom rule. string