Last updated: July 22, 2024

dqo data command-line command

The reference of the data command in DQOps. Commands related to the data

dqo data delete

Deletes stored data that matches the specified conditions

Description

Deletes stored data that matches specified conditions. Be careful when using this command, as it permanently deletes the selected data and cannot be undone.

Command-line synopsis

$ dqo [dqo options...] data delete [-hi] [-cr] [-er] [-es] [-fw] [-hl] [-sr] [-st] [-b=<begin>]
             [-c=<connection>] [-cat=<checkCategory>] [-ch=<check>]
             [-col=<column>] [-ct=<checkType>] [-ds=<dataGroupTag>] [-e=<end>]
             [-is=<incidentsStatus>] [-of=<outputFormat>]
             [-qd=<qualityDimension>] [-s=<sensor>] [-sc=<statisticsCollector>]
             [-stc=<statisticsCategory>] [-stt=<statisticsTarget>] [-t=<table>]
             [-tc=<tableComparison>] [-tg=<timeGradient>]

DQOps shell synopsis

dqo> data delete [-hi] [-cr] [-er] [-es] [-fw] [-hl] [-sr] [-st] [-b=<begin>]
             [-c=<connection>] [-cat=<checkCategory>] [-ch=<check>]
             [-col=<column>] [-ct=<checkType>] [-ds=<dataGroupTag>] [-e=<end>]
             [-is=<incidentsStatus>] [-of=<outputFormat>]
             [-qd=<qualityDimension>] [-s=<sensor>] [-sc=<statisticsCollector>]
             [-stc=<statisticsCategory>] [-stt=<statisticsTarget>] [-t=<table>]
             [-tc=<tableComparison>] [-tg=<timeGradient>]

Command options

All parameters supported by the command are listed below.

Command argument	Description	Accepted values
`-b` `--begin`	Beginning of the period for deletion. Date in format YYYY.MM or YYYY.MM.DD
`-cat` `--category`	Check category name (volume, nulls, numeric, etc.)
`-ch` `--check`	Data quality check name
`-cr` `--check-results`	Delete the check results
`-ct` `--check-type`	Data quality check type (profiling, monitoring, partitioned)	profiling monitoring partitioned
`-col` `--column`	Column name
`-c` `--connection`	Connection name
`-ds` `--data-group-tag`	Data group dimension level filter, that filters by tags.
`-e` `--end`	End of the period for deletion. Date in format YYYY.MM or YYYY.MM.DD
`-es` `--error-samples`	Delete the error samples
`-er` `--errors`	Delete the execution errors
`-fw` `--file-write`	Write command response to a file
`-t` `--table` `--full-table-name`	Full table name (schema.table), supports wildcard patterns 'sch.tab'
`--headless` `-hl`	Starts DQOps in a headless mode. When DQOps runs in a headless mode and the application cannot start because the DQOps Cloud API key is missing or the DQOps user home folder is not configured, DQOps will stop silently instead of asking the user to approve the setup of the DQOps user home folder structure and/or log into DQOps Cloud.
`-h` `--help`	Show the help for the command and parameters
`-i` `--incidents`	Delete the incidents
`-is` `--incidents-status`	Incidents status name (open, acknowledged, resolved or muted).
`-of` `--output-format`	Output format for tabular responses	TABLE CSV JSON
`-qd` `--quality-dimension`	Data quality dimension
`-s` `--sensor`	Data quality sensor name (sensor definition or sensor name)
`-sr` `--sensor-readouts`	Delete the sensor readouts
`-st` `--statistics`	Delete the statistics
`-stc` `--statistics-category`	Statistics category name (volume, nulls, numeric, etc.)
`-sc` `--statistics-collector`	Data quality statistics collector name
`-stt` `--statistics-target`	Data quality statistics target (table, column)	table column
`-tc` `--table-comparison`	Table comparison name.
`-tg` `--time-gradient`	Time gradient of the sensor

dqo data repair

Verify integrity of parquet files used to store data and removes corrupted files

Description

Verify integrity of parquet files used to store data and removes corrupted files. Be careful when using this command, as it permanently deletes the selected data and cannot be undone.

Command-line synopsis

$ dqo [dqo options...] data repair [-h] [-cr] [-er] [-fw] [-hl] [-sr] [-st] -c=<connection>
             [-of=<outputFormat>] [-t=<table>]

DQOps shell synopsis

dqo> data repair [-h] [-cr] [-er] [-fw] [-hl] [-sr] [-st] -c=<connection>
             [-of=<outputFormat>] [-t=<table>]

Command options

All parameters supported by the command are listed below.

Command argument	Description	Accepted values
`-cr` `--check-results`	Repair the check results
`-c` `--connection`	Connection name
`-er` `--errors`	Repair the execution errors
`-fw` `--file-write`	Write command response to a file
`-t` `--table` `--full-table-name`	Full table name (schema.table), supports wildcard patterns 'sch.tab'
`--headless` `-hl`	Starts DQOps in a headless mode. When DQOps runs in a headless mode and the application cannot start because the DQOps Cloud API key is missing or the DQOps user home folder is not configured, DQOps will stop silently instead of asking the user to approve the setup of the DQOps user home folder structure and/or log into DQOps Cloud.
`-h` `--help`	Show the help for the command and parameters
`-of` `--output-format`	Output format for tabular responses	TABLE CSV JSON
`-sr` `--sensor-readouts`	Repair the sensor readouts
`-st` `--statistics`	Repair the statistics