Skip to content

data

dqo data delete

Deletes stored data that matches the specified conditions

Description

Deletes stored data that matches specified conditions. Be careful when using this command, as it permanently deletes the selected data and cannot be undone.

Command-line synopsis 

$ dqo [dqo options...] data delete [-h] [-cr] [-er] [-fw] [-hl] [-sr] [-st] [-b=<begin>]
             [-c=<connection>] [-cat=<checkCategory>] [-ch=<check>]
             [-col=<column>] [-ct=<checkType>] [-ds=<dataGroupTag>] [-e=<end>]
             [-of=<outputFormat>] [-qd=<qualityDimension>] [-s=<sensor>]
             [-sc=<statisticsCollector>] [-stc=<statisticsCategory>]
             [-stt=<statisticsTarget>] [-t=<table>] [-tc=<tableComparison>]
             [-tg=<timeGradient>]
DQO Shell synopsis 
dqo> data delete [-h] [-cr] [-er] [-fw] [-hl] [-sr] [-st] [-b=<begin>]
             [-c=<connection>] [-cat=<checkCategory>] [-ch=<check>]
             [-col=<column>] [-ct=<checkType>] [-ds=<dataGroupTag>] [-e=<end>]
             [-of=<outputFormat>] [-qd=<qualityDimension>] [-s=<sensor>]
             [-sc=<statisticsCollector>] [-stc=<statisticsCategory>]
             [-stt=<statisticsTarget>] [-t=<table>] [-tc=<tableComparison>]
             [-tg=<timeGradient>]

Options

Command argument     Description Required Accepted values
-b
--begin
 Beginning of the period for deletion. Date in format YYYY.MM or YYYY.MM.DD
-cat
--category
 Check category name (volume, nulls, numeric, etc.)
-ch
--check
 Data quality check name
-cr
--check-results
 Delete the check results
-ct
--check-type
 Data quality check type (profiling, recurring, partitioned) profiling
recurring
partitioned
-col
--column
 Column name
-c
--connection
 Connection name
-ds
--data-group-tag
 Data group dimension level filter, that filters by tags.
-e
--end
 End of the period for deletion. Date in format YYYY.MM or YYYY.MM.DD
-er
--errors
 Delete the execution errors
-fw
--file-write
 Write command response to a file
-hl
--headless
 Run the command in an headless (no user input allowed) mode
-h
--help
 Show the help for the command and parameters
-of
--output-format
 Output format for tabular responses TABLE
CSV
JSON
-qd
--quality-dimension
 Data quality dimension
-s
--sensor
 Data quality sensor name (sensor definition or sensor name)
-sr
--sensor-readouts
 Delete the sensor readouts
-st
--statistics
 Delete the statistics
-stc
--statistics-category
 Statistics category name (volume, nulls, numeric, etc.)
-sc
--statistics-collector
 Data quality statistics collector name
-stt
--statistics-target
 Data quality statistics target (table, column) table
column
-t
--table
 Full table name (schema.table), supports wildcard patterns 'sch.tab'
-tc
--table-comparison
 Table comparison name.
-tg
--time-gradient
 Time gradient of the sensor

dqo data repair

Verify integrity of parquet files used to store data and removes corrupted files

Description

Verify integrity of parquet files used to store data and removes corrupted files. Be careful when using this command, as it permanently deletes the selected data and cannot be undone.

Command-line synopsis 

$ dqo [dqo options...] data repair [-h] [-cr] [-er] [-fw] [-hl] [-sr] [-st] -c=<connection>
             [-of=<outputFormat>] [-t=<table>]
DQO Shell synopsis 
dqo> data repair [-h] [-cr] [-er] [-fw] [-hl] [-sr] [-st] -c=<connection>
             [-of=<outputFormat>] [-t=<table>]

Options

Command argument     Description Required Accepted values
-cr
--check-results
 Repair the check results
-c
--connection
 Connection name
-er
--errors
 Repair the execution errors
-fw
--file-write
 Write command response to a file
-hl
--headless
 Run the command in an headless (no user input allowed) mode
-h
--help
 Show the help for the command and parameters
-of
--output-format
 Output format for tabular responses TABLE
CSV
JSON
-sr
--sensor-readouts
 Repair the sensor readouts
-st
--statistics
 Repair the statistics
-t
--table
 Full table name (schema.table), supports wildcard patterns 'sch.tab'