Dell DR6300 DR Series System Command Line Reference Guide - Page 154

Data Integrity Checking

Page 154 highlights

6 Data Integrity Checking The DR Series system design includes an online data integrity verification feature known as Data Check, which checks for potential or unexpected data inconsistencies in the data store associated with the internal system deduplication engine. Data Check performs a series of checks for unexpected data inconsistencies as early as possible in the data ingest and backup process. Data Check checks and verifies data both during the write process and also the data already stored on the system disks. The design purpose is to detect potential issues early enough in the data management process so that original data can be used to backup and correct any potential data inconsistencies. Data Check reports data verification issues, but it is not intended nor designed to repair these issues itself. Any data inconsistencies that are encountered are reported as DR Series system alerts, and these filesystem errors can be repaired using the Maintenance mode (for more information, see Maintenance. The Data Check feature runs continuously except for when the DR Series system enters its Maintenance mode (it does not run while the system is in this mode). Data Check leaves the system in an Operational mode when it detects an error, at which point, it sends an alert and an event. If an alert has already been sent, but has not been cleared (for example, when repairs occur during the Maintenance mode), no new event is sent. Similarly, for events, one is sent for the first detected data inconsistency, and then the total number of issues detected during the scan are listed in a new event. If Data Check is enabled, it runs in the background as a low-priority process, and changes to an idle state when the other major DR Series system operations (data ingest, replication, and cleaner) are active. NOTE: Unless otherwise noted, all later references to datacheck or Data Check in this guide are used interchangeably to represent the Data Check feature in the DR Series system. About Data Check The purpose of the Data Check feature is to perform data integrity checks to detect potential silent data inconsistencies that can affect the DR Series system disks or disk subsystems, and protect user data before there is any potential data loss. Silent data inconsistencies can be any of the following types of disk-based data storage issues: hardware imperfections, bit rot, current spikes, disk firmware problems, and ghost writes. Data Check performs its own integral data integrity checks that detect and identify potential issues after performing the following scans: • Priority write verify scans • Continuous data verification scans For more information, see Continuous Data Verification Scans and Priority Write Verify Scans. Priority Write Verify Scans Data Check performs an early write verify scan, also known as a namespace scan, when files are first created or when they are modified by users. All of the modified files are flagged for priority scanning and this process is based on its timestamp-with a higher priority given to the most recently modified files. Early write verify scans are performed every 154

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
  • 131
  • 132
  • 133
  • 134
  • 135
  • 136
  • 137
  • 138
  • 139
  • 140
  • 141
  • 142
  • 143
  • 144
  • 145
  • 146
  • 147
  • 148
  • 149
  • 150
  • 151
  • 152
  • 153
  • 154
  • 155
  • 156
  • 157
  • 158
  • 159
  • 160
  • 161

6
Data Integrity Checking
The DR Series system design includes an online data integrity verification feature known as Data Check, which checks
for potential or unexpected data inconsistencies in the data store associated with the internal system deduplication
engine. Data Check performs a series of checks for unexpected data inconsistencies as early as possible in the data
ingest and backup process.
Data Check checks and verifies data both during the write process and also the data already stored on the system disks.
The design purpose is to detect potential issues early enough in the data management process so that original data can
be used to backup and correct any potential data inconsistencies. Data Check reports data verification issues, but it is
not intended nor designed to repair these issues itself.
Any data inconsistencies that are encountered are reported as DR Series system alerts, and these filesystem errors can
be repaired using the
Maintenance
mode (for more information, see
Maintenance
.
The Data Check feature runs continuously except for when the DR Series system enters its
Maintenance
mode (it does
not run while the system is in this mode). Data Check leaves the system in an
Operational
mode when it detects an error,
at which point, it sends an alert and an event.
If an alert has already been sent, but has not been cleared (for example, when repairs occur during the
Maintenance
mode), no new event is sent. Similarly, for events, one is sent for the first detected data inconsistency, and then the total
number of issues detected during the scan are listed in a new event.
If Data Check is enabled, it runs in the background as a low-priority process, and changes to an idle state when the
other major DR Series system operations (data ingest, replication, and cleaner) are active.
NOTE:
Unless otherwise noted, all later references to datacheck or Data Check in this guide are used
interchangeably to represent the Data Check feature in the DR Series system.
About Data Check
The purpose of the Data Check feature is to perform data integrity checks to detect potential silent data inconsistencies
that can affect the DR Series system disks or disk subsystems, and protect user data before there is any potential data
loss.
Silent data inconsistencies can be any of the following types of disk-based data storage issues: hardware imperfections,
bit rot, current spikes, disk firmware problems, and ghost writes. Data Check performs its own integral data integrity
checks that detect and identify potential issues after performing the following scans:
Priority write verify scans
Continuous data verification scans
For more information, see
Continuous Data Verification Scans
and
Priority Write Verify Scans
.
Priority Write Verify Scans
Data Check performs an early write verify scan, also known as a
namespace
scan, when files are first created or when
they are modified by users. All of the modified files are flagged for priority scanning and this process is based on its
timestamp—with a higher priority given to the most recently modified files. Early write verify scans are performed every
154