HP D2D D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 71

Housekeeping monitoring and control

Page 71 highlights

Housekeeping monitoring and control Terminology Housekeeping: If data is deleted from the D2D system (e.g. a virtual cartridge is overwritten or erased), any unused chunks will be marked for removal, so space can be freed up (space reclamation). The process of removing chunks of data is not an inline operation because this would significantly impact performance. This process, termed ―housekeeping‖, runs on the appliance as a background operation. It runs on a per cartridge and NAS file basis, and will run as soon as the cartridge is unloaded and returned to its storage slot or a NAS file has completed writing and has been closed by the appliance, unless a housekeeping blackout window is set. Housekeeping also applies when data is replicated from a source D2D to a target D2D - the replicated data on the target D2D triggers housekeeping on the target D2D to take place. Blackout Window: This is a period of time (up to 2 separate periods in any 24 hours) that can be configured in the D2D during which the I/O intensive process of Housekeeping WILL NOT run. The main use of a blackout window is to ensure that other activities such as backup and replication can run uninterrupted and therefore give more predictable performance. Blackout windows must be set on BOTH the source D2D and Target D2D. This guide includes a fully worked example of configuring a complex D2D environment including setting housekeeping windows, see Appendix B. An example is shown below from a D2D source from the worked example:- In the above example we can see backups in green, housekeeping in yellow and replication from the source in blue. In this example we have already set a replication blackout window which enables replication to run at 20:00. The reason Share 3 and Share 4 do not replicate immediately the replication window is open is because this is a D2D2502 device which has a limit of 4 for the maximum concurrent replications. Share 3 & Share 4 have to wait until a free slot is available for replication. Without a housekeeping blackout window set we can see how in this scenario where four separate servers are being backed up to the D2D Backup System, the housekeeping can interfere with the backup jobs. For example the housekeeping associated with DIR1 starts to affect the end of backup DIR2 since the backup of DIR2 and the housekeeping of DIR1 are both competing for I/O. 71

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
  • 131

71
Housekeeping monitoring and control
Terminology
Housekeeping:
If data is deleted from the D2D system (e.g. a virtual cartridge is overwritten or erased), any
unused chunks will be marked for removal, so space can be freed up (space reclamation). The process of
removing chunks of data is not an inline operation because this would significantly impact performance. This
process, termed ―housekeeping‖, runs on the appliance as a background operation
. It runs on a per cartridge
and NAS file basis, and will run as soon as the cartridge is unloaded and returned to its storage slot or a NAS
file has completed writing and has been closed by the appliance, unless a housekeeping blackout window is set.
Housekeeping also applies when data is replicated from a source D2D to a target D2D
the replicated data on
the target D2D triggers housekeeping on the target D2D to take place.
Blackout Window:
This is a period of time (up to 2 separate periods in any 24 hours) that can be configured
in the D2D during which the I/O intensive process of Housekeeping WILL NOT run. The main use of a blackout
window is to ensure that other activities such as backup and replication can run uninterrupted and therefore give
more predictable performance. Blackout windows must be set on BOTH the source D2D and Target D2D.
This guide includes a fully worked example of configuring a complex D2D environment including setting
housekeeping windows, see Appendix B. An example is shown below from a D2D source from the worked
example:-
In the above example we can see backups in green, housekeeping in yellow and replication from the source in
blue. In this example we have already set a replication blackout window which enables replication to run at
20:00. The reason Share 3 and Share 4 do not replicate immediately the replication window is open is because
this is a D2D2502 device which has a limit of 4 for the maximum concurrent replications. Share 3 & Share 4
have to wait until a free slot is available for replication.
Without a housekeeping blackout window set we can see how in this scenario where four separate servers are
being backed up to the D2D Backup System, the housekeeping can interfere with the backup jobs. For example
the housekeeping associated with DIR1 starts to affect the end of backup DIR2 since the backup of DIR2 and the
housekeeping of DIR1 are both competing for I/O.