HP StoreOnce 4210 HP D2D Backup Systems Best practices for VTL, NAS and Replic
HP StoreOnce 4210 Manual
View all HP StoreOnce 4210 manuals
Add to My Manuals
Save this manual to your list of manuals |
HP StoreOnce 4210 manual content summary:
- HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 1
HP D2D Backup Systems Best practices for VTL, NAS and Replication implementations Table of contents Abstract...4 Related products ...4 Validity ...4 Executive summary...5 General D2D best practices at a glance 5 VTL best practices at a glance...5 NAS best practices at a glance ...6 HP StoreOnce - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 2
21 Best practices for network and Fibre Channel configuration 22 VTL best practices ...25 Summary of best practices...25 Tape library emulation ...25 Backup application configuration ...27 Rotation schemes and retention policy 28 D2D NAS best practices ...30 Introduction to D2D NAS - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 3
Generation 1 products, software 1.1.00 82 Appendix B - Fully Worked Example 83 Hardware and site configuration...83 Backup requirements specification...84 Using the HP StorageWorks Backup sizing tool 85 Configure D2D source devices and replication target configuration 98 Map out the interaction - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 4
D2D Backup System Best Practices for Performance Optimization" (HP Document Part Number EH990-90921) to include more detailed content; the previous document is now obsolete. Best practices identified in this document are predicated on using up-to-date D2D system firmware (check www.hp.com/support - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 5
document contains detailed information on best practices to get good performance from an HP D2D Backup System with HP StoreOnce Deduplication Technology. HP StoreOnce Technology is designed to increase the amount of historical backup data that can be stored without increasing the disk space needed - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 6
to the suggested maximum number of concurrent operations per share/appliance. Choose disk backup file sizes in backup software to meet the maximum backup size. Disable software compression, deduplication and synthetic full backups. Do not pre-allocate disk space for backup files. Do not append to - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 7
Technology works is necessary in order to understand factors that may impact performance of the overall system and to ensure optimal performance of your backup solution. HP StoreOnce Technology is an "inline" data deduplication process. It uses hash-based chunking technology, which analyzes incoming - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 8
ratio on the target D2D Backup System. Replication starts when the cartridge of concurrent replication jobs supported by source and concurrent target jobs D2D4324 50 16 48 D2D4312 50 16 48 D2D4112 G2 24 8 backups, restores, tape offload jobs or replication. In order to avoid this problem - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 9
of cartridges are manually erased or re-formatted. In general all media overwrites should be controlled by the backup rotation scheme so to 1. Use multiple backup streams The HP D2D system performs best with multiple backup streams sent to it simultaneously. For example an HP D2D4112 G2 will back - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 10
there is no encryption of data before it is sent to the D2D appliance. Ensure that software compression is turned off within the backup application. Not all data sources will result in high deduplication ratios and performance can, therefore, vary across different data sources. Digital images, video - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 11
D2D appliances have two 1GBit Ethernet ports, the D2D4312 and D2D4324 appliances also have two 10GBit Ethernet data over the Ethernet ports it will be necessary to configure the D2D network ports, backup servers and network infrastructure to maximise available bandwidth to the D2D device. Each pair - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 12
ports are available on the switch network or if the appliance is being used to transfer data over fibre channel ports only. On an HP D2D4312 or D2D4324 with 10Gbit ports it is possible that a single 10Gbit port will deliver good performance in most environments. Network configuration, single port - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 13
i.e. each server has a port for business network traffic and another for data backup. In this case one port on the D2D can be used solely for access a separate network SAN being used, configuration of CIFS backup shares with Active Directory authentication requires careful consideration, see Network - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 14
mode to achieve highest performance for iSCSI and NAS operation. It requires the switch to support IEEE802.3ad Link Aggregation and needs the switch to be set up accordingly. See the relevant product user guide for more details. This mode sets up "bonded" network ports, where both network ports in - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 15
it is common to configure a "Network SAN", which is a dedicated network for backup that is separate to the normal business data network; only backup data is transmitted over this network. Network configuration, HP D2D4312/4324 with 10Gbit ports When a separate network SAN is used, configuration of - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 16
and Separation of Corporate LAN and Network SAN traffic Option 1: HP D2D Backup System on Corporate SAN and Network SAN In this option, the authentication traffic so this solution will not provide optimal performance. On HP D2D4312/4324 devices with both 10Gbit and 1Gbit ports: the 10Gbit ports can - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 17
Option 2: HP D2D Backup System on Network SAN only with Gateway In this option the D2D has connections only to the Active Directory Domain controller. The illustration shows a simple Class C network for a medium-sized LAN configuration. HP D2D Backup System on Network SAN only with Gateway 17 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 18
network ports that are teamed / bonded in order to provide a fast connection to the LAN. Client servers (those that back up via a backup server) may be connected with only a single port, if backups are to be aggregated through the backup server. Ensure that no sub-1Gbit network components are in the - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 19
loop) topologies. Direct Attach (point to point) topology is not supported. Switched fabric using NPIV (N Port ID Virtualisation) offers a to form large fabrics. Fibre Channel, switched fabric topology HP StorageWorks D2D Backup System Virtual Library 1 (e.g. D2D Generic) Medium Changer Tape Tape - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 20
(private loop) topology HP StorageWorks D2D Backup System Virtual Library 1 (e.g. System may be connected to a FC private loop, direct attach topology. The FC port configuration of the D2D Appliance should be changed from the default N_Port topology setting to Loop. This topology only supports - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 21
supported along with the coexistence of array multipath software (no multipath to tape or library devices on the HP D2D Backup System part of the StoreOnce D2D VTL implementation are provided in the HP D2D Backup System user guide. There is a available values are 8Gbs (D2D4312 and D2D4324 only), 4Gbs - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 22
mainly for information and is useful in troubleshooting. Best practices for network and Fibre G2 D2D4106i G2 D2D4106FC G2 D2D4112 G2 D2D4312 G2 D2D4324 G2 EJ001A EH945A EJ002A EH938A/ on the switch to be only accessible from a single backup server device. This ensures that other SAN events, such - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 23
guide for the HP D2D Generation 2 product family for backups and backups and replication. HDaPilDy2bDacBkauDcpka:utipylypSiycBsatalecmakmGuoeupnnt-2ofTsidyzaipntagictgahualitdacemanobuenptrootefctdedatbay tHhPaSttocreaOnnbceeBpacrkoutpescytsteedmsby StoreOnce Backup systems. D2D4324 38TB D2D4312 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 24
The use of this tool enables accurate capacity sizing, retention period decisions and replication link sizing and performance for the most complex D2D environments. A fully worked example using the Sizing Tool and best practices is contained later in the document, see Appendix B. 24 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 25
each incremental backup. Tape library emulation Emulation types The HP D2D Backup Systems can emulate several types of physical HP Tape G2 products with 2.1.X or later software a more flexible emulation strategy is supported. The appliance is provided with a drive pool and these can be allocated - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 26
and G2 products. To achieve best performance the recommended maximum concurrent backup streams per library and appliance in the table should be followed. 96 64/96 48 6 D2D4312/4324 G2 200 4096 24, 48, 96 128 64 12 The HP D2DBS emulation type and the ESL/EML type, supported on the G2 product family - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 27
as described on page 71. Note that if backups are to be offloaded to physical media elsewhere in of libraries per appliance The D2D appliance supports the creation of multiple virtual library devices size, and up to 1 MB is suggested. For HP Data Protector and EMC Networker Software a block size of - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 28
fact that restore performance (required for verify) is slower for inline deduplication-enabled devices. Disabling verify for selected backup jobs can be done relatively safely as D2D Backup Systems perform CRC (Cyclic Redundancy Check) checking for every backed-up chunk to ensure that no errors are - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 29
can be configured for "free" and their sizes can be configured so that they are appropriate to the amount of data stored in a specific backup. Appended backups are of no benefit because media costs are not relevant. In addition, there will be a penalty when performing any tape offload because the - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 30
backup targets The HP StorageWorks D2D Backup System now supports the ability to create a NAS (CIFS or NFS) share to be used as a target for backup HP D2D NAS Implementation guides are available for on the HP web site for the following backup applications: HP Data Protector 6.11, Symantec Backup - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 31
responsiveness to data change. This is not an issue with backup applications because they create large files and it is very unlikely shares in order to realise best performance from the entire system by improving the responsiveness of each store. Smaller stores have D2D4312/4324 G2 128 128 640 31 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 32
of these limits is provided in the Backup Application Implementation Guides; there is a separate guide for HP Data Protector 6.11, Symantec Backup Exec 2010, CommVault Simpana 9.0 and Netbackup. Backup application configuration The HP D2D Backup System NAS functionality is designed to be used - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 33
closed, lots of smaller files would result in housekeeping running during the backup when the files are closed. * See Housekeeping monitoring and control size is the best approach. However in some specific cases using smaller backup files is of benefit. For example, in a replication environment, - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 34
ensure that there is enough disk space available to write the entire backup file. This setting has no value for D2D devices because it will not result in any physical disk space actually being allocated due to the deduplication system. It is advised that this setting is NOT used because it can - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 35
for each D2D share. Multiple servers, single stream backup Multiple servers, multi-stream backup Multiple servers, multiple single-stream backups The table below shows the recommended maximum number of backup streams or jobs per share to ensure that backups will not fail due to exceeding the maximum - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 36
. Unfortunately it also has a very detrimental effect on deduplication as data backed up will look different in every backup preventing the ability to match similar data blocks. The best practice is to disable software encryption and compression for all backups to the HP D2D Backup System. 36 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 37
and therefore a slow operation. An exception to this restriction is the HP Data Protector Synthetic full backup which works well. However the HP Data Protector Virtual Synthetic full backup which uses a distributed file system and creates thousands of open files does not. Housekeeping impact on - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 38
the D2D management interface. This mode requires the configuration of a respective local user on the backup application media server as well as configuration changes to the backup application services. Individual users can then be assigned access to individual shares on the D2D. This authentication - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 39
by the media servers should use the same "backup" user account, including any shares on other D2D devices or NAS systems. Tips for configuring AD authentication D2D products support configuration in a multi-domain tree forest but do not support multi-forest domain topologies. In order to join - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 40
1. Create a new Host(A) record in the forward lookup zone for the domain to which the D2D belongs with the hostname and IP address of the D2D. Click Add Host. 2. Also create a Pointer(PTR) in the reverse lookup zone for the domain for the D2D appliance by providing hostname and IP address. Click OK. - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 41
Now that the D2D is a member of the domain its shares can be managed from any computer on the domain by configuring a customized Microsoft Management Console (MMC) with the Shared Folders snap-in. Once you have created shares you can manage them as follows. 1. Open a new MMC window by typing mmc at - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 42
. 4. Finally select Finish and OK to complete the snap-in set up. Note that the Folder Path field contains an internal path on the D2D Backup System. 5. Save this customized snap-in for future use. 42 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 43
will reconfigure its own authentication mode, but will not correctly inform the domain controller that the computer has left the domain. The administrator should then manually remove the computer's entry in the AD configuration. 43 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 44
mode (downloadable free from http://www.hp.com/support/pat). The tools are: Dev Perf - This provides a simple test that will write data directly from system memory to a cartridge in a library on the D2D system. If this tool is run on a server being used as the backup media server it can provide the - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 45
The activity graph below shows the start of a Virtual Tape Write and the current throughput being achieved. The activity graph below shows the end of a Virtual Tape Write and the start of a Virtual Tape Read and the throughput achieved. 45 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 46
the appliance for best practice. The user will be able to see how different data sources will deduplicate and how changes in backup application configuration, for example, might improve the deduplication ratio achieved. Storage-Disk page on the Web Management Interface showing a summary of Total - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 47
page and shows the Disk Storage Capacity Growth for both User Data and Physical Data for the current week for the whole appliance as more backups have been sent to it during the week. This chart can also display this information for a month period. Deduplication Ratio and Daily and Weekly Change - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 48
provides a point-in-time "mirror" of the data on the source D2D at a target D2D system on another site; this enables quick recovery from a disaster that has resulted in the loss of both the original and backup versions of the data on the source site. Replication does not however provide any ability - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 49
well as receiving replicated data from each other. Many-to-One - A target D2D system at a data center is receiving replicated data from many other D2D systems at other locations. N-Way - A collection of D2D systems on several sites are acting as replication targets for other sites. The usage model - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 50
Many to One configuration 50 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 51
N-way configuration In most cases D2D VTL and D2D NAS replication is the same, the only significant configuration difference being that VTL replication allows multiple source libraries to replicate into a single target library, NAS mappings however are 1:1, one replication target share may only - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 52
the source library are used for which type of backup. Generally this is done by creating media pools with the backup application then manually assigning source library cartridges into the relevant pools. For example the backup administrator may configure 3 pools: Daily Incremental, 5 cartridge slots - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 53
in/out Each D2D model has a different level of support for the number of other D2D appliances that can D2D2504 G2 2 8 1 1 1 1 D2D4106 G2 4 16 1 8 1 1 D2D4112 G2 4 24 1 8 1 1 D2D4312 and D2D4324 G2 8 50 1 16 1 1 It is important to note that when utilizing a VTL replication Fan-in model (where - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 54
D2D4312 and D2D4324 G2 16 48 For example, an HP D2D2502 G2 may be replicating up to 4 source items to an HP D2D4312 G2; the HP D2D4312 may also be accepting another 44 source items from other D2D systems backup/restore) to have more available disk I/O. 2. The WAN Bandwidth is too low to support the - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 55
D2D deployment plan as it can sometimes be very time consuming or manually intensive work. During the seeding process it is recommended that no other operations starting on page 49 indicate the different replication models supported by HP D2D Backup Systems; the complexity of the replication models has a - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 56
first 500GB full backup over 1 GbE link (LAN) link will take 3.86 hours on a D2D2502 Backup System. This process backup application supporting the copy process, e.g. Media copy or "object" copy" Use of portable disk drives backup application copy or drag and drop USB portable disks, such as HP - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 57
final replication set-up (mappings) can be established immediately. Active/Passive Active/Active WAN seeding over the first backup is, in fact, the first wholesale replication. WAN seeding after the first backup at each location is, in fact, the first wholesale replication in each direction. 57 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 58
Many to One WAN seeding over the first backup is, in fact, the first wholesale replication from the many remote sites to the Target site. Care must be taken not to run too many replications simultaneously or the Target site may become overloaded. Stagger the seeding process from each remote site. 58 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 59
shipped to the Data Center Site and the replication "re-established" for the final time. Active/Passive Co-location seeding at Source (remote) site 1. Initial backup 3. Ship appliance to Data Center site 2. Replication over GbE link 4. Reestablish replication 59 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 60
Many to One Co-location seeding at Source (remote) sites; transport target D2D between remote sites. 1. Initial backup at each remote site 3. Move Target D2D between remote sites and repeat replication. 5. Re-establish replication. 2. Replication to Target D2D over GbE at each remote - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 61
(remote) sites. Transport floating target D2D between remote sites then perform replication at the Data Center site. Repeat as necessary. 1. Initial backup at each remote site. 3. Move floating Target D2D between remote sites and repeat replication. 2. Replication to floating Target D2D over GbE - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 62
2. At each remote site perform a full system backup to the source D2D and then configure a 1:1 mapping relationship with the floating D2D device" e.g. SVTL1 on Remote Site A - FTVTL1 on floating D2D. FTVTL1 = floating target - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 63
software describes "disk targets for backup" in different ways e.g. HP Data Protector calls D2D NAS shares " DP File Libraries", Commvault Simpana calls D2D NAS shares "Disk libraries." Proceed as follows 1. Perform full system backup to the D2D Backup System at the remote site using the local - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 64
tape, but of course multiple tapes are supported if a tape library is available. For USB disks, separate backup targets for disk devices would need to be by using the portable disk drives to drag and drop backup data from the source system onto the portable disk. Then transport the portable disk to - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 65
time the following are likely to be taking place: Other backups to the D2D system which have not yet finished Housekeeping of the current and other completed overwrite backups Copies to physical tape media of the completed backup These operations will all impact each other's performance, some best - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 66
tab to prevent malicious or accidental configuration of replication mappings from unknown or unauthorized source appliances. See the D2D Backup System user guide for information on how to configure Source Appliance Permissions. Note the following changes to replication functionality when Source - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 67
requirements. The D2D Backup System provides tools to help monitor replication performance and alert system administrators if requirements are maximum time to offsite is exceeded. If these logs and alerts indicate a problem, best practices may be applied in order to get replication times back within - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 68
also show whether replication is being able to utilize multiple jobs to improve performance or whether only small numbers of jobs are running due to backups completing at different times. A best practice is to use blackout windows so that replication jobs all run concurrently at a time when - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 69
details Replication share/library details show the synchronization status, throughput and disk usage for each replicated device. This allows the system administrator to identify the performance of each share individually to see the bandwidth utilization of each share and sync status. Replication - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 70
therefore deduplication ratio for an individual cartridge or file. These can be directly correlated to backup jobs and allow the backup administrator to see the deduplication efficiency of specific data backups. Individual files or cartridges that are not being replicated. This might be because the - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 71
set on BOTH the source D2D and Target D2D. This guide includes a fully worked example of configuring a complex D2D environment Backup System, the housekeeping can interfere with the backup jobs. For example the housekeeping associated with DIR1 starts to affect the end of backup DIR2 since the backup - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 72
By setting a housekeeping blackout window appropriately from 12:00 to 00:00 we can ensure the backups and replication run at maximum speed as can be seen below. The housekeeping is scheduled to run when the device is idle. However some tuning - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 73
with efficiently, maybe the housekeeping activity window is too short (housekeeping blackout window too large), or we may be overloading the D2D with backup and replication jobs and the unit may be undersized. Another indicator is the Time Idle status, which is a measure of the housekeeping empty - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 74
if housekeeping blackout windows are set. e) Re-schedule backup jobs to try and ensure all backup jobs complete at the same time so housekeeping starts at source and target devices. In the worked example later in this best practice guide two blackout windows are set on the target device, 10:00 to 14 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 75
this method. Copies of the data using Direct Tape offload are unable to be tracked by the backup application software. This offload feature is no longer supported on current shipping D2D models. Backup application Tape Offload/Copy from D2D This is now the preferred way of moving data from a D2D - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 76
Tape Offload/Copy from D2D versus Mirrored Backup from Data Source A summary of the supported methods is shown below. For easiest integration For optimum performance Backup application copy to tape Separate physical tape mirrored backup The backup application controls the copy from the D2D - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 77
Copy job to copy data from D2D to physical tape and is easy to automate and schedule, it has a slower copy performance. 2. Mirrored backup; specific backup policy used to back up to D2D and Physical Tape simultaneously (mirrored write) at certain times (monthly). This is a faster copy to tape method - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 78
periods for tape offloads when the D2D Backup System is not busy and use as many 15 TB of data to archive or offload from a D2D4312 to a 2-drive physical tape library, then the copy Practices See Appendix C for a worked example using HP Data Protector. 1. The first recommendation is to really - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 79
for tape offloads to occur. Later in this guide there is a complete multi-site D2D scenario, to be offloaded you may be able to support many hours dedicated to tape offload once HP Data Protector Import scripts. 6. Other backup applications' methods may vary in this area. For example, for most backup - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 80
Appendix A Key reference information 80 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 81
Jobs Source Max Appliance Concurrent Rep Jobs Target Physical Tape Copy Support Supports direct attach of physical tape device Max Concurrent Tape Attach Jobs streams per library Recommended Max Concurrent Backup Streams per appliance Recommended Max Concurrent Backup Streams per Library 16 3.2 96 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 82
Jobs Target 3 2 3 6 6 Physical Tape Copy Support Supports direct attach of physical tape device Yes Yes Yes Yes 96 96 Max Slots MSL2024,MSL4048,MSL8096 Recommended Max Concurrent Backup Streams per appliance Recommended Max Concurrent Backup Streams per Library 24,48,96 16 4 24,48 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 83
D2D design, configuration and deployment tuning. The following steps will be undertaken: Hardware and site configuration definition Backup requirements specification Using HP StorageWorks Backup sizing tool - size the hardware requirements, link speeds and likely costs Work out each D2D Device - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 84
One of the key parameters in sizing a solution such as this is trying to estimate the daily block level change rate for data in each backup job. In this example we will use the default value of 2% in the HP StorageWorks sizing tool. http://h30144.www3.hp.com/SWDSizerWeb/default.htm 84 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 85
Using the HP StorageWorks Backup sizing tool Configure replication environment Click on Backup calculators and then Design D2D for D and C within the sizer tool. 2. For each Source and Target - enter the backup sizes and rotation schemes. Source A and Target E are shown as examples below. Inputs for - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 86
all these throughputs per stream modeled with actual numbers from device testing. So, for best throughput, HP recommends four streams or more. What this means in practice is re-specifying backup jobs to use separate mount points. For example, instead of backing up "Filesystem1" spread across drives - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 87
change environments increase this number. For Site A Filesystem1 the retention scheme is Daily incrementals for 6 days, Weekly full backups kept for 4 weeks and then a monthly full backup. Inputting 6-6, for incremental, 4-4 for weekly fulls, and 1 for the monthly fulls allows us to simulate this - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 88
4. As you specify each job in turn click Add job and the job will be loaded to the summary table (see below). 88 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 89
5. Add all backup jobs for Sites A and D Please note in line with customer request, at sites A and D the D2D emulation has been selected as NAS Emulation with CIFS shares. 89 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 90
6. Repeat for Sites B and C. 90 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 91
7. Input backup job entries for Site E, which requires full backups every day for 29 days and is also required to have FC attach, so click FC in the System interface area. The rotation scheme for Site E is Fulls & Fulls. 91 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 92
We will retain 29 days of Fulls. 92 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 93
8. Press the Solve/Submit button and the Sizer will do the rest. 93 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 94
an excel spreadsheet with all the parts required for the solution including Service and Support, and any licenses required together with the List Pricing. It window. In the following output it has sized HP D2D2502i appliances for the sources and an HP D2D2504 single unit for the target, this is - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 95
under Total TX GB The output continues and shows a summary for each site of the backup concurrency up to the maximum the source device can support (in this case the D2D2502i can support a maximum of 4 concurrent replication jobs). The output also shows the replication concurrency - adding up all - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 96
same time and allow more headroom for future expansion should more remote sites come on line. With an HP D2D2504 as the target device only 8 replication jobs could have run at a time. In addition the HP D2D2504 does not support a FC interface which is a customer requirement for the target site. 96 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 97
2. Click Solve/Submit again. 3. A new parts list is generated with HP D2D4106 as the target, along with an HP D2D4106 replication license for the target. 97 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 98
Better replication efficiency at the target means lower link speeds can be used Target can now handle maximum replication concurrency of sources with room to spare. Note how because the replication is now more efficient we only need just over 2 Mbit/sec WAN links on each of the sources. Configure - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 99
support 2 backup streams) say 12 slots Server 2 VTL - 1 drive (since only one backup stream) say 12 slots Server 3 VTL - 1 drive (since only one backup stream) say 12 slots The monthly backup cycle means a total of 11 cartridges will be used in each cycle, which has guided the file system data, SQL - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 100
total source and target configuration is shown below. Example NAS and VTL configurations Map out the interaction of backup, housekeeping and replication for sources and target With HP D2D Backup Systems it is important to understand that the device cannot do everything at once, it is best to think - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 101
jobs can be scheduled to cpmplete at the same time, the impact of Housekeepong on backup performance will be geatly reduced The HP D2D Backup Systems have the ability to set blackout windows for replication, when no replication will take place - this is deliberate in order to ensure replication - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 102
of "tuning" required at each source site and target sites over time. 1. No changes to existing backup policies - all backups start at the same pre-defined time. 2. Re-schedule backup policies to help reduce the housekeeping overhead. 3. Set replication windows. 4. Set the housekeeping window on the - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 103
being overwritten daily, so housekeeping will happen daily. Consider Sites A and D In the example below housekeeping is happening when other backups are running and also when replication is running. Initial Configuration with NO replication blackout window set There are many overlapping activities - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 104
is not growing overall day by day. Site E, data center At Site E we have replication jobs from A and D, and from B and C as well as local backups. Replication jobs also trigger housekeeping at the target site. The replication window is set to 24 hours. The concurrency level of the target is 24 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 105
the activity at the target, but it is clear that, between 20:00 and 02:00, the target has a very heavy load because local backups, replication jobs from sites A and D and housekeeping associated with replication jobs from sites B and C are all running at the same time. Target improved configuration - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 106
has two options for the copy to tape. Use your backup application to perform a tape-to-tape copy. This can be used at the Central B, C and D onto physical tape. It is easy to administer within the backup application but the streaming performance will be slow because of the reasons explained above. - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 107
performance. Impacts replication performance because clones have to be made on the target. Where possible use "overwrites" on cartridges. Using backup methods that use heavy write-in-place functionality - such as, Drag & drop, Granular Recovery Technology, VMWare changed block tracking->create - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 108
the LTO5 media. Object Copy - this is the copy of a particular host backup or particular data set on a host. Sessions - A backup session is a collection of all the backup jobs that run under an overarching policy HP Data Protector allows copies using a variety of identifiers. The copies can also be - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 109
In this example the following storage devices are configured on HP Data Protector Cell Manager "zen": HP D2DMSL: is a Virtual Tape emulation on the D2D Backup System with 24 virtual slots (with virtual barcodes) and 1 virtual LTO5 drive. A physical MSL Tape Library configured with 2 x LTO5 drives - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 110
HP Data Protector has a context window for controlling Object operations as can be seen below. Full media copy e.g. 50GB on D2D virtual media copied to 800GB of LTO5 Physical media Copy process can happen immediately after backup or scheduled - for D2D scheduling copies is the preferred option. To - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 111
media copies that both the primary copy and the secondary copy media are of the same format in terms of block size, etc, as many backup applications cannot reformat "on the fly". 3. The media copy is shown as successful. To perform an interactive object copy, VTL 1. Select Objects in the left - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 112
2. Click Next and, depending on what backup objects have been selected, HP Data Protector will check that all the necessary source devices (that wrote the backups) are available. Click Next. 3. Select the target (copy to) device and the drive to be used and click Next. Here we have chosen LTO5 drive - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 113
to display the Summary screen and click Finish to start the object copy. 6. These screens show the Object copy in progress from the D2D Backup System to the physical LTO-5 media. Read Device Write Device Device 7. This Object copy can also be scheduled using the scheduled section under object copy - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 114
2. Click Next. Note below the Source device is now a D2D NAS share or in Data Protector terminology a File Library. 3. Select an LTO5 drive in the HP MSL G3 Library to create the copy. 114 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 115
shows the full path of the HP Data Protector File library and the file that represents the backup. 5. In this case the File pane is a Data Protector term used for generating synthetic full backups from a series of incremental backups and requires a specialist filesystem format. It is not associated - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 116
HP StoreOnce D2D software released in February 2011 includes significant performance stabilization updates that reduce the disk access overhead of the deduplication process and therefore improve overall system ), delete original devices and re-target backups to the new devices once replication is - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 117
space to be available on the existing D2D Backup System to work. D2D A HP ProLiant DL320s UID 1 2 1 D2D B HP ProLiant DL320s UID 1 2 Original VTL from the source device to the new target device. See the D2D user guide for detailed steps to create a replication mapping for NAS or VTL. 5. - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 118
of the new library may be different to the original. If using NAS and, if the share name is the same as previously used, the backup application should need no re-configuration to use the new share. 3. If using VTL scan/inventory the new device so that it can update its - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 119
devices on the same D2D Backup System. This model requires that there is sufficient disk space on the D2D Backup System to hold two copies of device self replication migration" Non Replicated device self replication migration D2D A HP ProLiant DL320s UID 1 2 2 Original VTL Original File Share 1 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 120
to allow replication of all data from the source device to the new target device located on the same D2D Backup System. See the HP StoreOnce Backup System user guide for detailed steps to create a replication mapping for NAS or VTL. 4. Allow replication to synchronize the two devices. 2 Step - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 121
. 2. Configure new replication mappings using the Replication Wizard on the D2D Backup Systems to allow replication of all data from the source device to the new target device. See the HP StoreOnce Backup System user guide for detailed steps to create a replication mapping for NAS or VTL. 3. Allow - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 122
. 6. Remove the appliance addresses from the list of replication target appliances on both D2D Backup Systems. 7. "Connect" the backup media server to the new source device. For example: - Mount the NFS share - Discover the iSCSI VTL device and connect - Zone the FC SAN so - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 123
Configuring Self Migration from the D2D Web Management Interface The HP StoreOnce Backup System user guide provides step by step instructions on how to configure replication mappings on the Web Management Interface. However, there are some differences when configuring Self Replication. This chapter - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 124
the IP address or FQDN (Fully Qualified Domain Name) of the D2D in Target Appliance Address. Note that this is the address of the local system. Addresses of other appliances may not be used because, without a license, the D2D Backup System may only replicate to itself. 124 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 125
5. Upon successful completion the local appliance will be added to the Target Appliances list. 6. Go to the Replication - NAS Mappings page, select the share to be replicated (i.e. the original share with backup data in it) and click Start Replication Wizard. 125 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 126
7. There are two main steps in the Wizard, the first is to select the target appliance from a list. This list will only contain the information about the local D2D appliance and will be highlighted already. Click Next. 8. Select the Target Share (this is the new share that was created earlier in the - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 127
9. After completing the wizard, replication will begin synchronizing the data between the two shares. Synchronization will take some time to complete because all data must be replicated to the new device. Once complete, the status will change to Synchronized which means that the same data is present - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 128
deleting the original share to ensure the migration has been successful and that the backup application can access the new share. 12.Once the replication mapping has been removed and the new share configured with the backup application, the original share can be deleted from the NAS - Shares page on - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 129
, 50 activity graph, 44 AD authentication, 39 AD domain joining, 39 leaving, 43 problems joining, 39 authentication, 38 B backup application and NAS, 32 backup application considerations, 27 backup job recommendations, 29 bandwidth limiting, 66 best practices general, 5 housekeeping, 9 NAS, 6, 30 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 130
, 58 overview, 56 using physical tape, 64 single port mode, 12 sizing guide, 23 sizing tool example, 87 source, 67 storage and deduplication ratio, 46 store migration, 118 StoreOnce technology, 7 switched fabric, 19 synthetic backups, 37 Sys-Perf, 44 T tape offload best practices, 79 overview, 76 - HP StoreOnce 4210 | HP D2D Backup Systems Best practices for VTL, NAS and Replic - Page 131
To read more about the HP D2D Backup System, go to www.hp.com/go/D2D Share with colleagues © Copyright 2011-2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the
1
HP D2D Backup Systems
Best practices for VTL, NAS and
Replication implementations
Table of contents
Abstract
..............................................................................................................................................
4
Related products
..................................................................................................................................
4
Validity
...........................................................................................................................................
4
Executive summary
...............................................................................................................................
5
General D2D best practices at a glance
.............................................................................................
5
VTL best practices at a glance
............................................................................................................
5
NAS best practices at a glance
.........................................................................................................
6
HP StoreOnce Technology
....................................................................................................................
7
Replication overview
........................................................................................................................
7
Housekeeping overview
....................................................................................................................
8
Upstream and Backup Application considerations
................................................................................
9
Data compression and encryption backup application features
............................................................
10
Network configuration
........................................................................................................................
11
Single Port mode
............................................................................................................................
12
Dual Port mode
..............................................................................................................................
13
High availability port mode (Port failover)
.........................................................................................
14
High availability port mode (Link Aggregate)
....................................................................................
14
10Gbit Ethernet ports on the 4312/4324 appliances
........................................................................
15
Network configuration for CIFS AD
..................................................................................................
15
Backup server networking
...............................................................................................................
18