HP D2D4009i HP D2D Backup Systems Best practices for VTL, NAS and Replication
HP D2D4009i Manual
View all HP D2D4009i manuals
Add to My Manuals
Save this manual to your list of manuals |
HP D2D4009i manual content summary:
- HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 1
HP D2D Backup Systems Best practices for VTL, NAS and Replication implementations Table of contents Abstract...4 Related products ...4 Validity ...4 Executive summary...5 General D2D best practices at a glance 5 VTL best practices at a glance...5 NAS best practices at a glance ...6 HP StoreOnce - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 2
21 Best practices for network and Fibre Channel configuration 22 VTL best practices ...25 Summary of best practices...25 Tape library emulation ...25 Backup application configuration ...27 Rotation schemes and retention policy 28 D2D NAS best practices ...30 Introduction to D2D NAS - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 3
Generation 1 products, software 1.1.00 82 Appendix B - Fully Worked Example 83 Hardware and site configuration...83 Backup requirements specification...84 Using the HP StorageWorks Backup sizing tool 85 Configure D2D source devices and replication target configuration 98 Map out the interaction - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 4
StorageWorks D2D Backup System Best Practices for Performance Optimization" (HP Document Part Number EH990-90921) to include more detailed content; the previous document is now obsolete. Best practices identified in this document are predicated on using up-to-date D2D system firmware (check www.hp - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 5
General D2D best practices at a glance Always use the HP D2D Sizing tool to size your D2D solution. Always ensure the hardware component firmware and D2D software in your HP D2D Backup System are fully up-to-date. (Check at http://www.hp.com/support.) Take into account the need for the deduplication - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 6
to the suggested maximum number of concurrent operations per share/appliance. Choose disk backup file sizes in backup software to meet the maximum backup size. Disable software compression, deduplication and synthetic full backups. Do not pre-allocate disk space for backup files. Do not append to - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 7
Technology works is necessary in order to understand factors that may impact performance of the overall system and to ensure optimal performance of your backup solution. HP StoreOnce Technology is an "inline" data deduplication process. It uses hash-based chunking technology, which analyzes - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 8
a better deduplication ratio on the target D2D Backup System. Replication starts when the cartridge is unloaded or maximum number of concurrent replication jobs supported by source and target D2D appliances further backups, restores, tape offload jobs or replication. In order to avoid this problem - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 9
of cartridges are manually erased or re-formatted. In general all media overwrites should be controlled by the backup rotation scheme so to 1. Use multiple backup streams The HP D2D system performs best with multiple backup streams sent to it simultaneously. For example an HP D2D4112 G2 will back - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 10
there is no encryption of data before it is sent to the D2D appliance. Ensure that software compression is turned off within the backup application. Not all data sources will result in high deduplication ratios and performance can, therefore, vary across different data sources. Digital images, video - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 11
. In order to deliver best performance when backing up data over the Ethernet ports it will be necessary to configure the D2D network ports, backup servers and network infrastructure to maximise available bandwidth to the D2D device. Each pair of network ports on the D2D, (i.e. the two 1Gbit ports - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 12
ports are available on the switch network or if the appliance is being used to transfer data over fibre channel ports only. On an HP D2D4312 or D2D4324 with 10Gbit ports it is possible that a single 10Gbit port will deliver good performance in most environments. Network configuration, single port - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 13
i.e. each server has a port for business network traffic and another for data backup. In this case one port on the D2D can be used solely for access a separate network SAN being used, configuration of CIFS backup shares with Active Directory authentication requires careful consideration, see Network - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 14
mode to achieve highest performance for iSCSI and NAS operation. It requires the switch to support IEEE802.3ad Link Aggregation and needs the switch to be set up accordingly. See the relevant product user guide for more details. This mode sets up "bonded" network ports, where both network ports in - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 15
it is common to configure a "Network SAN", which is a dedicated network for backup that is separate to the normal business data network; only backup data is transmitted over this network. Network configuration, HP D2D4312/4324 with 10Gbit ports When a separate network SAN is used, configuration of - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 16
configurations which allow both: Access to the Active Directory server for AD authentication and Separation of Corporate LAN and Network SAN traffic Option 1: HP D2D Backup System on Corporate SAN and Network SAN In this option, the D2D device has a port in the Corporate SAN which has access to the - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 17
Option 2: HP D2D Backup System on Network SAN only with Gateway In this option the D2D has connections only to the Active Directory Domain controller. The illustration shows a simple Class C network for a medium-sized LAN configuration. HP D2D Backup System on Network SAN only with Gateway 17 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 18
network ports that are teamed / bonded in order to provide a fast connection to the LAN. Client servers (those that back up via a backup server) may be connected with only a single port, if backups are to be aggregated through the backup server. Ensure that no sub-1Gbit network components are in the - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 19
loop) topologies. Direct Attach (point to point) topology is not supported. Switched fabric using NPIV (N Port ID Virtualisation) offers a to form large fabrics. Fibre Channel, switched fabric topology HP StorageWorks D2D Backup System Virtual Library 1 (e.g. D2D Generic) Medium Changer Tape Tape - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 20
(private loop) topology HP StorageWorks D2D Backup System Virtual Library 1 (e.g. System may be connected to a FC private loop, direct attach topology. The FC port configuration of the D2D Appliance should be changed from the default N_Port topology setting to Loop. This topology only supports - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 21
HBAs is supported along with the coexistence of array multipath software (no multipath to tape or library devices on the HP D2D Backup System, but on the appliance (Port 0 and Port 1) are provided in the HP D2D Backup System user guide. There is a page on the Web Management Interface that allows you - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 22
. This page is mainly for information and is useful in troubleshooting. Best practices for network and Fibre Channel configuration The following should be zoned on the switch to be only accessible from a single backup server device. This ensures that other SAN events, such as the addition and - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 23
a simple sizing guide for the HP D2D Generation 2 product family for backups and backups and replication. HDaPilDy2bDacBkauDcpka:utipylypSiycBsatalecmakmGuoeupnnt-2ofTsidyzaipntagictgahualitdacemanobuenptrootefctdedatbay tHhPaSttocreaOnnbceeBpacrkoutpescytsteedmsby StoreOnce Backup systems. D2D4324 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 24
The use of this tool enables accurate capacity sizing, retention period decisions and replication link sizing and performance for the most complex D2D environments. A fully worked example using the Sizing Tool and best practices is contained later in the document, see Appendix B. 24 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 25
each incremental backup. Tape library emulation Emulation types The HP D2D Backup Systems can emulate several types of physical HP Tape G2 products with 2.1.X or later software a more flexible emulation strategy is supported. The appliance is provided with a drive pool and these can be allocated - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 26
200 4096 24, 48, 96 128 64 12 The HP D2DBS emulation type and the ESL/EML type, supported on the G2 product family with code revision 2.1 onwards, is also clearly identified in most backup applications as a virtual tape library and so is easier for supportability. It is the recommended option for - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 27
as described on page 71. Note that if backups are to be offloaded to physical media elsewhere in of libraries per appliance The D2D appliance supports the creation of multiple virtual library devices size, and up to 1 MB is suggested. For HP Data Protector and EMC Networker Software a block size of - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 28
fact that restore performance (required for verify) is slower for inline deduplication-enabled devices. Disabling verify for selected backup jobs can be done relatively safely as D2D Backup Systems perform CRC (Cyclic Redundancy Check) checking for every backed-up chunk to ensure that no errors are - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 29
can be configured for "free" and their sizes can be configured so that they are appropriate to the amount of data stored in a specific backup. Appended backups are of no benefit because media costs are not relevant. In addition, there will be a penalty when performing any tape offload because the - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 30
backup targets The HP StorageWorks D2D Backup System now supports the ability to create a NAS (CIFS or NFS) share to be used as a target for backup HP D2D NAS Implementation guides are available for on the HP web site for the following backup applications: HP Data Protector 6.11, Symantec Backup - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 31
good replication responsiveness to data change. This is not an issue with backup applications because they create large files and it is very unlikely that several shares in order to realise best performance from the entire system by improving the responsiveness of each store. Smaller stores have less - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 32
of these limits is provided in the Backup Application Implementation Guides; there is a separate guide for HP Data Protector 6.11, Symantec Backup Exec 2010, CommVault Simpana 9.0 and Netbackup. Backup application configuration The HP D2D Backup System NAS functionality is designed to be used - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 33
closed, lots of smaller files would result in housekeeping running during the backup when the files are closed. * See Housekeeping monitoring and control size is the best approach. However in some specific cases using smaller backup files is of benefit. For example, in a replication environment, - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 34
ensure that there is enough disk space available to write the entire backup file. This setting has no value for D2D devices because it will not result in any physical disk space actually being allocated due to the deduplication system. It is advised that this setting is NOT used because it can - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 35
for each D2D share. Multiple servers, single stream backup Multiple servers, multi-stream backup Multiple servers, multiple single-stream backups The table below shows the recommended maximum number of backup streams or jobs per share to ensure that backups will not fail due to exceeding the maximum - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 36
. Unfortunately it also has a very detrimental effect on deduplication as data backed up will look different in every backup preventing the ability to match similar data blocks. The best practice is to disable software encryption and compression for all backups to the HP D2D Backup System. 36 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 37
and therefore a slow operation. An exception to this restriction is the HP Data Protector Synthetic full backup which works well. However the HP Data Protector Virtual Synthetic full backup which uses a distributed file system and creates thousands of open files does not. Housekeeping impact on - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 38
the D2D management interface. This mode requires the configuration of a respective local user on the backup application media server as well as configuration changes to the backup application services. Individual users can then be assigned access to individual shares on the D2D. This authentication - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 39
by the media servers should use the same "backup" user account, including any shares on other D2D devices or NAS systems. Tips for configuring AD authentication D2D products support configuration in a multi-domain tree forest but do not support multi-forest domain topologies. In order to join - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 40
1. Create a new Host(A) record in the forward lookup zone for the domain to which the D2D belongs with the hostname and IP address of the D2D. Click Add Host. 2. Also create a Pointer(PTR) in the reverse lookup zone for the domain for the D2D appliance by providing hostname and IP address. Click OK. - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 41
Now that the D2D is a member of the domain its shares can be managed from any computer on the domain by configuring a customized Microsoft Management Console (MMC) with the Shared Folders snap-in. Once you have created shares you can manage them as follows. 1. Open a new MMC window by typing mmc at - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 42
. 4. Finally select Finish and OK to complete the snap-in set up. Note that the Folder Path field contains an internal path on the D2D Backup System. 5. Save this customized snap-in for future use. 42 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 43
will reconfigure its own authentication mode, but will not correctly inform the domain controller that the computer has left the domain. The administrator should then manually remove the computer's entry in the AD configuration. 43 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 44
mode (downloadable free from http://www.hp.com/support/pat). The tools are: Dev Perf - This provides a simple test that will write data directly from system memory to a cartridge in a library on the D2D system. If this tool is run on a server being used as the backup media server it can provide the - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 45
The activity graph below shows the start of a Virtual Tape Write and the current throughput being achieved. The activity graph below shows the end of a Virtual Tape Write and the start of a Virtual Tape Read and the throughput achieved. 45 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 46
the appliance for best practice. The user will be able to see how different data sources will deduplicate and how changes in backup application configuration, for example, might improve the deduplication ratio achieved. Storage-Disk page on the Web Management Interface showing a summary of Total - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 47
page and shows the Disk Storage Capacity Growth for both User Data and Physical Data for the current week for the whole appliance as more backups have been sent to it during the week. This chart can also display this information for a month period. Deduplication Ratio and Daily and Weekly Change - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 48
HP StorageWorks D2D products provide deduplication-enabled, low bandwidth replication for both VTL and NAS devices. Replication enables data on a "replication source" D2D to be replicated to a "replication target" D2D system in the next backup, and all previous versions of backup on the source D2D - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 49
well as receiving replicated data from each other. Many-to-One - A target D2D system at a data center is receiving replicated data from many other D2D systems at other locations. N-Way - A collection of D2D systems on several sites are acting as replication targets for other sites. The usage model - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 50
Many to One configuration 50 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 51
N-way configuration In most cases D2D VTL and D2D NAS replication is the same, the only significant configuration difference being that VTL replication allows multiple source libraries to replicate into a single target library, NAS mappings however are 1:1, one replication target share may only - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 52
the source library are used for which type of backup. Generally this is done by creating media pools with the backup application then manually assigning source library cartridges into the relevant pools. For example the backup administrator may configure 3 pools: Daily Incremental, 5 cartridge slots - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 53
Appliance, library and share replication fan in/out Each D2D model has a different level of support for the number of other D2D appliances that can be involved in replication mappings with it, and also the number of libraries that may replicate - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 54
replication source and target D2D systems. In most cases a WAN link will be used to transfer the data between sites unless the replication environment is all on the same campus LAN. It is recommended that the HP StorageWorks Sizing Tool (http://www.hp.com/go/storageworks/sizer) is used to identify - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 55
D2D deployment plan as it can sometimes be very time consuming or manually intensive work. During the seeding process it is recommended that no other operations starting on page 49 indicate the different replication models supported by HP D2D Backup Systems; the complexity of the replication models has a - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 56
backup over 1 GbE link (LAN) link will take 3.86 hours on a D2D2502 Backup System backup application supporting the copy process, e.g. Media copy or "object" copy" Use of portable disk drives backup application copy or drag and drop USB portable disks, such as HP the StorageWorks Backup Sizing tool - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 57
final replication set-up (mappings) can be established immediately. Active/Passive Active/Active WAN seeding over the first backup is, in fact, the first wholesale replication. WAN seeding after the first backup at each location is, in fact, the first wholesale replication in each direction. 57 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 58
Many to One WAN seeding over the first backup is, in fact, the first wholesale replication from the many remote sites to the Target site. Care must be taken not to run too many replications simultaneously or the Target site may become overloaded. Stagger the seeding process from each remote site. 58 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 59
shipped to the Data Center Site and the replication "re-established" for the final time. Active/Passive Co-location seeding at Source (remote) site 1. Initial backup 3. Ship appliance to Data Center site 2. Replication over GbE link 4. Reestablish replication 59 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 60
Many to One Co-location seeding at Source (remote) sites; transport target D2D between remote sites. 1. Initial backup at each remote site 3. Move Target D2D between remote sites and repeat replication. 5. Re-establish replication. 2. Replication to Target D2D over GbE at each remote - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 61
(remote) sites. Transport floating target D2D between remote sites then perform replication at the Data Center site. Repeat as necessary. 1. Initial backup at each remote site. 3. Move floating Target D2D between remote sites and repeat replication. 2. Replication to floating Target D2D over GbE - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 62
2. At each remote site perform a full system backup to the source D2D and then configure a 1:1 mapping relationship with the floating D2D device" e.g. SVTL1 on Remote Site A - FTVTL1 on floating D2D. FTVTL1 = floating target - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 63
software describes "disk targets for backup" in different ways e.g. HP Data Protector calls D2D NAS shares " DP File Libraries", Commvault Simpana calls D2D NAS shares "Disk libraries." Proceed as follows 1. Perform full system backup to the D2D Backup System at the remote site using the local - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 64
tape, but of course multiple tapes are supported if a tape library is available. For USB disks, separate backup targets for disk devices would need to be by using the portable disk drives to drag and drop backup data from the source system onto the portable disk. Then transport the portable disk to - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 65
time the following are likely to be taking place: Other backups to the D2D system which have not yet finished Housekeeping of the current and other completed overwrite backups Copies to physical tape media of the completed backup These operations will all impact each other's performance, some best - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 66
tab to prevent malicious or accidental configuration of replication mappings from unknown or unauthorized source appliances. See the D2D Backup System user guide for information on how to configure Source Appliance Permissions. Note the following changes to replication functionality when Source - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 67
requirements. The D2D Backup System provides tools to help monitor replication performance and alert system administrators if requirements are maximum time to offsite is exceeded. If these logs and alerts indicate a problem, best practices may be applied in order to get replication times back within - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 68
also show whether replication is being able to utilize multiple jobs to improve performance or whether only small numbers of jobs are running due to backups completing at different times. A best practice is to use blackout windows so that replication jobs all run concurrently at a time when - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 69
details Replication share/library details show the synchronization status, throughput and disk usage for each replicated device. This allows the system administrator to identify the performance of each share individually to see the bandwidth utilization of each share and sync status. Replication - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 70
therefore deduplication ratio for an individual cartridge or file. These can be directly correlated to backup jobs and allow the backup administrator to see the deduplication efficiency of specific data backups. Individual files or cartridges that are not being replicated. This might be because the - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 71
set on BOTH the source D2D and Target D2D. This guide includes a fully worked example of configuring a complex D2D environment Backup System, the housekeeping can interfere with the backup jobs. For example the housekeeping associated with DIR1 starts to affect the end of backup DIR2 since the backup - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 72
By setting a housekeeping blackout window appropriately from 12:00 to 00:00 we can ensure the backups and replication run at maximum speed as can be seen below. The housekeeping is scheduled to run when the device is idle. However some tuning - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 73
with efficiently, maybe the housekeeping activity window is too short (housekeeping blackout window too large), or we may be overloading the D2D with backup and replication jobs and the unit may be undersized. Another indicator is the Time Idle status, which is a measure of the housekeeping empty - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 74
if housekeeping blackout windows are set. e) Re-schedule backup jobs to try and ensure all backup jobs complete at the same time so housekeeping starts at source and target devices. In the worked example later in this best practice guide two blackout windows are set on the target device, 10:00 to 14 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 75
this method. Copies of the data using Direct Tape offload are unable to be tracked by the backup application software. This offload feature is no longer supported on current shipping D2D models. Backup application Tape Offload/Copy from D2D This is now the preferred way of moving data from a D2D - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 76
Tape Offload/Copy from D2D versus Mirrored Backup from Data Source A summary of the supported methods is shown below. For easiest integration For optimum performance Backup application copy to tape Separate physical tape mirrored backup The backup application controls the copy from the D2D - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 77
Copy job to copy data from D2D to physical tape and is easy to automate and schedule, it has a slower copy performance. 2. Mirrored backup; specific backup policy used to back up to D2D and Physical Tape simultaneously (mirrored write) at certain times (monthly). This is a faster copy to tape method - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 78
you must schedule specific time periods for tape offloads when the D2D Backup System is not busy and use as many parallel copy streams (tape schedule. Summary of Best Practices See Appendix C for a worked example using HP Data Protector. 1. The first recommendation is to really assess the need for - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 79
for tape offloads to occur. Later in this guide there is a complete multi-site D2D scenario, to be offloaded you may be able to support many hours dedicated to tape offload once HP Data Protector Import scripts. 6. Other backup applications' methods may vary in this area. For example, for most backup - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 80
Appendix A Key reference information 80 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 81
Jobs Source Max Appliance Concurrent Rep Jobs Target Physical Tape Copy Support Supports direct attach of physical tape device Max Concurrent Tape Attach Jobs streams per library Recommended Max Concurrent Backup Streams per appliance Recommended Max Concurrent Backup Streams per Library 16 3.2 96 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 82
Jobs Target 3 2 3 6 6 Physical Tape Copy Support Supports direct attach of physical tape device Yes Yes Yes Yes 96 96 Max Slots MSL2024,MSL4048,MSL8096 Recommended Max Concurrent Backup Streams per appliance Recommended Max Concurrent Backup Streams per Library 24,48,96 16 4 24,48 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 83
D2D design, configuration and deployment tuning. The following steps will be undertaken: Hardware and site configuration definition Backup requirements specification Using HP StorageWorks Backup sizing tool - size the hardware requirements, link speeds and likely costs Work out each D2D Device - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 84
One of the key parameters in sizing a solution such as this is trying to estimate the daily block level change rate for data in each backup job. In this example we will use the default value of 2% in the HP StorageWorks sizing tool. http://h30144.www3.hp.com/SWDSizerWeb/default.htm 84 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 85
Using the HP StorageWorks Backup sizing tool Configure replication environment Click on Backup calculators and then Design D2D for D and C within the sizer tool. 2. For each Source and Target - enter the backup sizes and rotation schemes. Source A and Target E are shown as examples below. Inputs for - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 86
all these throughputs per stream modeled with actual numbers from device testing. So, for best throughput, HP recommends four streams or more. What this means in practice is re-specifying backup jobs to use separate mount points. For example, instead of backing up "Filesystem1" spread across drives - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 87
change environments increase this number. For Site A Filesystem1 the retention scheme is Daily incrementals for 6 days, Weekly full backups kept for 4 weeks and then a monthly full backup. Inputting 6-6, for incremental, 4-4 for weekly fulls, and 1 for the monthly fulls allows us to simulate this - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 88
4. As you specify each job in turn click Add job and the job will be loaded to the summary table (see below). 88 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 89
5. Add all backup jobs for Sites A and D Please note in line with customer request, at sites A and D the D2D emulation has been selected as NAS Emulation with CIFS shares. 89 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 90
6. Repeat for Sites B and C. 90 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 91
7. Input backup job entries for Site E, which requires full backups every day for 29 days and is also required to have FC attach, so click FC in the System interface area. The rotation scheme for Site E is Fulls & Fulls. 91 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 92
We will retain 29 days of Fulls. 92 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 93
8. Press the Solve/Submit button and the Sizer will do the rest. 93 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 94
an excel spreadsheet with all the parts required for the solution including Service and Support, and any licenses required together with the List Pricing. It window. In the following output it has sized HP D2D2502i appliances for the sources and an HP D2D2504 single unit for the target, this is - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 95
under Total TX GB The output continues and shows a summary for each site of the backup concurrency up to the maximum the source device can support (in this case the D2D2502i can support a maximum of 4 concurrent replication jobs). The output also shows the replication concurrency - adding up all - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 96
same time and allow more headroom for future expansion should more remote sites come on line. With an HP D2D2504 as the target device only 8 replication jobs could have run at a time. In addition the HP D2D2504 does not support a FC interface which is a customer requirement for the target site. 96 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 97
2. Click Solve/Submit again. 3. A new parts list is generated with HP D2D4106 as the target, along with an HP D2D4106 replication license for the target. 97 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 98
Better replication efficiency at the target means lower link speeds can be used Target can now handle maximum replication concurrency of sources with room to spare. Note how because the replication is now more efficient we only need just over 2 Mbit/sec WAN links on each of the sources. Configure - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 99
support 2 backup streams) say 12 slots Server 2 VTL - 1 drive (since only one backup stream) say 12 slots Server 3 VTL - 1 drive (since only one backup stream) say 12 slots The monthly backup cycle means a total of 11 cartridges will be used in each cycle, which has guided the file system data, SQL - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 100
total source and target configuration is shown below. Example NAS and VTL configurations Map out the interaction of backup, housekeeping and replication for sources and target With HP D2D Backup Systems it is important to understand that the device cannot do everything at once, it is best to think - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 101
jobs can be scheduled to cpmplete at the same time, the impact of Housekeepong on backup performance will be geatly reduced The HP D2D Backup Systems have the ability to set blackout windows for replication, when no replication will take place - this is deliberate in order to ensure replication - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 102
of "tuning" required at each source site and target sites over time. 1. No changes to existing backup policies - all backups start at the same pre-defined time. 2. Re-schedule backup policies to help reduce the housekeeping overhead. 3. Set replication windows. 4. Set the housekeeping window on the - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 103
being overwritten daily, so housekeeping will happen daily. Consider Sites A and D In the example below housekeeping is happening when other backups are running and also when replication is running. Initial Configuration with NO replication blackout window set There are many overlapping activities - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 104
is not growing overall day by day. Site E, data center At Site E we have replication jobs from A and D, and from B and C as well as local backups. Replication jobs also trigger housekeeping at the target site. The replication window is set to 24 hours. The concurrency level of the target is 24 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 105
the activity at the target, but it is clear that, between 20:00 and 02:00, the target has a very heavy load because local backups, replication jobs from sites A and D and housekeeping associated with replication jobs from sites B and C are all running at the same time. Target improved configuration - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 106
has two options for the copy to tape. Use your backup application to perform a tape-to-tape copy. This can be used at the Central B, C and D onto physical tape. It is easy to administer within the backup application but the streaming performance will be slow because of the reasons explained above. - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 107
performance. Impacts replication performance because clones have to be made on the target. Where possible use "overwrites" on cartridges. Using backup methods that use heavy write-in-place functionality - such as, Drag & drop, Granular Recovery Technology, VMWare changed block tracking->create - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 108
the LTO5 media. Object Copy - this is the copy of a particular host backup or particular data set on a host. Sessions - A backup session is a collection of all the backup jobs that run under an overarching policy HP Data Protector allows copies using a variety of identifiers. The copies can also be - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 109
In this example the following storage devices are configured on HP Data Protector Cell Manager "zen": HP D2DMSL: is a Virtual Tape emulation on the D2D Backup System with 24 virtual slots (with virtual barcodes) and 1 virtual LTO5 drive. A physical MSL Tape Library configured with 2 x LTO5 drives - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 110
HP Data Protector has a context window for controlling Object operations as can be seen below. Full media copy e.g. 50GB on D2D virtual media copied to 800GB of LTO5 Physical media Copy process can happen immediately after backup or scheduled - for D2D scheduling copies is the preferred option. To - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 111
media copies that both the primary copy and the secondary copy media are of the same format in terms of block size, etc, as many backup applications cannot reformat "on the fly". 3. The media copy is shown as successful. To perform an interactive object copy, VTL 1. Select Objects in the left - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 112
2. Click Next and, depending on what backup objects have been selected, HP Data Protector will check that all the necessary source devices (that wrote the backups) are available. Click Next. 3. Select the target (copy to) device and the drive to be used and click Next. Here we have chosen LTO5 drive - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 113
to display the Summary screen and click Finish to start the object copy. 6. These screens show the Object copy in progress from the D2D Backup System to the physical LTO-5 media. Read Device Write Device Device 7. This Object copy can also be scheduled using the scheduled section under object copy - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 114
2. Click Next. Note below the Source device is now a D2D NAS share or in Data Protector terminology a File Library. 3. Select an LTO5 drive in the HP MSL G3 Library to create the copy. 114 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 115
shows the full path of the HP Data Protector File library and the file that represents the backup. 5. In this case the File pane is a Data Protector term used for generating synthetic full backups from a series of incremental backups and requires a specialist filesystem format. It is not associated - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 116
HP StoreOnce D2D software released in February 2011 includes significant performance stabilization updates that reduce the disk access overhead of the deduplication process and therefore improve overall system to perform replication when backups cannot run Requires 2 D2D systems and a replication - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 117
the existing D2D Backup System to work. D2D A HP ProLiant DL320s UID 1 2 1 D2D B HP ProLiant DL320s UID LAN as the original D2D. 2. Upgrade the firmware on both D2D devices to 2.1.00/1.1.00. 3. the new target device. See the D2D user guide for detailed steps to create a replication mapping for - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 118
of the new library may be different to the original. If using NAS and, if the share name is the same as previously used, the backup application should need no re-configuration to use the new share. 3. If using VTL scan/inventory the new device so that it can update its - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 119
devices on the same D2D Backup System. This model requires that there is sufficient disk space on the D2D Backup System to hold two copies of device self replication migration" Non Replicated device self replication migration D2D A HP ProLiant DL320s UID 1 2 2 Original VTL Original File Share 1 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 120
to allow replication of all data from the source device to the new target device located on the same D2D Backup System. See the HP StoreOnce Backup System user guide for detailed steps to create a replication mapping for NAS or VTL. 4. Allow replication to synchronize the two devices. 2 Step - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 121
. 2. Configure new replication mappings using the Replication Wizard on the D2D Backup Systems to allow replication of all data from the source device to the new target device. See the HP StoreOnce Backup System user guide for detailed steps to create a replication mapping for NAS or VTL. 3. Allow - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 122
. 6. Remove the appliance addresses from the list of replication target appliances on both D2D Backup Systems. 7. "Connect" the backup media server to the new source device. For example: - Mount the NFS share - Discover the iSCSI VTL device and connect - Zone the FC SAN so - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 123
D2D Web Management Interface The HP StoreOnce Backup System user guide provides step by step instructions on how to configure replication share is created after the upgrade to new firmware, so will benefit from the performance enhancements. The D2D Backup System does NOT need to have a replication - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 124
the IP address or FQDN (Fully Qualified Domain Name) of the D2D in Target Appliance Address. Note that this is the address of the local system. Addresses of other appliances may not be used because, without a license, the D2D Backup System may only replicate to itself. 124 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 125
5. Upon successful completion the local appliance will be added to the Target Appliances list. 6. Go to the Replication - NAS Mappings page, select the share to be replicated (i.e. the original share with backup data in it) and click Start Replication Wizard. 125 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 126
7. There are two main steps in the Wizard, the first is to select the target appliance from a list. This list will only contain the information about the local D2D appliance and will be highlighted already. Click Next. 8. Select the Target Share (this is the new share that was created earlier in the - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 127
9. After completing the wizard, replication will begin synchronizing the data between the two shares. Synchronization will take some time to complete because all data must be replicated to the new device. Once complete, the status will change to Synchronized which means that the same data is present - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 128
deleting the original share to ensure the migration has been successful and that the backup application can access the new share. 12.Once the replication mapping has been removed and the new share configured with the backup application, the original share can be deleted from the NAS - Shares page on - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 129
, 50 activity graph, 44 AD authentication, 39 AD domain joining, 39 leaving, 43 problems joining, 39 authentication, 38 B backup application and NAS, 32 backup application considerations, 27 backup job recommendations, 29 bandwidth limiting, 66 best practices general, 5 housekeeping, 9 NAS, 6, 30 - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 130
overview, 56 using physical tape, 64 single port mode, 12 sizing guide, 23 sizing tool example, 87 source, 67 storage and deduplication ratio, 46 store migration, 118 StoreOnce technology, 7 switched fabric, 19 synthetic backups, 37 Sys-Perf, 44 T tape offload best practices, 79 overview - HP D2D4009i | HP D2D Backup Systems Best practices for VTL, NAS and Replication - Page 131
To read more about the HP D2D Backup System, go to www.hp.com/go/D2D Share with colleagues © Copyright 2011-2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the
1
HP D2D Backup Systems
Best practices for VTL, NAS and
Replication implementations
Table of contents
Abstract
..............................................................................................................................................
4
Related products
..................................................................................................................................
4
Validity
...........................................................................................................................................
4
Executive summary
...............................................................................................................................
5
General D2D best practices at a glance
.............................................................................................
5
VTL best practices at a glance
............................................................................................................
5
NAS best practices at a glance
.........................................................................................................
6
HP StoreOnce Technology
....................................................................................................................
7
Replication overview
........................................................................................................................
7
Housekeeping overview
....................................................................................................................
8
Upstream and Backup Application considerations
................................................................................
9
Data compression and encryption backup application features
............................................................
10
Network configuration
........................................................................................................................
11
Single Port mode
............................................................................................................................
12
Dual Port mode
..............................................................................................................................
13
High availability port mode (Port failover)
.........................................................................................
14
High availability port mode (Link Aggregate)
....................................................................................
14
10Gbit Ethernet ports on the 4312/4324 appliances
........................................................................
15
Network configuration for CIFS AD
..................................................................................................
15
Backup server networking
...............................................................................................................
18