HP D2D D2D Best Practices for VTL, NAS and Replication implementations (EH985-
HP D2D Manual
View all HP D2D manuals
Add to My Manuals
Save this manual to your list of manuals |
HP D2D manual content summary:
- HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 1
5 VTL best practices at a glance ...5 NAS best practices at a glance ...6 HP StoreOnce Technology ...7 Replication overview ...7 Housekeeping overview ...8 Upstream and Backup Application considerations 9 Data compression and encryption backup application features 10 Network configuration...11 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 2
44 Performance tools...44 Performance metrics on the Web Management Interface 44 How to use the D2D storage and deduplication ratio reporting metrics 46 D2D Replication ...48 D2D replication overview...48 Best practices overview...48 Replication usage models...49 What to replicate ...52 Appliance - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 3
HP StorageWorks Backup sizing tool 85 Configure D2D source devices and replication target configuration 98 Map out the interaction of backup, housekeeping and replication for sources and target 100 Tune the solution using replication windows and housekeeping windows 102 Worked example - backup - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 4
Data Deduplication are Virtual Tape library and NAS appliances designed to provide a cost-effective, consolidated backup solution for business data and fast restore of data in the event of loss. In order to get the best performance from a D2D Backup System there are some configuration best practices - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 5
tool to size your D2D solution. Always ensure the hardware component firmware and D2D software in your HP D2D Backup System are fully up-to-date. (Check at http://www.hp.com/support.) Take into account the need for the deduplication ―Housekeeping‖ process to run when designing backup configurations - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 6
NAS best practices at a glance Configure multiple shares and separate data types into their own shares. Adhere to the suggested maximum number of concurrent operations per share/appliance. Choose disk backup file sizes in backup software to meet the maximum backup size. Disable software compression, - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 7
of the overall system and to ensure optimal performance of your backup solution. HP StoreOnce Technology is an ―inline‖ data deduplication process. It uses hash-based chunking technology, which analyzes incoming backup data in ―chunks‖ that average up to 4K in size. The hashing algorithm generates - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 8
D2D2504i G1 8 2 3 D2D2503i G1 6 1 2 D2D2502i G2 4 2 3 Note: Fan in is the maximum number of source appliances that may replicate to the device as a replication target. Housekeeping overview If data is deleted from the D2D system (e.g. a virtual cartridge is overwritten or erased), any - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 9
stream. This must be disabled by reducing the ―Concurrency‖ configuration value for the tape device from 4 to 1. Use multiple backup streams The HP D2D system performs best with multiple backup streams sent to it simultaneously. For example an HP D2D4112 G2 will back up data at approximately 80 MB - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 10
and encryption will randomize the source data and will, therefore, not result in a high deduplication ratio for these data sources. Consequently, performance will also suffer. The D2D appliance will compress the data at the end of deduplication processing anyway. For these reasons it is best to - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 11
Network configuration All D2D appliances have two 1GBit Ethernet ports, the D2D4312 and D2D4324 appliances also have two 10GBit Ethernet ports. The Ethernet ports are used for data transfer to iSCSI VTL devices and CIFS/NFS shares and also for management access to the Web Management Interface. In - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 12
are available on the switch network or if the appliance is being used to transfer data over fibre channel ports only. On an HP D2D4312 or D2D4324 with 10Gbit ports it is possible that a single 10Gbit port will deliver good performance in most environments. Network configuration, single port mode 12 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 13
are split across two physical networks which need independent access to the D2D appliance. In this case virtual libraries and shares will be available on both network ports; the host configuration defines which port is used. Separate data (―Network SAN‖) and management LANs are being used, i.e. each - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 14
to achieve highest performance for iSCSI and NAS operation. It requires the switch to support IEEE802.3ad Link Aggregation and needs the switch to be set up accordingly. See the relevant product user guide for more details. This mode sets up ―bonded‖ network ports, where both network ports in the - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 15
on the 4312/4324 appliances 10Gbit Ethernet is provided as a viable alternative to the Fibre Channel interface for providing maximum VTL performance and also comparable NAS performance. When using 10Gbit Ethernet it is common to configure a ―Network SAN‖, which is a dedicated network for backup that - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 16
D2D devices with only 1Gbit ports: Dual Port mode should be configured and each port connected and configured for either the Corporate LAN or Network SAN. In this case one data port is ―lost‖ for authentication traffic so this solution will not provide optimal performance. On HP D2D4312/4324 devices - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 17
the Network SAN. This configuration allows both 1Gbit network connections to be used for data transfer but also allows authentication with the Active Directory Domain controller. The illustration shows a simple Class C network for a medium-sized LAN configuration. HP D2D Backup System on Network SAN - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 18
It is important to consider the whole network when considering backup performance, any server acting as a backup server should be configured where possible with multiple network ports that are teamed / bonded in order to provide a fast connection to the LAN. Client servers (those that back - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 19
flexible configuration between several Fibre Channel hosts and Fibre Channel targets such as the D2D appliance virtual libraries. Switches may be cascaded of meshed together to form large fabrics. Fibre Channel, switched fabric topology HP StorageWorks D2D Backup System Virtual Library 1 (e.g. D2D - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 20
2 Either of the FC ports on a D2D Backup System may be connected to a FC private loop, direct attach topology. The FC port configuration of the D2D Appliance should be changed from the default N_Port topology setting to Loop. This topology only supports a single host connected to each private loop - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 21
HBAs for disk and tape. Fibre Channel configuration via Web Management Interface Full details on how to use the Web Management Interface to create virtual libraries and assign them to one of the two ports on the appliance (Port 0 and Port 1) are provided in the HP D2D Backup System user guide. There - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 22
are present on each model of D2D appliance. Product/Model Name Part Number Ethernet Connection Fibre Channel Connection D2D2502iG1 D2D2503 G1 D2D2504i G1 D2D400xi G1 D2D400xFC G1 D2D4112 G1 D2D2502i G2 D2D2504i G2 D2D4106i G2 D2D4106FC G2 D2D4112 G2 D2D4312 G2 D2D4324 G2 EJ001A EH945A EJ002A - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 23
guide for the HP D2D Generation 2 product family for backups and backups and replication. HDaPiDly2bDacBkauDcpka:utipylypSiycBsatalecmakmGuoeupnnt-2ofTsidyzaipntagictgahualitdacemanobuenptrootefctdedatbay tHhPaSttocreaOnnbceeBpacrkoutpescytsetedmsby StoreOnce Backup systems. D2D4324 38TB D2D4312 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 24
The use of this tool enables accurate capacity sizing, retention period decisions and replication link sizing and performance for the most complex D2D environments. A fully worked example using the Sizing Tool and best practices is contained later in the document, see Appendix B. 24 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 25
of 256KB or greater. For HP Data Protector and EMC Networker software a block size of 512 KB has been found to provide the best deduplication ratio and performance balance. Disable the backup application verify pass for best performance. Remember that virtual cartridges cost nothing and use up very - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 26
parameters for both G1 and G2 products. To achieve best performance the recommended maximum concurrent backup streams per library and appliance in the table should be followed. As an example, while it is possible to configure 40 drives per library on a 4312 appliance, for best performance no more - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 27
several cartridges are performing low level housekeeping activity. It is best practice to configure housekeeping blackout windows, as described on page 71. Note that if backups are to be offloaded to physical media elsewhere in the network, it is recommended that the cartridge sizing matches that - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 28
full backup cartridge which reduces the amount of deduplication housekeeping overhead required. When using the D2D to copy cartridges to physical media a long retention policy ensures longer validity of the offloaded cartridges because they inherit the same retention period as the virtual cartridge - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 29
backup sessions some of which are expired and other that are valid. Space will be used by the D2D to store the expired sessions as well as the valid sessions. Moving to an overwrite strategy will avoid this. With virtual tape a large number of cartridges can be configured for ―free‖ and their sizes - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 30
. Overview of NAS best practices Configure bonded network ports for best performance. Configure multiple shares and separate data types into their own shares. Adhere to the suggested maximum number of concurrent operations per share/appliance. Choose disk backup file sizes in backup software to - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 31
below the deduplication file size threshold (24 MB) is applied. This prevents overloading of the deduplication system and thus loss of performance. See Appendix A for values for each specific model. When protecting a large amount of data from several servers with a D2D NAS solution it is sensible - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 32
be found in the Backup Application Implementation Guides. Most backup applications allow the operator to set various parameters related to the NAS backup device that is created, these parameters are important in ensuring good performance in different backup configurations. Generic best practices can - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 33
smaller files would result in housekeeping running during the backup when the files are closed. * See Housekeeping monitoring and control on page 71 for more details. If possible the best practice is to configure a maximum file size that is larger than the complete backup will be (allowing for some - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 34
virtual tape devices because they allow for more efficient use of the network interface by reducing the amount of metadata required for each data transfer. In general, set block or transfer size to the largest value allowed by the backup application. Concurrent operations For best D2D performance - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 35
below ensures that multiple backups or streams can run concurrently whilst remaining within the concurrent file limits for each D2D share. Multiple servers, single stream backup Multiple servers, multi-stream backup Multiple servers, multiple single-stream backups The table below shows the - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 36
concurrent operations per appliance D2D2502 G2 D2D2504 G2 D2D4106/4112 G2 4 4 6 D2D4312/4324 G2 12 16 32 48 64 Overall best performance is achieved by running a number of concurrent backup streams across several libraries; the exact number of streams depends upon the D2D model being - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 37
process can be temporarily delayed by applying housekeeping blackout windows to cover the period of time when backups are running; this is considered best practice. In general it is best to use larger backup files as previously described. G1 and G2 products using 1.1.X and 2.1.X or later software - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 38
important part of the data deduplication solution and enough time must be allowed for it to complete in order to make best use of available storage capacity. See Housekeeping monitoring and control on page 71 for more information on best practices for applying blackout windows and how to monitor the - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 39
the same username and password must be created on the media server that will be using the D2D CIFS share. The backup application services must be configured to run as the local user (how this is configured varies by backup application). The best practice when using User authentication is to create - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 40
Create a new Host(A) record in the forward lookup zone for the domain to which the D2D belongs with the hostname and IP address of the D2D. Click Add Host. 2. Also create a Pointer(PTR) in the reverse lookup zone for the domain for the D2D appliance by providing hostname and IP address. Click OK. 40 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 41
D2D is a member of the domain its shares can be managed from any computer on the domain by configuring a customized Microsoft Management Console (MMC) with the Shared Folders snap-in. Once you have created shares you can manage them as follows. 1. Open a new MMC window by typing mmc at the command - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 42
Add > In the dialog box choose the computer to be managed and select Shares from the View options. 4. Finally select Finish and OK to complete the snap-in set up. Note that the Folder Path field contains an internal path on the D2D Backup System. 5. Save this customized snap-in for future use. 42 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 43
in order to: Temporarily leave then rejoin the same domain Join a different AD Domain Put the D2D into either No Authentication or Local User Authentication modes. Use the NAS - CIFS Server Web Management Interface page as follows: Click Leave AD to leave the domain, but keep the option of rejoining - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 44
Ethernet or FC SAN) to the D2D system is the bottleneck because it isolates any backup application or source disk system from the environment. Running multiple instances of the Dev perf tool simultaneously to separate tape devices on the D2D will demonstrate the performance that can be achieved with - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 45
The activity graph below shows the start of a Virtual Tape Write and the current throughput being achieved. The activity graph below shows the end of a Virtual Tape Write and the start of a Virtual Tape Read and the throughput achieved. 45 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 46
when tuning the appliance for best practice. The user will be able to see how different data sources will deduplicate and how changes in backup application configuration, for example, might improve the deduplication ratio achieved. Storage-Disk page on the Web Management Interface showing a summary - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 47
GUI page and shows the Disk Storage Capacity Growth for both User Data and Physical Data for the current week for the whole appliance as more backups have been sent to it during the week. This chart can also display this information for a month period. Deduplication Ratio and Daily and Weekly Change - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 48
sharing the same WAN link. Best practices overview Use the D2D Sizing tool to accurately specify D2D appliance and WAN link requirements. Avoid replicating appended backups. Use replication blackout windows to avoid overlap with backup operations. Use bandwidth throttling to prevent oversubscription - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 49
other D2D systems at other locations. N-Way - A collection of D2D systems on several sites are acting as replication targets for other sites. The usage model employed will have some bearing on the best practices that can be employed to provide best performance. Active to Passive configuration Active - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 50
Many to One configuration 50 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 51
share may only receive data from a single replication source share. In both cases replication sources libraries or shares may only replicate into a single target. However with VTL replication a subset of the cartridges within a library may be configured for replication whereas a share may only be - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 52
it is possible to configure replication to only replicate those cartridges that are used for the full backups. Reducing the number of cartridges that make up the replication mapping may also be useful when replicating several source libraries from different D2D devices into a single target library - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 53
1 1 D2D2504 G2 2 8 1 1 1 1 D2D4106 G2 4 16 1 8 1 1 D2D4112 G2 4 24 1 8 1 1 D2D4312 and D2D4324 G2 8 50 1 16 1 1 It is important to note that when utilizing a VTL replication Fan-in model (where multiple source libraries are replicated to a single target library), the deduplication ratio may be - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 54
8 D2D2504 G2 4 8 D2D4106 G2 8 24 D2D4112 G2 8 24 D2D4312 and D2D4324 G2 16 48 For example, an HP D2D2502 G2 may be replicating up to 4 source items to an HP D2D4312 G2; the HP D2D4312 may also be accepting another 44 source items from other D2D systems and itself be replicating outward up to 16 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 55
from several source appliances, performance will be reduced due to the amount of disk activity required on the target system. Replication models and seeding The diagrams in Replication usage models starting on page 49 indicate the different replication models supported by HP D2D Backup Systems; the - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 56
on the backup application supporting the copy process, e.g. Media copy or ―object‖ copy‖ Use of portable disk drives backup application copy or drag and drop USB portable disks, such as HP RDX series, can be configured as Disk File Libraries within the backup application software and used for - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 57
over a WAN link With this seeding method the final replication set-up (mappings) can be established immediately. Active/Passive Active/Active WAN seeding over the first backup is, in fact, the first wholesale replication. WAN seeding after the first backup at each location is, in fact, the first - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 58
Many to One WAN seeding over the first backup is, in fact, the first wholesale replication from the many remote sites to the Target site. Care must be taken not to run too many replications simultaneously or the Target site may become overloaded. Stagger the seeding process from each remote site. 58 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 59
each site the target D2D visits before the target D2D is finally shipped to the Data Center Site and the replication ―re-established‖ for the final time. Active/Passive Co-location seeding at Source (remote) site 1. Initial backup 3. Ship appliance to Data Center site 2. Replication over GbE link - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 60
One Co-location seeding at Source (remote) sites; transport target D2D between remote sites. 1. Initial backup at each remote site 3. Move Target D2D between remote sites and repeat replication. 5. Re-establish replication. 2. Replication to Target D2D over GbE at each remote site. 4. Finally take - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 61
) sites. Transport floating target D2D between remote sites then perform replication at the Data Center site. Repeat as necessary. 1. Initial backup at each remote site. 3. Move floating Target D2D between remote sites and repeat replication. 2. Replication to floating Target D2D over GbE at each - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 62
2. At each remote site perform a full system backup to the source D2D and then configure a 1:1 mapping relationship with the floating D2D device‖ e.g. SVTL1 on Remote Site A - FTVTL1 on floating D2D. FTVTL1 = floating target VTL1. 3. Seeding remote site A to the floating D2D will take place over - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 63
1. Perform full system backup to the D2D Backup System at the remote site using the local media server, e.g. at remote site C. The media server must also be able to see additional devices such as a physical LTO tape library or a removable disk device configured as a disk target for backup. 63 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 64
2. Use the backup application software to perform a full media copy of the contents of the D2D to a physical tape or removable disk target for backup also attached to the media server. In the case of removable USB disk drives the capacity is probably limited to 2 TB, in the case of physical LTO5 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 65
run. Replication blackout windows The replication process can be delayed from running using blackout windows that may be configured using the D2D Web Management Interface. Up to two separate windows per day, which are at different times for each day of the week, may be configured. The best practice - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 66
is a good practice to use the Source Appliance Permissions functionality provided on the Replication Partner Appliances tab to prevent malicious or accidental configuration of replication mappings from unknown or unauthorized source appliances. See the D2D Backup System user guide for information on - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 67
. The ―maximum time to offsite‖ varies depending on business requirements. The D2D Backup System provides tools to help monitor replication performance and alert system administrators if requirements are not being met. Configurable Synchronisation Progress Logging and Out of Sync Notification These - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 68
deduplication is providing to the replication process. It can also show whether replication is being able to utilize multiple jobs to improve performance or whether only small numbers of jobs are running due to backups completing at different times. A best practice is to use blackout windows - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 69
replicated device. This allows the system administrator to identify the performance of each share individually to see the bandwidth utilization of each share and sync status. Replication File/Cartridge details Replication File/Cartridge details shows information about the last replication job to run - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 70
saving and therefore deduplication ratio for an individual cartridge or file. These can be directly correlated to backup jobs and allow the backup administrator to see the deduplication efficiency of specific data backups. Individual files or cartridges that are not being replicated. This might be - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 71
such as backup and replication can run uninterrupted and therefore give more predictable performance. Blackout windows must be set on BOTH the source D2D and Target D2D. This guide includes a fully worked example of configuring a complex D2D environment including setting housekeeping windows, see - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 72
appropriately from 12:00 to 00:00 we can ensure the backups and replication run at maximum speed as can be seen below. The housekeeping is scheduled to run when the device is idle. However some tuning is required to determine how long to set the housekeeping windows and to do this we must use the - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 73
condition would be a strong indication that the housekeeping jobs are not being dealt with efficiently, maybe the housekeeping activity window is too short (housekeeping blackout window too large), or we may be overloading the D2D with backup and replication jobs and the unit may be undersized - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 74
later in this best practice guide two blackout windows are set on the target device, 10:00 to 14:00 and 20:00 to 02:00 (see below). Note how the replication process of data received at the target (shown here in Blue) triggers housekeeping which must be managed. If housekeeping is not controlled - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 75
transfer of data on VTL devices in the D2D is possible using this method. Copies of the data using Direct Tape offload are unable to be tracked by the backup application software. This offload feature is no longer supported on current shipping D2D models. Backup application Tape Offload/Copy from - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 76
physical tape mirrored backup The backup application controls the copy from the D2D appliance to the network-attached tape drive so that: It is easier to find the correct backup tape The scheduling of copy to tape can be automated within the backup process Constraints: Streaming performance will be - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 77
is via ―importing‖ the replicated data at the D2D target into the catalog at Backup Server B, so that it knows what is on each replicated virtual tape or D2D NAS share. Copy to meant performance was poor. Also, the backup application software was unaware that other copies of the data existed. 77 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 78
periods for tape offloads when the D2D Backup System is not busy and use as many parallel copy streams (tape devices) as practical to improve the copy performance. Read performance graph Read Aggregate Throughput MB/sec Single stream read performance Streams read/written concurrently Much higher - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 79
drives (800 GB tapes) then when configuring D2D Virtual Tape Libraries the D2D cartridge size should also be configured to 800 GB. 3. Schedule time for Tape Offloads: The D2D is running many different functions - Backup & Deduplication, Replication and Housekeeping - and Tape Offload is another task - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 80
Appendix A Key reference information 80 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 81
D2D Gen2 Products, Software 2.1.00 D2D2502i D2D2504i D2D4106i/fc D2D4112fc D2D4312fc Devices Usable Disk Capacity (TB) 1.5 3 9 18 36 Max Number Devices (VTL/NAS) 4 8 16 24 50 Replication Max VTL Library Rep Fan Out Max VTL Library Rep Fan In Max Appliance Rep Fan Out Max Appliance - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 82
) 11 11 11 11 8 * DDThreshold is the size a file must reach before a file is deduplicated, set to 24MB. ** Assumes no backup client performance limitations. *** For every 100GB of user data overwritten allow this much time for the housekeeping process to run at a later time. D2D4112fc 18 24 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 83
Using HP StorageWorks Backup sizing tool - size the hardware requirements, link speeds and likely costs Work out each D2D Device configuration NAS, VTL, number of shares, and so on, using best practices that have been articulated earlier in this document. Configure D2D source devices and replication - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 84
D2D to Physical Tape One of the key parameters in sizing a solution such as this is trying to estimate the daily block level change rate for data in each backup job. In this example we will use the default value of 2% in the HP StorageWorks sizing tool. http://h30144.www3.hp.com/SWDSizerWeb/default - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 85
Backup sizing tool Configure replication environment Click on Backup calculators and then Design D2D/VLS replication over WAN to get started. 1. Configure the replication environment for 4 source appliances to 1 target appliance, commonly known as Many to One replication. The replication window - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 86
three streams simultaneously to a D2D will run at say 80 MB/sec. The Sizer has all these throughputs per stream modeled with actual numbers from device testing. So, for best throughput, HP recommends four streams or more. What this means in practice is re-specifying backup jobs to use separate mount - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 87
give us best throughput and backup performance. Site A Filesystem 1 uses an Incrementals & Fulls backup scheme This parameter is the block change rate of data per day and will determine along with retention period the dedupe ratio achieved and the amount of data to be replicated. The default is - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 88
4. As you specify each job in turn click Add job and the job will be loaded to the summary table (see below). 88 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 89
5. Add all backup jobs for Sites A and D Please note in line with customer request, at sites A and D the D2D emulation has been selected as NAS Emulation with CIFS shares. 89 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 90
6. Repeat for Sites B and C. 90 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 91
7. Input backup job entries for Site E, which requires full backups every day for 29 days and is also required to have FC attach, so click FC in the System interface area. The rotation scheme for Site E is Fulls & Fulls. 91 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 92
We will retain 29 days of Fulls. 92 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 93
8. Press the Solve/Submit button and the Sizer will do the rest. 93 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 94
a solution overview (see below) which indicates the types of devices to be used at source and target, the amount of data to be replicated to and stored on target, the Link Speeds at source and target for specified replication window. In the following output it has sized HP D2D2502i appliances for - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 95
not all replication jobs can run at once. *This is a configuration feature of every D2D device. As the models increase in size they can have high replication source concurrency and a higher target replication concurrency - see Appendix A. The Sizer also outputs a table that shows each backup in turn - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 96
the net effect of upgrading to an HP D2D4106 is that we can now have 16 of the 24 possible maximum replication jobs running at the same time and allow more headroom for future expansion should more remote sites come on line. With an HP D2D2504 as the target device only 8 replication jobs could have - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 97
2. Click Solve/Submit again. 3. A new parts list is generated with HP D2D4106 as the target, along with an HP D2D4106 replication license for the target. 97 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 98
is now more efficient we only need just over 2 Mbit/sec WAN links on each of the sources. Configure D2D source devices and replication target configuration Sites A and D The customer has already told us he wants NAS emulation at sites A and D. Server 1 - Filesystem data 1, 100GB, spread across - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 99
fixed emulations in HP D2D like ―MSL2024‖ would mean we would have to use a full set of 24 slots but, if the customer chooses the ―D2DBS‖ emulation, the number of cartridges in the VTL libraries is configurable. Note: the backup software must recognize the ―D2DBS‖ as a supported device. As a general - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 100
shown below. Example NAS and VTL configurations Map out the interaction of backup, housekeeping and replication for sources and target With HP D2D Backup Systems it is important to understand that the device cannot do everything at once, it is best to think of ―windows‖ of activity. Ideally, at any - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 101
on backup performance will be geatly reduced The HP D2D Backup Systems have the ability to set blackout windows for replication, when no replication will take place - this is deliberate in order to ensure replication is configured to run ideally when no backups or housekeeping are running. In - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 102
Tune the solution using replication windows and housekeeping windows The objective of this section is to allow the solution architect to design for predictable behavior and performance. Predictable configurations may not always give the fastest time to complete but in the long run they will prevent - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 103
D In the example below housekeeping is happening when other backups are running and also when replication is running. Initial Configuration with NO replication blackout window set There are many overlapping activities (housekeeping and replication running together) and performance is not predictable - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 104
in some backup job performance e.g. Share 1 DIR2 & Share 2 SQL data, but replication jobs can only run 4 at a time (2502 concurrent source replication limit). Addition of replication window allows us to force replication activities to only happen outside of the backup window. Housekeeping still - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 105
load because local backups, replication jobs from sites A and D and housekeeping associated with replication jobs from sites B and C are all running at the same time. Target improved configuration Consider improving the situation by imposing two housekeeping windows on the target device as shown - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 106
to know: ―What is the best practice to make monthly copies to physical tape from Site E?‖ One fundamental issue associated with the deduplication process used on D2D is that the data is ―chunked‖ into nominal 4K pieces before it is stored on disk. When data is read from D2D for a restore or for - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 107
Bad Practice Results Not using the Sizing tool Incorrect models chosen because of wrong throughput calculations. Replication Link sizing incorrect Insufficient backup streams configured to run in parallel Poor backup performance, poor replication performance Using single dedupe store (device - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 108
Protector Tape Offload - Worked Examples HP Data Protector has an extensive range of Copy processes. Here we will look at how to offload both D2D Virtual Tape Libraries and D2D NAS shares to physical tape. Similar processes to this exist for all the major backup applications. A note on terminology - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 109
this example the following storage devices are configured on HP Data Protector Cell Manager ―zen‖: HP D2DMSL: is a Virtual Tape emulation on the D2D Backup System with 24 virtual slots (with virtual barcodes) and 1 virtual LTO5 drive. A physical MSL Tape Library configured with 2 x LTO5 drives and - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 110
HP Data Protector has a context window for controlling Object operations as can be seen below. Full media copy e.g. 50GB on D2D virtual media copied to 800GB of LTO5 Physical media Copy process can happen immediately after backup or scheduled - for D2D scheduling copies is the preferred option. To - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 111
the default parameters for the copy. It is important for base media copies that both the primary copy and the secondary copy media are of the same format in terms of block size, etc, as many backup applications cannot reformat ―on the fly‖. 3. The media copy is shown as successful. To perform an - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 112
2. Click Next and, depending on what backup objects have been selected, HP Data Protector will check that all the necessary source devices (that wrote the backups) are available. Click Next. 3. Select the target (copy to) device and the drive to be used and click Next. Here we have chosen LTO5 drive - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 113
the Summary screen and click Finish to start the object copy. 6. These screens show the Object copy in progress from the D2D Backup System to the physical LTO-5 media. Read Device Write Device Device 7. This Object copy can also be scheduled using the scheduled section under object copy 113 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 114
To perform an interactive object copy, D2D NAS share 1. Select Objects in the left-hand navigation pane and locate the D1D NAS share. This object was backed up to a D2D NAS share 2. Click Next. Note below the Source device is now a D2D NAS share or in Data Protector terminology a File Library. 3. - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 115
full path of the HP Data Protector File library and the file that represents the backup. 5. In this case the File Library was in 64K block format and needed to be re-packaged because the LTO5 block size for generating synthetic full backups from a series of incremental backups and requires a specialist - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 116
Overview HP StoreOnce D2D software released in February 2011 includes significant performance stabilization updates that reduce the disk access overhead of the deduplication process and therefore improve overall system performance. However this performance improvement only applies to D2D virtual - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 117
for best performance the replication target appliance should be co-located on the same LAN as the original D2D. 2. Upgrade the firmware on both D2D devices to 2.1.00/1.1.00. 3. Ensure that the D2D to be used as replication target is licensed for replication. 4. Configure a replication mapping - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 118
synchronize the devices. 3. Remove the replication mapping from either the source or target D2D Web Management Interface. The new device on the original appliance now contains the same data as the old device did but will benefit from the improved performance Step 4 - Reconnect to backup host and - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 119
for Virtual Device Migration Self replication is the process of replicating data between two devices on the same D2D Backup System. This model requires that there is sufficient disk space on the D2D Backup System to hold two copies of the data being migrated but, with 2.1.00 and 1.1.00 software - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 120
Name) of the D2D Backup System. 3. Configure a replication mapping using the Replication wizard on the D2D Backup System to allow replication of all data from the source device to the new target device located on the same D2D Backup System. See the HP StoreOnce Backup System user guide for detailed - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 121
appliances by providing the D2D Backup Systems' own IP addresses or FQDNs. 2. Configure new replication mappings using the Replication Wizard on the D2D Backup Systems to allow replication of all data from the source device to the new target device. See the HP StoreOnce Backup System user guide - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 122
the replication mappings on both D2D Backup Systems. 6. Remove the appliance addresses from the list of replication target appliances on both D2D Backup Systems. 7. ―Connect‖ the backup media server to the new source device. For example: - Mount the NFS share - Discover the iSCSI VTL device and - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 123
is created after the upgrade to new firmware, so will benefit from the performance enhancements. The D2D Backup System does NOT need to have a replication license installed in order to perform self replication. Note: The following example shows NAS Share migration; a similar process can be followed - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 124
the Web Management Interface. 4. Enter the IP address or FQDN (Fully Qualified Domain Name) of the D2D in Target Appliance Address. Note that this is the address of the local system. Addresses of other appliances may not be used because, without a license, the D2D Backup System may only replicate to - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 125
5. Upon successful completion the local appliance will be added to the Target Appliances list. 6. Go to the Replication - NAS Mappings page, select the share to be replicated (i.e. the original share with backup data in it) and click Start Replication Wizard. 125 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 126
select the target appliance from a list. This list will only contain the information about the local D2D appliance and will be highlighted already. Click Next. 8. Select the Target Share (this is the new share that was created earlier in the process and is the target for replication) and click Next - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 127
data must be replicated to the new device. Once complete, the status will change to Synchronized which means that the same data is present in both shares. (Note that the size on disk may be slightly different due to reporting inaccuracy and a slight difference in deduplication ratio achieved). 10 - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 128
deleting the original share to ensure the migration has been successful and that the backup application can access the new share. 12.Once the replication mapping has been removed and the new share configured with the backup application, the original share can be deleted from the NAS - Shares page on - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 129
, 27 backup job recommendations, 29 bandwidth limiting, 66 best practices general, 5 housekeeping, 9 NAS, 6, 30 network and FC, 22 replication, 49 store migration, 118 tape offload, 79 VTL, 5, 25 blackout window, 72 blackout window, 66 block size, 25, 27, 34 bottleneck identification, 44 C cartridge - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 130
mode, 12 sizing guide, 23 sizing tool example, 87 source, 67 storage and deduplication ratio, 46 store migration, 118 StoreOnce technology, 7 switched fabric, 19 synthetic backups, 37 Sys-Perf, 44 T tape offload best practices, 79 overview, 76 performance factors, 79 transfer size, 27, 34 U user - HP D2D | D2D Best Practices for VTL, NAS and Replication implementations (EH985- - Page 131
To read more about the HP D2D Backup System, go to www.hp.com/go/D2D Share with colleagues © Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the
1
HP D2D Backup Systems
Best practices for VTL, NAS and
Replication implementations
Table of contents
Abstract
..............................................................................................................................................
4
Related products
..................................................................................................................................
4
Validity
...........................................................................................................................................
4
Executive summary
...............................................................................................................................
5
General D2D best practices at a glance
.............................................................................................
5
VTL best practices at a glance
...........................................................................................................
5
NAS best practices at a glance
.........................................................................................................
6
HP StoreOnce Technology
....................................................................................................................
7
Replication overview
........................................................................................................................
7
Housekeeping overview
....................................................................................................................
8
Upstream and Backup Application considerations
................................................................................
9
Data compression and encryption backup application features
............................................................
10
Network configuration
........................................................................................................................
11
Single Port mode
............................................................................................................................
12
Dual Port mode
..............................................................................................................................
13
High availability port mode (Port failover)
.........................................................................................
14
High availability port mode (Link Aggregate)
....................................................................................
14
10Gbit Ethernet ports on the 4312/4324 appliances
........................................................................
15
Network configuration for CIFS AD
..................................................................................................
15
Backup server networking
...............................................................................................................
18