Home » HP Manuals » Storage Devices » HP StorageWorks 6000 » Manual Viewer

HP StorageWorks 6000 HP StorageWorks VLS and D2D Solutions Guide (AG306-96028, - Page 192

Email Processing Example Script, VLS Non-deduplicated Replication

View all HP StorageWorks 6000 manuals

Add to My Manuals
Save this manual to your list of manuals

Page 192 highlights

Email Processing Example Script The following section details an example script to process the "ISV Import" email report from the VLS and convert it into a list of cartridges to be imported. The following steps show how this might be done in the target site (this example uses a Linux server client): • You will need an SMTP gateway server in the network (needed for the VLS SMTP emails). • Allocate a client server to use for the import script (could be a separate server or the actual master/cell server itself). • Ensure the selected client is running an email messaging system (e.g,. sendmail). • Create a user account on the client. • Ensure the selected client has CLI access to the backup application. • In the user account, create a filter that sequentially processes the incoming emails, and for the ISV import emails it should send the message body (containing the list of replicated cartridges) to the script that actually performs the tape import. One way of doing this is to create a .forward that sends your incoming emails to procmail. For example:|/usr/bin/procmailand then add the following lines to the .procmailrc that copy an ISV import email (containing the list of tapes to import) to another script that runs the ISV-specific import commands: :0 bc: # send VLS DP import files for processing* ^Subject:.*ISV| /home/importuser1/isv_import/dpimport.sh See Data Protector Import Example Script and NetBackup Import Example Script for sample import scripts. • On the target VLS device GUI, setup the SMTP Gateway address and then configure the "ISV Import" email report using the selected email account. VLS Non-deduplicated Replication If you have not enabled Accelerated deduplication on your VLS device , non-deduplicated replication can still provide a more reliable method of sending mission-critical data off-site compared to off-site using physical tape (because there is no need to load/unload physical media and ship it to the off-site location). VLS-to-VLS non-deduplicated replication options: • Using SAN-based Automigration Automigration also supports using a VLS as a destination library, as a device-to-device replication scheme over an extended SAN. To use a VLS as a destination library, designate one VLS as the source and a second VLS as the destination. The destination VLS is presented over an extended SAN so that it is visible to the source VLS. With Command View VLS, establishe an automigration policy and echo copy pools in the same way you set up automigration with a physical destination library. See Echo Copy Pools and Automigration Policy. The source VLS performs normal backups during your regular backup window. During the automigration window you defined, source virtual cartridges automatically migrate to matching virtual cartridges on the destination VLS. The VLS with the source library must support automigration; however, it is not necessary for the destination VLS to do so. If you have an earlier generation VLS system and you purchase a VLS6200, VLS6600, or VLS12000 Gateway, you can use the newer models to handle automigration as the source device. Earlier generation VLS devices can be used as destinations. 192 Virtual Library Systems

Section	Page
HP StorageWorks VLS and D2D Solutions Guide	1
Table of Contents	3
1 Introduction	13
2 Concepts	15
Disk-based Backup and Virtual Tape Libraries	15
Problems Addressed by Virtual Tape Libraries	15
Integration of Disk in Data Protection Processes	15
Where Virtual Tape Fits in the Big Picture	16
HP VLS and D2D Portfolio	16
Typical VLS Environments	17
Typical D2D Environments	17
What are the Alternatives?	18
Physical Tape	18
NAS	18
Application-based Disk Backup	18
Business Copy	19
Deduplication	20
Introduction	20
HP StorageWorks Deduplication Solutions	20
Deduplication Ratios	21
Target-based Deduplication	22
Tape Oversubscription	23
Replication	23
Introduction to Replication	23
HP StorageWorks Replication Solutions	24
Replication Deployment Options	26
Backup Application Interaction with Replication	28
Replication Limitations	29
3 Backup Solution Design Considerations	31
Analyze the Existing Environment	31
Consider How you Want to Back Up your Data to the VLS or D2D	31
Consider How you Want to Copy the Backup Data to an Off-site Location	33
Consider Speed and Ease of the Restore as well as the Backup	33
Single Library vs. Multiple Libraries	33
Single Library	33
Benefits of Single Library Systems	34
Considerations for Single Library Systems	34
Multiple Library	35
Benefits of Multiple Library Systems	35
Multiplexing, Multistreaming, and Multipathing	36
Multiplexing	36
Multistreaming	36
Multipathing	36
Blocksize and Transfer Size	37
LAN-free Backups	37
Retention Planning	37
Future Data Growth	38
Considerations for Copies	38
Copy to Physical Tape through the Backup Application	39
Media Server Considerations	40
Benefits of Copying to Physical Tape through the Backup Application	40
Considerations for Copying to Physical Tape through the Backup Application	41
Copy to Tape using VLS Automigration	41
Benefits of Echo Copy	42
Considerations of Echo Copy	42
Copy to Tape using D2D Tape Offload	43
Copy to Remote Disk Backup Device using Replication	43
Benefits of Replication	44
Considerations of Replication	44
Creating Archive Tapes from the Replication Target	44
Considerations for Restores	44
Restoring from Disk Backup Device	45
Restoring from Backup Application-created Tape Copy	45
Restoring from the Replication Target	45
Performance Bottleneck Identification	45
Backup SAN Design Guidelines	46
General SAN Design Considerations	46
SAN Zoning	46
Operating System Tape Configuration	47
LUN Masking and Mapping	49
Backup Application Basic Guidelines	50
HP Data Protector Application Overview	51
Symantec NetBackup Application Overview	51
IBM TSM Application Overview	52
EMC NetWorker Application Overview	53
4 D2D Systems	55
D2D Devices	55
D2D Defined	55
D2D Technical Specifications	56
D2D Design Considerations	56
D2D Port Optimization	56
D2D Ethernet Ports	56
Backup Server Networking	57
Fibre Channel SAN	57
Multiple Backup Streams	57
Disable Backup Application Verify Pass	58
Tape Copy or Offload Performance	58
Tape Library Emulation	59
Emulation Types	59
Cartridge Sizing	59
Number of Libraries per Appliance	59
Optimizing Rotation Scheme to Reduce Housekeeping	59
D2D Blueprints	60
Single Site Cost Effective Backup Device Consolidation	60
Large SME Site Consolidation Requiring Fibre Channel Shared Devices	61
Multi-site Small Business Disaster Recovery Solution	63
Introduction to VMWare Terminology	65
Using D2D in Simple VMWare Environments with ESXi	66
Using D2D in VMWare Environments with ESX4 and VMWare Consolidated Backup	66
Using D2D in larger VMWare environments with HP Data Protector Zero Downtime Backup with Instant Recovery (ZDB + IR)	67
D2D Dynamic Deduplication	69
How it Works	69
Dynamic Deduplication Implementation	70
Restoring Data	71
Housekeeping	72
D2D Replication	73
How it Works	73
D2D Replication Implementation	73
Licensing	74
Implementing the Initialization Process	74
Initialization — Co-location and WAN Replication	75
Physical Tape Initialization — Export and Import	75
Replication Setup	76
Configuring Replication	78
Reporting	82
Target Device Reporting	82
Source Device Reporting	83
Design Considerations	84
Link Sizing	84
Telco Provisioning — Overview of Inter-Site Links	90
Some Idea of Telco Costs	92
Telco Terminology and Branding for WAN Services	93
D2D Replication Data Recovery Options	95
Restore Directly from the D2D Target Device	95
Reverse Replication on the D2D	95
Reverse Tape Initialization on the D2D	98
Creating Archive Tapes from the Target	99
5 Virtual Library Systems	101
VLS Devices	101
VLS Defined	101
Prime Environments	102
VLS Benefits	102
VLS9000–series Configurations	103
VLS Technical Specifications	104
How it Works	111
VLS Scalability	111
VLS Automatic Performance Load Balancing	113
VLS Warm Failover	114
Implementation	115
Device Configuration Preparation	115
Basic VLS device configuration	115
Basic Backup Application Configuration	116
Capacity Licensing	117
Virtual Libraries/drives/cartridge Configuration	118
EVA Preparation	119
Storage Pooling	121
VLS9000 Storage Pooling	122
VLS Gateway Storage Pooling	123
VLS Design Considerations	123
VLS Sizing	123
Outlining the Steps	123
Considerations	124
EVA Performance Sizing (VLS12000 Gateway)	124
Sizing/implementation Examples	125
Example 1 VLS Sizing for Performance and Capacity	125
Example 2 Testing Backup to Tape vs. Backup to VLS	125
Example 3: VLS12000 EVA Sizing Without Deduplication	126
Example 4: VLS12000 EVA Sizing With Deduplication	126
VLS Blueprints	127
Reduce Backup Window (No Deduplication)	127
Large Scale Backup Consolidation (No Deduplication)	128
Managing Data Retention and Reducing Backup Storage Costs	129
Full Enterprise Backup and Disaster Recovery Capability	130
Multi-data Center Replication to a Common Disaster Recovery Site	132
VMWare Backup Environment with ESXi.	133
VMWare Backup Environment with ESX4 and VCB-based Backups	134
Larger VMWare Environment with ESX4 and HP Data Protector ZDB IR Integration with VMWare Consolidated Backup	136
Large Enterprise Cross-site Backup with Deduplication and Inbuilt Disaster Recovery	138
Combining D2D and VLS in an End-to-end Solution for ROBO/Regional DCs and Main Data Center using HP Data Protector	139
VLS Automigration	140
Echo Copy Concepts	141
Implementation	141
Echo Copy Pools	141
Automigration Policy	142
Automigration Setup	143
Design Considerations	145
Automigration Use Models	145
Backup to Non-shared Virtual Libraries	145
Backup to a Shared Virtual Library	146
Sizing the Tape Library	147
Restoring from Automigration Media	148
VLS Accelerated Deduplication	148
How it Works	149
Accelerated Deduplication Implementation	152
Supported Backup Applications and Data Types	153
Deduplication Preparation	153
Licensing	154
Migrating your Existing Backup Data	155
Configuration and Reporting	155
Handling the Device Out of Capacity Condition	156
Design Considerations	157
Performance	157
Capacity Sizing	158
Node Oversubscription	158
Optimum Record Sizing	159
Optimizing File Server Deduplication	159
Media Management	160
Client and Backup Job Naming	160
Disabling Deduplication on Specific Backup Policies	161
VLS Replication	161
How it Works	161
Replication of Incremental Backups	163
Multi-node Replication Scaling	164
VLS Replication Implementation	164
Licensing	164
Replication Preparation	165
Replication Setup	166
Implementing the Initialization Process	172
Physical Tape Initialization	172
WAN Initialization	174
Co-location Initialization	175
Continuing Role for Physical Tape	176
Reporting	176
Status of LAN/WAN Replication Connection	177
Source Device Replication Status	177
Target Device Replication Status	179
Replication Job Status	179
Replication Job History	179
Design Considerations	180
Advanced Replication Job Control	180
Link Sizing	182
Basic Calculations	182
Device Sizing	187
VLS Replication Data Recovery Options	187
Restore Directly from the VLS Target Device	187
Restore the VLS over the LAN/WAN	189
Rebuilding Source Device and Re-establishing Replication	190
Creating Archive Tapes from the Target	190
ISV Import Email Format	191
Email Processing Example Script	192
VLS Non-deduplicated Replication	192
Replicating a Subset of Virtual Cartridges - a Use Case	193
Detailed Backup Application Guidelines for VLS	194
HP Data Protector	194
Data Protector General Guidelines	194
Data Protector Deduplication Guidelines	195
Data Protector Import Example Script	196
Symantec NetBackup	197
NetBackup General Guidelines	197
NetBackup Deduplication Guidelines	198
NetBackup Import Example Script	198
IBM TSM	199
TSM General Guidelines	199
TSM Deduplication Guidelines	200
TSM Useful Queries	203
EMC NetWorker	204
Networker General Guidelines	204
Networker Deduplication Guidelines	206
6 Support and Other Resources	209
Related Information	209
Documents	209
Websites	209
Contacting HP	209
Before you contact HP	209
HP contact information	210
Subscription Service	210
Document Conventions and Symbols	210
Glossary	213

Match case Limit results 1 per page

Email Processing Example Script

The following section details an example script to process the

“

ISV Import

”

email report from the VLS

and convert it into a list of cartridges to be imported. The following steps show how this might be

done in the target site (this example uses a Linux server client):

•

You will need an SMTP gateway server in the network (needed for the VLS SMTP emails).

•

Allocate a client server to use for the import script (could be a separate server or the actual mas-

ter/cell server itself).

•

Ensure the selected client is running an email messaging system (e.g,. sendmail).

•

Create a user account on the client.

•

Ensure the selected client has CLI access to the backup application.

•

In the user account, create a filter that sequentially processes the incoming emails, and for the ISV

import emails it should send the message body (containing the list of replicated cartridges) to the

script that actually performs the tape import. One way of doing this is to create a

.forward

that

sends your incoming emails to procmail. For example:

|/usr/bin/procmailand

then add the

following lines to the

.procmailrc

that copy an ISV import email (containing the list of tapes to

import) to another script that runs the ISV-specific import commands:

:0 bc: # send VLS DP import files for processing* ^Subject:.*ISV| /home/importuser1/isv_im-

port/dpimport.sh

See

Data Protector Import Example Script

and

NetBackup Import Example Script

for sample import

scripts.

•

On the target VLS device GUI, setup the SMTP Gateway address and then configure the

“

ISV Import

”

email report using the selected email account.

VLS Non-deduplicated Replication

If you have

not

enabled Accelerated deduplication on your VLS device , non-deduplicated replication

can still provide a more reliable method of sending mission-critical data off-site compared to off-site

using physical tape (because there is no need to load/unload physical media and ship it to the off-site

location).

VLS-to-VLS non-deduplicated replication options:

•

Using SAN-based Automigration

Automigration also supports using a VLS as a destination library, as a device-to-device replication

scheme over an extended SAN. To use a VLS as a destination library, designate one VLS as the

source and a second VLS as the destination. The destination VLS is presented over an extended

SAN so that it is visible to the source VLS. With Command View VLS, establishe an automigration

policy and echo copy pools in the same way you set up automigration with a physical destination

library. See

Echo Copy Pools

and

Automigration Policy

. The source VLS performs normal backups

during your regular backup window. During the automigration window you defined, source virtual

cartridges automatically migrate to matching virtual cartridges on the destination VLS.

The VLS with the source library must support automigration; however, it is not necessary for the

destination VLS to do so. If you have an earlier generation VLS system and you purchase a

VLS6200, VLS6600, or VLS12000 Gateway, you can use the newer models to handle

automigration as the source device. Earlier generation VLS devices can be used as destinations.

Virtual Library Systems

192