HP Surestore Disk Array FC60 HP SureStore E Disk Array FC60 Service Manual (A5
HP Surestore Disk Array FC60 Manual
View all HP Surestore Disk Array FC60 manuals
Add to My Manuals
Save this manual to your list of manuals |
HP Surestore Disk Array FC60 manual content summary:
- HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 1
HP SureStore E Disk Array FC60 Service Manual hpHH Edition E0900 Printed in U.S.A. - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 2
. Components bearing this symbol are fragile. Handle with care. Components bearing this symbol are susceptible to damage by static electricity. ESD precautions are required. Service Any servicing, adjustment, maintenance, or repair must be performed only by authorized servicetrained personnel. 2 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 3
Note this font this font A hazard that can cause personal injury A hazard that can cause hardware or software damage Significant concepts or operating instructions Text to be typed verbatim: all commands, path names, file names, and directory names Text displayed on the screen Printing History 1st - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 4
guide is intended for use by system administrators and others involved in operating and managing the HP SureStore E Disk Array FC60. It is organized into the following chapters and section. Chapter 1, Product Description Describes the features, controls, and operation of the disk array. Chapter - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 5
HP SureStore E Disk Array FC60 Advanced User's Guide - this is the expanded version of the book you are reading. Topics that are discussed in more detail in the Advanced User's Guide are clearly identified throughout this book. !"Download: www.hp.com/support/fc60 • HP Storage Manager 60 User's Guide - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 6
6 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 7
Product Description 16 Operating System Support 18 Management Tools 18 Features 18 High Availability 18 Scalable Storage Capacity 19 LED Status Monitoring 19 Disk Enclosure Components 20 Operation Features 22 Disk Enclosure SC10 Modules 24 Array Controller Enclosure Components 31 Front - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 8
Enclosure Configuration 74 Two Disk Enclosure Configurations 76 Three Disk Enclosure Configurations 80 Four Disk Enclosure Configurations 84 Five Disk Enclosure Configurations 88 Six Disk Enclosure Configurations 92 Total Disk Array Capacity 96 For high-availability, one disk per SCSI channel - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 9
Electrical Requirements 114 Power Distribution Units (PDU/PDRU 117 Installing PDUs 119 Recommended UPS Models 119 Installing the Disk Array FC60 122 Installing the Disk Enclosures 127 Step 1: Collect Required Tools 127 Step 2: Unpack the Product 127 Step 3: Install Mounting Rails 129 Step - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 10
Adding Capacity to the Disk Array 200 Adding More Disk Modules 200 Adding Additional Disk Enclosures 201 Replacing Disk Modules with Higher Capacity Modules 201 Moving a Volume Group from One Disk Array to Another 203 Controller Firmware Components 204 5 Troubleshooting Introduction 208 About - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 11
Contents Disk Array Installation/Troubleshooting Checklist 211 Power-Up Troubleshooting 213 Controller Enclosure Troubleshooting 215 Introduction 215 Controller Enclosure LEDs 216 Controller Status LEDs 218 Identifying Interface Problems 236 Controller Enclosure Troubleshooting 240 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 12
Removal/Replacement 312 Backplane/Mezzanine Removal/Replacement 314 Disk Module Carrier Removal/Replacement 318 Controller Enclosure Modules / Legal / Regulatory System Requirements 360 Host Systems 360 Supported Operating Systems 360 Fibre Channel Host Adapters 360 Models and Options - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 13
SC10 363 Disk Array FC60 Upgrade and Add-On Products 364 PDU/PDRU Products 365 Replaceable Parts 366 A5635A Controller Enclosure Specifications 368 Dimensions 368 Weight 368 AC Power 369 Heat Output 369 Environmental Specifications 370 Acoustics 371 A5636A Disk Enclosure Specifications - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 14
Harmonics Conformance (Japan 386 Class A Warning Statement (Taiwan 386 Spécification ATI Classe A (France Seulement 387 Product Noise Declaration (For Germany Only 387 Geräuschemission (For Germany Only 388 Declaration of Conformity 389 14 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 15
Product Description 1 PRODUCT DESCRIPTION Product Description 16 Disk Enclosure Components 20 Array Controller Enclosure Components 31 Disk Array High Availability Features 45 Capacity Management Features 62 15 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 16
designed for installation in HP's original 19-inch cabinets, which include the C2785A (1.1m), C2786A (1.6m), C2787A (2m), A1896A (1.1 m), and A1897A (1.6 m) and the HP Rack System/E Racks which includes the A490xA and A150xA Rack System/E cabinets. The Disk Array FC60 is also supported in the Rittal - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 17
Product Description Array Controller FC60 SureStore E Disk System SC10 Figure 1 HP SureStore E Disk Array FC60 (Controller with Six Disk Enclosures) Product Description 17 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 18
currently supported on the following operating systems: • Windows NT 4.0 • Windows 2000 Management Tools The following tools are used to manage the Disk Array FC60 on Windows NT and Windows 2000. This tool is not included with the disk array, but must be ordered separately as product A5628A. • HP - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 19
Capacity The Disk Array FC60 is designed to provide maximum scalability, simplifying the process of adding storage capacity as required. Storage capacity can be added in three ways: - By adding additional disk modules to a disk enclosure - By adding additional disk enclosures to the array - By - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 20
-ended backplane for high-speed, high-capacity LVD SCSI disks. Six disk enclosures fully populated with 9.1 Gbtye disks provide 0.54 Tbytes of storage in a 2-meter System/E rack. When fully populated with 73 Gbyte disks, the array provides over 3 Tbytes of storage. These values represent maximum - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 21
Product Description BCC Modules Power Supply Modules Fan Modules Disk Modules Chassis (and Backplane) (Front Door Not Shown) Figure 2 Disk Enclosure Components, Exploded View Disk Enclosure Components 21 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 22
power supplies and fans. Status Indicators LEDs on the front and back of the disk enclosure enable you to quickly identify and replace failed components, thereby preventing or minimizing downtime. "Troubleshooting" on page 207 provides more detailed information about the operation of these LEDs. Two - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 23
lock F ESD plug G mounting ear H power supply I BCCs J fans K component LEDs Figure 3 Disk Enclosure Front and Back View Power Switch The power switch (B in Figure 3) interrupts power from the power supplies to the disk enclosure components. Power to the power supplies is controlled by the power - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 24
carrier design allows ten half height (1.6 inch) disks to fit the 19-inch width of a standard rack and meet cooling needs. WARNING Touching exposed circuits on the disk module can damage the disk drive inside. To avoid damage, always handle disks carefully and use ESD precautions. The following - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 25
frame D standoffs E circuit board F insertion guide G capacity label Disks fit snugly in their slots. The cam latch (B in Figure 4) is used to seat and unseat the connectors on the backplane. A label (G) on the disk provides the following information: • Disk mechanism height: 1.6 inch (half height - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 26
that is not connected to the SCSI channel fails, access to its five disks will be lost. Failure of the BCC that is connected to the SCSI channel will render all ten disks inaccessible. A alignment guides B SCSI Ports C LEDs D rotary switch Figure 5 BCC E DIP switches F locking screw G cam lever - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 27
the management tools to identify each enclosure. • DIP switches set disk enclosure options. The only option used by the Disk Array FC60 is the full-bus/split-bus mode. • Screws (F) . BCC functions include drive addressing, fault detection, and environmental services. Disk Enclosure Components 27 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 28
and triggers a fault when the speed of either blower falls below a critical level. If a fan failure occurs, the amber fault LED will go on. 28 Disk Enclosure Components - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 29
with locking screw, and an LED (C). Internal control prevents the rear DC connector from becoming energized when the power supply is removed from the disk enclosure. NOTE: LED position varies. A AC receptacle B cam handle C LED Figure 7 Power Supply Note Although it is possible to operate the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 30
triggers a fault when a power supply fan or other power supply part fails. If a power supply failure occurs, the amber fault LED will go on. 30 Disk Enclosure Components - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 31
modules and internal assemblies make up the field replaceable units (FRUs). Many modules can be removed and replaced without disrupting disk array operation. The following modules are contained in the controller enclosure: • Controller modules • Controller fan module • Power supply modules • Power - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 32
by the controller module cause the corresponding controller enclosure fault LED to go on. Additional LEDs on the individual components identify the failed component. See "Troubleshooting" on page 207 for detailed information on LED operation. 32 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 33
Product Description Figure 9 Controller Enclosure Front View Array Controller Enclosure Components 33 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 34
behind this cover. This cover must be removed to gain access to these modules, and also, to observe the controller status and BBU LEDs. 34 Array Controller Enclosure Components - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 35
Modules The controller enclosure contains two controller modules. See Figure 11. These modules provide the main data and status processing for the Disk Array FC60. The controller modules slide into two controller slots (A and B) and plug directly into the backplane. Two handles lock the modules in - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 36
two seconds beginning 15 seconds after power-on. "Troubleshooting" on page 207 contains additional information on controller LED module connects to the host via Fibre Channel, and to the disk enclosures via LVD SCSI. Each controller must have a unique host 36 Array Controller Enclosure Components - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 37
fan module is replaced. The fan module plugs into a slot on the front of the controller enclosure, and has a handle and captive screw for easy service. Array Controller Enclosure Components 37 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 38
Figure 13 Controller Fan Module 38 Array Controller Enclosure Components - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 39
for FCC compliance. Both power cords can plug into a common power source or each cord can plug into a separate circuit (to provide power source redundancy). Array Controller Enclosure Components 39 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 40
power switches should not be turned off unless all I/O activity to the disk array has been suspended from the host. Also, power should not be turned until the Fast Write Cache LED goes off before shutting off power to the disk array. Each power supply is equipped with a power-on LED indicator. If - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 41
Product Description Figure 15 Power Supply Fan Module Array Controller Enclosure Components 41 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 42
(120 hrs). All data stored in memory will be preserved as long as the BBU supplies power. When power to the disk array is restored, the cache data will be written to disk. Figure 16 Battery Backup Unit CAUTION During a power outage, do not remove the controller or the BBU. Removing either of - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 43
Under these circumstances, refer to "Troubleshooting" on page 207. Battery Operation for No Data Loss The BBU protects the write cache (data which has not been written to disk) for at least 120 hours (five days) in case of a power failure. When power to the disk array is restored, data in the cache - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 44
• If the BBU is removed, do not shut off power to the array unless the Fast Write Cache LED is off. Data in write cache will be posted to disk 10 seconds after the BBU is removed. 44 Array Controller Enclosure Components - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 45
can protect against the failure of any hardware component in the I/O path to the disk array by providing an alternate path to all user data. The Disk Array FC60 provides high availability in the following ways: • Supported RAID levels 1, 0/1, 3, and 5 all use data redundancy to protect data when - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 46
of an even number of disks, half of which are primary disks and the other half are mirror disks. If a disk fails or becomes inaccessible, the remaining disk of the mirrored pair provides uninterrupted data access. After a failed disk is replaced, the disk array automatically rebuilds a copy of the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 47
performance under varying sizes of I/O transactions. Stripe segment size is specified in 512-byte blocks of data. Stripe segment size can affect disk array performance. The smaller the stripe segment size, the more efficient the distribution of data read or written across the stripes in the volume - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 48
-standard RAID levels define the method used for distributing data on the disks in a volume group. Volume groups that use different RAID levels can be created on the same disk array. The Disk Array FC60 supports the following RAID levels: • RAID 0 • RAID 1 • RAID 0/1 • RAID 3 • RAID 5 RAID 0 RAID - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 49
in the mirrored pair must be located in a different enclosure. When a data disk or disk mirror in a RAID 1 volume group fails, the disk array automatically uses the remaining disk for data access. Until the failed disk is replaced (or a rebuild on a global hot spare is completed), the volume group - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 50
an even number of from four to 30 disks. One half of the disks are primary disks and the other half are disk mirrors. The disks in a RAID 0/1 volume group are mirrored by the disk array hardware, which automatically writes data to both disks in the mirrored pair. For highest data availability - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 51
or becomes inaccessible, the disk array can dynamically reconstruct all user data from the data and parity information on the remaining disks. When a failed disk is replaced, the disk array automatically rebuilds the contents of the failed disk on the new Disk Array High Availability Features 51 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 52
size is 8 blocks, and the stripe size is 40 blocks (8 blocks times 5 disks). The disk block addresses in the stripe proceed sequentially from the first disk to the second, third, and fourth, then back to the first, and so on. Figure 21 RAID 3 Volume Group 52 Disk Array High Availability Features - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 53
can dynamically reconstruct all user data from the data and parity information on the remaining disks. When a failed disk is replaced, the disk array automatically rebuilds the contents of the failed disk on the new disk. The rebuilt volume group contains an exact replica of the information it would - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 54
high read throughput for small block-size requests (2 KB to 8 KB) by allowing simultaneous read operations from each disk in the volume group. During a write I/O, the disk array must perform four individual operations, which affects the write performance of a RAID 5 volume group. For each write, the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 55
following tables compare the characteristics for the supported RAID levels. Where appropriate, the relative strengths disks in the volume group increases, so does the storage efficiency. 3-disk volume group: 66% 4-disk volume group: 75% 5-disk volume group: 80% 6-disk volume group: 83% Disk Array - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 56
Up to 3.0 > than single disk RAID 3 group with 5 disks Up to 4.0 > than single disk Up to 1.25 > than single disk RAID-5 group with 5 disks Up to 4.0 > than single disk Up to 1.25 > than single disk * Compares the relative read and write performance for array configurations with the performance of - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 57
- A RAID 1 mirrored pair requires one I/O operation for a read and two I/O operations for a write, one to each disk in the pair. - The disks in a RAID 1 mirrored pair are locked in synchronization, but the disk array can read data from the module whose read/write heads are the closest. - RAID 1 read - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 58
- Data protection is not critical. RAID 0 provides no data redundancy for protection against disk failure. - Useful for scratch files or other temporary data whose loss will not seriously database with a high read rate. - Transaction processing is required. 58 Disk Array High Availability Features - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 59
for each channel. A global hot spare can be used to replace any failed data disk within the array regardless of what channel it is on. When a disk fails, the disk array automatically begins rebuilding the failed disk's data on an available global hot spare. When all the data has been rebuilt on - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 60
hot spare is part of the volume group, which fulfills the roll of disk 3. 4. When disk 3 is replaced, the disk array begins copying all the information from the former global hot spare to the replacement disk. 5. When copying completes, the volume group is restored to its original configuration. The - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 61
to rebuild the contents of disk 3 on the hot spare disk. The information on the hot spare is copied to the replaced disk, and the hot spare is again available to protect against another disk failure. Figure 23 Rebuild Process on a RAID 5 LUN (or Volume Group) Disk Array High Availability Features 61 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 62
data. Disk Groups A disk group is a collection of individual disks that share a common role in disk array operation. All disks on the disk array become a member of one of the following disk groups: • Volume group - Each volume group on the disk array has its own disk group. When a disk is included - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 63
If a read I/O requests data that is already in read cache, the disk array services the request from cache RAM, thus avoiding the much slower process of accessing a disk for the data. A pre-fetch capability enables the disk array to anticipate needed data (for example, on a file transfer) and read - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 64
for 120 hours (5 days). Dynamic Capacity Expansion If slots are available in the disk enclosures, you can increase the capacity of the disk array without disrupting operation. By simply adding new disks to the array and then creating a new volume group, the capacity can be expanded. See "Adding - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 65
Topology and Array Planning 2 TOPOLOGY AND ARRAY PLANNING Overview 66 Array Design Considerations 67 Recommended Disk Array Configurations 73 Topologies for Windows NT and Windows 2000 98 65 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 66
assist you in configuring a storage system that meets your application needs using the Disk Array FC60. In designing the storage system, two things must be considered: the configuration of the disk array and how the array will fit into the system (topology). Factors to be considered when designing - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 67
options include: hardware configuration, RAID level and volume group creation, the number of SC10 disk enclosures used, and system support software. It should be noted that optimizing the disk array for one feature may compromise another. For example, optimizing for maximum performance may increase - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 68
provides six Ultra2 SCSI channel connections for up to six disk enclosures. Six separate channels provide several options. One is that the disk arrays can be added incrementally as storage capacity is needed. It also allows six disk enclosures to be connected, as mentioned above, to provide a high - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 69
(using separate Fibre Channel host I/O adaptors) • Two disk enclosures (minimum) • Four disk modules, two in each disk enclosure (minimum) • Volume groups that use only one disk per disk enclosure. With its dual controllers, the Disk Array FC60 provides two independent I/O paths to the data stored - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 70
offers full sequential performance and is more economical to implement. To scale up sequential transfer performance from the host, configure additional disk arrays. This will increase the total I/O bandwidth available to the server. Performance can also be measured by the number of I/O operations - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 71
add more capacity to the Disk Array FC60. There are several ways to increase the storage capacity of the disk array. It can be increased by replacing existing smaller capacity disk modules with larger capacity disk modules, by adding more disk modules to the disk enclosures, or by adding additional - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 72
bus mode and the additional number of enclosures installed into the rack and required number of full-bus enclosures. This expansion requires disk enclosures be recabled using full bus enclosures. As in all cases of adding disk enclosures to the array, the system has to be shut down for the expansion - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 73
Topology and Array Planning Recommended Disk Array Configurations This section presents recommended configurations for disk arrays using one to six disk enclosures. Configurations are provided for achieving high availability/high performance, and maximum capacity. The configuration recommended by - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 74
configuration, it may be necessary to take down the host, back up data, and recreate volume groups when adding disk enclosures. If you anticipate the need to expand your disk array, you may want to consider selecting a configuration that uses more enclosures operating in full bus mode. In addition - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 75
, a single channel failure, or a single controller failure - Expansion requires powering down the disk array, removing terminators and/or cables from the enclosures, and cabling additional disk enclosures. • Disk Capacity - Maximum capacity 730 GBytes - Usable capacity 365 GBytes Figure 24 One - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 76
Configurations High Availability/ High Performance • Hardware Configuration - Two disk array controllers connected directly to host Fibre Channel adapters - Two disk enclosures with ten 73 GByte disk modules (20 disks total) - Disk enclosures configured for split-bus mode (two SCSI channels per - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 77
Topology and Array Planning Figure 25 Two Disk Enclosure High Availability/ High Performance Configuration Recommended Disk Array Configurations 77 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 78
does not achieve that level of protection. • Hardware Configuration - Two disk array controllers connected directly to host Fibre Channel adapters - Two disk enclosures with ten 73 GByte disks each (20 disks total) - Disk enclosures configured for split-bus mode (two SCSI channels per enclosure - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 79
Topology and Array Planning Figure 26 Two Disk Enclosure Maximum Capacity Configuration Recommended Disk Array Configurations 79 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 80
Configurations High Availability/ High Performance • Hardware Configuration - Two disk array controllers connected directly to host Fibre Channel adapters - Three disk enclosures with ten 73 GByte disks each (30 disks total) - Disk enclosures configured for split-bus mode (two SCSI channels per - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 81
Topology and Array Planning Figure 27 Three Disk Enclosure High Availability/ High Performance Configuration Recommended Disk Array Configurations 81 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 82
is in a separate enclosure. • High Availability - Handles a single disk failure, single controller, single channel, single BCC, or a single disk enclosure failure - Expansion requires powering down the disk array, recabling the array to a full bus configuration, rebinding the volume groups, and - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 83
Topology and Array Planning Figure 28 Three Disk Enclosure Maximum Capacity Configuration Recommended Disk Array Configurations 83 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 84
Enclosure Configurations High Availability/High Performance • Hardware Configuration - Two disk array controllers connected directly to host Fibre Channel adapters - Four disk enclosures with ten 73 GByte disks each (40 disks total) - Disk enclosures configured for full-bus mode (one SCSI channel - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 85
Topology and Array Planning Figure 29 Four Disk Enclosure High Availability/High Performance Configuration Recommended Disk Array Configurations 85 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 86
Maximum Capacity • Hardware Configuration - Two disk array controllers connected directly to host Fibre Channel adapters - Four disk enclosures with ten 73 GByte disks each (40 disks total) - Disk enclosures configured for full-bus mode (one SCSI channel per enclosure) • Volume Group Configuration - - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 87
Topology and Array Planning Figure 30 Four Disk Enclosure Maximum Capacity Configuration Recommended Disk Array Configurations 87 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 88
Enclosure Configurations High Availability/High Performance • Hardware Configuration - Two disk array controllers connected directly to host Fibre Channel adapters - Five disk enclosures with ten 73 GByte disks each (50 disks total) - Disk enclosures configured for full-bus mode (one SCSI channel - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 89
Topology and Array Planning Figure 31 Five Disk Enclosure High Availability/High Performance Configuration Recommended Disk Array Configurations 89 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 90
Maximum Capacity • Hardware Configuration - Two disk array controllers connected directly to host Fibre Channel adapters - Five disk enclosures with ten 73 GByte disks each (50 disks total) - Disk enclosures configured for full-bus mode (one SCSI channel per enclosure) • Volume Group Configuration - - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 91
Topology and Array Planning Figure 32 Five Disk Enclosure Maximum Capacity Configuration Recommended Disk Array Configurations 91 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 92
Enclosure Configurations High Availability/High Performance • Hardware Configuration - Two disk array controllers connected directly to host Fibre Channel adapters - Six disk enclosures with ten 73 GByte disks each (60 disks total) - Disk enclosures configured for full-bus mode (one SCSI channel per - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 93
Topology and Array Planning Figure 33 Six Disk Enclosure High Availability/High Performance Configuration Recommended Disk Array Configurations 93 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 94
Maximum Capacity • Hardware Configuration - Two disk array controllers connected directly to host Fibre Channel adapters - Six disk enclosures with ten 73 GByte disks each (60 disks total) - Disk enclosures configured for full-bus mode (one SCSI channel per enclosure) • Volume Group Configuration - - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 95
Topology and Array Planning Figure 34 Six Disk Enclosure High Maximum Capacity Configuration Recommended Disk Array Configurations 95 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 96
Disk Array Capacity The total capacity provided by the disk array depends on the number and capacity of disks installed in the array, and the RAID levels used. RAID levels are selected to optimize performance or capacity. Table 6 lists the total capacities available when using fully loaded disk - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 97
Topology and Array Planning For high-availability, one disk per SCSI channel is used as a global hot spare. Table 6 Capacities for Optimized Performance Configurations Number of disk enclosures RAID No. of Level LUNs Disks per LUN Total Capacity (with indicated disks) 9.1 GB 18.2 GB 36.4 GB - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 98
on Windows. Due to limitations in the RDAC driver included with the HP Storage Manager 60 (SM60) software, some topologies that use a single hub are not supported. The RDAC driver supports only two data paths to the FC60 Disk Array, so any topology that provides more than two paths will not work - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 99
Windows Topology Because this topology provides four paths from the host to each disk array, it is not supported. Any topology that provides more than two paths from a host to the disk array is not supported. Path 4 Path 3 Figure 35 An Unsupported Single-Hub Topology Topologies for Windows NT - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 100
is, if the critical component fails, access to the data on the disk array will be interrupted. These topologies are simpler and less expensive to implement distance that can be achieved between the host and the Disk Array FC60. The host and hub can be up to 500 meters apart, and the distance from - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 101
Topology and Array Planning Figure 36 Four Host/Single Hub/ Single Disk Array Non-HA Topology Topologies for Windows NT and Windows 2000 101 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 102
Figure 37 Four Host/Cascaded Hubs/ Dual Disk Array Non-HA Topology 102 Topologies for Windows NT and Windows 2000 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 103
Topology and Array Planning Figure 38 Four Host/Single Switch/ Dual Disk Array Non-HA Topology Topologies for Windows NT and Windows 2000 103 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 104
use of hubs and switches increases the distance that can be achieved between the host and the Disk Array FC60. The host and hub can be up to 500 meters apart, and the distance from the hub to the disk arrays can be an additional 500 meters. 104 Topologies for Windows NT and Windows 2000 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 105
Topology and Array Planning Figure 39 Direct Connect Single Host/Single Disk Array HA Topology Topologies for Windows NT and Windows 2000 105 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 106
Figure 40 Dual Host/Dual Hub/Four Disk Array HA Topology 106 Topologies for Windows NT and Windows 2000 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 107
Topology and Array Planning Figure 41 Four Host/Dual Hub/Dual Disk Array HA Topology Topologies for Windows NT and Windows 2000 107 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 108
Figure 42 Four Host/Dual Cascaded-Hubs/Four Disk Array HA Topology 108 Topologies for Windows NT and Windows 2000 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 109
Topology and Array Planning Topologies for Windows NT and Windows 2000 109 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 110
110 Topologies for Windows NT and Windows 2000 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 111
3 INSTALLATION Host System Requirements 113 Site Requirements 114 Power Distribution Units (PDU/PDRU 117 Installing the Disk Array FC60 122 Installing the Disk Enclosures 127 Installing the Controller 136 Configuration Switches 142 Attaching Power Cords 149 Attaching SCSI Cables and - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 112
be established. See Chapter 2, Topology and Array Planning for information on these topics. The Disk Array FC60 is designed to be installed in the following HP cabinets: - Legacy (also referred to as original) HP cabinets (1.1m, 1.6m, and 2m) - System/E Rack (which includes A490xA/J150xA: 1.1m, 1.6m - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 113
Installation Host System Requirements Windows NT and Windows 2000 For information on Windows NT and Windows 2000 host system requirements, see the HP Storage Manager 60 User's Guide included with the HP Storage Manager 60 software (A5628A). Host System Requirements 113 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 114
to power the Disk Array FC60 and any other peripherals installed in the cabinet. The Disk Array FC60 is scalable and may contain from one to six disk enclosures. The power all electrical wiring to the service point (plug) is adequately sized to carry in-rush and steady state currents. - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 115
@ 110v Operating Current @ 220v Controller w/ 6 Disk Enclosures 41.3A Controller w/ 5 Disk Enclosures 34.8A Controller w/ 4 Disk Enclosures 28.3A Controller w/ 3 Disk Enclosures 21.8A Controller w/ 2 Disk Enclosures 15.3A Controller w/ 1 Disk Enclosure 8.8 * In-rush current occurs for - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 116
10 Disk Enclosure Electrical Requirements Measurement Value Voltage - Range - Frequency 220-240V 100 - 127V 50-60Hz Current - Typical Maximum Operating - 100 - 120 V - 200 - 240 V - Maximum In-rush 2.9 - 3.2A 2.6 - 3.2A 5.3 - 6.7A 20A * In-rush current occurs for 10 to 12 milliseconds HP - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 117
power to its ten receptacles. The disk array power cords are connected to the rack. For example, to install more than four disk enclosures in an HP legacy rack, HP recommends HP 30-amp PDRUs (E7681A, E7682A) for their inherent in-rush protection. • On/Off switch support. Some PDU/PDRU options support - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 118
PDRUs 9 - 10 NA** NA** * Supports cabinet on/off switch. ** Rack height does not allow additional enclosures. Four 19-inch/30-amp 13 Recommended PDU/PDRUs for HP System/E Racks Number of Enclosures 1.25-meter (25 U) Rack 1.6-meter (33 U) Rack 2.0-meter (41 U) Rack 1 - 4 Two 19- - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 119
aside for servicing the disk enclosures (see Figure 44). Refer to the documentation supplied with the PDU/PDRU for installation instructions. Recommended UPS Models The following Hewlett-Packard Power Trust models are recommended for use with the HP SureStore E Disk Array FC60. Each UPS supplies - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 120
PDU 16 Amp or PDRU 30 Amp PDU 16 Amp or PDRU 30 Amp Figure 43 PDU Placement in 1.6-Meter Rack 120 Power Distribution Units (PDU/PDRU) - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 121
Installation PDU (16 Amp) or PDRU (30 Amp) PDU (16 Amp)or PDRU (30 Amp) Figure 44 PDRU Placement in 2.0-Meter Rack Power Distribution Units (PDU/PDRU) 121 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 122
. The Disk Array FC60 is supported in the System/E racks and in the HP legacy (original) cabinets. The Disk Array FC60 is also supported in Rittal 9000 racks. Note The HP SureStore E Disk Array FC60 has been tested for proper operation in supported Hewlett-Packard cabinets. If the disk array is - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 123
Figure 45 shows EIA rack locations for installation of six disk enclosures and one controller enclosure FC60 in a System/E rack. Special rails for the System/E racks allow installation of enclosures at either full EIA or mid-EIA (1/2-EIA) position. This allows the Installing the Disk Array FC60 123 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 124
one controller enclosure (positioned on top) for legacy racks. When disk enclosures are installed in legacy racks, an unusable 1/2-EIA space is left at the bottom of the enclosures. This space must be filled with a 1/2-EIA unit filler for each enclosure installed. 124 Installing the Disk Array FC60 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 125
Installation Figure 45 Enclosure EIA Positions for System/E Racks Installing the Disk Array FC60 125 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 126
Figure 46 Enclosure EIA Positions for Legacy Cabinets 126 Installing the Disk Array FC60 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 127
disk enclosure. Installation instructions for the disk enclosure SC10 are provided below; installation instructions for the controller enclosure FC60 ) for System/E cabinets Rail kit (A5656A) for Rittal racks Rack filler panel, 1/2 EIA Unit, 1 ea. Disks or fillers (A5234A or A5235A), pack of 10 SCSI - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 128
Figure 47 Disk Enclosure Contents 128 Installing the Disk Enclosures - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 129
the appropriate rack and follow the instructions included with the rail kit to install the rails in the rack. The following rail kits are available for use with the disk enclosure: • HP A5250A for legacy HP Racks (C2785A, C2786A, C2787A A1896A, or A1897A) • HP A5251A for HP Rack System/E • HP 5656A - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 130
A Front Mounting Ears B Chassis C Rail D Rail clamp Figure 48 Mounting the Disk Enclosure (Rack System/E shown) 130 Installing the Disk Enclosures - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 131
hole in each mounting ear (A in Figure 48) aligns with the sheet metal nuts previously installed on the rack front columns. 5. Insert two screws (A in Figure 48) through the matching holes in the disk enclosure mounting ears and rack front columns. Tighten screws. 6. Close the door. Installing the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 132
to the rails using the rear hold-down clamps from the rail kit. a. If you are installing the disk enclosure in an HP legacy rack, set the clamp (A in Figure 50) on top of the rail (B) so that the tabs point up and the screw holes are on the slotted - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 133
. Grip disks only by their handles (B in Figure 51) and carriers, and follow strict ESD procedures. Installation A disk enclosure door B disk handle C cam latch D ESD plug E disk carrier F insertion guide G slot guide H slot number Figure 51 Disk Installation Installing the Disk Enclosures 133 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 134
on the top of the disk module. This mark identifies the disk slot the disk module should be installed in case it is removed. It is important to return a disk to its same location to maintain disk module addressing used by some FC60 software applications. Figure 52 Disk Module Slot Location Map - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 135
and fillers. CAUTION Every slot must contain either a disk or filler. Moving a Disk Enclosure from One Disk Array to Another If you have more than one HP SureStore E Disk Array FC60, it is possible to move a disk enclosure from one array to another to balance capacity. The steps involved in moving - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 136
Installing the Controller This procedure describes how to install the Disk Array FC60 controller enclosure into an HP legacy rack or an HP System/E Rack. Step 1: Gather Required Tools • Torx T25 screwdriver • Torx T15 screwdriver • Small flat-blade screwdriver Step 2: Unpack the Product 1. Lift off - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 137
3 disk enclosures 0 ea. / 6 disk enclosures G Fibre Channel cables, 2 ea.; if ordered 2M (1005-0585) 16M (1005-0586) H Media Interface Adapter (MIA) 1 ea./ controller module (5064-2464) I Power cords, ferrite bead (5064-2482), 2 ea. J ESD strap (9300-2170) 1 ea. K User's manual & Quick Install Guide - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 138
Figure 53 Controller Enclosure Package Contents 138 Installing the Controller - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 139
and follow the instructions included with the rail kit to install the rails in the rack. The following rail kits are available for use with the controller enclosure: • HP A5250A for legacy HP Racks ((C2785A, C2786A, C2787A A1896A, or A1897A) • HP A5251A for HP Rack System/E • HP 5656A for Rittal - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 140
Figure 54 Mounting the Controller Enclosure 140 Installing the Controller - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 141
and the rail and tighten with a Torx T25 screwdriver. In HP Rack System/E racks: a. Set the clamp (E in Figure 54) inside the rail with the holes in the clamp along the slots in the rail. b. Push the clamp tight against the back of the disk - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 142
by FC60 diagnostic software and the controller to identify the disk enclosure for status monitoring operations. Each enclosure in the array must on down the rack. See "How are disk modules in the array identified?" on page 190 for additional disk module addressing information.) Disk Enclosure DIP - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 143
on one BCC are inverted and in reverse order from the other. Tray ID Configuration DIP switch Installation B Configuration DIP switch A Tray ID Figure 55 Disk Enclosure Configuration Switches Configuration Switches 143 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 144
can be accessed together on a single SCSI bus. In this mode, one SCSI channel from the FC60 controller is connected to all ten disk modules through either BCC (typically BCC A). Note In full bus mode, all ten disks can be accessed through either BCC. However, internally each BCC still manages five - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 145
two busses are isolated within the enclosure. See "How are disk modules in the array identified?" on page 190 for additional disk module addressing information. Table 19 Disk Slot, Full-Bus/Split-Bus Mode, SCSI IDs Physical Disk Slot #s BCC 0 1 2 3 4 5 6 7 8 9AB BCC A (or B) Full-Bus Mode SCSI - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 146
"1" or down for "0" (refer to Table 20 for binary switch settings). Figure 56 illustrates the loop ID switch set to 42 (0101010). Note The factory default Fibre Channel Host ID loop address settings for controller A (BD1) is 5, and the default for controller B (BD2) is 4. If you must change the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 147
Fibre Channel Host ID Switch ( 0 1 0 1 0 1 0 = 42) Installation Figure 56 Fibre Channel Connectors and Fibre Channel Host (Loop) ID Switches Note Occasionally two or more ports in an arbitrated loop will arbitrate simultaneously. Priorities are decided according to the loop IDs. The higher the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 148
. Table 20 Fibre Channel Addresses Decimal Binary Decimal 0 000 0000 38 1 000 0001 39 2 000 0010 40 3 000 0011 41 4 000 0100 42 5 000 0101 43 6 000 0110 44 7 000 0111 45 8 000 1000 46 9 000 1001 47 10 000 1010 48 11 000 1011 49 12 000 1100 50 13 000 1101 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 149
To complete the power connection, follow the steps below. 1. Set the power switch on the disk enclosures to OFF. The switch is located at the front, top, right corner of the enclosure to the PDUs/PDRUs on the right side of the rack and connect the power cords from the left-side power supplies to the PDUs/ - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 150
among all disk enclosures. "Cascading" refers to overload faults that occur on a backup PDU as a result of power surges after the primary PDU fails. - Serviceability. Choose PDU locations that prevent power cords from interfering with the removal and replacement of serviceable components. Also - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 151
Installation A A A A AC IN B B B B 30A PDRU AD AD AC AC BC BC BD BD Figure 57 Wiring Scheme for 1.6-Meter Rack C C C C AC IN D D D D 30A PDRU Attaching Power Cords 151 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 152
30A PDRU A A A A AC IN B B B B 30A PDRU C C C C AC IN D D D D AE AF AG BE BF BH CF CG CH DG DH Figure 58 Wiring Scheme for 2.0-Meter Rack 152 Attaching Power Cords 30A PDRU E E E E AC IN F F F F 30A PDRU G G G G AC IN H H H H - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 153
by a number of factors which are described in Chapter 2, Topology and Array Planning. When you have determined which configuration you will use, refer to enclosure, any unused SCSI connector must be terminated. On the disk enclosure, not every connector requires termination. If a SCSI cable - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 154
enclosure down, and so on down the rack. - Install cables along the left side of the disk enclosure connectors (as viewed from the back of the rack) and install terminators along the right side connectors. To configure the disk array for full-bus operation: 1. Connect one end of a SCSI cable to - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 155
both BCCs Segment 1 set to "1" Note inverted orientation from upper BCC Figure 59 Full Bus BCC Configuration Switch Settings Attaching SCSI Cables and Configuring the Disk Enclosure Switches 155 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 156
Figure 60 Full-Bus Cabling 156 Attaching SCSI Cables and Configuring the Disk Enclosure Switches - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 157
to the next enclosure down. - Install cables along the left side of the disk enclosure connectors (as viewed from the back of the rack) and install terminators along the right side connectors. To configure the disk array for split-bus operation: 1. Connect one end of a SCSI cable to the controller - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 158
All segments set to "0" Tray ID set to unique value for each enclosure Tray ID set to same value on both BCCs All segments set to "0" Note inverted orientation from upper BCC Figure 61 Split- Bus Configuration Switch Settings 158 Attaching SCSI Cables and Configuring the Disk Enclosure Switches - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 159
Installation Figure 62 Split-Bus Cabling Attaching SCSI Cables and Configuring the Disk Enclosure Switches 159 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 160
identified by its channel number and SCSI ID. These values will differ depending on which type of configuration is used for the disk array. See "How are disk modules in the array identified?" on page 190 for more information. Figure 63 is an example of split-bus addressing. Figure 64 is an example - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 161
Installation Figure 64 Full-Bus Addressing Example Attaching SCSI Cables and Configuring the Disk Enclosure Switches 161 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 162
cables provide the I/O path to the disk array. The Fibre Channel cable connects the controller enclosure directly to a host, or to a hub. For information on Fibre Channel host adapters supported on Windows NT and Windows 2000, check the Host Adapter folder on the HP Storage Manager 60 CD. To connect - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 163
Installation Figure 65 MIA, RFI Gasket, and Fibre Channel Installation 3. Connect the Fibre Channel connectors to the controller MIAs. a. Remove the optical protectors from the ends of the MIAs and the Fibre Channel cables (Figure 65). b. Insert the Fibre Channel connectors into the MIAs. The fibre - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 164
power it up again in the proper sequence. To power up the disk array: Note The following procedure assumes the disk array components will be powered up individually. All disk array components can also be powered up simultaneously using a single rack power switch. 1. Open all front doors on the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 165
, if the Enclosure Fault LED remains on, it indicates that a fault has been detected. Refer to "Troubleshooting" on page 207 for additional information. 4. Power up the controller enclosure using both power switches on the back of the enclosure (see Figure 67). Applying Power to the Disk Array 165 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 166
error has been detected. Refer to "Troubleshooting" on page 207, for additional information. 6. Close and lock the disk enclosure doors. 7. If the host was shutdown to install the array, boot the host. 8. Perform an ioscan to verify that the host sees the array. 166 Applying Power to the Disk Array - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 167
Power Full Bus BCC Fault Bus Active LVD Fan Module Fan Normal State Off On (green) Flashing (green) when disk is being accessed. Off On (green) On (green) Off (if split bus) On (green - if single bus operating in single ended mode) On (green) Installation Applying Power to the Disk Array 167 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 168
Figure 68 Disk Enclosure LEDs A System fault LED B System power LED C Disk activity LED D Disk fault LED E Power On LED F Term. Pwr. LED G Full Bus LED H BCC Fault LED I Bus Active LED J LVD LED K Fan Fault LED 168 Applying Power to the Disk Array - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 169
after batteries are fully charged. The LEDs flash while charging is in progress, and remain on when charging is complete. Any time power to the disk array controller enclosure is cycled, the BBU will recharge for 15 minutes. During this time, the Full Charge LEDs will flash. Applying Power to the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 170
Figure 69 Controller Enclosure LEDs 170 Applying Power to the Disk Array A Power On LED B Power Fault LED C Fan Fault LED D Controller Fault LED E Fast Write Cache LED F Controller Power LED G Controller Fault LED H Heartbeat LED I Status - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 171
be shut off simultaneously using a single cabinet power switch or circuit breaker. In this situation, stop all I/O to the disk array and then wait two minutes for all cache data to be written to disk before shutting off power. The Fast Write Cache LED will remain off when all cache data is written - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 172
Manager 60 software is used to verify that the disk array is visible to the Windows host. See the HP Storage Manager 60 User's Guide for instructions on installing and using the HP Storage Manager 60 software. Note If there are any hardware enablement bundles installed on the host from a release - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 173
Windows 2000 Perform the following steps to configure the disk for operation on a Windows NT or Windows 2000 host. Refer to the HP Storage Manager 60 User's Guide for detailed instructions on performing each of these tasks. 1. Add the disk array to the SM60 management topology. 2. Set up any alert - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 174
Capacity Scalability is an important part of the design of the HP SureStore E Disk Array FC60. The capacity of the disk array can be increased in a variety of ways to meet growing storage needs. See "Adding Capacity to the Disk Array" on page 200 for more information on scalability options. Adding - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 175
a detailed diagram of the existing Disk Array FC60 layout. b. Attach a label to each Fiber Channel cable attached to the disk array, identifying the host interface and disk array controller port it connects. c. Identify the disks comprising each volume group on the disk array. Then attach a label to - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 176
2. Identify the expanded disk array layout by performing the following tasks: a. Create a detailed diagram of the expanded HP FC60 array layout. Include all Fibre Channel and SCSI cabling connections. This diagram will serve as your configuration guide as you add the new enclosures. The Capacity - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 177
the disks which comprise the volume group. Contact HP Support if the volume groups cannot be made OPTIMAL before the moving disk drives. HP FC60 Array and drive components. Wearing an ESD wrist strap grounded to the component chassis is sufficient for most environments. 1. Power down the disk array - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 178
enclosure to the controller enclosure. Note To simplify disk array management, it is recommended that the SCSI cabling be connected to the disk enclosures according to where in the rack the enclosure is installed. The disk enclosure closest to the controller enclosure should be connected to SCSI - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 179
Enclosure ID switch setting must be the same for both BCC A and BCC B. b. The Enclosure ID switch settings are made as follows for the disk enclosures installed. The enclosure connected to channel 1 should be set to 0. The enclosure connected to channel 2 should be set to 1. The enclosure connected - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 180
the disk. If a new disk does not clear the fault, contact HP Support. 4. Add any new disks to the disk enclosures. Refer to your expanded configuration drawing for information on what slots to install the disks in. Note If you are adding disks that were installed in another Disk Array FC60, make - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 181
the cables, as this may cause problems with applications that depend on a specific path. This completes the process of expanding the disk array. You can now make the capacity provided by the new disks available to the host by creating volume groups. Adding Disk Enclosures to Increase Capacity 181 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 182
Capacity Expansion Example An example of expanding an Disk Array FC60 is shown in Figure 70. In this example, three new disk enclosures are added to a disk array with three fully loaded enclosures. The disk array is configured with five 6-disk volume groups. The original enclosures were operating in - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 183
Installation Disks are moved to the slot that corresponds to their original channel:ID. High availability is maintained by having no more than one disk per LUN or volume group on each channel. Figure 70 Capacity Expansion Example Adding Disk Enclosures to Increase Capacity 183 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 184
184 Adding Disk Enclosures to Increase Capacity - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 185
0 Split-bus IDs 0 8 1 9 2 10 3 11 4 12 0 1 1 22 3 3 44 Full-bus IDs 0 Split-bus IDs 0 8 1 9 2 10 3 11 4 12 0 1 1 22 3 3 44 Figure 71 Capacity Expansion Map Adding Disk Enclosures to Increase Capacity 185 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 186
3 3 44 Full-bus IDs 0 Split-bus IDs 0 8 1 9 2 10 3 11 4 12 0 1 1 22 3 3 44 Full-bus IDs 0 Split-bus IDs 0 8 1 9 2 10 3 11 4 12 0 1 1 22 3 3 44 186 Adding Disk Enclosures to Increase Capacity - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 187
4 MANAGING THE DISK ARRAY Tools for Managing the Disk Array FC60 188 Managing Disk Array Capacity 189 Adding Capacity to the Disk Array 200 Managing the Disk Array 187 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 188
Tools for Managing the Disk Array FC60 On Windows NT and Windows 2000, the disk array is managed using the HP Storage Manager 60 software. See the HP Storage Manager 60 User's Guide for information on managing the disk array on Windows NT and Windows 2000. The information in this chapter provides - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 189
the following: • Any size limitations imposed by Windows NT or Windows 2000. • The maximum numbers of volume groups that can be created on the disk array is 32. Because volume numbering begins at 0, the highest volume number is 31. • Your backup strategy. If you do unattended backup to a device such - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 190
be on one channel, and disks in the odd-numbered slots will be on a different channel. • SCSI ID identifies the ID assigned to the disk module. SCSI ID's are determined by the slot in which the disk module is installed in the disk enclosure. If the disk enclosure is 190 Managing Disk Array Capacity - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 191
ID switches located on the rear of the enclosure. Each disk enclosure in the disk array must have a unique enclosure ID number. Disk enclosures should be numbered from the top down, with the enclosure mounted highest in the rack being 0. The slot number indicates the physical enclosure slot in - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 192
IDs Full bus configuration 0 Split bus configuration 0 81 01 9 2 10 3 11 4 12 1 2 2 3 3 44 This disk module uses the following address parameters: Channel 2 SCSI ID 10 (full bus) or 2 (split bus) Enclosure 3 Slot 5 Figure 72 Disk Module Addressing Parameters 192 Managing Disk Array Capacity - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 193
the ownership of one or more volume groups to solve the problem. Selecting a RAID Level The RAID level you select for each volume group determines the the exception of RAID 0, all RAID levels supported by the disk array provide protection against disk failure. However, there are differences in performance - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 194
volume to continue writing. For example, if the stripe segment size is set to 4 Kbytes, the disk array will write 4 Kbytes of data to disk 1, then 4 Kbytes of data to disk 2, then 4 Kbytes of data to disk 3, and so on. For more information, see "Data Striping" on page 47. When creating a volume, the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 195
consider the following: • Stripe segment size can affect disk array performance. The smaller the stripe segment size, the is too small for a single I/O operation, the operation requires access to two disk. Called a stripe crossing, this action reduces performance. The optimum stripe segment size - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 196
how it may affect performance. Table 23 identifies the settings that impact disk array performance and what the impact is. Table 23 Performance Impact of the I/O size. In this case, only one disk is required to service an I/O, leaving the remaining disk in the volume available for other I/Os. A - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 197
Function: Sets the level at which the disk array controller begins flushing write cache content to disk media. The setting is specified as the cache hits. (A "hit" is an I/O that can be serviced from cache rather than accessing the disk media.) A higher cache threshold value increases the amount of - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 198
hits on write cache. Because less data is written to the disk during each flush cycle, data flushing will occur more often, increasing disk activity. In most situations this value should be left at the be used for large I/O, sequential, high bandwidth applications. 198 Managing Disk Array Capacity - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 199
setting and monitoring the cache hit percentage. If the percentage improves, the setting can be increased again until no improvement in performance is seen. Managing Disk Array Capacity 199 Managing the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 200
installing in the disk array. Any data on the disk will be lost when it is installed. To increase capacity by adding disk modules: 1. Install the disk modules in available slots in the disk enclosures. See "Disk Enclosure Modules" on page 291 for instructions on installing disk modules. Note Each - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 201
no important data on the disks. All data on the disks will be lost when they are installed in the new disk array. If you have more than one HP SureStore E Disk Array FC60, you can move disks from one array to another to balance capacity. The disks can be installed in the new array with power on and - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 202
activity to the volume group and unmount the file system. 4. Delete the volume group. 5. Replace the disk modules. See "Disk Enclosure Modules" on page 291 for instructions on replacing disk modules. 6. Create a new volume group using the higher capacity disks. 202 Adding Capacity to the Disk Array - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 203
to Another It is possible to move an entire volume group from one HP SureStore E Disk Array FC60 to another by moving all the disk in the volume group. However, this is not the recommended procedure for moving LUN data from one array to another. If possible, the data should be moved to a LUN in the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 204
specific versions of each of these components. For proper disk array operation, the three component versions must match. When replacing or troubleshooting a controller, you should understand how the three firmware components are managed by the disk array. This will ensure that you have the correct - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 205
of the NVSRAM may cause undesired results in some situations. For example, you might attempt to upgrade the firmware on a disk array by installing two new controllers that have the new firmware loaded on them. When the disk array is powered up, the older version of the NVSRAM will be copied from the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 206
NVSRAM settings on one of the controllers changes the disk information is updated. This would only occur if the controller was removed, the NVSRAM settings changed by installing it in another disk array, and then reinstalling the controller in the original array 206 Moving a Volume Group from One - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 207
Troubleshooting 5 TROUBLESHOOTING Introduction 208 Disk Array Installation/Troubleshooting Checklist 211 Power-Up Troubleshooting 213 Controller Enclosure Troubleshooting 215 SureStore E Disk System SC10 Troubleshooting 281 207 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 208
Introduction The modular design of the Disk Array FC60 simplifies the isolation and replacement of failed hardware components. Most disk array components are hot-swappable Field Replaceable Units (FRUs), which can be replaced while the disk array is operating. Some of the FRUs are customer - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 209
Troubleshooting About Field Replaceable Units (FRUs) The Disk Array FC60 consists of a Controller Enclosure and one or more SureStore E Disk System SC10 enclosures. Table 24 identifies the disk array FRUs and whether they are customer replaceable. See "Removal and Replacement" on page 287 for more - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 210
Windows NT and Windows 2000 Troubleshooting Tools The HP Storage Manager 60 software includes a set of tools for troubleshooting the disk array. See the HP Storage Manager 60-NT User's Guide for information on using the HP Storage Manager 60 software. 210 Introduction - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 211
Troubleshooting Disk Array Installation/Troubleshooting Checklist The following checklist is intended to help isolate and solve problems that may occur when installing the disk array. • Check for Physical Damage: - Disk array packaging and disk array components undamaged - Cabinet packaging and - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 212
disk modules spun up - Host ioscan displays proper disk array configuration - Fibre Channel drivers installed - Different capacity disk modules not mixed in same volume group - Disk modules with different part/product numbers not mixed in same volume group 212 Disk Array Installation/Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 213
Troubleshooting When the disk array is powered up, each component perform an internal self-test, to ensure it is operating properly. Visual indications of power-up are: • The green Power LED on the controller enclosure is on • The green Power LED on each disk modules in the disk array must be - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 214
are ON and the fans are not running, it indicates that no AC power is being supplied to the disk array power supply modules. Check the input AC power to the disk array. See "Applying Power to the Disk Array" on page 164 for information on powering up the disk array. 214 Power-Up Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 215
discusses how to identify interface problems, how to identify a controller failure, and how to service the controller modules and the memory modules within the controller enclosure as shown in Figure 73. For troubleshooting procedures, refer to the "Master Troubleshooting Table" on page 275 Figure - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 216
25 summarizes the operating LED states for all components within the controller enclosure. Figure 74 Controller Enclosure LEDs 216 Controller Enclosure Troubleshooting A Power On LED B Power Fault LED C Fan Fault LED D Controller Fault LED E Fast Write Cache LED F Controller Power LED G Controller - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 217
Troubleshooting Table 25 Normal LED Status for Controller Enclosure Module LED Normal State Controller Power On Enclosure Power Fault On (green are fully charged. The LEDs flash while charging is in progress, and remain on when charging is complete. Controller Enclosure Troubleshooting 217 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 218
Status LED bank for an active controller alternates between 0x00 to 0x80 . A passive controller's status LEDs will alternate between 0x6E to 0xEE . 218 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 219
Troubleshooting Errors During Normal Operations It is possible for the controller to encounter errors from which it is unable to recover during normal operations. Specific status LED patterns are used to give a visual indication of any problem. The error pattern returns to the normal setting after - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 220
LED is ON or Flashing. Table 26 LEDs Prior to Boot Menu 0x01 0x02 0x04 0x08 0x10 0x20 0x40 0x80 x01, etc. 220 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 221
Troubleshooting Note These status codes are displayed only momentarily and are typically not visible if the controller is operating normally. They a ! indicates the LED is On or Flashing. Table 27 Firmware Download LED Patterns 0x01 0x03 0x07 0x0F 0x1F Controller Enclosure Troubleshooting 221 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 222
Verifying write of boot segments Erasing file flash segments Writing file flash segments LED Pattern 0x80 0x81 0x82 0x83 0x84 0x89 0x8A 222 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 223
Flash memory into processor memory. 4. Ethernet and Fibre Channel: If the controller hardware supports the integrated Ethernet controller and/or the Fibre Channel host interface, the firmware components will be returned with a Check Condition, along with the Controller Enclosure Troubleshooting 223 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 224
LUN configuration information from dacStore. The controller will now read the drive and LUN configuration information from the dacStore on the drives, 224 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 225
If the controller finds LUN information on these "new" drives for a LUN that already exists in the array subsystem, then the LUN number will be changed to the next available LUN number. Please refer to the them but were cold-removed during the last power-down. Controller Enclosure Troubleshooting 225 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 226
to make configuration changes, such as adding or deleting LUNs, changing controller modes, or drive states. 28. Controller Start-Of-Day completed. 226 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 227
Troubleshooting Errors During / After Firmware Download Different patterns are displayed after downloading firmware. The patterns are shown in Table 29. Note Firmware. The user must download matched versions of both code types. 0x95 0x96 0x97 0x98 0xE6 Controller Enclosure Troubleshooting 227 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 228
timer) also turns ON the Controller Fault LED if it does not get serviced periodically by the firmware, indicating that there has been a catastrophic controller failure. If this error happens, contact a trained service representative to upload new firmware. 228 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 229
start-up Kernel memory initialization 0x27 0x28 0x29 Kernel clock start Kernel service initialization Kernel symbol table initialization 0x2A 0x2B 0x2C 0x2D 0x2E 0x2F status diagnostics running Cause / Solution Controller module / reseat or replace Controller Enclosure Troubleshooting 229 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 230
data Cause / Solution Controller module / reseat or replace Firmware file is bad / Download Firmware with a good file. Controller module / reseat or replace 230 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 231
Troubleshooting Table 30 Controller Status LEDs codes (cont'd) Code Description Comments 0x6B 0x01 Drive SCSI Channel 1 (53C810) 0x6B 0x25 Drive SCSI Channel 5 (53C875) diagnostics running Cause / Solution Controller module / reseat or replace Controller Enclosure Troubleshooting 231 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 232
file is bad / Download Firmware with a good file. 0x8B 0x8C Verifying erase of file flash segments Verifying write of file flash segments 232 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 233
/ Download Firmware with a good file. Attempt to download Firmware again. If the problem persists, replace the controller module. Invalid address in flash device Length too long for Boot Menu memory Boot Funct. Status Memory problem / reseat or replace Controller Enclosure Troubleshooting 233 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 234
device on the PCI bus HW Init. status Cause / Solution Controller module / reseat or replace Memory problem / reseat or replace Controller module / reseat or replace Controller module / reseat or replace Memory problem Controller module / reseat or replace 234 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 235
Troubleshooting Table 30 Controller Status LEDs codes (cont'd) Code Description Comments 0xE6 Software load failure 0xE7 0xE8 Kernel missing slot. Controller module / reseat or replace Hardware reset is in progress or there is a bad controller module. Controller Enclosure Troubleshooting 235 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 236
disk enclosure Interface problems can be caused by either software or hardware. • Software problems, which indicate operating system or disk array disk modules, host adapter boards, or other devices on the Fibre Channel network - Failed disk modules 236 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 237
as necessary. For cable connection information for other devices, refer to applicable hardware manuals. Make sure that the Split/Full bus switch is set on the disk enclosure for the desired configuration. Problems resulting from a defective host adapter board, controller module, memory module, or - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 238
servicing disk array controller modules: • Always use proper precautions against electrostatic discharge when removing and handling disk array components. • Always read pertinent documentation. This includes software instructions cables are not hot swappable. 238 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 239
the other controller module is running. • If cache mirroring is enabled and one controller module fails, the remaining controller module will assume operation of the disk array, but write cache will be disabled. Controller Enclosure Troubleshooting 239 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 240
Controller Enclosure Troubleshooting Introduction This section describes procedures to troubleshoot the controller enclosure. See Figure 76. For troubleshooting procedures, refer to Table 32 or the "Master Troubleshooting Table" on page 275. Figure 76 Controller FRU, Slots and LEDs 240 Controller - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 241
Table 31 Controller Enclosure Troubleshooting Flowchart (Sheet 1 of 5) Start A Yes Power LED on? Look at the Array Controller's FRONT PANEL LEDs No Power is being applied to the Array Enclosure. Array Enclosure Power Problem Check for: 1. Power Cords 2. Power Switch 3. PDU 4. A/C Breaker - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 242
Controller Enclosure Troubleshooting Flowchart (Sheet 0xAB, 0xAF, or 0xB2 ? Possible Overheating or Midplane Problem. Check: 1. Environment 2. Power Supply Fan 3. Controller has failed. See the status LED section of the service manual for more information No on the exact LED meanings. Otherwise - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 243
Table 31 Controller Enclosure Troubleshooting Flowchart (Sheet 3 of 5) Yes Fan Subsystem FAULT. C Is the FRONT COVER Fan Fault LED on? No Go To D Is Power Front Cover Fan Fault? Front Cover Fan Fault? No No No Yes Contact the Response Center Go to A Controller Enclosure Troubleshooting 243 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 244
supply in the array is functioning. CAUTION: If a supply is unseated and its the only remaining functioning supply the array enclosure will abruptly power down! Fixed? No Possible causes: 1. Possible Midplane 2. Power supply to Midplane Connector damage 244 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 245
Table 31 Controller Enclosure Troubleshooting Flowchart (Sheet 5 of 5) Go to E A Yes Is the Fault-A or Fault-B BBU LED on? Yes The charging circuit or harness a. Replace both Power Supplies b. Replace the Battery Harness 2. DOA BBU 3. Midplane Controller Enclosure Troubleshooting 245 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 246
Midplane. If the Fault LED remains ON after replacing the midplane, call the factory service center. A Controller failed - Check the Fan LED on the front cover. If it is on, go to "Troubleshooting Controller Fan Module Problems" on page 257. If not, continue at the next step. - Replace the failed - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 247
Introduction This section describes procedures to troubleshoot the controller enclosure midplane. See Figure 77. For troubleshooting procedures, refer to Table 33, or the "Master Troubleshooting Table" on page 275. Controller Slots Controller Midplane Fibre Host Connectors 5 Volt Connectors - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 248
To replace the controller enclosure midplane, replace the entire chassis, not just the board. Servicing the chassis is a major task that requires removing and disassembly. Before assuming that the properly and that the controller modules are not overheated. 248 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 249
Enclosure Midplane Problems Table 33 Troubleshooting Controller Enclosure Midplane Problems Symptom Possible Cause Procedure Power LEDs (front and power supply FRUs) are ON but all other Power LEDs are off Software errors occur when attempting to access controller or disks A Other FRUs - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 250
Table 33 Troubleshooting Controller Enclosure Midplane Problems (cont'd) Symptom Possible Cause Procedure Software errors occur when attempting to access controller or disks A Software function or configuration problems - Check the appropriate software and documentation to make sure the system - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 251
Cooling System Introduction This section describes procedures to troubleshoot the controller enclosure cooling system. See Figure 78. For troubleshooting procedures. refer to the "Master Troubleshooting Table" on page 275 Controller Fan CRU Power Supply Fan CRU Ventilation Holes Figure - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 252
Servicing the Cooling System Cooling problems include any malfunctions or obstructions that impede air flow and cause one or more components in the controller enclosure to overheat. To avoid cooling problems, obstructions. Figure 79 Air Flow through Chassis 252 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 253
Troubleshooting Determining Which Fan Failed If the Fan Fault LED on the front cover is on, one of the fans in the controller enclosure has . - If the power supply fan module Fault LED is on, go to "Controller Enclosure Power Supply Fan Module" on page 258. Controller Enclosure Troubleshooting 253 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 254
Controller Fan Fault LED Controller Enclosure Power Supply Fan Module Power Supply Fan Fault LED Figure 80 Controller Enclosure and Power Supply Fan Fault LEDs 254 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 255
Controller Fan Module Introduction This section describes procedures to troubleshoot the controller fan module. See Figure 81. For troubleshooting procedures. refer to Table 34, or the "Master Troubleshooting Table" on page 275. Figure 81 Controller Fan Module and Status LEDs Controller - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 256
a failure would cause the temperature in the enclosure to rise, triggering a sensor in the fan module to turn on the Fan Fault LED. Operating the disk array at an elevated temperature for an extended period of time could damage the controller modules. . 256 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 257
Troubleshooting Troubleshooting Table 34 Troubleshooting Controller Fan Module Problems Symptom Possible Cause Controller Fan LEDs ON If the Power LED is ON and the Fault LED is off, the problem may be caused by the controller fan module. The temperature sensor in the controller fan module - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 258
troubleshooting procedures. refer to the "Master Troubleshooting Table" on page 275. Figure 82 Controller Enclosure Power Supply Fan Module Servicing Notes . Operating the disk array without a fan module for more than 15 minutes may cause a thermal shutdown. 258 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 259
Troubleshooting • Both fans in the fan module failing simultaneously is unlikely. Such a failure could cause one or both controller enclosure power the power supply Fault LED remains on, the power supply module has sustained heat damage and must be replaced. Controller Enclosure Troubleshooting 259 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 260
the controller enclosure power system. See Figure 83. For troubleshooting procedures. refer to the "Master Troubleshooting Table" on page 275. Figure 83 Controller Enclosure Power System FRUs Servicing the Power System Power system problems include any malfunctions that delay or interrupt power - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 261
controller enclosure's LEDs and a few simple procedures in this chapter to determine if the power problem is in the controller enclosure, the rack, or the building. Hardware-Related Problems Problems in the hardware components in the controller enclosure's power system include: • Loose or damaged - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 262
troubleshooting procedures. refer to Table 35 or the "Master Troubleshooting Table" on page 275. Figure 84 Battery Backup Unit (BBU) Servicing battery was serviced. Check this label to determine when to replace the BBU. If you replace the BBU and still experience battery-related problems such as - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 263
BBU is a sealed unit. There are no user-serviceable parts inside. When servicing the BBU, replace the entire BBU, not individual batteries or parts. Opening the BBU will void your warranty. Troubleshooting Table 35 Troubleshooting BBU Problems Symptom Possible Cause Procedure Fault-A or Fault - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 264
Table 35 Troubleshooting BBU Problems (cont'd) Symptom Possible Cause Procedure New BBU will not hold A Battery hours in order to properly charge the batteries. If this does not solve the problem, go to cause B. - Replace both power supplies. - Replace the battery harness. - Replace the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 265
Troubleshooting Checking the Battery Service Date Note Under normal circumstances, replace the BBU every two years. Operating the disk array in a environment with elevated temperature (above 35º C or 95º F), lowers the life expectancy of the BBU. Under these conditions you may need to replace the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 266
Check replacement date here Figure 85 Battery FRU Service Label CAUTION If the used BBU is physically damaged and is leaking electrolyte gel, DO NOT ship to your local regulations, which may include procedures for handling batteries as a hazardous waste. 266 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 267
Power Supply Module Introduction This section describes procedures to troubleshoot the controller enclosure power supply modules. See Figure 86. For troubleshooting procedures, refer to Table 36, or the "Master Troubleshooting Table" on page 275. Figure 86 Power Supply FRU Controller - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 268
off all power to the controller enclosure. CAUTION There is a serious cooling problem if the air temperature inside the enclosure is hot enough to cause both power the controller module and attempts to spin up the disks (which has no effect on the disks if they are already running), and returns the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 269
Troubleshooting Table 36 Troubleshooting Power Supply Module Problems Symptom Possible Cause Procedure No power to the controller module (all Power LEDs off) Power switches are turned off. Turn on both power switches on the controller enclosure. Turn on the main circuit breakers in the rack - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 270
problem in the rack. Remove all panels from the rack immediately to help cool the controller enclosure. Take whatever action is necessary to alleviate the over-temperature problem (such as shutting down the power or using external fans to cool the area). 270 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 271
For troubleshooting procedures, refer to the "Master Troubleshooting Table" on page 275 Battery Harness Figure 87 Battery Harness Servicing Notes An enclosure midplane, you must remove the controller enclosure from the rack and completely disassemble the chassis. For this reason, you should - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 272
the controller enclosure DC Power Harness. See Figure 88. For troubleshooting procedures, refer to the "Master Troubleshooting Table" on page 275. DC Power Supply Harnesses Figure 88 DC Power Harnesses Servicing Notes An intermittent or complete loss of power to the controller modules, Battery - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 273
cache memory. The Fast Cache Write LED will be off when all data has been written from write cache to the disk. 3. Turn OFF all power to the disk array. 4. Remove the controller enclosure from the cabinet. 5. Disassemble the chassis to access the harnesses. Controller Enclosure Troubleshooting 273 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 274
Power Interface Board Introduction This section describes procedures to troubleshoot the controller enclosure power interface board. For troubleshooting procedures, refer to the "Master Troubleshooting Table" on page 275 Servicing Notes CAUTION The controller enclosure's power supply assembly must - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 275
LED remains ON after replacing the midplane, call the factory service center. Software issued a controller error message Controller failed Check the Fan Fault LED on the front cover. If it is on, go to Troubleshooting Controller fan module Problems. If not, continue at the next step. Replace the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 276
B. Defective DC power Replace the DC power harnesses and the harness or power interface power supply assembly. If this does not board. solve the problem, go to cause C. Failed controller enclosure Replace the controller enclosure midplane. midplane. 276 Controller Enclosure Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 277
Table 37 Master Troubleshooting Controller Enclosure Master Troubleshooting Table (cont'd) Symptom Possible Cause Procedure Software errors occur when attempting to access controller or disks A Software function or configuration problems Check the appropriate software and documentation - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 278
Table 37 Master Troubleshooting Controller Enclosure Master Troubleshooting Table (cont'd) Symptom Possible Cause Procedure LEDs ON If the Power LED is on and the Fan Fault LED is off, the problem may be caused by the controller fan module. The temperature sensor in the controller fan module - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 279
Troubleshooting Controller Enclosure Master Troubleshooting FRU is due for replacement. Check the last service date for the BBU. If it has batteries. If this does not solve the problem, go to cause B. Faulty battery harness the main circuit breakers in the rack, if applicable. Power cords unplugged - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 280
Table 37 Master Troubleshooting Controller Enclosure Master Troubleshooting Table (cont'd) Symptom Possible Cause Procedure Power - Replace the DC Power Harnesses. If this does not resolve the problem, go to cause B. - Replace the power supply. See "Power Interface Board" on page - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 281
that the disk array is operational using IOSCAN or other host utilities. Disk Enclosure LEDs Figure 89 shows the locations of the disk enclosure status LEDs. Table 38 summarizes the operating LED states for all components within the disk enclosure. SureStore E Disk System SC10 Troubleshooting 281 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 282
LED Table 38 Disk Enclosure LED Functions LED State Indication System Power System Fault Green OFF Amber OFF Flashing Power is on. Normal operation. Power is off Self-test1 / Problem2 Normal operation BCC A & B DIP switch settings do not match 282 SureStore E Disk System SC10 Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 283
out of normal range. See "Isolating Causes" on page 284 3 When a disk is installed with power on, its activity LED stays ON until the disk has spun up. When the disk is ready, the LED turns off. Thereafter, it flashes when there is I/O to the disk. SureStore E Disk System SC10 Troubleshooting 283 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 284
/PDRU or primary power source has failed. Part Fault LED on A component has failed. See problem descriptions below. Buzzer sounds when BCC BCC Fault flashing installed BCC DIP switch settings do not match has slowed or stopped. Replace the fan. 284 SureStore E Disk System SC10 Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 285
Table 39 Disk Enclosure Troubleshooting Table (cont'd) Problem Description LED State Probable Cause/Solution Power Supply LED is on BCC A and BCC B are different versions. Internal bus is faulty. Contact HP technical support to replace midplane. SureStore E Disk System SC10 Troubleshooting 285 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 286
286 SureStore E Disk System SC10 Troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 287
Removal and Replacement 6 REMOVAL AND REPLACEMENT Overview 288 Required Tools and Equipment 290 Disk Enclosure Modules 291 Internal Disk Enclosure Assemblies 304 Controller Enclosure Modules 321 Internal Controller Enclosure Assemblies 342 287 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 288
. Note Is the HP SureStore E Disk Array FC60 customer repairable? Although the modular design of the Disk Array FC60 makes it easy to replace failed components, it is recommended that repair of the product be done by a trained service representative. This includes troubleshooting, and removal and - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 289
and Replacement Table 40 Field Replaceable Units (FRUs) Field Replaceable Units Disk Enclosure Disk & Filler Modules Disk Fan Modules Power Supply Modules BCC (Bus Controller Card) Modules Disk Enclosure (from rack) Front Cover Door Top Cover (Enclosure) Power Button Assembly Backplane/Mezzanine - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 290
Required Tools and Equipment • Small flat-blade screwdriver • Torx T-10 screwdriver • Torx T-15 screwdriver • Torx T-25 screwdriver • Phillips #1 screwdriver • Phillips #2 screwdriver • ESD wrist strap • ESD mat 290 Required Tools and Equipment - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 291
is part of the same volume group as the failed disk. - Never move disks from one array to another or within an array with power on. Moving disks with power on may result in data loss. Always power down the disk array before moving disks. Moving disk should not be confused with replacing a failed - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 292
disk. A special feature called drive lockout prevents unsupported disk drives from being used in the disk array. If an unsupported disk drive is installed in the disk array and inserting disks. 4. Slide the module out of the slot until you can grasp the handle (C). Support the disk module with - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 293
Replacement A ESD plug-in B cam latch C handle Figure 90 Disk Module Removal Installing a Disk Module or Filler Module CAUTION Touching the disk circuit board can cause high energy discharge and damage the disk. Disks modules are fragile and should be handled carefully. Disk Enclosure Modules 293 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 294
are installing has been removed from another Disk Array FC60, you should ensure that the module has a status of Unassigned. This is done by deleting the volume group the disk module was a part of in the original disk array. See "Moving Disks from One Disk Array to Another" on page 201. 1. Remove - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 295
LED should blink for a few seconds and then go out. If the host begins to access the disk, the Activity LED will flash. If this behavior does not occur, refer to chapter 6, Troubleshooting, for information on identifying and solving the problem. 7. Unplug the ESD strap, and close and lock the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 296
maintain proper cooling. However, if the remaining fan module fails before the defective fan is replaced, the disk enclosure must be shut down to prevent heat damage. CAUTION Do not remove a disk fan module until you a replacement. An empty slot will disrupt the cooling airflow within the enclosure - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 297
Removal and Replacement A - Locking screw B - Pull tab B Figure 93 Disk Enclosure Fan Module Removal and Replacement Installing the Fan Module 1. Slide the replacement fan green after a few seconds. If the LED does not turn green, refer to "Troubleshooting" on page 207. Disk Enclosure Modules 297 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 298
fails before the first power supply is replaced, all power will be lost to the disk enclosure. CAUTION Do not remove a power supply module until you have a replacement. An 4. Slide the power supply out of the chassis. Support the power supply with your free hand as it clears the chassis. 298 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 299
- locking screw C - power supplies D - power supply slot Figure 94 Disk Enclosure Power Supply Module Removal and Replacement Installing the Power Supply Module 1. With off or is amber, see chapter 6, Troubleshooting for information on identifying and solving the problem. Disk Enclosure Modules 299 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 300
operation of any LUNs using disks in the enclosure. The loss of the disks may initiate a rebuild for any LUN included on the disks. Note When the BCC replacement is completed and the disk enclosure is powered up, the array may perform a rebuild or copy-back to the disks. depending on the amount of - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 301
. c. Push both cam levers flat against the center of the module to seat the BCC pins firmly into the backplane connector. d. Tighten the locking screws. Disk Enclosure Modules 301 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 302
fault, refer to chapter 6, Troubleshooting. Note If the BCC Fault LED is on and the BCC or SCSI cable is not correctly seated, prior to attempting to reseat it, power off the disk enclosure, reseat the component, then power up the disk enclosure. 16. Reseat the disk modules one at a time: a. Push - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 303
using one of the software management tools. Initially the disk modules status will be either "write failed" or "no_response." Eventually, all the disk modules should return to "replaced" status. Once this occurs, the disk array will perform a rebuild (a result of I/O occurring during the period - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 304
the rack. This is required if you are replacing the front door or if you are replacing an internal enclosure assembly. The disk enclosure must be removed by a trained service representative only. This procedure requires stopping all host I/O to the disk array, and powering down the disk array. See - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 305
, complete the following steps: 1. Stop all host I/Os to the array. 2. Power down the controller enclosure. Set both switches at the rear of the controller enclosure to off. 3. Use a flat-blade screwdriver to unlock and open all disk enclosure doors (Figure 97). Figure 97 Door Lock 4. Power off all - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 306
Removal/Replacement 8. Close and lock the door. WARNING The disk enclosure weighs approximately 80 lbs. (36kgs.) without disks. If you choose to remove the disk enclosure from the rack, use two people or a lift device. 9. Push the disk enclosure forward then, using two people, lift it out of - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 307
To replace the disk enclosure into the rack, complete the steps below. 1. Using two people, lift the enclosure into the rack. Slide the enclosure disk modules to spin up and the enclosure to become completely functional. Use the Array Manager 60 commands to check the status of the disks. Some disks - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 308
service representative. The disk enclosure rack. See "Disk Enclosure SC10" on page 304. 1. With the door closed, remove two screws from each hinge block (C in Figure 99). 2. Pull the hinge blocks straight out from the sides of the enclosure, letting the latch hold the door in place. 3. Supporting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 309
the latch hold the door. 6. Insert the right and left hinge blocks behind the disk enclosure mounting ears (E), lining up all holes and inserting the hinge arm (F) over and disk enclosure chassis. 8. Reinstall the disk enclosure in the rack. See "Installing the Disk Enclosure SC10" on page 307. - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 310
. The top cover must be replaced by a trained service representative only. CAUTION All disk modules must be removed from the enclosure before removing the top cover. 1. Power off the disk enclosure and slide it out of the rack about 10 inches. See "Disk Enclosure SC10" on page 304. 2. Remove all - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 311
Removal and Replacement A - cover plate B - power switch C - cover tabs Figure 100 Disk Enclosure Top Cover Assembly Removal and Replacement 6. Slide the cover to the middle of the chassis. The push rod automatically engages the internal switch (B in - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 312
by a trained service representative only. 1. Power off the disk enclosure and slide it out of the rack about 10 inches. See "Disk Enclosure SC10" on wide end of the rod pass through the L-shaped notch in the cover. b. Guide the narrow end of the rod past additional slots at the front edge until the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 313
Removal and Replacement A - on/off button B - cover plate (bottom view) C - push rod D - standoffs Figure 101 Power Button Assembly Removal and Replacement Internal Disk Enclosure Assemblies 313 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 314
backplane when troubleshooting determines it is the source of the problem. Disks, BCCs, replaced by a trained service representative only. Also, the disk enclosure will need to be following steps: 1. Power off the disk enclosure and remove it from the rack. See "Disk Enclosure SC10" on page 304. 2. - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 315
A - mezzanine board B - backplane C - pin connector Removal and Replacement Figure 102 Disk Enclosure Mezzanine Assembly Removal and Replacement 4. If you are removing the backplane: a. Remove screw from the cam handle, open the handle, and pull power supplies - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 316
page 310. 8. Reseat and secure the power supplies. 9. Reseat and secure the BCCs. See "BCC Module Removal/Replacement" on page 300. 10. Re-install the disk enclosure. See "Installing the Disk Enclosure SC10" on page 307. 316 Internal - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 317
Removal and Replacement A - Torx T-15 screws B - alignment pin C - backplane-mezzanine Figure 103 Disk Enclosure Backplane Assembly Removal and Replacement Internal Disk Enclosure Assemblies 317 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 318
carrier is a result of dropping it, the disk drive inside may be damaged as well. Disk carriers must be replaced by a trained service representative only. CAUTION Touching the disk circuit board can cause high energy discharge and permanently damage the disk. Disks are fragile and should be handled - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 319
Assembly Removal and Replacement 3. Remove the four screws holding the insertion guides (B) and carrier (A) to the disk. Note Working near the edge of the table improves the angle of the screwdriver. 4. Lift the carrier off the disk drive. 5. With the latch (C in Figure 104) facing up and - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 320
the inside edge of the latch and the disk drive. 7. Set the insertion guides (B) on the sides of the carrier, aligning holes in the guide with holes in the carrier and disk drive. Nubs on the carrier fit dimples on the guides and help to hold the guides in position on the carrier. 8. Insert and - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 321
Removal and Replacement Controller Enclosure Modules This section provides removal and replacement procedures for the controller enclosure modules, plus the controller enclosure front cover. Most controller modules are hot swappable, however certain restrictions need to be observed for some - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 322
Front Cover Removal/Replacement " Hot Swappable Component! To gain access to the front of the controller module, the controller fan module, or the battery backup unit (BBU), the front cover must be removed. Removing the Front Cover 1. Pull the bottom of the cover out about one inch to release the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 323
Removal and Replacement Installing the Front Cover 1. Slide the top edge of the cover up under the lip of the chassis. 2. Push the cover up as far as it will go, then push the bottom in until the pins snap into the mounting holes. Controller Fan Module " Hot Swappable Component! CAUTION Do not - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 324
fan module is inserted all the way into the chassis, and the thumbscrew is tight. If the Fan Fault LED remains on, it may indicate a problem with the new module. 3. Install the front cover. See "Front Cover Removal/Replacement" on page 322. 324 Controller Enclosure Modules - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 325
write cache data will be written to disk. However, if a power outage occurs prior to completing the cache write to disk, data may be lost. Therefore, make Figure 107. CAUTION The BBU weighs approximately 24 pounds so be prepared to support its weight when you pull it out of the chassis. The BBU is - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 326
Figure 107 BBU Removal and Replacement 326 Controller Enclosure Modules - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 327
the new BBU. Save the shipping material for transporting the used BBU to the disposal facility. 2. Fill in the following information on the "Battery Support Information" label on the front of the battery. See Figure 108. a. Record the current date on the blank line next to "Date of Installation - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 328
minutes to remove the Controller Fan Module and insert the new one. Removing the Power Supply Fan Module 1. Gain access to the rear of the disk array controller enclosure. 2. Lift up on the ring/latch on the module to release the catch. See Figure 109. 3. Slide the power supply fan module from - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 329
into the chassis and locked in place. If the Fault LED remains on, the new power supply fan module may be malfunctioning, refer to Chapter 5, Troubleshooting. Controller Enclosure Modules 329 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 330
Component! A power supply should be replaced as quickly as possible to avoid the possibility of the remaining supply failing and shutting down the disk array. Removing the Power Supply Module 1. Turn off the power switch and unplug the power cord from the failed power supply module. See Figure - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 331
Removal and Replacement Figure 111 Power Supply Module Removal and Replacement Installing the Power Supply Module 1. Slide the supply into the slot until it is fully seated and the latch snaps into place. 2. Plug in the power cord and turn on the power. See Figure 110. 3. Check the power supply - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 332
controller disk array to a dual controller configuration. Replacement of the controller modules must be performed by a trained service upgradeability. Table 41 Controller Module Compatibility Operating System Controller Module P/N HP-UX HP-UX Windows NT/2000 A5278-60006 (3.5v model) A5278-60001 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 333
controller disk array FC60 to a dual controller array, you may need to add a Fibre Channel I/O adaptor to the host system. This will require shutting the host system down to install the adaptor card. If you are replacing a functioning controller because you suspect it may be causing problems, the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 334
. Figure 112 Controller Module Removal and Replacement Installing the DIMM Card on the New Controller Note If you are upgrading a single controller disk array by installing an add-on A5278A Controller Module, you do not need to perform the following procedure. Skip to "Installing the Controller - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 335
DIMM into the same connector in the replacement controller module. d. Replace the top cover on each controller module. e. Return the failed controller module to the factory. Controller Enclosure Modules 335 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 336
DIMM Figure 113 Controller Module DIMM Replacement Installing the Controller Module Note When a new controller module is installed, the resident controller checks the firmware version of the new controller. If the versions do not match, the resident controller downloads its firmware to the new - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 337
Removal and Replacement CAUTION If Auto Code Synchronization (ACS) occurs when the new controller module is installed. DO NOT turn array power off, reset the controller modules, or reseat the controller module for approximately 15 minutes after initial insertion. Performing any of these actions - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 338
6, for troubleshooting information. Figure 114 Identifying the ACS Process SCSI Cables Replacing SCSI cables requires that the disk enclosure be disk enclosure is powered up, the array will perform a rebuild (since I/O has occurred to the array while the disk enclosure was powered off). Array - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 339
"write failed" or "no_response." Eventually, all the disk modules should return to "replaced" status. Once this occurs, the disk array will perform a rebuild (a result of I/O occurring during the period the enclosure was powered off). The disk array will operate at reduced performance until the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 340
cable be removed. If the Disk Array FC60 contains two controllers, the system may array controller. However, if the disk array contains a single controller module, host I/Os to the disk array must be stopped before performing this procedure. This procedure must be performed by a trained service - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 341
Removal and Replacement Figure 115 MIA Removal and Replacement Controller Enclosure Modules 341 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 342
assemblies requires the controller enclosure be powered down and removed from the rack, host I/O activity to the disk array should be stopped before performing this procedure. CAUTION Only a trained service representative should perform the procedures described in this section. These procedures - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 343
. Figure 116 Door Lock 4. Switch off power to the disk enclosures. 5. Disconnect the Fibre Channel cables. Use a label it from the enclosure. 10. Disconnect the front of the controller enclosure from the rack column by removing the two screws (A in Figure 117) from each mounting bracket (B) - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 344
another person or a lift device. 11. Remove the enclosure from the rack. Pull the enclosure out about four inches then, using two people, each grab a side of the controller and pull it from the rack. To reinstall the enclosure, perform the above steps in reverse. See Chapter - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 345
Removal and Replacement Figure 117 Controller Enclosure Removal and Installation Internal Controller Enclosure Assemblies 345 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 346
DIMM/SIMM Memory Cards This procedure describes how to remove and replace the DIMM (cache) memory card and SIMM memory card contained in the controller modules. This procedure is required when replacing failed DIMM/SIMM, or transferring the DIMM to a replacement controller module. Note Replacement - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 347
Removal and Replacement Figure 118 Controller Module Cover Removal 5. Install the DIMM/SIMM card (Figure 119): - Replace the DIMM - If you are transferring the DIMM to a new replacement module or installing a new DIMM into the existing controller module - by pressing the card into the front DIMM - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 348
DIMM SIMM Figure 119 Replacing Memory in Controller Module 6. Replace the top plate on the controller modules (Figure 118) by replacing the six cover screws. 7. Replace the controller module into the controller enclosure. Refer to the "Controller Module" on page 332 for the required installation - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 349
Removal and Replacement Harness Cover Plate To gain access to the power harnesses and the battery harness (one end), remove the harness cover plate. This plate must also be removed when removing either the controller cage/midplane assembly or the power supply cage/midplane assembly. 1. Loosen the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 350
, complete the following steps: +5 VDC Power Harnesses +12 VDC Power Harness Figure 121 DC Power Harnesses 1. Remove the controller enclosure from the rack. See "Controller Enclosure" on page 342. 2. Remove the harness cover plate. See "Harness Cover Plate" on page 349. 3. Disconnect the harness - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 351
the four screws in the controller rear shield and press it down then tighten the screws. 7. Install the controller enclosure into the rack. See "Controller Enclosure" on page 342. For more complete installation instructions, see Chapter 3, Installation. Internal Controller Enclosure Assemblies 351 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 352
strap or other antistatic precautions before removing or handling the components in the controller enclosure. 1. Remove the controller enclosure from the rack. See "Controller Enclosure" on page 342. 2. Remove the harness cover plate. See "Harness Cover Plate" on page 349. 352 Internal Controller - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 353
Removal and Replacement 3. Remove the power supply cage/ midplane assembly. See Figure 123. a. Remove the eight screws, four each side, from the controller chassis. b. Pull the cage back a couple of inches to gain access to the power harness connectors and disconnect the connectors from the back of - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 354
the way into the chassis and install the eight screws (four each side). See Figure 123. 7. Install the controller enclosure into the rack (reverse the procedure "Controller Enclosure" on page 342). Battery Harness The controller module contains one battery harness. The battery harness (Figure 124 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 355
inside the controller cage (controller modules, power interface board, and fans), as well as to LVD-SCSI connections to the disk enclosures, and Fibre Channel connections to the Fibre Channel network. Figure 125 Controller Cage/ Midplane Assembly Internal Controller Enclosure Assemblies 355 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 356
components. Use a grounding wrist strap or other antistatic precautions before removing or handling the components. 1. Remove the controller enclosure from the rack. See "Controller Enclosure" on page 342. 2. Remove the harness cover plate. See "Harness Cover Plate" on page 349. 3. Disconnect the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 357
Removal and Replacement 4. Remove the eight screws, four from each side, of the controller cage (see Figure 127). 2 3 1 Figure 127 Controller Cage/ Midplane Assembly Removal 5. Remove the cage from the chassis: lift the top, front edge of the controller cage/ midplane assembly slightly upward ( - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 358
the top, front edge of the cage and push the unit toward the back, guiding the connectors on the backplane into the connector holes in the rear shield, until the Install the controller enclosure into the rack (reverse the procedure "Controller Enclosure" on page 342). 358 Internal - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 359
/ LEGAL / REGULATORY Models and Options 361 PDU/PDRU Products 365 Replaceable Parts 366 A5635A Controller Enclosure Specifications 368 A5636A Disk Enclosure Specifications 372 Warranty and License Information 376 Regulatory Compliance 384 FCC Statements (USA Only 385 Reference / Legal - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 360
Any host running Windows NT 4.0 or Windows 2000. Supported Operating Systems • Windows NT 4.0 (with Service Pack 4, 5, or 6) • Windows 2000 Fibre Channel Host Adapters Windows NT 4.0 and /2000 See the HP Storage Manager 60 User's Guide for a list of supported host adapters. 360 System Requirements - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 361
Reference / Legal / Regulatory Models and Options The HP SureStore E Disk Array FC60 consists of two products: theA5635A controller enclosure and theA5636A SureStore E Disk System SC10, or disk enclosure. Each of these products have their own options as indicated below. A5635A Controller Enclosure - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 362
Table 42 A5635A Product Options Option Description Host Connect Cable Options 0Z4 2-meter Fibre Channel cable AFY 16-meter Fibre Channel cable 0Z5 50-meter Fibre Channel cable 0Z6 100-meter Fibre Channel cable 701 Replace 1.5M VHDCI SCSI cable with 5M VHDCI SCSI cable 362 Models and Options - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 363
System SC10 is integrated into the disk array by servicetrained personnel. This product is ordered in conjunction with A5635A controller enclosure. The A5636A includes the following components: - SC10 Rack-mount enclosure (accommodates 10, 1.6" or 1," disk modules) - Two power supplies - Two fan - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 364
Disk Array FC60 Upgrade and Add-On Products Order the following parts to expand or reconfigure your original purchase: Table 43 Upgrade Products Order No. Description A5637A A5638A A5639A A5640A A5641A A5642A A5643A A5250A A5251A A5656A A5644A A5645A A5646A A5647A A5648A A5650A 9.2-Gbyte disk - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 365
following PDUs and PDRUs, with US and international power options, for meeting electrical requirements: Table 44 PDU/PDRU Products Order No. Description Supported on Original Racks E7676A 19 inch, 100-240 V, 16 Amp, 1 C20 inlet, 10 C20 outlets E7671A 19 inch, 100-240 V, 16 Amp, 1 C20 inlet - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 366
Replaceable Parts A5635A Controller Enclosure Replaceable Parts Table 45 Controller Enclosure Replaceable Parts Part Number Field Replaceable Units Exchange Part # A5635-60002 Windows NT1 Controller Module w/32 MB SIMM (no cache DIMMs) Includes Windows NT NVSRAM settings A5635-69002 A5278- - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 367
and mezzanine assy. Mezzanine board Bus Control Card (BCC) Half-U rack filler panel Rail kit, E3660 series Rail kit, Rack System/E Rail kit, Rittal 9000 racks Disk filler assembly 9 GB LP disk drive 18 GB HH disk drive 36 GB disk drive 73 GB disk drive HDD carrier assembly Exchange Part Order No - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 368
Power Supply 3.3 Power Supply Fan 1.5 Front Cover 2 Chassis 31.6 Controller Enclosure - Total Quantity 2 1 1 2 1 1 1 Subtotal (lbs) 13.2 1.9 21.4 6.6 1.5 2 31.6 78 lbs HP recommends the use of magnetic-type circuit breakers, which are capable of handling large in-rush currents for short - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 369
ranging Current: Voltage 100 - 127 VAC 220 - 240 VAC Typical Operating Current 1.5 A 0.8 A Maximum In-Rush Current Operating Current 2.3 A 1.2 A 21.7 A 42.9 A HP recommends the use of magnetic-type circuit breakers, which are capable of handling large in-rush currents for short durations (10 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 370
HP SureStore E Disk Array FC60 has been tested for proper operation in supported Hewlett-Packard cabinets. If the disk array is installed in an untested rack product failure. Operating Environment For continuous, trouble-free operation, the high availability disk array should not be operated at its - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 371
Non-operating Environmental (shipping and storage): • Temperature: • Maximum gradient: • Relative humidity: • Altitude: -40º C to 70º C (-40º F to 158º F) 20º C per hour (68º F per hour) 10% to 90% RH @ 28º C (wet bulb) 4572 m (0 - 15,000 ft) Acoustics • Meets or exceeds all known international - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 372
: Height 5.91 in. (15.0 cm) Width 18.9 in. (48.0 cm) Depth 27.2 in. (69.1 cm) Weight: Component Weight of Each (lbs) Disk Drive (HH) 2.8 Fan 3 .3 Power Supply 10.6 BCC 4.5 Midplane-Mezzanine 6 Door 2 Chassis 35 Total, Approx. Quantity 10 2 2 2 1 1 1 Subtotal (lbs) 28 7 22 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 373
2.4 a 3.2 a 50-60 Hz , single phase, power factor corrected HP recommends the use of magnetic-type circuit breakers, which are capable of handling Power Consumption 100- 127 VAC 200 - 240 VAC 347 watts 347 watts DC Power Output: • Disk: +5 V and +12 V from power supply • BCC: +5 V and +12 V - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 374
HP SureStore E Disk Array FC60 has been tested for proper operation in supported Hewlett-Packard cabinets. If the disk array is installed in an untested rack product failure. Operating Environment For continuous, trouble-free operation, the high availability disk array should not be operated at its - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 375
Note For continuous, trouble-free operation, the disk enclosure should NOT be operated at its maximum environmental limits for extended Acoustics • Sound power: 6.4 Bels • Sound pressure at operator's position: 56.2 dB(A) Reference / Legal / Regulatory A5636A Disk Enclosure Specifications 375 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 376
time commitment for your HP SureStore E Disk Array FC60. For more information on upgrading your warranty, contact your local HP sales representative or authorized reseller. For hardware service and telephone support, contact: - An HP-authorized reseller or - HP Customer Support Center at 970-635 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 377
placing the call will expedite the support process: - Product model name and problem over the phone. It may be helpful to have your system administrator available for consultation and to run configuration and diagnostic programs as necessary. The standard warranty includes onsite service, and HP - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 378
or replaced by an organization other than HP or by a service provider not authorized by HP Software Product Limited Warranty The HP Software Product Limited Warranty will apply to all Software that is provided to you by HP as part of the HP SureStore E Disk Array FC60 for the NINETY (90) day period - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 379
execute its programming instructions when all files are properly installed. HP does not warrant service but may be service under a separate HP support contract covering the product. Limitation of Warranty HP does not warrant uninterrupted or error-free operation of an HP SureStore E Disk Array FC60 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 380
items not designed for use with the product. The HP warranty does not cover errors, malfunctions, or problems caused by or related to third-party products that are external to your HP SureStore E Disk Array FC60. HP reserves the right to charge for services where the cause of the error is found to - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 381
OF THIS PRODUCT TO YOU. Hewlett-Packard Software License Terms The disk array hardware described herein uses Licensed Internal Code ("LIC"). The LIC, supplies, spare parts, and upgrades on HP's Price List on the date HP receives Customer's order. License Grant. HP grants you a license to Use one - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 382
, you must erase the Software before any such transfer or disposal. You will make reasonable efforts to protect the confidentiality of the Software. Termination. HP may terminate your license upon notice for failure to comply with any of these License Terms. Upon termination or when you cease to use - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 383
or regulations. f. Any disputes arising in connection with this agreement will be governed by the laws of California. g. These HP Software License Terms supersede any previous communications, representations or agreements between the parties, whether oral or written, regarding transactions hereunder - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 384
Regulatory Compliance Safety Certifications: • UL listed • CUL certified • TUV certified with GS mark • Gost Certified • CE-Mark EMC Compliance • US FCC, Class A • CSA, Class A • VCC1, Class A • BCIQ, Class A • CE-Mark • C-Tick Mark 384 Regulatory Compliance - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 385
. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 386
VCCI Statement (Japan) This equipment is in the Class A category information technology equipment based on the rules of Voluntary Control Council For Interference by Information Technology Equipment (VCCI). When used in a residential area, radio interference may be caused. In this case, user may be - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 387
faire l'objet d'une déclaration (en deux exemplaires) simultanément auprès des services suivants: • Comité de Coordination des Télécommunications 20, avenue de Ségur having the highest acoustic emissions: 12 disk modules. • All other configurations have lower emission levels. FCC Statements (USA Only) - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 388
Geräuschemission (For Germany Only) • LpA: 45.0 dB (suchend) • Am fiktiven Arbeitsplatz nach DIN 45635 T. 19. • Die Daten sind die Ergebnisse von Typprüfungen an Gerätekonfigurationen mit den höchsten Geräuschemissionen:12 Plattenlaufwerke. • Alle andere Konfigurationen haben geringere Geräuschpegel - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 389
Guide 22 and EN 45014 Manufacturer Name: Manufacturer Address: Hewlett-Packard Company Enterprise Storage Business Unit P.O.Box 15 Boise, Idaho U.S.A. 83707 Declares, that the product Product Name: Product Numbers: Product Options: SureStore E Disk Array FC60 Packard Sales and Service office or - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 390
390 FCC Statements (USA Only) - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 391
, FC adapter, or host bus adapter (HBA). ArrayID The value used to identify a disk array when using Array Manager 60. The ArrayID can be either the disk array S/N, or an alias assigned to the disk array. auto failover The process of transferring the I/O data path from a failed controller to the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 392
distances. Cascaded hubs allow distances up to 500 meters between hubs, or between a hub and a device. channel One of the six SCSI busses connecting the disk array controller enclosure to the disk enclosures. Each channel is an independent LVD SCSI bus. channel:ID The two-part value used to identify - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 393
Class of Service The types of services provided by the Fibre Channel topology and used by the communicating port. controller A removable unit that contains an array controller. dacstore A region on each disk used to store configuration information. During the Start Of Day process, this information - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 394
of LUNs within the disk array. disk group A collection of individual disks that share a common role in disk array operation. All disks on the disk array will be a member of one of the following disk groups: a LUN, hot spare, or unassigned. disk module The individual disk drive assemblies used in - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 395
a point-to-point topology, from two to 126 devices in an arbitrated loop, and up to 224 devices in a fabric switched topology. The disk array default topology is arbitrated loop. Fibre Channel is a generalized transport mechanism that has no protocol or native I/O command set, but can transport any - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 396
FC-AL is controlled by an arbitration scheme. The FC-AL topology supports all classes of service and guarantees in-order delivery of Fibre Channel frames when the originator and responder are on the same FC-AL. The disk array's default topology is arbitrated loop. Fibre Channel Arbitrated Loop Hub - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 397
removed and replaced by a customer or Hewlett-Packard service representative. global hot spare A disk that is powered up and electrically connected to a disk array but not used until a disk failure occurs. A global hot spare is a dedicated, on-line, backup disk that cannot be used to store user data - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 398
for data storage and retrieval. hot swappable Hot swappable components can be removed and replaced while the disk array is online without disrupting system operation. Disk array controller modules, disk modules, power supply modules, and fan modules are all hot swappable components. I/O operation An - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 399
the same disk array. A numeric value is assigned to a LUN at the time it is created. LVD-SCSI Low voltage differential implementation of SCSI. Also referred to as Ultra2 SCSI. LVM (Logical Volume Manager) The default disk configuration strategy on HP-UX. In LVM one or more physical disk modules are - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 400
fabric, loop, or switching elements present. port The hardware entity that connects a device to a Fibre Channel topology. A device can contain one or more ports. primary disk array path or primary path The main data path used for host I/Os to a LUN. The primary path can be set using LVM. Because the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 401
implement data redundancy. The RAID levels supported by the disk array include RAID 1, RAID 3, and RAID 5. RAID 1 A RAID level in which the LUN uses a single mirrored pair of disks. One disk serves as the data disk, and the other serves as the mirror disk. RAID 0/1 A RAID configuration in which the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 402
storage (cache) for an SP. An SP must have at least two 4-MB memory modules to support the storage system cache. Start Of Day (SOD) The initialization process used by the disk array controllers to configure itself and establish various operating parameters. Each controller runs its own SOD process - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 403
errors may occur. topology The physical layout of devices on a network. The three Fibre Channel topologies are fabric, arbitrated loop, and point-to-point. The disk array's default topology is arbitrated loop. unbind Unbinding reverses the LUN binding process, deleting the LUN and returning the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 404
the input ac mains supply loses its source of power. VHDCI Very high density cable interface. volume set addressing (VSA) An enhanced technique for addressing disk array LUNs. VSA overcomes the eight LUN limit imposed by PDA, allowing all 32 LUNs on the - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 405
protection 43 checking service date 265 damaged 266 date of installation 265 described 42 labels 265 life expectancy 43, 261, 265 precaution on servicing 263 problems with 262 removal and replacement 325 service label 262 servicing notes 262 status signals for 354 troubleshooting problems 263 Index - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 406
service notes 271 battery module illustration of 262 life expectancy 261 BCC module described 26 removal and replacement 300 troubleshooting 284 C cabinets supported 63 capacity adding 200 expanding with disk enclosures 174 managing 189 maximum 71 channel number disk module 190 chassis air flow 252 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 407
servicing notes 238 troubleshooting 257 who may service 238 controllers 215 cooling system illustrated 251 servicing 252 troubleshooting 253 current disk enclosure described 239 replacing 346 servicing notes 239 disk cable connectors for 247 disk array capacity management features 62 configuration - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 408
, high availability and performance 80 three disk enclosure, maximum capacity 82 two disk enclosure, high availability and performance 76 two disk enclosure, maximum capacity 78 disk array management software 18 disk drives See disk modules disk enclosure acoustics 375 adding 201 current 373 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 409
116 recommended PDU/PDRU for HP System/E racks 118 site 114 environmental disk enclosures 174 overview 71 F factory default configurations See recommended array configurations failure/fault fan indicator 254 fans 253 host adapter board 237 fan determining which failed 253 troubleshooting - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 410
capacity of the disk array 200 initialization LEDs 221 in-rush current 114 installation controller enclosure 136 disk enclosures 127 disk enclosures into rack 129 disk module 133 filler mdoule 133 interface external connections 236 internal boards 236 problems 236 troubleshooting hints 237 ioscan - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 411
119 order numbers 365 recommended for HP System/E racks 118 troubleshooting 284 performance array configuration 69 I/Os per second 70 impact of configuration settings 196 rebuild 59 SCSI channels 68 split-bus configurartion 70 planning a disk array configuration 67 power AC input specifications - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 412
171 powering up the disk array 164 power-up controller 213 LEDs 213 self tests 213 precautions for controller fan module time limits 256 problems host adapter board 237 products add-on & support 364 proper ventilation 328 R rack Rittal 16 racks supported 16 RAID described 45 supported levels 18 RAID - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 413
characteristics 57 RAID levels described 48 tips on selecting 193 rail installation HP original rack 129 rebuild 59 recommended disk array configurations 73 recommended UPS 119 recovering from interface problems 236 power supply shutdown 268 recycling battery 266 redundant pair of controllers - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 414
SIMMs 37 described 239 replacing 346 servicing notes 239 single-inline memory supported operating systems 18 SureStore E Disk System SC10 See disk enclosure switch configuration 142 disk enclosure 153 disk problems with power supply 268 throughput Fibre Channel 67 SCSI channels 68 top cover, disk - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 415
ownership 193 defined 62 moving from one array to another 203 selecting disks for 189 selecting RAID level for 193 setting stripe segment size 194 W warranty information 376 weight controller enclosure 368 disk enclosure 372 Windows NT troubleshooting tools 210 write cache battery backup 43 - HP Surestore Disk Array FC60 | HP SureStore E Disk Array FC60 Service Manual (A5 - Page 416
416 Index
HP SureStore E Disk Array FC60
Service Manual
Edition E0900
Printed in U.S.A.
h
p
H