Compaq ProLiant 6500 Compaq Parallel Database Cluster Model PDC/O2000 for Orac
Compaq ProLiant 6500 Manual
View all Compaq ProLiant 6500 manuals
Add to My Manuals
Save this manual to your list of manuals |
Compaq ProLiant 6500 manual content summary:
- Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 1
Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Second Edition (June 2001) Part Number 225082-002 Compaq Computer Corporation - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 2
Compaq Computer Corporation Compaq, the Compaq logo, Compaq Insight Manager, SmartStart, ROMPaq, ProLiant, and StorageWorks Registered in U.S. Patent and Trademark Office. ActiveAnswers is a trademark of Compaq Information Technologies Group, L.P. in the United States and other countries Compaq - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 3
About This Guide Purpose ...xiii Audience...xiii Scope ...xiv Referenced Manuals xv Supplemental Documents xvi Text Conventions...xvii Symbols in Text...xvii Symbols on Equipment xviii Rack Stability ...xix Getting Help ...xix Compaq Technical Support xix Compaq Website xx Compaq Authorized - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 4
Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide Chapter 2 Cluster Architecture Compaq ProLiant Servers 2-2 High-Availability Features of ProLiant Servers 2-3 Shared Storage Components 2-3 RA4000 Array 2-4 RA4100 Array 2-4 RA4000 Array Controllers 2-5 Fibre - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 5
Area Network 2-76 Chapter 3 Cluster Software Components Overview of the Cluster Software 3-1 Microsoft Windows 2000 Advanced Server 3-1 Compaq Software ...3-2 Compaq SmartStart and Support Software 3-2 Compaq System Configuration Utility 3-3 Compaq 4-3 Compaq ProLiant Servers 4-3 Planning - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 6
2000 Administrator Guide Cluster Planning continued Planning Cluster Configurations for Redundant Fibre Channel Arbitrated Loops ...4-11 Sample Small Configuration in a Redundant FC-AL 4-11 Sample Large Configuration in a Redundant FC-AL 4-13 RAID Planning...4-14 Supported RAID Levels 4-16 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 7
Contents vii Installing Compaq OSDs 5-30 5-48 Power Distribution and Power Sequencing Guidelines 5-48 Server Power Distribution 5-49 RA4000/RA4100 Array Power Distribution 5- Concepts 6-2 Powering Off a Node Without Interrupting Cluster Services 6-2 Managing a Cluster in a Degraded Condition - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 8
viii Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide Cluster Management continued Replacing a Cluster of the Dynamic Link Library NM.DLL Failed 7-8 Troubleshooting Node-to-Node Connectivity Problems 7-8 Nodes Are Unable to Communicate with Each - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 9
Troubleshooting continued Troubleshooting Secure Path 7-14 Secure Path Guidelines for Windows 2000 Advanced Server Starting 7-16 Appendix A Diagnosing and Resolving Shared Disk Problems Introduction ...A-1 Run Object Link Manager on All Nodes Compaq Support Representative A-8 Glossary Index - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 10
Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide List of Figures Figure 1-1. Example of a two-node Compaq Parallel Database Model PDC/O2000 cluster 1-2 Figure 2-1. Two-node PDC/O2000 with a two-fabric redundant Fibre Channel Fabric 2-10 Figure 2-2. Two - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 11
Fibre Channel SAN Switches 5-6 Figure 5-2. RA4000/RA4100 Arrays connected to clustered servers through one redundant Fibre Channel Fabric or redundant FC-AL 5-8 Figure 5-3. for a two-node PDC/O2000 cluster 5-19 Figure 5-9. Server power distribution in a three-node cluster 5-49 Figure A-1. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 12
xii Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide List of Tables Table 2-1 High-Availability Components of ProLiant Servers 2-3 Table 2-2 Features of Active/Standby and Active/Active Configurations for Redundant Fibre Channel Fabrics 2-17 Table - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 13
configuration, implementation, management, and troubleshooting of the Compaq Parallel Database Cluster Model PDC/O2000 running Oracle8i software on the Microsoft Windows 2000 Advanced Server operating system. Audience The expected audience of this guide consists primarily of MIS professionals whose - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 14
the PDC/O2000. I Chapter 7, "Troubleshooting," contains troubleshooting information for the PDC/O2000. I Appendix A, "Diagnosing and Resolving Shared Disk Problems," describes procedures to diagnose and resolve shared disk problems. I Glossary contains definitions of terms used in this guide. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 15
refer to documentation related to the specific hardware and software components of the Compaq Parallel Database Cluster. These related manuals include, but are not limited to: I Documentation related to the ProLiant servers you are clustering (for example, guides, posters, and performance and tuning - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 16
Guide Supplemental Documents The following technical documents contain important supplemental information for the Compaq Parallel Database Cluster Model PDC/O2000: I Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server (ECG062/0299), at www.compaq - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 17
are instructed to enter information, type the information and then press the Enter key. Symbols in Text These symbols may be found in the text of this guide. They set off in this manner presents clarifying information or specific instructions. NOTE: Text set off in this manner presents commentary, - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 18
Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide Symbols on Equipment These icons may be located on equipment in areas where hazardous conditions may exist. Any surface or area hazards. Enclosed area contains no operator serviceable parts. WARNING: To - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 19
Help If you have a problem and have exhausted the information in this guide, you can get further information and other help in the following locations. Compaq Technical Support In North America, call the Compaq Technical Phone Support Center at 1-800-OK-COMPAQ. This service is available 24 hours - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 20
/02000 for Oracle8i and Windows 2000 Administrator Guide Compaq Website The Compaq website has information on this product as well as the latest drivers and Flash ROM images. You can access the Compaq website by logging on to the Internet at www.compaq.com Compaq Authorized Reseller For the name of - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 21
features, availability and scalability, have been moving into client/server products for the last few years. The absorption of clustering than proprietary clustering systems. Before examining the features and benefits of the Compaq Parallel Database Cluster Model PDC/O2000 (referred to here as the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 22
the cluster nodes. Refer to Chapter 3, "Cluster Software Components" to determine the specific releases your cluster kit supports. Figure 1-1 shows an example of a PDC/O2000 that includes two nodes (ProLiantTM servers), two Compaq StorageWorks RAID Array 4000s or 4100s (RA4000/RA4100 Arrays), two - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 23
has several primary causes: hardware faults, software faults, planned service, operator error, and environmental factors. Minimizing downtime is a . In a stand-alone server configuration, scalable systems allow increased throughput by adding processors or more memory. In a cluster configuration, - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 24
Guide Compaq Parallel Database Cluster Overview As traditional clustering technology has moved into the open systems of client/server computing, Compaq 2000 Advanced Server operating system and the industry-leading Oracle8i Parallel Server with award-winning Compaq ProLiant servers and shared - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 25
computing environment. The hardware products include: I Compaq ProLiant servers I Shared storage components G Compaq StorageWorks RAID Array 4100s (RA4100 Arrays) or Compaq StorageWorks RAID Array 4000s (RA4000 Arrays) G Two Compaq StorageWorks RAID Array 4000 Controllers (RA4000 Array Controllers - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 26
Advanced Server with Service Pack 1 or later I Compaq drivers and utilities I Oracle8i Enterprise Edition with the Oracle8i Parallel Server Option Refer to Chapter 3, "Cluster Software Components," for a description of the software products used with the PDC/O2000. Compaq ProLiant Servers A primary - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 27
which offer excellent reliability through redundant power supplies, redundant cooling fans, and Error Checking and Correcting (ECC) memory. The high-availability features of ProLiant servers are a critical foundation of Compaq clustering products. Table 2-1 lists the high-availability features found - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 28
PDC/O2000. Each redundant Fibre Channel Fabric or redundant FC-AL supports one or more RA4000 Arrays. Each RA4000 Array contains two single more information about the RA4000 Array, refer to the Compaq StorageWorks RAID Array 4000 User Guide. RA4100 Array The RA4100 Array is another shared storage - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 29
controller slots contains the active array controller. The array controller that is installed in the active slot is automatically assigned active status by Compaq Secure Path, without the need for any further configuration. To determine which of the two array controllers in an RA4000/RA4100 Array is - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 30
, refer to the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Fibre Channel SAN Switches An 8-port Fibre Channel SAN Switch and 16-port Fibre Channel SAN Switch are supported. From two to four Fibre Channel SAN Switches can be used in each - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 31
ports. With the addition of the 3-port Expansion Module (PEM), the switch supports 11 ports. For further information, refer to the Compaq StorageWorks Fibre Channel Arbitrated Loop Switch (FC-AL Switch) User Guide. Storage Hubs Storage Hubs can also be installed between cluster nodes and shared - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 32
Compaq StorageWorks Fibre Channel Storage Hub 12 Installation Guide for further information about the Storage Hubs. Fibre Host Adapters Each redundant Fibre Channel Fabric or redundant FC-AL in a PDC/O2000 contains a dedicated set of Fibre Host Adapters in every cluster node. Across servers, Fibre - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 33
define a multi-layered architecture for moving data across the storage area network (SAN). This layered architecture can be implemented using the or the Fibre Channel Arbitrated Loop (FC-AL) topology. The PDC/O2000 supports both topologies. A redundant Fibre Channel Fabric is two to four Fibre - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 34
to the array controllers IMPORTANT: For detailed information about cascading two Fibre Channel SAN Switches, refer to the latest Compaq StorageWorks documentation. This guide does not document cascaded configurations for the Fibre Channel SAN Switch. A redundant Fibre Channel Fabric consists of from - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 35
Cluster Architecture 2-11 Multiple Redundant Fibre Channel Fabrics The PDC/O2000 supports the use of multiple redundant Fibre Channel Fabrics within the same is restricted by the number of Fibre Host Adapters your Compaq servers support. Refer to the Compaq server documentation for this information. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 36
2-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Figure 2-2 shows a two-node PDC/O2000 that contains two redundant Fibre Channel Fabrics. In this example, each redundant Fibre Channel Fabric has its own pair - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 37
Cluster Architecture 2-13 Maximum Distances Between Nodes and Shared Storage Components in a Redundant Fibre Channel Fabric By using standard short-wave Fibre Channel cables with Gigabit Interface Converter-Shortwave (GBIC-SW) modules, the following maximum distances apply: I Each RA4000/RA4100 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 38
2-14 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I/O Data Paths in a Redundant Fibre Channel Fabric A distinct I/O path connection exists between each Fibre Host Adapter in a redundant Fibre Channel Fabric and every array controller - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 39
Cluster Architecture 2-15 Fibre Channel SAN Switch-to-Array Controller Paths Figure 2-5 highlights the I/O data paths that run between the Fibre Channel SAN Switches and the two single-port RA4000 Array Controllers in each RA4000/RA4100 Array. Fibre Host Adapters (2) Fibre Channel SAN Switch #1 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 40
2-16 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide In every redundant Fibre Channel Fabric, at least two Fibre Host Adapters must be installed in each node (one adapter for each Fibre Channel SAN - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 41
Cluster Architecture 2-17 Table 2-2 identifies the features of the active/standby and active/active configurations for redundant Fibre Channel Fabrics. Table 2-2 Features of Active/Standby and Active/Active Configurations for Redundant Fibre Channel Fabrics I/O Path Configuration Active/standby - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 42
2-18 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-2 Features of Active/Standby and Active/Active Configurations for Redundant Fibre Channel Fabrics continued I/O Path Configuration Advantage Disadvantage Active/active with two or - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 43
Cluster Architecture 2-19 I/O Path Configuration Rules for Redundant Fibre Channel Fabrics The following rules must be observed in I/O path configurations for PDC/O2000 clusters with redundant Fibre Channel Fabrics: I Each redundant Fibre Channel Fabric must use either an active/standby or active/ - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 44
2-20 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Standby Configuration Examples for Redundant Fibre Channel Fabrics This section describes examples of active/standby configurations when one, two, three, four, and five RA4000/ - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 45
Cluster Architecture 2-21 I In each RA4000/RA4100 Array, the bottom (rack model) or left rear (tower model) array controller is always the standby controller. I The odd-numbered Fibre Channel SAN Switch (Fibre Channel SAN Switch #1) is connected to the active array controller in each RA4000/RA4100 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 46
Guide Active/Standby Configuration with One RA4000/4100 Array Figure 2-6 shows an active/standby I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with one RA4000/RA4100 Array. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 47
Channel Fabric in a four-node cluster with two RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 Fibre Channel SAN Switch #1 Fibre Channel SAN Switch #2 Active Array Controller RA4000/4100 Array #1 Standby - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 48
Guide Active/Standby Configuration with Three RA4000/RA4100 Arrays Figure 2-8 shows an active/standby I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with three RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 49
Fibre Channel Fabric in a four-node cluster with four RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 Fibre Channel SAN Switch #1 Fibre Channel SAN Switch #2 RA4000/4100 Array #1 RA4000/4100 Array #2 RA4000 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 50
Guide Active/Standby Configuration with Five RA4000/RA4100 Arrays Figure 2-10 shows an active/standby I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with five RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 51
Cluster Architecture 2-27 Active/Active Configuration Examples for Redundant Fibre Channel Fabrics This section describes examples of active/active configurations when two, three, four, and five RA4000/RA4100 Arrays are present in one redundant Fibre Channel Fabric of a four-node PDC/O2000 cluster. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 52
2-28 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I The even-numbered Fibre Channel SAN Switch (Fibre Channel SAN Switch #2) is connected to the active array controller in each even-numbered RA4000/RA4100 Array (2 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 53
I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with two RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 Fibre Channel SAN Switch #1 Fibre Channel SAN Switch #2 Active RA4000/4100 Standby RA4000/4100 Array - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 54
2000 Administrator Guide Active/Active Configuration with Three RA4000/RA4100 Arrays Figure 2-12 shows an active/active I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with three RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 55
path configuration for a redundant Fibre Channel Fabric in a four-node cluster with four RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 Fibre Channel SAN Switch #1 Fibre Channel SAN Switch #2 RA4000/4100 Array #1 RA4000/4100 Array #2 RA4000 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 56
2000 Administrator Guide Active/Active Configuration with Five RA4000/RA4100 Arrays Figure 2-14 shows an active/active I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with five RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 57
Cluster Architecture 2-33 Summary of I/O Path Failure and Failover Scenarios for Redundant Fibre Channel Fabrics Table 2-3 identifies possible I/O path failure events in redundant Fibre Channel Fabrics for active/standby configurations with one RA4000/RA4100 Array and the failover response, if any, - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 58
2-34 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-3 I/O Path Failure and Failover Scenarios in Redundant Fibre Channel Fabrics for Active/Standby Configurations With One RA4000/RA4100 Array continued Description of Failure Failover - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 59
Cluster Architecture 2-35 Table 2-4 identifies possible I/O path failure events for active/standby configurations in redundant Fibre Channel Fabrics with two or more RA4000/RA4100 Arrays and the failover response, if any, implemented by Secure Path for each failure. Table 2-4 I/O Path Failure and - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 60
2-36 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-4 I/O Path Failure and Failover Scenarios in Redundant Fibre Channel Fabrics for Active/Standby Configurations With Two or More RA4000/RA4100 Arrays continued Description of - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 61
Cluster Architecture 2-37 Table 2-5 identifies possible I/O path failure events in redundant Fibre Channel Fabrics for active/active configurations with two or more RA4000/RA4100 Arrays and the failover response, if any, implemented by Secure Path for each failure. Table 2-5 I/O Path Failure and - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 62
2-38 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-5 I/O Path Failure and Failover Scenarios in Redundant Fibre Channel Fabrics for Active/Active Configurations With Two or More RA4000/RA4100 Arrays continued Description of - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 63
define a multi-layered architecture for moving data across the storage area network (SAN). This layered architecture can be implemented using the Fibre for each port. When FC-AL Switches are used, the FC-AL SAN supports multiple 100 MB/sec point-to-point connections in parallel. Each FC-AL Switch - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 64
FC-AL Switches to the array controllers IMPORTANT: For detailed information about cascading two FC-AL Switches, refer to the latest Compaq StorageWorks documentation. This guide does not document cascaded configurations for the FC-AL Switch. A redundant FC-AL consists of from two to four individual - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 65
Cluster Architecture 2-41 Figure 2-15 shows a two-node PDC/O2000 with a redundant FC-AL that contains two loops, one for each Fibre Host Adapter per node. The components and cable paths for the first loop are shaded to distinguish them from the components for the other loop. Fibre Host Adapters (2) - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 66
2-42 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Multiple Redundant Fibre Channel Arbitrated Loops The PDC/O2000 supports the of Fibre Host Adapters your Compaq servers support. Refer to the Compaq server documentation for this information. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 67
Cluster Architecture 2-43 Figure 2-16 shows a two-node PDC/O2000 that contains two redundant FC-ALs. In this example, each redundant FC-AL has its own pair of Fibre Host Adapters in each node, a pair of Storage Hubs or FC-AL Switches, and two RA4000/RA4100 Arrays. In Figure 2-2, the hardware - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 68
2-44 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Maximum Distances Between Nodes and Shared Storage Components in a Redundant FC-AL By using standard short-wave Fibre Channel cables with Gigabit Interface Converter-Shortwave ( - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 69
Cluster Architecture 2-45 I/O Data Paths in a Redundant FC-AL A distinct I/O path connection exists between each Fibre Host Adapter in a cluster node and every array controller port in each RA4000/RA4100 Array in the redundant FC-AL. Fibre Host Adapter-to-Storage Hub/Switch Paths Figure 2-18 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 70
2-46 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Storage Hub/Switch-to-Array Controller Paths Figure 2-19 highlights the I/O data paths that run between the Storage Hubs or FC-AL Switches and the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 71
Cluster Architecture 2-47 I/O Path Configuration Guidelines for Redundant Fibre Channel Arbitrated Loops You can use either of two I/O path configurations for every redundant FC-AL in your PDC/O2000 cluster: I Active/standby configuration I Active/active configuration In every redundant FC-AL, at - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 72
2-48 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide See "Active/Standby Configuration Examples for Redundant FC-ALs" in this chapter for a detailed description of active/standby configuration examples for a redundant FC-AL with - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 73
Cluster Architecture 2-49 Table 2-6 Features of Active/Standby and Active/Active Configurations for Redundant Fibre Channel Arbitrated Loops continued I/O Path Configuration Advantage Disadvantage Active/active with two or more RA4000/RA4100 Arrays Provides a small but measurable improvement - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 74
2-50 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I/O Path Configuration Rules for Redundant FC-ALs The following rules must be observed in I/O path configurations for PDC/O2000 clusters with redundant FC-ALs: I Each - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 75
Cluster Architecture 2-51 Active/Standby Configuration Examples for Redundant FC-ALs This section describes examples of active/standby configurations when one, two, three, four, and five RA4000/RA4100 Arrays are present in one redundant FC-AL of a four-node PDC/O2000. These examples represent one - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 76
2-52 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I In each RA4000/RA4100 Array, the bottom (rack model) or left rear (tower model) array controller is always the standby controller. I The odd-numbered Storage - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 77
for a redundant FC-AL in a four-node cluster with one RA4000/RA4100 Array. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 FC-AL Switch/Storage Hub #1 FC-AL Switch/Storage Hub #2 Standby Array Controller RA4000/4100 Array - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 78
Administrator Guide Active/Standby Configuration with Two RA4000/4100 Arrays Figure 2-21 shows an active/standby I/O path configuration for a redundant FC-AL in a four-node cluster with two RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers (4) Node - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 79
for a redundant FC-AL in a four-node cluster with three RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 FC-AL Switch/Storage Hub #1 FC-AL Switch/Storage Hub #2 RA4000/4100 Array #1 RA4000/4100 Array #2 Active - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 80
2000 Administrator Guide Active/Standby Configuration with Four RA4000/RA4100 Arrays Figure 2-23 shows an active/standby I/O path configuration for a redundant FC-AL in a four-node cluster with four RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 81
for a redundant FC-AL in a four-node cluster with five RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 FC-AL Switch/Storage Hub #1 FC-AL Switch/Storage Hub #2 RA4000/4100 Array #1 Active Array Controller - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 82
2-58 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Active Configuration Examples for Redundant FC-ALs This section describes examples of active/active configurations when two, three, four, and five RA4000/RA4100 Arrays - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 83
Cluster Architecture 2-59 I The even-numbered Storage Hub or FC-AL Switch (Storage Hub/FC-AL Switch #2) is connected to the active array controller in each even-numbered RA4000/RA4100 Array (2 and 4). I The even-numbered Storage Hub or FC-AL Switch is connected to the standby array controller in - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 84
and Windows 2000 Administrator Guide Active/Active Configuration with Two RA4000/RA4100 Arrays Figure 2-25 shows an active/active I/O path configuration for a redundant FC-AL in a four-node cluster with two RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 Node - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 85
an active/active I/O path configuration for a redundant FC-AL in a four-node cluster with three RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 FC-AL Switch/Storage Hub #1 FC-AL Switch/Storage Hub #2 RA4000/4100 Array #1 RA4000/4100 Array - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 86
and Windows 2000 Administrator Guide Active/Active Configuration with Four RA4000/RA4100 Arrays Figure 2-27 shows an active/active I/O path configuration for a redundant FC-AL in a four-node cluster with four RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 Node - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 87
shows an active/active I/O path configuration for a redundant FC-AL in a four-node cluster with five RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 FC-AL Switch/Storage Hub #1 FC-AL Switch/Storage Hub #2 RA4000/4100 Array #1 RA4000/4100 Array - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 88
2-64 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Summary of I/O Path Failure and Failover Scenarios for Redundant FC-ALs Table 2-7 identifies possible I/O path failure events in redundant FC-ALs for active/standby configurations - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 89
Cluster Architecture 2-65 Table 2-7 I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Standby Configurations With One RA4000/RA4100 Array continued Description of Failure Failover Response The Fibre Channel cable None connection between a Fibre Host Adapter and the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 90
2-66 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-8 identifies possible I/O path failure events for active/standby configurations with two or more RA4000/RA4100 Arrays and the failover response, if any, implemented by - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 91
Cluster Architecture 2-67 Table 2-8 I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Standby Configurations With Two or More RA4000/RA4100 Arrays continued Description of Failure Failover Response The Fibre Channel cable connection between the Storage Hub or FC-AL Switch - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 92
2-68 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-9 identifies possible I/O path failure events in redundant FC-ALs for active/active configurations with two or more RA4000/RA4100 Arrays and the failover response, - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 93
Cluster Architecture 2-69 Table 2-9 I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Active Configurations With Two or More RA4000/RA4100 Arrays continued Description of Failure Failover Response A Storage Hub or FC-AL Switch fails. Secure Path makes each active array - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 94
area network (SAN), and private network. Throughout this guide, the term cluster interconnect is used. A PDC/O2000 cluster running Oracle8i Parallel Server the technical white paper Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server (ECG062/0299) for - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 95
switches or hubs G For two-node PDC/O2000 clusters, you can use two 100-Mbit/second Ethernet switches or hubs with cables to connect the servers. G For PDC/O2000 clusters with three or more nodes, you use two 100-Mbit/second Ethernet switches connected by Ethernet cables to a separate Ethernet - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 96
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server to the client network (LAN) or to servers that are not part of the PDC/O2000 cluster. When an Ethernet - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 97
Cluster Architecture 2-73 Ethernet Cluster Interconnect Diagrams Figure 2-29 shows the non-redundant Ethernet cluster interconnect components used in a two-node PDC/O2000 cluster. These components include a dual-port Ethernet adapter in each node. The top port on each adapter connects by Ethernet - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 98
2-74 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Figure 2-30 shows another a crossover cable makes it easier to upgrade the cluster interconnect if more servers are added to the cluster. IMPORTANT: Crossover cables and Ethernet hubs cannot - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 99
Cluster Architecture 2-75 Figure 2-31 shows the redundant Ethernet cluster interconnect components used in a two-node PDC/O2000 cluster. Ethernet Switch/Hub #2 for Cluster Interconnect Dual-port Ethernet Adapters (2) Ethernet Switch/Hub #1 for Cluster Interconnect Crossover Cable Dual-port - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 100
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Local Area server application requires a local area network, or LAN, over which client machines and servers auto-reconnect in an Oracle8i Parallel Server environment, contact your Oracle representative. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 101
Cluster Model PDC/O2000 Certification Matrix for Windows 2000 at www.compaq.com/solutions/enterprise/ha-pdc.html Microsoft Windows 2000 Advanced Server This version of the PDC/O2000 supports only Microsoft Windows 2000 Advanced Server with Service Pack 1 or later. NOTE: The PDC/O2000 does not work - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 102
take advantage of specific capabilities offered on Compaq products. These drivers are provided for use with Compaq hardware only. The PDC/O2000 requires version 4.9 or later of the SmartStart and Support Software CD. For information about SmartStart, refer to the Compaq Server Setup and Management - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 103
. For information about the Array Configuration Utility, see the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Fibre Channel Fault Isolation Utility The SmartStart and Support Software CD also contains the Fibre Channel Fault Isolation Utility - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 104
Insight Manager. This log is used with the Compaq Integrated Management Display (IMD), the optional Remote Insight controller, and SmartStart. In Compaq servers, each hardware subsystem, such as non-shared disk storage, system memory, and system processor, has a robust set of management capabilities - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 105
to manage multiple path StorageWorks RAID array configurations. Secure Path and informs Oracle8i Parallel Server. Oracle8i Parallel Server recovers the part of the database affected Server, refer to the Oracle8i Parallel Server Setup and Configuration Guide. The OSD software is found on the Compaq - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 106
Guide Oracle Software The PDC/O2000 supports Oracle8i software. If you are using a release other than Oracle8i Release 8.1.7, confirm that the release has been certified for the PDC/O2000 on the Compaq website at www.compaq.com/solutions/enterprise/ha-pdc.html Oracle8i Server Enterprise - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 107
who choose to deliver platforms for use with Oracle8i Parallel Server must demonstrate the successful completion of the Oracle8i Parallel Server for Windows 2000 Certification. Neither Oracle nor Compaq will support any implementation of Oracle8i Parallel Server that does not strictly conform to the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 108
3-8 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Application Failover and Reconnection Software When a network client computer operates in a clustered environment, it must be more resilient than when operating with a stand-alone server. Because a - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 109
Before connecting any cables or powering on any hardware on your Compaq Parallel Database Cluster Model PDC/O2000 (referred to here as the Fabrics I Planning cluster configurations for redundant Fibre Channel Arbitrated Loops I RAID planning I Planning the grouping of physical disk storage space I - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 110
4-2 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Site Planning You must carefully select to the installation area I Availability of appropriate equipment and qualified personnel I Space for unpacking, installing, and servicing the computer - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 111
computer hardware is needed to support the applications and data on your clustered servers. Given the size of your database and the performance you expect, you must decide how many servers and shared storage arrays the cluster needs. Compaq ProLiant Servers The number of servers you install in a PDC - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 112
Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I One or more Compaq StorageWorks RAID Array 4000s (RA4000 Arrays) or Compaq StorageWorks RAID Array 4100s (RA4100 Arrays) I Two single-port Compaq StorageWorks RAID Array 4000 Controllers (RA4000 Array Controllers) installed in each - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 113
Fibre Host Adapters in each node I Two or more Compaq StorageWorks Storage Hubs (Storage Hubs) or Compaq StorageWorks FC-AL Switches (FC-AL Switches) I One or amount of shared storage space required by the database, the hardware RAID levels used on the shared storage disks, and the number and storage - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 114
technical white paper Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server for detailed . Planning the Client LAN Every client/server application requires a local area network (LAN) over which client machines and servers communicate. In the case of a - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 115
investigated your requirements with respect to particular parts of the cluster (ProLiant servers, shared storage components, cluster interconnect : Use the Oracle documentation identified in the front matter of this guide to obtain detailed information about planning for the Oracle software. Once - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 116
4-8 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The small redundant Fibre Channel Fabric cluster configuration shown in Figure 4-1 contains these key cluster components: I Two ProLiant servers (nodes) I Two Fibre Host Adapters in each server I - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 117
Cluster Planning 4-9 Sample Large Configuration in a Redundant Fibre Channel Fabric Figure 4-2 shows an example of a larger PDC/O2000 cluster: a six-node cluster with five RA4000/RA4100 Arrays in one redundant Fibre Channel Fabric. Fibre Host Adapters (2) Node 5 Node 6 Node 1 Node 2 Node 3 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 118
4-10 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The larger redundant Fibre Channel Fabric configuration shown in Figure 4-2 contains these key cluster components: I Six ProLiant servers (nodes) I Two Fibre Host Adapters in each server node I - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 119
investigated your requirements with respect to particular parts of the cluster (ProLiant servers, shared storage components, cluster interconnect : Use the Oracle documentation identified in the front matter of this guide to obtain detailed information about planning for the Oracle software. Once - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 120
4-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The small redundant FC-AL configuration shown in Figure 4-3 contains these key cluster components: I Two ProLiant servers (nodes) I Two Fibre Host Adapters in each server I Two Storage Hubs or FC- - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 121
Cluster Planning 4-13 Sample Large Configuration in a Redundant FC-AL Figure 4-4 shows an example of a larger PDC/O2000 cluster: a six-node cluster with five RA4000/RA4100 Arrays in one redundant FC-AL. Fibre Host Adapters (2) Node 5 Node 6 Node 1 Node 2 Node 3 Node 4 FC-AL Switch/Storage - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 122
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The larger redundant FC-AL configuration shown in Figure 4-4 contains these key cluster components: I Six ProLiant servers (nodes) I Two Fibre Host Adapters in each server to users. RAID also uses the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 123
ProLiant server model you will be using. Refer to the server documentation RAID. When you implement RAID on shared storage arrays, you use the hardware RAID to perform such functions as making copies of the data or calculating checksums. Use the Compaq Array Configuration Utility to implement RAID - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 124
about RAID configuration contained in the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. I Refer to the Compaq white paper Configuring Compaq RAID Technology for Database Servers, #ECG 011/0598, available at the Compaq website at www.compaq.com - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 125
Consult with your Oracle representative for further details. Selecting the Appropriate RAID Levels Many factors affect which RAID levels you select for your cluster database. These include the specific availability, performance, reliability, and recovery capabilities required from the database. Each - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 126
4-18 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The following general guidelines apply to RAID selection for a cluster with RA4000/RA4100 Arrays using Oracle8i Parallel Server: I Oracle recommends that some form of disk fault tolerance be - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 127
User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Use Disk Management to define one extended partition per RAID logical drive. Also using Disk Management, divide the extended partitions into logical partitions, each having its own drive letter. (Windows 2000 Advanced Server logical - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 128
to each node in the PDC/O2000. If a logical drive is configured with a RAID level that does not support fault tolerance (for example, RAID 0), then the failure of the shared disk drives in that logical drive will disrupt service to all Oracle databases that are dependent on that disk drive. See - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 129
Cluster Planning 4-21 Client LAN Physically, the structure of the client network is no different than that used for a nonclustered configuration. To ensure continued access to the database when a cluster node is evicted from the cluster, each network client should have physical network access to all - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 130
clustered Compaq ProLiant servers I Installation posters for the clustered ProLiant servers I Installation guides for the cluster interconnect and client LAN interconnect adapters I Compaq StorageWorks RAID Array 4000 User Guide I Compaq StorageWorks RAID Array 4100 User Guide I Compaq StorageWorks - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 131
Guide I Compaq StorageWorks Fibre Channel SAN Switch Management Guide I Compaq SmartStart Installation poster I Compaq SmartStart and Support Software CD I Microsoft Windows 2000 Advanced Server Administrator's Guide I Microsoft Windows 2000 Advanced Server CD with Service Pack 1 or later I Compaq - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 132
and configuring operating system software, including: G SmartStart 4.9 or later G Windows 2000 Advanced Server with Service Pack 1 or later I Installing and configuring Secure Path for Windows 2000, including: G Installing the Secure Path Server software G Installing the Secure Path Client software - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 133
identical, for example, the ProLiant server model, cluster interconnect adapters, amount of memory, cache, and number server and into the same two PCI slots in each server. If you need specific instructions, see the Compaq StorageWorks Fibre Channel Host Bus Adapter Installation Guide or the Compaq - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 134
cables, connect Fibre Host Adapter #2 in each server to Storage Hub/Switch #2. IMPORTANT: When connecting a Fibre Channel Host Adapter to a Storage Hub or Fibre Channel SAN Switch, do not mount the Fibre Channel cables on cable management arms. Support the Fibre Channel cable so that a bend radius - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 135
Hub 7 Installation Guide and the Compaq StorageWorks Storage Hub 12 Installation Guide. Installing the Cluster Interconnect Adapters A PDC/O2000 running Oracle8i software uses an Ethernet cluster interconnect. Both redundant and non-redundant cluster interconnects are supported. However, a redundant - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 136
Matrix for Windows 2000 at www.compaq.com/solutions/enterprise/ha-pdc.html If you need specific instructions on how to install an Ethernet adapter, refer to the documentation of the Ethernet adapter you are installing or refer to the user guide of the ProLiant server you are using. Refer to the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 137
servers SmartStart installation, review the instructions in the "Installing the Operating System Software and Configuring the RA4000/RA4100 Arrays" section of this chapter. These instructions include clustering information that is not included in the Compaq StorageWorks RAID Array 4000 User Guide - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 138
the drives using the Array Configuration Utility, see the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. For information about configuring your shared storage subsystem with RAID, see Chapter 4, "Cluster Planning." Installing GBIC-SW Modules for - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 139
5-10 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide In an active/active configuration, and Storage Hub/Switch #2 connects to standby RA4000 Array Controllers. The cabling instructions are the same for any number of RA4000/RA4100 Arrays. NOTE: When - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 140
Installation and Configuration 5-11 Figure 5-3 shows two Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches connected to the RA4000 Array Controllers in two RA4000/RA4100 Arrays. Storage Hub/Switch #1 Storage Hub/Switch #2 Active RA4000/4100 Standby RA4000/4100 Array Controller Array - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 141
5-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 5-1 summarizes the active/active cabling methods. Select the method that is best for your site. Method 1 2 Table 5-1 Active/Active Cabling Methods Active Array Controller - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 142
Installation and Configuration 5-13 Figure 5-4 shows an example of using method 1 cabling to connect two Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches to RA4000 Array Controllers in two RA4000/RA4100 Arrays. Storage Hub/Switch #1 Storage Hub/Switch #2 Active RA4000/4100 Standby - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 143
5-14 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Figure 5-5 shows an example of using two RA4000/RA4100 Arrays NOTE: When defining the active array controllers as instructed later in this chapter, for method 1 cabling make the top array - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 144
Channel Fabric, including: I Two or more Fibre Host Adapters in each server I Two or more Fibre Channel SAN Switches I Fibre Channel cables connecting redundant FC-AL, including: I Two or more Fibre Host Adapters in each server I Two or more Storage Hubs or FC-AL Switches I Fibre Channel cables - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 145
5-16 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Cabling the Ethernet Cluster can use two 100-Mbit/sec Ethernet switches or hubs with cables to connect the servers. G For PDC/O2000 clusters with three or more nodes, you use two 100-Mbit - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 146
Installation and Configuration 5-17 Figure 5-6 shows the non-redundant Ethernet cluster interconnect components used in a two-node PDC/O2000 cluster. These components include a dual-port Ethernet adapter in each node. The top port on each adapter connects by Ethernet crossover cable to the top port - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 147
5-18 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide To connect two or more nodes in a non-redundant Ethernet cluster interconnect: 1. Install a standard Ethernet cable between an Ethernet adapter in one node and one - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 148
configuring Ethernet connections in a redundant or non-redundant cluster interconnect, including enabling failover from one Ethernet path to another, see Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server at www.compaq.com/support/techpubs/whitepapers - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 149
is not supported. For information on configuring Ethernet connections in a redundant client LAN, including enabling failover from one Ethernet path to another, see Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server at www.compaq.com/support/techpubs - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 150
on each server. I Be sure your servers, adapters, hubs, and switches are installed and cabled before you install the software. I Power on the cluster as instructed later in this chapter in "Power Distribution and Power Sequencing Guidelines." I SmartStart runs the Compaq Array Configuration - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 151
the following during SmartStart installation: I SmartStart and Support Software CD 4.9 or later I Microsoft Windows 2000 Advanced Server with Service Pack 1 or later I SmartStart Installation poster I Server Profile diskette Cluster-Specific SmartStart Installation The SmartStart Installation poster - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 152
Switches G Ethernet hubs or switches 2. Power up a cluster node and put the SmartStart and Support Software CD into the CD-ROM drive. 3. Select the Assisted Integration installation path. 4. When prompted, insert the Server Profile diskette into the floppy disk drive. 5. Select Windows 2000 Advanced - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 153
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 9. Enter unique IP addresses and node names for each node in the hosts and lmhosts files located at %SystemRoot%\system32\drivers 2000 Advanced Server assigned to and you are using Service Pack 1 or - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 154
information later when installing Compaq OSDs. 12. If you are installing node1, open Windows 2000 Advanced Server Disk Management to create For more information on creating partitions, see the Oracle8i Parallel Server Setup and Configuration Guide. 13. If you are installing a node other than node1 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 155
and Windows 2000 Administrator Guide Installing Secure Path Software for Windows 2000 The Secure Path software for Windows 2000 is installed on both the server and the client. The Secure Path server software is installed on the Windows host system to which the RAID storage system is connected - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 156
software: 1. Insert the Compaq SANWorks Secure Path Software CD into your CD-ROM drive. 2. If you have AutoRun enabled on your server, the Secure Path setup software, refer to the document Secure Path for Windows 2000 on RAID Array 4000/4100. Verifying Shared Disk Storage Using Secure Path Manager - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 157
5-28 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 3. If you double-click "Storage System X", you should get two more branches that represent the two RA4000 Array Controllers in that array. These controllers are - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 158
Installation and Configuration 5-29 Table 5-2 Active Array Controller Locations Configuration Active/Standby Active/Active: Cabling Method 1 Active/Active: Cabling Method 2 Active Array Controller Location Top array controller slot Top array controller slot Top array controller slot in odd- - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 159
5-30 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 1. On any cluster node, click Start the Compaq operating system dependent modules (OSDs) for Oracle8i Parallel Server. Compaq supplies a software package with the OUI that installs Compaq OSDs for - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 160
provided that: I The servers are communicating through a local area network using a TCP the option to install Oracle8i Parallel Server. The Compaq operating system dependent modules (OSDs) to each cluster node while you were using SmartStart to install the operating system software. If drivers\etc. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 161
5-32 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide For example, the command ping node1 should privileges are required for most installation tasks, such as installing device drivers and changing registry entries. To install the OSDs, you must have - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 162
domains, create a local user on each server with the same Windows Server user name and password on each node. Then make that local user a member of the local Administrators group on each node before installing the OSDs. 2. Insert the Compaq Parallel Database Cluster Clustering Software for Oracle8i - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 163
5-34 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 3. If autorun is enabled, the Oracle Universal Installer Welcome screen appears. If autorun is disabled, enter d:\setup at a C: prompt. Substitute the letter assigned to the CD drive for d. The - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 164
Installation and Configuration 5-35 4. Click Next to continue. The License screen appears. 5. Click Accept to accept the terms of the license agreement. The File Locations screen appears. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 165
5-36 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 6. Click Next to continue. The Installation Types screen appears. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 166
Installation and Configuration 5-37 7. Select Typical to install the Ethernet OSDs into the default location, C:\Compaq\OPS. Skip to step 12. 8. Select Custom to install the Ethernet OSDs into a location of your choice. The Component Locations screen appears. 9. If you want - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 167
5-38 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 11. If you want to specify an alternate location but do not know the exact directory path, click Change Location. The Choose Directory screen appears. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 168
Installation and Configuration 5-39 12. Browse to the location where you want to install the OSDs. Click OK. The Component Locations screen appears indicating the alternate location you specified. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 169
5-40 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 13. Click Next to continue. The Cluster Members screen appears. 14. The Cluster Members screen indicates the host name of the installing machine. Define the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 170
Installation and Configuration 5-41 15. Click Next to continue. The Cluster Members screen reappears. 16. The Cluster Members screen now shows the node names you specified on the first Cluster Members screen with "_san" appended to each name, indicating it as a cluster interconnect node name. If - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 171
5-42 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 17. Click Next to continue. The OSD Summary screen appears. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 172
Installation and Configuration 5-43 18. If the information on the OSD Summary screen is not correct, click Previous to modify the previous screens. When the information is correct, click Next to continue. The Summary screen appears. 19. Click Install to install the components listed in the summary. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 173
on all nodes in the cluster. This service must be started before installing Oracle software. See the Oracle documentation for information on starting the cluster manager. Installing Oracle Software Using the Oracle8i Parallel Server Setup and Configuration Guide, follow the steps to install Oracle8i - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 174
does not offer the option to install Oracle8i Parallel Server, it could mean that the OSDs did not install successfully or that the OracleCMService is not running. After installing Oracle software, the Oracle8i documentation instructs you to install vendor-supplied operating system dependent modules - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 175
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide which disk drives are brought online changes, Oracle8i Server can find the correct data files and can For instructions on installing and using Object Link Manager, see the readme file on the Compaq - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 176
SystemRoot%\system32\drivers\etc. service did not start successfully, make sure that the OracleCMService is started and the SID is in the Oracle registry. There are two logs that can provide information about why the Oracle service did not start. These logs are: I \Compaq\OPS\cmsrvr.log I \Compaq - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 177
Guide Other Verification Tasks Perform these other verification tasks: I Verify that Object Link Manager has been installed and is running. I Verify that the OPS_CMDISK symbolic link has actually been set. To verify the Object Link Manager has been installed and is running, select the Services Compaq - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 178
(with respect to connecting them to PDUs and UPSs) can be configured similarly to the example shown for server power distribution. By substituting RA4000/RA4100 Arrays for ProLiant servers in Figure 5-9, you can provide two redundant paths from the RA4000/RA4100 Arrays to building power. If each - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 179
Guide Power Sequencing Be sure to power up the cluster components in the following order: 1. RA4000/RA4100 Arrays 2. Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches (Power is applied to Storage Hub when the AC power cord is plugged in.) 3. Ethernet hubs or switches 4. ProLiant servers - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 180
ongoing activities. This chapter describes these management activities for the Compaq Parallel Database Cluster Model PDC/O2000 (referred to here as this chapter contain high-level instructions. The instructions summarize what has either already been discussed in this guide, Oracle documentation, or - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 181
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Cluster Management Concepts Powering Off a Node Without Interrupting Cluster Services node. 3. Shut down the server. The node can now be helpful to follow this troubleshooting process: 1. Determine - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 182
to repair the problem. G If the problem is not considered to be critical, wait until a non-peak time to service the problem. G If the problem is critical be viewed either within the System log or within specific error log files. The Oracle8i Server events are sent to the Application log and can be - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 183
and interconnect adapters I Forwards server alert fault conditions I Remotely controls servers In Compaq servers, each hardware subsystem, such as network adapters, system processors, and system memory, has a robust set of management capabilities. Compaq Full Spectrum Fault Management notifies - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 184
ACU is available on the SmartStart and Support Software CD, which is found in the Compaq Server Setup and Management pack. For additional information about the ACU, see the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Disk Management is first - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 185
2000 Administrator Guide Compaq Secure Path Compaq StorageWorks Storage Hubs (Storage Hubs) or Compaq StorageWorks FC-AL Switches (FC-AL Switches) I At least two Fibre Host Adapters installed in each server . FFIU is on the SmartStart and Support Software CD. Compaq Secure Path software can detect - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 186
Guide I Oracle8i Parallel Server Concepts I Oracle8i Parallel Server Administration, Deployment, and Performance Oracle8i Enterprise Manager and its corresponding documentation are shipped as part of Oracle8i Enterprise Edition. Remotely Managing a Cluster Oracle8i Enterprise Manager, Compaq - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 187
for Oracle8i and Windows 2000 Administrator Guide Before installing Compaq Insight Manager, Compaq Insight Manager XE, or Oracle8i Enterprise Be sure to shut down the Oracle instance on all nodes and stop the Oracle services running on all nodes prior to removing the OSDs. To deinstall the OSDs: - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 188
Cluster Management 6-9 4. If autorun is disabled, enter d:\setup at a C: prompt. Substitute the letter assigned to the CD-ROM drive for d. The Oracle Universal Installer Welcome screen appears. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 189
and Windows 2000 Administrator Guide 5. Click Deinstall Products. Next, a window containing an inventory of the installed components appears. The following shows the Inventory screen that is displayed when Ethernet is used for the cluster interconnect. 6. Select Compaq Ethernet OSDs and click - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 190
likely affect the operation of the cluster. Before upgrading to any new release of Oracle8i Server, consult your Compaq and Oracle service representatives. Make sure that the new release is certified and supported on the PDC/O2000, and get assistance to determine which procedure you should follow to - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 191
6-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Upgrading the Ethernet OSDs To upgrade The Inventory screen displays a list of installed components. 3. Select Compaq Ethernet OSDs and click Remove. The Oracle Universal Installer removes all - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 192
installation (by removing it) before you can successfully run the Oracle Universal Installer again. To remove a partial OSD installation: 1. Insert the Compaq Parallel Database Cluster Clustering Software for Oracle8i on Microsoft Windows 2000 CD into the CD-ROM drive of a cluster node. 2. From - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 193
of Oracle8i Server, consult your Compaq and Oracle service representatives. Make sure that the new release is certified and supported on the PDC the information in the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide that describes the conditions - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 194
, run the Array Configuration Utility to create drive arrays, configured with RAID, and then create logical drives. 3. Using Disk Management, create an the database. Refer to the Oracle8i Parallel Server Setup and Configuration Guide for more detailed instructions. Adding an RA4000/RA4100 Array You - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 195
arrays, configured with RAID, and then Guide for more detailed instructions. Replacing a Failed Fibre Host Adapter To replace a failed Fibre Host Adapter in a cluster node: 1. Shut down the Oracle instance on the node. 2. Shut down the Oracle services running on the node. 3. Shut down the server - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 196
. 9. Restart the Oracle services on the node. 10. Start up the Oracle instance on the node. Replacing a Cluster Node Before replacing a node, verify that the new configuration is supported by the PDC/O2000. To determine if your new server is supported, see the Compaq Parallel Database Cluster Model - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 197
the server for the replacement node to the cluster interconnect components and the client LAN. Power on the replacement node. Although physically connected to the cluster, the node is not yet integrated into the cluster. 2. Start the replacement node with the Compaq SmartStart and Support Software - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 198
Cluster Management 6-19 5. Install and configure Windows 2000 Advanced Server with Service Pack 1 or later (whichever is installed on the other cluster nodes). 6. Install necessary Compaq drivers and utilities from the Compaq SmartStart and Support Software CD. 7. Install Fibre Host Adapters in the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 199
and Configuration." 6. Install Oracle8i Server with the Oracle8i Parallel Server Option on the replacement node. 7. Restart the replacement node which, upon restart, is now fully integrated into the cluster. 8. At this point, all further operations are specific to Oracle configuration. Refer to - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 200
Node Before adding a node, verify the new configuration is supported by the PDC/O2000. To determine if your new server is supported, see the Compaq Parallel Database Cluster Model PDC/O2000 Certification Matrix for Windows 2000 at www.compaq.com/solutions/enterprise/ha-pdc.html IMPORTANT: With some - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 201
disks with RAID. 5. Install and configure Windows 2000 Advanced Server with Service Pack 1 or later (whichever is installed on the other cluster nodes). 6. Install all necessary Compaq drivers and utilities from the Compaq SmartStart and Support Software CD, including the drivers for the Fibre - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 202
files of each existing cluster node. These files are located at %SystemRoot%\system32\drivers\etc. 2. Verify TCP/IP connectivity between the new node and the existing application-level cluster software, including Oracle8i Server with the Oracle8i Parallel Server Option. The cluster must be brought - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 203
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide down the Oracle instance. b. Stop all Oracle services. c. Deinstall the OSDs by running the OUI on See the Oracle8i Parallel Server Setup and Configuration Guide for details on installing - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 204
memory, processor, hard drive performance, network software, and application software. I Oracle8i Performance Manager captures, computes, and presents performance data about the Oracle database. Specific data about Oracle8i Parallel Server Redundant hardware, advanced RAID technology, and automated - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 205
6-26 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Secure Path Manager is the effect until you stop and restart the Secure Path Agent Service. From Administrative Tools, open the Services screen, select "Secure Path Agent," and restart it by - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 206
when you have Load Distribution enabled and you want to disable I/O operations to one or more I/O paths. I Make path after the problem has been corrected. Refer to the Compaq documentation provided with , failover events are logged by the RaiDisk driver in the Event Viewer. You should routinely - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 207
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Note that Secure Path Manager client is not required to be running in order for Secure Path to protect path availability. The RaiDisk device driver Securepath Server for Windows 2000 on RAID Array 4000 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 208
chapter addresses potential problems you might encounter as you install, configure, test, and operate your Compaq Parallel Database Cluster Model PDC/O2000 (referred to here as the PDC/O2000). This chapter is organized as follows: I Basic troubleshooting tips I Troubleshooting Oracle8i and operating - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 209
Guide Basic Troubleshooting Tips Power Verify that the following are all powered on: I Cluster nodes I StorageWorks RAID Array 4000s (RA4000 Arrays) or StorageWorks RAID Array 4100s (RA4100 Arrays) I Compaq plugged in.) I Ethernet switches/hubs I ProLiant servers NOTE: The Storage Hub and some - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 210
Troubleshooting 7-3 Server Option Release 8.1.7 I RA4000 Array Controller drivers I Compaq Insight Manager I Compaq Array Configuration Utility I Compaq Secure Path for Windows 2000 I Compaq Ethernet OSDs I Cluster interconnect drivers I Microsoft Windows 2000 Advanced Server, including Service - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 211
of the following cluster components: I The system ROM on each ProLiant server I Firmware for the RA4000 Array Controllers For information about currently supported firmware revisions for the PDC/O2000, refer to the Compaq Parallel Database Cluster Model PDC/O2000 Certification Matrix for Windows - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 212
Troubleshooting 7-5 Troubleshooting Oracle8i and OSD Installation Problems and Error Messages Potential Difficulties will likely result in an incomplete installation. If difficulties persist, contact your support representative for assistance. I The OUI uses the network connections to transfer files - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 213
7-6 Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide I Determine whether or not Manager Service, OracleNMService, is running. If not, see the error logs in C:\compaq\ops\nm.log. If OracleNMService is running, check the CM Server logs in C:\compaq\ops - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 214
scan the list of services and confirm that the OracleService is started. I Verify that the database links are properly set up on all nodes and that correct entries exist for all datafiles, including OPS_CMDISK. Refer to the Oracle8i Parallel Server Setup and Configuration Guide for further details. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 215
7-8 Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide Initialization of the the service and restart it. Troubleshooting Node-to-Node Connectivity Problems Nodes Are Unable to Communicate with Each Other I Check the Windows 2000 Advanced Server event - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 216
Troubleshooting 7-9 Unable to Ping the Cluster Interconnect or the Client LAN If you to the redundant switch. I Make sure that the Ethernet drivers are properly installed and configured on the cluster nodes. Verify the Ethernet drivers for the interconnect adapters are the same revision level on all - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 217
7-10 Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide I Make sure the OracleCMService and all other Oracle services have started without error. From the Services screen, scan the list of services and check to see if the Oracle services have started. - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 218
/RA4100 Array problems that are specific to the product itself or to the use of the RA4000/RA4100 Array in a stand-alone server configuration. For those issues, refer to the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Verifying Connectivity - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 219
Fibre Channel Host Adapter Installation Guide or the Compaq StorageWorks 64-bit/66-MHz Fibre Channel Host Adapter Installation Guide for installation instructions. I Determine whether or not hardware errors or communications transport failures are causing the problem. Use the Event Viewer to - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 220
offline (degraded or failed). The online utility is installed as part of the Compaq SmartStart and Support Software CD. G If all drives are not recognized by the Array Configuration Utility, it is probably a physical connection problem. G Verify that the indicator lights on the Fibre Host Adapters - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 221
and Resolving Shared Disk Problems." Troubleshooting Secure Path For detailed information about troubleshooting Secure Path software, refer to the troubleshooting documentation provided with Secure Path. Secure Path Guidelines for Windows 2000 Advanced Server The following rules and guidelines - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 222
Troubleshooting 7-15 I The same Secure Path Manager password must be used for all of the hosts in a profile. I Before you change the Secure Path Agent's list of authorized clients or passwords, you must first manually process (SecurePathAgent) from the Services screen. Examples of physical changes - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 223
Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide manual refresh, press the F5 key. The Addition of New LUNs Causes an Error In a PDC/O2000 cluster running Windows 2000 Advanced Server the following: 1. From the Services screen, right click on Secure - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 224
) cannot properly join the cluster, you need to consider two possible causes: I A problem related to the shared disk storage in the cluster's Compaq StorageWorks RAID Array 4000s (RA4000 Arrays) or Compaq StorageWorks RAID Array 4100s (RA4100 Arrays) is preventing one or more nodes from accurately - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 225
Perform Cluster Hardware Checks OK Problem Persists Contact Your Compaq Support Representative Exit. Problem Fixed or No Further Disk Problems Rerun and Validate Object Link OK Manager On All Affected Nodes Problem Persists Exit. Problem Fixed or No Further Disk Problems Figure A-1. Tasks for - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 226
Shared Disk Problems A-3 order in which disk drives are brought online changes, Oracle8i Server can find the correct data files and can properly start the Affected Nodes in the Cluster" in this appendix for further instructions. For instructions on installing and using Object Link Manager, see the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 227
A-4 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Restart All Affected Nodes Manager service is properly installed on the node. For instructions on installing and using Object Link Manager, refer to this readme file contained on the Compaq Parallel - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 228
Shared Disk Problems A-5 Run for Secure Path Manager is correct. Refer to the Compaq Parallel Database Cluster Model PDC/O2000 Certification Matrix for Windows Windows 2000" in Chapter 5, "Installation and Configuration," for installation instructions. 4. Repeat steps 1 through 3 for all nodes in the - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 229
Compaq SmartStart and Support Software CD to perform these checks on the cluster software and firmware: 1. Verify that all necessary drivers have been installed. For example, verify that the Compaq StorageWorks Fibre Channel Host Adapter (Fibre Host Adapter) driver for Windows 2000 Advanced Server - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 230
problems exist. Check the event log for disk I/O error messages or indications of problems with the communications transport. 2. Determine whether or not the Compaq servers support to the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. 7. Verify - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 231
Guide Contact Your Compaq Support Representative If you are unable to resolve the problem, contact your Compaq support representative for assistance. In North America, call the Compaq Technical Support Phone Center at 1-800-OK-COMPAQ. Outside North America, call the nearest Compaq Technical Support - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 232
100 percent being the best possible rating. A local area network dedicated to servicing requests between network client machines and between the cluster of software and hardware technologies that enables a set of loosely coupled servers and storage to present a single system image to clients and to - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 233
at least two paths from each node to each RA4000/RA4100 Array. A storage area network (SAN) topology that uses Fibre Channel SAN Switches to connect cluster nodes the cluster heartbeat. The Compaq Parallel Database Cluster interconnect is dedicated to servicing requests only between cluster nodes - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 234
parallel database support. An additional license is required for Oracle8i Parallel Server. An RAID is categorized into several levels. The continuous integrity of a system (server, storage, network, or cluster). A software or hardware entity upon which a client/server application or service - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 235
for Oracle8i and Windows 2000 Administrator Guide Scalability Secure Path Service Shared resource Shared storage System UPS The ability of a system (server, storage, network, or cluster) to grow or expand in performance, throughput, or capacity. The Compaq software that provides cluster nodes with - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 236
Index A active/active configurations cabling for Oracle8i 5-11 active/active configurations for redundant FC-ALs definition 2-47 example with five RA4000/RA4100 Arrays 2-63 example with four RA4000/RA4100 Arrays 2-62 example with three RA4000/RA4100 Arrays 2-61 example with two RA4000/RA4100 Arrays - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 237
2 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide active/standby configurations for redundant Fibre for Oracle8i 5-22 availability definition 1-3 features of Compaq ProLiant Servers 2-3 C cabling active/active configuration for Oracle8i 5- - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 238
a node 6-17 shutting down cleanly 6-2 supported servers 2-2 cluster operation, monitoring 6-25 cluster supported RAID levels 4-16 cluster software for Oracle8i Compaq software overview 3-2 Oracle software 3-6 overview 3-1 cluster troubleshooting basic tips 7-2 client to cluster connectivity problems - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 239
for shared disk problems A-6 troubleshooting shared storage with 7-13 using to set up RA4000/RA4100 Arrays for Oracle8i 5-8 Compaq authorized reseller xx Compaq Full Spectrum Fault Management 3-4 Compaq Insight Manager monitoring cluster operation with 6-25 monitoring server and network hardware - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 240
overview Compaq Array Configuration Utility 3-3 Compaq Insight Manager 3-4 Compaq Insight Manager XE 3-4 Compaq operating system dependent modules for Oracle8i 3-5 Compaq Options ROMPaq 3-4 Compaq SmartStart and Support software 3-2 Compaq SmartStart and Support Software CD 3-2 Compaq System - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 241
6 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide E error logs for Oracle8i 6-4 Ethernet adapters planning 4-6 Ethernet client LAN cabling for Oracle8i 5-20 Ethernet cluster interconnect 2-70 adapter installation for Oracle8i 5-7 adapters 2-72 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 242
physical disk storage space 4-18 H hardware installation verification for Oracle8i 5-47 help additional sources xix Compaq authorized resellers, telephone numbers xx Compaq website xx technical support telephone numbers xix hosts files for Ethernet cluster interconnect 4-20 for Oracle8i 5-24, 5-31 - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 243
, using with Compaq Insight Manager 3-4 L lmhosts files for Ethernet cluster interconnect 4-20 for Oracle8i 5-24, 5-31 local area network (LAN) 2-76 log files for Oracle8i 5-47, 6-4 M managing network clients 6-3 Microsoft Windows 2000 Advanced Server overview 3-1 versions supported 3-1 Microsoft - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 244
Server 3-6 Oracle8i Server 3-6 Oracle8i Server Enterprise Edition 3-6 overview 3-6 OracleCMService starting 5-44 troubleshooting 7-6 OracleNMService, troubleshooting 7-7 OSDs See Compaq 4-19 overview 4-1 RAID planning 4-14 raw data storage and database size 4-17 selecting RAID levels 4-17 shared - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 245
49 supported servers 2-2 R RA4000 Array Controllers See Compaq StorageWorks RAID Array 4000 Array Controllers RA4000 Arrays See Compaq StorageWorks RAID Array 4000s RA4000/4100 Arrays adding to a cluster 6-15 RA4000/RA4100 Arrays troubleshooting 7-11 RA4100 Arrays See Compaq StorageWorks RAID Array - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 246
Service Packs for Windows 2000 Advanced Server versions supported 3-1 Service Packs for Windows NT Server supported for Oracle8i 5-22 shared disk problems contacting your Compaq support drives 4-19 site planning 4-2 SmartStart See Compaq SmartStart and Support Software Index 11 software application - Compaq ProLiant 6500 | Compaq Parallel Database Cluster Model PDC/O2000 for Orac - Page 247
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide potential problems 7-1 unable to start database for Oracle8i 7-7 troubleshooting tips accessibility rack stability xix Windows 2000 Advanced Server See Microsoft Windows 2000 AdvancedServer Windows
Parallel Database Cluster Model
PDC/O2000 for Oracle8
i
and
Windows 2000
Administrator Guide
Second Edition (June 2001)
Part Number 225082-002
Compaq Computer Corporation