Compaq ProLiant 6400R Compaq Parallel Database Cluster Model PDC/O2000 for Ora
Compaq ProLiant 6400R Manual
View all Compaq ProLiant 6400R manuals
Add to My Manuals
Save this manual to your list of manuals |
Compaq ProLiant 6400R manual content summary:
- Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 1
Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Second Edition (June 2001) Part Number 225082-002 Compaq Computer Corporation - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 2
of Microsoft Corporation in the United States and other countries. All other product names mentioned herein may be trademarks of their respective companies. Compaq shall not be liable for technical or editorial errors or omissions contained herein. The information in this document is provided "as is - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 3
About This Guide Purpose ...xiii Audience...xiii Scope ...xiv Referenced Manuals xv Supplemental Documents xvi Text Conventions...xvii Symbols in Text...xvii Symbols on Equipment xviii Rack Stability ...xix Getting Help ...xix Compaq Technical Support xix Compaq Website xx Compaq Authorized - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 4
Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide Chapter 2 Cluster Architecture Compaq ProLiant Servers 2-2 High-Availability Features of ProLiant Servers 2-3 Shared Storage Components 2-3 RA4000 Array 2-4 RA4100 Array 2-4 RA4000 Array Controllers - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 5
3-1 Compaq Software ...3-2 Compaq SmartStart and Support Software 3-2 Compaq System Configuration Utility 3-3 Compaq Array Configuration Utility 3-3 Fibre Channel Fault Isolation Utility 3-3 Compaq Insight Manager 3-4 Compaq Insight Manager XE 3-4 Compaq Options ROMPaq 3-4 Compaq StorageWorks - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 6
Guide Cluster Planning continued Planning Cluster Configurations for Redundant Fibre Channel Arbitrated Loops ...4-11 Sample Small Configuration in a Redundant FC-AL 4-11 Sample Large Configuration in a Redundant FC-AL 4-13 RAID Planning...4-14 Supported Advanced Server Hosts Files for an Ethernet - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 7
Contents vii Installing Compaq OSDs 5-30 Verifying Cluster Communications 5-31 Mounting Remote Drives and Cluster Management Cluster Management Concepts 6-2 Powering Off a Node Without Interrupting Cluster Services 6-2 Managing a Cluster in a Degraded Condition 6-2 Managing Network Clients - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 8
viii Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide Cluster Management continued Replacing a Cluster of the Dynamic Link Library NM.DLL Failed 7-8 Troubleshooting Node-to-Node Connectivity Problems 7-8 Nodes Are Unable to Communicate with Each - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 9
Contents ix Troubleshooting continued Troubleshooting Secure Agent From Starting 7-16 Appendix A Diagnosing and Resolving Shared Disk Problems Introduction ...A-1 Run Object Link Manager on All Nodes A-3 Restart All Hardware Checks A-7 Contact Your Compaq Support Representative A-8 Glossary Index - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 10
Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide List of Figures Figure 1-1. Example of a two-node Compaq Parallel Database Model PDC/O2000 cluster 1-2 Figure 2-1. Two-node PDC/O2000 with a two-fabric redundant Fibre Channel Fabric 2-10 Figure 2-2. Two - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 11
interconnect for a two-node PDC/O2000 cluster 5-19 Figure 5-9. Server power distribution in a three-node cluster 5-49 Figure A-1. Tasks for diagnosing and resolving shared storage problems A-2 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 12
xii Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide List of Tables Table 2-1 High-Availability Components of ProLiant Servers 2-3 Table 2-2 Features of Active/Standby and Active/Active Configurations for Redundant Fibre Channel Fabrics 2-17 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 13
configuration, implementation, management, and troubleshooting of the Compaq Parallel Database Cluster Model PDC/O2000 running Oracle8i software on the Microsoft Windows 2000 Advanced Server operating system. Audience The expected audience of this guide consists primarily of MIS professionals whose - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 14
the PDC/O2000. I Chapter 7, "Troubleshooting," contains troubleshooting information for the PDC/O2000. I Appendix A, "Diagnosing and Resolving Shared Disk Problems," describes procedures to diagnose and resolve shared disk problems. I Glossary contains definitions of terms used in this guide. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 15
These related manuals include, but are not limited to: I Documentation related to the ProLiant servers you are clustering (for example, guides, posters, and performance and tuning guides) I Compaq StorageWorks documentation G Compaq StorageWorks RAID Array 4000 User Guide G Compaq StorageWorks RAID - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 16
Manager Configuration Guide G Oracle Enterprise Manager Concepts Guide Supplemental Documents The following technical documents contain important supplemental information for the Compaq Parallel Database Cluster Model PDC/O2000: I Supported Ethernet Interconnects for Compaq Parallel Database - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 17
and GUI selections can appear in uppercase and lowercase letters. File Names, Command Names, Directory Names, Drive Names These elements can instructed to enter information, type the information and then press the Enter key. Symbols in Text These symbols may be found in the text of this guide - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 18
2000 Administrator Guide Symbols on Equipment These icons may be located on equipment in areas where hazardous conditions may exist. Any surface or area of the equipment marked with these symbols indicates the presence of electrical shock hazards. Enclosed area contains no operator serviceable parts - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 19
Help If you have a problem and have exhausted the information in this guide, you can get further information and other help in the following locations. Compaq Technical Support In North America, call the Compaq Technical Phone Support Center at 1-800-OK-COMPAQ. This service is available 24 hours - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 20
/02000 for Oracle8i and Windows 2000 Administrator Guide Compaq Website The Compaq website has information on this product as well as the latest drivers and Flash ROM images. You can access the Compaq website by logging on to the Internet at www.compaq.com Compaq Authorized Reseller For the name of - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 21
software, thereby providing key clustering features at a lower price than proprietary clustering systems. Before examining the features and benefits of the Compaq Parallel Database Cluster Model PDC/O2000 (referred to here as the PDC/O2000), it is helpful to understand the concepts and terminology - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 22
1-2 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Clusters Defined A cluster is releases your cluster kit supports. Figure 1-1 shows an example of a PDC/O2000 that includes two nodes (ProLiantTM servers), two Compaq StorageWorks RAID Array 4000s - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 23
of time the system is unavailable is referred to as downtime. Downtime has several primary causes: hardware faults, software faults, planned service, operator error, and environmental factors. Minimizing downtime is a primary goal of a cluster. Simply defined, availability is the measure of how well - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 24
Guide Compaq Parallel Database Cluster Overview As traditional clustering technology has moved into the open systems of client/server computing, Compaq the industry-leading Oracle8i Parallel Server with award-winning Compaq ProLiant servers and shared storage subsystems. Together, these - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 25
StorageWorks FC-AL Switches (FC-AL Switches) for redundant Fibre Channel Arbitrated Loops G Compaq StorageWorks 64-bit/66 MHz Fibre Channel Host Adapters or Compaq StorageWorks Fibre Channel Host Adapter/Ps (Fibre Host Adapters) installed in each server G Gigabit Interface Converter-Shortwave (GBIC - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 26
Oracle8i and Windows 2000 Administrator Guide I Cluster interconnect components G Ethernet NIC adapters G Ethernet cables G Ethernet switches/hubs The software products include: I Microsoft Windows 2000 Advanced Server with Service Pack 1 or later I Compaq drivers and utilities I Oracle8i Enterprise - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 27
cooling fans, and Error Checking and Correcting (ECC) memory. The high-availability features of ProLiant servers are a critical foundation of Compaq clustering products. Table 2-1 lists the high-availability features found in many ProLiant servers. Table 2-1 High-Availability Components of ProLiant - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 28
PDC/O2000. Each redundant Fibre Channel Fabric or redundant FC-AL supports one or more RA4000 Arrays. Each RA4000 Array contains two single more information about the RA4000 Array, refer to the Compaq StorageWorks RAID Array 4000 User Guide. RA4100 Array The RA4100 Array is another shared storage - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 29
controller slots contains the active array controller. The array controller that is installed in the active slot is automatically assigned active status by Compaq Secure Path, without the need for any further configuration. To determine which of the two array controllers in an RA4000/RA4100 Array is - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 30
-port Fibre Channel SAN Switch are supported. From two to four Fibre Channel manuals provided with each Fibre Channel SAN Switch: I Compaq StorageWorks Fibre Channel SAN Switch 8 Installation and Hardware Guide I Compaq StorageWorks Fibre Channel SAN Switch 16 Installation and Hardware Guide I Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 31
ports. With the addition of the 3-port Expansion Module (PEM), the switch supports 11 ports. For further information, refer to the Compaq StorageWorks Fibre Channel Arbitrated Loop Switch (FC-AL Switch) User Guide. Storage Hubs Storage Hubs can also be installed between cluster nodes and shared - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 32
, you should also consider the likelihood of cluster growth. Refer to the Compaq StorageWorks Fibre Channel Storage Hub 7 Installation Guide and the Compaq StorageWorks Fibre Channel Storage Hub 12 Installation Guide for further information about the Storage Hubs. Fibre Host Adapters Each redundant - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 33
This layered architecture can be implemented using the Fibre Channel Fabric or the Fibre Channel Arbitrated Loop (FC-AL) topology. The PDC/O2000 supports both topologies. A redundant Fibre Channel Fabric is two to four Fibre Channel SAN Switches installed between Fibre Host Adapters in a PDC/O2000 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 34
to the array controllers IMPORTANT: For detailed information about cascading two Fibre Channel SAN Switches, refer to the latest Compaq StorageWorks documentation. This guide does not document cascaded configurations for the Fibre Channel SAN Switch. A redundant Fibre Channel Fabric consists of from - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 35
Cluster Architecture 2-11 Multiple Redundant Fibre Channel Fabrics The PDC/O2000 supports the use of multiple redundant Fibre Channel Fabrics within the same is restricted by the number of Fibre Host Adapters your Compaq servers support. Refer to the Compaq server documentation for this information. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 36
2-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Figure 2-2 shows a two-node PDC/O2000 that contains two redundant Fibre Channel Fabrics. In this example, each redundant Fibre Channel Fabric has its own pair - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 37
Cluster Architecture 2-13 Maximum Distances Between Nodes and Shared Storage Components in a Redundant Fibre Channel Fabric By using standard short-wave Fibre Channel cables with Gigabit Interface Converter-Shortwave (GBIC-SW) modules, the following maximum distances apply: I Each RA4000/RA4100 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 38
2-14 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I/O Data Paths in a Redundant Fibre Channel Fabric A distinct I/O path connection exists between each Fibre Host Adapter in a redundant Fibre Channel Fabric and every array controller - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 39
Cluster Architecture 2-15 Fibre Channel SAN Switch-to-Array Controller Paths Figure 2-5 highlights the I/O data paths that run between the Fibre Channel SAN Switches and the two single-port RA4000 Array Controllers in each RA4000/RA4100 Array. Fibre Host Adapters (2) Fibre Channel SAN Switch #1 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 40
2-16 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide In every redundant Fibre Channel Fabric, at least two Fibre Host Adapters must be installed in each node (one adapter for each Fibre Channel SAN - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 41
Cluster Architecture 2-17 Table 2-2 identifies the features of the active/standby and active/active configurations for redundant Fibre Channel Fabrics. Table 2-2 Features of Active/Standby and Active/Active Configurations for Redundant Fibre Channel Fabrics I/O Path Configuration Active/standby - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 42
2-18 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-2 Features of Active/Standby and Active/Active Configurations for Redundant Fibre Channel Fabrics continued I/O Path Configuration Advantage Disadvantage Active/active with two or - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 43
Cluster Architecture 2-19 I/O Path Configuration Rules for Redundant Fibre Channel Fabrics The following rules must be observed in I/O path configurations for PDC/O2000 clusters with redundant Fibre Channel Fabrics: I Each redundant Fibre Channel Fabric must use either an active/standby or active/ - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 44
2-20 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Standby Configuration Examples for Redundant Fibre Channel Fabrics This section describes examples of active/standby configurations when one, two, three, four, and five RA4000/ - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 45
Cluster Architecture 2-21 I In each RA4000/RA4100 Array, the bottom (rack model) or left rear (tower model) array controller is always the standby controller. I The odd-numbered Fibre Channel SAN Switch (Fibre Channel SAN Switch #1) is connected to the active array controller in each RA4000/RA4100 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 46
2-22 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Standby Configuration with One RA4000/4100 Array Figure 2-6 shows an active/standby I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 47
Cluster Architecture 2-23 Active/Standby Configuration with Two RA4000/4100 Arrays Figure 2-7 shows an active/standby I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with two RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 48
2-24 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Standby Configuration with Three RA4000/RA4100 Arrays Figure 2-8 shows an active/standby I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 49
Cluster Architecture 2-25 Active/Standby Configuration with Four RA4000/RA4100 Arrays Figure 2-9 shows an active/standby I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with four RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 50
2-26 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Standby Configuration with Five RA4000/RA4100 Arrays Figure 2-10 shows an active/standby I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 51
Cluster Architecture 2-27 Active/Active Configuration Examples for Redundant Fibre Channel Fabrics This section describes examples of active/active configurations when two, three, four, and five RA4000/RA4100 Arrays are present in one redundant Fibre Channel Fabric of a four-node PDC/O2000 cluster. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 52
2-28 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I The even-numbered Fibre Channel SAN Switch (Fibre Channel SAN Switch #2) is connected to the active array controller in each even-numbered RA4000/RA4100 Array (2 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 53
Cluster Architecture 2-29 Active/Active Configuration with Two RA4000/RA4100 Arrays Figure 2-11 shows an active/active I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with two RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 54
2-30 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Active Configuration with Three RA4000/RA4100 Arrays Figure 2-12 shows an active/active I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 55
Cluster Architecture 2-31 Active/Active Configuration with Four RA4000/RA4100 Arrays Figure 2-13 shows an active/active I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster with four RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 56
2-32 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Active Configuration with Five RA4000/RA4100 Arrays Figure 2-14 shows an active/active I/O path configuration for a redundant Fibre Channel Fabric in a four-node cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 57
Cluster Architecture 2-33 Summary of I/O Path Failure and Failover Scenarios for Redundant Fibre Channel Fabrics Table 2-3 identifies possible I/O path failure events in redundant Fibre Channel Fabrics for active/standby configurations with one RA4000/RA4100 Array and the failover response, if any, - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 58
2-34 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-3 I/O Path Failure and Failover Scenarios in Redundant Fibre Channel Fabrics for Active/Standby Configurations With One RA4000/RA4100 Array continued Description of Failure Failover - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 59
Cluster Architecture 2-35 Table 2-4 identifies possible I/O path failure events for active/standby configurations in redundant Fibre Channel Fabrics with two or more RA4000/RA4100 Arrays and the failover response, if any, implemented by Secure Path for each failure. Table 2-4 I/O Path Failure and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 60
2-36 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-4 I/O Path Failure and Failover Scenarios in Redundant Fibre Channel Fabrics for Active/Standby Configurations With Two or More RA4000/RA4100 Arrays continued Description of - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 61
Cluster Architecture 2-37 Table 2-5 identifies possible I/O path failure events in redundant Fibre Channel Fabrics for active/active configurations with two or more RA4000/RA4100 Arrays and the failover response, if any, implemented by Secure Path for each failure. Table 2-5 I/O Path Failure and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 62
2-38 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-5 I/O Path Failure and Failover Scenarios in Redundant Fibre Channel Fabrics for Active/Active Configurations With Two or More RA4000/RA4100 Arrays continued Description of - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 63
ports. The more devices used, the less bandwidth that is available for each port. When FC-AL Switches are used, the FC-AL SAN supports multiple 100 MB/sec point-to-point connections in parallel. Each FC-AL Switch provides multiple dedicated, non-blocking connections between Fibre Host Adapters and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 64
FC-AL Switches to the array controllers IMPORTANT: For detailed information about cascading two FC-AL Switches, refer to the latest Compaq StorageWorks documentation. This guide does not document cascaded configurations for the FC-AL Switch. A redundant FC-AL consists of from two to four individual - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 65
Cluster Architecture 2-41 Figure 2-15 shows a two-node PDC/O2000 with a redundant FC-AL that contains two loops, one for each Fibre Host Adapter per node. The components and cable paths for the first loop are shaded to distinguish them from the components for the other loop. Fibre Host Adapters (2) - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 66
2-42 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Multiple Redundant Fibre Channel Arbitrated Loops The PDC/O2000 supports the use of multiple redundant FC-ALs within the same cluster. You would install additional redundant FC-ALs in a PDC/O2000 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 67
Cluster Architecture 2-43 Figure 2-16 shows a two-node PDC/O2000 that contains two redundant FC-ALs. In this example, each redundant FC-AL has its own pair of Fibre Host Adapters in each node, a pair of Storage Hubs or FC-AL Switches, and two RA4000/RA4100 Arrays. In Figure 2-2, the hardware - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 68
2-44 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Maximum Distances Between Nodes and Shared Storage Components in a Redundant FC-AL By using standard short-wave Fibre Channel cables with Gigabit Interface Converter-Shortwave ( - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 69
Cluster Architecture 2-45 I/O Data Paths in a Redundant FC-AL A distinct I/O path connection exists between each Fibre Host Adapter in a cluster node and every array controller port in each RA4000/RA4100 Array in the redundant FC-AL. Fibre Host Adapter-to-Storage Hub/Switch Paths Figure 2-18 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 70
2-46 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Storage Hub/Switch-to-Array Controller Paths Figure 2-19 highlights the I/O data paths that run between the Storage Hubs or FC-AL Switches and the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 71
Cluster Architecture 2-47 I/O Path Configuration Guidelines for Redundant Fibre Channel Arbitrated Loops You can use either of two I/O path configurations for every redundant FC-AL in your PDC/O2000 cluster: I Active/standby configuration I Active/active configuration In every redundant FC-AL, at - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 72
2-48 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide See "Active/Standby Configuration Examples for Redundant FC-ALs" in this chapter for a detailed description of active/standby configuration examples for a redundant FC-AL with - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 73
Cluster Architecture 2-49 Table 2-6 Features of Active/Standby and Active/Active Configurations for Redundant Fibre Channel Arbitrated Loops continued I/O Path Configuration Advantage Disadvantage Active/active with two or more RA4000/RA4100 Arrays Provides a small but measurable improvement - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 74
2-50 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I/O Path Configuration Rules for Redundant FC-ALs The following rules must be observed in I/O path configurations for PDC/O2000 clusters with redundant FC-ALs: I Each - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 75
Cluster Architecture 2-51 Active/Standby Configuration Examples for Redundant FC-ALs This section describes examples of active/standby configurations when one, two, three, four, and five RA4000/RA4100 Arrays are present in one redundant FC-AL of a four-node PDC/O2000. These examples represent one - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 76
2-52 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I In each RA4000/RA4100 Array, the bottom (rack model) or left rear (tower model) array controller is always the standby controller. I The odd-numbered Storage - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 77
Cluster Architecture 2-53 Active/Standby Configuration with One RA4000/4100 Array Figure 2-20 shows an active/standby I/O path configuration for a redundant FC-AL in a four-node cluster with one RA4000/RA4100 Array. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers (4) - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 78
2-54 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Standby Configuration with Two RA4000/4100 Arrays Figure 2-21 shows an active/standby I/O path configuration for a redundant FC-AL in a four-node cluster with - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 79
Cluster Architecture 2-55 Active/Standby Configuration with Three RA4000/RA4100 Arrays Figure 2-22 shows an active/standby I/O path configuration for a redundant FC-AL in a four-node cluster with three RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 80
2-56 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Standby Configuration with Four RA4000/RA4100 Arrays Figure 2-23 shows an active/standby I/O path configuration for a redundant FC-AL in a four-node cluster with - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 81
Cluster Architecture 2-57 Active/Standby Configuration with Five RA4000/RA4100 Arrays Figure 2-24 shows an active/standby I/O path configuration for a redundant FC-AL in a four-node cluster with five RA4000/RA4100 Arrays. Fibre Host Adapter (Active) Fibre Host Adapter (Standby) ProLiant Servers - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 82
2-58 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Active Configuration Examples for Redundant FC-ALs This section describes examples of active/active configurations when two, three, four, and five RA4000/RA4100 Arrays - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 83
Cluster Architecture 2-59 I The even-numbered Storage Hub or FC-AL Switch (Storage Hub/FC-AL Switch #2) is connected to the active array controller in each even-numbered RA4000/RA4100 Array (2 and 4). I The even-numbered Storage Hub or FC-AL Switch is connected to the standby array controller in - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 84
2-60 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Active Configuration with Two RA4000/RA4100 Arrays Figure 2-25 shows an active/active I/O path configuration for a redundant FC-AL in a four-node cluster with - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 85
Cluster Architecture 2-61 Active/Active Configuration with Three RA4000/RA4100 Arrays Figure 2-26 shows an active/active I/O path configuration for a redundant FC-AL in a four-node cluster with three RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 86
2-62 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Active/Active Configuration with Four RA4000/RA4100 Arrays Figure 2-27 shows an active/active I/O path configuration for a redundant FC-AL in a four-node cluster with - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 87
Cluster Architecture 2-63 Active/Active Configuration with Five RA4000/RA4100 Arrays Figure 2-28 shows an active/active I/O path configuration for a redundant FC-AL in a four-node cluster with five RA4000/RA4100 Arrays. Fibre Host Adapters (2) ProLiant Servers (4) Node 1 Node 2 Node 3 Node 4 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 88
2-64 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Summary of I/O Path Failure and Failover Scenarios for Redundant FC-ALs Table 2-7 identifies possible I/O path failure events in redundant FC-ALs for active/standby configurations - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 89
Cluster Architecture 2-65 Table 2-7 I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Standby Configurations With One RA4000/RA4100 Array continued Description of Failure Failover Response The Fibre Channel cable None connection between a Fibre Host Adapter and the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 90
2-66 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-8 identifies possible I/O path failure events for active/standby configurations with two or more RA4000/RA4100 Arrays and the failover response, if any, implemented by - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 91
Cluster Architecture 2-67 Table 2-8 I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Standby Configurations With Two or More RA4000/RA4100 Arrays continued Description of Failure Failover Response The Fibre Channel cable connection between the Storage Hub or FC-AL Switch - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 92
2-68 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 2-9 identifies possible I/O path failure events in redundant FC-ALs for active/active configurations with two or more RA4000/RA4100 Arrays and the failover response, - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 93
Cluster Architecture 2-69 Table 2-9 I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Active Configurations With Two or More RA4000/RA4100 Arrays continued Description of Failure Failover Response A Storage Hub or FC-AL Switch fails. Secure Path makes each active array - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 94
interconnect, system area network (SAN), and private network. Throughout this guide, the term cluster interconnect is used. A PDC/O2000 cluster running NOTE: Refer to the technical white paper Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server (ECG062 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 95
Cluster Architecture 2-71 Non-Redundant Ethernet Cluster Interconnect Components The following components are used in a non-redundant Ethernet cluster interconnect: I One Ethernet adapter in each cluster node I Ethernet cables and a switch or hub G For two-node PDC/O2000 clusters, you can either use - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 96
2-72 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Ethernet Cluster Interconnect Adapters To client LAN. Refer to the technical white paper Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server for - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 97
Cluster Architecture 2-73 Ethernet Cluster Interconnect Diagrams Figure 2-29 shows the non-redundant Ethernet cluster interconnect components used in a two-node PDC/O2000 cluster. These components include a dual-port Ethernet adapter in each node. The top port on each adapter connects by Ethernet - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 98
2-74 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Figure 2-30 shows another option for a non-redundant Ethernet cluster interconnect in a two-node PDC/O2000 cluster. These include an Ethernet adapter in each node - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 99
Cluster Architecture 2-75 Figure 2-31 shows the redundant Ethernet cluster interconnect components used in a two-node PDC/O2000 cluster. Ethernet Switch/Hub #2 for Cluster Interconnect Dual-port Ethernet Adapters (2) Ethernet Switch/Hub #1 for Cluster Interconnect Crossover Cable Dual-port - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 100
2-76 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Local Area Network NOTE: For the PDC/O2000, the client LAN and the cluster interconnect must be treated as separate networks. Do not use either - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 101
Cluster Model PDC/O2000 Certification Matrix for Windows 2000 at www.compaq.com/solutions/enterprise/ha-pdc.html Microsoft Windows 2000 Advanced Server This version of the PDC/O2000 supports only Microsoft Windows 2000 Advanced Server with Service Pack 1 or later. NOTE: The PDC/O2000 does not work - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 102
and Windows 2000 Administrator Guide Compaq Software Compaq offers an extensive set of features and optional tools to support effective configuration and management of the PDC/O2000: I Compaq SmartStart™ and Support Software I Compaq System Configuration Utility I Compaq Array Configuration Utility - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 103
. For information about the Array Configuration Utility, see the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Fibre Channel Fault Isolation Utility The SmartStart and Support Software CD also contains the Fibre Channel Fault Isolation Utility - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 104
PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Compaq Insight Manager Compaq Insight Manager, loaded from the Compaq Management CD, is a software utility used to collect information about the servers in the cluster. Compaq Insight Manager performs these functions: I Monitors server - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 105
remotely at a management station. Compaq Operating System Dependent Modules Compaq supplies low-level services, called operating system dependent modules Oracle8i Parallel Server Setup and Configuration Guide. The OSD software is found on the Compaq Parallel Database Cluster Clustering Software for - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 106
for Oracle8i and Windows 2000 Administrator Guide Oracle Software The PDC/O2000 supports Oracle8i software. If you are using a release other than Oracle8i Release 8.1.7, confirm that the release has been certified for the PDC/O2000 on the Compaq website at www.compaq.com/solutions/enterprise/ha-pdc - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 107
, refer to: I Oracle8i Parallel Server Setup and Configuration Guide I Other Oracle documentation for Oracle8i Server and Oracle8i Parallel Parallel Server for Windows 2000 Certification. Neither Oracle nor Compaq will support any implementation of Oracle8i Parallel Server that does not strictly - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 108
3-8 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Application Failover and Reconnection Software When a network client computer operates in a clustered environment, it must be more resilient than when operating with a stand-alone server. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 109
4 Chapter Cluster Planning Before connecting any cables or powering on any hardware on your Compaq Parallel Database Cluster Model PDC/O2000 (referred to here as the PDC/O2000), it is important that you understand how all the various cluster components - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 110
4-2 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Site Planning You must carefully select and and qualified personnel I Space for unpacking, installing, and servicing the computer equipment I Sufficient floor strength for the computer equipment - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 111
, the failure of one node leaves the one remaining node to service all clients. This could result in an unacceptable level of performance. supported by the Compaq Parallel Database Cluster. For a current list of PDC/O2000-certified servers and details on supported configurations, refer to the Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 112
Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide I One or more Compaq StorageWorks RAID Array 4000s (RA4000 Arrays) or Compaq StorageWorks RAID Array 4100s (RA4100 Arrays) I Two single-port Compaq StorageWorks RAID Array 4000 Controllers (RA4000 Array Controllers) installed - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 113
Loop (FC-AL) in a PDC/O2000 uses these hardware components: I Two or more Fibre Host Adapters in each node I Two or more Compaq StorageWorks Storage Hubs (Storage Hubs) or Compaq StorageWorks FC-AL Switches (FC-AL Switches) I One or more RA4000 Arrays or RA4100 Arrays I Two single-port RA4000 Array - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 114
4-6 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Planning Cluster Interconnect and Client LAN cluster interconnects. This document is available at www.compaq.com/support/techpubs/whitepapers Before installing an Ethernet cluster interconnect in - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 115
for small and larger clusters using redundant Fibre Channel Fabrics. IMPORTANT: Use the Oracle documentation identified in the front matter of this guide to obtain detailed information about planning for the Oracle software. Once the required level of performance, the size of the database, and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 116
4-8 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The small redundant Fibre Channel Fabric cluster configuration shown in Figure 4-1 contains these key cluster components: I Two ProLiant servers (nodes) I Two Fibre Host Adapters in - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 117
Cluster Planning 4-9 Sample Large Configuration in a Redundant Fibre Channel Fabric Figure 4-2 shows an example of a larger PDC/O2000 cluster: a six-node cluster with five RA4000/RA4100 Arrays in one redundant Fibre Channel Fabric. Fibre Host Adapters (2) Node 5 Node 6 Node 1 Node 2 Node 3 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 118
4-10 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The larger redundant Fibre Channel Fabric configuration shown in Figure 4-2 contains these key cluster components: I Six ProLiant servers (nodes) I Two Fibre Host Adapters in each - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 119
sample configurations for small and large clusters using redundant FC-ALs. IMPORTANT: Use the Oracle documentation identified in the front matter of this guide to obtain detailed information about planning for the Oracle software. Once the required level of performance, the size of the database, and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 120
4-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The small redundant FC-AL configuration shown in Figure 4-3 contains these key cluster components: I Two ProLiant servers (nodes) I Two Fibre Host Adapters in each server I - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 121
Cluster Planning 4-13 Sample Large Configuration in a Redundant FC-AL Figure 4-4 shows an example of a larger PDC/O2000 cluster: a six-node cluster with five RA4000/RA4100 Arrays in one redundant FC-AL. Fibre Host Adapters (2) Node 5 Node 6 Node 1 Node 2 Node 3 Node 4 FC-AL Switch/Storage - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 122
4-14 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The larger redundant FC-AL configuration shown in Figure 4-4 contains these key cluster components: I Six ProLiant servers (nodes) I Two Fibre Host Adapters in each server - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 123
on shared storage arrays, you use the hardware RAID to perform such functions as making copies of the data or calculating checksums. Use the Compaq Array Configuration Utility to implement RAID on your logical disks. NOTE: Do not use the software RAID offered by the operating system to configure - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 124
4-16 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Supported RAID Levels RAID provides several fault-tolerant options to protect your cluster's shared data. However, each RAID level offers a different mix of performance, reliability, and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 125
Cluster Planning 4-17 Raw Data Storage and Database Size Raw data storage is the amount of storage available before any RAID levels have been configured. It is called raw data storage because RAID volumes require some overhead. The maximum size of a database stored in a RAID system will always be - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 126
4-18 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The following general guidelines apply to Drive Drive Drive Drive Drive Drive Drive Create logical drive arrays with Compaq Array Configuration Utility RAID 5 Disk Array RAID 1 Disk Array RAID - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 127
drive arrays in the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Use Disk Management to in restoration of a failed drive. Since the Oracle Parallel Server application files are stored on these drives, it is recommended that you use hardware - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 128
that does not support fault tolerance (for example, RAID 0), then the failure of the shared disk drives in that logical drive will disrupt service to all Oracle databases nodes, the Compaq operating system dependent modules (OSDs) require a unique entry in the hosts and lmhosts files located at % - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 129
Cluster Planning 4-21 Client LAN Physically, the structure of the client network is no different than that used for a nonclustered configuration. To ensure continued access to the database when a cluster node is evicted from the cluster, each network client should have physical network access to all - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 130
Configuration This chapter provides instructions for installing and configuring the Compaq Parallel Database Cluster Model Compaq StorageWorks RAID Array 4000 User Guide I Compaq StorageWorks RAID Array 4100 User Guide I Compaq StorageWorks Fibre Channel Host Bus Adapter Installation Guide or Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 131
Guide I Compaq StorageWorks Fibre Channel SAN Switch Management Guide I Compaq SmartStart Installation poster I Compaq SmartStart and Support Software CD I Microsoft Windows 2000 Advanced Server Administrator's Guide I Microsoft Windows 2000 Advanced Server CD with Service Pack 1 or later I Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 132
: G SmartStart 4.9 or later G Windows 2000 Advanced Server with Service Pack 1 or later I Installing and configuring Secure Path for Windows Manager G Defining Active Array controllers I Installing and configuring the Compaq operating system dependent modules (OSDs), including: G Using Oracle - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 133
the same PCI slots in each server. While setting up the physical hardware, follow the installation instructions in your Compaq ProLiant Server Setup and Installation Guide and in your Compaq ProLiant Server Installation poster. When you are ready to install the Fibre Host Adapters and your cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 134
: When connecting a Fibre Channel Host Adapter to a Storage Hub or Fibre Channel SAN Switch, do not mount the Fibre Channel cables on cable management arms. Support the Fibre Channel cable so that a bend radius at the cable connector is not less than 3 inches. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 135
Hub 7 Installation Guide and the Compaq StorageWorks Storage Hub 12 Installation Guide. Installing the Cluster Interconnect Adapters A PDC/O2000 running Oracle8i software uses an Ethernet cluster interconnect. Both redundant and non-redundant cluster interconnects are supported. However, a redundant - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 136
you are using. Setting Up the RA4000/RA4100 Arrays Unless otherwise indicated in this guide, follow the instructions in the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide o set up shared storage subsystem components. For example, these user - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 137
in the "Installing the Operating System Software and Configuring the RA4000/RA4100 Arrays" section of this chapter. These instructions include clustering information that is not included in the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 138
detailed information about configuring the drives using the Array Configuration Utility, see the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. For information about configuring your shared storage subsystem with RAID, see Chapter 4, "Cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 139
5-10 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide In an active/active configuration, and Storage Hub/Switch #2 connects to standby RA4000 Array Controllers. The cabling instructions are the same for any number of RA4000/RA4100 Arrays. NOTE: When - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 140
Installation and Configuration 5-11 Figure 5-3 shows two Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches connected to the RA4000 Array Controllers in two RA4000/RA4100 Arrays. Storage Hub/Switch #1 Storage Hub/Switch #2 Active RA4000/4100 Standby RA4000/4100 Array Controller Array - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 141
5-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Table 5-1 summarizes the active/active cabling methods. Select the method that is best for your site. Method 1 2 Table 5-1 Active/Active Cabling Methods Active Array Controller - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 142
Installation and Configuration 5-13 Figure 5-4 shows an example of using method 1 cabling to connect two Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches to RA4000 Array Controllers in two RA4000/RA4100 Arrays. Storage Hub/Switch #1 Storage Hub/Switch #2 Active RA4000/4100 Standby - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 143
5-14 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Figure 5-5 shows an example of using two RA4000/RA4100 Arrays NOTE: When defining the active array controllers as instructed later in this chapter, for method 1 cabling make the top array - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 144
Installation and Configuration 5-15 Installing Additional Redundant Fibre Channel Fabrics At this point, you have installed the hardware for one redundant Fibre Channel Fabric or one redundant FC-AL. To add a second redundant Fibre Channel Fabric to the PDC/O2000, install another set of the hardware - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 145
5-16 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Cabling the Ethernet Cluster Interconnect A PDC/O2000 running Oracle8i software uses an Ethernet cluster interconnect. The following components are used in a non-redundant Ethernet cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 146
Installation and Configuration 5-17 Figure 5-6 shows the non-redundant Ethernet cluster interconnect components used in a two-node PDC/O2000 cluster. These components include a dual-port Ethernet adapter in each node. The top port on each adapter connects by Ethernet crossover cable to the top port - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 147
5-18 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide To connect two or more nodes in a non-redundant Ethernet cluster interconnect: 1. Install a standard Ethernet cable between an Ethernet adapter in one node and one - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 148
clusters of three or more nodes using a redundant Ethernet cluster interconnect, Compaq requires that you use two Ethernet 100-Mbit/sec switches to maintain good one Ethernet path to another, see Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server at - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 149
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Cabling the Client LAN You can use any TCP/IP network to connect to a client LAN. The following procedure contains instructions between the nodes is not supported. For information on configuring - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 150
are installed and cabled before you install the software. I Power on the cluster as instructed later in this chapter in "Power Distribution and Power Sequencing Guidelines." I SmartStart runs the Compaq Array Configuration Utility, which is used to configure the drives in the RA4000/RA4100 Arrays - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 151
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide and node names for each node in the hosts and lmhosts files at %SystemRoot%\system32\drivers\etc. G For an Ethernet Support Software CD 4.9 or later I Microsoft Windows 2000 Advanced Server with Service - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 152
Hubs, FC-AL Switches, or Fibre Channel SAN Switches G Ethernet hubs or switches 2. Power up a cluster node and put the SmartStart and Support Software CD into the CD-ROM drive. 3. Select the Assisted Integration installation path. 4. When prompted, insert the Server Profile diskette into the floppy - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 153
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 9. Enter unique IP addresses and node names for each node in the hosts and lmhosts files dialog box for the client LAN port and you are using Service Pack 1 or later: a. Double-click the Network and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 154
assigned to them. You will need this information later when installing Compaq OSDs. 12. If you are installing node1, open Windows 2000 more information on creating partitions, see the Oracle8i Parallel Server Setup and Configuration Guide. 13. If you are installing a node other than node1, open Disk - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 155
5-26 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Installing Secure Path Secure Path Server Software To install the Secure Path Server software: 1. Insert the Compaq SANWorks Secure Path Software CD into your CD-ROM drive. 2. If you have - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 156
Secure Path Server software or any Windows workstation. The workstation must be TCP/IP-capable. To install the Secure Path Client software: 1. Insert the Compaq SANWorks Secure Path Software CD into your CD-ROM drive. 2. If you have AutoRun enabled on your server, the Secure Path setup program will - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 157
5-28 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 3. If you double-click "Storage System X", you should get two more branches that represent the two RA4000 Array Controllers in that array. These controllers are - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 158
Installation and Configuration 5-29 Table 5-2 Active Array Controller Locations Configuration Active/Standby Active/Active: Cabling Method 1 Active/Active: Cabling Method 2 Active Array Controller Location Top array controller slot Top array controller slot Top array controller slot in odd- - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 159
with the OUI that installs Compaq OSDs for an Ethernet cluster interconnect. The OUI runs from one node in the cluster and performs the following tasks: I Copies the OSDs to the internal hard drive of all cluster nodes. I Sets up registry entries for file location and standard registry parameters - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 160
not install successfully, the OUI will not offer the option to install Oracle8i Parallel Server. The Compaq operating system dependent modules (OSDs) are installed from one node in the cluster (the installing , check the entries in the hosts and lmhosts files at %SystemRoot%\system32\drivers\etc. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 161
5-32 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide For example, the command ping node1 should return the following type of information. Pinging node1.loc1.yoursite.com [127.0.0.1] with 32 bytes of data: Reply - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 162
and password on each node. Then make that local user a member of the local Administrators group on each node before installing the OSDs. 2. Insert the Compaq Parallel Database Cluster Clustering Software for Oracle8i on Microsoft Windows 2000 CD into the CD-ROM drive. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 163
5-34 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 3. If autorun is enabled, the Oracle Universal Installer Welcome screen appears. If autorun is disabled, enter d:\setup at a C: prompt. Substitute the letter assigned to the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 164
Installation and Configuration 5-35 4. Click Next to continue. The License screen appears. 5. Click Accept to accept the terms of the license agreement. The File Locations screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 165
5-36 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 6. Click Next to continue. The Installation Types screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 166
Installation and Configuration 5-37 7. Select Typical to install the Ethernet OSDs into the default location, C:\Compaq\OPS. Skip to step 12. 8. Select Custom to install the Ethernet OSDs into a location of your choice. The Component Locations screen appears. 9. If you want - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 167
5-38 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 11. If you want to specify an alternate location but do not know the exact directory path, click Change Location. The Choose Directory screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 168
Installation and Configuration 5-39 12. Browse to the location where you want to install the OSDs. Click OK. The Component Locations screen appears indicating the alternate location you specified. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 169
5-40 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 13. Click Next to continue. The Cluster Members screen appears. 14. The Cluster Members screen indicates the host name of the installing machine. Define the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 170
it as a cluster interconnect node name. If necessary, retype the cluster interconnect node names to match the names you entered into the hosts and lmhosts files for the Ethernet cluster interconnect. Do not use special characters. Separate the node names with a space. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 171
5-42 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 17. Click Next to continue. The OSD Summary screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 172
Installation and Configuration 5-43 18. If the information on the OSD Summary screen is not correct, click Previous to modify the previous screens. When the information is correct, click Next to continue. The Summary screen appears. 19. Click Install to install the components listed in the summary. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 173
on all nodes in the cluster. This service must be started before installing Oracle software. See the Oracle documentation for information on starting the cluster manager. Installing Oracle Software Using the Oracle8i Parallel Server Setup and Configuration Guide, follow the steps to install Oracle8i - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 174
Oracle software, the Oracle8i documentation instructs you to install vendor-supplied operating Server Setup and Configuration Guide and the Oracle8i Enterprise Edition maintains the symbolic links between disk partitions and Oracle data files. Failure to install Object Link Manager can result in - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 175
Oracle database software to ensure that the symbolic links are defined before creating a database. For instructions on installing and using Object Link Manager, see the readme file on the Compaq Parallel Database Cluster Clustering Software for Oracle8i on Microsoft Windows 2000 CD at \Object Link - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 176
and lmhosts files at %SystemRoot service did not start successfully, make sure that the OracleCMService is started and the SID is in the Oracle registry. There are two logs that can provide information about why the Oracle service did not start. These logs are: I \Compaq\OPS\cmsrvr.log I \Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 177
Guide Other Verification Tasks Perform these other verification tasks: I Verify that Object Link Manager has been installed and is running. I Verify that the OPS_CMDISK symbolic link has actually been set. To verify the Object Link Manager has been installed and is running, select the Services Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 178
Installation and Configuration 5-49 Server Power Distribution Figure 5-9 shows an example of server power distribution for a three-node cluster. Power supply #1 of each server is connected to PDU #1. Power supply #2 of each server is connected to PDU #2. PDU #1 is connected to UPS #1, and PDU #2 is - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 179
5-50 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Power Sequencing Be sure to power up the cluster components in the following order: 1. RA4000/RA4100 Arrays 2. Storage Hubs, FC-AL Switches, or Fibre Channel - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 180
ongoing activities. This chapter describes these management activities for the Compaq Parallel Database Cluster Model PDC/O2000 (referred to here as this chapter contain high-level instructions. The instructions summarize what has either already been discussed in this guide, Oracle documentation, or - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 181
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Cluster Management Concepts Powering Off a Node Without Interrupting Cluster Services degraded condition, it is helpful to follow this troubleshooting process: 1. Determine what caused the degradation. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 182
to repair the problem. G If the problem is not considered to be critical, wait until a non-peak time to service the problem. G If the problem is critical can be viewed either within the System log or within specific error log files. The Oracle8i Server events are sent to the Application log and can - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 183
PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide The following log files are used: I The Node Manager (NM), provided by Compaq, logs messages to C:\compaq\ops\nm.log I By default the OracleCMService sends messages to C:\compaq\ops\cmsrvr.log Management Applications Monitoring Server and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 184
is available on the SmartStart and Support Software CD, which is found in the Compaq Server Setup and Management pack. For additional information about the ACU, see the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Disk Management is first run - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 185
Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Compaq Secure Path software can detect failures in redundant Fibre device on an FC-AL. FFIU is on the SmartStart and Support Software CD. Compaq Secure Path software can detect failures in redundant Fibre Channel Fabric components - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 186
Guide I Oracle8i Parallel Server Concepts I Oracle8i Parallel Server Administration, Deployment, and Performance Oracle8i Enterprise Manager and its corresponding documentation are shipped as part of Oracle8i Enterprise Edition. Remotely Managing a Cluster Oracle8i Enterprise Manager, Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 187
for Oracle8i and Windows 2000 Administrator Guide Before installing Compaq Insight Manager, Compaq Insight Manager XE, or Oracle8i Enterprise Be sure to shut down the Oracle instance on all nodes and stop the Oracle services running on all nodes prior to removing the OSDs. To deinstall the OSDs: - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 188
Cluster Management 6-9 4. If autorun is disabled, enter d:\setup at a C: prompt. Substitute the letter assigned to the CD-ROM drive for d. The Oracle Universal Installer Welcome screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 189
and Windows 2000 Administrator Guide 5. Click Deinstall Products. Next, a window containing an inventory of the installed components appears. The following shows the Inventory screen that is displayed when Ethernet is used for the cluster interconnect. 6. Select Compaq Ethernet OSDs and click - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 190
the operation of the cluster. Before upgrading to any new release of Oracle8i Server, consult your Compaq and Oracle service representatives. Make sure that the new release is certified and supported on the PDC/O2000, and get assistance to determine which procedure you should follow to perform the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 191
6-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Upgrading the Ethernet OSDs To upgrade The Inventory screen displays a list of installed components. 3. Select Compaq Ethernet OSDs and click Remove. The Oracle Universal Installer removes all - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 192
installation (by removing it) before you can successfully run the Oracle Universal Installer again. To remove a partial OSD installation: 1. Insert the Compaq Parallel Database Cluster Clustering Software for Oracle8i on Microsoft Windows 2000 CD into the CD-ROM drive of a cluster node. 2. From - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 193
Oracle8i Server, consult your Compaq and Oracle service representatives. Make sure that the new release is certified and supported on the PDC/O2000 the information in the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide that describes the conditions - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 194
can using the Disk Management. 7. Perform the necessary Oracle commands to associate the new data files to the database. Refer to the Oracle8i Parallel Server Setup and Configuration Guide for more detailed instructions. Adding an RA4000/RA4100 Array You must shut down the cluster to add an RA4000 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 195
/RA4100 Array. 16. Perform the necessary Oracle commands to associate the new data files to the database. Refer to the Oracle8i Parallel Server Setup and Configuration Guide for more detailed instructions. Replacing a Failed Fibre Host Adapter To replace a failed Fibre Host Adapter in a cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 196
Storage Hub. 8. Power on the node. 9. Restart the Oracle services on the node. 10. Start up the Oracle instance on the is supported by the PDC/O2000. To determine if your new server is supported, see the Compaq Parallel or to a remote file server that can be restored onto the replacement node. 3. Stop - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 197
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide 4. Stop all Oracle services follow. If you need detailed instructions, read Chapter 5, "Installation and the Compaq SmartStart and Support Software CD in the CD-ROM drive. 3. Use the Compaq System - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 198
6-19 5. Install and configure Windows 2000 Advanced Server with Service Pack 1 or later (whichever is installed on the other cluster nodes). 6. Install necessary Compaq drivers and utilities from the Compaq SmartStart and Support Software CD. 7. Install Fibre Host Adapters in the replacement - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 199
Administrator Guide 1. To add a node to the cluster, you must disassemble the existing cluster and then reform it to include the replacement node. Do the following on all original cluster nodes (not the replacement node): a. Shut down the Oracle instance. b. Stop all Oracle services. c. Deinstall - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 200
supported by the PDC/O2000. To determine if your new server is supported, see the Compaq Parallel Database Cluster Model PDC/O2000 Certification Matrix for Windows 2000 at www.compaq. of the steps to follow. If you need detailed instructions, read through Chapter 5, "Installation and Configuration." - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 201
RAID. 5. Install and configure Windows 2000 Advanced Server with Service Pack 1 or later (whichever is installed on the other cluster nodes). 6. Install all necessary Compaq drivers and utilities from the Compaq SmartStart and Support Software CD, including the drivers for the Fibre Host Adapters - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 202
for adding a new node: 1. Add the unique IP addresses and node names for the new node in the hosts and lmhosts files of each existing cluster node. These files are located at %SystemRoot%\system32\drivers\etc. 2. Verify TCP/IP connectivity between the new node and the existing cluster nodes. Run - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 203
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Oracle instance. b. Stop all Oracle services. c. Deinstall the OSDs by running files and additional rollback segments to the database. After the new partitions are created for the log files - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 204
by each node, which signifies a need to adjust the distribution of the workload so that the overall cluster performance is maximized. I Compaq Insight Manager and Compaq Insight Manager XE can be used to gather low-level, in-depth hardware statistics for the server and networking hardware components - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 205
6-26 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Secure Path Manager is the effect until you stop and restart the Secure Path Agent Service. From Administrative Tools, open the Services screen, select "Secure Path Agent," and restart it by - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 206
I/O path. Use this action when you want Secure Path Manager to restore access to a failed path after the problem has been corrected. Refer to the Compaq documentation provided with the Secure Path software for details on performing these operations. Detecting I/O Path and Array Controller Failures - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 207
6-28 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Note that Secure Path Manager client is not required in the cluster. NOTE: To aid in the reinstallation of Secure Path, the file "client.ini" is not removed. The uninstallation process is complete. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 208
chapter addresses potential problems you might encounter as you install, configure, test, and operate your Compaq Parallel Database Cluster Model PDC/O2000 (referred to here as the PDC/O2000). This chapter is organized as follows: I Basic troubleshooting tips I Troubleshooting Oracle8i and operating - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 209
for Oracle8i and Windows 2000 Administrator Guide Basic Troubleshooting Tips Power Verify that the following are all powered on: I Cluster nodes I StorageWorks RAID Array 4000s (RA4000 Arrays) or StorageWorks RAID Array 4100s (RA4100 Arrays) I Compaq StorageWorks Fibre Channel SAN Switches (Fibre - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 210
Troubleshooting and Resolving Shared Disk Problems" for more detailed guidelines Compaq Insight Manager I Compaq Array Configuration Utility I Compaq Secure Path for Windows 2000 I Compaq Ethernet OSDs I Cluster interconnect drivers I Microsoft Windows 2000 Advanced Server, including Service - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 211
PDC/02000 for Oracle8i and Windows 2000 Administrator Guide For information about currently supported software revisions for the PDC/O2000, refer to the Compaq Parallel Database Cluster Model PDC/O2000 Certification Matrix for Windows 2000 at www.compaq.com/solutions/enterprise/ha-pdc.html Depending - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 212
Troubleshooting 7-5 Troubleshooting Oracle8i and OSD Installation Problems and Error Messages Potential Difficulties Installing the OSDs with the Oracle Universal Installer I The Oracle Universal Installer (OUI) uses an inventory file to track which components of the OSDs have been installed on each - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 213
7-6 Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide I Determine whether or not Manager Service, OracleNMService, is running. If not, see the error logs in C:\compaq\ops\nm.log. If OracleNMService is running, check the CM Server logs in C:\compaq\ops - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 214
and Resolving Shared Disk Problems" for detailed guidelines. I Verify that all files created by Net8 Config Assistant were transferred properly to each respective node. I Verify the connections and accessibility of the cluster components. Refer to the "Basic Troubleshooting Tips" section in this - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 215
the service and restart it. Troubleshooting Node-to-Node Connectivity Problems Nodes Are Unable to Communicate with Each Other I Check the Windows 2000 Advanced Server event logs for errors. I Check the OracleCMService error log for information. The default location for the error log is C:\compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 216
Troubleshooting 7-9 Unable to Ping the Cluster Interconnect or the Client LAN If you are using the recommended method of using static IP addresses, ensure that the hosts file and lmhosts files are properly set up. When Using the Ethernet Cluster Interconnect I Make sure that the Ethernet cables are - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 217
7-10 Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide I Make sure the OracleCMService and all other Oracle services have started without error. From the Services screen, scan the list of services and check to see if the Oracle services have started. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 218
section does not address RA4000/RA4100 Array problems that are specific to the product itself or to the use of the RA4000/RA4100 Array in a stand-alone server configuration. For those issues, refer to the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 219
Fibre Channel Host Adapter Installation Guide or the Compaq StorageWorks 64-bit/66-MHz Fibre Channel Host Adapter Installation Guide for installation instructions. I Determine whether or not hardware errors or communications transport failures are causing the problem. Use the Event Viewer to - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 220
drive volumes can be accurately viewed from Disk Management on each node. I If you continue to have problems, refer to Appendix A, "Diagnosing and Resolving Shared Disk Problems," for further information. Also refer to the Compaq Fibre Channel Troubleshooting Guide for further corrective actions. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 221
Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide Problems." Troubleshooting Secure Path For detailed information about troubleshooting Secure Path software, refer to the troubleshooting Array. I There is no support for Windows 2000 dynamic disks. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 222
Troubleshooting 7-15 I The same Secure Path Manager password must be used for all of the hosts in a profile. I Before you change the Secure Path Agent's list of authorized clients or passwords, you must first manually the Services screen. name correctly. Hyphenated host file names must be changed to - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 223
Compaq Parallel Database Cluster Model PDC/02000 for Oracle8i and Windows 2000 Administrator Guide screen is refreshed every 60 seconds. To perform a manual refresh, press the F5 key. The Addition of New this occurs, do the following: 1. From the Services screen, right click on Secure Path Agent. 2. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 224
the PDC/O2000) cannot properly join the cluster, you need to consider two possible causes: I A problem related to the shared disk storage in the cluster's Compaq StorageWorks RAID Array 4000s (RA4000 Arrays) or Compaq StorageWorks RAID Array 4100s (RA4100 Arrays) is preventing one or more nodes from - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 225
Perform Cluster Hardware Checks OK Problem Persists Contact Your Compaq Support Representative Exit. Problem Fixed or No Further Disk Problems Rerun and Validate Object Link OK Manager On All Affected Nodes Problem Persists Exit. Problem Fixed or No Further Disk Problems Figure A-1. Tasks for - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 226
Nodes in the Cluster" in this appendix for further instructions. For instructions on installing and using Object Link Manager, see the readme file: \Object Link Manager\readme.txt This file is located on the Compaq Parallel Database Cluster Clustering Software for Oracle8i on Microsoft Windows - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 227
A-4 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Restart All Affected Nodes Manager service is properly installed on the node. For instructions on installing and using Object Link Manager, refer to this readme file contained on the Compaq Parallel - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 228
Shared Disk Problems A-5 Run for Secure Path Manager is correct. Refer to the Compaq Parallel Database Cluster Model PDC/O2000 Certification Matrix for Windows Windows 2000" in Chapter 5, "Installation and Configuration," for installation instructions. 4. Repeat steps 1 through 3 for all nodes in the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 229
A-6 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Run and Validate nodes in the cluster. Perform Cluster Software and Firmware Checks Use the Compaq SmartStart and Support Software CD to perform these checks on the cluster software and firmware: - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 230
problems exist. Check the event log for disk I/O error messages or indications of problems with the communications transport. 2. Determine whether or not the Compaq servers support to the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. 7. Verify - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 231
Guide Contact Your Compaq Support Representative If you are unable to resolve the problem, contact your Compaq support representative for assistance. In North America, call the Compaq Technical Support Phone Center at 1-800-OK-COMPAQ. Outside North America, call the nearest Compaq Technical Support - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 232
as a single system. Clustering is a way to improve availability and scalability. The period of time that a computer system is unable to service clients' requests. A standard network protocol that operates mostly on a physical level, using network interface cards and cabling to transmit data between - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 233
2 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Fibre Channel Fibre Channel Arbitrated Loop (FC also called the cluster heartbeat. The Compaq Parallel Database Cluster interconnect is dedicated to servicing requests only between cluster nodes. An - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 234
server in a cluster. New Technology File System. A file organization system by which data is responsible for enabling parallel database support. An additional license is required or hardware entity upon which a client/server application or service is dependent. As it pertains to the PDC/O2000, - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 235
for Oracle8i and Windows 2000 Administrator Guide Scalability Secure Path Service Shared resource Shared storage System UPS The ability of a system (server, storage, network, or cluster) to grow or expand in performance, throughput, or capacity. The Compaq software that provides cluster nodes with - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 236
Index A active/active configurations cabling for Oracle8i 5-11 active/active configurations for redundant FC-ALs definition 2-47 example with five RA4000/RA4100 Arrays 2-63 example with four RA4000/RA4100 Arrays 2-62 example with three RA4000/RA4100 Arrays 2-61 example with two RA4000/RA4100 Arrays - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 237
2 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide active/standby configurations for example with two RA4000/RA4100 Arrays 2-23 examples overview 2-20 ACU See Compaq Array Configuration Utility adding disk drives in RA4000/RA4100 Arrays 6-15 new - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 238
17 shared disk drives 4-20 site planning 4-2 supported RAID levels 4-16 cluster software for Oracle8i Compaq software overview 3-2 Oracle software 3-6 overview 3-1 cluster troubleshooting basic tips 7-2 client to cluster connectivity problems 7-10 cluster cannot communicate with client 7-10 cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 239
overview 3-3 running to check for shared disk problems A-6 troubleshooting shared storage with 7-13 using to set up RA4000/RA4100 Arrays for Oracle8i 5-8 Compaq authorized reseller xx Compaq Full Spectrum Fault Management 3-4 Compaq Insight Manager monitoring cluster operation with 6-25 monitoring - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 240
overview Compaq Array Configuration Utility 3-3 Compaq Insight Manager 3-4 Compaq Insight Manager XE 3-4 Compaq operating system dependent modules for Oracle8i 3-5 Compaq Options ROMPaq 3-4 Compaq SmartStart and Support software 3-2 Compaq SmartStart and Support Software CD 3-2 Compaq System - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 241
6 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide E error logs for Oracle8i 6-4 Ethernet adapters planning Oracle8i 5-16, 5-19 Ethernet switch 2-72 lmhosts and hosts files entries for Oracle8i 5-22 non-redundant Ethernet cluster interconnect 2-71 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 242
space 4-18 H hardware installation verification for Oracle8i 5-47 help additional sources xix Compaq authorized resellers, telephone numbers xx Compaq website xx technical support telephone numbers xix hosts files for Ethernet cluster interconnect 4-20 for Oracle8i 5-24, 5-31 I I/O data paths Fibre - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 243
Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide files for Oracle8i 5-47, 6-4 M managing network clients 6-3 Microsoft Windows 2000 Advanced Server overview 3-1 versions supported disk problems A-3 operating system dependent modules See Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 244
OracleCMService starting 5-44 troubleshooting 7-6 OracleNMService, troubleshooting 7-7 OSDs See Compaq operating system dependent Compaq Parallel Database Cluster 1-4 Compaq software 3-2 installation for Oracle8i 5-2 Oracle8i Server Enterprise Edition 3-6 Oracle8i software 3-6 shared disk problems - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 245
4000s RA4000/4100 Arrays adding to a cluster 6-15 RA4000/RA4100 Arrays troubleshooting 7-11 RA4100 Arrays See Compaq StorageWorks RAID Array 4100s RAID nonshared disk drives 4-19 planning 4-14 selecting RAID levels 4-17 supported RAID levels 4-16 RAID planning overview 4-14 raw data storage and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 246
Configuration Utility See Compaq System Configuration Utility T TCP/IP network protocol for Oracle8i 5-22 required for OSDs for Oracle8i 5-31 technical support xix telephone numbers xx text conventions xvii troubleshooting basic tips 7-2 client to cluster connectivity problems 7-10 cluster cannot - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O2000 for Ora - Page 247
12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Fibre Channel Fabric connectivity guidelines 7-11 NM storage 7-11 summary of potential problems 7-1 unable to start database for Oracle8i 7-7 troubleshooting tips accessibility of resources 7-3
Parallel Database Cluster Model
PDC/O2000 for Oracle8
i
and
Windows 2000
Administrator Guide
Second Edition (June 2001)
Part Number 225082-002
Compaq Computer Corporation