Compaq ProLiant 6400R Compaq Parallel Database Cluster Model PDC/O1000 for Ora
Compaq ProLiant 6400R Manual
View all Compaq ProLiant 6400R manuals
Add to My Manuals
Save this manual to your list of manuals |
Compaq ProLiant 6400R manual content summary:
- Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 1
Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Second Edition (June 2001) Part Number 225083-002 Compaq Computer Corporation - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 2
of Microsoft Corporation in the United States and other countries. All other product names mentioned herein may be trademarks of their respective companies. Compaq shall not be liable for technical or editorial errors or omissions contained herein. The information in this document is provided "as is - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 3
About This Guide Purpose ...xiii Audience...xiii Scope ...xiv Referenced Manuals xv Supplemental Documents xvi Text Conventions...xvii Symbols in Text...xvii Symbols on Equipment xviii Rack Stability ...xix Getting Help ...xix Compaq Technical Support xix Compaq Website xx Compaq Authorized - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 4
Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Chapter 2 Architecture Compaq ProLiant Servers 2-2 High-Availability Features of ProLiant Servers 2-3 Shared Storage Components 2-3 RA4000 Array 2-4 RA4100 Array 2-4 RA4000 Array Controller 2-5 Fibre - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 5
3-2 Compaq Software ...3-2 Compaq SmartStart and Support Software 3-2 Compaq System Configuration Utility 3-3 Compaq Array Configuration Utility 3-3 Fibre Channel Fault Isolation Utility 3-3 Compaq Insight Manager 3-4 Compaq Insight Manager XE 3-4 Compaq Options ROMPaq 3-4 Compaq Operating - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 6
vi Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Cluster Planning continued Disk Drive Planning 4-18 Nonshared Disk Drives 4-18 Shared Disk Drives 4-18 Network Planning 4-19 Windows 2000 Advanced Server Hosts Files for an Ethernet Cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 7
5-40 Power Sequencing 5-41 Chapter 6 Cluster Management Cluster Management Concepts 6-2 Powering Off a Node Without Interrupting Cluster Services 6-2 Managing a Cluster in a Degraded Condition 6-2 Managing Network Clients Connected to a Cluster 6-3 Cluster Events 6-3 Management Applications - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 8
viii Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Cluster Management continued Adding a of the Dynamic Link Library NM.DLL Failed 7-8 Troubleshooting Node-to-Node Connectivity Problems 7-8 Nodes Are Unable to Communicate with Each Other - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 9
Contents ix Appendix A Diagnosing and Resolving Shared Disk Problems Introduction ...A-1 Run Object Link Manager On All Nodes A-3 Restart All Affected Cluster Software and Firmware Checks A-6 Perform Cluster Hardware Checks A-6 Contact Your Compaq Support Representative A-7 Glossary Index - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 10
Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide List of Figures Figure 1-1. Example of a six-node Compaq Parallel Database Cluster Model PDC/O1000 1-2 Figure 2-1. Fibre Host Adapters in a two-node PDC/O1000 cluster 2-7 Figure 2-2. Two-node PDC/O1000 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 11
interconnect for a two-node PDC/O1000 cluster 5-15 Figure 5-7. Server power distribution in a three-node cluster 5-40 Figure A-1. Tasks for diagnosing and resolving shared disk problems A-2 List of Tables Table 2-1 High-Availability Components of ProLiant Servers 2-3 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 12
configuration, implementation, management, and troubleshooting of the Compaq Parallel Database Cluster Model PDC/O1000 running Oracle8i software on the Microsoft Windows 2000 Advanced Server operating system. Audience The expected audience of this guide consists primarily of MIS professionals whose - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 13
the PDC/O1000. I Chapter 7, "Troubleshooting," contains troubleshooting information for the PDC/O1000. I Appendix A, "Diagnosing and Resolving Shared Disk Problems," describes procedures to diagnose and resolve shared disk problems. I Glossary contains definitions of terms used in this guide. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 14
These related manuals include, but are not limited to: I Documentation related to the ProLiant servers you are clustering (for example, guides, posters, and performance and tuning guides) I Compaq StorageWorks documentation G Compaq StorageWorks RAID Array 4000 User Guide G Compaq StorageWorks RAID - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 15
Manager Configuration Guide G Oracle Enterprise Manager Concepts Guide Supplemental Documents The following technical documents contain important supplemental information for the Compaq Parallel Database Cluster Model PDC/O1000: I Supported Ethernet Interconnects for Compaq Parallel Database - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 16
and GUI selections can appear in uppercase and lowercase letters. File Names, Command Names, Directory Names, Drive Names These elements can instructed to enter information, type the information and then press the Enter key. Symbols in Text These symbols may be found in the text of this guide - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 17
2000 Administrator Guide Symbols on Equipment These icons may be located on equipment in areas where hazardous conditions may exist. Any surface or area of the equipment marked with these symbols indicates the presence of electrical shock hazards. Enclosed area contains no operator serviceable parts - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 18
Help If you have a problem and have exhausted the information in this guide, you can get further information and other help in the following locations. Compaq Technical Support In North America, call the Compaq Technical Phone Support Center at 1-800-OK-COMPAQ. This service is available 24 hours - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 19
/O1000 for Oracle8i and Windows 2000 Administrator Guide Compaq Website The Compaq website has information on this product as well as the latest drivers and Flash ROM images. You can access the Compaq website by logging on to the Internet at www.compaq.com Compaq Authorized Reseller For the name of - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 20
software, thereby providing key clustering features at a lower price than proprietary clustering systems. Before examining the features and benefits of the Compaq Parallel Database Cluster Model PDC/O1000 (referred to here as the PDC/O1000), it is helpful to understand the concepts and terminology - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 21
1-2 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i on Windows 2000 Administrator Guide Clusters Defined A cluster is an integration of software and hardware products that enables a set of loosely coupled servers and shared storage subsystem components to present a - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 22
topologies for its shared storage I/O data paths. These two SAN topologies support the use of multiple non-redundant fabrics and loops, respectively. In has several primary causes: hardware faults, software faults, planned service, operator error, and environmental factors. Minimizing downtime is a - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 23
Database Cluster Model PDC/O1000 for Oracle8i on Windows 2000 Administrator Guide Compaq Parallel Database Cluster Overview As traditional clustering technology has moved into the open systems of client/server computing, Compaq has provided innovative, customer-focused solutions. The PDC/O1000 moves - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 24
to your computing environment. The hardware products include: I Compaq Proliant servers I Shared storage components G Compaq StorageWorks RAID Array 4100s (RA4100 Arrays) or Compaq StorageWorks RAID Array 4000s (RA4000 Arrays) G Compaq StorageWorks RAID Array 4000 Controller (RA4000 Array Controller - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 25
Guide G Gigabit Interface Converter-Shortwave (GBIC-SW) modules G Fibre Channel cables I Cluster interconnect components G Ethernet NIC adapters G Ethernet cables G Ethernet switches or hubs The software products include: I Microsoft Windows 2000 Advanced Server with Service Pack 1 or later I Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 26
cooling fans, and Error Checking and Correcting (ECC) memory. The high-availability features of ProLiant servers are a critical foundation of Compaq clustering products. Table 2-1 lists the high-availability features found in many ProLiant servers. Table 2-1 High-Availability Components of ProLiant - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 27
The RA4000 Array comes in either a rack-mountable or a tower model. For more information about the RA4000 Array, refer to the Compaq StorageWorks RAID Array 4000 User Guide. RA4100 Array The RA4100 Array is another shared storage solution for the PDC/O1000. Each non-redundant Fibre Channel Fabric or - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 28
to multiple shared storage devices. For more information about the RA4000 Array Controller, refer to the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Fibre Channel SAN Switch One Fibre Channel SAN Switch is installed between cluster nodes and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 29
PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide For further information, refer to these manuals provided with the Fibre Channel SAN Switch: I Compaq StorageWorks Fibre Channel SAN Switch 8 Installation and Hardware Guide I Compaq StorageWorks Fibre Channel SAN Switch 16 Installation and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 30
ports. With the addition of the 3-port Expansion Module (PEM), the switch supports 11 ports. For further information, refer to the Compaq StorageWorks Fibre Channel Arbitrated Loop Switch (FC-AL Switch) User Guide. Fibre Host Adapters Fibre Host Adapters are the interface between the cluster nodes - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 31
about the Fibre Channel Host Adapter, refer to the Compaq StorageWorks Fibre Channel Host Bus Adapter Installation Guide or the Compaq StorageWorks 64-Bit/66-MHz Fibre Channel Host Adapter Installation Guide. Gigabit Interface Converter-Shortwave Modules A Gigabit Interface Converter-Shortwave - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 32
, refer to the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. I/O Path Configurations in the Fibre Channel Arbitrated Loop (FC-AL) topology. The PDC/O1000 supports both topologies. Fibre Channel SAN Switches provide full 100 MBps bandwidth per - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 33
2-10 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Non-Redundant Fibre Channel Fabric The PDC/O1000 supports non-redundant Fibre Channel Fabrics. A non-redundant Fibre Channel Fabric provides one I/O path between each cluster node and its Fibre - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 34
each cluster node, multiple Fibre Host Adapters are used to connect the nodes to different sets of RA4000/RA4100 Arrays. NOTE: The PDC/O1000 supports the mixing of non-redundant Fibre Channel Fabrics and non-redundant FC-ALs in the same cluster. You would install additional non-redundant Fibre - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 35
2-12 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Adding a second non is restricted by the number of Fibre Host Adapters your Compaq ProLiant servers support. Refer to the Compaq ProLiant server documentation for this information. Figure 2-3 shows - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 36
Architecture 2-13 Maximum Distances Between Cluster Nodes and Shared Storage Subsystem Components in a Non-Redundant Fibre Channel Fabric By using standard short-wave Fibre Channel cables and GBIC-SW modules, an RA4000/RA4100 Array can be placed up to 500 meters from the Fibre Channel SAN Switch, - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 37
2-14 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Fibre Host Adapter-to-Fibre Channel SAN Switch Paths Figure 2-5 highlights the Insight Manager screens, and eventually to the device list. Refer to the Compaq Insight Manager Guide for details. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 38
remains safely stored on the physical disks inside the RA4000/RA4100 Array. As with the Fibre Host Adapter-to-Fibre Channel SAN Switch data path, Compaq Insight Manager detects this fault, changes the affected RA4000/RA4100 Array's status to "Failed," and changes its condition to red. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 39
2-16 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide I/O Path Configurations in a Non- for each port. When you use a FC-AL Switch, the FC-AL SAN supports multiple 100 MB/second point-to-point connections in parallel. The FC-AL Switch provides - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 40
Architecture 2-17 Each non-redundant FC-AL consists of the following hardware: I One Fibre Host Adapter in each node I One Storage Hub or FC-AL Switch I One or more RA4000/RA4100 Arrays, each containing one single-port RA4000 Array Controller I A GBIC-SW module installed in each Fibre Host Adapter, - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 41
2-18 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Using Multiple Non-Redundant Fibre Channel Arbitrated Loops The PDC/O1000 supports the use of multiple non-redundant FC-ALs within the same cluster. Physically, this means that within each cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 42
Architecture 2-19 Figure 2-8 shows a four-node PDC/O1000 cluster with two non-redundant FC-ALs. Each FC-AL has its own Fibre Host Adapter in every node, one Storage Hub or FC-AL Switch, and one or more RA4000/RA4100 Arrays. In Figure 2-8, the hardware components that constitute the second non- - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 43
2-20 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Maximum Distances Between Cluster Nodes and Shared Storage Subsystem Components in a Non-Redundant FC-AL By using standard short-wave Fibre Channel cables and GBIC- - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 44
the time required for the network clients to reconnect to the database through another node. Note that Compaq Insight Manager monitors the health of each RA4000/RA4100 Array. If any part of the I/O data path , and eventually to the device list. Refer to the Compaq Insight Manager Guide for details. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 45
2-22 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Storage Hub/FC-AL Switch-to- the Fibre Host Adapter-to-Storage Hub/FC-AL Switch data path, Compaq Insight Manager detects this fault, changes the affected RA4000/RA4100 Array's status to "Failed - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 46
interconnect, system area network (SAN), and private network. Throughout this guide, the term cluster interconnect is used. A PDC/O1000 cluster running NOTE: Refer to the technical white paper Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server (ECG062 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 47
2-24 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Non-Redundant Ethernet Cluster Interconnect Components The following components are used in a non-redundant Ethernet cluster interconnect: I One Ethernet adapter in each cluster node I Ethernet - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 48
the Ethernet cluster interconnect and the second port for the client LAN. Refer to the technical white paper Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server for detailed information about configuring redundant Ethernet cluster interconnects. This - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 49
2-26 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Ethernet Cluster Interconnect Diagrams Figure 2-12 shows the non-redundant Ethernet cluster interconnect components used in a two-node PDC/O1000 cluster. These components include a dual- - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 50
Architecture 2-27 Figure 2-13 shows another option for a non-redundant Ethernet cluster interconnect in a two-node PDC/O1000 cluster. These include an Ethernet adapter in each node connected by Ethernet cables to an Ethernet switch or hub. RA4000/4100 Array Storage Hub/Switch Ethernet Adapter - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 51
2-28 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Because Ethernet switches are required in PDC/O1000 clusters with three or more nodes, using an Ethernet switch instead of a crossover cable makes it easier - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 52
Architecture 2-29 Local Area Network NOTE: For the PDC/O1000, the client LAN and the cluster interconnect must be treated as separate networks. Do not use either network to handle the other network's traffic. Every client/server application requires a local area network, or LAN, over which client - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 53
modules (OSDs) and this Oracle software: I Oracle8i Enterprise Edition with the Oracle8i Parallel Server Option NOTE: For information about currently-supported software revisions for the, refer to the Compaq Parallel Database Cluster Model PDC/O1000 for Windows 2000 Certification Matrix at www - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 54
3-2 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Microsoft Windows 2000 Advanced Server This version of the PDC/O1000 supports only Microsoft Windows 2000 Advanced Server with Service Pack 1 or later. NOTE: The PDC/O1000 does not work in - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 55
. For information about the Array Configuration Utility, see the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Fibre Channel Fault Isolation Utility The SmartStart and Support Software CD also contains the Fibre Channel Fault Isolation Utility - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 56
PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Compaq Insight Manager Compaq Insight Manager, loaded from the Compaq Management CD, is a software utility used to collect information about the servers in the cluster. Compaq Insight Manager performs these functions: I Monitors server - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 57
for the PDC/O1000. Oracle Software The PDC/O1000 supports Oracle8i software. If you are using a release other than Oracle8i Release 8.1.7, confirm that the release has been certified for the PDC/O1000 on the Compaq website at www.compaq.com/solutions/enterprise/ha-pdc.html Oracle8i Server Enterprise - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 58
3-6 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Oracle8i Server Oracle8i Server the software components of the cluster. Hardware components are managed with Compaq Insight Manager. To conserve space for cluster resources (memory, processes), - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 59
Parallel Server must demonstrate the successful completion of the Oracle8i Parallel Server for Windows 2000 Certification. Neither Oracle nor Compaq will support any implementation of Oracle8i Parallel Server that does not strictly conform to the configurations certified with this process. For - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 60
4 Chapter Cluster Planning Before connecting any cables or powering on any hardware on your Compaq Parallel Database Cluster Model PDC/O1000 (referred to here as the PDC/O1000), it is important that you understand how all the various cluster components - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 61
4-2 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Site Planning You must carefully select and and qualified personnel I Space for unpacking, installing, and servicing the computer equipment I Sufficient floor strength for the computer equipment - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 62
, the failure of one node leaves the one remaining node to service all clients. This could result in an unacceptable level of performance. supported by the Compaq Parallel Database Cluster. For a current list of PDC/O1000-certified servers and details on supported configurations, refer to the Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 63
2000 Administrator Guide Planning Shared Storage Components for Non-Redundant Fibre Channel Fabrics Several key components make up the shared storage subsystem for the PDC/O1000. Each non-redundant Fibre Channel Fabric in a PDC/O1000 uses these hardware components: I One Compaq StorageWorks 64 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 64
Channel Arbitrated Loop (FC-AL) in a PDC/O1000 uses these hardware components: I One Fibre Host Adapter in each node I One Compaq StorageWorks Storage Hub (Storage Hub) or Compaq StorageWorks FC-AL Switch (FC-AL Switch) I One or more RA4000 Arrays or RA4100 Arrays I One single-port RA4000 Array - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 65
4-6 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Planning Cluster Interconnect and Client LAN Components cluster interconnects. This document is available at www.compaq.com/support/techpubs/whitepapers Before you install an Ethernet cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 66
midsize and larger clusters that use non-redundant Fibre Channel Fabrics. IMPORTANT: Use the Oracle documentation identified in the front matter of this guide to obtain detailed information about planning for the Oracle software. Once the required level of performance, the size of the database, and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 67
4-8 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Sample Midsize Cluster with One Non-Redundant Fibre Channel Fabric Figure 4-1 shows an example of a midsize PDC/O1000 cluster with one non-redundant Fibre Channel - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 68
Cluster Planning 4-9 Sample Large Cluster with One Non-Redundant Fibre Channel Fabric Figure 4-2 shows an example of a larger PDC/O1000 cluster with one non-redundant Fibre Channel Fabric that contains six cluster nodes and six RA4000/RA4100 Arrays. RA4000/4100 Arrays (6) Node 5 Node 3 Node 1 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 69
4-10 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Planning Cluster IMPORTANT: Use the Oracle documentation identified in the front matter of this guide to obtain detailed information about planning for the Oracle software. Once the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 70
Cluster Planning 4-11 The sample midsize cluster configuration shown in Figure 4-3 contains these hardware components: I Four ProLiant servers (cluster nodes) I One Fibre Host Adapter in each cluster node I One Storage Hub or FC-AL Switch installed between the Fibre Host Adapters and the shared - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 71
4-12 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide The larger configuration shown in Figure 4-4 contains these hardware components: I Six ProLiant servers (cluster nodes) I One Fibre Host Adapter in each cluster node I One Storage - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 72
on shared storage arrays, you use the hardware RAID to perform such functions as making copies of the data or calculating checksums. Use the Compaq Array Configuration Utility to implement RAID on your logical disks. NOTE: Do not use the software RAID offered by the operating system to configure - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 73
4-14 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Supported RAID Levels RAID provides several fault-tolerant options to protect your cluster's shared data. However, each RAID level offers a different mix of performance, reliability, and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 74
Cluster Planning 4-15 Raw Data Storage and Database Size Raw data storage is the amount of storage available before any RAID levels have been configured. It is called raw data storage because RAID volumes require some overhead. The maximum size of a database stored in a RAID system will always be - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 75
4-16 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Selecting the Appropriate RAID Levels Many factors affect which RAID levels you select for your cluster database. These include the specific availability, performance, reliability, and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 76
Drive Drive Drive Drive Drive Drive Drive Drive Create logical drive arrays with Compaq Array Configuration Utility RAID 5 Disk Array RAID 1 Disk Array RAID 1 the information on drive arrays in the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 77
Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide the Oracle Parallel Server application files are stored on these support fault tolerance (for example, RAID 0), then the failure of the shared disk drives in that logical drive will disrupt service - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 78
an Ethernet Cluster Interconnect When an Ethernet cluster interconnect is installed between cluster nodes, the Compaq operating system dependent modules (OSDs) require a unique entry in the hosts and lmhosts files located at %SystemRoot%\system32\drivers\etc for each network port on each node. Each - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 79
4-20 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Client LAN Physically, the structure of the client network is no different than that used for a nonclustered configuration. To ensure continued access to the database - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 80
Configuration This chapter provides instructions for installing and configuring the Compaq Parallel Database Cluster Model PDC Compaq StorageWorks RAID Array 4000 User Guide I Compaq StorageWorks RAID Array 4100 User Guide I Compaq StorageWorks Fibre Channel Host Adapter Installation Guide or Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 81
Guide I Compaq StorageWorks Fibre Channel SAN Switch Management Guide I Compaq SmartStart Installation poster I Compaq SmartStart and Support Software CD I Microsoft Windows 2000 Advanced Server Administrator's Guide I Microsoft Windows 2000 Advanced Server CD with Service Pack 1 or later I Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 82
configuring operating system software, including: G SmartStart 4.9 or later G Microsoft Windows 2000 Advanced Server with Service Pack 1 or later I Installing and configuring the Compaq operating system dependent modules (OSDs), including: G Using Oracle Universal Installer to install OSDs for an - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 83
the same PCI slots in each server. While setting up the physical hardware, follow the installation instructions in your Compaq ProLiant Server Setup and Installation Guide and in your Compaq ProLiant Server installation poster. When you are ready to install the Fibre Host Adapters and your cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 84
a Fibre Host Adapter to a Storage Hub, FC-AL Switch or Fibre Channel SAN Switch, do not mount the Fibre Channel cables on cable management arms. Support the Fibre Channel cable so that a bend radius at the cable connector is not less than 3 inches. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 85
Compaq StorageWorks Fibre Channel SAN Switch Management Guide provided with the Fibre Channel SAN Switch. Installing the Cluster Interconnect Adapters A PDC/O1000 running Oracle8i software uses an Ethernet cluster interconnect. Both redundant and non-redundant cluster interconnects are supported - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 86
Certification Matrix for Windows 2000 at www.compaq.com/solutions/enterprise/ha-pdc.html If you need specific instructions on how to install an Ethernet adapter, refer to the documentation of the Ethernet adapter you are installing or refer to the user guide of the ProLiant server you are using - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 87
O1000 for Oracle8i and Windows 2000 Administrator Guide Setting Up the RA4000/RA4100 Arrays Unless otherwise indicated in this guide, follow the instructions in the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide to set up shared storage subsystem - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 88
5-9 Installing GBIC-SW Modules for the RA4000 Array Controller For the PDC/O1000, each RA4000/RA4100 Array contains one single-port Compaq StorageWorks RAID Array 4000 Controller (RA4000 Array Controller) and ships with GBIC-SW modules. Insert one module into the RA4000 Array Controller - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 89
5-10 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Installing Additional Fibre Channel Fabrics or FC-ALs At this point, you have installed the hardware for one non-redundant Fibre Channel Fabric or one - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 90
Installation and Configuration 5-11 Figure 5-3 shows a PDC/O1000 with two non-redundant Fibre Channel Fabrics or two non-redundant FC-ALs. The hardware for the second Fibre Channel Fabric or FC-AL is shaded. NOTE: You can mix non-redundant Fibre Channel Fabrics and non-redundant FC-ALs in the same - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 91
5-12 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide The following components are used in a redundant Ethernet cluster interconnect: I Two Ethernet adapters in each cluster node I Ethernet cables and switches or hubs G For two- - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 92
Installation and Configuration 5-13 Figure 5-4 shows the non-redundant Ethernet cluster interconnect components used in a two-node PDC/O1000 cluster. These components include a dual-port Ethernet adapter in each node. The top port on each adapter connects by Ethernet crossover cable to the top port - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 93
5-14 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Figure 5-5 shows another option for a non-redundant Ethernet cluster interconnect in a two-node PDC/O1000 cluster. These include an Ethernet adapter in each node connected - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 94
clusters of three or more nodes using a redundant Ethernet cluster interconnect, Compaq requires that you use two Ethernet 100-Mbit/sec switches to maintain good one Ethernet path to another, see Supported Ethernet Interconnects for Compaq Parallel Database Clusters Using Oracle Parallel Server at - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 95
Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Cabling the Client LAN You can use any TCP/IP network to connect to a client LAN. The following procedure contains instructions between the nodes is not supported. For information on configuring - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 96
are installed and cabled before you install the software. I Power on the cluster as instructed later in this chapter in "Power Distribution and Power Sequencing Guidelines." I SmartStart runs the Compaq Array Configuration Utility, which is used to configure the drives in the RA4000/RA4100 Arrays - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 97
Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide I Be sure to set up unique IP addresses and node names for each node in the hosts and lmhosts files and Support Software CD 4.9 or later I Microsoft Windows 2000 Advanced Server with Service Pack - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 98
Hubs, FC-AL Switches, or Fibre Channel SAN Switches G Ethernet hubs or switches 2. Power up a cluster node and put the SmartStart and Support Software CD into the CD-ROM drive. 3. Select the Assisted Integration installation path. 4. When prompted, insert the Server Profile diskette into the floppy - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 99
Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide 9. Enter unique IP addresses and node names for each node in the hosts and lmhosts files dialog box for the client LAN port and you are using Service Pack 1 or later: a. Double-click the Network and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 100
assigned to them. You will need this information later when installing Compaq OSDs. 12. If you are installing node1, open Disk Management more information on creating partitions, see the Oracle8i Parallel Server Setup and Configuration Guide. 13. If you are installing a node other than node1, open - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 101
Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Installing Compaq OSDs Use the Oracle Universal Installer (OUI) program to install the Compaq operating system dependent modules (OSDs) for Oracle8i Parallel Server. Compaq supplies a software package with the OUI that installs - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 102
cluster interconnect address. If the ping utility does not return the expected IP addresses, check the entries in the hosts and lmhosts files at %SystemRoot%\system32\drivers\etc. For example, the command ping node1 should return the following type of information. Pinging node1.loc1.yoursite - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 103
5-24 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide To mount drives on remote nodes, enter each node before installing the OSDs. 2. Insert the Compaq Parallel Database Cluster Clustering Software for Oracle8i on Microsoft Windows 2000 CD into the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 104
Installation and Configuration 5-25 3. If autorun is enabled, the Oracle Universal Installer Welcome screen appears. If autorun is disabled, enter d:\setup at a C: prompt. Substitute the letter assigned to the CD drive for d. The Oracle Universal Installer Welcome screen appears. NOTE: The OUI - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 105
5-26 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide 4. Click Next to continue. The License screen appears. 5. Click Accept to accept the terms of the license agreement. The File Locations screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 106
Installation and Configuration 5-27 6. Click Next to continue. The Installation Types screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 107
Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide 7. Select Typical to install the Ethernet OSDs into the default location, C:\Compaq\OPS. Skip to step 12. 8. Select Custom to install the Ethernet OSDs into a location of your choice. The Component Locations - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 108
Installation and Configuration 5-29 9. If you want to accept the default location, skip to step 13. 10. If you want to specify an alternate location and you know the exact directory path, specify it by typing over the default location and skip to step 12. 11. If you want to specify an alternate - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 109
5-30 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide 12. Browse to the location where you want to install the OSDs. Click OK. The Component Locations screen appears indicating the alternate location you specified. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 110
Installation and Configuration 5-31 13. Click Next to continue. The Cluster Members screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 111
5-32 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide 14. The Cluster Members screen indicates the host name of the installing machine. Define the node names for the client LAN by adding the node names you specified in the hosts and lmhosts files for - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 112
a cluster interconnect node name. If necessary, retype the cluster interconnect node names to match the names you entered into the hosts and lmhosts files for the Ethernet cluster interconnect. Do not use special characters. Separate the node names with a space. 17. Click Next to continue. The OSD - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 113
5-34 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide 18. If the information on the OSD Summary screen is not correct, click Previous to modify the previous screens. When the information is correct, click Next to continue. The Summary screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 114
Exit to quit the OUI or Next Install to install another product. 23. Start the cluster manager, OracleCMService, on all nodes in the cluster. This service must be started before installing Oracle software. See the Oracle documentation for information on starting the cluster manager. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 115
Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Installing Oracle Software Using the Oracle8i Parallel Server Setup and Configuration Guide Oracle8i documentation instructs you to disk partitions and Oracle data files. Failure to install Object Link - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 116
Oracle database software to ensure that the symbolic links are defined before creating a database. For instructions on installing and using Object Link Manager, see the readme file on the Compaq Parallel Database Cluster Clustering Software for Oracle8i on Microsoft Windows 2000 CD at \Object Link - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 117
and lmhosts files at %SystemRoot service did not start successfully, make sure that the OracleCMService is started and the SID is in the Oracle registry. There are two logs that can provide information about why the Oracle service did not start. These logs are: I \Compaq\OPS\cmsrvr.log I \Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 118
and is running, select the Services icon in the Control Panel. Once there, look for Oracle Object Service in the list of services and see if it is It is recommended you connect most PDC/O1000 cluster components to a Compaq power distribution unit (PDU). PDUs connect to an uninterruptible power supply - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 119
5-40 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Server Power Distribution Figure 5-7 shows an example of server power distribution for a three-node PDC/O1000 cluster. Power supply #1 of each server is connected to - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 120
Installation and Configuration 5-41 Power Sequencing Be sure to power up the cluster components in the following order: 1. RA4000/RA4100 Arrays 2. Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches (Power is applied to a Storage Hub when the AC power cord is plugged in.) 3. Ethernet hubs or - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 121
ongoing activities. This chapter describes these management activities for the Compaq Parallel Database Cluster Model PDC/O1000 (referred to here this chapter contain high-level instructions. The instructions summarize what has either already been discussed in this guide, Oracle documentation, or - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 122
Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Cluster Management Concepts Powering Off a Node Without Interrupting Cluster Services degraded condition, it is helpful to follow this troubleshooting process: 1. Determine what caused the degradation. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 123
to repair the problem. G If the problem is not considered to be critical, wait until a non-peak time to service the problem. G If the problem is critical can be viewed either within the System log or within specific error log files. The Oracle8i Server events are sent to the Application log and can - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 124
PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide The following log files are used: I The Node Manager (NM), provided by Compaq, logs messages to C:\compaq\ops\nm.log I By default the OracleCMService sends messages to C:\compaq\ops\cmsrvr.log Management Applications Monitoring Server and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 125
is available on the SmartStart and Support Software CD, which is found in the Compaq Server Setup and Management pack. For additional information about the ACU, see the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide. Disk Management is first run - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 126
6-6 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide I Gigabit Interface Converter-Shortwave (GBIC-SW) modules device on an FC-AL. FFIU is on the SmartStart and Support Software CD. Monitoring the Database Oracle8i Enterprise Manager uses agents to - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 127
Guide I Oracle8i Parallel Server Concepts I Oracle8i Parallel Server Administration, Deployment, and Performance Oracle8i Enterprise Manager and its corresponding documentation are shipped as part of Oracle8i Enterprise Edition. Remotely Managing a Cluster Oracle8i Enterprise Manager, Compaq - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 128
6-8 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Software Maintenance for Oracle8i Be sure to shut down the Oracle instance on all nodes and stop the Oracle services running on all nodes prior to removing the OSDs. To deinstall the OSDs: 1. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 129
Cluster Management 6-9 4. If autorun is disabled, enter d:\setup at a C: prompt. Substitute the letter assigned to the CD-ROM drive for d. The Oracle Universal Installer Welcome screen appears. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 130
Windows 2000 Administrator Guide 5. Click Deinstall Products. Next, a window containing an inventory of the installed components appears. The following shows the Inventory screen that is displayed when Ethernet is used for the cluster interconnect. 6. To deinstall OSDs, select Compaq Ethernet OSDs - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 131
the operation of the cluster. Before upgrading to any new release of Oracle8i Server, consult your Compaq and Oracle service representatives. Make sure that the new release is certified and supported on the PDC/O1000, and get assistance to determine which procedure you should follow to perform the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 132
6-12 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Upgrading the Ethernet OSDs To upgrade the Ethernet OSDs: 1. Insert the CD containing the new revision of the OSDs into the CD-ROM drive on - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 133
installation (by removing it) before you can successfully run the Oracle Universal Installer again. To remove a partial OSD installation: 1. Insert the Compaq Parallel Database Cluster Clustering Software for Oracle8i on Microsoft Windows 2000 CD into the CD-ROM drive of a cluster node. 2. From - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 134
6-14 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide 4. Run the uninstall utility by entering: of Oracle8i Server, consult your Compaq and Oracle service representatives. Make sure that the new release is certified and supported on the PDC/O1000, and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 135
follow the rules described in the Compaq StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide can result in loss of data. the new data files to the database. Refer to the Oracle8i Parallel Server Setup and Configuration Guide for more detailed instructions. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 136
seen from every node in the cluster by running Disk Management on each node. 14. Perform the necessary Oracle commands to associate the new data files to the database. Refer to the Oracle8i Parallel Server Setup and Configuration Guide for more detailed instructions. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 137
Host Adapter To replace a failed Fibre Host Adapter in a cluster node: 1. Shut down the Oracle instance on the node. 2. Shut down the Oracle services running on the node. 3. Shut down the server. 4. Power off the node. 5. From the Fibre Host Adapter, disconnect the Fibre Channel cable installed - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 138
PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Replacing a Cluster Node Before replacing a node, verify that the new configuration is supported by the PDC/O1000 cluster. To determine if your new server is supported, see the Compaq Parallel Database Cluster Model PDC/O1000 Certification - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 139
of the steps to follow. If you need detailed instructions, read Chapter 5, "Installation and Configuration." Preparing the Replacement Service Pack 1 or later (whichever is installed on the other cluster nodes). 6. Install necessary Compaq drivers and utilities from the Compaq SmartStart and Support - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 140
Guide 7. Install the Fibre Host Adapter or Fibre Host Adapters in the replacement node in the same server PCI slot locations used in the other cluster nodes. 8. Enter unique IP addresses and node names for each node in the hosts and lmhosts files . b. Stop all Oracle services. c. Deinstall the OSDs - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 141
on all nodes: a. Shut down the Oracle instance. b. Stop all Oracle services. c. Uninstall the OSDs from each node by running uninstallOSD, located in the the new configuration is supported by the PDC/O1000. To determine if your new server is supported, see the Compaq Parallel Database Cluster Model - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 142
of the steps to follow. If you need detailed instructions, read through Chapter 5, "Installation and Configuration." Preparing the Service Pack 1 or later (whichever is installed on the other cluster nodes). 6. Install all necessary Compaq drivers and utilities from the Compaq SmartStart and Support - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 143
for adding a new node: 1. Add the unique IP addresses and node names for the new node in the hosts and lmhosts files of each existing cluster node. These files are located at %SystemRoot%\system32\drivers\etc. 2. Verify TCP/IP connectivity between the new node and the existing cluster nodes. Run - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 144
Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Oracle instance. b. Stop all Oracle services. c. Deinstall the OSDs by running files and additional rollback segments to the database. After the new partitions are created for the log files - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 145
by each node, which signifies a need to adjust the distribution of the workload so that the overall cluster performance is maximized. I Compaq Insight Manager and Compaq Insight Manager XE can be used to gather low-level, in-depth hardware statistics for the server and networking hardware components - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 146
chapter addresses potential problems you might encounter as you install, configure, test, and operate your Compaq Parallel Database Cluster Model PDC/O1000 (referred to here as the PDC/O1000). This chapter is organized as follows: I Basic troubleshooting tips I Troubleshooting Oracle8i and operating - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 147
Oracle8i and Windows 2000 Administrator Guide Basic Troubleshooting Tips Power Verify that the following are all powered on: I ProLiant servers (cluster nodes) I StorageWorks RAID Array 4000s (RA4000 Arrays) or StorageWorks RAID Array 4100s (RA4100 Arrays) I Compaq StorageWorks Fibre Channel SAN - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 148
Troubleshooting 7-3 , refer to Appendix A, "Diagnosing and Resolving Shared Disk Problems" for more detailed guidelines. Software Revisions The following software components Array Controller drivers I Compaq Ethernet OSDs I Microsoft Windows 2000 Advanced Server, including Service Pack 1 or later - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 149
PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide For information about currently supported software revisions for the PDC/O1000, refer to the Compaq Parallel Database Cluster Model PDC/O1000 Certification Matrix for Windows 2000 at www.compaq.com/solutions/enterprise/ha-pdc.html Depending - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 150
Troubleshooting 7-5 Troubleshooting Oracle8i and OSD Installation Problems and Error Messages Potential Difficulties Installing the OSDs with the Oracle Universal Installer I The Oracle Universal Installer (OUI) uses an inventory file to track which components of the OSDs have been installed on each - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 151
7-6 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide I Determine whether or not Manager Service, OracleNMService, is running. If not, see the error logs in C:\compaq\ops\nm.log. If OracleNMService is running, check the CM Server logs in C:\compaq\ops - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 152
and Resolving Shared Disk Problems" for detailed guidelines. I Verify that all files created by Net8 Config Assistant were transferred properly to each respective node. I Verify the connections and accessibility of the cluster components. Refer to the "Basic Troubleshooting Tips" section in this - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 153
Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Initialization Services screen. Locate each service in the displayed list, highlight it, then stop it. Finally, highlight the service and restart it. Troubleshooting Node-to-Node Connectivity Problems - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 154
Troubleshooting 7-9 When Using an Ethernet Cluster Interconnect I Make sure that the Ethernet you are using the recommended method of using static IP addresses, ensure that the hosts file and lmhosts files are properly set up. When Using an Ethernet Cluster Interconnect I Make sure that the - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 155
Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide services have started without error. From the Services screen, scan the list of services and check to see if the Oracle services Disk Problems." Troubleshooting Client-to-Cluster Connectivity Problems A - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 156
Troubleshooting 7-11 I Make sure that the TNSNames.ora file is properly configured on client and cluster nodes as defined by the Oracle Net8 Config Assistant utility. I Make sure that the Oracle TNSListener is running on the cluster nodes. From the Services screen, verify that Oracle TNSListener is - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 157
Fibre Channel Host Adapter Installation Guide or the Compaq StorageWorks 64-bit/66-MHz Fibre Channel Host Adapter Installation Guide for installation instructions. I Determine whether or not hardware errors or communications transport failures are causing the problem. Use the Event Viewer to - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 158
drive volumes can be accurately viewed from Disk Management on each node. I If you continue to have problems, refer to Appendix A, "Diagnosing and Resolving Shared Disk Problems," for further information. Also refer to the Compaq Fibre Channel Troubleshooting Guide for further corrective actions. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 159
7-14 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide A Cluster Node Cannot Connect to the Shared Drives I Verify that a physical connection exists to the RA4000/RA4100 Arrays, refer to Appendix A, "Diagnosing and Resolving Shared Disk Problems." - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 160
the PDC/O1000) cannot properly join the cluster, you need to consider two possible causes: I A problem related to the shared disk storage in the cluster's Compaq StorageWorks RAID Array 4000s (RA4000 Arrays) or Compaq StorageWorks RAID Array 4100s (RA4100 Arrays) is preventing one or more nodes from - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 161
Manager On All Affected Nodes Exit. Problem Fixed or No Further Disk Problems Perform Cluster Software OK and Firmware Checks Problem Persists Problem Persists Perform Cluster Hardware Checks OK Problem Persists Contact Your Compaq Support Representative Figure A-1. Tasks for diagnosing and - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 162
Nodes in the Cluster" in this appendix for further instructions. For instructions on installing and using Object Link Manager, see the readme file: \Object Link Manager\readme.txt This file is located on the Compaq Parallel Database Cluster Clustering Software for Oracle8i on Microsoft Windows - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 163
A-4 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Restart All Affected Nodes in service is properly installed on the node. For instructions on installing and using Object Link Manager, refer to this readme file contained on the Compaq Parallel - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 164
Diagnosing and Resolving Shared Disk Problems A-5 Run Disk Management On All Nodes Perform these steps from each node: 1. From Disk Management, verify that each RA4000 Array or RA4100 Array is visible. 2. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 165
Administrator Guide Perform Cluster Software and Firmware Checks Use the Compaq SmartStart and Support Software CD problems exist. Check the event log for disk I/O error messages or indications of problems with the communications transport. 2. Determine whether or not the ProLiant servers support - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 166
4100 User Guide. 7. Verify that all Fibre Host Adapters, RA4000 Array Controllers, and RA4000/RA4100 Array shared disk modules are properly installed and seated in their receptacles. Contact Your Compaq Support Representative If you are unable to resolve the problem, contact your Compaq support - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 167
as a single system. Clustering is a way to improve availability and scalability. The period of time that a computer system is unable to service clients' requests. A standard network protocol that operates mostly on a physical level, using network interface cards and cabling to transmit data between - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 168
2 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Fibre Channel Fibre Channel Arbitrated Loop (FC also called the cluster heartbeat. The Compaq Parallel Database Cluster interconnect is dedicated to servicing requests only between cluster nodes. An - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 169
the network. An individual server in a cluster. New Technology File System. A file organization system by which data is stored and accessed in a Enterprise Edition. The component is responsible for enabling parallel database support. An additional license is required for Oracle8i Parallel Server. - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 170
4 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide Reliability Resource Scalability Service Shared resource Shared storage System UPS The continuous integrity of a system (server, storage, network, or cluster). A software or hardware entity upon - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 171
Array Configuration Utility automated installation for Windows 2000 Advanced Server 5-18 availability defined 1-3 features of Compaq ProLiant Servers 2-3 C cabling client LAN 5-16 Ethernet cluster interconnect 5-11, 5-15 Fibre Host Adapters 5-5 capacity planning client LAN 4-7 cluster interconnect - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 172
2 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide redundant 5-7, 5-16 transmissions management 2-23 Ethernet cluster interconnect 2-23 options 2-23 troubleshooting 7-8 types supported 1-3 cluster management overview 6-1 remote 6-7 cluster manager, - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 173
with 6-5 overview 3-3 Index 3 running to check for shared disk problems A-5 troubleshooting shared storage with 7-13 using to set up RA4000/4100 Arrays 5-8 Compaq authorized reseller xx Compaq Full Spectrum Fault Management 3-4 Compaq Insight Manager for RA4000 External Storage Subsystem 2-15, 2-22 - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 174
Administrator Guide Compaq Options ROMPaq, overview 3-4 Compaq Parallel Database Cluster, overview 1-4 Compaq SmartStart and Support software 3-2 Compaq SmartStart and Support Software CD 3-2 Compaq software overview Compaq Array Configuration Utility 3-3 Compaq Insight Manager 3-4 Compaq Insight - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 175
Disk Management running to check for shared disk problems A-5 verifying shared storage 5-21 distributed lock manager 2-23 downtime 1-3 non-redundant FC-AL 2-16 topology overview 2-16 FC-AL Switches See Compaq StorageWorks FC-AL Switches description 2-7 FFIU See Fibre Channel Fault Isolation Utility - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 176
for Oracle8i and Windows 2000 Administrator Guide Fibre Host Adapters See Compaq StorageWorks Fibre Channel Host Bus Adapters additional sources xix Compaq authorized resellers, telephone numbers xx Compaq website xx technical support telephone numbers xix hosts files for Ethernet cluster - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 177
system dependent modules See Compaq operating system dependent modules Index 7 operating system software installing for Windows 2000 Advanced Server 5-17 versions supported 3-2 Oracle software certification for Oracle8i 3-7 configuring for Oracle8i 5-36 installation troubleshooting for Oracle8i - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 178
Arrays adding to a cluster 6-16 RA4000/RA4100 Arrays availability features 2-9 troubleshooting 7-11 RA4100 Arrays See Compaq StorageWorks RAID Array 4100s RAID nonshared disk drives 4-18 planning 4-12 selecting RAID levels 4-16 supported RAID levels 4-14 RAID planning overview 4-12 raw data storage - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 179
45 receptacle xviii ROMPaq See Compaq Options Rompaq S SCU See Compaq System Configuration Utility Service Packs for Windows 2000 Advanced Server supported for the PDC/O1000 5-18 versions supported 3-2 shared disk problems contacting your Compaq support representative A-7 introduction A-1 performing - Compaq ProLiant 6400R | Compaq Parallel Database Cluster Model PDC/O1000 for Ora - Page 180
10 Compaq Parallel Database Cluster Model PDC/O1000 for Oracle8i and Windows 2000 Administrator Guide cluster degradation 6-2 cluster interconnect 7-8 storage 7-11 summary of potential problems 7-1 unable to start database for Oracle8i 7-7 troubleshooting tips accessibility of resources 7-3 firmware
Parallel Database Cluster Model
PDC/O1000 for Oracle8
i
and
Windows 2000
Administrator Guide
Second Edition (June 2001)
Part Number 225083-002
Compaq Computer Corporation