HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 5

About This Manual

This manual describes the Myricom Myrinet system interconnects used in some

HP Cluster Platform solutions.

This manual does not describe the procedures and tools that are required to install

and configure the system hardware or software. It does contain references for

cluster components that have their own documentation.

Audience

This manual is intended for experienced hardware system administrators. The

information in this manual assumes that the end user:

•

Is familiar with HP rack-mounted servers and associated rack hardware

•

Is familiar with basic networking concepts, network switch technology, and

network cables

•

Is familiar with HP cluster architecture and concepts

Organization

This manual is organized as follows:

Chapter 1

Presents an overview of the Myrinet-2000

system interconnects.

Chapter 2

Presents an explanation of the Myricom PCI

cards.

Chapter 3

Describes the 8-port infiniband and gigabit

ethernet switch cards, spine cards and

monitoring line cards.

Chapter 4

Presents an explanation of the LEDs and

some diagnostic procedures.

Chapter 5

Provides instructions for replacing some

components in the system interconnect.

Chapter 6

Describes how to power up the system

interconnect, its operating temperatures

and its specificiations.

Additional documentation

More information about cluster components can be found in the documentation set

that shipped with your cluster. More information about the Myricom interconnects

can be found on the Myricom Web site,

http://www.myri.com

. You can search

for additional HP documents online at

http://docs.hp.com

.

Providing feedback

HP welcomes your comments on this manual. Please send your comments and

suggestions by email to [email protected].

About This Manual

v

Section	Page
Table of Contents	1
Audience	5
Organization	5
Additional documentation	5
Providing feedback	5
Symbols in text	6
Myrinet interconnect overview	7
1.1 Interconnect characteristics	7
Figure 1-1: Fat Tree Topology	7
1.2 Backplane and chassis types	8
Figure 1-2: Myrinet System Interconnect Backplane	8
Figure 1-3: Federated Configuration Switches	8
Figure 1-4: Nonfederated Configuration Switch	9
Figure 1-5: 128-Port Myrinet System Interconnect	10
1.3 Wiring rules	10
Figure 1-6: Fully Populated 128-Port Myrinet System Interconnect	11
PCI cards	13
2.1 General characteristics	13
Figure 2-1: PCI Identification Label	13
2.2 Single-port XP PCI card	14
Figure 2-2: Single-port XP PCI Rev. D card	14
2.3 Dual-port 2XP PCI	15
Figure 2-3: Myricom 2XP PCI Rev. E card	16
2.4 Single-port 2XP PCI	17
Figure 2-4: Myricom 2XP PCI Rev. F card	18
Switch, spine and monitoring line cards	19
3.1 Switch card	19
Figure 3-1: Myrinet system Interconnect 8-port switch card	19
Figure 3-2: External features of the Myrinet system interconnect	19
Figure 3-3: Myrinet system interconnect 8-Port GigE switch card	20
Figure 3-4: Block Diagram of the gigabit ethernet switch card	21
3.2 Spine card	21
Figure 3-5: Spine Card Block Diagram	22
3.3 Monitoring line card	22
Figure 3-6: Monitoring Line Card	23
Figure 3-7: External Features of the Monitoring Line Card	23
LED indications and diagnostics	25
4.1 Line card and PCI LEDs	25
4.2 Using LEDs for diagnostics	25
4.3 Using the monitoring line card for diagnostics	26
Replacing components	29
5.1 Installing a monitoring line card	29
5.2 Removing and installing an 8-port line card	30
Figure 5-1: Unlocking Switch Card Handles	30
Figure 5-2: Ejecting a Switch Card	31
Figure 5-3: Sliding a Switch Card	31
Figure 5-4: Backplane Power Connector	31
5.3 Replacing a fan tray	32
Figure 5-5: Removing a Fan Tray	32
5.4 Replacing an interconnect chassis	33
Powering up procedure	39

HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 5

Audience, Organization, Additional documentation, Providing feedback, HP Cluster Platform solutions.

Page 5 highlights