HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 20

Item

Description

3

Port identification number

4

Type LC fiber port

Figure 3-3 identifies the external features of the Myrinet system interconnect

8-port GigE switch card. Each GigE port has two green LEDs in the RJ45

connector. The right LED indicates link activity, and the left LED indicates traffic.

Figure 3-3: Myrinet system interconnect 8-Port GigE switch card

8

9

10

11

12

13

14

15

Item

Description

1

Card latch in unlocked position.

2

Switch card power status light.

3

RJ45 Ethernet port.

4

Port LEDs. The right LED indicates link activiy, and the left LED

indicates traffic.

5

Port identification number, which is used as part of the port ID string

for point-to-point cabling.

Every 8-port switch card in the system interconnect is numbered 8–15. This is

normal. The port number on the panel of the line card is only one element used to

identify a port. In port numbering discussions, a port is uniquely identified by the

rack number, chassis number, slot number, and the line card port number.

The backplane interface includes 8 SAN-2000 links numbered 0-7, corresponding

to the port numbering of the XBar16. Figure 3-4 shows the backplane of the GigE

switch card, and Figure 3-5 shows the backplane of the fiberoptic switch card. The

backplane interface also includes dual +12V power, and a serial-link interface to

the monitoring line card.

3-2

Switch, spine and monitoring line cards

Section	Page
Table of Contents	1
Audience	5
Organization	5
Additional documentation	5
Providing feedback	5
Symbols in text	6
Myrinet interconnect overview	7
1.1 Interconnect characteristics	7
Figure 1-1: Fat Tree Topology	7
1.2 Backplane and chassis types	8
Figure 1-2: Myrinet System Interconnect Backplane	8
Figure 1-3: Federated Configuration Switches	8
Figure 1-4: Nonfederated Configuration Switch	9
Figure 1-5: 128-Port Myrinet System Interconnect	10
1.3 Wiring rules	10
Figure 1-6: Fully Populated 128-Port Myrinet System Interconnect	11
PCI cards	13
2.1 General characteristics	13
Figure 2-1: PCI Identification Label	13
2.2 Single-port XP PCI card	14
Figure 2-2: Single-port XP PCI Rev. D card	14
2.3 Dual-port 2XP PCI	15
Figure 2-3: Myricom 2XP PCI Rev. E card	16
2.4 Single-port 2XP PCI	17
Figure 2-4: Myricom 2XP PCI Rev. F card	18
Switch, spine and monitoring line cards	19
3.1 Switch card	19
Figure 3-1: Myrinet system Interconnect 8-port switch card	19
Figure 3-2: External features of the Myrinet system interconnect	19
Figure 3-3: Myrinet system interconnect 8-Port GigE switch card	20
Figure 3-4: Block Diagram of the gigabit ethernet switch card	21
3.2 Spine card	21
Figure 3-5: Spine Card Block Diagram	22
3.3 Monitoring line card	22
Figure 3-6: Monitoring Line Card	23
Figure 3-7: External Features of the Monitoring Line Card	23
LED indications and diagnostics	25
4.1 Line card and PCI LEDs	25
4.2 Using LEDs for diagnostics	25
4.3 Using the monitoring line card for diagnostics	26
Replacing components	29
5.1 Installing a monitoring line card	29
5.2 Removing and installing an 8-port line card	30
Figure 5-1: Unlocking Switch Card Handles	30
Figure 5-2: Ejecting a Switch Card	31
Figure 5-3: Sliding a Switch Card	31
Figure 5-4: Backplane Power Connector	31
5.3 Replacing a fan tray	32
Figure 5-5: Removing a Fan Tray	32
5.4 Replacing an interconnect chassis	33
Powering up procedure	39

HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 20

Myrinet system interconnect 8-Port GigE switch card, rack number, chassis number

Page 20 highlights