HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 22

Figure 3-5: Spine Card Block Diagram

μC

Clocks

Backplane

Interface

0

1

2

3

4

5

6

7

Front-Panel

Ports

Serial link

Sense &

Control

Power & hot-swap

circuits

Physical-Level Conversion Circuits

dual +12V

0

1

2

3

4

5

6

7

3.3 Monitoring line card

All system interconnects must have a monitoring line card installed. The

monitoring line card is powered from the dual +12V sources in the same way as the

port line cards, and likewise includes a small microcontroller to monitor internal

functions, voltages, and temperatures. The monitoring line card is keyed by the

position of the backplane connector so that it can be inserted only in the top slot of

an enclosure, and so that port line cards cannot be inserted into this slot.

The main circuitry on the card is a microcontroller with RAM and flash

memory that communicates internally via 26 individual serial links with small

microcontrollers on the port line cards, backplane XBars, the fan-monitoring

board, and on the monitoring line card itself. Self-test, board identification,

voltage monitoring, and temperature monitoring are some of the functions of

the monitoring line card. All status information is reported on demand through

the serial link to the main microcontroller. The microcontroller will shut off the

line-card power on over-temperature or other fault conditions.

The front panel of the monitoring line card (Figure 3-6 and Figure 3-7) has

a

Status

LED, green for operating and yellow for fault. The card also has

dual-redundant 10-Base Ethernet ports. Each Ethernet port has a green LED. If

the LED is off, the card is not connected to an active port. If the LED is on, the

card is connected to an active port. If the LED is blinking, there is traffic. There

are two other LEDs for the +12V A and B internal power buses.

3-4

Switch, spine and monitoring line cards

Section	Page
Table of Contents	1
Audience	5
Organization	5
Additional documentation	5
Providing feedback	5
Symbols in text	6
Myrinet interconnect overview	7
1.1 Interconnect characteristics	7
Figure 1-1: Fat Tree Topology	7
1.2 Backplane and chassis types	8
Figure 1-2: Myrinet System Interconnect Backplane	8
Figure 1-3: Federated Configuration Switches	8
Figure 1-4: Nonfederated Configuration Switch	9
Figure 1-5: 128-Port Myrinet System Interconnect	10
1.3 Wiring rules	10
Figure 1-6: Fully Populated 128-Port Myrinet System Interconnect	11
PCI cards	13
2.1 General characteristics	13
Figure 2-1: PCI Identification Label	13
2.2 Single-port XP PCI card	14
Figure 2-2: Single-port XP PCI Rev. D card	14
2.3 Dual-port 2XP PCI	15
Figure 2-3: Myricom 2XP PCI Rev. E card	16
2.4 Single-port 2XP PCI	17
Figure 2-4: Myricom 2XP PCI Rev. F card	18
Switch, spine and monitoring line cards	19
3.1 Switch card	19
Figure 3-1: Myrinet system Interconnect 8-port switch card	19
Figure 3-2: External features of the Myrinet system interconnect	19
Figure 3-3: Myrinet system interconnect 8-Port GigE switch card	20
Figure 3-4: Block Diagram of the gigabit ethernet switch card	21
3.2 Spine card	21
Figure 3-5: Spine Card Block Diagram	22
3.3 Monitoring line card	22
Figure 3-6: Monitoring Line Card	23
Figure 3-7: External Features of the Monitoring Line Card	23
LED indications and diagnostics	25
4.1 Line card and PCI LEDs	25
4.2 Using LEDs for diagnostics	25
4.3 Using the monitoring line card for diagnostics	26
Replacing components	29
5.1 Installing a monitoring line card	29
5.2 Removing and installing an 8-port line card	30
Figure 5-1: Unlocking Switch Card Handles	30
Figure 5-2: Ejecting a Switch Card	31
Figure 5-3: Sliding a Switch Card	31
Figure 5-4: Backplane Power Connector	31
5.3 Replacing a fan tray	32
Figure 5-5: Removing a Fan Tray	32
5.4 Replacing an interconnect chassis	33
Powering up procedure	39

HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 22

Spine Card Block Diagram, 3.3 Monitoring line card, Physical-Level Conversion Circuits

Page 22 highlights