HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 29

5

Replacing components

Several components can be replaced in the Myrinet system interconnect: This

chapter presents the following instructions relating to the replaceable components:

•

Installing a monitoring line card (Section 5.1).

•

Removing and installing an 8-port line card (Section 5.2).

•

Replacing a fan tray (Section 5.3)

•

Replacing a chassis (Section 5.4)

5.1 Installing a monitoring line card

To install a monitoring line card in your Myrinet system interconnect switch,

do the following:

1.

Read the MAC address from the faceplate of the monitoring line card, and

register this MAC address with a static IP address in the DHCP server

configuration file (

/etc/dhcpd.conf

) on the DHCP server on the local

network. The DHCP server will then serve this static IP address to the

monitoring line card when it boots and asks for it.

The MAC address is a group of 6 hexadecimal numbers separated by colons,

and should begin with 00:60:dd:7f:

2.

Before sliding the monitoring line card into the top slot of the Myrinet

interconnect, connect at least the first ethernet port to the LAN. For high

availability, you can also connect the second ethernet port.

You can only install the monitoring line card in the top slot of your Myrinet

interconnect. The ethernet ports on the monitoring line card are 10base-T.

3.

When the monitoring line card is locked in position, a green LED will

illuminate, and the LEDs for the connected ethernet ports will light up. The

monitoring line card will immediately start to broadcast DHCP requests.

4.

When the monitoring line card has received its IP address, it is reachable. You

can ping the card or open a Web browser to it.

To determine the IP address that was assigned to the monitoring line card,

look at the file

/var/state/dhcp/dhcpd.leases

on your DHCP server.

Each time a monitoring line card is powered on, it sks for its IP address (and

netmask) via DHCP. You can specify a gateway with the DHCP "routers"

option. The lease time is 1 day.

_________________________

Note

_________________________

You must have DHCP to install the monitoring line card or to run the

switch monitoring tools. You must install the monitoring line card prior

to building the switch monitoring tools.

Replacing components

5-1

Section	Page
Table of Contents	1
Audience	5
Organization	5
Additional documentation	5
Providing feedback	5
Symbols in text	6
Myrinet interconnect overview	7
1.1 Interconnect characteristics	7
Figure 1-1: Fat Tree Topology	7
1.2 Backplane and chassis types	8
Figure 1-2: Myrinet System Interconnect Backplane	8
Figure 1-3: Federated Configuration Switches	8
Figure 1-4: Nonfederated Configuration Switch	9
Figure 1-5: 128-Port Myrinet System Interconnect	10
1.3 Wiring rules	10
Figure 1-6: Fully Populated 128-Port Myrinet System Interconnect	11
PCI cards	13
2.1 General characteristics	13
Figure 2-1: PCI Identification Label	13
2.2 Single-port XP PCI card	14
Figure 2-2: Single-port XP PCI Rev. D card	14
2.3 Dual-port 2XP PCI	15
Figure 2-3: Myricom 2XP PCI Rev. E card	16
2.4 Single-port 2XP PCI	17
Figure 2-4: Myricom 2XP PCI Rev. F card	18
Switch, spine and monitoring line cards	19
3.1 Switch card	19
Figure 3-1: Myrinet system Interconnect 8-port switch card	19
Figure 3-2: External features of the Myrinet system interconnect	19
Figure 3-3: Myrinet system interconnect 8-Port GigE switch card	20
Figure 3-4: Block Diagram of the gigabit ethernet switch card	21
3.2 Spine card	21
Figure 3-5: Spine Card Block Diagram	22
3.3 Monitoring line card	22
Figure 3-6: Monitoring Line Card	23
Figure 3-7: External Features of the Monitoring Line Card	23
LED indications and diagnostics	25
4.1 Line card and PCI LEDs	25
4.2 Using LEDs for diagnostics	25
4.3 Using the monitoring line card for diagnostics	26
Replacing components	29
5.1 Installing a monitoring line card	29
5.2 Removing and installing an 8-port line card	30
Figure 5-1: Unlocking Switch Card Handles	30
Figure 5-2: Ejecting a Switch Card	31
Figure 5-3: Sliding a Switch Card	31
Figure 5-4: Backplane Power Connector	31
5.3 Replacing a fan tray	32
Figure 5-5: Removing a Fan Tray	32
5.4 Replacing an interconnect chassis	33
Powering up procedure	39

HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 29

Replacing components, 5.1 Installing a monitoring line card

Page 29 highlights