HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 3

Contents

About This Manual

1

Myrinet interconnect overview

1.1

Interconnect characteristics

.................................................

1-1

1.2

Backplane and chassis types

................................................

1-2

1.3

Wiring rules

...................................................................

1-4

2

PCI cards

2.1

General characteristics

......................................................

2-1

2.2

Single-port XP PCI card

.....................................................

2-2

2.3

Dual-port 2XP PCI

............................................................

2-3

2.4

Single-port 2XP PCI

..........................................................

2-5

3

Switch, spine and monitoring line cards

3.1

Switch card

....................................................................

3-1

3.2

Spine card

......................................................................

3-3

3.3

Monitoring line card

..........................................................

3-4

4

LED indications and diagnostics

4.1

Line card and PCI LEDs

.....................................................

4-1

4.2

Using LEDs for diagnostics

.................................................

4-1

4.3

Using the monitoring line card for diagnostics

...........................

4-2

5

Replacing components

5.1

Installing a monitoring line card

...........................................

5-1

5.1.1

Rebooting the monitoring line card

...................................

5-2

5.2

Removing and installing an 8-port line card

.............................

5-2

5.3

Replacing a fan tray

..........................................................

5-4

5.4

Replacing an interconnect chassis

.........................................

5-5

5.4.1

Removing the interconnect from the rack

............................

5-5

5.4.2

Swapping the line cards

.................................................

5-9

5.4.3

Replacing the interconnect in the rack

...............................

5-10

6

Powering up procedure

Index

Figures

1-1

Fat Tree Topology

.............................................................

1-1

1-2

Myrinet System Interconnect Backplane

.................................

1-2

1-3

Federated Configuration Switches

.........................................

1-2

1-4

Nonfederated Configuration Switch

.......................................

1-3

Contents

iii

Section	Page
Table of Contents	1
Audience	5
Organization	5
Additional documentation	5
Providing feedback	5
Symbols in text	6
Myrinet interconnect overview	7
1.1 Interconnect characteristics	7
Figure 1-1: Fat Tree Topology	7
1.2 Backplane and chassis types	8
Figure 1-2: Myrinet System Interconnect Backplane	8
Figure 1-3: Federated Configuration Switches	8
Figure 1-4: Nonfederated Configuration Switch	9
Figure 1-5: 128-Port Myrinet System Interconnect	10
1.3 Wiring rules	10
Figure 1-6: Fully Populated 128-Port Myrinet System Interconnect	11
PCI cards	13
2.1 General characteristics	13
Figure 2-1: PCI Identification Label	13
2.2 Single-port XP PCI card	14
Figure 2-2: Single-port XP PCI Rev. D card	14
2.3 Dual-port 2XP PCI	15
Figure 2-3: Myricom 2XP PCI Rev. E card	16
2.4 Single-port 2XP PCI	17
Figure 2-4: Myricom 2XP PCI Rev. F card	18
Switch, spine and monitoring line cards	19
3.1 Switch card	19
Figure 3-1: Myrinet system Interconnect 8-port switch card	19
Figure 3-2: External features of the Myrinet system interconnect	19
Figure 3-3: Myrinet system interconnect 8-Port GigE switch card	20
Figure 3-4: Block Diagram of the gigabit ethernet switch card	21
3.2 Spine card	21
Figure 3-5: Spine Card Block Diagram	22
3.3 Monitoring line card	22
Figure 3-6: Monitoring Line Card	23
Figure 3-7: External Features of the Monitoring Line Card	23
LED indications and diagnostics	25
4.1 Line card and PCI LEDs	25
4.2 Using LEDs for diagnostics	25
4.3 Using the monitoring line card for diagnostics	26
Replacing components	29
5.1 Installing a monitoring line card	29
5.2 Removing and installing an 8-port line card	30
Figure 5-1: Unlocking Switch Card Handles	30
Figure 5-2: Ejecting a Switch Card	31
Figure 5-3: Sliding a Switch Card	31
Figure 5-4: Backplane Power Connector	31
5.3 Replacing a fan tray	32
Figure 5-5: Removing a Fan Tray	32
5.4 Replacing an interconnect chassis	33
Powering up procedure	39

HP Cluster Platform Interconnects v2010 Myrinet System Interconnect Guide - Page 3

About This Manual, LED indications and diagnostics

Page 3 highlights