Home » HP Manuals » Servers » HP Cluster Platform Express v2010 » Manual Viewer

HP Cluster Platform Express v2010 Workgroup System and Cluster Platform Expres - Page 117

F.1.3 In-Band Network Switch Administrative Network for 21-32 Nodes Using the ProCurve 2848 Gigabit Ethernet Switch

Get HP Cluster Platform Express v2010 PDF manuals and user guides

View all HP Cluster Platform Express v2010 manuals

Add to My Manuals
Save this manual to your list of manuals

Page 117 highlights

From ProCurve 2824 Port 15 ProCurve 2824 Port 16 ProCurve 2824 Port 17 ProCurve 2824 Port 18 ProCurve 2824 Port 19 ProCurve 2824 Port 20 ProCurve 2824 Port 21 ProCurve 2824 Port 22 ProCurve 2824 Port 23 ProCurve 2824 Port 24 Label Admin-ES1-P15 Admin-ES1-P16 Admin-ES1-P17 Admin-ES1-P18 Admin-ES1-P19 Admin-ES1-P20 Admin-ES1-P21 Admin-ES1-P22 Admin-ES1-P23 Admin-ES1-P24 To Embedded NIC1 (eth0) in Node 07 Embedded NIC1 (eth0) in Node 06 Embedded NIC1 (eth0) in Node 05 Embedded NIC1 (eth0) in Node 04 Embedded NIC1 (eth0) in Node 03 Embedded NIC1 (eth0) in Node 02 Embedded NIC1 (eth0) in Node 01 Embedded NIC1 (eth0) in Control Node InfiniBand switch #1 management port (if present) Uplink to console switch Label Cable Server07-NIC1 C7533A Server06-NIC1 C7533A Server05-NIC1 C7533A Server04-NIC1 C7533A Server03-NIC1 C7533A Server02-NIC1 C7533A Server01-NIC1 C7533A Control-NIC1 C7533A IB-SW1-NIC C7535A Consol-ES1-P26 C7533A F.1.3 In-Band Network Switch Administrative Network for 21-32 Nodes Using the ProCurve 2848 Gigabit Ethernet Switch The following table shows the in-band network switch administrative network for 21-32 nodes, using the ProCurve 2848 Gigabit Ethernet network switch: From Label To Label ProCurve 2848 Port 1 Not connected ProCurve 2848 Port 2 Not connected ProCurve 2848 Port 3 Not connected ProCurve 2848 Port 4 Admin-ES1-P04 Embedded NIC1 (eth0) in Node 32 Server32-NIC1 ProCurve 2848 Port 5 Admin-ES1-P05 Embedded NIC1 (eth0) in Node 31 Server31-NIC1 ProCurve 2848 Port 6 Admin-ES1-P06 Embedded NIC1 (eth0) in Node 30 Server30-NIC1 ProCurve 2848 Port 7 Admin-ES1-P07 Embedded NIC1 (eth0) in Node 29 Server29-NIC1 ProCurve 2848 Port 8 Admin-ES1-P08 Embedded NIC1 (eth0) in Node 28 Server28-NIC1 ProCurve 2848 Port 9 Admin-ES1-P09 Embedded NIC1 (eth0) in Node 27 Server27-NIC1 ProCurve 2848 Port 10 Admin-ES1-P10 Embedded NIC1 (eth0) in Node 26 Server26-NIC1 ProCurve 2848 Port 11 Not connected ProCurve 2848 Port 12 Not connected ProCurve 2848 Port 13 Admin-ES1-P13 Embedded NIC1 (eth0) in Node 25 Server25-NIC1 ProCurve 2848 Port 14 Admin-ES1-P14 Embedded NIC1 (eth0) in Node 24 Server24-NIC1 ProCurve 2848 Port 15 Admin-ES1-P15 Embedded NIC1 (eth0) in Node 23 Server23-NIC1 ProCurve 2848 Port 16 Admin-ES1-P16 Embedded NIC1 (eth0) in Node 22 Server22-NIC1 ProCurve 2848 Port 17 Admin-ES1-P17 Embedded NIC1 (eth0) in Node 21 Server21-NIC1 ProCurve 2848 Port 18 Admin-ES1-P18 Embedded NIC1 (eth0) in Node 20 Server20-NIC1 ProCurve 2848 Port 19 Admin-ES1-P19 Embedded NIC1 (eth0) in Node 19 Server19-NIC1 ProCurve 2848 Port 20 Admin-ES1-P20 Embedded NIC1 (eth0) in Node 18 Server18-NIC1 Cable C7533A C7533A C7533A C7533A C7533A C7533A C7533A C7533A C7533A C7533A C7533A C7533A C7533A C7533A C7533A F.1 Ethernet and Gigabit Ethernet Network Cabling Tables 117

Section	Page
and Cluster Platform Express	1
Table of Contents	3
About This Document	9
Intended Audience	9
Document Organization	9
Typographic Conventions	10
Related Information	10
HP Encourages Your Comments	10
1 Cluster Platform Express Overview	11
1.1 Cluster Platform Workgroup System	11
1.2 CPE BladeSystem with c7000 Enclosure	12
1.3 CPE with Rack-Mountable Servers	12
1.4 CPE Architecture Overview	12
1.4.1 Basic Components Used in CPE	13
1.4.2 Power Distribution Units Used in CPE Configurations	14
1.4.3 Power Strips	16
1.4.3.1 Power Strip Installation for BladeSystem and Newer Rack-Mountable Configurations	16
1.4.3.2 Power Strips Used in Older CPE Systems	17
1.4.4 Fast-Ethernet Network Switches and the Optional InfiniBand Network	18
1.4.4.1 Fast-Ethernet Switches	19
1.4.4.2 InfiniBand High-Speed Interconnects	20
1.4.4.3 Cable Management Plate	23
1.4.4.4 Cabling Guidelines	24
1.4.5 Control Nodes for BladeSystem or Rack-Mountable Server Configurations	24
1.4.5.1 Identifying Node Port and PCI Slot Assignments	25
1.4.6 Connecting to an External Network	26
1.4.6.1 CPE Workgroup System with Single-Density Server Blades	26
1.4.6.2 CPE Workgroup System with Double-Density Server Blades	27
1.4.6.3 CPE BladeSystem Configurations with an External Control Node	28
1.4.6.4 CPE BladeSystem Configurations with Double-Density Server Blades and an External Control Node	30
1.4.6.5 CPE BladeSystem Configurations with a Single-Density Server Blade Control Node	31
1.4.6.6 CPE BladeSystem Configurations with Double-Density Server Blade Control Node	33
1.4.6.7 CPE with Rack-Mountable Servers	34
1.4.7 Cable Management Components	34
1.5 Component Documentation Sources	34
1.5.1 Documentation Resources, Updates and Release Notes	36
2 Cluster Platform Workgroup System	37
2.1 CP Workgroup System Configuration Examples	37
2.1.1 22U Cabinet with a c3000 Enclosure and an External Control Node	38
2.1.2 22U Cabinet with a c3000 Enclosure without an External Control Node	38
2.2 Site Preparation Guidelines for CP Workgroup System	39
2.3 Unpacking and Removing CPE Systems from a Shock Pallet	40
2.4 Installation and Start-up	40
2.5 Post-Installation and Diagnostics	41
2.6 Setting Up Local Networks	41
2.7 Operating System Information	41
3 CPE BladeSystem with c7000 Enclosure Configurations	43
3.1 CPE c7000 Configuration Examples	43
3.1.1 Server Blade Configuration Example with Three Enclosures in a 42U Rack	44
3.1.2 Server Blade Configuration Example with Two Enclosures in a 42U Rack	46
3.1.3 Server Blade Configuration Example with One Enclosure in a 42U Rack	47
3.1.4 Server Blade Configuration with Two Enclosures in a 22U Rack	48
3.1.5 Server Blade Configuration with One Enclosure in a 22U Rack	48
3.2 Site Preparation Guidelines for CPE BladeSystem with c7000 Enclosure	49
3.3 Unpacking and Removing CPE Systems from a Shock Pallet	49
3.4 Installation and Start-up	50
3.5 Post-Installation and Diagnostics	51
3.6 Setting Up Local Networks	51
3.7 Operating System Information	51
3.7.1 Software Management Requirements	51
4 CPE with Rack-Mountable Servers	55
4.1 CPE with Rack-Mountable Servers — 42U Rack Configuration	55
4.2 CPE with Rack-Mountable Servers — 22U Rack Configuration	56
4.3 Site Preparation	58
4.4 Unpacking and Removing From a Shock Pallet	58
4.5 Installation and Start-up	58
4.6 Post-Installation and Diagnostics	58
4.7 Setting Up Local Networks	58
4.8 Operating System Information	59
A Port Labeling Syntax	61
B CP Workgroup System Configuration Diagrams and Cabling Tables	63
B.1 Example Configuration Diagrams	63
B.1.1 CP Workgroup System – Basic Configuration	63
B.1.2 CP Workgroup System with an External Control Node	64
B.1.3 CP Workgroup System with Direct Attached Storage Blade SB40c	65
B.1.4 CP Workgroup System with an Optional InfiniBand Interconnect	67
B.2 CP Workgroup System Cabling Tables	69
B.2.1 HP BladeSystem c3000 and c7000 Network Cabling Tables	70
B.2.2 c3000 InfiniBand Cabling Tables	70
C Configuring a VLAN for the Administrative Network for c3000 BladeSystem Configurations	73
D Cabling Tables for CPE BladeSystem, with c7000 Enclosure Configurations	75
D.1 Cabling Examples	76
D.2 Administrative/Console Wiring Tables for One c7000 Enclosure with Double-Density Server Blades	79
D.3 Administrative/Console Wiring Tables for Two or Three c7000 Enclosures with Single-Density Server Blades	79
D.4 Administrative/Console Wiring Tables for Two c7000 Enclosures with Double-Density Server Blades	81
D.5 Administrative/Console Wiring Tables for Three c7000 Enclosures with Double-Density Server Blades	82
D.6 Administrative/Console Wiring Tables for Three c7000 Enclosures with Double-Density Server Blades and the InfiniBand Fabric	84
D.7 One c7000 Enclosure with Single-Density Blades and an HP 4x DDR InfiniBand Switch Module	86
D.8 InfiniBand Wiring Table for Two c7000 Enclosures with Single-Density Blades (Without an External InfiniBand Switch)	88
D.9 InfiniBand Wiring Table for Two or Three c7000 Enclosures with Single-Density Blades and an External InfiniBand Switch	89
D.10 One c7000 Enclosure with Double-Density Server Blades, the HP 4X DDR InfiniBand Switch Module and Without an External InfiniBand Switch	90
D.11 One c7000 Enclosure with Double-Density Server Blades, the HP 4X DDR InfiniBand Switch Module, and an External InfiniBand Switch	91
D.12 Two or Three c7000 Enclosures with Double-Density Server Blades and Using the HP 4X DDR InfiniBand Switch Module	92
D.13 One c7000 Enclosure with Single-Density Server Blades and the HP BLc 4X DDR InfiniBand Gen2 Switch	95
D.14 Wiring for Two c7000 Enclosures with Single-Density Server Blades and the HP BLc 4X DDR InfiniBand Gen2 Switch (Without an External InfiniBand Switch)	97
D.15 Wiring for Two or Three c7000s with Single-Density Server Blades and Using the HP BLc 4X DDR InfiniBand Gen2 Switch	98
D.16 One c7000 Enclosure with Double-Density Server Blades and the HP BLc 4X DDR InfiniBand Gen2 Switch (No External InfiniBand Switch)	101
D.17 One c7000 Enclosure with Double-Density Server Blades, the HP BLc 4X DDR InfiniBand Gen2 Switch and External InfiniBand Switches	102
D.18 Wiring for a Configuration of Two or Three c7000 Enclosures with Double-Density Server Blades Using the HP BLc 4X DDR InfiniBand Gen2 Switch and External InfiniBand Switches	105
E Configuration Rules for CPE BladeSystems	111
E.1 CP Workgroup System Device and Interconnect Bays	111
E.1.1 HP BladeSystem c3000 Enclosure Device Bays (Front of the c3000 Enclosure)	111
E.1.2 HP BladeSystem c3000 Enclosure Interconnect Bays (Rear of the c3000 Enclosure)	111
E.2 CP Workgroup System Fan Bays	111
E.3 CP Workgroup System Power and Configuration Rules	111
E.4 CPE with c7000 Enclosure Configuration Device and Interconnect Bay Rules	112
E.5 CPE with c7000 Fan Bay Rules	113
E.6 CPE with c7000 Power Distribution Rules	113
F Cabling Tables for Rack-Mountable Servers	115
F.1 Ethernet and Gigabit Ethernet Network Cabling Tables	115
F.1.1 In-Band Network Switch Console Network for 24 Nodes Using the ProCurve 2824 Gigabit Ethernet Network Switch	115
F.1.2 In-Band Network Switch Administrative Network for 1-20 Nodes Using the ProCurve 2824 Gigabit Ethernet Switch	116
F.1.3 In-Band Network Switch Administrative Network for 21-32 Nodes Using the ProCurve 2848 Gigabit Ethernet Switch	117
F.1.4 In-Band Network Switch Administrative Network for 1-20 Nodes Using the ProCurve 2626 Gigabit Ethernet Switch	119
F.1.5 In-Band Network Switch Administrative Network for 21-32 Nodes Using the ProCurve 2650 Gigabit Ethernet Switch	120
F.2 InfiniBand Cabling Tables for Rack-Mountable Servers	121
F.2.1 Cabling Topology and Rules	121
F.2.1.1 Using the Cabling Tables	121
F.2.2 Using a Single ISR 9024 Interconnect to Support up to 24 Nodes	122
F.2.3 Using Two ISR 9024 Interconnects to Support 25-32 Nodes	123

Match case Limit results 1 per page

Cable

Label

From

C7533A

Server07-NIC1

Embedded NIC1 (eth0) in Node 07

Admin-ES1-P15

ProCurve 2824 Port 15

C7533A

Server06-NIC1

Embedded NIC1 (eth0) in Node 06

Admin-ES1-P16

ProCurve 2824 Port 16

C7533A

Server05-NIC1

Embedded NIC1 (eth0) in Node 05

Admin-ES1-P17

ProCurve 2824 Port 17

C7533A

Server04-NIC1

Embedded NIC1 (eth0) in Node 04

Admin-ES1-P18

ProCurve 2824 Port 18

C7533A

Server03-NIC1

Embedded NIC1 (eth0) in Node 03

Admin-ES1-P19

ProCurve 2824 Port 19

C7533A

Server02-NIC1

Embedded NIC1 (eth0) in Node 02

Admin-ES1-P20

ProCurve 2824 Port 20

C7533A

Server01-NIC1

Embedded NIC1 (eth0) in Node 01

Admin-ES1-P21

ProCurve 2824 Port 21

C7533A

Control-NIC1

Embedded NIC1 (eth0) in Control

Node

Admin-ES1-P22

ProCurve 2824 Port 22

C7535A

IB-SW1-NIC

InfiniBand switch #1 management

port (if present)

Admin-ES1-P23

ProCurve 2824 Port 23

C7533A

Consol-ES1-P26

Uplink to console switch

Admin-ES1-P24

ProCurve 2824 Port 24

F.1.3 In-Band Network Switch Administrative Network for 21-32 Nodes Using the

ProCurve 2848 Gigabit Ethernet Switch

The following table shows the in-band network switch administrative network for 21-32 nodes,

using the ProCurve 2848 Gigabit Ethernet network switch:

Cable

Label

From

Not connected

ProCurve 2848 Port 1

Not connected

ProCurve 2848 Port 2

Not connected

ProCurve 2848 Port 3

C7533A

Server32-NIC1

Embedded NIC1 (eth0) in Node 32

Admin-ES1-P04

ProCurve 2848 Port 4

C7533A

Server31-NIC1

Embedded NIC1 (eth0) in Node 31

Admin-ES1-P05

ProCurve 2848 Port 5

C7533A

Server30-NIC1

Embedded NIC1 (eth0) in Node 30

Admin-ES1-P06

ProCurve 2848 Port 6

C7533A

Server29-NIC1

Embedded NIC1 (eth0) in Node 29

Admin-ES1-P07

ProCurve 2848 Port 7

C7533A

Server28-NIC1

Embedded NIC1 (eth0) in Node 28

Admin-ES1-P08

ProCurve 2848 Port 8

C7533A

Server27-NIC1

Embedded NIC1 (eth0) in Node 27

Admin-ES1-P09

ProCurve 2848 Port 9

C7533A

Server26-NIC1

Embedded NIC1 (eth0) in Node 26

Admin-ES1-P10

ProCurve 2848 Port 10

Not connected

ProCurve 2848 Port 11

Not connected

ProCurve 2848 Port 12

C7533A

Server25-NIC1

Embedded NIC1 (eth0) in Node 25

Admin-ES1-P13

ProCurve 2848 Port 13

C7533A

Server24-NIC1

Embedded NIC1 (eth0) in Node 24

Admin-ES1-P14

ProCurve 2848 Port 14

C7533A

Server23-NIC1

Embedded NIC1 (eth0) in Node 23

Admin-ES1-P15

ProCurve 2848 Port 15

C7533A

Server22-NIC1

Embedded NIC1 (eth0) in Node 22

Admin-ES1-P16

ProCurve 2848 Port 16

C7533A

Server21-NIC1

Embedded NIC1 (eth0) in Node 21

Admin-ES1-P17

ProCurve 2848 Port 17

C7533A

Server20-NIC1

Embedded NIC1 (eth0) in Node 20

Admin-ES1-P18

ProCurve 2848 Port 18

C7533A

Server19-NIC1

Embedded NIC1 (eth0) in Node 19

Admin-ES1-P19

ProCurve 2848 Port 19

C7533A

Server18-NIC1

Embedded NIC1 (eth0) in Node 18

Admin-ES1-P20

ProCurve 2848 Port 20

F.1 Ethernet and Gigabit Ethernet Network Cabling Tables

117