HP Cluster Platform Express v2010 Workgroup System and Cluster Platform Expres - Page 77

D-1 Cabling Configuration for One c-Class Enclosure, InfiniBand module IMB5 and IMB6.

Get HP Cluster Platform Express v2010 PDF manuals and user guides View all HP Cluster Platform Express v2010 manuals
Add to My Manuals
Save this manual to your list of manuals

Page 77 highlights

Figure D-1 Cabling Configuration for One c-Class Enclosure 1 2 3 6 7 10 6 11 R e m o v e m a n a g e m e n mt o d u le s b e of re e je c tin g s le e v e 15 13 5 8 12 2 4 9 14 The following list describes the callouts in Figure D-1: 1. Control node (optional). If the configuration has a control node that is connected to the InfiniBand fabric, then the HCA in the control node is also connected to the enclosure's InfiniBand switch. (This example uses a DL380 G5. Note that the HCA can be used in either PCI slot 3 or PCI slot 5.) 2. Connection from NIC2 on the control node to the external network. 3. Connection from IMB1 port 21 on the Nortel Gigabit Ethernet switch to the external control node's iLO connection. 4. Connection from IMB1 port 23 on the Nortel Gigabit Ethernet switch to the InfiniBand switch Ethernet port. 5. Pass-through module. 6. Connection from IMB1 port 22 on the Nortel Gigabit Ethernet switch to the Onboard Administrator OA1 connection in the c-Class enclosure. 7. GbE2c Gigabit Ethernet switch. 8. Connection from port 1 of the 4X DDR InfiniBand module to the InfiniBand switch. 9. ISR 9024 InfiniBand switch. 10. InfiniBand module (IMB5 and IMB6). 11. Onboard Administrator. 12. Redundant Onboard Administrator switch. 13. Connection from IMB port 24 on the Nortel Gigabit Ethernet switch to the external control node Ethernet port (NIC1). 14. External network access. 15. Connection from the control node's HCA to port 8 of the 4X DDR InfiniBand module. Figure D-2 shows the cabling configuration for two or more c-Class enclosures connected to an InfiniBand network. Configurations with three enclosures require an external InfiniBand switch. If the configuration does not have a control node connected to the InfiniBand fabric, then the eight uplinks in each of the three enclosures are connected to the 24-port InfiniBand switch. D.1 Cabling Examples 77

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
Figure D-1 Cabling Configuration for One c-Class Enclosure
6
13
8
2
1
9
4
14
12
5
7
6
10
11
3
15
The following list describes the callouts in
Figure D-1
:
1.
Control node (optional). If the configuration has a control node that is connected to the
InfiniBand fabric, then the HCA in the control node is also connected to the enclosure's
InfiniBand switch. (This example uses a DL380 G5. Note that the HCA can be used in either
PCI slot 3 or PCI slot 5.)
2.
Connection from NIC2 on the control node to the external network.
3.
Connection from IMB1 port 21 on the Nortel Gigabit Ethernet switch to the external control
node's iLO connection.
4.
Connection from IMB1 port 23 on the Nortel Gigabit Ethernet switch to the InfiniBand switch
Ethernet port.
5.
Pass-through module.
6.
Connection from IMB1 port 22 on the Nortel Gigabit Ethernet switch to the Onboard
Administrator OA1 connection in the c-Class enclosure.
7.
GbE2c Gigabit Ethernet switch.
8.
Connection from port 1 of the 4X DDR InfiniBand module to the InfiniBand switch.
9.
ISR 9024 InfiniBand switch.
10.
InfiniBand module (IMB5 and IMB6).
11.
Onboard Administrator.
12.
Redundant Onboard Administrator switch.
13.
Connection from IMB port 24 on the Nortel Gigabit Ethernet switch to the external control
node Ethernet port (NIC1).
14.
External network access.
15.
Connection from the control node's HCA to port 8 of the 4X DDR InfiniBand module.
Figure D-2
shows the cabling configuration for two or more c-Class enclosures connected to an
InfiniBand network. Configurations with three enclosures require an external InfiniBand switch.
If the configuration does not have a control node connected to the InfiniBand fabric, then the
eight uplinks in each of the three enclosures are connected to the 24-port InfiniBand switch.
D.1 Cabling Examples
77