HP 1032 HP High Performance Clusters LC 2000 Series Cabling Guide - Page 79

Rack Population Rules, PCI Cards, Storage Systems, Power, Servers, Switches

Page 79 highlights

Cabling Rules for LC Clusters PCI Cards-Labels on cables connected to the PCI cards use the PCI slot markings on the server if available. The designator of the actual slot name is used on the labels, if present, or "PCIn" is used, where n is the slot number, if the slots are numbered. For example, if the hardware marks the slots with "1" or "2," then the cable labels refer to these slots as "PCI1" and "PCI2," respectively. If the slots are not uniquely identified by markings on the server, then the numbering starts at 1 and increases from left to right and then bottom to top. For slots without markings on the server, the labels on the cables connected to these PCI cards include "PCIn," where n is the slot number. All cable labels to or from PCI cards, regardless of type (NIC, IB, Myrinet), are labeled with "PCI." If there is only one PCI device used in a server, n is not used. It is labeled "PCI." Storage Systems-Storage systems are numbered from 1 to n and from bottom to top in each rack. Labels on cables connected to storage devices will include "STn," where n is the storage device number in the rack. Power-Power cord labeling is according to factory standards. The factory typically uses color-coding to label the power cables. Rack Population Rules Servers, Switches, and Storage System-These components are populated in the rack from bottom to top with the lowest numbered component in the lowest rack position. Switch Modules and PCI Cards-These components are populated in the lowest available module port or slot number. Additional modules and cards are installed in the next higher module port or slot number. Exceptions to this rule apply when a specific type of module or card must be installed in a specific module port or slot. Ports-Ports start with the lowest numbered port and increase unless the following rules apply: • Switch ports (single function switch, for example: Cyclades terminal server): - Server-to-switch connections start with the lowest port and increase. - Switch-to-switch connections start with the uplink ports first and then with the highest numbered port and work backwards. • Switch ports (multi-function switch, for example: 16 node system where the interconnect and the management networks connect to the same switch): - Server-to-switch connections: The switch is split into "regions" for each functional area and then populated from the lowest port number per region and work up. - Switch-to-switch connections start with the uplink ports first and then with the highest numbered port and work backwards. - When dividing the switch into functional regions, be sure to reserve enough ports at the top end to handle the switch-to-switch connections. Use this formula to determine the number of ports for each region in the switch: ((Total switch ports) - (ports reserved for switch-to-switch connections))/(# of regions). A-2 HP High Performance Clusters LC 2000 Series Cabling Guide

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80

Cabling Rules for LC Clusters
PCI Cards
—Labels on cables connected to the PCI cards use the PCI slot markings on the
server if available. The designator of the actual slot name is used on the labels, if present, or
“PCIn” is used, where n is the slot number, if the slots are numbered. For example, if the
hardware marks the slots with “1” or “2,” then the cable labels refer to these slots as “PCI1”
and “PCI2,” respectively.
If the slots are not uniquely identified by markings on the server, then the numbering starts at
1 and increases from left to right and then bottom to top. For slots without markings on the
server, the labels on the cables connected to these PCI cards include “PCIn,” where n is the
slot number. All cable labels to or from PCI cards, regardless of type (NIC, IB, Myrinet), are
labeled with “PCI.”
If there is only one PCI device used in a server, n is not used. It is labeled “PCI.”
Storage Systems
—Storage systems are numbered from 1 to n and from bottom to top in each
rack. Labels on cables connected to storage devices will include “STn,” where n is the storage
device number in the rack.
Power
—Power cord labeling is according to factory standards. The factory typically uses
color-coding to label the power cables.
Rack Population Rules
Servers, Switches, and Storage System
—These components are populated in the rack from
bottom to top with the lowest numbered component in the lowest rack position.
Switch Modules and PCI Cards
—These components are populated in the lowest available
module port or slot number. Additional modules and cards are installed in the next higher
module port or slot number. Exceptions to this rule apply when a specific type of module or
card must be installed in a specific module port or slot.
Ports
—Ports start with the lowest numbered port and increase unless the following rules
apply:
Switch ports (single function switch, for example: Cyclades terminal server):
— Server-to-switch connections start with the lowest port and increase.
— Switch-to-switch connections start with the uplink ports first and then with the
highest numbered port and work backwards.
Switch ports (multi-function switch, for example: 16 node system where the interconnect
and the management networks connect to the same switch):
— Server-to-switch connections: The switch is split into “regions” for each functional
area and then populated from the lowest port number per region and work up.
— Switch-to-switch connections start with the uplink ports first and then with the
highest numbered port and work backwards.
— When dividing the switch into functional regions, be sure to reserve enough ports at
the top end to handle the switch-to-switch connections. Use this formula to determine
the number of ports for each region in the switch:
((Total switch ports) – (ports
reserved for switch-to-switch connections))/(# of regions)
.
A-2
HP High Performance Clusters LC 2000 Series Cabling Guide