HP Cluster Platform Interconnects v2010 HP Cluster Platform InfiniBand Interco - Page 50

ISR ISR 9XXX Interconnect Architecture, 4.1.3 ISR ISR 9XXX Building Blocks

Page 50 highlights

- ISR 9096: up to 96 InfiniBand 4X (10 Gb/s, 20 Gb/s DDR) ports or 32 12X (30 Gb/s, 3.84 Tb/s DDR) ports. - ISR 9288: up to 288 InfiniBand 4X (10 Gb/s, 20 Gb/s DDR) ports or 96 12X (30 Gb/s, 3.84 Tb/s DDR) ports. • Modular architecture with any combination of InfiniBand ports and router blades. • Bisectional switch bandwidth in a passive mid-plane architecture. • Fat tree topology with less than 1 microsecond of latency between any two ports. • Redundant, hot-swappable sMB boards, power supplies and fans. • An sMB board that hosts embedded subnet management software and network management software. • Compliance with InfiniBand specification 1.1, including support for InfiniBand form-factor I/O modules and router blades. • for bandwidth aggregation Router blade drawers that allow multiple modules to be pooled and managed as a single entity. 4.1.2 ISR ISR 9XXX Interconnect Architecture The ISR 9XXX interconnect is a modular, rack-mountable chassis that can be configured for a wide range of applications. The ISR 9288 chassis is 14U. The ISR 9096 is 6U. Features of the ISR 9XXX architecture are: • Supports multiple line boards (sLB-24) with 24 4X or 8 12X InfiniBand copper interfaces for connectivity between the line cards and the interconnect fabric. The ISR 9096 can support up to 4 line boards, and the ISR 9288 can support up to 12 line boards. • Optical interfaces are supported with MediaConverter devices. • Optional router blade drawers (sRBD) can be installed with IPR (TCP/IP router) and FCR (Fibre Channel router) modules. Each router module drawer can contain up to three router blades. • Supports up to four vertical fabric boards (sFB). • Supports one or two redundant hot swappable management boards (sMB) for fabric management and chassis management; when two sMB boards are installed, they support failover capabilities in the event of failure to one of the boards. • Supports multiple power supply units (sPSU) with N:1 or N:N redundancy. • Supports an air cooling system comprised of a horizontal fan unit (sFU-8) for fabric, line and sMB board cooling, as well as a vertical fan unit for line board cooling. The ISR 9288 uses the sFU-4 for its vertical fan unit, and the ISR 9096 uses the sFU-2. • Two chassis reset buttons, front and rear. • An sCTRL board that provides the ISR 9XXX system interfaces for management (Ethernet and Serial). • Cabling for InfiniBand, chassis and fabric management, and power located at rear of chassis. • Remote management through a graphical user interface. • Local management and provisioning through a Command Line Interface (CLI). 4.1.3 ISR ISR 9XXX Building Blocks The ISR 9288 has 12 slots hosting sLB or sRBD modules. The ISR 9096 has 4 slots. For InfiniBand switching only, up to 12 sLB modules can be plugged into the ISR 9288, and four sLB modules can be plugged into the ISR 9096. The main building block components of the ISR 9XXX are as follows: • Chassis midplane Passive non-swappable boards allow the InfiniBand differential signals, control signals, and power connectivity between the different boards in the chassis. The sFB signals are routed 50 Installing and Maintaining the ISR 9096 and ISR 9288 Interconnects

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
  • 131
  • 132
  • 133
  • 134
  • 135
  • 136
  • 137
  • 138
  • 139
  • 140

ISR 9096: up to 96 InfiniBand 4X (10 Gb/s, 20 Gb/s DDR) ports or 32 12X (30 Gb/s, 3.84
Tb/s DDR) ports.
ISR 9288: up to 288 InfiniBand 4X (10 Gb/s, 20 Gb/s DDR) ports or 96 12X (30 Gb/s, 3.84
Tb/s DDR) ports.
Modular architecture with any combination of InfiniBand ports and router blades.
Bisectional switch bandwidth in a passive mid-plane architecture.
Fat tree topology with less than 1 microsecond of latency between any two ports.
Redundant, hot-swappable sMB boards, power supplies and fans.
An sMB board that hosts embedded subnet management software and network management
software.
Compliance with InfiniBand specification 1.1, including support for InfiniBand form-factor
I/O modules and router blades.
for bandwidth aggregation Router blade drawers that allow multiple modules to be pooled
and managed as a single entity.
4.1.2 ISR ISR 9XXX Interconnect Architecture
The ISR 9XXX interconnect is a modular, rack-mountable chassis that can be configured for a
wide range of applications. The ISR 9288 chassis is 14U. The ISR 9096 is 6U. Features of the ISR
9XXX architecture are:
Supports multiple line boards (sLB-24) with 24 4X or 8 12X InfiniBand copper interfaces for
connectivity between the line cards and the interconnect fabric. The ISR 9096 can support
up to 4 line boards, and the ISR 9288 can support up to 12 line boards.
Optical interfaces are supported with MediaConverter devices.
Optional router blade drawers (sRBD) can be installed with IPR (TCP/IP router) and FCR
(Fibre Channel router) modules. Each router module drawer can contain up to three router
blades.
Supports up to four vertical fabric boards (sFB).
Supports one or two redundant hot swappable management boards (sMB) for fabric
management and chassis management; when two sMB boards are installed, they support
failover capabilities in the event of failure to one of the boards.
Supports multiple power supply units (sPSU) with N:1 or N:N redundancy.
Supports an air cooling system comprised of a horizontal fan unit (sFU-8) for fabric, line
and sMB board cooling, as well as a vertical fan unit for line board cooling. The ISR 9288
uses the sFU-4 for its vertical fan unit, and the ISR 9096 uses the sFU-2.
Two chassis reset buttons, front and rear.
An sCTRL board that provides the ISR 9XXX system interfaces for management (Ethernet
and Serial).
Cabling for InfiniBand, chassis and fabric management, and power located at rear of chassis.
Remote management through a graphical user interface.
Local management and provisioning through a Command Line Interface (CLI).
4.1.3 ISR ISR 9XXX Building Blocks
The ISR 9288 has 12 slots hosting sLB or sRBD modules. The ISR 9096 has 4 slots. For InfiniBand
switching only, up to 12 sLB modules can be plugged into the ISR 9288, and four sLB modules
can be plugged into the ISR 9096.
The main building block components of the ISR 9XXX are as follows:
Chassis midplane
Passive non-swappable boards allow the InfiniBand differential signals, control signals, and
power connectivity between the different boards in the chassis. The sFB signals are routed
50
Installing and Maintaining the ISR 9096 and ISR 9288 Interconnects