HP Superdome SX2000 User Service Guide, Seventh Edition - HP Integrity Superdo - Page 26

Backplane, Crossbar Chip

Page 26 highlights

Figure 1-5 HUCB Backplane The system backplane assembly fabric provides the following functionality in an sx2000 system: • Interfaces the CLU subsystem to the system backplane and cell modules • Houses the system crossbar switch fabrics and cell modules • Provides switch fabric interconnect between multiple cabinets • Generates system clock sources • Performs redundant system clock source switching • Distributes the system clock to crossbar chips and cell modules • Distributes HKP to cell modules • Terminates I/O cables to cell modules The backplane supports up to eight cells, interconnected by the crossbar links. A sustained total bandwidth of 25.5 GB is provided to each cell. Each cell connects to three individual XBC ASICs. This connection enables a single chip crossing when a cell communicates with another cell in its four-cell group. When transferring data between cells in different groups, two crossbar links compensate for the resultant multiple chip crossings. This topology also provides for switch fabric redundancy Dual rack/backplane systems contain two identical backplanes. These backplanes use 12 high-speed interface cables as interconnects instead of the flex cable interface previously employed for the legacy Superdome crossbar. The sustainable bisection bandwidth between cabinets is 72 GB/s at a link speed of 2.1 GT/s. Crossbar Chip The crossbar fabrics in the sx2000 are implemented using the XBC crossbar chip. Each XBC is a non-bit-sliced, eight-port non-blocking crossbar that can communicate with the CC or XBC ASICs. Each of the eight ports is full duplex, capable of transmitting and receiving independent packets simultaneously. Each port consists of 20 channels of IBM's HSS technology. Eighteen channels are used for packet data. One channel is used for horizontal link parity, and one channel is a spare. The HSS channels can run from 2.0- 3.2 GT/s. At 3.0 GT/s, each port provides 8.5 GB/s of sustainable bidirectional data bandwidth. Like the CC and the SBA, XBC implements link-level retry to recover from intermittent link errors. XBC can also replace a hard-failed channel with the spare channel during the retry process, which guarantees continued reliable operation in the event of a broken channel, or single or multibit intermittent errors. XBC supports enhanced security between hard partitions by providing write protection on key CSRs. Without protection, CSRs such as the routing tables can be modified by a rogue OS, causing other hard partitions in the system to crash. To prevent this, key CSRs in XBC can only be modified by packets with the Secure bit set. This bit is set by the CC, based on a register that is set only by 26 Overview

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
  • 131
  • 132
  • 133
  • 134
  • 135
  • 136
  • 137
  • 138
  • 139
  • 140
  • 141
  • 142
  • 143
  • 144
  • 145
  • 146
  • 147
  • 148
  • 149
  • 150
  • 151
  • 152
  • 153
  • 154
  • 155
  • 156
  • 157
  • 158
  • 159
  • 160
  • 161
  • 162
  • 163
  • 164
  • 165
  • 166
  • 167
  • 168
  • 169
  • 170
  • 171
  • 172
  • 173
  • 174
  • 175
  • 176
  • 177
  • 178
  • 179
  • 180
  • 181
  • 182
  • 183
  • 184
  • 185
  • 186
  • 187
  • 188
  • 189
  • 190
  • 191
  • 192
  • 193
  • 194
  • 195
  • 196
  • 197
  • 198
  • 199
  • 200

Figure 1-5 HUCB
Backplane
The system backplane assembly fabric provides the following functionality in an sx2000 system:
Interfaces the CLU subsystem to the system backplane and cell modules
Houses the system crossbar switch fabrics and cell modules
Provides switch fabric interconnect between multiple cabinets
Generates system clock sources
Performs redundant system clock source switching
Distributes the system clock to crossbar chips and cell modules
Distributes HKP to cell modules
Terminates I/O cables to cell modules
The backplane supports up to eight cells, interconnected by the crossbar links. A sustained total
bandwidth of 25.5 GB is provided to each cell. Each cell connects to three individual XBC ASICs.
This connection enables a single chip crossing when a cell communicates with another cell in its
four-cell group. When transferring data between cells in different groups, two crossbar links
compensate for the resultant multiple chip crossings. This topology also provides for switch
fabric redundancy
Dual rack/backplane systems contain two identical backplanes. These backplanes use 12
high-speed interface cables as interconnects instead of the flex cable interface previously employed
for the legacy Superdome crossbar. The sustainable bisection bandwidth between cabinets is 72
GB/s at a link speed of 2.1 GT/s.
Crossbar Chip
The crossbar fabrics in the sx2000 are implemented using the XBC crossbar chip. Each XBC is a
non-bit-sliced, eight-port non-blocking crossbar that can communicate with the CC or XBC ASICs.
Each of the eight ports is full duplex, capable of transmitting and receiving independent packets
simultaneously. Each port consists of 20 channels of IBM's HSS technology. Eighteen channels
are used for packet data. One channel is used for horizontal link parity, and one channel is a
spare. The HSS channels can run from 2.0- 3.2 GT/s. At 3.0 GT/s, each port provides 8.5 GB/s of
sustainable bidirectional data bandwidth.
Like the CC and the SBA, XBC implements link-level retry to recover from intermittent link
errors. XBC can also replace a hard-failed channel with the spare channel during the retry process,
which guarantees continued reliable operation in the event of a broken channel, or single or
multibit intermittent errors.
XBC supports enhanced security between hard partitions by providing write protection on key
CSRs. Without protection, CSRs such as the routing tables can be modified by a rogue OS, causing
other hard partitions in the system to crash. To prevent this, key CSRs in XBC can only be modified
by packets with the Secure bit set. This bit is set by the CC, based on a register that is set only by
26
Overview