HP StorageWorks 8/80 HP StorageWorks Fabric OS 6.1.x administrator guide (5697 - Page 347

Administering Extended Fabrics

Page 347 highlights

18 Administering Extended Fabrics This chapter provides information on implementing Extended Fabrics software. Extended Fabrics licensing To implement long distance dynamic (LD) and long distance static (LS) distance levels, you must first install the Extended Fabrics license. Use the licenseShow command to verify that the license is present on both switches used on both ends of the extended ISL. Extended Fibre Channel over distance Extended Fabrics software optimizes switch buffering to ensure the highest possible performance on interswitch links (ISLs). When Extended Fabrics is installed on gateway switches, the ISLs (E_Ports) are configured with a large pool of buffer credits. The enhanced switch buffers help ensure that data transfer can occur at near-full bandwidth to efficiently utilize the connection over the extended links. The Extended Fabrics feature extends the distance the ISLs can reach over a dark fiber or wave division multiplexing (WDM) connection. This is accomplished by providing enough buffer credits on each side of the link to compensate for latency introduced by the extended distance. Distance levels for extended Inter-Switch Links (ISLs) As the distance between switches and the link speed increases, additional buffer credits are required for the ports used for long distance connections. Distance levels define how these buffer credits are allocated and managed for extended ISLs. Buffer credits are managed from a common pool available to a group of ports on a switch. The buffer credit, can be changed for specific applications or operating environments, but must be in agreement among all switches to allow formation of the fabric. Information about switch characteristics and capacity in terms of buffers per port group, port speed, and distances supported is in Table 77 on page 352. This table may be useful in choosing an appropriate distance level, and for estimating the impact an extended ISL may have on buffer availability and port performance. Buffer-to-Buffer Credits Buffer-to-buffer (BB) credit flow control is implemented to limit the amount of data a port may send based on the number and size of the frames sent from that port. Buffer credits represent finite physical port memory. Within a fabric, each port may have a different number of BB credits. Within a connection, each side may have a different number of BB credits. One buffer credit allows a device to send one payload up to 2112 bytes (2148 with headers). Assuming that each payload is 2112, you need one credit per 1 km of link length at 2 Gbps (smaller payloads require additional BB credits to maintain link utilization). The final frame size must be a multiple of 4 bytes. If the data (payload) needs to segment, it will be padded with 1 to 3 "fill-bytes" to achieve an overall 4 byte frame alignment. The standard frame header size is 24 bytes. If applications require extensive control information, up to 64 additional bytes (for a total of an 88 byte header) can be included. Because the total frame size cannot exceed the maximum of 2,148 bytes, the additional header bytes will subtract from the data segment size by as much as 64 bytes (per frame). This is why the maximum data (payload) size is 2,112 (because [2,112 - 64] = 2,048, which is exactly 2K-bytes of data). The final frame, after it is constructed, is passed through the 8 byte to 10 byte conversion process. Fabric OS 6.1.x administrator guide 347

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
  • 131
  • 132
  • 133
  • 134
  • 135
  • 136
  • 137
  • 138
  • 139
  • 140
  • 141
  • 142
  • 143
  • 144
  • 145
  • 146
  • 147
  • 148
  • 149
  • 150
  • 151
  • 152
  • 153
  • 154
  • 155
  • 156
  • 157
  • 158
  • 159
  • 160
  • 161
  • 162
  • 163
  • 164
  • 165
  • 166
  • 167
  • 168
  • 169
  • 170
  • 171
  • 172
  • 173
  • 174
  • 175
  • 176
  • 177
  • 178
  • 179
  • 180
  • 181
  • 182
  • 183
  • 184
  • 185
  • 186
  • 187
  • 188
  • 189
  • 190
  • 191
  • 192
  • 193
  • 194
  • 195
  • 196
  • 197
  • 198
  • 199
  • 200
  • 201
  • 202
  • 203
  • 204
  • 205
  • 206
  • 207
  • 208
  • 209
  • 210
  • 211
  • 212
  • 213
  • 214
  • 215
  • 216
  • 217
  • 218
  • 219
  • 220
  • 221
  • 222
  • 223
  • 224
  • 225
  • 226
  • 227
  • 228
  • 229
  • 230
  • 231
  • 232
  • 233
  • 234
  • 235
  • 236
  • 237
  • 238
  • 239
  • 240
  • 241
  • 242
  • 243
  • 244
  • 245
  • 246
  • 247
  • 248
  • 249
  • 250
  • 251
  • 252
  • 253
  • 254
  • 255
  • 256
  • 257
  • 258
  • 259
  • 260
  • 261
  • 262
  • 263
  • 264
  • 265
  • 266
  • 267
  • 268
  • 269
  • 270
  • 271
  • 272
  • 273
  • 274
  • 275
  • 276
  • 277
  • 278
  • 279
  • 280
  • 281
  • 282
  • 283
  • 284
  • 285
  • 286
  • 287
  • 288
  • 289
  • 290
  • 291
  • 292
  • 293
  • 294
  • 295
  • 296
  • 297
  • 298
  • 299
  • 300
  • 301
  • 302
  • 303
  • 304
  • 305
  • 306
  • 307
  • 308
  • 309
  • 310
  • 311
  • 312
  • 313
  • 314
  • 315
  • 316
  • 317
  • 318
  • 319
  • 320
  • 321
  • 322
  • 323
  • 324
  • 325
  • 326
  • 327
  • 328
  • 329
  • 330
  • 331
  • 332
  • 333
  • 334
  • 335
  • 336
  • 337
  • 338
  • 339
  • 340
  • 341
  • 342
  • 343
  • 344
  • 345
  • 346
  • 347
  • 348
  • 349
  • 350
  • 351
  • 352
  • 353
  • 354
  • 355
  • 356
  • 357
  • 358
  • 359
  • 360
  • 361
  • 362
  • 363
  • 364
  • 365
  • 366
  • 367
  • 368
  • 369
  • 370
  • 371
  • 372
  • 373
  • 374
  • 375
  • 376
  • 377
  • 378
  • 379
  • 380
  • 381
  • 382
  • 383
  • 384
  • 385
  • 386
  • 387
  • 388
  • 389
  • 390
  • 391
  • 392
  • 393
  • 394
  • 395
  • 396
  • 397
  • 398
  • 399
  • 400
  • 401
  • 402
  • 403
  • 404
  • 405
  • 406
  • 407
  • 408
  • 409
  • 410
  • 411
  • 412
  • 413
  • 414
  • 415
  • 416
  • 417
  • 418
  • 419
  • 420
  • 421
  • 422
  • 423
  • 424
  • 425
  • 426
  • 427
  • 428
  • 429
  • 430
  • 431
  • 432
  • 433
  • 434
  • 435
  • 436
  • 437
  • 438
  • 439
  • 440
  • 441
  • 442
  • 443
  • 444
  • 445
  • 446
  • 447
  • 448
  • 449
  • 450
  • 451
  • 452
  • 453
  • 454
  • 455
  • 456
  • 457
  • 458
  • 459
  • 460
  • 461
  • 462
  • 463
  • 464
  • 465
  • 466
  • 467
  • 468
  • 469
  • 470
  • 471
  • 472
  • 473
  • 474
  • 475
  • 476
  • 477
  • 478
  • 479
  • 480
  • 481
  • 482
  • 483
  • 484
  • 485
  • 486
  • 487
  • 488
  • 489
  • 490
  • 491
  • 492

Fabric OS 6.1.x administrator guide
347
18
Administering Extended Fabrics
This chapter provides information on implementing Extended Fabrics software.
Extended Fabrics licensing
To implement long distance dynamic (LD) and long distance static (LS) distance levels, you must first install
the
Extended Fabrics license
. Use the
licenseShow
command to verify that the license is present on both
switches used on both ends of the extended ISL.
Extended Fibre Channel over distance
Extended Fabrics software optimizes switch buffering to ensure the highest possible performance on inter-
switch links (ISLs). When Extended Fabrics is installed on gateway switches, the ISLs (E_Ports) are
configured with a large pool of buffer credits. The enhanced switch buffers help ensure that data transfer
can occur at near-full bandwidth to efficiently utilize the connection over the extended links.
The Extended Fabrics feature extends the distance the ISLs can reach over a dark fiber or wave division
multiplexing (WDM) connection. This is accomplished by providing enough buffer credits on each side of
the link to compensate for latency introduced by the extended distance.
Distance levels for extended Inter-Switch Links (ISLs)
As the distance between switches and the link speed increases, additional buffer credits are required for
the ports used for long distance connections. Distance levels define how these buffer credits are allocated
and managed for extended ISLs. Buffer credits are managed from a common pool available to a group of
ports on a switch. The buffer credit, can be changed for specific applications or operating environments,
but must be in agreement among all switches to allow formation of the fabric.
Information about switch characteristics and capacity in terms of buffers per port group, port speed, and
distances supported is in
Table 77
on page 352. This table may be useful in choosing an appropriate
distance level, and for estimating the impact an extended ISL may have on buffer availability and port
performance.
Buffer-to-Buffer Credits
Buffer-to-buffer (BB) credit flow control is implemented to limit the amount of data a port may send based
on the number and size of the frames sent from that port. Buffer credits represent finite physical port
memory. Within a fabric, each port may have a different number of BB credits. Within a connection, each
side may have a different number of BB credits. One buffer credit allows a device to send one payload up
to 2112 bytes (2148 with headers). Assuming that each payload is 2112, you need one credit per 1 km of
link length at 2 Gbps (smaller payloads require additional BB credits to maintain link utilization).
The final frame size must be a multiple of 4 bytes. If the data (payload) needs to segment, it will be padded
with 1 to 3 “fill-bytes” to achieve an overall 4 byte frame alignment. The standard frame header size is 24
bytes. If applications require extensive control information, up to 64 additional bytes (for a total of an 88
byte header) can be included. Because the total frame size cannot exceed the maximum of 2,148 bytes, the
additional header bytes will subtract from the data segment size by as much as 64 bytes (per frame). This
is why the maximum data (payload) size is 2,112 (because [2,112 – 64] = 2,048, which is exactly 2K-bytes
of data). The final frame, after it is constructed, is passed through the 8 byte to 10 byte conversion process.