HP ProLiant DL380G5-WSS 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 251

usage is important if replication is to be successful., Replication increases the load on the CPU

Page 251 highlights

• Replication increases the use of physical memory and swap space. If your system is running well with 8GB of main memory and you add replication to it at near the configuration limits, there is a substantial chance that the system will be unable to service its normal workload in addition to the replication workload. • Replication must have sufficient bandwidth between sites to allow data transfers to complete in a timely fashion. Calculating how much data flows between sites is difficult, since it is based upon the speed with which data changes, the replication interval, and many other factors. A rough guess for the bandwidth required is the amount of data that is changing per interval divided by the interval length. (The replication overhead in packet headers is made up for by the potential compression of data being transferred in this estimate). If your replicated load is composed primarily of small files or small changes, the bandwidth consumed by replication may be much lower than the full bandwidth available to it, due to latency in file access during the replication process. This can slow replication significantly. As a rule of thumb, during instance zero replication (when a new filesystem is being populated on the destination side of the link), when replication can be at its most efficient, the maximum replication rate for a 1Gb link is roughly 100-110 MB/sec. This means that a 10TB filesystem will take at least 27 hours to fully replicate. This is without any delays, errors, or network trouble, and using the replication network as hard as it is possible to use it. A non-instance zero case, where the changes are scattered throughout the filesystem, will use the network less effectively and thus will take longer to replicate a given amount of data. It easy to see that planning for replication bandwidth usage is important if replication is to be successful. • Replication increases the load on the CPU, especially on the replication sentinel node. • Replication loads the administrative filesystem heavily. System capacity must be increased for replication to proceed successfully at high loads. The system load is greatest is when there is a sudden surge of file or filesystem changes. It is difficult to predict the effects on the system of surges from the steady state performance of the system. For this reason, HP recommends that the system be over-configured for day-to-day use so that surges can be accommodated without problems. Replication has been tested with up to 16 nodes and 200 replication mount points. Clusters that are configured to these limits should expect that the nodes on which the sentinel is expected to run should be configured per the recommendations below. HP Scalable NAS File Serving Software administration guide 251

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
  • 131
  • 132
  • 133
  • 134
  • 135
  • 136
  • 137
  • 138
  • 139
  • 140
  • 141
  • 142
  • 143
  • 144
  • 145
  • 146
  • 147
  • 148
  • 149
  • 150
  • 151
  • 152
  • 153
  • 154
  • 155
  • 156
  • 157
  • 158
  • 159
  • 160
  • 161
  • 162
  • 163
  • 164
  • 165
  • 166
  • 167
  • 168
  • 169
  • 170
  • 171
  • 172
  • 173
  • 174
  • 175
  • 176
  • 177
  • 178
  • 179
  • 180
  • 181
  • 182
  • 183
  • 184
  • 185
  • 186
  • 187
  • 188
  • 189
  • 190
  • 191
  • 192
  • 193
  • 194
  • 195
  • 196
  • 197
  • 198
  • 199
  • 200
  • 201
  • 202
  • 203
  • 204
  • 205
  • 206
  • 207
  • 208
  • 209
  • 210
  • 211
  • 212
  • 213
  • 214
  • 215
  • 216
  • 217
  • 218
  • 219
  • 220
  • 221
  • 222
  • 223
  • 224
  • 225
  • 226
  • 227
  • 228
  • 229
  • 230
  • 231
  • 232
  • 233
  • 234
  • 235
  • 236
  • 237
  • 238
  • 239
  • 240
  • 241
  • 242
  • 243
  • 244
  • 245
  • 246
  • 247
  • 248
  • 249
  • 250
  • 251
  • 252
  • 253
  • 254
  • 255
  • 256
  • 257
  • 258
  • 259
  • 260
  • 261
  • 262
  • 263
  • 264
  • 265
  • 266
  • 267
  • 268
  • 269
  • 270
  • 271
  • 272
  • 273
  • 274
  • 275
  • 276
  • 277
  • 278
  • 279
  • 280
  • 281
  • 282
  • 283
  • 284
  • 285
  • 286
  • 287
  • 288
  • 289
  • 290
  • 291
  • 292
  • 293
  • 294
  • 295
  • 296
  • 297
  • 298
  • 299
  • 300
  • 301
  • 302
  • 303
  • 304
  • 305
  • 306
  • 307
  • 308
  • 309
  • 310
  • 311
  • 312
  • 313
  • 314
  • 315
  • 316
  • 317
  • 318
  • 319
  • 320
  • 321
  • 322
  • 323
  • 324
  • 325
  • 326
  • 327
  • 328
  • 329
  • 330
  • 331
  • 332
  • 333
  • 334
  • 335
  • 336
  • 337
  • 338
  • 339
  • 340
  • 341
  • 342
  • 343
  • 344
  • 345
  • 346
  • 347
  • 348
  • 349
  • 350
  • 351
  • 352
  • 353
  • 354
  • 355
  • 356
  • 357
  • 358
  • 359
  • 360
  • 361
  • 362
  • 363
  • 364
  • 365
  • 366
  • 367
  • 368
  • 369
  • 370
  • 371
  • 372
  • 373
  • 374
  • 375
  • 376
  • 377
  • 378
  • 379
  • 380
  • 381
  • 382
  • 383
  • 384
  • 385
  • 386
  • 387
  • 388
  • 389
  • 390
  • 391
  • 392
  • 393
  • 394
  • 395
  • 396
  • 397
  • 398
  • 399
  • 400
  • 401
  • 402
  • 403
  • 404
  • 405
  • 406
  • 407
  • 408
  • 409
  • 410
  • 411
  • 412
  • 413
  • 414
  • 415
  • 416
  • 417
  • 418
  • 419
  • 420
  • 421
  • 422
  • 423
  • 424
  • 425
  • 426
  • 427
  • 428
  • 429
  • 430
  • 431
  • 432
  • 433
  • 434
  • 435

Replication increases the use of physical memory and swap space. If your system
is running well with 8GB of main memory and you add replication to it at near
the configuration limits, there is a substantial chance that the system will be unable
to service its normal workload in addition to the replication workload.
Replication must have sufficient bandwidth between sites to allow data transfers
to complete in a timely fashion. Calculating how much data flows between sites
is difficult, since it is based upon the speed with which data changes, the replic-
ation interval, and many other factors. A rough guess for the bandwidth required
is the amount of data that is changing per interval divided by the interval length.
(The replication overhead in packet headers is made up for by the potential
compression of data being transferred in this estimate).
If your replicated load is composed primarily of small files or small changes, the
bandwidth consumed by replication may be much lower than the full bandwidth
available to it, due to latency in file access during the replication process. This
can slow replication significantly. As a rule of thumb, during instance zero replic-
ation (when a new filesystem is being populated on the destination side of the
link), when replication can be at its most efficient, the maximum replication rate
for a 1Gb link is roughly 100-110 MB/sec. This means that a 10TB filesystem
will take at least 27 hours to fully replicate. This is without any delays, errors, or
network trouble, and using the replication network as hard as it is possible to use
it. A non-instance zero case, where the changes are scattered throughout the
filesystem, will use the network less effectively and thus will take longer to replicate
a given amount of data. It easy to see that planning for replication bandwidth
usage is important if replication is to be successful.
Replication increases the load on the CPU, especially on the replication sentinel
node.
Replication loads the administrative filesystem heavily.
System capacity must be increased for replication to proceed successfully at high
loads. The system load is greatest is when there is a sudden surge of file or filesystem
changes. It is difficult to predict the effects on the system of surges from the steady
state performance of the system. For this reason, HP recommends that the system be
over-configured for day-to-day use so that surges can be accommodated without
problems.
Replication has been tested with up to 16 nodes and 200 replication mount points.
Clusters that are configured to these limits should expect that the nodes on which the
sentinel is expected to run should be configured per the recommendations below.
HP Scalable NAS File Serving Software administration guide
251