HP ProLiant 4000 I/O Performance Tuning of Compaq Servers

HP ProLiant 4000 Manual

HP ProLiant 4000 manual content summary:

  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 1
    Drive Technology 28 RAID Level Performance.........35 Hardware RAID vs. Software RAID 36 I/O Performance Tuning of Compaq Servers Abstract: Tuning the disk system wide range of server applications. The major areas examined in this paper are • disk systems • NICs • memory • system configuration •
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 2
    or registered trademarks of their respective companies. Compaq, Contura, Deskpro, Fastart, Compaq Insight Manager, LTE, PageMarq, Systempro, Systempro/LT, ProLiant, TwinTray, ROMPaq, LicensePaq, QVision, SLT, ProLinea, SmartStart, NetFlex, DirectPlus, QuickFind, RemotePaq, BackPaq, TechPaq, SpeedPaq
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 3
    memory bottlenecks, can seriously degrade performance. For example, simply adding or rearranging drives or adapters can, in some cases, increase the throughput of your entire disk system by as much as 96%. While not all servers your server is delivering maximum performance. Compaq performs extensive
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 4
    server environment, there are variables that must be considered regardless of configuration and operation. For instance, physical drive delays as the heads are positioned over the data are present in every computer. Performance tuning seeks to reduce the effect of individual delays on overall system
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 5
    and a 40% price difference. In general, simply adding redundant instances of a system allows parallel P In this paper, a flag execution of that system's task and can increase the effective performance of that system. For instance, striping the data from a single drive onto two indicates
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 6
    bus. P In order to maintain maximum performance, Compaq recommends that you balance the load according to the architecture in your server. Bus Balancing in ProLiant Servers Bridged PCI bus P In bridged PCI busses, such as the ProLiant 2500 and ProLiant 2500R, you should populate the primary PCI bus
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 7
    of Compaq Servers 7 adapters with the lightest I/O load. Microprocessor Motherboard Chipset System Memory 133MB/s Primary PCI Bus 133MB/s PCI Bridge Chip drive array controller, split the two network controllers between the busses. Network controllers consume more bandwidth than array
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 8
    Table 1. PCI Bus Architectures of ProLiant servers PCI Slot Number 1 2 3 4 5 6 7 8 9 10 11 Bridged PCI Bus Systems Peered PCI Bus Systems ProLiant 2500 ProLiant 1200 ProLiant 1600 ProLiant 3000/ ProLiant 5000 ProLiant 6000/ ProLiant 5500 ProLiant 7000 Secondary Secondary Secondary Primary
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 9
    Compaq servers are less likely to become saturated in environments where random, small-block transfers are the norm. Operating critical part of your server's performance. Compaq recommends more powerful and MB. Ultra The Ultra protocol, part of the SCSI-3 specification, builds on the performance of
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 10
    Compaq Servers 10 SCSI Bus Interface Since SCSI was introduced, several specifications have been released and many new extensions have been defined. With each subsequent release of the SCSI specification Devices per Bus: Wide SCSI busses support 16 devices (15 drives, plus controller) as opposed to
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 11
    of Compaq Servers 11 interface and because its backward compatibility provides investment protection for Compaq customers. P In general, use devices with the highest SCSI specification that your controller can support. In the case of Fibre Channel Arrays, use Wide-Ultra SCSI-3 compatible drives
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 12
    Maximum Number of (Busses) Drives 1 7 2 8 1 7 2 12-1" or 8-1.6" SCSI Revision Supported Wide-Ultra SCSI-3 Wide-Ultra SCSI-3 Fast-Wide SCSI-2 Wide-Ultra SCSI-3 The SMART-2 family of controllers and the ProLiant Storage System boxes provide an integrated storage array solution. The various
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 13
    on the FC. If you operate your server under such extreme I/O conditions, you server. Compaq Fibre Channel Array 5 Server Compaq Fibre Channel Array 0 Compaq Fibre Channel Array 4 Fibre Channel Storage Hub 7 Compaq Fibre Channel Array 1 Compaq Fibre Channel Array 3 Compaq Fibre Channel Array
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 14
    or placing a heavier load on one bus. Compaq storage on Fibre Channel is the Fibre Channel Array. These arrays consist of a chassis with a Fibre Channel adapter and bays for eight 1-1/2 inch drives or twelve 1 inch drives. There are two SCSI busses in each array; one on the left and the other on
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 15
    of physical delays in various drives. Table 5. Relative Performance of Drive Technologies Rotational Speed 3,600 rpm 5,400 rpm 7,200 rpm 10,000 rpm Average RAID can provide phenomenal performance for your drive system and at the same time protect your server from data loss. Published in 1987,
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 16
    Compaq Servers 16 service. To a client, distributing the workload means that any individual request will be filled more quickly. By spanning the data and workload to multiple devices, it becomes more likely that an individual drive across all of the drives in the array. This configuration provides
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 17
    parity and recovery information. In high level RAID systems, such as RAID 5, using OS RAID solutions and allowing the server CPU to handle this task can consume a great deal of CPU resources. Moreover, the hardware RAID implementation itself is up to nine times faster than a software array. Hardware
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 18
    you weigh the performance gains against the added cost of the second controller card. System Memory Even the most optimized server can improve response time to client requests by adding additional system memory. Since server operating systems employ powerful caching algorithms, client ECG044.0399
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 19
    drive to fetch data. By adding more RAM to your server, you can allocate additional memory operating systems are "auto-tuning," manual adjustment of the server environment variables and registry entries may be necessary to achieve optimal server server performance. None of these tools provide specific
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 20
    by CPU #1 only. In this case you would select the Processor object, then the Interrupts/sec counter, and the #1 instance. Compaq Resource Paq Version 5.0 for Microsoft Windows NT contains additional hardware performance monitoring components that give specific insight into your Compaq server PCI
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 21
    provide insight into CPU and, in some servers, PCI bus or EISA bus utilization. Compaq Insight Manager for NetWare adds the ability to add utilization thresholds to the comprehensive alerting and reporting management system. SCO UnixWare and OpenServer With SCO UNIX operating systems Compaq and SCO
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 22
    volumes of information that may be specific enough to actually provide clear tuning instructions for your environment. As part of the ASE training courses, Compaq offers in-depth classes on Integration and Tuning for each of the supported operating systems. Information of these classes can be
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 23
    Tests were run on a variety of Compaq servers, including ProLiant 1850R, ProLiant 6500, and ProLiant 5000. The results shown here are not system. Fibre Channel vs. SMART-2DH performance Below are several graphical performance comparisons between Fibre Channel Storage Array and a SMART-2DH SCSI Array
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 24
    I/O Performance Tuning of Compaq Servers 24 Simulated Application: Web Server (8 KB, 100% Read, 0% Write, 0% Sequential, 100% Random) 900 800 700 600 500 400 300 200 100 0 RAID 0 RAID 1 RAID 5 RAID Level RAID 5 No Cache Fibre Channel Array SMART-2DH Figure 8. Relative performance of SCSI
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 25
    Sequential, 50% Random) 1600 1400 1200 1000 800 600 400 200 0 1 2 3 4 5 6 Number of Fibre Channel Arrays 5 Meter Cable 10 Kilometer Cable 2 x 10 Kilometer Cables Figure 11. Relative performance of FC-AL systems for common workstation loads. These results were obtained using Iometer
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 26
    of Compaq Servers 26 Simulated Workload: OLTP (2 KB, 67% Read, 33% Write, 0% Sequential, 100% Random) 3000 2500 2000 1500 1000 500 0 1 2 3 4 5 6 Number of Fibre Channel Arrays 5 Meter Cable 10 Kilometer Cable 2 x 10 Kilometer Cables Figure 12. Relative performance of FC-AL systems
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 27
    of Compaq Servers 27 Simulated Workload: Decision Support (25% Access, 8 KB, 0% Read, 100% Write, 100% Sequential, 0% Random 75% Access, 8 KB, 100% Read, 0% Write, 80% Sequential 20% Random) 900 800 700 600 500 400 300 200 100 0 1 2 3 4 5 6 Number of Fibre Channel Arrays 5 Meter
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 28
    Tuning of Compaq Servers 28 IO/sec vs. Number of Fibre Channel Arrays 4500 4000 3500 3000 2500 2000 1500 1000 500 0 0 1 2 3 4 5 6 7 8 9 10 11 Number of Fibre Channel Arrays 2 KB OLTP WS Mix Web Server Decision Support Figure 16. Relative sustained I/O for each number of FC arrays under different
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 29
    Representative Compaq 7,200-rpm drive Compaq 10k-II drive 800 600 400 200 With larger block sizes, the SCSI bus will saturate, limiting the I/O rate 0 1 2 3 4 5 6 7 Number of Drives/Block Count Figure 17. Composite performance of 10k-II drives and 7,200-rpm drives in a typical server
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 30
    of Compaq Servers 30 60 Read Latency - 7,200-rpm Write Latency - 7,200-rpm 50 Read Latency - 10k-II Write Latency - 10k-II 40 Latency (ms) 30 20 10 0 0 500 1000 1500 2000 2500 3000 3500 4000 4500 I/Os per Second Figure 19. Response versus throughput for 10k and 7.2k rpm hard drives
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 31
    10k-II RAID 5 400 300 200 100 0 1 2 4 6 8 12 16 20 24 28 32 36 40 44 48 52 56 60 Server Configuration: Number of Clients 128MB RAM Figure 21. Relative performance of a 7-disk, RAID 5 array of 10k rpm drives and a 7-disk, RAID 5 array of 7.2k rpm drives under Windows NT. These results were
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 32
    I/O Performance Tuning of Compaq Servers 32 Like Capacity Scaling Figures 23 through 27 show, again, the sustained performance of distributing loads to more drives regardless of the RAID level. Like Capacity Scaling (RAID 0 - 1 Controller) 16,000,000 Server Throughput (Bytes/sec) 14,000,000 12,
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 33
    I/O Performance Tuning of Compaq Servers 33 Server Throughput (Bytes/sec) Like Capacity Scaling (RAID 5 - 1 or warranties as to the results of the test. Like Capacity Scaling (RAID 5 - 1 Controller) Server Throughput (Bytes/sec) 14,000,000 12,000,000 10,000,000 8,000,000 6,000,000 28
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 34
    Tuning of Compaq Servers 34 Drive Controller Scaling Figures 27 and 28 illustrate the performance gains of distributing parity calculations by adding RAID array controllers. In Figure 29, the gains are negligible because the RAID 0 does not place a computational load on the array controller
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 35
    1998 by Intel Corporation. Intel does not endorse any Iometer results. Compaq Smart-2DH SCSI Controller Simulated Application: Web Server (8 KB, 100% Read, 0% Write, 0% Sequential, 100% Random) 900 800 700 600 500 400 300 200 100 0 RAID 0 RAID 1 RAID 5 RAID Level RAID 5 No Cache Figure 30
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 36
    a video server application. These results were obtained using Iometer version 1998.10.08, Copyright 1998 by Intel Corporation. Intel does not endorse any Iometer results. Compaq Smart-2DH performance benefits of a hardware RAID solution, especially when a drive in a RAID 5 array fails. ECG044.0399
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 37
    I/O Performance Tuning of Compaq Servers 37 30000 25000 (256 KB Block 2000 1500 1000 921 1035 SMART-2SL SW RAID in NT 500 280 0 RAID 1 ( 2 drvs ) RAID 5 ( 6 drvs ) RAID 5, Degraded ( 5 drvs ) Figure 34. Relative maximum sustained throughput for both hardware and software RAID systems
  • HP ProLiant 4000 | I/O Performance Tuning of Compaq Servers - Page 38
    I/O Performance Tuning of Compaq Servers 38 IO/s for a Common Database Profile (8KB Block Size, 67% Read, 100% Random) 450 400 377 350 335 300 288 IO/sec 250 200 200 SMART-2SL SW RAID in NT 150 121 100 75 50 0 RAID 1 ( 2 drvs) RAID 5 ( 6 drvs ) RAID 5, Degraded ( 5 drvs) Figure 35.
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38

Technical Guide
Help us improve our technical communication. Let us know what you think
about the technical information in this document. Your feedback is valuable
and will help us structure future communications. Please send your
comments to:
March 1999
ECG044.0399
Prepared by OS
Integration
Engineering
Compaq Computer Corporation
Contents
Executive Summary
...................
3
Introduction
................................
4
I/O Performance and
Recommendations
.....................
4
Network Interface
......................
5
Peripheral Component
Interconnect (PCI) Bus
..............
6
SCSI Bus
..................................
9
Fibre Channel
.........................
12
Drive Technology
....................
14
System Memory
......................
18
OS Performance Monitoring
Tools
.........................................
19
Microsoft Windows NT
............
20
Novell NetWare
.......................
21
SCO UnixWare and
OpenServer
............................
21
Conclusion
..............................
22
Appendix - Performance
Tuning Data
..............................
23
Fibre Channel Bus
..................
23
Drive Technology
....................
28
RAID Level Performance
.........
35
Hardware RAID vs. Software
RAID
......................................
36
I/O Performance Tuning of
Compaq Servers
Abstract:
Tuning the disk system and I/O paths can be key to
achieving maximum performance from your server. This paper
begins with definitions, guidelines, and recommendations for I/O
performance tuning. The last section of this paper provides actual
performance data to reinforce recommendations. In general, this
paper deals with universal I/O concerns and applies to a wide range
of server applications. The major areas examined in this paper are
disk systems
NICs
memory
system configuration
performance monitoring tools.