IBM 71413SU Technical Reference

IBM 71413SU - System x3950 M2 Manual

IBM 71413SU manual content summary:

  • IBM 71413SU | Technical Reference - Page 1
    the x3850 M2 with the x3850 4 Comparing the x3950 M2 with the x3950 5 IBM ScaleXpander Option Kit 6 Multinode configurations 7 Front and rear layouts 11 Current models 12 IBM XA-64e fourth-generation chipset 14 Processors 16 XceL4v Dynamic Server Cache 21 System memory 21 SAS disk
  • IBM 71413SU | Technical Reference - Page 2
    , page 7 New ScaleXpander Option Kit to upgrade an x3850 M2 to an x3950 M2, page 6 Models of the x3950 M2, page 12 Models of the x3950 M2 supporting Windows® Server 2003, DataCenter Edition, page 12 Processor options for the x3950 M2 models, page 17 New 8 GB memory DIMMs to allow up to 256 GB of RAM
  • IBM 71413SU | Technical Reference - Page 3
    leading, 64-bit framework for high-performance scalable computing, the IBM System x3850 M2 and x3950 M2 are built on the power of the latest generation of industry-standard servers. Figure 1 The IBM System x3850 M2 and IBM System x3950 M2 Both the x3850 M2 and x3950 M2 combine unmatched four-socket
  • IBM 71413SU | Technical Reference - Page 4
    , with six or 12 processors and up to 768 GB RAM installed Four servers: A four-node complex comprised of four x3950 M2 servers, with eight or 16 processors and up to 1 TB RAM installed Note: Support for three-node and four-node configurations is planned for 2Q08. The following are the key features
  • IBM 71413SU | Technical Reference - Page 5
    x3950 Table 2 shows the major differences between the x3950 and the x3950 M2. Table 2 Major differences between x3950 and x3950 M2 Feature x3950 server Enterprise X-Architecture Third-generation XA-64e chipset x3950 M2 server Fourth generation XA-64e chipset IBM System x3950 M2 and x3850 M2
  • IBM 71413SU | Technical Reference - Page 6
    Maximum SMP Memory Internal disks Disk subsystem RAID support PCI-X slots per node PCI Express slots per node Active PCI slots Ethernet controller Video controller Keyboard and mouse connectors Service processor Trusted Platform Module Power supply Mechanical x3950 server x3950 M2 server Dual
  • IBM 71413SU | Technical Reference - Page 7
    the server to scale Multinode configurations The x3950 M2 is the base building block, or node, for a scalable system. At their most basic, these nodes are comprised of four-way SMP-capable systems with processors, memory, and I/O devices. The x3950 M2 is the building block that allows supported
  • IBM 71413SU | Technical Reference - Page 8
    x460, MXE-460, x3950 (machine type 8872 and 8878) and x3950 E (machine type 8874 and 8879) are not supported. Processors Each x3950 M2 server must have either two or four processors installed, and all processors in the complex must be the same speed and cache size. Memory For performance reasons
  • IBM 71413SU | Technical Reference - Page 9
    x3850 M2 and x3950 M2. Scalable systems setup Certain tasks must be performed before a multinode configuration can be operated successfully: All system firmware, including the system BIOS, diagnostics, BMC firmware and RSA II firmware, must be at the same level across all systems. Memory settings
  • IBM 71413SU | Technical Reference - Page 10
    is that partitions be formed on node boundaries. The interface where you set up and maintain partitions is an extension of the Remote Supervisor Adapter II Web interface. It is used to create, delete, control, and view scalable partitions. 10 IBM System x3950 M2 and x3850 M2 Technical Introduction
  • IBM 71413SU | Technical Reference - Page 11
    of the server. Gigabit Ethernet 1 Gigabit Ethernet 2 Remote Supervisor Adapter II Power supply 1 System serial SMP Expansion Port 1 SMP Expansion Port 2 SMP Expansion Port 3 Figure 6 Rear panel of the x3850 M2 and x3950 M2 Power supply 2 USB Video connector SAS IBM System x3950 M2 and x3850
  • IBM 71413SU | Technical Reference - Page 12
    Option Guide. The amount of memory memory is recommended. Windows Datacenter models IBM now offers two methods to run Microsoft® Windows Server® 2003 R2, Datacenter Edition on the x3950 M2, either the 32-bit version or the 64-bit version. Windows 2000 Datacenter Server is not supported. IBM
  • IBM 71413SU | Technical Reference - Page 13
    Datacenter operating system license is included with the hardware. All x3950 M2 Datacenter models come with a 4-socket license of Windows Server 2003 R2, Datacenter Edition. Licenses are combined when combining x3950 M2s to form a multinode configuration. IBM System x3950 M2 and x3850 M2 Technical
  • IBM 71413SU | Technical Reference - Page 14
    1 GB With 64-bit Windows Server 2003, Datacenter Edition (4-socket license for each system) 7141-3EY 2x 2.40 GHz Xeon E7330 Quad core 6 MB 8x 1 GB 7141-4EY 2x 2.93 GHz Xeon X7350 Quad core 8 MB 8x 1 GB IBM XA-64e fourth-generation chipset The x3850 M2 and x3950 M2 uses the fourth generation of
  • IBM 71413SU | Technical Reference - Page 15
    CPU 2 CPU 3 CPU 4 Each FSB: 1066 MHz 8.53 GBps IBM X4 Architecture core chipset Memory controller ("Hurricane 4") 8 ports, each: R: 4.26 GBps W: 2. port HDD backplane Figure 7 x3850 M2 and x3950 M2 system block diagram Each memory port out of the memory controller has a peak read throughput of
  • IBM 71413SU | Technical Reference - Page 16
    8 shows the media hood half-way open. Note: Power off the server before raising the media hood. Figure 8 The x3850 M2 and x3950 M2 with the media hood partly open The processors and the order of installation are shown in Figure 9 on page 17. 16 IBM System x3950 M2 and x3850 M2 Technical Introduction
  • IBM 71413SU | Technical Reference - Page 17
    or quad-core) CPU power consumption Part number for CPU option 7141-1SU 2 x 1.6 GHz Xeon E7310 Dual core 80 W 44W2784 7141-3SU 2 x 2.40 GHz Xeon E7330 Quad core 80 W 44E4242 7141-4SU 2 x 2.93 GHz Xeon X7350 Quad core 130 W 44E4243 IBM System x3950 M2 and x3850 M2 Technical Introduction 17
  • IBM 71413SU | Technical Reference - Page 18
    core is used to store micro-operations, decoded executable machine instructions. It serves those to the processor at rated speed. This additional level of cache saves decode time on cache hits. The Tigerton processors do not have L3 cache. 18 IBM System x3950 M2 and x3850 M2 Technical Introduction
  • IBM 71413SU | Technical Reference - Page 19
    die. Hyper-Threading Technology is not supported. Each core has separate L1 instruction and data caches, as well as .1 GBps peak throughput of the x3850 M2 and x3950 M2 eX4 Architecture with four memory cards is well-suited to dual-core IBM System x3950 M2 and x3850 M2 Technical Introduction 19
  • IBM 71413SU | Technical Reference - Page 20
    adds: - A set of new 64-bit general purpose registers (GPR) - 64-bit instruction pointers - The ability memory. The amount of physical memory will be determined by how many DIMM slots the server has and the maximum DIMM capacity supported and available at the time. 20 IBM System x3950 M2 and x3850 M2
  • IBM 71413SU | Technical Reference - Page 21
    for XceL4v cache. System memory The x3850 M2 and x3950 M2 models have either 4 GB or 8 GB of RAM standard, implemented as four or eight 1 GB DIMMs. Memory is PC2-5300 ECC DDR2. Memory is implemented in the x3850 M2 and x3950 M2 using memory cards. The server supports up to four memory cards. Each
  • IBM 71413SU | Technical Reference - Page 22
    memory cards. Refer to "Memory mirroring" on page 25 and "Hot-add memory" on page 27 for an explanation of how this can even be done while the system and the operating system are up and running. Tip: You do not need to lift the media hood to add or replace memory. 22 IBM System x3950 M2 and x3850 M2
  • IBM 71413SU | Technical Reference - Page 23
    is provided in System x3850 M2 Installation Guide. If you want to install the full 256 GB, you will need to remove the existing DIMMs and fully populate the x3850 M2 and x3950 M2 with four memory cards, each with eight 8 GB DIMMs. IBM System x3950 M2 and x3850 M2 Technical Introduction 23
  • IBM 71413SU | Technical Reference - Page 24
    data from the damaged DIMM is used until the system is powered down and the DIMM is replaced. Because x3850 M2 and x3950 M2 are now capable of supporting large amounts of memory, IBM has added the Initialization Scrub Control setting to the BIOS, to let customers choose when this scrubbing is done
  • IBM 71413SU | Technical Reference - Page 25
    memory The x3850 M2 and x3950 M2 support the replacing of failed DIMMs while the server is still running. This hot-swap support works in conjunction with memory mirroring. The server also supports adding additional memory while the server is running. Adding memory requires operating system support
  • IBM 71413SU | Technical Reference - Page 26
    DIMMs in card 4. Therefore, with memory mirroring enabled in the BIOS, you can hot-swap any memory card as long as the hot-swap enabled LED is lit. Refer to x3850 M2 and x3950 M2 User's Guide for complete instructions about how to hot-swap a memory card. After memory mirroring is enabled, the data
  • IBM 71413SU | Technical Reference - Page 27
    sees 4 GB minus half the total XceL4v Dynamic Server Cache if this is a multinode system, after memory mirroring is enabled. It is disabled in the BIOS by default. Hot-swap memory The x3850 M2 and x3950 M2 support hot-swap memory. If a DIMM fails, it can be replaced with a new DIMM without powering
  • IBM 71413SU | Technical Reference - Page 28
    capability and is supported on the x3850 M2 and x3950 M2 is Windows Server 2003, Enterprise Edition or Datacenter Edition. Memory hot-add must be specifically enabled in the BIOS setup. When this is done, the system allocates blank windows of memory space for future memory additions. By enabling
  • IBM 71413SU | Technical Reference - Page 29
    is created. Unlike with the x3850, the x3850 M2 and x3950 M2 now support Memory ProteXion with the HPMA setting, providing maximum performance while still providing the reliability of dedicated slot, as shown in Figure 14 on page 30 IBM System x3950 M2 and x3850 M2 Technical Introduction 29
  • IBM 71413SU | Technical Reference - Page 30
    are only supported externally because they require a minimum of six or eight drives, respectively. The ServeRAID-MR10k supports stripe voltage, temperature, and current to the server. Transportable: The iTBBU can be used M2 or x3950 M2. 30 IBM System x3950 M2 and x3850 M2 Technical Introduction
  • IBM 71413SU | Technical Reference - Page 31
    ://www.redbooks.ibm.com/abstracts/tips0054.html The following publications are available for further reference: ServeRAID MR10k Quick Installation Guide ServeRAID MR10k User's Guide ServeRAID MR Software User's Guide ServeRAID-MR Device Driver Installation IBM System x3950 M2 and x3850 M2 Technical
  • IBM 71413SU | Technical Reference - Page 32
    Server 2003 to be able to use Active PCI on the x3850 M2 and x3950 M2. Support in Linux® distributions is planned for 2008. The optional ServeRAID-MR10k adapter does not use a PCI slot because it has a dedicated slot on the motherboard (TPM). 32 IBM System x3950 M2 and x3850 M2 Technical Introduction
  • IBM 71413SU | Technical Reference - Page 33
    1 is slots 1, 2, 3 and 4; bridge 2 is slots 5, 6, and 7) with a maximum of four per system. Examples of adapter cards that have bandwidth maximums of 8 Gbps or more include 10 Gbps Ethernet card and dual-port 4 Gbps Fibre Channel cards. IBM System x3950 M2 and x3850 M2 Technical Introduction 33
  • IBM 71413SU | Technical Reference - Page 34
    enable individual fan replacement without powering down the server. Each of the three groups of two fans is redundant. In the event of a fan failure, the other fans will speed up to continue to provide adequate cooling until the fan can be 34 IBM System x3950 M2 and x3850 M2 Technical Introduction
  • IBM 71413SU | Technical Reference - Page 35
    (one below the other) Memory redundancy features: memory mirroring, Memory ProteXion, and ChipKill Figure 16 Redundancy features of the x3850 M2 and x3950 M2 Light path diagnostics To limit the customer's need to slide the server out of the rack to diagnose problems, a light path diagnostics panel
  • IBM 71413SU | Technical Reference - Page 36
    viewing. System power state tracking The BMC monitors the system power state and logs transitions into the system event log. System initialization The BMC has I2C access to certain system components that might require initialization before power-up. System software state tracking 36 IBM System x3950
  • IBM 71413SU | Technical Reference - Page 37
    connectors are used on the x3850 M2 and x3950 M2. The other external ports (including remote power and the ASM interconnect) are not supported on these servers. System-management connector Video connector Ethernet connector Video adapter System management daughter card Figure 18 Remote Supervisor
  • IBM 71413SU | Technical Reference - Page 38
    log and export them while the server is up and running. Operating system failure screen capture When the operating system hangs, for example, with a blue screen, you can do a screen capture for support purposes. Additionally, the RSA II stores the last failure screen in memory so you can refer to it
  • IBM 71413SU | Technical Reference - Page 39
    Moon is the team leader at IBM System x Techline in Greenock, Scotland. He is coauthor of IBM System x3755 Solution Assurance Product Review Guide. He has more than 10 years of experience with System x servers, including pre-sale and post-sale technical support. He has been involved with Solution
  • IBM 71413SU | Technical Reference - Page 40
    Kolvick Mark Kapoor Dan Kelaher Colin Mckerrell Vinod Menon Jim Rix Bill Schwartz Ketan Shah Karen Taylor Steve Zaharias IBM Marketing Craig Alexander Jay Bretzmann Mark Chapman Kyle Hampton Beth McElroy Brian Sanders Novell Adam Spiers 40 IBM System x3950 M2 and x3850 M2 Technical Introduction
  • IBM 71413SU | Technical Reference - Page 41
    right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service. IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not
  • IBM 71413SU | Technical Reference - Page 42
    review Redbooks form found at: ibm.com/redbooks Send your comments in an e-mail to: [email protected] Mail your comments to: IBM Corporation, International Technical Support , or service names may be trademarks or service marks of others. 42 IBM System x3950 M2 and x3850 M2 Technical Introduction
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42

© Copyright IBM Corp. 2007, 2008. All rights reserved.
ibm.com
/redbooks
1
Red
paper
IBM System x3950 M2 and x3850 M2
Technical Introduction
Table of Contents
Summary of changes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Comparing the x3850 M2 with the x3850. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Comparing the x3950 M2 with the x3950. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
IBM ScaleXpander Option Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Multinode configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Front and rear layouts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Current models. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
IBM XA-64e fourth-generation chipset . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Processors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
XceL4v Dynamic Server Cache . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
System memory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
SAS disk subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
PCI subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Broadcom dual Gigabit Ethernet controller . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Redundancy. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Light path diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Baseboard Management service processor. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Remote Supervisor Adapter II . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Trusted Platform Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Active Energy Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
The team that wrote this IBM Redpaper . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
David Watts
Robert Moon