HP ProLiant DL360e Configuring and using DDR3 memory with HP ProLiant Gen8 Ser
HP ProLiant DL360e Manual
 |
View all HP ProLiant DL360e manuals
Add to My Manuals
Save this manual to your list of manuals |
HP ProLiant DL360e manual content summary:
- HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 1
Memory 7 ProLiant Gen8 memory Architecture ...7 HP ProLiant Gen8 Servers...8 HP ProLiant Gen8 Processors ...8 DDR3 memory for HP ProLiant Gen8 servers 9 Populating memory in HP ProLiant Gen8 servers 10 HP ProLiant Gen8 memory slot configurations 10 Population rules for HP ProLiant Gen8 servers - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 2
optimizing for power consumption 21 Optimizing for Resiliency...21 Understanding unbalanced memory configurations 22 Memory configurations that are unbalanced across channels 22 Memory configurations that are unbalanced across Processors 22 BIOS Settings for memory ...23 Controlling Memory Speed - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 3
provides superior performance over 3rd party memory in certain configurations. The new 2 socket HP ProLiant Gen8 servers also feature advances in memory support. HP ProLiant Gen8 servers based on the Intel® Xeon® E5-2600 series processor-family support 4 separate memory channels per CPU and up to - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 4
platform architecture to be able to run at memory speeds up to 1866 MT/s once processor chipsets supporting it are available. Basics of DIMMs Before exploring the new technologies in DDR3 DIMMs for HP ProLiant Gen8 servers, let's quickly review some of the basics of DIMM technology. DRAM technology - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 5
consumption. See the section on BIOS settings for details. DDR3 DIMM types ProLiant Gen8 servers support three different DIMM types - Unbuffered with ECC Memory (UDIMMs), Registered Memory (RDIMMs) and Load Reduced Memory (LRDIMMs). UDIMMs and RDIMMs are familiar from their use in both G6 and G7 - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 6
to run on HP ProLiant Gen8 servers. Use of HP SmartMemory DIMMs enables extended performance and manageability features for the 2P ProLiant Gen8 servers. HP SmartMemory support extended performance compared to third party memory for several DIMM types and configurations. Table 3 summarizes these - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 7
/c02878598.pdf ProLiant Gen8 memory architecture and DDR3 Memory ProLiant Gen8 memory Architecture The DDR3 memory architecture for HP ProLiant Gen8 servers (as shown in Figure 1) features several advancements over that of G6/G7 servers, including the following: • 4 memory channels per processor - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 8
In addition, different models support different maximum memory speeds. This affects the maximum performance and the power consumption of the memory subsystem and the server in general. Table 5: HP ProLiant Gen8 Intel Xeon E5-2600 Series Processor Family Processor Model Number CPU Frequency Level - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 9
E5-2609 E5-2603 2.40 GHz 1.80 GHz 10MB 10MB 1066 MT/s 1066 MT/s 8.5 GB/s 8.5 GB/s DDR3 memory for HP ProLiant Gen8 servers HP ProLiant Gen8 servers using the Intel Xeon processors support the use of DDR3 DIMMs specified at speeds of both 1600 MT/s (PC3-12800) and 1333 MT/s (PC3-10600). Table 6 - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 10
Memory Part Number Decoder Populating memory in HP ProLiant Gen8 servers HP ProLiant Gen8 memory slot configurations The latest HP ProLiant Gen8 servers feature one of two memory slot configurations - either 16 or 24 memory slots total. For servers using the Intel® Xeon® E5-2600 series processor - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 11
not supported in HP ProLiant Gen8 servers. memory type and number of installed processors. • To realize the performance memory capabilities listed in this document, HP SmartMemory is required. DIMM Population Order Figure 3 shows the memory slot configuration for 24-slot 2P ProLiant DL380pGen8 server - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 12
you should consult the User Guide: hp.com > support & drivers > product support & troubleshooting > enter your product Figure 4 shows the memory slot configuration for 16 slot 2P ProLiant Gen8 servers. Their configuration is quite similar to the to the 24 slot servers. However, they have only 2 DIMM - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 13
each processor (For 2 processor systems, this means populating in groups of 8 identical DIMMs). • Use the same HP SmartMemory part number in each memory channel. Optimizing memory configurations By taking advantage of the different DIMM types, sizes and speeds available for HP ProLiant Gen8 servers - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 14
Table 7: Maximum memory capacities for HP 2P ProLiant Gen8 servers using different DIMM types Number of DIMM Slots DIMM Type Maximum Capacity Configuration 24 UDIMM 128 GB 16 x 8GB 2R RDIMM 384 GB 24 x 16GB 2R LRDIMM 768 GB 24 x 32GB 4R 16 UDIMM 128 GB 16 x 8GB - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 15
1DPC HP ProLiant Gen8 servers 160 140 120 100 80 Idle Latency 60 Loaded Latency 40 20 0 2 GB 4GB 8GB 4GB 4GB 8GB 8GB 16GB 16GB 32GB 1Rx8 2Rx8 2Rx8 1Rx4 1Rx4 2Rx4 1Rx4 2Rx4 2Rx4 4Rx4 1333 U1333 U 1333 U 1333 R 1600 R 1333 R 1600 R 1333 R 1600 R 1333 L Factors influencing memory throughput - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 16
as a function of number of populated channels 16 GB 2R DDR3-1600 at 1 DIMM per channel Throughput (GB/s) 100.00 80.00 60.00 40.00 20.00 0.00 1 2 4 6 8 Memory speed and throughput Higher memory speeds increase throughput. Using a one DIMM per channel configuration, Figure 8 shows that - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 17
40 30 20 10 0 800 MT/s 1066 MT/s 1333 MT/s 1600 MT/s Number of DIMMs per channel and throughput Figure 9 shows the measured memory throughput for several one and two DIMM per channel configurations. Throughput actually decreases when a 2nd DIMM is added to each channel. With 2 DIMMs - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 18
2R 1600 RDIMM 1 DIMM / channel 2 DIMMs / channel Throughput benefits of two DIMMs per Channel at 1333 MT/s Although Intel's design supports two UDIMMs per channel running at 1066 MT/s, HP has engineered ProLiant Gen8 servers to reliability operate at 1333 MT/s with 2 DIMMs per channel when using - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 19
LV RDIMMs per channel at 1.35V vs. 1.5V operation in a 24 slot HP ProLiant Gen8 server Throughput (GB/s) Idle Power (W) Loaded Power (W) 3 DPC @ 1.5V 60.5 16.6 98.6 3DPC @ 1.35V 60.5 15.5 78.8 Delta 0% 7% lower 20% lower HP 1333 MT/s SmartMemory LRDIMMs are capable of operating at 1.35V at one - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 20
by DIMM capacity. Loaded and Idle power for each DIMM type and capacity supported on HP ProLiant Gen8 servers Power consumed by DIMM type and capacity HP ProLiant Gen8 servers 12 10 8 6 Idle Power Loaded Power 4 2 0 2 GB 4GB 8GB 4GB 4GB 8GB 8GB 16GB 16GB 32GB 1Rx8 2Rx8 2Rx8 1Rx4 1Rx4 2Rx4 1Rx4 2Rx4 - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 21
can configure 2P ProLiant Gen8 servers up to 128 GB using UDIMMs. • Use the smallest number of DIMMs possible, by using the highest capacity DIMM. • For additional power savings with any memory configuration, you should run memory at the slowest speed possible. With HP ProLiant Gen8 servers, this - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 22
each of the 4 channels of each installed processor are not identical. • Unbalanced across processors. A memory configuration is unbalanced across processors if a different amount of memory is installed on each of the processors. Memory configurations that are unbalanced across channels In unbalanced - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 23
memory configuration that is unbalanced across processors. BIOS Settings for memory The settings below in the ROM Based Setup Utility (RBSU) of HP ProLiant Gen8 server BIOS provide control over memory configuration. To launch RBSU, press the F9 key during the server boot sequence. Controlling Memory - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 24
In NUMA configuration, each CPU core allocates memory closest to it. If all this near memory is consumed, then it will allocate memory attached to the remote CPU socket. When node interleaving is enabled, BIOS builds the system memory map by first using all memory attached to the first processor and - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 25
ual/c02126499/c02126499.pdf http://h20000.www2.hp.com/bc/docs/support/SupportMan ual/c02878598/c02878598.pdf © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 26
Configurations for 2P ProLiant Gen8 servers 24 DIMM slot servers Sample Memory Configurations (2CPU) Total Memory 1333 768 L 24 x 8GB 2R 1333 R 192 Number of DIMMs 8 8 8 8 16 8 8 8 .4 161.9 138.9 235.0 189.0 Throughput (GB/s) Idle Power (W) Loaded Power (W) 74.3 76.1 74.0 81.0 73.5 76.9 77 - HP ProLiant DL360e | Configuring and using DDR3 memory with HP ProLiant Gen8 Ser - Page 27
DIMM Slot Servers Sample Memory Configurations Total Memory (GB R 16 x 16GB 2R 1600 256 R 16 x 32GB 4R 1333 512 L Number of DIMMs 8 8 8 8 16 8 8 8 16 16 16 8 8 152.1 115.8 122.1 150.7 121.4 138.9 Throughput (GB/s) Idle Power (W) Loade d Power (W) 74.27 76.14 74.03 0.56 1.13 2.14 11
-
1 -
2 -
3 -
4 -
5 -
6 -
7 -
8
-
9
-
10
-
11
-
12
-
13
-
14
-
15
-
16
-
17
-
18
-
19
-
20
-
21
-
22
-
23
-
24
-
25
-
26
-
27
 |
 |
Configuring and using DDR3 memory with HP ProLiant
Gen8 Servers
Best Practice Guidelines for ProLiant servers with the Intel® Xeon® E5-2600
processor series
Engineering Whitepaper, 1
st
Edition
Introduction
.........................................................................................................................................
3
Overview of DDR3 memory technology
..................................................................................................
3
Basics of DDR3 memory technology
....................................................................................................
3
DDR3 Memory Technology
............................................................................................................
3
DDR3 Speeds
...............................................................................................................................
3
Basics of DIMMs
..............................................................................................................................
4
DRAM technology
.........................................................................................................................
4
Ranks
..........................................................................................................................................
4
Speed
.........................................................................................................................................
4
DDR3 DIMM types
............................................................................................................................
5
Unbuffered DIMMs
........................................................................................................................
5
Registered DIMMs
.........................................................................................................................
5
Load Reduced DIMMs
...................................................................................................................
5
HP SmartMemory
.............................................................................................................................
6
HP Advanced Memory Error Detection
................................................................................................
6
ProLiant Gen8 memory architecture and DDR3 Memory
............................................................................
7
ProLiant Gen8 memory Architecture
....................................................................................................
7
HP ProLiant Gen8 Servers
..................................................................................................................
8
HP ProLiant Gen8 Processors
.............................................................................................................
8
DDR3 memory for HP ProLiant Gen8 servers
........................................................................................
9
Populating memory in HP ProLiant Gen8 servers
....................................................................................
10
HP ProLiant Gen8 memory slot configurations
....................................................................................
10
Population rules for HP ProLiant Gen8 servers
....................................................................................
10
Rules for populating processors and DIMM slots
.............................................................................
10
Rules for DIMM types
..................................................................................................................
10
General rules
.............................................................................................................................
11
DIMM Population Order
..................................................................................................................
11