HP Cluster Platform Interconnects v2010 HP Cluster Platform InfiniBand Interco - Page 93

Installing and Maintaining HCA Cards and Mezzanines, 8.1 Overview of the Voltaire HCA 400 PCI–X

Page 93 highlights

8 Installing and Maintaining HCA Cards and Mezzanines A feature of InfiniBand fabrics is that individual components can contain an InfiniBand host channel adapter (HCA), or as in the case of an HP BladeSystem server blade, a mezzanine HCA. Every device containing an HCA is a visible and manageable part of the InfiniBand fabric. The HCA can be an integrated circuit that is embedded on the circuit board of a device, (such as a storage array controller) or it can be in the form of a PCI card that you install in a server. In HP Cluster platform, the HCA can be a single-port, or a dual-port InfiniBand PCI card. This chapter thoroughly describes Voltaire HCA cards and briefly describes several other models used in HP Cluster Platform as follows: • Voltaire HCA 400 PCI-X and HCA 400 PCI-Express. (See Section 8.1). • Installing the HCA, (See Section 8.2). This chapter also provides brief descriptions of the various HCAs used in HP Cluster Platform: • Topspin/Mellanox SDR PCI-X. (See Section 8.3). • Topspin/Mellanox SDR PCI-Express. (See Section 8.4). • Mellanox SDR PCI-X. (See Section 8.5). • Mellanox SDR PCI-Express. (See Figure 8-6). • Mellanox Memory-Free SDR PCI-Express. (See Section 8.7). • Mellanox Memory-Free DDR PCI-Express. (See Section 8.8). • Mellanox DDR PCI-Express. (See Section 8.9). • HP HPC 4x DDR IB Mezzanine HCA (See Section 8.9.2). Note: Specific combinations of HCA card and card firmware are required to support operating environments such as HP XC. Consult the InfiniBand Firmware Matrix and Qualified Solutions Tables in the InfiniBand Fabric Management and Diagnostic Guide or on the web at http://docs.hp.com/en/highperfcomp.html. 8.1 Overview of the Voltaire HCA 400 PCI-X, and HCA 400 PCI-Express Cards Figure 8-1 shows the HCA-400 PCI card. Information about the HCA-400 and HCA-400Ex is provided in this section. In the text, the card is referred to as the HCA and any differences between the two models are clearly specified. This section shows a typical HCA card and also how to install a typical HCA card. 8.1 Overview of the Voltaire HCA 400 PCI-X, and HCA 400 PCI-Express Cards 93

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
  • 131
  • 132
  • 133
  • 134
  • 135
  • 136
  • 137
  • 138
  • 139
  • 140

8 Installing and Maintaining HCA Cards and Mezzanines
A feature of InfiniBand fabrics is that individual components can contain an InfiniBand host
channel adapter (HCA), or as in the case of an HP BladeSystem server blade, a mezzanine HCA.
Every device containing an HCA is a visible and manageable part of the InfiniBand fabric. The
HCA can be an integrated circuit that is embedded on the circuit board of a device, (such as a
storage array controller) or it can be in the form of a PCI card that you install in a server. In HP
Cluster platform, the HCA can be a single-port, or a dual-port InfiniBand PCI card. This chapter
thoroughly describes Voltaire HCA cards and briefly describes several other models used in HP
Cluster Platform as follows:
Voltaire HCA 400 PCI–X and HCA 400 PCI–Express. (See
Section 8.1
).
Installing the HCA, (See
Section 8.2
).
This chapter also provides brief descriptions of the various HCAs used in HP Cluster Platform:
Topspin/Mellanox SDR PCI–X. (See
Section 8.3
).
Topspin/Mellanox SDR PCI–Express. (See
Section 8.4
).
Mellanox SDR PCI–X. (See
Section 8.5
).
Mellanox SDR PCI–Express. (See
Figure 8-6
).
Mellanox Memory-Free SDR PCI-Express. (See
Section 8.7
).
Mellanox Memory-Free DDR PCI-Express. (See
Section 8.8
).
Mellanox DDR PCI-Express. (See
Section 8.9
).
HP HPC 4x DDR IB Mezzanine HCA (See
Section 8.9.2
).
Note:
Specific combinations of HCA card and card firmware are required to support operating
environments such as HP XC.
Consult the InfiniBand Firmware Matrix and Qualified Solutions Tables in the
InfiniBand Fabric
Management and Diagnostic Guide
or on the web at
.
8.1 Overview of the Voltaire HCA 400 PCI–X, and HCA 400 PCI-Express
Cards
Figure 8-1
shows the HCA-400 PCI card. Information about the HCA-400 and HCA-400Ex is
provided in this section. In the text, the card is referred to as the HCA and any differences between
the two models are clearly specified. This section shows a typical HCA card and also how to
install a typical HCA card.
8.1 Overview of the Voltaire HCA 400 PCI–X, and HCA 400 PCI-Express Cards
93