HP Cluster Platform Interconnects v2010 HP Cluster Platform InfiniBand Interco - Page 20

Identifying InfiniBand Fabric Components, InfiniBand Protocol

Get HP Cluster Platform Interconnects v2010 PDF manuals and user guides View all HP Cluster Platform Interconnects v2010 manuals
Add to My Manuals
Save this manual to your list of manuals

Page 20 highlights

- Security and partitioning - Integrated management tools • A strong technical future, with support for: - PCI cards: ◦ Voltaire SDR PCI-X ◦ Topspin/Mellanox SDR PCI-X Rev B; Mellanox SDR PCI-X Rev C ◦ Topspin/Mellanox SDR PCI-Express Rev B; Mellanox SDR PCI-Express Rev C ◦ Mellanox Mem Free SDR PCI-Express ◦ Mellanox Mem Free DDR PCI-Express ◦ Mellanox DDR PCI-Express - Remote direct memory access (RDMA) - Faster link speeds InfiniBand Protocol InfiniBand fabrics provide a single point of management for all HCAs (host channel adapters) in the fabric. Management utilities enable you discover and configure devices, handle device or path failures and allocate resources. InfiniBand enables applications to access the HCA directly without involving the operating system by mapping the application memory to the physical memory in tables that are maintained in the HCA. An applications programming interface (API) facilitates control of HCAs and enables reliable message passing between the channel adapters in different devices. The entire transport layer is implemented in hardware (on integrated circuits, rather than is a software layer), Each channel adapter provides queue pairs, for read and write that are accessible directly by programs. Each queue pair provides a reliable connection between connected applications, nodes, or an unreliable datagram message queue. The communications protocol consists of four operations: • Transmit a message. • Using remote data memory access (RDMA), writes data directly into a device's memory. • Using remote data memory access (RDMA), reads data directly from a device's memory. • Atomic operations, updating remote memory words. The HCA device provides the following functions: • Receives and posts the following operations to a queue as work queue elements: - Messages. - RDMA operations. • Handles notifications and completion events through completion queues. To reduce the volume of events in the system, completion queues might be shared for several queue pairs. The remaining sections in this chapter include the following topics: • Identifying InfiniBand fabric components (Section 1.1). • ISR 9xxxx-series Interconnects (Section 1.2). • Identifying the ISR 9024 interconnect (Section 1.3). • Identifying the ISR 9024 S/D RoHS compliant interconnect (Section 1.4). • Identifying the ISR 9096 interconnect (Section 1.5). • Identifying the ISR 9288 interconnect (Section 1.6). • Understanding the interconnect management capabilities (Section 1.7). 1.1 Identifying InfiniBand Fabric Components Figure 1-1 shows a simplified model of an InfiniBand fabric and identifies the following typical fabric components: • HCA (Host Channel Adapter), which can have two hardware formats: 20 InfiniBand Technology Overview

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
  • 131
  • 132
  • 133
  • 134
  • 135
  • 136
  • 137
  • 138
  • 139
  • 140
—
Security and partitioning
—
Integrated management tools
•
A strong technical future, with support for:
—
PCI cards:
◦
Voltaire SDR PCI-X
◦
Topspin/Mellanox SDR PCI-X Rev B; Mellanox SDR PCI-X Rev C
◦
Topspin/Mellanox SDR PCI-Express Rev B; Mellanox SDR PCI-Express Rev C
◦
Mellanox Mem Free SDR PCI-Express
◦
Mellanox Mem Free DDR PCI-Express
◦
Mellanox DDR PCI-Express
—
Remote direct memory access (RDMA)
—
Faster link speeds
InfiniBand Protocol
InfiniBand fabrics provide a single point of management for all HCAs (host channel adapters)
in the fabric. Management utilities enable you discover and configure devices, handle device or
path failures and allocate resources. InfiniBand enables applications to access the HCA directly
without involving the operating system by mapping the application memory to the physical
memory in tables that are maintained in the HCA.
An applications programming interface (API) facilitates control of HCAs and enables reliable
message passing between the channel adapters in different devices. The entire transport layer
is implemented in hardware (on integrated circuits, rather than is a software layer), Each channel
adapter provides queue pairs, for read and write that are accessible directly by programs. Each
queue pair provides a reliable connection between connected applications, nodes, or an unreliable
datagram message queue. The communications protocol consists of four operations:
•
Transmit a message.
•
Using remote data memory access (RDMA), writes data directly into a device's memory.
•
Using remote data memory access (RDMA), reads data directly from a device's memory.
•
Atomic operations, updating remote memory words.
The HCA device provides the following functions:
•
Receives and posts the following operations to a queue as work queue elements:
—
Messages.
—
RDMA operations.
•
Handles notifications and completion events through completion queues. To reduce the
volume of events in the system, completion queues might be shared for several queue pairs.
The remaining sections in this chapter include the following topics:
•
Identifying InfiniBand fabric components (
Section 1.1
).
•
ISR 9
xxxx
-series Interconnects (
Section 1.2
).
•
Identifying the ISR 9024 interconnect (
Section 1.3
).
•
Identifying the ISR 9024 S/D RoHS compliant interconnect (
Section 1.4
).
•
Identifying the ISR 9096 interconnect (
Section 1.5
).
•
Identifying the ISR 9288 interconnect (
Section 1.6
).
•
Understanding the interconnect management capabilities (
Section 1.7
).
1.1 Identifying InfiniBand Fabric Components
Figure 1-1
shows a simplified model of an InfiniBand fabric and identifies the following typical
fabric components:
•
HCA (Host Channel Adapter), which can have two hardware formats:
20
InfiniBand Technology Overview