HP ML530 RDMA protocol: improving network performance

HP ML530 - ProLiant - 128 MB RAM Manual

HP ML530 manual content summary:

  • HP ML530 | RDMA protocol: improving network performance - Page 1
    network performance technology brief Abstract...2 Introduction...2 Limitations of TCP/IP ...2 RDMA solution ...3 RDMA over TCP ...4 RDMA protocol overview ...5 RDMA data transfer operations...6 Send operations ...6 RDMA write ...7 RDMA read ...7 Terminate ...7 Verbs...7 RNIC interface ...8 RDMA over
  • HP ML530 | RDMA protocol: improving network performance - Page 2
    . A typical data center today uses a variety of disparate interconnects for servers-to-servers and serverto-storage links. The use of multiple system and peripheral bus interconnects decreases compatibility, interoperability, and management efficiency and drives up the cost of equipment, software
  • HP ML530 | RDMA protocol: improving network performance - Page 3
    written to the device driver buffer, copied into an operating system (OS) buffer, and then copied into application memory space. Figure 1. Typical flow of network data in receiving host Memory NOTE: The actual number of memory copies varies depending on OS (Example: Linux uses 2). Chipset Network
  • HP ML530 | RDMA protocol: improving network performance - Page 4
    the memory of applications on two systems (or nodes), with minimal work by the operating system kernel and without interim data copying into system buffers (Figure 2). This capability enables RDMA over TCP to work over standard TCP/IP-based networks (such as Ethernet) that are commonly used in
  • HP ML530 | RDMA protocol: improving network performance - Page 5
    for the TCP protocol. MPA provides a generalized framing mechanism that enables a network adapter using DDP to locate the DDP header. The adapter can then place the data directly in the application buffer, based on the control information carried in the header. MPA enables this capability even when
  • HP ML530 | RDMA protocol: improving network performance - Page 6
    in memory without processing base address of the buffer. Tagged buffers are typically used target and data source host processors are not involved in the data transfer operations, so they can continue to do useful system protocol stack on both the send and receive sides. Send operations RDMA uses
  • HP ML530 | RDMA protocol: improving network performance - Page 7
    write operation. The RDMA write message uses the DDP tagged buffer model to transfer the ULP message into the data target's tagged buffer. The STag associated with consumer uses the capabilities of the RNIC to accomplish some objective. A verbs consumer may be defined as an operating system kernel
  • HP ML530 | RDMA protocol: improving network performance - Page 8
    memory of another verbs consumer, while preserving operating system and memory protection semantics. Figure 4 is a conceptual model of elements used RNIC services and the RNIC. Verbs specify behavior of the RNIC and enable creation and management of queue pairs, management of the RNIC, management of
  • HP ML530 | RDMA protocol: improving network performance - Page 9
    manage. Like Ethernet, InfiniBand architecture uses multi-layer processing to transfer data between nodes. Each InfiniBand node contains a host or target scalable with system expansion and capable of a bandwidth from 2.5 to 120 Gbps in each direction (although processor overhead and server I/O bus
  • HP ML530 | RDMA protocol: improving network performance - Page 10
    A number of InfiniBand upper layer protocols are available, three of which support RDMA based RDMA protocol that operates from the kernel. Applications must be written to take advantage of the SDP interface. SDP is based on the WinSock Direct Protocol used by Microsoft server operating systems
  • HP ML530 | RDMA protocol: improving network performance - Page 11
    data faster than the destination device can receive it, InfiniBand uses a queue pair (one send, one receive) system similar to the one for RDMA over TCP. InfiniBand queue pairs may be located in the HCA or TCA of each device or, if necessary, in main memory. When a connection between two channel
  • HP ML530 | RDMA protocol: improving network performance - Page 12
    is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12

RDMA protocol: improving network performance
technology brief
Abstract
..............................................................................................................................................
2
Introduction
.........................................................................................................................................
2
Limitations of TCP/IP
............................................................................................................................
2
RDMA solution
....................................................................................................................................
3
RDMA over TCP
..................................................................................................................................
4
RDMA protocol overview
..................................................................................................................
5
RDMA data transfer operations
..........................................................................................................
6
Send operations
...........................................................................................................................
6
RDMA write
.................................................................................................................................
7
RDMA read
.................................................................................................................................
7
Terminate
....................................................................................................................................
7
Verbs
..............................................................................................................................................
7
RNIC interface
.................................................................................................................................
8
RDMA over InfiniBand
..........................................................................................................................
9
InfiniBand RDMA protocols
.............................................................................................................
10
Direct Access Programming Library
..............................................................................................
10
Sockets Direct Protocol
................................................................................................................
10
SCSI RDMA Protocol
...................................................................................................................
11
InfiniBand link operation
.................................................................................................................
11
Conclusion
........................................................................................................................................
11
For more information
..........................................................................................................................
12
Call to action
....................................................................................................................................
12