Dell S3048-ON EMC Solutions for Microsoft Azure Stack HCI Networking Guide - Page 13

13

Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide

4.4

Adapter/RDMA/DCB options

This guide is applicable to the following network adapter, RDMA, and DCB combinations:

•

QLogic QL41262

–

iWARP with or without DCB

•

Mellanox ConnectX-4 Lx

–

RoCEv2 with or without DCB

4.5

VLANs and IP addressing

Table 2 shows the three VLANs used in this deployment. VLAN 1611 uses the 10GbE connections for in-

band management and VM traffic. VLANs 1613 and 1614 are for storage traffic on the 25GbE links.

A gateway is configured using Virtual Router Redundancy Protocol (VRRP) to allow VLAN 1611 traffic to be

routed. A virtual IP address, 172.16.11.254 in this example, is shared by the two leaf switches. Storage traffic

on VLANs 1613 and 1614 is not routed in this deployment.

VLAN 1611 traffic uses a Hyper-V virtual switch (vSwitch), named

ProdSwitch

in this example, configured for

Switch Embedded Teaming (SET). SET allows between one and eight physical Ethernet network adapters to

be grouped into one or more software-based virtual network adapters.

The two storage VLANs in this deployment use the physical NICs instead of a vSwitch for best performance.

VLANs and network IP addresses

VLAN

ID

Description

Network

Gateway

vSwitch

1611

In-Band management and VM traffic 172.16.11.0/24 172.16.11.254 ProdSwitch

1613

Storage 1

172.16.13.0/24 Not used

Not used

1614

Storage 2

172.16.14.0/24 Not used

Not used

The FQDNs, VLAN IDs, and IP addresses used in this guide are shown in Table 3.

Host VLAN and IP address configuration

Item

FQDN

VLAN ID

IP address

S2D Ready Node 1

storage-01.dell.lab

1611

1613

1614

172.16.11.1

172.16.13.1

172.16.14.1

S2D Ready Node 2

storage-02.dell.lab

1611

1613

1614

172.16.11.2

172.16.13.2

172.16.14.2

S2D Ready Node 3

storage-03.dell.lab

1611

1613

1614

172.16.11.3

172.16.13.3

172.16.14.3

S2D Ready Node 4

storage-04.dell.lab

1611

1613

1614

172.16.11.4

172.16.13.4

172.16.14.4

Management system

mgmt-01.dell.lab

1611

172.16.11.5

S2D Cluster

cluster-01.dell.lab

1611

172.16.11.250

Section	Page
1 Introduction	6
1.1 Typographical conventions	6
1.2 Attachments	6
2 Hardware Overview	7
2.1 Dell EMC Networking S5248F-ON	7
2.2 Dell EMC Networking S3048-ON	7
2.3 Dell EMC S2D Ready Nodes	7
2.4 Management system	8
2.5 Supported Dell EMC Networking switches	8
3 Topology	9
3.1 Connections to leaf switches	10
3.2 Connections to OOB management switch	11
4 Configuration planning	12
4.1 RDMA overview	12
4.2 DCB overview	12
4.3 Ready Node network adapter options	12
4.3.1 QLogic FastLinQ QL41262	12
4.3.2 Mellanox ConnectX-4 Lx	12
4.4 Adapter/RDMA/DCB options	13
4.5 VLANs and IP addressing	13
5 Configure network adapters	14
5.1 Reset network adapters to factory defaults	14
5.2 Configure QLogic QL41262 adapters	15
5.3 Verify Mellanox ConnectX-4 Lx adapter settings	19
6 Leaf switch configuration prerequisites	22
6.1 Check switch OS version	22
6.2 Verify license installation	22
6.3 Factory default configuration	23
7 Configure leaf switches	24
7.1 General settings	25
7.2 Configure port-groups	25
7.3 Configure VLANs and VRRP	26
7.4 Configure storage interfaces	27
7.5 Configure in-band management interfaces	28
7.6 Configure VLT	29
7.7 Configure DCB	30
8 Switch validation	33
8.1 General commands	33
8.1.1 show interface status	33
8.1.2 show vlan	33
8.1.3 show lldp neighbors	34
8.1.4 show vrrp brief	34
8.2 VLT validation commands	35
8.2.1 show vlt domain_id	35
8.2.2 show vlt domain_id backup-link	35
8.2.3 show vlt domain_id mismatch	36
9 S2D Ready Node configuration and deployment	37
9.1 Initial state	37
9.2 Ensure DCB is disabled on Intel X710 adapters	38
9.3 Install roles and features	39
9.4 Configure the in-band management and VM network	39
9.5 Configure storage networks	40
9.5.1 Configure storage VLANs	40
9.5.2 Configure storage IP addresses	40
9.5.3 Enable RDMA	41
9.5.4 Enable iWARP on QLogic adapters	41
9.5.5 Enable jumbo frames on NICs	41
9.6 Join Ready Nodes to the Active Directory domain	42
9.7 Clean disks	42
9.8 Run the Test-Cluster cmdlet	44
9.9 Create the cluster	44
9.10 Configure a cluster witness	45
9.11 Enable S2D	46
9.12 Create storage volumes	46
9.13 Configure DCB on Ready Nodes	47
10 PowerShell validation commands and output	48
10.1 Get-NetAdapter	48
10.2 Get-VMSwitch	48
10.3 Get-NetIPAddress	49
10.4 Get-NetRoute	49
10.5 Get-DnsClientServerAddress	49
10.6 View VLAN IDs	49
10.7 Get-NetAdapterRdma	50
10.8 Ensure iWARP is enabled (QLogic adapters only)	50
10.9 View jumbo frame settings	50
10.10 Storage validation commands	51
10.10.1 Get-PhysicalDisk	51
10.10.2 Get-StoragePool	52
10.10.3 Get-VirtualDisk	52
10.11 DCB validation commands	52
10.11.1 Get-NetQosPolicy	52
10.11.2 Get-NetAdapterQos	53
10.11.3 Get-NetQosFlowControl	54
10.11.4 Get-NetQosTrafficClass	54
10.11.5 Get-NetQosDcbxSetting	54
10.11.6 Verify Mellanox adapters are set to “Host in Charge”	54
11 Switch DCB validation commands	55
11.1 Show queuing statistics	55
11.2 Show interface priority flow control	55
A Validated components	56
A.1 Dell EMC Networking Switches	56
A.2 S2D Ready Nodes	56
A.3 Management System	57
A.4 Dell EMC Networking Optics and Cables	58
A.5 S2D Ready Node and management system software	58
B Port-groups	59
C Technical resources	61
D Fabric Design Center	62

Dell S3048-ON EMC Solutions for Microsoft Azure Stack HCI Networking Guide - Page 13

Adapter/RDMA/DCB options, VLANs and IP addressing

Page 13 highlights