Dell S3048-ON EMC Solutions for Microsoft Azure Stack HCI Networking Guide - Page 50

50

Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide

10.7

Get-NetAdapterRdma

Use the

Get-NetAdapterRdma

cmdlet to verify storage adapters have RDMA enabled. RDMA is enabled in

Section 9.4.3.

PS>

Get-NetAdapterRdma

Name

InterfaceDescription

Enabled

PFC

ETS

----

--------------------

-------

---

---

vEthernet (Management) Hyper-V Virtual Ethernet

False

NA

NA

SLOT 2 Port 1

Mellanox ConnectX-4 Lx E

True

True

True

SLOT 2 Port 2

Mellanox ConnectX-4 Lx E

True

True

True

10.8

Ensure iWARP is enabled (QLogic adapters only)

The following command is used to ensure QLogic adapters are set to iWARP. The command syntax varies

depending on the version of Windows Server installed. iWARP is enabled in Section 9.5.4.

For Windows Server 2016, use the following command:

PS>

Get-NetAdapterAdvancedProperty -DisplayName 'RDMA Mode'

Name

DisplayName

DisplayValue

RegistryKeyword RegistryValue

----

-----------

------------

--------------- -------------

SLOT 2 Port 2

RDMA Mode

iWARP

RDMAMode

{2}

SLOT 2 Port 1

RDMA Mode

iWARP

RDMAMode

{2}

For Windows Server 2019, use the following command:

PS>

Get-NetAdapterAdvancedProperty -DisplayName 'NetworkDirect Technology'

Name

DisplayName

DisplayValue


----

-----------

------------

--------------- -------------

SLOT 2 Port 2 NetworkDirect Tech

iWARP

*NetworkDire... {1}

SLOT 2 Port 1 NetworkDirect Tech

iWARP

*NetworkDire... {1}

10.9

View jumbo frame settings

The following command is used to ensure NICs carrying storage traffic have Jumbo frames enabled. In this

example, jumbo frames of up to 9014 bytes are enabled on the ports in slot 2. Jumbo frames are enabled in

Section 9.5.5.

PS>

Get-NetAdapterAdvancedProperty -Name "*" -RegistryKeyword '*JumboPacket'

Name

DisplayName

DisplayValue


----

-----------

------------

--------------- -------------

vEthernet (Management) Jumbo Packet

Disabled

*JumboPacket

{1514}

NIC4

Jumbo Packet

Disabled

*JumboPacket

{1514}

SLOT 2 Port 2

Jumbo Packet

9014

*JumboPacket

{9014}

SLOT 2 Port 1

Jumbo Packet

9014

*JumboPacket

{9014}

NIC1

Jumbo Packet

Disabled

*JumboPacket

{1514}

NIC3

Jumbo Packet

Disabled

*JumboPacket

{1514}

NIC2

Jumbo Packet

Disabled

*JumboPacket

{1514}

Section	Page
1 Introduction	6
1.1 Typographical conventions	6
1.2 Attachments	6
2 Hardware Overview	7
2.1 Dell EMC Networking S5248F-ON	7
2.2 Dell EMC Networking S3048-ON	7
2.3 Dell EMC S2D Ready Nodes	7
2.4 Management system	8
2.5 Supported Dell EMC Networking switches	8
3 Topology	9
3.1 Connections to leaf switches	10
3.2 Connections to OOB management switch	11
4 Configuration planning	12
4.1 RDMA overview	12
4.2 DCB overview	12
4.3 Ready Node network adapter options	12
4.3.1 QLogic FastLinQ QL41262	12
4.3.2 Mellanox ConnectX-4 Lx	12
4.4 Adapter/RDMA/DCB options	13
4.5 VLANs and IP addressing	13
5 Configure network adapters	14
5.1 Reset network adapters to factory defaults	14
5.2 Configure QLogic QL41262 adapters	15
5.3 Verify Mellanox ConnectX-4 Lx adapter settings	19
6 Leaf switch configuration prerequisites	22
6.1 Check switch OS version	22
6.2 Verify license installation	22
6.3 Factory default configuration	23
7 Configure leaf switches	24
7.1 General settings	25
7.2 Configure port-groups	25
7.3 Configure VLANs and VRRP	26
7.4 Configure storage interfaces	27
7.5 Configure in-band management interfaces	28
7.6 Configure VLT	29
7.7 Configure DCB	30
8 Switch validation	33
8.1 General commands	33
8.1.1 show interface status	33
8.1.2 show vlan	33
8.1.3 show lldp neighbors	34
8.1.4 show vrrp brief	34
8.2 VLT validation commands	35
8.2.1 show vlt domain_id	35
8.2.2 show vlt domain_id backup-link	35
8.2.3 show vlt domain_id mismatch	36
9 S2D Ready Node configuration and deployment	37
9.1 Initial state	37
9.2 Ensure DCB is disabled on Intel X710 adapters	38
9.3 Install roles and features	39
9.4 Configure the in-band management and VM network	39
9.5 Configure storage networks	40
9.5.1 Configure storage VLANs	40
9.5.2 Configure storage IP addresses	40
9.5.3 Enable RDMA	41
9.5.4 Enable iWARP on QLogic adapters	41
9.5.5 Enable jumbo frames on NICs	41
9.6 Join Ready Nodes to the Active Directory domain	42
9.7 Clean disks	42
9.8 Run the Test-Cluster cmdlet	44
9.9 Create the cluster	44
9.10 Configure a cluster witness	45
9.11 Enable S2D	46
9.12 Create storage volumes	46
9.13 Configure DCB on Ready Nodes	47
10 PowerShell validation commands and output	48
10.1 Get-NetAdapter	48
10.2 Get-VMSwitch	48
10.3 Get-NetIPAddress	49
10.4 Get-NetRoute	49
10.5 Get-DnsClientServerAddress	49
10.6 View VLAN IDs	49
10.7 Get-NetAdapterRdma	50
10.8 Ensure iWARP is enabled (QLogic adapters only)	50
10.9 View jumbo frame settings	50
10.10 Storage validation commands	51
10.10.1 Get-PhysicalDisk	51
10.10.2 Get-StoragePool	52
10.10.3 Get-VirtualDisk	52
10.11 DCB validation commands	52
10.11.1 Get-NetQosPolicy	52
10.11.2 Get-NetAdapterQos	53
10.11.3 Get-NetQosFlowControl	54
10.11.4 Get-NetQosTrafficClass	54
10.11.5 Get-NetQosDcbxSetting	54
10.11.6 Verify Mellanox adapters are set to “Host in Charge”	54
11 Switch DCB validation commands	55
11.1 Show queuing statistics	55
11.2 Show interface priority flow control	55
A Validated components	56
A.1 Dell EMC Networking Switches	56
A.2 S2D Ready Nodes	56
A.3 Management System	57
A.4 Dell EMC Networking Optics and Cables	58
A.5 S2D Ready Node and management system software	58
B Port-groups	59
C Technical resources	61
D Fabric Design Center	62

Dell S3048-ON EMC Solutions for Microsoft Azure Stack HCI Networking Guide - Page 50

Get-NetAdapterRdma, Ensure iWARP is enabled QLogic adapters only, View jumbo frame settings

Page 50 highlights