Home » Dell Manuals » Hubs & Switches » Dell S5248F-ON » Manual Viewer

Dell S5248F-ON EMC Solutions for Microsoft Azure Stack HCI Networking Guide - Page 10

Connections to leaf switches

Add to My Manuals
Save this manual to your list of manuals

Page 10 highlights

3.1 The two leaf switches are connected to spine switches upstream (not shown). Using two leaf switches provides fault tolerance and twice the bandwidth. Note: Spine switch configuration is beyond the scope of this guide and is covered in Dell EMC Networking Layer 3 Leaf-Spine Deployment and Best Practices with OS10EE. Connections to leaf switches Each S5248F-ON switch has 48x25GbE ports available for connections to S2D Ready Nodes and other servers in the rack. Connections from the Ready Nodes to the leaf switches are used for S2D storage traffic, in-band host management traffic, and VM traffic. All traffic may share the same physical connections (converged network), or storage traffic may be placed on dedicated network connections (non-converged network). Note: All examples in this document use the non-converged network configuration shown in Figure 6. Two 25GbE connections from each Ready Node, shown in green, are dedicated for S2D storage traffic. Inband host management and VM traffic share two 10GbE connections from the rNDC (rack server network daughter card), shown in blue, to the leaf switches. S5248F-ON Stack ID Leaf 1A S5248F-ON Stack ID Leaf 1B GRN=10G ACT/ LNK A GRN=10G ACT/ LNK B R740xd S2D Ready Node 25GbE Storage traffic 10GbE In-band mgmt and VM traffic 2x100GbE VLTi (QSFP28-DD DAC) S2D Ready Node with non-converged connections The Virtual Link Trunking interconnect (VLTi) connections use the two 2x100GbE QSFP28-DD ports available on each S5248F-ON. 10 Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide

Section	Page
1 Introduction	6
1.1 Typographical conventions	6
1.2 Attachments	6
2 Hardware Overview	7
2.1 Dell EMC Networking S5248F-ON	7
2.2 Dell EMC Networking S3048-ON	7
2.3 Dell EMC S2D Ready Nodes	7
2.4 Management system	8
2.5 Supported Dell EMC Networking switches	8
3 Topology	9
3.1 Connections to leaf switches	10
3.2 Connections to OOB management switch	11
4 Configuration planning	12
4.1 RDMA overview	12
4.2 DCB overview	12
4.3 Ready Node network adapter options	12
4.3.1 QLogic FastLinQ QL41262	12
4.3.2 Mellanox ConnectX-4 Lx	12
4.4 Adapter/RDMA/DCB options	13
4.5 VLANs and IP addressing	13
5 Configure network adapters	14
5.1 Reset network adapters to factory defaults	14
5.2 Configure QLogic QL41262 adapters	15
5.3 Verify Mellanox ConnectX-4 Lx adapter settings	19
6 Leaf switch configuration prerequisites	22
6.1 Check switch OS version	22
6.2 Verify license installation	22
6.3 Factory default configuration	23
7 Configure leaf switches	24
7.1 General settings	25
7.2 Configure port-groups	25
7.3 Configure VLANs and VRRP	26
7.4 Configure storage interfaces	27
7.5 Configure in-band management interfaces	28
7.6 Configure VLT	29
7.7 Configure DCB	30
8 Switch validation	33
8.1 General commands	33
8.1.1 show interface status	33
8.1.2 show vlan	33
8.1.3 show lldp neighbors	34
8.1.4 show vrrp brief	34
8.2 VLT validation commands	35
8.2.1 show vlt domain_id	35
8.2.2 show vlt domain_id backup-link	35
8.2.3 show vlt domain_id mismatch	36
9 S2D Ready Node configuration and deployment	37
9.1 Initial state	37
9.2 Ensure DCB is disabled on Intel X710 adapters	38
9.3 Install roles and features	39
9.4 Configure the in-band management and VM network	39
9.5 Configure storage networks	40
9.5.1 Configure storage VLANs	40
9.5.2 Configure storage IP addresses	40
9.5.3 Enable RDMA	41
9.5.4 Enable iWARP on QLogic adapters	41
9.5.5 Enable jumbo frames on NICs	41
9.6 Join Ready Nodes to the Active Directory domain	42
9.7 Clean disks	42
9.8 Run the Test-Cluster cmdlet	44
9.9 Create the cluster	44
9.10 Configure a cluster witness	45
9.11 Enable S2D	46
9.12 Create storage volumes	46
9.13 Configure DCB on Ready Nodes	47
10 PowerShell validation commands and output	48
10.1 Get-NetAdapter	48
10.2 Get-VMSwitch	48
10.3 Get-NetIPAddress	49
10.4 Get-NetRoute	49
10.5 Get-DnsClientServerAddress	49
10.6 View VLAN IDs	49
10.7 Get-NetAdapterRdma	50
10.8 Ensure iWARP is enabled (QLogic adapters only)	50
10.9 View jumbo frame settings	50
10.10 Storage validation commands	51
10.10.1 Get-PhysicalDisk	51
10.10.2 Get-StoragePool	52
10.10.3 Get-VirtualDisk	52
10.11 DCB validation commands	52
10.11.1 Get-NetQosPolicy	52
10.11.2 Get-NetAdapterQos	53
10.11.3 Get-NetQosFlowControl	54
10.11.4 Get-NetQosTrafficClass	54
10.11.5 Get-NetQosDcbxSetting	54
10.11.6 Verify Mellanox adapters are set to “Host in Charge”	54
11 Switch DCB validation commands	55
11.1 Show queuing statistics	55
11.2 Show interface priority flow control	55
A Validated components	56
A.1 Dell EMC Networking Switches	56
A.2 S2D Ready Nodes	56
A.3 Management System	57
A.4 Dell EMC Networking Optics and Cables	58
A.5 S2D Ready Node and management system software	58
B Port-groups	59
C Technical resources	61
D Fabric Design Center	62

Match case Limit results 1 per page

Dell EMC Solutions for Microsoft Azure Stack HCI Networking Guide

The two leaf switches are connected to spine switches upstream (not shown). Using two leaf switches

provides fault tolerance and twice the bandwidth.

Note:

Spine switch configuration is beyond the scope of this guide and is covered in

Dell EMC Networking

Layer 3 Leaf-Spine Deployment and Best Practices with OS10EE

3.1

Connections to leaf switches

Each S5248F-ON switch has 48x25GbE ports available for connections to S2D Ready Nodes and other

servers in the rack. Connections from the Ready Nodes to the leaf switches are used for S2D storage traffic,

in-band host management traffic, and VM traffic. All traffic may share the same physical connections

(converged network), or storage traffic may be placed on dedicated network connections (non-converged

network).

Note:

All examples in this document use the non-converged network configuration shown in Figure 6.

Two 25GbE connections from each Ready Node, shown in green, are dedicated for S2D storage traffic. In-

band host management and VM traffic share two 10GbE connections from the rNDC (rack server network

daughter card), shown in blue, to the leaf switches.

Stack ID

GRN=10G

ACT/ LN K A

GRN=10G

ACT/ LN K B

25GbE Storage traffic

10GbE In-band mgmt and VM traffic

2x100GbE VLTi (QSFP28-DD DAC)

S5248F-ON

Leaf 1A

S5248F-ON

Leaf 1B

R740xd

S2D Ready

Node

S2D Ready Node with non-converged connections

The Virtual Link Trunking interconnect (VLTi) connections use the two 2x100GbE QSFP28-DD ports available

on each S5248F-ON.