Dell S3048-ON EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7
Dell S3048-ON Manual
View all Dell S3048-ON manuals
Add to My Manuals
Save this manual to your list of manuals |
Dell S3048-ON manual content summary:
- Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 1
EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 Deploying S5200F-ON series switches for a VxRail 4.7 cluster Abstract This document provides Dell EMC SmartFabric OS10 switch configuration examples and topology options for a VxRail 4.7 cluster deployment using S5200F-ON series switches - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 2
of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners. Dell believes the information in this document is accurate as of its publication date. The information is subject to change without notice. 2 Dell EMC SmartFabric OS10 Switch Configuration Guide for - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 3
19 6.1 Check switch OS version...19 6.2 Verify license installation ...19 6.3 Factory default configuration ...20 7 Configure switches ...21 7.1 Dual switch with VLT ...21 7.1.1 General settings...22 7.1.2 Configure VLANs ...22 3 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 4
for S5248F-ON using VxRail 4.7 44 A.1 Dell EMC PowerSwitches ...44 A.2 DAC Cables ...44 A.3 VxRail P570 nodes ...44 A.4 VxRail appliance software ...45 B S5248F-ON port groups ...46 C Technical resources ...48 D Support and feedback ...49 4 Dell EMC SmartFabric OS10 Switch Configuration Guide for - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 5
not configured for VLT • A single Dell PowerSwitch This document provides switch topology options and configuration examples for a VxRail 4.7 cluster using nodes built on 14th generation (14G) PowerEdge servers. Nodes in these examples use 25GbE network adapters. Switches in this guide use Dell EMC - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 6
guide use VxRail 4.7 nodes connected to S5248F-ON switches running Dell EMC SmartFabric OS10. Dell EMC Networking supports the following switches and operating systems for VxRail 4.7 and later: 1.2 1.3 Supported Dell .pdf format includes switch configuration file attachments. To access attachments - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 7
hardware and software validated for this guide. Dell EMC PowerSwitch S5248F-ON The S5248F-ON is a 1-Rack Unit (RU), multilayer switch with 48x25GbE, 4x100GbE, and 2x200GbE ports. This guide uses two S5248F-ONs as leaf switches. 2.2 Dell EMC PowerSwitch S5248F-ON Dell EMC PowerSwitch S3048-ON The - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 8
ports (for single CPU nodes only, max 8 nodes/cluster) Rear view of VxRail 2-RU node (1-RU node is similar) Note: Each of the VxRail P570 nodes in the deployment examples in this guide contains a Broadcom 57414 rNDC with 2x25GbE SFP28 ports. 8 Dell EMC SmartFabric OS10 Switch Configuration Guide - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 9
a 1GbE BASE-T integrated Dell Remote Access Card (iDRAC) for OOB management. Note: P, V, and S Series nodes support additional network adapters in PCIe slots. See the Dell EMC VxRail Network Planning Guide for more information. 9 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 10
not used, the switches are connected with a standard LACP port channel. 3.1.1 Dual switch with VLT Dell EMC recommends using a dual switch configuration with VLT, as shown in Figure 7. S5248F-Leaf1A S5248F-Leaf1B VLTi 12 VxRail node 1 12 VxRail node 2 100GbE VLTi connections 25GbE connections - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 11
two switches are configured in an LACP port channel. S5248F-Leaf1A S5248F-Leaf1B LACP 12 VxRail node 1 12 VxRail node 2 100GbE LACP connections 25GbE connections 12 VxRail node n Rack 1 Dual switch topology without VLT 11 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 12
connect to a single switch. This topology is not recommended as the switch becomes a single point of failure. S5248F-ON 12 VxRail node 1 12 VxRail node 2 25GbE connections 12 VxRail node n Rack 1 Single switch topology 12 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 13
configured as VLT peers. The switches and VxRail nodes covered in this guide are shown in Rack 1 in Figure 10 and are incorporated into a data center's leaf-spine network. Spine1 Spine2 L3 L2 S5248F-Leaf1A S5248F within a single rack. Note: By default, VxRail does not enable routing of vSAN - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 14
ports. It is also commonly used to carry heartbeat messages sent between switches configured as VLT peers. For OOB Management network connections, one S3048-ON switch is installed guide use the 100.67.0.0/16 IP address block. 14 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 15
NA NA Optional, not used Optional, not used not used VLAN ports Untagged Tagged Tagged Tagged Tagged Tagged Note: By default, VxRail does not enable routing of vSAN or vMotion traffic. this VLAN for node discovery to succeed. 15 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 16
configure the VLAN on each ESXi™ host using DCUI, and set tagging for your management VLAN on your switch before you deploy VxRail. If you cannot reach the default (192.168.10.200/24), set an alternate IP address Time zone NTP server(s) DNS server(s) IP address and port Username and password - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 17
*Setting this value to 0 is explained in Section 9.1 of this guide. Values the Platform Services Controller, VxRail dell.local 172.16.11.1 vxhost02.dell.local 172.16.11.2 vxhost03.dell.local 172.16.11.3 vxhost04.dell.local 172.16.11.4 17 Dell EMC SmartFabric OS10 Switch Configuration Guide - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 18
guide, the PowerEdge server used as the jump box also provides DNS and NTP services for the VxRail cluster. It is connected to both leaf switches for redundancy using Microsoft Windows NIC teaming (switch-independent load balancing). 18 Dell EMC SmartFabric OS10 Switch Configuration Guide - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 19
is installed, licenses purchased from Dell EMC are available for download on Dell Digital Locker. Installation instructions are provided in the Dell EMC SmartFabric OS10 User Guide Release 10.5.0. OS10# show license status System Information Vendor Name : Dell EMC Product Name : S5248F-ON - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 20
follow begin with S5248F-ON switches at their factory default settings. Dell EMC PowerSwitches running SmartFabric OS10 can be reset to their default configuration using the serial console port as follows: OS10# delete startup-configuration Proceed to delete startup-configuration [confirm yes/no - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 21
are provided as attachments to this guide. Dual switch with VLT This example uses a four-node VxRail cluster connected to a pair of switches configured with VLT, as shown in Figure 12. Dell EMC recommends using this topology. S5248F-Leaf1A 1/1/20 19 18 17 S5248F-Leaf1B 1/1/17 18 19 20 VLTi - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 22
interface and globally by default. LLDP is useful for troubleshooting and validation. Dell EMC recommends leaving it enabled. General settings - dual switch with VLT S5248F-Leaf1A configure terminal S5248F-Leaf1B configure terminal hostname S5248F-Leaf1A hostname S5248F-Leaf1B interface mgmt1 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 23
snooping querier 7.1.3 Configure interfaces Configure the interfaces for the jump box or laptop computer connections to be used during VxRail deployment. This example uses 10GbE interface 1/1/9:1 on each switch. Note: See Appendix B to change the native speed of S5248F-ON port groups from 25GbE to - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 24
network interfaces in ESXi by default. For more information, see VMware vSAN Network Design. Configure interfaces - dual switch with VLT S5248F-Leaf1A S5248F-Leaf1B interface ethernet1/1/9:1 description JumpBox_DNS switchport access vlan 1611 spanning-tree port type edge no shutdown interface - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 25
Note: For more information on VLT, see the Dell EMC SmartFabric OS10 User Guide Release 10.5.0. When the configuration is complete, exit configuration mode and save the configuration with the end and write memory commands. Configure VLT - dual switch with VLT S5248F-Leaf1A interface ethernet1/1/53 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 26
configuration commands correspond to those shown in Figure 13. Note: The commands in the tables below should be entered in the order shown. All commands are provided in the file attachments named S5248F-1A-no-vlt.txt and S5248F-1B-no-vlt.txt. 26 Dell EMC SmartFabric OS10 Switch Configuration Guide - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 27
and globally by default. LLDP is useful for troubleshooting and validation. Dell EMC recommends leaving it enabled. General settings - dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B configure terminal configure terminal hostname S5248F-Leaf1A hostname S5248F-Leaf1B interface mgmt1 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 28
snooping querier 7.2.3 Configure interfaces Configure the interfaces for the jump box or laptop computer connections to be used during VxRail deployment. This example uses 10GbE interface 1/1/9:1 on each switch. Note: See Appendix B to change the native speed of S5248F-ON port groups from 25GbE to - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 29
ESXi by default. For more information, see VMware vSAN Network Design. Configure interfaces - dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B interface tree port type edge flowcontrol receive on flowcontrol transmit off no shutdown 29 Dell EMC SmartFabric OS10 Switch Configuration Guide for - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 30
the channel-group 127 mode active command. When the configuration is complete, exit configuration mode and save the configuration with the end and write memory commands. Configure switch interconnect - dual switch without VLT S5248F-Leaf1A S5248F-Leaf1B interface port-channel 127 description - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 31
at 32769. Modify the spanning tree settings if required for your environment. LLDP is enabled on each interface and globally by default. LLDP is useful for troubleshooting and validation. Dell EMC recommends leaving it enabled. 31 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 32
settings - single switch S5248F-ON configure terminal hostname S5248F-ON interface mgmt1/1/1 no ip address ip address 100.67.172.38/24 no shutdown management route 0.0.0.0/0 100.67.172.254 ipv6 mld snooping enable ntp server 100.67.10.20 7.3.2 Configure VLANs In this section, VLANs are configured - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 33
7.3.3 Configure interfaces Configure the interfaces for the jump box or laptop computer connections to be used during VxRail deployment. This example uses 10GbE interfaces 1/1/9:1 and 1/1/10:1. Note: See Appendix B to change the native speed of S5248F-ON port groups from 25GbE to 10GbE for jump - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 34
ethernet1/1/22 description Node3_Port2 switchport mode trunk switchport access vlan 1611 switchport trunk allowed vlan 1612-1615,3939 spanning-tree port type edge flowcontrol receive on flowcontrol transmit off no shutdown 34 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 35
24 description Node4_Port2 switchport mode trunk switchport access vlan 1611 switchport trunk allowed vlan 1612-1615,3939 spanning-tree port type edge flowcontrol receive on flowcontrol transmit off no shutdown end write memory 35 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 36
speeds. S5248F-Leaf1A# show interface status | grep up Port Description Status Speed port-channel) F - Fallback Activated Group Port-Channel Type Protocol Member Ports 1000 port-channel1000 Eth STATIC 1/1/53(P) 1/1/54(P) 36 Dell EMC SmartFabric OS10 Switch Configuration Guide - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 37
control VLAN for the VLT domain, and it is not user configurable. S5248F-Leaf1A# show vlan Codes: * - Default VLAN, M - Management VLAN, R - Remote Port Mirroring VLANs Q: A /1/17-1/1/20 T Po1000 4094 Active T Po1000 37 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 38
VLT Active VM_Network_B 3939 Active Internal_Mgmt Q Ports A Eth1/1/1-1/1/8,1/1/11:1, A Eth1/1/9:1,1/1/10 below). These settings are required for discovery of the VxRail nodes before creating the VxRail cluster. S5248F-Leaf1A# show Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 39
S5248F-Leaf1A# show lldp neighbors Loc PortID Rem Host Name Rem Port VLT topology, the output is identical to the above. For the single switch topology, the output includes all eight node-connected ports, and ports 1/1/53-54 are not used. 39 Dell EMC SmartFabric OS10 Switch Configuration Guide - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 40
Peer-Routing : Enabled Peer-Routing-Timeout timer : 0 seconds VLTi Link Status port-channel1000 : up VLT Peer Unit ID System MAC Address Status IP Address Version 2 d8:9e:f3:bf:ae:00 up fda5:74c8:b79e:1::2 2.3 40 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 41
default 8.2.3 show vlt domain_id mismatch This command highlights any potential configuration issues between VLT peers. All items must indicate No mismatch. S5248F-Leaf1A# show vlt 127 mismatch VLT mismatch (Output truncated) 41 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 42
from a jump box to a leaf switch for clarity. Port-group1/1/3 on the S5248F-ON is set to 10GbE to allow connectivity to a 10GbE NIC on the jump box. See Appendix B for information on S5248F-ON port-group configuration. 42 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 43
the value set to 0, as shown in Figure 17. Management Network VLAN ID is set to 0 during deployment Use the actual VLAN numbers for the remaining VLANs when prompted by the deployment GUI. Ports in the remaining VLANs are tagged. 43 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 44
following tables include hardware, software, and firmware that was used to configure and validate the examples in this guide. Dell EMC PowerSwitches Switches and operating system versions Qty Item 2 Dell EMC PowerSwitch S5248F-ON leaf switches 1 Dell EMC PowerSwitch S3048-ON management switch OS - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 45
A.4 VxRail appliance software The examples in this guide were validated using VxRail 4.7 appliance software. The software consists of 6.7 U2a 13643870 VMware vSAN 6.7 EP09 VMware vRealize Log Insight 4.6.0 build 8080673 45 Dell EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 46
default setting of 25GbE. The commands to change the interfaces in port-group 1/1/3 from 25GbE to 10GbE are as follows: S5248F-Leaf1A# configure terminal S5248F-Leaf1A(config)# port-group 1/1/3 S5248F-Leaf1A(conf-pg-1/1/3)# mode eth 10g-4x 46 Dell EMC SmartFabric OS10 Switch Configuration Guide - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 47
port group 1/1/3 to 10GbE also changes the affected interface names to eth1/1/9:1- 1/1/12:1. Port-group configuration options for the S5248F-ON are shown in Table 20. Port group number S5248F-ON port-group configuration options Native physical interface name Native speed Other supported speeds - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 48
OS10 User Guide Release 10.5.0 Manuals and documentation for Dell EMC PowerSwitch S3048-ON Manuals and documentation for Dell EMC PowerSwitch S5248F-ON Dell EMC Networking Layer 3 Leaf-Spine Deployment and Best Practices with OS10 Dell EMC VxRail Network Planning Guide Dell EMC VxRail support and - Dell S3048-ON | EMC SmartFabric OS10 Switch Configuration Guide for VxRail 4.7 - Page 49
://www.dell.com/support Telephone: USA: 1-800-945-3355 Feedback for this document Readers are encouraged to provide feedback on the quality and usefulness of this publication by sending an email to [email protected]. 49 Dell EMC SmartFabric OS10 Switch Configuration Guide for
Dell EMC Configuration and Deployment Guide
Dell EMC SmartFabric OS10 Switch Configuration
Guide for VxRail 4.7
Deploying S5200F-ON series switches for a VxRail 4.7 cluster
Abstract
This document provides Dell EMC SmartFabric OS10 switch
configuration examples and topology options for a VxRail 4.7 cluster
deployment using S5200F-ON series switches.
August 2019