Dell S3048-ON VxFlex Network Deployment Guide using EMC Networking 25GbE switc
Dell S3048-ON Manual
View all Dell S3048-ON manuals
Add to My Manuals
Save this manual to your list of manuals |
Dell S3048-ON manual content summary:
- Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 1
25GbE switches and OS10EE A VxFlex Ready Node deployment guide using Dell EMC Networking S5200-ON switches Abstract The Dell EMC Networking S5248F-ON is the latest in the S-series of 25GbE switches that provide the bandwidth and low latency support for a scalable storage architecture. This document - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 2
. Other trademarks may be trademarks of their respective owners. Dell believes the information in this document is accurate as of its publication date. The information is subject to change without notice. 2 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 3
1.3 Dell EMC VxFlex...7 2 Hardware overview...8 2.1 Dell EMC Networking S3048-ON ...8 2.2 Dell EMC Networking S5248F-ON ...8 2.3 Dell EMC configuration ...25 6 Deploy Dell EMC VxFlex ...27 6.1 Deploy the VxFlex plug-in...27 3 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 4
of Service using DiffServ ...34 A Troubleshoot SDS connectivity ...36 B Routing VxFlex Virtual Machine traffic ...37 C Validated hardware and components...39 D Validated software ...40 E Supported switches ...41 F Product manuals and technical guides ...42 G Fabric Design Center ...43 H Support and - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 5
Edition (OS10EE) • Delivers instructions and working examples for the deployment and configuration of a sample Dell EMC VxFlex virtual SAN • Shows conceptual, physical, and logical diagram examples for various networking topologies 5 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 6
Ethernet switch, designed to be used as a data center Leaf or Top of Rack (ToR) switch. The example topology that is illustrated in this guide uses VxFlex Ready Nodes (formerly known as ScaleIO Ready Nodes). Dell EMC VxFlex Ready Nodes are a combination of VxFlex software-defined block storage and - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 7
with three members on three servers, or five members on five servers. The example in this guide creates a three-member MDM configuration. • Storage Data Server (SDS) - Manages the capacity component communication 7 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 8
adjustments to the commands given in the examples. Dell EMC Networking S3048-ON The Dell EMC Networking S3048-ON is a 1-Rack Unit (RU) switch with forty-eight 1GbE Base-T ports and four 10GbE SFP+ ports. In this guide, one S3048-ON supports management traffic in each rack. 1 2 3 4 5 6 7 8 9 10 11 - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 9
guide is to provide a step-by-step example for configuring the network for VxFlex using OS10EE. Chapter 4 provides instructions for configuring Dell . Regardless of the model used, VxFlex supports VLANs. Management may be done on a in this deployment and Quality of Service (QoS) is used to ensure - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 10
iDRAC connectivity to the VxFlex nodes. Figure 6 shows the S3048-ON is connected to the leaf switches through the OOB port on each leaf switch. In this guide, OS10EE is used on the S3048-ON management switch. 10 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 11
3.2 MGMT Switch S3048-ON S5248F-ON (Leaf1A) S5248F-ON (Leaf1B) iDRAC VxFlex-1 iDRAC VxFlex-2 iDRAC VxFlex-3 iDRAC VxFlex-4 Management for VxFlex-2 through VxFlex-4 (not shown) are done in the same manner. 11 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 12
VLT peers. Dell EMC recommends using at least one S3048-ON switch per 42-RU rack for OOB management network connections. Each S3048-ON has forty minimum, Dell EMC recommends changing the admin password to a complex password during the first login. 12 VxFlex Network Deployment Guide using Dell EMC - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 13
done in the same manner. The production switches are also connected to the S3048-ON management switch using the OOB port on the back of each switch. -T adapter, Dell EMC part number XTY28, for each iDRAC connection. 13 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 14
network cannot be on the same subnet in a VMware setup. VxFlex OS only supports the following network configurations when deployed on VMware: * A single data storage network and SVM_MGMT_IP + N * IDRAC_MGMT_IP 14 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 15
& SVM_DATA2_IP 172.16.35.0/24 n/a Each data and management network can reside on a different VLAN, enabling separation at a much higher granularity. In this deployment guide, VLANs are used to separate each subnet as shown in Table 5. VLAN and subnet association 15 VxFlex Network Deployment - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 16
PERPETUAL. If an evaluation license is installed, licenses purchased from Dell EMC are available for download on Dell Digital Locker. Installation instructions are provided in the OS10 Enterprise Edition User Guide Release 10.4.2.0. OS10# show license status System Information Vendor Name - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 17
has been modified. Save? [yes/no]:n Proceed to reboot the system? [confirm yes/no]:y The switch is now ready for configuration. 17 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 18
version 10.4.2.2 or later for the commands that are provided in this guide to work. Note: Dell EMC recommends that the switches are using a perpetual license and are set to factory defaults. Before proceeding, use the instructions in section 3.3 to verify the operating system version of each switch - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 19
in this configuration. See chapter 7 for the Maximum Transmission Unit (MTU) guidelines used in this guide. S5248-Leaf1A(conf-if-vl-1632)# interface vlan 1633 S5248-Leaf1A(conf-if-vl-1633)# ip address each VLAN. 19 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 20
the same subnet. Connecting SDC's via router on a different subnet is supported and will require manual configuration of static routes on the SVM and the ESXi as described in primary : 2.0 : 54:bf:64:e6:dd:c1 : 1 20 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 21
VLT Backup Link Destination : 172.16.30.102 Peer Heartbeat status : Up Heartbeat interval : 30 Heartbeat timeout : 90 Destination VRF : default 21 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 22
Prempt State Version Master addr Virtual addr vlan1633 IPv4 33 1 true master-state 2 172.16.33.251 172.16.33.253 22 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 23
default standard switch to the VDS created in this section. See How to migrate service console / VMkernel port from standard switches to VMware vSphere Distributed Switch. Load balancing Enabled Failback Yes 23 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 24
NIC Virtual NIC Uplink Mapping atx01-w01-vds01 Mellanox ConnectX-4 LX vmnic5 Uplink 1 atx01-w01-vds01 Mellanox ConnectX-4 LX vmnic7 Uplink 2 24 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 25
chapter 6). VMkernel adapter settings Network label Connected port group Enabled services MTU Comment management atx01-w01-vds01-management Management traffic 9000 Management -vds01 topology shown in vCenter 25 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 26
VxFlex HCI platform which is created in the next chapter. The screen is taken from Home > Hosts and Clusters. Continue to chapter 6 for instructions to deploy the VxFlex HCI platform. vCenter host and clusters 26 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 27
step-by-step instructions for deploying VxFlex. For a detailed step-by-step guide, see the ScaleIO IP Fabric Best Practice and Deployment Guide. Deploy the VMware vSphere plug-in parameters Parameter Setting vCenter Server atx01m01vc01.dell.local Data center name VxFlex Path to OVA local OVA - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 28
name SIO01 Admin password VxFlex Admin Password vCenter server atx01m01vc01.dell.local Host selection VxFlex components atx01w01esx05, atx01w01esx06, atx01w01esx07, .11.4 DNS Server 2 172.16.11.5 28 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 29
atx01-w01-vds01-VxFlex-management Data01 network label atx01-w01-vds01-VxFlex-data01 Data02 network label atx01-w01-vds01-VxFlex-data02 29 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 30
IP addresses are mandatory, and configuration is performed using the VxFlex OS VMware Installation Wizard, in the Configure SVM stage. The 30 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 31
VxFlex for Windows download. The VxFlex cluster that is created is shown below in Figure 11. VxFlex under load showing throughput 31 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 32
vSphere and Dell EMC VxFlex • Configure Quality of Service using Differentiated Services (DiffServ) For more information on performance tuning, including ESXi hosts and VxFlex VMs, see the VxFlex v2.x Performance Fine-Tuning Technical Notes Guide - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 33
/ifcfg-eth1 DEVICE=eth1 STARTMODE=onboot USERCONTROL=no BOOTPROTO=static NETMASK=255.255.255.0 IPADDR=172.16.34.12 MTU=9000 33 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 34
Controller eth2 IP address: 172.16.35.12/24 done Setting up service network done 4. Use the ping command to validate jumbo frames connectivity to of granular control. For more information, see the Dell EMC VxFlex v2.x Deployment Guide. A DSCP value of 46 corresponds to expedited forwarding - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 35
In the switch configuration section, a policy map is created and instructs both switches to trust the DSCP value mapping. The configuration below ets mode : Enabled pfc mode : Enabled Dscp-tc-mapping : default 35 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 36
A Troubleshoot SDS connectivity SDS connectivity problems affect VxFlex performance. VxFlex has a built-in tool .dell.local-ESX 172.16.34.12 atx01w01esx07.dell.local-ESX 172.16.34.14 --> 3.3 GB (3424 MB) per-second - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 37
'200 eth2' >> /etc/iproute2/rt_tables && cat /etc/iproute2/rt_tables # reserved values 255 local 254 main 253 default 0 unspec # # local # #1 inr.ruhep 37 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 38
filter 0 packets dropped by kernel Note: This example solution is not persistent across reboots but can be automated by the administrator. 38 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 39
used to configure and validate the examples in this guide. Table 20 shows the Dell EMC Networking switches and associated versions used. It is the latest operating systems available on Dell Digital Locker (account required). Dell EMC Networking switches Qty Item 1 S3048-ON - Management switch 2 - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 40
components used to validate the example configurations in this guide. It is important to update to the latest versions located at VxFlex Ready Nodes driver and firmware version requirements. Software versions Item Version Dell EMC VxFlex 2.6.1.1_113 VMware vSphere Power CLI 11.0 VxFlex - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 41
10.4.2.2 or later and must also support 25GbE connections. Supported switches for this deployment guide For the latest list of 25GbE switches from Dell EMC, visit Dell Networking S-Series 25-100GbE switches. 41 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches and OS10EE - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 42
for Dell EMC software, hardware, and services. Dell EMC Networking Guides VxFlex Ready Nodes solution overview VxFlex Ready Nodes driver and firmware version requirements Manuals and documentation for Dell Networking S5248F-ON Manuals and documentation for Dell Networking S3048-ON Manuals and - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 43
automation based on validated deployment guides like this one. FDC allows design customization and flexibility to go beyond validated deployment guides. For additional information, visit the Dell EMC Fabric Design Center. 43 VxFlex Network Deployment Guide using Dell EMC Networking 25GbE switches - Dell S3048-ON | VxFlex Network Deployment Guide using EMC Networking 25GbE switc - Page 44
: http://support.dell.com/ Telephone: USA: 1-800-945-3355 Feedback for this document We encourage readers to provide feedback on the quality and usefulness of this publication by sending an email to [email protected] 44 VxFlex Network Deployment Guide using Dell EMC Networking
VxFlex Network Deployment Guide using Dell EMC
Networking 25GbE switches and OS10EE
A VxFlex Ready Node deployment guide using Dell EMC
Networking S5200-ON switches
Abstract
The Dell EMC Networking S5248F-ON is the latest in the S-series of
25GbE switches that provide the bandwidth and low latency support for a
scalable storage architecture. This document details the deployment of
the Dell EMC VxFlex Ready Node solution using these Dell EMC
Networking 25GbE switches.
March 2019