Dell S3048-ON EMC Networking Virtualization Overlay with BGP EVPN - Page 16

16

Dell EMC Networking Virtualization Overlay with BGP EVPN

4.3

BGP EVPN VXLAN overlay

Rack n

R740xd-1

R740xd-2

R740xd-3

R740xd-4

ECMP

Gateway/

Firewall

S5248F-1a

S5248F-1b

S4148U-2a

S4148U-2b

S4148U-3a

S4148U-3b

VNI 1614

172.16.14.253

172.16.15.253

172.16.14.253

172.16.15.253

172.16.16.253

VTEP

10.222.222.1

Border leafs

eBGP

eBGP

Rack 1

Rack 2

VNI 1614

VNI 1616

VRF tenant1

VLTi

VLTi

VLTi

VLT

Z9264F-1

Z9264F-2

VLT

VLT

VM

VM

VM

VM

VM

VM

VM

VM

Physical L3 connection

Physical L2 connection

Virtual L2 connection



VM

VM

VM

VM on VNI 1614, IP 172.16.14.x /24

VM on VNI 1615, IP 172.16.15.x /24

VM on VNI 1616, IP 172.16.16.x /24

172.16.15.253

172.16.16.253

Anycast gateway - VNI 1614

Anycast gateway - VNI 1615

Indirect gateway - VNI 1616

172.16.14.253

VNI 1615

VTEP

10.222.222.2

VTEP

10.222.222.3

BGP EVPN topology with anycast gateways and an indirect gateway

In this deployment example, three VNIs are used: 1614, 1615, and 1616. All VNIs are configured all on six

leaf switches. However, only VNIs 1614 and 1615 are configured with anycast gateways. Because these VNIs

have anycast gateways, VMs on those VNIs which are routing to other networks can use the same gateway

information while behind different leaf pairs. When those VMs route, their local leaf switches will always be

doing the routing. This replaces VRRP and enables VMs to migrate from one leaf pair to another without the

need to change the network configuration. It also eliminates hairpinning and improves link utilization since

routing is performed much closer to the source.

This topology also uses a traditional centralized gateway for routing to external networks, such as the

Internet. VNI 1616 does not have anycast gateways configured, and VMs on this VNI use the physical

gateway/firewall switch as their default gateway. When VMs on VNI 1616 send packets to another VNI or

Internet destination, their packets are tunneled to the third leaf pair where their VXLAN information is stripped

off, and the original frame is exposed. The destination MAC address matches the gateway/firewall and is

forwarded according to its routing table.

With the addition of static routes, VMs with anycast gateways also use the indirect gateway to communicate

with external networks or VMs on VNI 1616. In this example, default routes are installed on all leaf switches

pointing to the indirect gateway. This way, a VM on VNI 1614, for instance, can get the benefit of anycast

gateways, while also being able to access resources made available via the indirect gateway. Static routes

are also used at the indirect gateway to route traffic from external networks or VNI 1616 back to VNIs 1614

and 1615.

Note:

VNIs can any number be in the range 1-16777215.

Section	Page
1 Introduction	6
1.1 Typographical conventions	6
1.2 Attachments	6
2 Hardware Overview	7
2.1 Dell EMC PowerSwitch S5248F-ON	7
2.2 Dell EMC PowerSwitch S4148U-ON	7
2.3 Dell EMC PowerSwitch Z9264F-ON	8
2.4 Dell EMC PowerSwitch S3048-ON	8
2.5 Dell EMC PowerEdge R740xd server	8
3 BGP EVPN VXLAN overview	9
3.1 The VXLAN protocol	10
3.2 BGP EVPN VXLAN operation	11
3.3 Integrated routing and bridging (IRB)	11
3.4 Anycast gateway	11
3.5 Indirect gateway	11
4 Topology	12
4.1 Leaf-spine underlay	12
4.1.1 BGP ASNs and router IDs	13
4.1.2 Point-to-point IP networks	13
4.2 Underlay network connections	15
4.3 BGP EVPN VXLAN overlay	16
4.4 OOB management network connections	17
5 Switch preparation	19
5.1 Check switch OS version	19
5.2 Verify license installation	19
5.3 Factory default configuration	20
5.4 Configure switch port profile (S4148U-ON only)	20
6 Configure leaf switches	21
6.1 Initial configuration settings	21
6.2 VLT configuration	22
6.3 Virtual network configuration	22
6.4 VLAN configuration	24
6.5 Downstream interface configuration	25
6.6 Upstream interface configuration	26
6.7 Route map configuration	26
6.8 Configure UFD in reverse	27
6.9 BGP configuration	28
6.10 Static route configuration	30
7 Configure spine switches	31
7.1 Initial configuration settings	31
7.2 Downstream interface configuration	31
7.3 Route map configuration	33
7.4 BGP configuration	33
8 Leaf switch validation	37
8.1 General commands	37
8.1.1 show interface status	37
8.1.2 show vlan	37
8.1.3 show lldp neighbors	38
8.1.4 show uplink-state-group id_# detail	38
8.2 VLT validation commands	39
8.2.1 show vlt domain_id	39
8.2.2 show vlt domain_id backup-link	39
8.2.3 show vlt domain_id mismatch	39
8.2.4 show vlt domain_id vlt-port-detail	40
8.3 Routing validation commands	41
8.3.1 show bfd neighbors	41
8.3.2 show ip route	41
8.3.3 show ip bgp summary	42
8.4 EVPN validation commands	42
8.4.1 show ip route vrf vrf_name	42
8.4.2 show evpn evi	42
8.4.3 show ip bgp l2vpn evpn summary	43
8.4.4 show ip bgp l2vpn evpn	43
8.4.5 show evpn mac-ip	45
9 Spine switch validation	46
9.1 General commands	46
9.1.1 show interface status	46
9.1.2 show lldp neighbors	46
9.2 Routing validation commands	47
9.2.1 show bfd neighbors	47
9.2.2 show ip route	47
9.2.3 show ip bgp summary	48
9.2.4 show ip bgp l2vpn evpn summary	48
10 VMware host and network configuration	49
10.1 VMware ESXi download and installation	49
10.2 Install and configure VMware vCenter Server 6.7 U1	49
10.3 Add ESXi hosts to vCenter Server	49
10.4 Create VMs and install guest operating systems	50
10.5 vSphere distributed switches	51
10.6 Create a VDS	51
10.7 Add distributed port groups	52
10.8 Create LACP LAGs	52
10.9 Associate hosts and assign uplinks to LAGs	54
10.10 Connect VMs to VDS and port group	56
10.11 Configure networking in the guest OS	57
11 Validate connectivity	58
11.1 Validate tunneled Layer 2 bridging	58
11.2 Validate routing using anycast gateways	59
11.3 Validate routing using the indirect gateway	60
A Gateway/firewall switch configuration	62
A.1 Initial configuration settings	62
A.2 Indirect gateway configuration	62
A.3 Simulated external network interface configuration	63
A.4 Upstream interfaces	63
A.5 Static routes to VNIs	63
B Validated components	64
B.1 Dell EMC PowerSwitches	64
B.2 PowerEdge R740xd Servers	64
B.3 VMware software	64
C Technical resources	65
C.1 Dell EMC product manuals and technical guides	65
C.1 VMware product manuals and technical guides	65
D Fabric Design Center	66

Dell S3048-ON EMC Networking Virtualization Overlay with BGP EVPN - Page 16

BGP EVPN VXLAN overlay

Page 16 highlights