HP 1606 Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20
HP 1606 Manual
View all HP 1606 manuals
Add to My Manuals
Save this manual to your list of manuals |
HP 1606 manual content summary:
- HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 1
53-1001766-01 ® 30 March 2010 Fabric OS FCIP Administrator's Guide Supporting Fabric OS v6.4.0 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 2
and DCFM, Extraordinary Networks, and SAN Health set forth any warranty, expressed or implied, concerning any equipment, equipment feature, or service information contained in this book or the computer programs that accompany it. The product ://www.brocade.com/support/oscd. Brocade Communications - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 3
Publication number 53-1001349-01 53-1001349-02 Fabric OS FCIP Administrator's Guide 53-1001755-01 Fabric OS FCIP Administrator's Guide 53-1001766-01 Summary of changes Date New document. July 2009 Various changes and corrections. October 2009 New document for Fabric OS January 2010 version - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 4
iv Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 5
supported features 1 FCIP concepts 3 IP WAN network considerations 3 FCIP on the 7800 Switch and FX8-24 Blade In this chapter 5 7800 switch hardware overview 6 7800 switch of service 16 VLANs and layer two quality of service 16 When both DSCP and L2CoS are used 16 DSCP and VLAN support on - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 6
the media type for GbE ports 0 and 1 (7800 switch only 27 Setting the GbE port operating mode (FX8-24 blade only) . . . .28 Configuring a GbE or XGE port IP address 29 Configuring an IP route 30 Validating IP connectivity 30 Creating an FCIP tunnel 31 Creating additional FCIP circuits - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 7
51 TCP Byte Streaming 51 Supported third party WAN optimizer hardware 51 Options for enhancing tape I/O performance 52 FCIP Fastwrite and OSTP 52 FCIP Fastwrite and OSTP configurations 53 Unsupported configurations for Fastwrite and OSTP 54 FCIP services configuration guidelines 56 Setting - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 8
for a circuit 88 Displaying FCIP tunnel information (7500 switch/FR4-18i blade 89 FCIP tunnel issues 92 FCIP links 94 Gathering additional information 95 FTRACE concepts 96 Displaying the trace for a tunnel 97 Deleting an FTRACE configuration for a tunnel 98 Example of capturing an FTRACE - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 9
FCIP tunnel configuration options for the 7500 switch and FR4-18i blade. • Chapter 4, "FCIP Management and Troubleshooting" describes FCIP management and troubleshooting operations. Supported hardware and software . The following hardware platforms support FCIP as described in this manual. • Brocade - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 10
manual applies to FCIP support in Fabric OS version 6.4.0 and later releases. New features include support for IPSec, support for VLAN and DSCP tagging, and support Identifies the names of user-manipulated GUI elements Identifies keywords narrative portions of this guide are presented in mixed - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 11
Command syntax in this manual follows these conventions: command --option, option -argument, arg [ ] variable ... value | \ Commands are printed in bold. Command options are printed in bold. Arguments. Optional element. Variables are printed in italics. In the help pages, variables are underlined - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 12
Networking at no cost for a user ID and password. For additional Brocade documentation, firmware. Other industry resources • White papers, online demos, and data sheets are available through the Brocade website at http://www.brocade.com/products-solutions/products/index.page. • Best practice guides - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 13
• Switch model • Switch operating system version • Error numbers and messages received • supportSave command output • Detailed description of the problem, including the switch or fabric behavior immediately following the problem, and specific questions • Description of any troubleshooting steps - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 14
effort to ensure the accuracy and completeness of this document. However, if you find an error or an omission, or you think that a topic needs further development, we want to hear , including the topic heading and page number and your suggestions for improvement. xiv Fabric OS FCIP Administrator - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 15
and supported features 1 •FCIP concepts 3 •IP WAN network considerations 3 FCIP platforms and supported features There are five Brocade platforms that support FCIP: • The Brocade 7800 switch. • Gbps) Yes LZ only Yes Yes LZ only Yes Fabric OS FCIP Administrator's Guide 1 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 16
WAN No* optimization hardware IPv6 addresses for FCIP Yes tunnels** Support for jumbo frames No* MTU of 1500 is maximum FX8-24 blade Yes Yes Yes Yes Yes Transport mode Yes No* Yes No* MTU of 1500 is maximum 7500/7500E switch Yes Yes No Yes Yes Tunnel mode Yes Yes Yes - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 17
the WAN carrier and IP network administrator to be sure that the network hardware and software equipment operating in the data path can properly support the TCP connections. When consulting, keep the following in mind: • Routers and firewalls that are in the data path must be configured to pass FCIP - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 18
1 IP WAN network considerations 4 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 19
FX8-24 Blade 2 In this chapter •7800 switch hardware overview 6 •7800 switch license options 6 •FX8-24 blade hardware VLANs 16 •IPSec implementation over FCIP tunnels 20 •Support for IPv6 Addressing 24 •Configuration preparation 26 •Configuration steps 26 •Virtual fabrics and the FX8-24 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 20
copper ports are the default. • The 7800 switch require feature licenses. These include the following: • The 7800 upgrade license to enable full hardware capabilities, full FCIP tunnel capabilities, support configure VEX_ports. Please refer to Chapter 16 of the Brocade Fabric OS Administrator's Guide - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 21
eight FCIP tunnels may be created. The 7800 switch supports VEX_ports to avoid the need to merge fabrics. FCIP trunking capacity on the 7800 switch FCIP trunks are built by creating a set of FCIP circuits. FCIP circuits create multiple source and destination addresses for routing traffic over a WAN - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 22
ATTENTION If you configure an FX8-24 in a DCX or DCX-4S slot and decide to relocate the blade and its IP addresses to another slot within the same chassis, the IP addresses assigned to the blade to the original slot and delete the IP addresses. 8 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 23
ports. (labeled XGE0 and XGE1 on the sticker). 2 GbE ports 0 through 3. 3 GbE ports 4 through 9. 4 FC ports 6 through 11. 5 FC ports 0 through 5. Fabric OS FCIP Administrator's Guide 9 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 24
: • 10GbE support. • Advanced FICON acceleration. • The IR license is required for FCR. The IR license is required to configure VEX_ports. • an FCIP tunnel. A tunnel may have multiple circuits. Each circuit is a connection between a pair of IP addresses that are associated with source and destination - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 25
equal cost tunnels are not supported between the switch pairs when emulation is enabled on any one or more tunnels without controlling the routing of SID/DID pairs to individual tunnels using TI Zones or LS/LF configurations.When load leveling across multiple circuits, the difference between the - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 26
multiple across multiple circuits, utilized. If you configure circuits with the committed IP addresses are not on the same subnet, a IP static route must be defined which designates the gateway IP address. • For IPv4 connections, multiple 1GbE or 10GbE ports on a FX8-24 blade or a 7800 switch switch. - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 27
, and the available bandwidth is updated again as each circuit comes online. For example, if circuit 0 is recovered, the available bandwidth is updated as 1 Gbps. If circuit 1 is also recovered, the available bandwidth is updated as 1.5 Gbps. Fabric OS FCIP Administrator's Guide 13 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 28
the FCIP tunnel transmits data through the IP network. ARL uses information from the TCP connections to determine and adjust the rate limit is a circuit configured with a maximum committed rate greater than 5 times the minimum committed rate, the configuration will need to updated so the maximum - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 29
Brocade Fabric OS Adaptive Networking licensed feature. This . Each circuit has four internal TCP connections that manage QoS SID/DID when there is congestion on the network. If there is no congestion, TCP TCP TCP TCP Connection Connection Connection Connection IP Interface GE Port FIGURE 7 TCP - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 30
DSCP uses six bits of the Type of Service (TOS) field in the IP header to establish up to 64 different values to associate with data traffic priority. DSCP settings are useful only if IP routers are configured to enforce QoS policies uniformly within the network. IP routers use the DSCP value as an - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 31
Default QoS Reserved DSCP and VLAN support on FCIP circuits When a to enable VLAN support on circuit - -dscp-low The parameter sets the VLAN tag value in the header assigning the each FCIP circuit. On the 7800 switch and FX8-24 blade, only traffic circuit 0. switch:admin> portcfg - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 32
switch:admin and modify options. switch:admin> portcfg fcipcircuit configuration and modify options. switch:admin> portcfg values. switch:admin> IPSec: Disabled Remote WWN: Not Configured Local WWN: 10:00:00: Oper Status: In Progress Remote IP: 192.168.2.20 Local IP: 192.168.2.10 Metric: 0 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 33
network mask of 255.255.255.0. If frames are already VLAN tagged, those tags take precedence over entries in this table. NOTE If you do not specify a destination IP address, the destination address defaults to 0.0.0.0, and all frames are tagged with the associated VLAN tag. 1. Connect to the switch - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 34
) policies are created and assigned on peer switches or blades on both ends of the FCIP tunnel. 2. Traffic from an IPsec peer with the lower local IP address initiates the IKE negotiation process. 3. IKE negotiates security association (SA) parameters, setting up matching SAs in the peers. Some of - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 35
supported for IPsec. • There is no RAS message support for IPsec. • IPsec can only be configured on IPv4 based tunnels. IPSec for the 7800 and FX8-24 blade AES-GCM-ESP is used as a single, pre-defined mode of operation for protecting all TCP lifetime expires. For the 7800 switch and FX8-24 blade, the - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 36
17 create 4 192.168.4.91 192.168.4.81 50000 -x 0 portcfg fcipcircuit 17 create 5 192.168.5.91 192.168.5.81 50000 -x 0 22 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 37
number of round-trip times needed to complete the I/O over the IP network and speeds up the process. Each GbE port supports up to 2048 simultaneous accelerated exchanges. Both sides of an FCIP tunnel must have matching configurations for these features to work. FCIP Fastwrite and OSTP are enabled - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 38
LF configurations may be used to control the routing of SID/DID pairs to individual tunnels and provide deterministic flows between the switches, allowing the use of multiple equal cost tunnels. Refer to the Fabric OS Administrator's Guide for more information about traffic isolation zoning. Support - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 39
for IPv6 (RFC 2474). The configuration of this will be done on the FCIP circuit using the Differentiate Services Code Point (DSCP) parameters to fill the 6-bit DSCP field. • Flow labels are not supported on this IPv6 implementation. The 20-bit Flow Label field will be defaulted to all zeros. • The - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 40
. • If required, configure VEX_ports. • For the 7800 switch, set the media type for GbE ports 0 and 1. • For the FX8-24 blade, set the GbE port operating mode • Assign IP addresses to the GbE ports. • Create one or more IP routes using the portCfg iproute command. • Test the IP connection using the - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 41
ID 2 and preferred domain ID 220: switch:admin> portcfgvexport 18 -a 1 -f 2 -d 220 Configuring the media type for GbE ports 0 and 1 (7800 switch only) Two media types are supported for GbE ports 0 and 1 on the 7800 switch; copper and optical. The media type must be set for GbE ports 0 and 1 using - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 42
:admin> bladecfggemode --set 1g -slot 8 You can use the bladecfggemode --show command to display the GbE port mode for the FX8-24 blade in slot 8, as shown in the following example. switch:admin> bladecfggemode --show -slot 8 bladeCfgGeMode: Blade in slot 8is configured in 1GigE Mode 1GigE mode - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 43
168.1.24 255.255.255.0 1500 The following command creates an IP interface for port ge0 on the Brocade 7800 switch. switch:admin> portcfg ipif ge0 create 192.168.1.78 255.255.255.0 1500 FIGURE 10 Basic sample configuration NOTE For IPv4 connections, multiple GbE (or 10GbE) ports on a FX8-24 blade or - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 44
.11.1 FIGURE 11 Configuring an IP route Validating IP connectivity After you have established the IP interfaces and an IP route, you can issue a portcmd - -ping command to verify connectivity. The following example tests the connectivity between the FX8-24 blade and 7800 switch in the basic sample - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 45
Configuration steps 2 Creating an FCIP tunnel FCIP tunnels are created using the portCfg fciptunnel create command. The following command creates the FX8-24 end of the tunnel. VE_port 12 is specified. Circuit parameters are included to create circuit 0. The 7800 switch 's Guide 31 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 46
Configuration is set by the . Compression cannot be set or modified by the This option supports up to provides a more aggressive algorithm. This option supports up to 2.5 Gbps of FC traffic. Open Systems Tape Pipelining" on page 23. Causes the remote-side FCIP tunnels" on page 20 for information about - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 47
instead to set the availability and network performance. multiple turn selective acknowledgement off. This option is used to toggle the option off and on. The keep-alive timeout in seconds. The range of valid values is 8 through 7,200 sec and the default is 10. Fabric OS FCIP Administrator's Guide - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 48
and the default is 100 ms. You can configure standby circuits by assigning a metric. Refer to "FCIP circuit failover capabilities" on page 12 for a description of circuit failover and the use of standby circuits. Applies a VLAN tag to a circuit and sets a specific layer two class of service. Refer - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 49
destination address for the 7800 switch, and the source address for the FX8-24 blade. • ARL minimum and maximum rates are set per circuit. They must be the same on either end of a circuit, but individual circuits may have different rates. • You can configure standby circuits by assigning a metric - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 50
must be disabled while they are being configured. Before an FCIP tunnel can be used, the associated ports must be persistently enabled. 1. Connect to the switch and log in using an account assigned to verify the port is persistently enabled. 36 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 51
created. Options are as listed and described in Table 5 on page 33. NOTE You can modify all circuits, including circuit 0, using the portcfg fcipcircuit command. Deleting an IP interface You can delete an IP interface using the portcfg ipif command with the delete option. The command - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 52
IP route Deleting an IP route You can delete an IP route to a gateway destination IP and GbE port configuration information. The total number of VE_ports in all the logical switches is equal to the supported on the 7800 switch at this time. 38 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 53
over FCIP 45 •Virtual Fabrics and FCIP 51 •TCP Byte Streaming 51 •Options for enhancing tape I/O performance 52 •FCIP services configuration guidelines 56 •Setting persistently disabled ports 57 •Configuring VEX_Ports 57 •Creating IP interfaces and routes 58 •Creating an FCIP tunnel 61 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 54
and FR4-18i blade The 7500 switch and FR4-18i blade Fabric OS supports SAN extension between Brocade 7500 switches, or between FR4-18i blades installed on Brocade 48000 directors or Brocade DCX Data 14 Brocade 7500 Port Numbering 40 FC15 GbE0 GbE1 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 55
general design considerations when configuring the Brocade 7500 switch and the FR4-18i blade: • The Brocade 7500 and FR4-18i blade can have up to 8 tunnels per 1GE interface. • Source and destination IP addresses are defined on the FCIP tunnel. FCIP circuits are not supported. • If the source and - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 56
Switch presents only 2 active FC ports and 1 virtual port per GE interface. Each GbE interface can support enable FC-FC Routing Service functionality over an FCIP tunnel page 43 illustrates a portion of a Fibre Channel network that uses FCIP ISLs, which are VE_Ports connected over the IP WAN network - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 57
7500 switch and FR4-18i blade 3 Fibre Channel initiator Data Center FC SAN Brocade 7500 VE_Port Fibre Channel initiator IP WAN Network VE_Port FIGURE 15 Network using FCIP Compression on FCIP tunnels Data compression can be enabled or disabled on FCIP tunnels. The default setting is to - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 58
DSCP uses six bits of the Type of Service (TOS) field in the IP header to establish up to 64 different values to associate with data traffic priority. DSCP settings are useful only if IP routers are configured to enforce QoS policies uniformly within the network. IP routers use the DSCP value as an - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 59
. By default, when creating an FCIP tunnel, IPsec is disabled. Used to provide greater security in tunneling on an FR4-18i blade or a Brocade 7500 Extension Switch, the IPsec feature does not require you to configure separate security for each application that uses TCP/IP. When configuring for IPsec - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 60
MAC IP to set up supported on an interface with a secure tunnel. • IPsec can only be configured on IPv4 based tunnels. Secure tunnels cannot be created on a Brocade 7500 Extension Switch or FR4-18i blade if any IPv6 addresses are defined on either ge0 or ge1. 46 Fabric OS FCIP Administrator's Guide - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 61
with the lower local IP address initiates the IKE negotiation process. 2. IKE negotiates SAs and authenticates IPsec peers, and sets up a secure channel IPsec policies are managed using the policy command. You can configure up to 32 IKE and 32 IPsec policies. Policies cannot Guide 47 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 62
is the default. The following example shows how to create IKE policy number 10 using 3DES encryption, MD5 authentication, and Diffie-Hellman Group 1: switch:admin> policy --create ike 10 -enc 3des -auth md5 -dh 1 The following policy has been set: 48 Fabric OS FCIP Administrator's Guide 53 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 63
IKE and IPsec policy settings 1. Connect to the switch and log in using an account assigned to the admin role. 2. Display the settings for a single delete and then recreate a policy with the new parameters. 1. Connect to the switch and log in using an account assigned to the admin role. 2. Enter - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 64
for tunnel 3: switch:admin> portshow fciptunnel 8/ge0 3 -ipsec Port: ge0 Tunnel ID 3 Remote IP Addr 192.175.5.200 Local IP Addr 192.175.5.100 Remote WWN Not Configured Local WWN 10: seconds): 1500000 Pre-Shared Key 1234567890123456 50 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 65
as an extended ISL must be assigned to the base switch. TCP Byte Streaming TCP Byte Streaming allows a Brocade 7500 Extension Switch or an FR4-18i blade to communicate with supported third party WAN optimization hardware connected on the GigE ports configured for FCIP. This feature is enabled when - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 66
not support multiple equal-cost path configurations (see "FCIP Fastwrite and OSTP configurations"). Does not support multiple equal-cost path configurations or multiple non-equal-cost path configurations (see "FCIP Fastwrite and OSTP configurations"). 52 Fabric OS FCIP Administrator's Guide 53 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 67
pairs. By default, only Fastwrite-based acceleration is performed on the unassociated pairs. Does not support multiple non-equal-cost path between host and sequential device FCIP Fastwrite and OSTP configurations To help understand the supported configurations, consider the configurations shown in - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 68
to multiple ports, Fastwrite and OSTP enabled on a per-tunnel/per-port basis Unsupported configurations for Fastwrite and OSTP The following configurations are not supported with Fastwrite and OSTP. These configurations use multiple equal-cost paths. 54 Fabric OS FCIP Administrator's Guide 53 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 69
Options for enhancing tape I/O performance 3 VE-VE or VEX-VEX FIGURE 18 Unsupported configurations with Fastwrite and OSTP Fabric OS FCIP Administrator's Guide 55 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 70
port 16, and define an IP interface and one or more IP routes over ge0. 3. Persistently disable the VE_ports before you configure them. Ports on a new Brocade 7500 Extension Switch or FR4-18i blade are persistently disabled by default. On a Brocade 7500 Extension Switch or FC4-18i blade that has - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 71
negotiate fabric parameters. The following example configures a port as a VEX_Port for slot number 8 in port number 18, enables admin, and specifies fabric ID 2 and preferred domain ID 220: switch:admin> portcfgvexport 8/18 -a 1 -f 2 -d 220 Fabric OS FCIP Administrator's Guide 57 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 72
than 1500 B). If the network you are using supports jumbo packets, a value of 2348 can improve performance. By default, the virtual ports will automatically become VE_Ports. 2. Define IP routes on a GbE port. After defining the IP interface of the remote switch, you can define destination routes - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 73
the same IP subnet as one of the port IP addresses. metric The link metric associated with the route. Valid values are 0-255. The default value is 0. A low value encourages the use of the route, and a high value discourages the use of a route. Fabric OS FCIP Administrator's Guide 59 53-1001766 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 74
to the remote interface. You can test a connection only if both ports have IP interfaces set. The command syntax is as follows. portCmd --ping [slot/]ge0|ge1 [-s source_ip] [-d dest_ip] [-c L2 class-of-service] [-n num-requests] [-q type-of-service] [-t ttl] [-v vlan tag] [-w wait-time] [-z size - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 75
ping packet to use. The total size cannot be greater than the configured MTU size (refer to step 1). The default size is 64 bytes. The following example tests the connection between 192.175.5.100 and 192.175.5.200, switch:admin06> portcmd --ping ge0 -s 192.175.5.100 -d 192.175.5.200 Pinging 192 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 76
The DSCP marking for the FCIP tunnel's TCP control connection. The range of valid values is 0 through 63. The default is 0. Before configuring DSCP settings, determine if the IP network you are using implements PHB, and consult with the network administrator to determine the appropriate DSCP values - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 77
Verifying the FCIP tunnel configuration 3 -v vlan_id The number used as the VLAN ID. This number is used in the IP frame to route the frame to a specific VLAN. -p control_L2Cos The layer 2 class of service used for control traffic. -P data_L2Cos The layer 2 class of service used for data - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 78
Fastwrite and OSTP (tape pipelining) enabled. If TCP Byte Streaming were enabled, then FCIP Fastwrite and OSTP would be disabled. SP3:admin> portshow fciptunnel ge1 1 Port: ge1 Tunnel ID 1 Tunnel Description Not Configured Remote IP Addr 192.168.15.2 Local IP Addr 192.168.15.1 Remote WWN Not - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 79
configured FCIP tunnels now appear in the fabric as VE_Ports. 3. Verify that the VE_Port or VEX_Port is online, use the switchShow command to view and verify that the FCIP tunnel is online. switch:admin06> portenable 8/18 switch:admin06> portenable 8/19 switch:admin06> switchshow switchName:switch - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 80
as shown below: switch:admin06> portcfgpersistentenable 8/16 switch:admin06> portcfgpersistentenable 8/17 switch:admin06> portcfgpersistentenable 8/18 switch:admin06> portcfgpersistentenable 8/19 switch:admin06> portcfgshow Ports . LM:L0.5 66 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 81
does not apply to the stand-alone Brocade 7500 Extension Switch. ge0|ge1 The Ethernet port used by the tunnel (ge0 or ge1). tunnel_id The tunnel number (0 - 7). modify The modify option changes the FCIP tunnel configuration options and parameters. -b comm_rate The new committed traffic rate - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 82
The DSCP marking for the FCIP tunnel's TCP control connection. The range of valid values is 0 through 63. The default is 0. Before configuring DSCP settings, determine if the IP network you are using implements PHB, and consult with the network administrator to determine the appropriate DSCP values - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 83
. Range is 0-7. -default Resets or sets the virtual channel QoS map to default values. -delete Deletes associated QoS map configuration file. Delete QoS mappings before downgrading to pre-v6.0.0 firmware versions that do not support QoS mapping. It removes the file from the config flash memory - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 84
tag table through their own configuration procedures. Manual entries are needed on both the local and remote sides for portCmd ping and portCmd traceroute commands when they are used to test and trace routes across a VLAN when no FCIP tunnel is active. 1. Connect to the switch and log in using an - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 85
options are available. • portCmd --tperf-Used only with the 7800 switch and FX8-24 blade, tperf is a tunnel test tool that generates and sends test data over an FCIP tunnel to determine the characteristics and reliability of the IP network used by the tunnel at the FCIP circuit level. • portCmd - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 86
analysis tools Tperf will test single and multiple circuit tunnels. Tperf also tests the different priority connections that that same VE port will show the following: switch:admin> switchshow | grep 16 16 16 631000 -- -- Offline VE The Tperf command determines the path characteristics to - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 87
is refreshed, in seconds. The default is 30 seconds. The following example creates a Tperf data sink and a Tperf data source on VE_port 16. switch:admin> portcmd --tperf 16 -sink -interval 15 TPerf has been configured successfully for 16 TPerf is servicing requests on 16 priority: high TPerf - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 88
last rtt N/A N/A N/A switch:admin> portcmd --tperf 16 -source -interval 15 TPerf has been configured successfully for 16 TPerf is 32 291 Tperf generates statistics every 30 seconds by default unless you specify a different value for -interval. Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 89
configuration, you can specify the IP addresses of the endpoints, target bandwidth for the path, and optional parameters such as the length of time to run the test and statistic polling interval. Only a single ipperf session can be active on an FCIP GbE port at any time. Each FCIP port supports - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 90
BW, Loss, and PMTU values printed may not be accurate. Starting an ipperf session Typically, you start the WAN tool before setting up a new FCIP tunnel between two sites. You can configure and use the --ipperf option immediately after installing the IP configuration on the FCIP port (for example - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 91
the default, 30 seconds. Total Time The current running test total supported for FCIP tunnels). If 1260 also fails, --ipperf gives up. There is no support for aging. During black hole PMTU detection the BW, WBW, Loss and PMTU values printed may not be accurate. Fabric OS FCIP Administrator's Guide - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 92
). -q diffserv The DiffServ marking code point (DSCP) for the TCP connection. The value must be an integer in the range of 0 to 63. The default value is 0. This operand is optional. Before configuring DSCP settings, determine if the IP network you are using implements PHB, and consult with the - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 93
the configured MTU size. The default size is 64 bytes. -c L2_Cos The Class of Service/Priority, as defined by IEEE 802.1p. Values must be in the range between 0 and 7. The default is 0. This operand is optional with the -v option. (7500 switch and FR4-18i blade only). The following example tests - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 94
than the configured MTU size. The default size is 64 bytes. Service/Priority, as defined by IEEE 802.1p. Values must be in the range between 0 and 7. The default is 0. This operand is optional with the -v option (7500 switch and FR4-18i blade only). The following example traces the route between IP - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 95
, 7500 switches, and FR4-18i blades. The Fabric OS Command Reference Manual and the man pages provide complete descriptions of portshow command syntax and options. The following sections identify a few specific outputs that may be useful for maintenance and troubleshooting. Displaying IP interfaces - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 96
Option: Off IPSec: Disabled Remote WWN: Not Configured Local WWN: 10:00:00:05:1e:55:59:e9 Peer WWN: 10:00:00:05:1e:55:68:05 Circuit Count: 4 Flags: 0x00000000 FICON: Off Displaying an FCIP tunnel with FCIP circuit information (7800 switch and FX8-24 blade) The following example adds - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 97
8 Keepalive Timeout: 5000 Path MTU Disc: 0 VLAN ID: 0 L2CoS: F: 0 H: 0 M: 0 L: 0 DSCP: F: 0 H: 0 M: 0 L: 0 Flags: 0x00000000 Circuit ID: 16.3 Circuit Num: 3 Admin Status: Enabled Oper Status: Up Remote IP: 100.83.0.103 Local IP: 100.80.0.103 Fabric OS FCIP Administrator's Guide 83 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 98
Bytes 14 Bps 30s Avg, 21 Bps Lifetime Avg 2754 Input Packets 0 pkt/s 30s Avg, 0 pkt/s Lifetime Avg Displaying FCIP tunnel TCP connections (7800 switch and FX8-24 blade) The following example shows TCP connections for a tunnel on a 7800 switch. 84 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 99
Portshow command usage 4 switch:admin>portshow fciptunnel 17 -c --tcp Tunnel ID: 17 Tunnel Description: Admin Status: Enabled Oper Status: Up Compression: On (Moderate) Fastwrite: Off Tape Acceleration: Off TPerf Option: Off IPSec: Disabled Remote WWN: Not Configured Local WWN: 10:00:00:05:1e:55: - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 100
300000 ms TCP Connection 17.0:68740859 Priority: Low Flags: 0x00000000 Duration: 7 hours, 9 minutes, 50 seconds (output truncated) Displaying FCIP circuits (7800 switch and FX8- Up ----s 7h34m58s 0.00 0.00 3 150/150 0 Flags: circuit: s=sack 86 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 101
FCIP circuit on a 7800 switch. switch:admin> portshow fcipcircuit 20 1 Circuit ID: 20.1 Circuit Num: 1 Admin Status: Enabled Oper Status: Up Remote IP: 104.83.0.141 Local IP: 104.80.0.141 Metric: Avg, 2 Bps Lifetime Avg 754 Output Packets Fabric OS FCIP Administrator's Guide 87 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 102
FCIP circuit on a 7800 switch. switch:admin> portshow fcipcircuit 20 1 --perf --qos Circuit ID: 20.1 Circuit Num: 1 Admin Status: Enabled Oper Status: Up Remote IP: 104.83.0.141 Local IP: 104.80.0.141 Metric: 0 Bps 30s Avg, 1 Bps Lifetime Avg 88 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 103
switch:admin06> portshow fciptunnel 8/ge0 all -perf Slot: 8 Port: ge0 Tunnel ID 0 Remote IP Addr 192.175.4.200 Local IP Addr 192.175.4.100 Remote WWN Not Configured lifetime avg 7.35 compression ratio FC control traffic TCP connection: Local 192.175.4.100:4139, Remote 192 Guide 89 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 104
TCP switch:admin06> portshow fciptunnel 8/ge0 0 -params Slot: 8 Port: ge0 Tunnel ID 0 Remote IP Addr 192.175.4.200 Local IP Addr 192.175.4.100 Remote WWN Not Configured TCP sequence# MIN(2950582519) MAX(2950582655) NXT(2950582655) 2 packets in-flight Send.Unacknowledged(TCP queued: TCP sequence# NXT - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 105
Portshow command usage 4 timeout 10 s Data transfer TCP connection: Local 192.175.4.100:4140, Remote 192.175.4.200:3226 Performance stats: 12899612 output packets 34508 avg 207859776 input Bytes 556200 Bps 30s avg, 491394 Bps lifetime avg Fabric OS FCIP Administrator's Guide 91 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 106
the 7500 switch and FR4 Mac Address: 00.05.1e.37.93.06 Port State: 1 Online Port Phys: 6 In_Sync Port Flags: 0x3 PRESENT ACTIVE Port Speed: 1G 2. Confirm IP configuration is successful, then you have IP connectivity and your tunnel should 11.1.1.2 from IP interface 11 IP route. If there are routed IP - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 107
to the Fabric OS Administrator's Guide to review the setup of the ipRoute. 6. Confirm FCIP tunnel is configured correctly. The Compression, Fastwrite, and Tape Pipelining settings must match the opposite endpoint or the tunnel may not come up. Remote and local IP and WWN should be opposite each - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 108
, errors can be seen when trying to reuse these IP addresses. • The portCmd --ping command only verifies physical connectivity. This command does not verify that you have configured the ports correctly for FCIP tunnels. • One port can be included in multiple tunnels, but each tunnel must - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 109
perf and - params options can be applied only to the 7500 switch and FR4-18i blade. • traceDump -n • portTrace --show number/] Displays IP interface configuration for each GbE port (IP address, gateway and MTU . See Fabric OS Administrator's Guide or Fabric OS Command Reference - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 110
4 FTRACE concepts FTRACE concepts FTRACE is a support tool used primarily by your switch support provider. FTRACE can be used in a manner similar to that of a channel protocol analyzer. FTRACE may be used to troubleshoot problems using a Telnet session rather than sending an analyzer or technical - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 111
trace pool. If there are multiple tunnels defined, they will be all configurations, the VE_port used in the portshow ftrace command must exist in the VF context that is set. The following is and example of output for a 7800 switch. switch Error Fabric OS FCIP Administrator's Guide 97 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 112
| Wrap | In | Out | Switch | Switch | | Id | State | Size configuration for a tunnel This command applies only to the 7500 switch switch as admin. 2. Enter the portCfg ftrace [slot/]Ge_Port tunnel_Id del command. The following example deletes the FTRACE configuration for GbE port 1, tunnel 1. switch - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 113
are captured in a supportSave automatically. There is no user command to force the saving of a trace buffer. If there manually, then take a supportSave and the FTRACE data will be included in the supportSave output. 1. Enable FTRACE on ge1 interface tunnel 0 using the default parameters: switch - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 114
Current | 200000 | 0x10010100 | 0 | FFFF | FFFF | | | | 2| unused | 200000 | 0x10010200 | 0 | FFFF | FFFF | | | | 3| unused | 200000 | 0x10010300 | 0 | FFFF | FFFF | | | 6. Transfer the FTRACE information off of the switch. 100 Fabric OS FCIP Administrator's Guide 53-1001766-01 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 115
blade, 41 7800 switch, 6 configuring a GbE port, 29 configuring an IP route, 30 creating an FCIP tunnel, 31 creating and FCIP circuit, 35 A Adaptive Rate Limiting (ARL), 14 F Fastwrite, 52 Fabric OS FCIP Administrator's Guide 53-1001766-01 FCIP configuration guidelines, 56 configuring VEX_Ports, 27 - HP 1606 | Fabric OS FCIP Administrators Guide v6.4.0 (53-1001766-01, November 20 - Page 116
FCIP, 45 FCIP changeable parameters, 48 FCIP configuration, 47 FCIP fixed parameters, 47 L License requirements 7800 switch, 6 FX8-24 blade, 10 Load leveling and acceleration, 52 tperf, 71 tunnel goes on- and offline, 93 V VE_Ports, 42 VEX_Port, 42 Virtual Fabrics FCIP, 51 W WAN,
53-1001766-01
30 March 2010
®
Fabric OS FCIP
Administrator’s Guide
Supporting Fabric OS v6.4.0