HP StorageWorks 8/8 Brocade Fabric OS Troubleshooting and Diagnostics Guide v6
HP StorageWorks 8/8 - SAN Switch Manual
View all HP StorageWorks 8/8 manuals
Add to My Manuals
Save this manual to your list of manuals |
HP StorageWorks 8/8 manual content summary:
- HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 1
53-1001340-01 ® 28 July 2009 Fabric OS Troubleshooting and Diagnostics Guide Supporting Fabric OS v6.3.0 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 2
53-1001340-01 Diagnostics Guide Summary of changes First released edition. Date March 2008 Added support for Virtual Fabrics, fcPing, pathInfo, and additional troubleshooting tips. November 2008 Added support for checking physical connections, updated commands, removed obsolete information, and - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 3
6 Capturing command output 6 Building a case for your switch support provider 6 Basic information 7 Detailed problem information 8 Gathering additional information 9 Chapter 2 General Issues In this chapter 11 Licensing issues 11 Fabric OS Troubleshoot and Diagnostics Guide iii 53 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 4
in the wrong mode 26 Marginal links 26 Troubleshooting a marginal link 27 Device login issues 29 Pinpointing problems with device logins 29 Media-related issues 31 Testing a port's external transmit and receive path 32 Testing a switch's internal components 32 Testing components to and from - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 5
issues 56 Base switch issues 57 Logical switch issues 58 Switch configuration blade compatibility 59 Gathering additional information 60 ISL Trunking Issues In this chapter 61 Link issues 61 Buffer credit issues 62 Zone Issues In this chapter 63 Fabric OS Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 6
information 70 iSCSI Issues In this chapter 71 Connectivity 71 Zoning 73 Authentication 74 Working With Diagnostic Features In this chapter 75 About Fabric OS diagnostics 75 Diagnostic information 75 Power-on self test 76 Disabling POST 78 Enabling POST 78 Switch status 78 Viewing - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 7
dump transfers 90 Specifying a remote server 91 Enabling the automatic transfer of trace dumps 91 Setting up periodic checking of the remote server 91 Saving comprehensive diagnostic files to the server 91 Switch Type Hexadecimal Fabric OS Troubleshoot and Diagnostics Guide vii 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 8
viii Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 9
for performing firmware downloads, as well troubleshooting information. • Chapter 10, "iSCSI Issues," provides information and procedures on iSCSI problems. • Chapter 11, "Working With Diagnostic Features," provides procedures for the use of the diagnostics commands for the chassis, ports, and other - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 10
procedures documented here apply to some switches but not to others, this guide identifies exactly which switches are supported and which are not. Although many different software and hardware configurations are tested and supported by Brocade Communications Systems, Inc. for 6.3.0, documenting all - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 11
was obsoleted because it was no longer supported in the current version of firmware. - FCIP chapter has been moved to the Fibre Channel over IP Administrator's Guide. - FICON chapter has been moved to the FICON Administrator's Guide. For further information about documentation updates for - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 12
For definitions specific to Brocade and Fibre Channel, see the Brocade Glossary. For definitions of SAN-specific terms, visit the Storage Networking Industry Association online dictionary at: http://www.snia.org/education/dictionary xii Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 13
• Switch model • Switch operating system version • Error numbers and messages received • supportSave command output • Detailed description of the problem, including the switch or fabric behavior immediately following the problem, and specific questions Fabric OS Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 14
located inside the chassis on the port side on the left • Brocade 5000-On the switch ID pull-out tab located on the bottom of the port side of the switch • Brocade 7600-On the bottom of the chassis • Brocade 48000-Inside the chassis next to the power supply bays • Brocade DCX-On the bottom right on - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 15
1 In this chapter •Troubleshooting overview 1 •Most common problem areas 2 •Questions for common symptoms 2 •Gathering information for your switch support provider 5 •Building a case for your switch support provider 6 Troubleshooting overview This book is a companion guide to be used in - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 16
within SANs and identifies tools to use to resolve them. TABLE 1 Common troubleshooting problems and tools Problem area Investigate Tools Fabric Storage Devices Hosts Storage Management Applications • Missing devices • Switch LEDs • Marginal links (unstable connections) • Switch commands - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 17
IP Administrator's tunnel endpoints. Guide Licensing Chapter 2, "General Issues" FCR LSAN tags Chapter 2, "General Issues" FICON settings FICON Administrator's Guide FTP or SCP server or USB availability Firmware version compatibility Unsupported features enabled Firmware versions on switch - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 18
ports Licensing Cables are on same port group SFPs Trunked ports Zoning E_Port QOS configuration mismatch Password recovery Chapter or Document Chapter 3, "Connectivity Issues" Chapter 2, "General Issues" Chapter 2, "General Issues" Chapter 3, "Connectivity Issues" Chapter 3, "Connectivity Issues - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 19
-s Host IP Addr[1080::8:800:200C:417A]: User Name[njoe]: userFoo Password hidden> Remote Dir[support]: supportftp: parameters changed Capturing a supportSave 1. Connect to the switch and log in using an account assigned to the admin role. 2. Type the appropriate supportSave command based on your - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 20
to your switch support provider when you are ready to contact them. Having this information immediately available will expedite the information gathering process that is necessary to begin determining the problem and finding a solution. 6 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 21
.) 5. If you have a redundant fabric, did a failover occur? 6. Was POST enabled on the switch? 7. Which CP blade was active? (Only applicable to the Brocade 48000 director, and the Brocade DCX and DCX-4S enterprise-class platforms.) Fabric OS Troubleshoot and Diagnostics Guide 7 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 22
Use the haShow command to determine the answer. 9. List out when and what were the last actions or changes made to the switch, the fabric, and the SAN or metaSAN? TABLE 3 Environmental changes Type of Change Date when change occurred 8 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 23
additional information. The additional information is necessary in order for your switch support provider to effectively and efficiently troubleshoot your issue. Refer to the chapter or document specified for the commands whose data you need to capture: • Configurations, see Chapter 3, "Connectivity - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 24
1 Building a case for your switch support provider 10 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 25
Fabric OS Administrator's Guide. Licenses are created using a switch's License Identifier so you cannot apply one license to different switches. Before calling your switch support provider, verify that you have the correct licenses installed by using the licenseIdShow command. Symptom A feature is - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 26
in understanding what is going on in your fabric or on your switch. Weekly review of the RAS logs is necessary to prevent minor problems from becoming larger issues, or in catching problems at an early stage. Below are some common problems that can occur with or in your system message log. Symptom - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 27
command to upload Switch boot issues Symptom The enterprise-class platform model rebooted again after an initial bootup. Probable cause and recommended action This issue FC-FC Routing Service enables you to route the ECHO generated when an fcPing command is issued on a switch, providing fcPing - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 28
OS switch, make sure that the source and destination devices are properly configured in the LSAN zone before entering the fcPing command. This command performs the following functions: • Checks the zoning configuration for the two ports specified. • Generates an ELS (extended link service) ECHO - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 29
. This routing information describes the full path that a data stream travels between these ports, including all intermediate switches. ATTENTION Using the pathInfo command when exchange-based routing is turned on can provide different paths with each attempt. The routing and statistics information - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 30
- - 0 Hop In Port Domain ID (Name) Out Port BW Cost 1 3 10 (web229) 12 1G 1000 Port B/s (1s) B/s (64s) Txcrdz (1s) Txcrdz (64s) F/s (1s) 3 12 Tx Rx Tx Rx 36 76 0 0 5 5 5 5 0 - 0 - 0 - 0 - 1 1 0 0 16 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 31
20025929 54999 162338 56710 Errors - 4 - 0 Hop In Port Domain ID (Name) Out Port BW Cost 2 14 8 (web228) E - - (output truncated) For details about the pathInfo command, see the Fabric OS Command Reference. Performance issues Symptom General slow-down in FCR performance and - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 32
2 18 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 33
. A Gigabit Ethernet switch port configured for an FCIP tunnel is called a VE port (virtual E-port). However, with a VEX_Port at the other end it does not propagate fabric services or routing topology information from one edge fabric to another. Fabric OS Troubleshoot and Diagnostics Guide 19 53 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 34
embedded port will still PLOGI and attempt PRLI with these devices. To display the contents of a switch's Name Server, use the nsShow or nsAllShow command. For more information about these name server commands, refer to Fabric OS Command Reference. 20 Fabric OS Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 35
LED this could mean several things. To determine what is happening on either your port status LED or power status LED, refer to that switch's model hardware reference manual. There is a table that describes the LEDs purpose and explains the current behavior as well as provides suggested resolutions - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 36
failure" on page 25 as the next potential trouble spot. Checking the Name Server (NS) 1. Enter the nsShow command on the switch to determine if the device is attached: switch:admin> nsshow The Local Name Server has 9 entries { 22 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 37
of successful logins and SCSI INQUIRY commands sent over this port and a list of the attached devices. 5. Check the port log to determine whether or not the device sent the FLOGI frame to the switch, and the switch probed the device. Fabric OS Troubleshoot and Diagnostics Guide 23 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 38
, speed_level command if the fields in step 5 do not appear. switch:admin> portcfgspeed Usage: portCfgSpeed PortNumber Speed_Level Speed_Level: 0 - Auto Negotiate 1 - 1Gbps 2 - 2Gbps 4 - 4Gbps 8 - 8Gbps ax - Auto Negotiate + enhanced retries 24 Fabric OS Troubleshoot and Diagnostics Guide 53 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 39
pstate. The command entry AC indicates that the port has completed point-to-point initialization. switch:admin> portlogdumpport 4 time task event port cmd args 11:38:21.726 INTR pstate 4 AC 4. Skip over the loop initialization phase. Fabric OS Troubleshoot and Diagnostics Guide 25 53 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 40
a switch. This test sends frames from a given port's transmitter and loops them back into the same port's receiver. The loopback is done at the parallel loopback path. The path traversed in this test does not include the media or the fiber cable. 26 Fabric OS Troubleshoot and Diagnostics Guide 53 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 41
switch, patch panel, and other devices. Check the SFP by swapping it with a known good working SFP. If you see this issue on an 8 Gbps blade, use the portCfgFillWord command if you are having a cable problem, take snapshots of the port errors by using the portErrShow command in increments of 5 to 10 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 42
the port blade or switch. • If the loopback test did not fail, the SFP was bad. 6. Replace the SFP on the marginal port. 7. Perform the following steps to rule out cabling issues: a. Insert a new cable in the suspected marginal port. b. Enter the portErrShow command to determine if a problem still - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 43
" (Trunk master) Pinpointing problems with device logins 1. Log in to the switch as admin. 2. Enter the switchShow command; then, check for state logins. 3. Enter the portCfgShow command to see if the port is configured correctly. Fabric OS Troubleshoot and Diagnostics Guide 29 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 44
and therefore the device cannot log into the switch. To correct this type of problem, remove the Lock L_Port configuration using the portCfgDefault command. switch:admin> portcfgshow Ports of Slot 0 0 1 2 3 4 PRESENT U_PORT LED 30 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 45
basic testing of the switch circuit. If a structural test fails, replace the main board or port blade. • Functional tests verify the intended operational behavior of the switch by running frames through ports or bypass circuitry. Fabric OS Troubleshoot and Diagnostics Guide 31 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 46
on the command options). See Table 7 on page 33 for a list of additional tests that can be used to determine the switch components that are not functioning properly. See the Fabric OS Command Reference for additional command information. 32 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 47
a functional test of port N to N path. Verifies the functional components of the switch. turboRamTest Verifies that the switches as admin. 2. Enter the configShow -pattern "fabric.ops" command. 3. Log in to another switch in the same fabric as admin. Fabric OS Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 48
switch. 9. Enable the switch by entering the switchEnable command. Alternatively, you can reconcile fabric parameters by entering the configUpload command for each switch and upload a known-good configuration file. If you do this option, the two switches will need to be the same model. Downloading - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 49
System services (yes, y, no, n): [no] Portlog events enable (yes, y, no, n): [no] ssl attributes (yes, y, no, n): [no] rpcd attributes (yes, y, no, n): [no] webtools attributes (yes, y, no, n): [no] WARNING: The domain ID will be changed. The port level zoning may be affected Fabric OS Troubleshoot - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 50
3 Segmented fabrics 36 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 51
-l command switch:admin> usbstorage -l firmwarekey\ 0B 2007 Aug 15 15:13 support\ 106MB 2007 Aug 24 05:36 support1034\ 105MB 2007 Aug 23 06:11 config\ 0B 2007 Aug 15 15:13 firmware\ 380MB 2007 Aug 15 15:13 FW_v6.0.0\ 380MB 2007 Aug 15 15:13 Available space on usbstorage 74% Fabric OS Troubleshoot - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 52
to Services FTP service. User (10.255.252.50:(none)): userFoo 331 Please specify the password. Password: 530 Login incorrect. Login failed. If your login to the FTP or SCP server has failed, verify the username and password are correct. 38 Fabric OS Troubleshoot and Diagnostics Guide 53 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 53
with the instructions. Otherwise Issue the command again. Gathering additional information Be sure to capture the output from the commands you are issuing both from the switch and from your computer when you are analyzing the problem. Send this and all logs to your switch support provider. Fabric - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 54
form Use this form as a hard copy reference for your configuration information. In the hardware reference manuals for the Brocade 48000 and DCX modular switches there is a guide for FC port setting tables. The tables can be used to record configuration information for the various blades. TABLE - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 55
for the commit operation to complete, issue the firmwareShow command to verify the partitions are synchronized, and reissue the firmwareDownload command. If the problem persists, you will need to contact the switch service provider. Fabric OS Troubleshoot and Diagnostics Guide 41 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 56
is inaccessible or firmware path is invalid. Probable cause and recommended action • The FTP or SCP server's host name is not known to the switch. Verify with your network administrator that the switch has access to the FTP server. 42 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 57
the firmware doesn't support this platform. Please enter another firmware path. Cannot download on a switch with Interop mode turned on. Probable cause and recommended action On single CP, Interop fabric does not support Coordinated HotCode Load. Fabric OS Troubleshoot and Diagnostics Guide 43 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 58
and firmwareShow commands to monitor its progress. If the problem persists, contact your switch support provider. Example of a firmwaredownload already in progress switch:admin> firmwaredownload Server Name or IP Address: 192.126.168.115 User Name: userFoo File Name: /users/home/userFoo/firmware/v6 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 59
. • If a problem persists, package together all of the information (the Telnet session logs and serial console logs, output from the supportSave command) for your switch support provider. Make sure you identify what information was gathered before and after issuing the firmwareDownload command. USB - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 60
OS v6.1.1_enc or earlier with one or more Brocade FC8-18 AP blades (blade ID 43) in the system. Brocade Encryption Blade FC8-18 AP blades are not supported on firmware v6.1.1 or earlier, so the firmware download operation failed. 46 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 61
VF before proceeding. Probable cause and recommended action You cannot downgrade because Virtual Fabrics are enabled. Delete the logical switches, delete the base switch, and disable Virtual Fabrics prior to downgrading the firmware. Fabric OS Troubleshoot and Diagnostics Guide 47 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 62
the switch's firmware. switch is running v6.2.0 or later, and IOD Delay value is configured for one or more domains, you cannot downgrade the switch to v6.1.0 or earlier. Use the iodDelayReset command to reset the IOD delay to its default value. 48 Fabric OS Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 63
user passwd admin passwd factory 4. Enter the requested information at the prompts. Symptom Unable to log in as root password. Probable cause and recommended action To recover your root password, contact your switch service provider. Fabric OS Troubleshoot and Diagnostics Guide 49 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 64
to default. How to recover boot PROM password? Contact your switch service provider and provide the recovery string. Refer to the Fabric OS Administrator's Guide for more information on setting the boot PROM password. How do I recover a user, admin, or factory password? Refer to "Password issues - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 65
supported in Fabric OS v6.2.0. Symptom Troubleshooting certificates Probable cause and recommended action If you receive messages in the browser or in a pop-up window when logging in to the target switch using HTTPS, refer to Table 11 for recommended actions you can take to correct the problem - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 66
to this generic issue. You will need to verify the following: • There are no port filters in the switch support provider. Gathering additional information In addition to supportSave, gather the MIB browser snapshot with the problem (like Adventnet screen snapshot) for an MIB variable. FIPS issues - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 67
results. If the tests fail on your switch it will constantly reboot. Because boot PROM access is disabled you will not be able to exit out of the reboot. You will need to send the switch back to your switch service provider for repair. Fabric OS Troubleshoot and Diagnostics Guide 53 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 68
6 FIPS issues 54 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 69
such a configuration is not supported. • ICL ports can only be in the base or default switch. If XISL is turned off, you can connect ICLs to other logical switches. • A default switch can be configured as a base switch in the Brocade 5100 and 5300 switches, but not in a Brocade DCX or DCX-4S. Fabric - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 70
and recommended action You may not create two (2) or more logical switches with the same FID. Use the lsCfg --show and fcrFabricShow commands to view FIDs in use. Logical Fabric issues Symptom Logical port disabled. Probable cause and recommended action This message indicates an - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 71
fabric using XISLs is running an incompatible firmware version and must be upgraded to Fabric OS v6.2.0. Base switch issues All logical switches in a fabric should have the same base switch attribute. If a base switch is connected to a non-base switch, then you must take the appropriate action - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 72
in the default switch. This issue may be seen when attempting to move ports on a Condor-based blade into a non-default switch. To determine if you have a Condor-based blade, refer to the Fabric OS Administrator's Guide. Symptom Validation of switch configuration changes is not supported on this - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 73
All ports on the FR4-18i, both GE and FC, are automatically moved to the default switch. Use the lsCfg -config command to correct the problem. Once the configuration discrepancy has been fixed, you may use slotPowerOff followed by slotPowerOn to recover. Fabric OS Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 74
information For Virtual Fabric-related issues, use the following guidelines to gather additional data for your switch support provider: • Perform the supportSave command. • If not sure about the problem area, perform the supportSave command on all chassis and logical switches in the fabric. • If you - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 75
:45 The trunkDebug command displays the possible reason that two ports cannot be trunked. Possible reasons are: • The switch does not support trunking. • A trunking license is required. • Trunking is not supported in switch interoperability mode. Fabric OS Troubleshoot and Diagnostics Guide 61 53 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 76
non-buffer limited ports). 4. If you are in buffer-limited mode on the LD port, then increase the estimated distance. 5. Enable any of these changes on the buffer-limited port or switch by issuing the commands portDisable and portEnable. 62 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 77
until you issue the cfgEnable command. This should be done during a maintenance window because this may cause disruption in large fabrics. Verifying a fabric merge problem 1. Enter the switchShow command to validate that the segmentation is because of a zone issue. 2. Review "Segmented fabrics - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 78
section discusses fabric segmentation. Fabric segmentation occurs when two or more switches are joined together by ISLs and do not communicate to each other. Each switch appears as a separate fabric when you use the fabricShow command. 64 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 79
is enabled in ports that connects the fabrics. This will cause a merge, making the fabric consistent with the correct configuration. ATTENTION Be careful using the cfgClear command because it deletes the defined configuration. Table 12 summarizes commands that are useful for debugging zoning issues - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 80
switch where the command is run. 6. Enter the switchEnable command on each switch once the zoning configuration has been cleared. This forces the zones to merge and populates the switches with the correct zoning database. The fabrics will then merge. 66 Fabric OS Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 81
zone is set to "no access". Before the switch can join, the default zone setting has to be set to "all access". When the default zone no access option is enabled and the active configuration is disabled by using the cfgDisable command, a special hidden configuration with no members is activated - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 82
Checking for Fibre Channel connectivity problems Enter the fcPing command (refer to the Fabric OS Command Reference for more information on this command), which checks the zoning configuration for the two ports specified by: • Generates an ELS (Extended Link Service frame) ECHO request to the - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 83
. The defZone command sets the default zone access mode to No Access. switch:admin> defzone --show Default Zone Access Mode committed - No Access transaction - No Transaction See "Zone conflicts" on page 65 for additional information. Fabric OS Troubleshoot and Diagnostics Guide 69 53-1001340 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 84
information Gathering additional information Collect the data from a supportSave -n command. Then collect the data from the cfgTransShow command. For the port having the problem, collect the data from the filterPortShow command. 70 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 85
is not supported in the Brocade DCX or DCX-4S enterprise-class platforms. Symptom iSCSI host reports connection failed. Probable cause and recommended action Network connectivity is having problems. Verify the IP address using the portShow ipif /ge command. Verify the IP route using - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 86
Use the following commands to fix this issue: switch:admin> iscsiportcfg --modify iscsiswcfg -- command. Or the target is not compatible with fcLunQuery. Create a virtual target and add LUNs manually using the iscsiCfg command. Symptom Cannot get GE ports - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 87
The following issues address zoning problems that can occur in iSCSI. Symptom No DDSet or zoning configuration enabled and iSCSI host cannot discover any targets. Probable cause and recommended action Default zoning is set to no access. Check default zoning using the defZone --show command. Either - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 88
are not in the same zone as the targets. Check zoning using the cfgShow command. Make sure iSCSI virtual initiators are in the same zone as the targets. Display the port WWN of the iSCSI virtual initiators using the nsShow command. 74 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 89
the session Most information can be captured using the supportShow or supportSave commands and FTP'd off the switch, but when you are collecting information from commands, this information has to be captured using a Telnet client. Fabric OS Troubleshoot and Diagnostics Guide 75 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 90
and POST2 validates the ability of the device to pass data frames between the ports. The specific set of diagnostic and test commands run during POST depends on the switch model. You can use the diagDisablePost command to disable both POST1 and POST2, and you can reenable it using the diagEnablePost - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 91
,, INFO, Paulsa45, Initializing Ports... Enabling switch... 2005/03/31-20:13:13, [BL-1001], 222,, INFO, Paulsa45, Port Initialization Completed 2005/03/31 services are started and the boot process displays additional console status and progress messages. Fabric OS Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 92
. 2. Enter the diagEnablePost command to enable POST with rebooting the switch. switch:admin> diagenablepost Config update Succeeded Diagnostic POST is now enabled. Switch status Use the switchStatusShow command to display the overall status of the switch, including its power supplies, fans, and - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 93
) in the base fabric to carry traffic to this logical switch. Values are ON or OFF. Displays logical switch attributes, including the fabric ID (FID) associated with the logical switch and the switch role (default switch or base switch). Fabric OS Troubleshoot and Diagnostics Guide 79 53-1001340 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 94
support by GbE port. Information about the port. This section may be blank or display the WWN for an F_Port or an E_Port, the trunking state, or upstream or downstream status. The details displayed for each switch differ on different switch models. For more information see the switchShow command - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 95
Fabrics-mode is enabled, the command portTest is available only on the default switch. This test is not supported in the logical switch context. If Virtual Fabrics-mode is not enabled, then this command is available to the switch. Port information Use the following instructions to view information - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 96
for slot or port numbering, displaying IP interfaces on a GbE port, or displaying FCIP tunnel connection or configuration information. Displaying the port statistics 1. Connect to the switch and log in as admin. 2. At the command line, enter the portStatsShow command. Port statistics include - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 97
port errors for a switch 1. Connect to the switch and log in as admin. 2. Enter the portErrShow command. See the Fabric OS Command Reference for additional portErrShow command information. switch : 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 24: 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 25 Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 98
, refer to the switch hardware reference manual. The specific output from the status commands varies depending on the switch type. Checking the temperature, fan, and power supply 1. Log in to the switch as user. 2. Enter the sensorShow command. See the Fabric OS Command Reference for details - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 99
other internal error). If any of the power supplies show a status other than OK, consider replacing the power supply as soon as possible. For certain switch models, the OEM serial ID data displays after each power supply status line. Fabric OS Troubleshoot and Diagnostics Guide 85 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 100
. Refer to the hardware reference manual for your switch to determine the normal temperature range. System message log The system message, or RAS, log feature enables messages to be saved across power cycles and reboots. The Brocade 48000 director and the Brocade DCX and DCX-4S enterprise-class - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 101
separate from the system message log. The port log is typically used to troubleshoot device connections. Viewing the port log 1. Connect to the switch and log in as admin. 2. Enter the portLogShow command: switch:admin> portlogshow time task event port cmd args Fri Feb 22 16:48:45 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 102
logs for all or particular ports, without page breaks. Enable port logs for all or particular ports. Display port logs for all or particular ports, with page breaks. The portLogDump command output (trace) is a powerful tool that is used to troubleshoot fabric issues. The portLogDump output provides - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 103
20:29:32.639 PORT Tx 9 28 00300000,00000000,000005f4,00020182,00000000 9 40 02fffffd,00fffffd,09aaffff,14000000 Syslogd configuration The system logging daemon (syslogd) is an IP-based service for logging system messages made available by default on Unix and Linux operating - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 104
can then provide your customer support representative with the most detailed information possible. To ensure the best service, you should set up for automatic transfer as part of standard switch configuration, before a problem occurs. 90 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 105
For details on the commands, see the Fabric OS Command Reference. Specifying a remote server 1. Verify that the FTP service is running on the remote server. 2. Connect to the switch and log in as admin. 3. Enter the supportFtp -s command and respond to the prompts. Enabling the automatic transfer of - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 106
11 Automatic trace dump transfers 92 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 107
-port switch with switch limit 2 Gb 20-port embedded switch 4 Gb 256-port core fabric switch 2 Gb 24-port embedded switch 4 Gb 64-port 2 Gb 16-port embedded switch 4 Gb 32-port switch and FC Router 2 Gb 16/18-port embedded switch 4 Gb 32-port switch Fabric OS Troubleshoot and Diagnostics Guide 93 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 108
GoldenEye2 8 Gb 24-port embedded switch 76 8000 Condor2 8 Gb 16-FC port, 10 GbE 8-Ethernet port switch 77 Brocade DCX-4S Condor2 8 Gb 192-port core fabric backbone 83 7800 Condor2 8 Gb 16-FC ports, 6 GbE ports extension switch 94 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 109
a base of 16 to specify well-known addresses and port IDs. Example port number) = 06 00 = Port (ALPA) = 0 (not used in this instance, but is used in loop, NPIV, and Access Gateway devices) Result: hexadecimal triplet 610600 = decimal triplet 97,06,00 Fabric OS Troubleshoot and Diagnostics Guide - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 110
17 18 19 1a 1b 1c 1d 1e Decimal 31 32 33 34 35 36 37 38 39 40 Hex 1f 20 21 22 23 24 25 26 27 28 Decimal 41 42 43 44 45 46 47 48 49 50 Hex 29 179 180 Hex ab ac ad ae af b0 b1 b2 b3 b4 96 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 111
Hex f1 f2 f3 f4 f5 f6 f7 f8 f9 fa Decimal 251 252 253 254 255 Hex fb fc fd fe ff Fabric OS Troubleshoot and Diagnostics Guide 97 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 112
B Hexadecimal 98 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 113
portCfg, 71 portCmd, 71 portShow, 71 command output, 6 common problem areas, 2 symptoms, 2 configdownload fails, 3 configupload fails, 3 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 configuration download fails, 39 save to a host, 37 switch reboots during the download, 39 upload fails - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 114
on, 43 cannot upgrade directly to v6.0, 47 command fails, 3 firmware path is invalid, 42 firmwaredownload is already in progress, 44 gathering additional information, 45 non-disruptive firrmwaredownload, 47 server is inaccessible, 42 USB error handling, 45 Virtual Fabrics is enabled, 47 FL_Port, 19 - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 115
host and storage, 4 no connectivity between switches, 4 no light on LEDs, 4 NS, 22 nsShow, 72, 74 NTP, 1 O output from a console, 6 P passwords, recovering forgotten, 49 pathInfo, 15 performance problems, 4 PLOGI, 20 point-to-point initialization failure, 25 port bypassed, 26 disabled, 26 in wrong - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 116
, viewing, 78 switchType, 93 symptoms, 2 synchronize switches, 1 syslog messages, 4 T targets, 2 temperature, fan, and power supply, 84 temperature, status of, 86 test a port, 32 a switch, 32 TI zone problem, 63 time is not in-sync, 11 troubleshooting certificates, 51 corrupt certificate, 51 invalid - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 117
port information, 81 port log, 87 port status, 81 power supply status, 85 power-on self test, 76 switch status, 78 temperature status, 86 the system message log, 86 Virtual Fabrics E_Ports directly connecting two logical switches does not form, 56 firmwaredownload errors, 47 general troubleshooting - HP StorageWorks 8/8 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6 - Page 118
104 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01
53-1001340-01
28 July 2009
®
Fabric OS
Troubleshooting and Diagnostics Guide
Supporting Fabric OS v6.3.0