HP 8/24 Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100
HP 8/24 Manual
View all HP 8/24 manuals
Add to My Manuals
Save this manual to your list of manuals |
HP 8/24 manual content summary:
- HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 1
53-1001340-01 ® 28 July 2009 Fabric OS Troubleshooting and Diagnostics Guide Supporting Fabric OS v6.3.0 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 2
SAN , or service offered or Troubleshooting and Diagnostics Guide Fabric OS Troubleshooting and Diagnostics Guide Publication number 53-0000853-01 53-1001187-01 Fabric OS Troubleshooting and 53-1001340-01 Diagnostics Guide Summary of changes First released edition. Date March 2008 Added support - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 3
command output 6 Building a case for your switch support provider 6 Basic information 7 Detailed problem information 8 Gathering additional information 9 Chapter 2 General Issues In this chapter 11 Licensing issues 11 Fabric OS Troubleshoot and Diagnostics Guide iii 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 4
34 Reconciling a domain ID conflict 34 Configuration Issues In this chapter 37 Configupload and download issues 37 Gathering additional information 39 Brocade configuration form 40 FirmwareDownload Errors In this chapter 41 iv Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 5
56 Base switch issues 57 Logical switch issues 58 Switch configuration blade compatibility 59 Gathering additional information 60 ISL Trunking Issues In this chapter 61 Link issues 61 Buffer credit issues 62 Zone Issues In this chapter 63 Fabric OS Troubleshoot and Diagnostics Guide v 53 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 6
problems 68 Checking for zoning problems 69 Gathering additional information 70 iSCSI Issues In this chapter the port statistics 82 Displaying a summary of port errors for a switch 83 Equipment status 84 Checking the temperature, fan, Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 7
Enabling the automatic transfer of trace dumps 91 Setting up periodic checking of the remote server 91 Saving comprehensive diagnostic files to the server 91 Switch Type Hexadecimal Fabric OS Troubleshoot and Diagnostics Guide vii 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 8
viii Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 9
and procedures for configuration file issues. • Chapter 5, "FirmwareDownload Errors," provides procedures for troubleshooting firmware download issues. • Chapter 6, "Security Issues," provides procedures for user account and security issues. • Chapter 7, "Virtual Fabrics", provides procedures to - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 10
hardware and software In those instances in which procedures or parts of procedures documented here apply to some switches but not to others, this guide identifies exactly which switches are supported and which are not. Although many different software and hardware configurations are tested and - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 11
For readability, command names in the narrative portions of this guide are presented in mixed lettercase: for example, switchShow. In actual examples, command lettercase is often all lowercase. Otherwise, this manual specifically notes those cases in which a command is case sensitive. Command - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 12
used in this manual. They are specific to Brocade and Fibre Channel, see the Brocade Glossary. For definitions of SAN-specific terms, visit the Storage Networking Industry Association online dictionary at: http://www.snia.org/education/dictionary xii Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 13
• Switch model • Switch operating system version • Error numbers and messages received • supportSave command output • Detailed description of the problem, including the switch or fabric behavior immediately following the problem, and specific questions Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 14
troubleshooting steps already performed and the results • Serial console and Telnet session logs • syslog message logs 2. Switch Serial Number The switch of this document. However, if you find an error or an omission, or you think that a topic needs Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 15
1 In this chapter •Troubleshooting overview 1 •Most common problem areas 2 •Questions for common symptoms 2 •Gathering information for your switch support provider 5 •Building a case for your switch support provider 6 Troubleshooting overview This book is a companion guide to be used - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 16
the most common problem areas that arise within SANs and identifies tools to use to resolve them. TABLE 1 Common troubleshooting problems and tools Problem area Investigate Tools Fabric Storage Devices Hosts Storage Management Applications • Missing devices • Switch LEDs • Marginal links - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 17
Issues" FCR LSAN tags Chapter 2, "General Issues" FICON settings FICON Administrator's Guide FTP or SCP server or USB availability Firmware version compatibility Unsupported features enabled Firmware versions on switch Chapter 5, "FirmwareDownload Errors" Chapter 7, "Virtual Fabrics" FCR LSAN - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 18
Issues" Chapter 2, "General Issues" Chapter 6, "Security Issues" Chapter 8, "ISL Trunking Issues" Chapter 2, "General Issues" Chapter 3, "Connectivity Issues" Chapter 8, "ISL Trunking Issues" Chapter 9, "Zone Issues" Chapter 6, "Security Issues" 4 Fabric OS Troubleshoot and Diagnostics Guide 53 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 19
Document Chapter 6, "Security Issues" Chapter 7, "Virtual Fabrics" Chapter 9, "Zone Issues" Chapter 9, "Zone Issues" Chapter 9, "Zone Issues" Gathering information for your switch support provider If you are troubleshooting a production system, you must gather data quickly. As soon as a problem is - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 20
to your switch support provider when you are ready to contact them. Having this information immediately available will expedite the information gathering process that is necessary to begin determining the problem and finding a solution. 6 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 21
Inband Management installed on the switches GigE ports? Yes or no. User the portShow iproute geX command to switch? 7. Which CP blade was active? (Only applicable to the Brocade 48000 director, and the Brocade DCX and DCX-4S enterprise-class platforms.) Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 22
items as possible prior to contacting the SAN technical support vendor. Document the sequence of events by answering the following questions: • When did problem occur? • Is this a new installation? • How long has the problem been occurring? • Are specific devices affected? If so, what are their - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 23
require you to gather additional information. The additional information is necessary in order for your switch support provider to effectively and efficiently troubleshoot your issue. Refer to the chapter or document specified for the commands whose data you need to capture: • Configurations, see - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 24
1 Building a case for your switch support provider 10 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 25
cause and recommended action NTP is not set up on the switches in your fabric. Set up NTP on your switches in all fabrics in your SAN and metaSAN. For more information on setting up NTP, refer to the Fabric OS Administrator's Guide. Fabric OS Troubleshoot and Diagnostics Guide 11 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 26
them by working with the switch supplier. When encountering an MQ error, issue the supportSave command to capture debug information about the switch; then, forward the supportSave data to the switch supplier for further investigation. 12 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 27
. Generate and route an ECHO The FC-FC Routing Service enables you to route the ECHO generated when an fcPing command is issued on a switch, providing fcPing capability between two devices in different fabrics across the FC router. Fabric OS Troubleshoot and Diagnostics Guide 13 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 28
In addition, two Fibre Channel Extended Link Service (ELS) requests will be generated. The . On the edge Fabric OS switch, make sure that the source request. NOTE There are some devices that do not support the ELS ECHO request. In these cases, the Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 29
data stream travels between these ports, including all intermediate switches. ATTENTION Using the pathInfo command when exchange-based routing is turned on can provide different paths with each to the egress EX_Ports in the backbone. Fabric OS Troubleshoot and Diagnostics Guide 15 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 30
Errors - - - 0 Hop In Port Domain ID (Name) Out Port BW Cost 1 3 10 (web229) 12 1G 1000 Port B/s (1s) B/s (64s) Txcrdz (1s) Txcrdz (64s) F/s (1s) 3 12 Tx Rx Tx Rx 36 76 0 0 5 5 5 5 0 - 0 - 0 - 0 - 1 1 0 0 16 Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 31
0 0 Words 240434036 2294316 2119951 2121767 Frames 20025929 54999 162338 56710 Errors - 4 - 0 Hop In Port Domain ID (Name) Out more switch resources to process them. Use the enforce tag feature to prevent a backbone switch from Troubleshoot and Diagnostics Guide 17 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 32
2 18 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 33
. A Gigabit Ethernet switch port configured for an FCIP tunnel is called a VE port (virtual E-port). However, with a VEX_Port at the other end it does not propagate fabric services or routing topology information from one edge fabric to another. Fabric OS Troubleshoot and Diagnostics Guide 19 53 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 34
will still PLOGI and attempt PRLI with these devices. To display the contents of a switch's Name Server, use the nsShow or nsAllShow command. For more information about these name server commands, refer to Fabric OS Command Reference. 20 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 35
the current SFP with a known good working SFP. • Clean the optics. There are many kits on the market for cleaning fiber optics. You want to find a product that does not leave residue either from a lint-free wipe or from the solvent. Fabric OS Troubleshoot and Diagnostics Guide 21 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 36
failure" on page 25 as the next potential trouble spot. Checking the Name Server (NS) 1. Enter the nsShow command on the switch to determine if the device is attached: switch:admin> nsshow The Local Name Server has 9 entries { 22 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 37
this port and a list of the attached devices. 5. Check the port log to determine whether or not the device sent the FLOGI frame to the switch, and the switch probed the device. Fabric OS Troubleshoot and Diagnostics Guide 23 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 38
communicating to or through the switch. If the switchShow command or switch:admin> portcfgspeed Usage: portCfgSpeed PortNumber Speed_Level Speed_Level: 0 - Auto Negotiate 1 - 1Gbps 2 - 2Gbps 4 - 4Gbps 8 - 8Gbps ax - Auto Negotiate + enhanced retries 24 Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 39
log for all ports on the switch; or if you are looking for a specific port, enter the portLogDumpPort command switch:admin> portlogdumpport 4 time task event port cmd args 11:38:21.726 INTR pstate 4 AC 4. Skip over the loop initialization phase. Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 40
. If the opposite device is another switch, the port becomes an E_Port. If there is a problem with the host or target device, switch port, switch SFP, cable, edge device, and edge device SFP). Troubleshooting a marginal link can involve inspecting the error counters describe in "Troubleshooting - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 41
bad or damaged device in the path. • The disc_c3 errors are discarded class 3 errors, which means that the switch is holding onto the frame longer than the hold time allows. One problem this could be related to is ISL oversubscription. Fabric OS Troubleshoot and Diagnostics Guide 27 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 42
port is bad. Replace the port blade or switch. • If the loopback test did not problem still exists. • If the portErrShow output displays a normal number of generated errors, the issue is solved. • If the portErrShow output still displays a high number of generated errors, follow the troubleshooting - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 43
" (Trunk master) Pinpointing problems with device logins 1. Log in to the switch as admin. 2. Enter the switchShow command; then, check for state logins. 3. Enter the portCfgShow command to see if the port is configured correctly. Fabric OS Troubleshoot and Diagnostics Guide 29 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 44
log into the switch. To correct this type of problem, remove the Lock L_Port configuration using the portCfgDefault command. switch:admin> portcfgshow port that shares the same area. Error counters increment unexpectedly for the secondary port Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 45
basic testing of the switch circuit. If a structural test fails, replace the main board or port blade. • Functional tests verify the intended operational behavior of the switch by running frames through ports or bypass circuitry. Fabric OS Troubleshoot and Diagnostics Guide 31 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 46
and isolate problems to near-end terminal equipment, far-end terminal equipment, or transmission line. Diagnostics can be executed every day or on demand. Tests switch-to-switch ISL cabling and trunk group operations. The following procedures are for checking switch-specific components. Testing - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 47
• BB credit • PID format Reconciling fabric parameters individually 1. Log in to one of the segmented switches as admin. 2. Enter the configShow -pattern "fabric.ops" command. 3. Log in to another switch in the same fabric as admin. Fabric OS Troubleshoot and Diagnostics Guide 33 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 48
; connect to the conflicting switch in that fabric. 5. Enter the switchDisable command. 6. Enter the configure command. 7. When the Fabric Parameters prompt displays, type y. 8. When the Domain prompt displays, type in the new number. 34 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 49
switches have conflicting domain IDs. Example of setting the domain ID switch_89:FID89:admin> switchdisable switch_89:FID89:admin> configure Configure... Fabric parameters (yes, y, no, n): [no] y Domain: (1..239) [1] 89 WWN Based System services ( Troubleshoot and Diagnostics Guide 35 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 50
3 Segmented fabrics 36 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 51
Aug 15 15:13 support\ 106MB 2007 Aug 24 05:36 support1034\ 105MB 2007 Aug 23 06:11 config\ 0B 2007 Aug 15 15:13 firmware\ 380MB 2007 Aug 15 15:13 FW_v6.0.0\ 380MB 2007 Aug 15 15:13 Available space on usbstorage 74% Fabric OS Troubleshoot and Diagnostics Guide 37 53-1001340 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 52
to Services FTP service. User (10.255.252.50:(none)): userFoo 331 Please specify the password. Password: 530 Login incorrect. Login failed. If your login to the FTP or SCP server has failed, verify the username and password are correct. 38 Fabric OS Troubleshoot and Diagnostics Guide 53 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 53
or Role-Based Access Control. For more information on these types of restrictions, refer to the Fabric OS Administrator's Guide. • switch and from your computer when you are analyzing the problem. Send this and all logs to your switch support provider. Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 54
configuration form Use this form as a hard copy reference for your configuration information. In the hardware reference manuals for the Brocade 48000 and DCX modular switches there is a guide for FC port setting tables. The tables can be used to record configuration information for the various - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 55
for the commit operation to complete, issue the firmwareShow command to verify the partitions are synchronized, and reissue the firmwareDownload command. If the problem persists, you will need to contact the switch service provider. Fabric OS Troubleshoot and Diagnostics Guide 41 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 56
on the switch (or on the standby CP in director). In this case, you can enter the firmwareCommit command manually on the switch (or on to the switch. Verify with your network administrator that the switch has access to the FTP server. 42 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 57
the firmware doesn't support this platform. Please enter another firmware path. Cannot download on a switch with Interop mode turned on. Probable cause and recommended action On single CP, Interop fabric does not support Coordinated HotCode Load. Fabric OS Troubleshoot and Diagnostics Guide 43 53 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 58
problem persists, contact your switch support provider. Example of a firmwaredownload already in progress switch:admin> firmwaredownload Server Name or IP Address: 192.126.168.115 User Name: userFoo File Name: /users ENABLED. (error 3) 44 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 59
switch support provider. Make sure you identify what information was gathered before and after issuing the firmwareDownload command. USB error handling The following table outlines how the USB device handles errors under specific 6.3. Fabric OS Troubleshoot and Diagnostics Guide 45 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 60
on this switch is using or IP Address: 10.1.2.3 User Name: userfoo File Name system. Brocade DCX Extension blades are not supported on firmware v6.2.0 supported on firmware v6.1.1 or earlier, so the firmware download operation failed. 46 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 61
rule. Upgrade your switch to Fabric OS version v6.2.0 before upgrading to v6.3.0 Non-disruptive firmwaredownload is not supported when downgrading to 6.1. switches, delete the base switch, and disable Virtual Fabrics prior to downgrading the firmware. Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 62
action If the switch is running v6.2.0 or later, and IOD Delay value is configured for one or more domains, you cannot downgrade the switch to v6.1.0 or earlier. Use the iodDelayReset command to reset the IOD delay to its default value. 48 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 63
: passwd user passwd admin passwd factory 4. Enter the requested information at the prompts. Symptom Unable to log in as root password. Probable cause and recommended action To recover your root password, contact your switch service provider. Fabric OS Troubleshoot and Diagnostics Guide 49 53 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 64
default. How to recover boot PROM password? Contact your switch service provider and provide the recovery string. Refer to the Fabric OS Administrator's Guide for more information on setting the boot PROM password. How do I recover a user, admin, or factory password? Refer to "Password issues" on - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 65
, except the AUTH_NEGOTIATE ELS frame, are blocked by the switch. During this time, the Fibre Channel driver rejects all other ELS frames. The F_Port will not form data for your switch support provider. • Perform a supportSave -n command. Fabric OS Troubleshoot and Diagnostics Guide 51 53-1001340 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 66
correctly for your network. If you continue to have problems, collect the data in the next section and contact your switch support provider. Gathering additional information In addition to supportSave, by the random number generator. 52 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 67
results. If the tests fail on your switch it will constantly reboot. Because boot PROM access is disabled you will not be able to exit out of the reboot. You will need to send the switch back to your switch service provider for repair. Fabric OS Troubleshoot and Diagnostics Guide 53 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 68
6 FIPS issues 54 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 69
Virtual Fabrics Chapter 7 In this chapter •General Virtual Fabric troubleshooting 55 •Fabric identification issues 56 •Logical Fabric issues 56 •Base switch issues 57 •Logical switch issues 58 •Switch configuration blade compatibility 59 General Virtual Fabric troubleshooting All of the - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 70
that has XISL use turned on. Although VE_Ports are allowed in a base switch, Fabric OS v6.2.0 and later do not support the use of VE_Ports to carry traffic for logical fabrics using XISLs the LISL using the lfCfg --lislenable command. 56 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 71
. Probable cause and recommended action Only one base switch is allowed on a platform. Use the lsCfg --delete FID command and then the lsCfg --create FID -b base command to remove the current base switch and then create a new one. Fabric OS Troubleshoot and Diagnostics Guide 57 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 72
when attempting to move ports on a Condor-based blade into a non-default switch. To determine if you have a Condor-based blade, refer to the Fabric OS Administrator's Guide. Symptom Validation of switch configuration changes is not supported on this platform. Probable cause and recommended action - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 73
-18i, both GE and FC, are automatically moved to the default switch. Use the lsCfg -config command to correct the problem. Once the configuration discrepancy has been fixed, you may use slotPowerOff followed by slotPowerOn to recover. Fabric OS Troubleshoot and Diagnostics Guide 59 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 74
the supportSave command on all chassis and logical switches in the fabric. • If you think it may be related to E_Port authentication, then perform the supportSave -n command on both switches or logical switches of the affected E_Port. 60 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 75
command displays the possible reason that two ports cannot be trunked. Possible reasons are: • The switch does not support trunking. • A trunking license is required. • Trunking is not supported in switch interoperability mode. Fabric OS Troubleshoot and Diagnostics Guide 61 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 76
switch with which you want to communicate. • The ports are not the same speed or they are not set to an invalid speed. Manually set port speeds to a speed supported on port or switch by issuing the commands portDisable and portEnable. 62 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 77
Zone Issues Chapter 9 In this chapter •Overview of corrective action 63 •Segmented fabrics 64 •Zone conflicts 65 •Gathering additional information 70 Overview of corrective action The following overview provides a basic starting point for you to troubleshoot your zoning problem. 1. Verify that - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 78
section discusses fabric segmentation. Fabric segmentation occurs when two or more switches are joined together by ISLs and do not communicate to each other. Each switch appears as a separate fabric when you use the fabricShow command. 64 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 79
Use to create a zone alias. Use to delete a zone alias. Use to create a zone configuration. Displays zoning configuration. Disables the active (effective) configuration Fabric OS Troubleshoot and Diagnostics Guide 65 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 80
command is run. 6. Enter the switchEnable command on each switch once the zoning configuration has been cleared. This forces the zones to merge and populates the switches with the correct zoning database. The fabrics will then merge. 66 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 81
configuration for the segmented switch (see Table 12 on page 65 for specific commands. If the zoneset members between two switches are not listed for both switches is the same. Arrange zone members in alphabetical order, if possible. Fabric OS Troubleshoot and Diagnostics Guide 67 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 82
the request: switch:admin> fcping 0x020800 22:00:00:04:cf:75:63:85 Source: 0x20800 Destination: 22:00:00:04:cf:75:63:85 Zone Check: Zoned Pinging 0x020800 with 12 bytes of data: received reply from 0x020800: 12 bytes time:1159 usec 68 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 83
that the problem is being 2. Confirm that the specific edge devices that must communicate switch:admin> defzone --show Default Zone Access Mode committed - No Access transaction - No Transaction See "Zone conflicts" on page 65 for additional information. Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 84
information Gathering additional information Collect the data from a supportSave -n command. Then collect the data from the cfgTransShow command. For the port having the problem, collect the data from the filterPortShow command. 70 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 85
supported in the Brocade DCX or DCX-4S enterprise-class platforms. Symptom iSCSI host reports connection failed. Probable cause and recommended action Network connectivity is having problems interpreted by the shell. switch:admin> portcmd --ping Troubleshoot and Diagnostics Guide 71 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 86
: switch:admin> iscsiswcfg --disableconn -s Symptom iSCSI host can log in to targets, but cannot mount any compatible with fcLunQuery. Create a virtual target and add LUNs manually using the iscsiCfg command. Symptom Cannot get GE ports to Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 87
The following issues address zoning problems that can occur in to force the commit operation, in which case uncommitted changes on other switches are erased. Symptom No DDSet or zoning configuration enabled and iSCSI host committed. Fabric OS Troubleshoot and Diagnostics Guide 73 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 88
initiators are in the same zone as the targets. Display the port WWN of the iSCSI virtual initiators using the nsShow command. 74 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 89
installed into a director chassis. • Manually using Fabric OS CLI commands. The error messages generated during these test activities switch, but when you are collecting information from commands, this information has to be captured using a Telnet client. Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 90
do not require user input to function. They typically operate within several minutes, and support minimal validation because between the ports. The specific set of diagnostic and test commands run during POST depends on the switch model. You can use Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 91
/31-20:13:13, [BL-1000], 221,, INFO, Paulsa45, Initializing Ports... Enabling switch... 2005/03/31-20:13:13, [BL-1001], 222,, INFO, Paulsa45, Port services are started and the boot process displays additional console status and progress messages. Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 92
reboot is not required for this command to take effect. 1. Connect to the switch and log in with a user account that has admin privileges with the chassis-role permission. 2. Enter the HEALTHY Marginal ports monitorHEALTHY 78 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 93
) in the base fabric to carry traffic to this logical switch. Values are ON or OFF. Displays logical switch attributes, including the fabric ID (FID) associated with the logical switch and the switch role (default switch or base switch). Fabric OS Troubleshoot and Diagnostics Guide 79 53-1001340 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 94
. The port status. Protocol support by GbE port. Information about switch 1. Connect to the switch and log in as admin. 2. Enter the uptime command: ecp:admin> uptime 10:50:19 up 11 days, 6:28, 1 user switches until the test stops them. 80 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 95
switch. This test is not supported in the logical switch context. If Virtual Fabrics-mode is not enabled, then this command is available to the switch. Port information Use the following instructions to view information about ports and to help diagnose if your switch is experiencing port problems - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 96
1. Connect to the switch and log in as admin error outside of frames Invalid ordered set Class 3 frames discarded due to timeout Class 3 frames discarded due to destination Other discards frames with FTB type 1 miss frames with FTB type 2 miss 82 Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 97
summary of port errors for a switch 1. Connect to the switch and log in as : 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 29: 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 30: 664k 6.7k 0 0 0 0 0 0 6 0 0 1 2 0 0 31: 12 4 0 0 0 0 0 0 3 0 0 1 2 0 0 (output truncated) Fabric OS Troubleshoot and Diagnostics Guide 83 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 98
depends on the switch type. For detailed specifications on these components, refer to the switch hardware reference manual. The specific output from the status commands varies depending on the switch type. Checking the temperature, fan, and power supply 1. Log in to the switch as user. 2. Enter the - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 99
or other internal error). If any of the power supplies show a status other than OK, consider replacing the power supply as soon as possible. For certain switch models, the OEM serial ID data displays after each power supply status line. Fabric OS Troubleshoot and Diagnostics Guide 85 53-1001340 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 100
might occur. Refer to the hardware reference manual for your switch to determine the normal temperature range. System Switch10, Switch status changed from HEALTHY to DOWN. For details on error messages, see the Fabric OS Message Reference. 86 Fabric OS Troubleshoot and Diagnostics Guide 53 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 101
error message displays. NOTE Port log functionality is completely separate from the system message log. The port log is typically used to troubleshoot device connections. Viewing the port log 1. Connect to the switch 0000001c,00000000 Fabric OS Troubleshoot and Diagnostics Guide 87 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 102
service or FC_4 upper level protocol. There are many different payload formats based on the protocol. Because a portLogDump output is long, a truncated example is presented: switch:admin 00fffffd,00fffffd,00000000,00000000, 00000000 88 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 103
daemon (syslogd) is an IP-based service for logging system messages made available switch Configuring the switch involves specifying syslogd hosts and, optionally, setting the facility level. You can also remove a host from the list of syslogd hosts. Fabric OS Troubleshoot and Diagnostics Guide - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 104
can then provide your customer support representative with the most detailed information possible. To ensure the best service, you should set up for automatic transfer as part of standard switch configuration, before a problem occurs. 90 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 105
server becomes unavailable and you can correct the problem. After the setup is complete, you can data and other diagnostic support information to the server without the FTP service is running on the remote server. 2. Connect to the switch and log Troubleshoot and Diagnostics Guide 91 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 106
11 Automatic trace dump transfers 92 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 107
-port switch with switch limit 2 Gb 20-port embedded switch 4 Gb 256-port core fabric switch 2 Gb 24-port embedded switch 4 Gb 64-port 2 Gb 16-port embedded switch 4 Gb 32-port switch and FC Router 2 Gb 16/18-port embedded switch 4 Gb 32-port switch Fabric OS Troubleshoot and Diagnostics Guide 93 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 108
8 Gb 24-port embedded switch 76 8000 Condor2 8 Gb 16-FC port, 10 GbE 8-Ethernet port switch 77 Brocade DCX-4S Condor2 8 Gb 192-port core fabric backbone 83 7800 Condor2 8 Gb 16-FC ports, 6 GbE ports extension switch 94 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 109
hex, is a numeral system with a base of 16, usually written using unique symbols hexadecimal triplet: Ox616000 Notice the PID in the nsshow output is in hexadecimal. Switch:admin> nsshow { Type Pid COS PortName NodeName TTL(sec) N 610600; Troubleshoot and Diagnostics Guide 95 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 110
Decimal 171 172 173 174 175 176 177 178 179 180 Hex ab ac ad ae af b0 b1 b2 b3 b4 96 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 111
Hex f1 f2 f3 f4 f5 f6 f7 f8 f9 fa Decimal 251 252 253 254 255 Hex fb fc fd fe ff Fabric OS Troubleshoot and Diagnostics Guide 97 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 112
B Hexadecimal 98 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 113
, 71 portCmd, 71 portShow, 71 command output, 6 common problem areas, 2 symptoms, 2 configdownload fails, 3 configupload fails, 3 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01 configuration download fails, 39 save to a host, 37 switch reboots during the download, 39 upload fails, 37 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 114
zoning problems, 69 support, 5 H host connection failure, 71 iSCSI log out, 74 host application times out, 17 hosts, 2 HTTPS, 51 I I2C bus errors, 13 identifying media-related issues, 31 inaccurate information in the system message log, 12, 17 intermittent connectivity, 3 100 Fabric OS Troubleshoot - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 115
any targets, 73 host cannot mount any disks, 72 host connection between host and storage, 4 no connectivity between switches, 4 no light on LEDs, 4 NS, recovering forgotten, 49 pathInfo, 15 performance problems, 4 PLOGI, 20 point-to-point Troubleshoot and Diagnostics Guide 101 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 116
retry errors, 4 timeout errors, 4 problem, 63 time is not in-sync, 11 troubleshooting certificates, 51 corrupt certificate, 51 invalid certificate, 51 trunk bounces, 4 failed to form, 4 trunk goes offline and online (bounces), 62 U U_Port, 19 user forgot password, 4 user is unable to change switch - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 117
Fabrics E_Ports directly connecting two logical switches does not form, 56 firmwaredownload errors, 47 general troubleshooting, 55 Virutal Fabrics FID is mismatch, 5 resolving conflicts, 65 troubleshooting, 65 type mismatch, 5 Fabric OS Troubleshoot and Diagnostics Guide 103 53-1001340-01 - HP 8/24 | Brocade Fabric OS Troubleshooting and Diagnostics Guide v6.3.0 (53-100 - Page 118
104 Fabric OS Troubleshoot and Diagnostics Guide 53-1001340-01
53-1001340-01
28 July 2009
®
Fabric OS
Troubleshooting and Diagnostics Guide
Supporting Fabric OS v6.3.0