Cisco SFS-7012 User Guide

Cisco SFS-7012 - SFS InfiniBand Server Switch 7012 Manual

Cisco SFS-7012 manual content summary:

  • Cisco SFS-7012 | User Guide - Page 1
    Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Text Part Number: OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 2
    if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation relationship between Cisco and any other company. (0609R) Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Copyright © 2006 Cisco Systems, Inc
  • Cisco SFS-7012 | User Guide - Page 3
    xiii Cisco Technical Support & Documentation Website xiii Submitting a Service Request xiv Definitions of Service Request Severity xiv Obtaining Additional Publications and Information xiv Product Overview 1 SFS 7012 Feature Set 1 Strategic Benefits 1 Key Design Features 1 SFS 7012 Product
  • Cisco SFS-7012 | User Guide - Page 4
    Contents InfiniBand General Services Managers and Agents 6 SNMP Support 7 SNMP SFS 7012 Component LEDs 34 SFS 7012 Leaf and Spine Module LEDs 35 Accessing On-line Help 37 Shutdown Procedures 38 Rebooting Components from Chassis Viewer 38 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide
  • Cisco SFS-7012 | User Guide - Page 5
    41 Chassis Viewer 41 The Chassis Viewer Manages 41 Home Page 42 ? (Help) Button 42 Support Button 42 Displaying the Leaf and Spine Module Views 43 Leaf Module View 43 Spine Module View 59 Filter Status 62 Setting Community Strings 63 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iii
  • Cisco SFS-7012 | User Guide - Page 6
    Chassis Traps 64 SFS 7012 Port Statistics 67 Port Statistics Field Descriptions 68 Leaf and Spine Module IB Port Statistics 70 Leaf Modules 70 Spine Modules 70 Set Field Thresholds 71 Time Service 73 Configuring the 92 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide iv OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 7
    RJ45 Port 96 Problem 96 Fix 96 SFS 7012 Leaf Module IB Ports 96 Problem 96 Fix 96 Troubleshooting Scenarios 97 InfiniBand 97 Invalid IP Address entered for SWC via Console Port 97 Bad IB Cable 97 Improperly Seated IB Cable 97 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide v OL-8787
  • Cisco SFS-7012 | User Guide - Page 8
    Contents Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide vi OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 9
    supported SFS 7012 release. Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Feature Description Initial release of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Changed in Release Where Documented OL-8787-04 Cisco SFS 7012
  • Cisco SFS-7012 | User Guide - Page 10
    Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide (continued) Feature Redundant Management Description Changed in Release Added redundant management information. 3.3 Where Documented Installing the Spine and Leaf Modules, page 2-26 Updating
  • Cisco SFS-7012 | User Guide - Page 11
    information for configuring and monitoring the SFS 7012 SFS 7012 technical specifications Reference information for the SFS 7012 command line interface (CLI) Troubleshooting symptoms and resolutions for the SFS 7012 OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide ix
  • Cisco SFS-7012 | User Guide - Page 12
    : • Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 • Cisco SFS 7012 InfiniBand Server Switch Release Notes for Cisco Releases • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide • Cisco SFS 7012 InfiniBand Server Switch Installation and Configuration Note
  • Cisco SFS-7012 | User Guide - Page 13
    Cisco products • Register to receive security information from Cisco A current list of security advisories, security notices, and security responses for Cisco products is available at this URL: http://www.cisco.com/go/psirt OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide
  • Cisco SFS-7012 | User Guide - Page 14
    user. (To register as a Cisco.com user, go to this URL: http://tools.cisco.com/RPF/register/register.do) Registered users can access the tool at this URL: http://tools.cisco.com/Support/PAT/do/ViewMyProfiles.do?local=en Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xii OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 15
    box and then click the Technical Support & Documentation radio button. To provide feedback about the Cisco.com website or a particular technical document, click Contacts & Feedback at the top of any Cisco.com web page. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiii
  • Cisco SFS-7012 | User Guide - Page 16
    newsletters and other communications. Create a profile and then select the subscriptions that you would like to receive. To visit the Cisco Online Subscription Center, go to this URL: http://www.cisco.com/offer/subscribe Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xiv OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 17
    at this URL: http://www.cisco.com/univercd/cc/td/doc/abtunicd/136957.htm • World-class networking training is available from Cisco. You can view current offerings at this URL: http://www.cisco.com/en/US/learning/index.html OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xv
  • Cisco SFS-7012 | User Guide - Page 18
    Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide xvi OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 19
    availability, and serviceability (RAS) features. Leveraging InfiniBand (IB) - an industry-standard interconnect - the SFS 7012 provides high performance for InfiniBand (4X) • SDR and DDR support • Embedded system management OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 1
  • Cisco SFS-7012 | User Guide - Page 20
    SFS 7012 Product Specifications Mechanical/Thermal/Power Specifications • 7U - 19" rack mount environment • Integrated thermal management • Front-to-back module enclosure • Available power (all copper): 745 Watts max Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 2 Chapter OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 21
    IP address • Manage and monitor log files, including: - Set debug levels determining the amount of information to be logged - Reset the logs OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 3
  • Cisco SFS-7012 | User Guide - Page 22
    Chapter - Perform maintenance tasks - Manage firmware updates, including uploading new firmware and setting the active version. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 4 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 23
    and running, the InfiniBand General Services Managers (GSMs) begin to interface with General Services Agents (GSAs). Subnet Management Subnet SFS 7012 Switch, a Subnet Management Agent (SMA) is implemented within its firmware. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide
  • Cisco SFS-7012 | User Guide - Page 24
    up and running, the InfiniBand General Services Managers begin to interface with General Services Agents. The General Services Managers and Agents include: • Subnet Administration (PM) and Performance Management Agent (PMA) Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 6 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 25
    : MIBs from the CMU of the SFS 7012 provide status information regarding the physical environment of the switch. Additionally, the CMU MIBs provide status and activity information for all line cards residing in the switch. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 7
  • Cisco SFS-7012 | User Guide - Page 26
    Chapter Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 8 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 27
    page 2-22 • Hot Swapping Components, page 2-39 Note Before you install, operate, or service the system, read the Regulatory Compliance and Safety Information for the Cisco SFS 7012 and 7024 for important safety information. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 9
  • Cisco SFS-7012 | User Guide - Page 28
    that accompanied this device. Statement 1071 SAVE THESE INSTRUCTIONS Warning This unit is intended for installation in restricted should be allowed to install, replace, or service this equipment. Statement 1030 Warning A readily . Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 10 OL
  • Cisco SFS-7012 | User Guide - Page 29
    produktet krever beskyttelse mot kortslutninger (overspenninger) som en del av installasjonen. Bare installer utstyret i henhold til nasjonale og lokale krav til ledningsnett. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 11
  • Cisco SFS-7012 | User Guide - Page 30
    . Advarsel Dette produkt kræver beskyttelse mod kortslutning (overstrøm). Dette skal være en del elinstallationen i bygningen. Installation skal ske i overensstemmelse med nationale og lokale ledningsregler. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 12 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 31
    ón del equipo debe cumplir con las normativas de electricidad locales y nacionales. Varning! Installation av utrustningen måste ske i enlighet med gällande elinstallationsföreskrifter. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 13
  • Cisco SFS-7012 | User Guide - Page 32
    DC power terminals. Always replace cover when terminals are not in service. Be sure uninsulated conductors are not accessible when cover is in condutores sem isolamento não estão acessíveis, quando a tampa estiver colocada. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 14 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 33
    . Humidity Power supplies use the air inside the chassis and exhaust out the front of the chassis. 5% to 85% relative humidity (noncondensing). OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 15
  • Cisco SFS-7012 | User Guide - Page 34
    19-inch equipment rack or server rack. The SFS 7012 switch is designed for a four-post server cabinet. It is not designed for a two-post telco cabinet. Racks should conform the 2" connector stand-off from the panel surface. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 16 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 35
    Chapter Figure 2-3 Bend Radius Measurement Diagram • Support cable using a cable manager mounted above connectors to avoid unnecessary weight on the cable Whether or not the UPS unit also provides online protection. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 17
  • Cisco SFS-7012 | User Guide - Page 36
    packing slip. Mark the rack and install the mounting rails. Physically install the switch in the rack. Install IB cables between the SFS 7012 and other IB-enabled network . Warning Potential for personal injury. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 18 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 37
    one extended component could cause the rack to tip over. Warning Do not step on or stand on any component when servicing other components in a rack. Warning The chassis, when fully populated with high voltage components. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 19
  • Cisco SFS-7012 | User Guide - Page 38
    when all operating instructions have been followed. - The unit exhibits a distinct change in performance, indicating a need for service. Tools and Equipment Required • An ESD wrist strap • A #2 Phillips screwdriver • Pen (felt-tip) to mark the mounting holes Cisco SFS 7012 InfiniBand Server Switch
  • Cisco SFS-7012 | User Guide - Page 39
    any problems to the shipping company. Verify that the equipment serial numbers match those on the packing slip. Resolve any issues with incorrect serial numbers or missing/incorrect parts before installing the equipment. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 21
  • Cisco SFS-7012 | User Guide - Page 40
    the Rails in the Rack Note The front flange (chassis fan side) of the rail has 3 holes. The back flange of the rail (chassis leaf module side) has two holes, which correspond to the bottom two holes on the front flange. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 22 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 41
    the rack by installing one screw into the top hole of each rail. Figure 5 Rail Front Flange Install 2 screws to top and bottom holes Install the second rail on the other side of the rack by repeating steps 1 through 3. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 23
  • Cisco SFS-7012 | User Guide - Page 42
    or three (3) people install the SFS 7012. To install the switch into the rack, perform the following steps: Step trays. These handles are not designed to support the weight of the SFS 7012. Step 4 Tighten the screw on the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 24 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 43
    Chapter Figure 7 Secure Chassis to Rack Install 1 screw and caged nut into each hole above and below the handle Step 6 Using two screws and chassis Installing the Switch Face Plate To install the switch face plate(s): OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 25
  • Cisco SFS-7012 | User Guide - Page 44
    spine module(s) be installed into: - Slot 1 for managed. For redundant management, populate slots 1 and 2 with management-capable spines. - Slot 3 for unmanaged. Refer to Figure 2-9 below: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 26 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 45
    with slot 1, then slot 2, then slots 3 through 12 respectively. Refer to Figure 2-10: Figure 2-10 SFS 7012 Chassis - Leaf Module Slot Numbering Leaf 11 Leaf 12 Leaf 9 Leaf 10 Leaf 7 Leaf 5 Leaf 3 the power supplies). OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 27
  • Cisco SFS-7012 | User Guide - Page 46
    2 Connect a Category 5 or 6 (Cat 5/6) Ethernet cable to one of the RJ-45 connectors on the SFS 7012. Connect the other end of the Cat 5/6 to the OOB LAN workstation. Refer to Figure 2-12 for which the IB cable connector. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 28 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 47
    , power supply, and fan LEDs light up. Bringing Up the System For the First Time Start-up Procedures Step 1 Power up the SFS 7012. Step 2 From its flash image on the CMU spine module, the switch begins its boot process. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 29
  • Cisco SFS-7012 | User Guide - Page 48
    serial cables to the RS-232 ports of the SFS 7012. If using a terminal emulation device, the settings should be: - 8 data bits - no parity bits - 1 stop bit - 56K baud - Use VT100 emulation. - Flow control = XON/XOFF Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 30 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 49
    the new subnet mask in dotted decimal (i.e., xxx.xxx.xxx.xxx) format. To change the SFS 7012 default gateway IP address enter: setDefaultRoute -h ipaddress where -h ipaddress is the new default gateway , do the following: OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 31
  • Cisco SFS-7012 | User Guide - Page 50
    system on device /rfa1. (size=2097152 bytes) Unified Boot Manager [1] image1 [2] image2 CPU: Broadcom BCM1125 VxWorks Version: 5.4 [boot]: Unified Boot Manager For The T3 Platform. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 32 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 51
    Image Information: Product = SFS7012 BSP = t3 Version = 3.3.0.0.4 Compressed Image Size = 3616523 bytes md5 = 46086777be1b5bae45140a440425b915 vxWorks Image Type = loadable Computed md5 = 46086777be1b5bae45140a440425b915 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 33
  • Cisco SFS-7012 | User Guide - Page 52
    OOB LAN. The home page displays the front and back views of the SFS 7012 switch. SFS 7012 Component LEDs Chassis Status LED The chassis status LED is Green when the system are present. • No functional leaves are present. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 34 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 53
    at less than 4000 RPM or greater than 10950 RPM. • Red indicates a possible problem, including: - The fan tray is not responding to commands for configuration and temperature-related (port is in the Initialization state). OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 35
  • Cisco SFS-7012 | User Guide - Page 54
    Each SFS 7012 spine module has three management LEDs: • Capable: - Green indicates that the spine slot supports management. - Off indicates that the spine slot does not support management at DDR speeds (i.e., SDR only). Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 36 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 55
    topical information with textual references to more detailed information within the documentation. A sample on-line help screen is shown in Figure 2-16: OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 37
  • Cisco SFS-7012 | User Guide - Page 56
    be rebooted, or select the Reboot Entire Chassis radio button to reboot the SFS 7012 chassis and all spines. Click Reboot. Rebooting Multiple Managed Spines In a redundant , SSH, or through the SFS 7012 RS232 serial ports. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 38 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 57
    managed spine to be hot swapped is a that same firmware level as all other components in the SFS 7012. A hot swap of a managed spine with another firmware level will cause a disruptive reboot (i.e., will begin to close. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 39
  • Cisco SFS-7012 | User Guide - Page 58
    re-engage the unit. Tighten the captive panel screw. Hot Swapping Power Supplies The SFS 7012 switch requires a minimum of three power supplies for normal operation. Power supplies can be . Tighten the captive panel screw. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 40 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 59
    the Chassis Viewer, point a browser to the IP address of the SFS 7012. The Chassis Viewer Manages • The SFS 7012 chassis. • Each SFS 7012 leaf module. • Each SFS 7012 spine module. • Logging and monitoring functionality. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 41
  • Cisco SFS-7012 | User Guide - Page 60
    help. Each help screen gives the user a high-level, topic-specific description. Support Button Figure 3-3 Support Button The Support button displays key contact information for support, displayed in the following window: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 42 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 61
    Chapter Figure 3-4 Support Contact Screen Displaying the Leaf and Spine Module Views Leaf Module View To display the leaf module view for the SFS 7012: Step 1 Mouse over the leaf module to module view will be displayed. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 43
  • Cisco SFS-7012 | User Guide - Page 62
    Module View Chapter Spine Module View To display the spine module view for the SFS 7012: Step 1 Mouse over the spine module to display. The edges of the The Component Details Area contains three areas. • Details Header Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 44 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 63
    leaf and spine Details Header allows the user to execute the most common tasks for the SFS 7012 switch: • Display the Home page • View field-replaceable unit (FRU) information. • display the chassis view for the SFS 7012: OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 45
  • Cisco SFS-7012 | User Guide - Page 64
    are highlighted green as shown in Figure 3-12 below: Figure 3-12 Spine Module Chassis Mouseover Left click the mouse. The chassis view will be displayed. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 46 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 65
    Details Header Rebooting Components from Chassis Viewer Step 1 From the Chassis Details header, click Reboot. A screen similar to the following is displayed. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 47
  • Cisco SFS-7012 | User Guide - Page 66
    Step 2 Step 3 Step 4 Access the master spine CLI via Telnet, SSH, or through the SFS 7012 RS232 serial ports. The system prompts for a user name. At the prompt enter: admin The system to the CLI following the reboot. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 48 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 67
    for chassis status, chassis SMA, fan and power supplies. • Slot-based temperature and AC-power sensor data for the internal switching complex. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 49
  • Cisco SFS-7012 | User Guide - Page 68
    either spine, the next reboot will be treated as disruptive. System Uptime The elapsed time since the last time switch was re-initialized. System Contact Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 50 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 69
    includes the following items: Description A description of the component, assigned by an administrator. Status Displays the status of the component. Part Num OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 51
  • Cisco SFS-7012 | User Guide - Page 70
    which is applicable to the existing network environment. To save, click the Apply button at the bottom of the screen. Figure 3-18 System Information Area Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 52 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 71
    Menu Logging The Chassis View Menu allows the user to execute all configuration and operation tasks available for the SFS 7012 switch. The Logging submenu allows the user to set and reset levels for the message log file. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 53
  • Cisco SFS-7012 | User Guide - Page 72
    button allows the user to set log level configuration parameters for all software modules on the SFS 7012. To set log levels: Step 1 From the menu, select Logging. Step 2 From , which displays a configuration screen: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 54 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 73
    user should immediately contact the supplier's technical support. - ALARM - Indicates that a serious problem has occurred which degrades capacity or service. If the error is recoverable, the does not need to take action. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 55
  • Cisco SFS-7012 | User Guide - Page 74
    care should be taken to ensure that system performance issues are weighed against troubleshooting requirements. Generally, the higher the debug number the more information is written the Submit button to save any changes. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 56 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 75
    the logging levels: Step 1 Step 2 Step 3 From the menu, select Logging. Click Logging. Click Reset Levels. The Reset Levels window is displayed: OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 57
  • Cisco SFS-7012 | User Guide - Page 76
    The Firmware Update button allows the user to select an alternate firmware file for the SFS 7012. These alternate files are reflected in the drop-down lists in the Firmware Update server where the firmware files reside. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 58 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 77
    the Target Configuration window: Step 1 Step 2 Step 3 From the menu, select SNMP. Select Target Configuration. The SNMP Target Configuration window is displayed: OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 59
  • Cisco SFS-7012 | User Guide - Page 78
    the IP address, the last 4 make up the port number. For example, specify 0xc0:a8:00:65:00:a2 for 192.168.0.101 Port: 162. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 60 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 79
    used in the event a trap is generated by the system. Toggling a trap to not in service, which temporarily suspends trap forwarding, may be useful to keep values intact. SNMP Target Parameters: SNMP messages for entry. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 61
  • Cisco SFS-7012 | User Guide - Page 80
    in service, which temporarily suspends trap forwarding, may be useful to keep values intact. Filter Status The SNMP Filter Status screen allows the user to view parameters for rfc2273 (SNMP-NOTIFICATION-MIB). Figure 3-33 Filter Status Button To view SNMP filter status: Cisco SFS 7012 InfiniBand
  • Cisco SFS-7012 | User Guide - Page 81
    Strings Button To set the Community Strings: Step 1 Click SNMP Step 2 Click Set Community Strings. The Set Community Strings screen is displayed. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 63
  • Cisco SFS-7012 | User Guide - Page 82
    The Chassis Trap Control screen allows the user to set default trap scenarios related to SFS 7012. Figure 3-37 Chassis Trap Control Step 1 Step 2 Step 3 Click Chassis. Click trap, click the applicable Gen Trap button. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 64 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 83
    . icsChassisTrapSystemMgmtSrvcAborted This trap indicates that the internal service used to support the management of the chassis has terminated abnormally rebooting. Power Group icsChassisTrapPowerSupplyNotResponding OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 65
  • Cisco SFS-7012 | User Guide - Page 84
    to HEARTBEAT poll requests, that are issued by the internal chassis management service. icsChassisTrapFanTrayInserted This trap indicates that a fan was inserted into the encountered when reading the EEPROM of the fan tray. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 66 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 85
    provides IB port information for all of the external and internal ports of the SFS 7012. Figure 3-39 IB Port Statistics To view port statistical information, do the following spine module 2, switch chip A and leaf module 8. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 67
  • Cisco SFS-7012 | User Guide - Page 86
    The supported link speed of the port. This could be 2.5Gbps (SDR), 5.0Gbps (DDR) or both. InfiniBand Statistics: Transmit 32 Bit Words: The number of 32-bit data words transmitted by the port, not including flow control and VCRC data. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 68
  • Cisco SFS-7012 | User Guide - Page 87
    support an advanced InfiniBand feature for logically partitioning a physical subnet into logical access domains. Raw Violations Inbound: Number of times raw inbound packet discarded. Raw Violations Outbound: Number of times raw outbound packet was discarded. OL-8787-04 Cisco SFS 7012 InfiniBand
  • Cisco SFS-7012 | User Guide - Page 88
    displayed. Step 2 From the Spine Port Stats menu, select IB Port Stats. Figure 3-43 Spine Port Stats Menu The spine port statistics window is displayed: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 70 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 89
    ports on the SFS 7012. Figure 3-45 Set Field Thresholds To change error reporting thresholds, do the following: Step 1 Click on Port Stats. Step 2 Click on Set Field Thresholds. The Set Field Thresholds screen is displayed: OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 71
  • Cisco SFS-7012 | User Guide - Page 90
    The threshold for the number of data packets transmitted by the port. portRecvPktsThresh The threshold for the number of data packets received by the port. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 72 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 91
    threshold for the number of excessive buffer overrun errors on the port. Time Service The System Time Information screen allows the user to set the system time using either network time protocol (NTP) or manual overrides. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 73
  • Cisco SFS-7012 | User Guide - Page 92
    the system time: Step 1 From the menu, click Time Service. Step 2 Click Set System Time. The System Time Information screen . To save, click on Apply. Figure 3-49 Time Service - NTP Setup To manually set the system time: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 74 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 93
    well as Hour, Minute, Seconds, and AM/PM. To save, click on Apply. Figure 3-50 Time Service - Manual Setup To set time zone and daylight saving time (DST) settings: Step 1 Step 2 Step 3 In . Following are upcoming DST end dates: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 75
  • Cisco SFS-7012 | User Guide - Page 94
    port to an external network. To configure the Switch default gateway IP address: Step 1 From the OOB LAN IP submenu, click Set Default Gateway IP. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 76 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 95
    in the correct switch default gateway IP address. Step 4 Click Apply. Note A reboot is required to activate the new gateway IP address. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 77
  • Cisco SFS-7012 | User Guide - Page 96
    Spine View Menu Chapter Note For information on IB port statistics refer to the section SFS 7012 Port Statistics, page 3-67. Logging The Logging submenu allows the user to view, View Log Button To view the message log: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 78 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 97
    Button To purge the log: Step 1 From the menu, click Logging. Step 2 Click Purge Log. The Purge Log confirmation window is displayed OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 79
  • Cisco SFS-7012 | User Guide - Page 98
    Boot Image The Select Boot Image button allows the user to choose an alternative boot image for the SFS 7012. To select a boot image: Figure 3-62 Select Boot Image Button Step 1 From the menu, as an add-on to the SFS 7012. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 80 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 99
    Administration. The Key Management window is displayed. Step 3 To delete a license key, click the Delete button. The system prompts with the following: OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 81
  • Cisco SFS-7012 | User Guide - Page 100
    Figure 3-68 License Key Delete Prompt Step 4 Click OK to delete. Chapter Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 82 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 101
    Technical Specifications Table A-1 SFS 7012 Technical Specifications Switch Physical Dimensions Weight Cooling Environmental Power Supply Certification Marks • 7U high (24.5") • 19" rack mount (17.32" Class B, ICES - 003 OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 83
  • Cisco SFS-7012 | User Guide - Page 102
    Appendix Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 84 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 103
    This section details the usage of the Command Line Interface (CLI) feature for the Cisco SFS 7012™. The CLI allows the user to perform remote configuration and management tasks, which in user is executing the same command. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 85
  • Cisco SFS-7012 | User Guide - Page 104
    for setting the time zone and daylight saving time parameters. Snmp: Provides commands for configuring SNMP trap destinations and security parameters required to access the SFS 7012 from an SNMP manager. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 86 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 105
    IP address of the SFS 7012 (the default IP address is 192.168.100.9) with the following command: open The system prompts for a username. The CLI has the following default user names: - Operator access: operator OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 87
  • Cisco SFS-7012 | User Guide - Page 106
    Type the appropriate password and press Enter. The system responds with: Welcome to the SFS 7012 CLI. Type 'list' for the list of commands. Groups and Commands The following return code from the last SCP Firmware Push Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 88 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 107
    Use smShowSubscriptions smDisplayMasterLMC Use smShowMasterLMC smDisplaySmMasterLid Use smShowMasterLid smDumpLidMap Use smShowLidMap smDisplayMaxLid Use smShowMaxLid smDisplaySMParms Use smShowSMParms ismTune OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 89
  • Cisco SFS-7012 | User Guide - Page 108
    : N/A, SN: N/A NAME: "Fan Tray 3", DESCR: "SFS 7012/7024 Fan Tray" PID: 74-4323-01, VID: N/A, SN: N/A NAME: "Fan Tray 4", DESCR: "SFS 7012/7024 Fan Tray" PID: 74-4323-01, VID: N/A, SN: N/A Total devices found: 9 Appendix Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 90 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 109
    Change the default gateway IP address arpShow Displays the link level adress resolution protocol (ARP) table hostShow Displays the host name table OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 91
  • Cisco SFS-7012 | User Guide - Page 110
    host address logShowConfig Display the current log configuration KeyManagement showKeys Display the list of installed license keys addKey Install a license key removeKey Remove a license key Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 92 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 111
    the SNMP trap targets snmpTargetParams Access the snmpTargetParamsTable snmpNotifyProfile Access the snmpNotifyFilterProfileTable snmpNotifyFilter Access the snmpNotifyFilterTable snmpNotify Access the snmpNotifyTable OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 93
  • Cisco SFS-7012 | User Guide - Page 112
    includes information such as license keys, memory test, time zone, and time Daylight Saving Time (DST) captureSnmp Capture SNMP information captureShell Capture shell command information Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 94 OL-8787-04
  • Cisco SFS-7012 | User Guide - Page 113
    A P P E N D I X This appendix describes how to troubleshoot the Cisco SFS 7012™, and it includes the following information: • Hardware Checks, page C-95 • Troubleshooting Scenarios, page C-97 Hardware Checks Switch Power Supply Problem The Switch has no power Fix Ensure that the power cord(s) is
  • Cisco SFS-7012 | User Guide - Page 114
    6 certified. SFS 7012 Leaf Module IB Ports Problem No LED Bad IB Cable Fix LED may be bad if IB Link (A and B) LEDs are lit, and the ATTN and/or STAT is not. If the QUAL LED is not lit: Test with a known good IB cable. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 96 OL
  • Cisco SFS-7012 | User Guide - Page 115
    Appendix Troubleshooting Scenarios InfiniBand This section documents common problems seen with the SFS 7012 switch. Invalid IP Address entered for SWC via Console Port nodes) can be seen in your Subnet Manager window. OL-8787-04 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 97
  • Cisco SFS-7012 | User Guide - Page 116
    Appendix Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide 98 OL-8787-04
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116

Corporate Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 526-4100
Cisco SFS 7012 InfiniBand Server Switch
Hardware Users Guide
Text Part Number: OL-8787-04