HP StorageWorks 2/24 FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env
HP StorageWorks 2/24 - Edge Switch Manual
View all HP StorageWorks 2/24 manuals
Add to My Manuals
Save this manual to your list of manuals |
HP StorageWorks 2/24 manual content summary:
- HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 1
McDATA® Products in a SAN Environment Planning Manual P/N 620-000124-500 REV A - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 2
Revision of the manual to describe the Eclipse 1620 Switch, Eclipse 2640 Switch, Intrepid 10000 Director, Release 4.6 without notice. McDATA Corporation assumes no responsibility for any errors that may appear. All computer software programs, including but in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 3
1-10 Intrepid 10000 Director 1-12 Fabric Switches 1-15 Fabric Switch Performance 1-15 Sphereon 3232 Fabric Switch 1-16 Sphereon 4300 Fabric Switch 1-17 Sphereon 4500 Fabric Switch 1-18 SAN Routers 1-20 SAN Router Performance 1-21 Eclipse 1620 SAN Router 1-22 Eclipse 2640 SAN Router 1-24 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 4
3-13 Fabric Topologies 3-14 Mesh Fabric 3-14 Core-to-Edge Fabric 3-16 SAN Islands 3-18 Planning for Multiswitch Fabric Support 3-18 Fabric Topology Limits 3-19 Factors to Consider When Implementing a Fabric Topology 3-20 iv McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 5
3-31 Fabric Availability 3-37 Fabric Scalability 3-39 Obtaining Professional Services 3-40 Mixed Fabric Design Considerations 3-40 FCP and FICON Chapter 4 Implementing SAN Internetworking Solutions SAN Island Consolidation 4-2 Flexible Partitioning Technology 4-4 SAN Routing 4-8 Implementing - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 6
, and Remote Access Support ...........5-9 Management Server 5-9 Remote User Workstations 5-11 SNMP Management Workstations 5-13 SANpilot Interface 5-14 Security Provisions 5-15 Password Protection 5-15 SANtegrity Authentication 5-16 SANtegrity Binding 5-19 PDCM Arrays 5-20 Preferred Path - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 7
16: Plan Zone Sets for Multiple Products (Optional) ....... 6-30 Task 17: Plan SAN Routing (Optional 6-31 Task 18: Complete Planning Checklists 6-34 Appendix A Product Specifications Director, Fabric Switch, and SAN Cabinet Footprint A-8 Appendix B Firmware Summary System-Related Differences - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 8
Contents viii McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 9
Summary 2-6 3-1 ISL Transfer Rate Versus Fabric Port Availability (Two-Director Fabric) 3-22 4-1 mSAN Routing Domain 4-18 4-2 mSAN Supported Limits 4-21 4-3 mFCP Versus iFCP 4-28 4-4 Transport Technology Comparison 4-48 5-1 Cable Type and Transmission Rate versus Distance and Link Budget - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 10
Tables x McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 11
1-4 1-2 Intrepid 6064 Director 1-9 1-3 Intrepid 6140 Director 1-11 1-4 Intrepid 10000 Director 1-13 1-5 Sphereon 3232 Fabric Switch 1-16 1-6 Sphereon 4300 Fabric Switch 1-17 1-7 Sphereon 4500 Fabric Switch 1-19 1-8 Eclipse 1620 SAN Router 1-22 1-9 Eclipse 2640 SAN Router 1-24 2-1 Out - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 12
Core-to-Edge Fabric 3-17 3-11 Example Multiswitch Fabric 3-19 3-12 ISL Oversubscription 3-33 3-13 Device Locality 3-34 3-14 Device Fan-Out Ratio 3-35 3-15 Fabric Performance Tuning 3-36 3-16 12 SAN 21 5-5 PDCM Array - Example Problem 5-22 5-6 Preferred Path Configuration 5-23 5-7 Director - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 13
supports McDATA® multi-protocol switching and routing products, including the: • Intrepid® 6064 Director. • Intrepid 6140 Director. • Intrepid 10000 Director. • Sphereon™ 3232 Fabric Switch. • Sphereon 4300 Fabric Switch. • Sphereon 4500 Fabric Switch. • Eclipse™ 1620 SAN Router. • Eclipse 2640 SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 14
Specifications - This appendix lists specifications for directors, fabric switches, and SAN routers. Appendix B, Firmware Summary - This appendix summarizes differences and similarities between firmware versions that support directors, fabric switches, and SAN routers. An Index is also provided - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 15
Switch Installation and Service Manual (620-000171). • Sphereon 4500 Fabric Switch: - McDATA Sphereon 4500 Fabric Switch Element Manager User Manual (620-000175). - McDATA Sphereon 4500 Fabric Switch Installation and Service Manual (620-000159). • Eclipse 1620 SAN Router: - McDATA Eclipse 1620 SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 16
Ordering Printed Manuals • Eclipse 2640 SAN Router: - McDATA Eclipse 2640 SAN Router Administration and Configuration Manual (620-000203). - McDATA Eclipse 2640 SAN Router Installation and Service Manual (620-000202). • General Support Publications: - McDATA SANavigator Software User Manual (621 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 17
address listed below. Please have the product serial number (printed on the service label attached to the director or switch) available. Phone: (800) 752-4572 or (720) 558-3910 Fax: (720) 558-3851 E-mail: [email protected] We welcome comments about this publication. Please send comments to the - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 18
certified in the United States to conform to Title 21 of the Code of Federal Regulations (CFR), Subchapter not installed and used in accordance with instructions provided, may cause interference to radio literature, invalidates the service contract and voids the SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 19
CB Scheme) A certification bodies (CB) test report supporting a product indicates safety compliance with the International Electrotechnical and light industrial environments (equipment with rated current less than or equal to 16 amperes per phase). In addition, the European Union (EU) Council has - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 20
technology equipment) as set forth by the Australian Communications Authority (ACA) and the Radio Spectrum Management Group (RSM) of New Zealand. xx McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 21
Preface People's Republic of China CCC Mark The China Compulsory Certification mark (CCC mark) on a product indicates compliance with People's Republic of China regulatory requirements for safety and EMC (for information technology equipment) as set forth by the National Regulatory Commission for - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 22
observed while installing or servicing a product. A DANGER statement provides essential information or instructions for which disregard or . • Hebrew. • Italian. • Portuguese. • Spanish (European). • Spanish (Latin American). xxii McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 23
Preface DANGER Use the supplied power cords. Ensure the facility power receptacle is the correct type, supplies the required voltage, and is properly grounded. DANGER Utiliser les câbles d'alimentation fournis. S'assurer que la prise de courant du local est du type correct, délivre la tension - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 24
a terra idonea. PERIGO Use os cordões elétricos fornecidos. Certifique-se de que o tipo el receptáculo tomacorriente para la instalación sea del tipo correcto, suministre el voltaje necesario, y que esté apropiadamente conectado a tierra. xxiv McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 25
servicing a product. An ATTENTION statement provides essential information or instructions array that prohibits E_Port connectivity, mistakes can render ISLs unusable and cause complex routing problems. These problems number, a change to the director or switch fiber-optic cable configuration disrupts - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 26
Preface xxvi McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 27
to McDATA Multi-Protocol Products The enterprise-level storage area network (SAN) of today is typically complex and managed at the device layer. These problems result in SANs that use storage assets inefficiently, and are complex, error prone, expensive, and time-consuming to manage. This chapter - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 28
deployed at the core of large fabrics (greater than 500 ports) and are the optimum choice to support mission-critical business requirements. McDATA offers the: - 64-port Intrepid 6064 Director. - 140-port Intrepid 6140 Director. - 256-port Intrepid 10000 Director. Refer to Directors for detailed - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 29
access to traditional Fibre Channel SANs. McDATA offers the: - Four-port Eclipse 1620 SAN Router. - 16-port Eclipse 2640 SAN Router. Refer to SAN Routers for detailed information about each product. McDATA products (except the Sphereon 4300 Fabric Switch) are managed and controlled through - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 30
Introduction to McDATA Multi-Protocol Products 1 6. Sphereon 4500 Switch. 7. Intrepid 6140 Director. 8. Eclipse 1620 SAN Router. 9. Eclipse 2640 SAN Router. 10. Intrepid 10000 Director. Figure 1-1 Cabinet-Mount McDATA Products 1-4 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 31
software package that provides management of an enterprise-wide, heterogeneous SAN (with multiple vendor applications) from a single console. an integrated software package that provides management of McDATA directors and switches from a single console. Element Manager applications installed on - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 32
Product Management for information about SAN management applications and the management server. Chapter 2 also describes switch management through: • The Internet devices, and peripherals in a Fibre Channel switched network. Directors also support mainframe and open-systems interconnection (OSI) - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 33
-to-point topology provides a single direct connection between two device N_Ports. This topology supports bidirectional transmission between source and destination ports. Through dynamic switching, directors configure different point-to-point transmission paths. In all cases, connected N_Ports use - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 34
up to 64 Fibre Channel devices. The product provides high-performance scalable bandwidth, highly-available operation, redundant switched data paths, long transmission distances (up to 20 km), and high device population. Figure 1-2 illustrates the director. 1-8 McDATA Products in a SAN Environment - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 35
-Protocol Products 1 Figure 1-2 Intrepid 6064 Director The director supports McDATA's non-blocking extendable open network (EON™) architecture and concurrent firmware downloads through hot code activation (HotCAT®) technology. The director also provides a modular design that enables quick removal - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 36
16 10.2000 Gbps 140 Fibre Channel devices. The product provides high-performance scalable bandwidth, highly-available operation, redundant switched data paths, long transmission distances (up to 20 km), and high device population. Figure 1-3 illustrates the director. 1-10 McDATA Products in a SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 37
The director supports McDATA's non-blocking EON architecture and concurrent firmware downloads through HotCAT technology. The director also provides a modular design that enables quick removal and replacement of FRUs, including a: • Front bezel with power (green) and system error (amber) LEDs - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 38
network addresses. Intrepid 10000 Director The Intrepid 10000 Director is a fourth-generation, enterprise-class product that provides switched fabric connectivity for up to 256 Fibre Channel devices operating at 1.0625 or 2.1250 Gbps, or up to 64 devices operating at 10.2000 Gbps. The product - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 39
, the director supports concurrent firmware downloads through HotCAT technology. FlexPar-specific software can also be independently and concurrently upgraded. The combination of high port count and the FlexPar feature enables an enterprise to use the director at the core of both small and large SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 40
. The director provides a modular design that enables quick removal and replacement of FRUs, including a: • Front bezel with green power (SYSTEM ON) and amber error (SYSTEM FAULT) LEDs. • Redundant CTP (1.0625, 2.1250, and 10.2000 Gbps operation) logic cards. • Redundant and shared switching module - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 41
firmware upgrades and spare or unused Fibre Channel ports. Excluding an availability of 99.999%, fabric switches offer the same general performance features as directors, including high bandwidth, low latency, local control, low communication overhead, multiple topology support, and multiple service - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 42
are enabled (in eight-port increments) through purchase of a PFE key. The switch front panel provides an initial machine load (IML) button, Ethernet LAN connector, port status LEDs, green power (PWR) LED, and amber system error (ERR) LED. 1-16 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 43
switched fabric devices. • Fabric loop ports (FL_Ports) to provide switched arbitrated loop connectivity and fabric attachment for FC-AL devices. The switch supports information. • E_Ports to provide ISL connectivity to fabric directors and switches. E_Port connectivity is not standard and must be - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 44
switch provides a modular amber system error (ERR) LED. The switch rear panel switched fabric devices. • FL_Ports to provide switched arbitrated loop connectivity and fabric attachment for FC-AL devices. The switch supports directors and switches. 1-18 McDATA Products in a SAN Environment - Planning - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 45
switch. Figure 1-7 Sphereon 4500 Fabric Switch The switch provides a modular design that enables quick removal and replacement of FRUs, including: • Redundant power supplies and cooling fans. The switch PWR) LED, and amber system error (ERR) LED. Introduction to McDATA Multi-Protocol Products 1-19 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 46
can use the port to configure switch network addresses. SAN Routers The Fibre Channel protocol was , geographically-dispersed networks. SAN routers provide multi-protocol solutions to this problem by unifying storage (FCP information. 1-20 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 47
and Implementing BC/DR Solutions for detailed information. • Provide connectivity for iSCSI integration - SAN routers provide cost-effective solutions (based on the iSCSI-protocol) to consolidate servers and more efficient data transmission. Introduction to McDATA Multi-Protocol Products 1-21 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 48
through concurrent firmware upgrades and spare or unused multi-protocol ports. • Multi-protocol support - SAN routers support the following service (iSNS). The iSNS protocol provides intelligent storage device discovery and management services comparable to those found in Fibre Channel SANs - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 49
connectivity at 1.0625 Gbps, using only the SFP port connector. The ports support FC-Auto, FL_Port, F_Port, L_Port, and R_Port operation. - IP network connectivity duplex LC connectors. SFP port transceivers are the only SAN router FRUs. The SAN router has two power supplies and eight cooling fans - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 50
operations personnel can use the port to configure SAN router network addresses. Eclipse 2640 SAN Router The Eclipse 2640 SAN Router is a second-generation product that provides (FC-Auto) operation. This is the default selection. 1-24 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 51
modular design that enables quick removal and replacement of FRUs, including: • Redundant power supplies and cooling fans. The SAN router provides two power supplies each with an AC power receptacle, power switch, and two cooling fans (four fans total). • Up to 16 . • Serviceability features. Introduction to - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 52
zones cannot recognize and communicate with each other. Directors, fabric switches, and SAN routers support port number and world-wide name (WWN) zoning. • State change notification - Directors and the Sphereon 3232 Fabric Switch support a state change notification function that allows attached - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 53
Director - Each director LIM contains two scalable packet processors, each supporting two optical paddles (a maximum of 16 1.0625 or 2.1250 Gbps ports or four 10.2000 Gbps ports). After assigning BB_Credit values of 16 to 60. - Sphereon 4300 Fabric Switch - All switch ports are preset to a BB_Credit - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 54
attempt to access a managed product. • Port blocking - System administrators can restrict device access by blocking or unblocking any director or fabric switch port through the associated Element Manager application. NOTE: SAN routers do not support port blocking. 1-28 McDATA Products in - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 55
switches (switch binding). NOTE: SAN routers do not support the SANtegrity Binding feature. SAN routers support port binding only for R_Ports. McDATA directors, fabric switches, SAN routers, and the SAN management and Element Manager applications offer the following general serviceability features - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 56
software that performs port diagnostics (internal and external loopback tests). NOTE: SAN routers do not support loopback testing. • Directors and fabric switches (except the Sphereon 4300 and Sphereon 4500 Switches), can perform a diagnostic Fibre Channel (FC) wrap test. The FC wrap test applies - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 57
modem support. • An RS-232 maintenance port on the director, fabric switch, or SAN router (port access is password protected) that enables installation or service personnel to change the product's IP address, subnet mask, and gateway address; or to run diagnostics and isolate system problems through - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 58
of failover. The SAN management application queries the SAN routers) to help isolate system problems. The data includes a memory dump file and audit, hardware, and engineering logs. • SNMP management for directors and fabric switches the SAN management on each director or switch. Up director or switch - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 59
documents, RFC memorandums, and McDATA. All listed MIBs run on each SAN router. Up to eight authorized management workstations can be configured through the run on each router and contain management objects to support multi-protocol router functions. Introduction to McDATA Multi-Protocol Products - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 60
, automatically blocks the disruptive E_Port. - Digital SFP diagnostic support - This feature provides access to diagnostic data generated by traffic sourced from or delivered to a switch's embedded port. Log contents assist in fault diagnosis of SAN traffic problems. - Embedded fabric log - This log - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 61
multi-protocol products, including Intrepid-series directors, Sphereon-series fabric switches, and Eclipse-series SAN routers. The chapter specifically describes: associated Ethernet hub, and optional remote workstation support. • Product firmware, including the Enterprise Operating System (E/OS); - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 62
local area network (LAN) connection on a director control processor (CTP) card, fabric switch front panel, or SAN router front panel. As an optional feature, SAN management and Element Manager application is not supported for the Sphereon 4300 Switch. • Management of SAN routers through a SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 63
and SAN routers do not support product management through the SANpilot interface. • Management of all products through a PC-based Telnet session using the CLI. Any platform that supports Telnet client software can be used. • Management of directors and fabric switches through the EFC Management - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 64
and SAN routers do not support product management through the EFCM Lite application. Figure 2-1 illustrates out-of-band product management. In the figure, the managed product is an Intrepid 6064 Director. For a tabular summary of McDATA switch products and associated out-of-band management methods - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 65
or switch port, and communicates using Fibre Channel common transport (FC-CT) protocol. Product operation, port connectivity, zoning, and fabric control are managed through a device-attached console. Refer to OSMS for information. NOTE: The Intrepid 10000 Director and SAN routers do not support out - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 66
Product Support Summary Product 6064 Director 6140 Director SANvergence EFCM SANavigator EFCM Manager SNMP CLI SANpilot Lite OSMS FMS YES YES NO YES YES YES YES YES YES YES YES NO YES YES YES YES YES YES 10000 Director YES YES NO YES YES NO YES NO YES 3232 Fabric Switch YES - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 67
NO YES YES YES NO NO NO NO Management Server Support The management server is a one rack unit (1U) high, LAN-accessed, rack-mount unit that provides a central point of control for up to 48 connected directors, fabric switches, or SAN routers. The server desktop is accessed through a LAN-attached - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 68
service packs) may interfere with normal operation. United States English is the only language supported by the SAN containing switches or 2000 Professional (with service pack 4), Windows XP Professional (with service pack 2), or Windows Server 2003 operating system (Enterprise Edition with service - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 69
using the V .92 dial-up specification. • 16 MB graphics card. • Network interface card (NIC 2003 operating system (Enterprise Edition with service pack 1). • TightVNC™ Viewer Version dial-up specification. • Video graphics array (VGA) capable 32 MB graphics card. • NIC with two 10/100 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 70
Product Management 2 Ethernet Hub . The management server and managed directors, fabric switches, and SAN routers connect through a 10/100 Base-T Ethernet hub. Figure 2-4 illustrates the 24-port hub. 1 45 13 16 17 89 20 21 12 MID MDIX 24 1 13 23 14 15 Green - 114600M15,7PYeollr1o6t8wS- - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 71
Packard® PA-RISC® processor with 400 MHz or greater clock speed, using the HP-UX® 11 or higher operating system. - Sun® Microsystems UltraSPARC™ IIi or Product Firmware McDATA provides three product-embedded operating systems (firmware) that support underlying director, fabric switch, and SAN router - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 72
Eclipse-series SAN routers. Director and fabric switch firmware (E/OS and E/OSn) provides services that manage services - This function supports all software subsystems for system initialization, logging, tracing, debugging, and communicating with RS-232 maintenance ports. • Operating system services - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 73
redundant directors, fabric services also implement a replication manager that synchronizes node port (N_Port) registration databases between redundant CTP cards and allows CTP failover. • Loop services - This function supports FL_Port initialization for Sphereon 4000-Series Switches and implements - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 74
credit (BB_credit), error detect timeout value (E_D_TOV), resource allocation timeout value (R_A_TOV), switch priority, switch speed (1.0625 or contents change. The SAN management data directory includes: - All log files (SAN management logs and individual director or switch Element Manager logs). - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 75
a SAN management application (SANavigator 4.2 or EFCM 8.6) along with director or switch-specific problems. • Discovery and visualization - Through TCP/IP (out-of-band) or Fibre Channel (inband) connections, the SAN management application automatically discovers every device attached to a SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 76
- Vendor-specific device management applications can be launched from the SAN management application, including McDATA Element Manager applications. The application also provides management of director and switch zoning across multiple vendors and product models. • Monitoring and notification - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 77
of the window provide drop-down menu selections to perform functions for SAN devices, including editing, viewing, planning, discovery, configuration, and monitoring , the physical map at the right side of the window depicts the SAN topology, discovered devices, and color-coded links. • Tool box - The - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 78
- The minimap at the lower right corner of the window displays the entire SAN topology and provides an aid to navigate the more detailed physical map. • discovery status. McDATA directors and fabric switches, original equipment manufacturer (OEM) directors and fabric switches, and other OEM devices - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 79
NOTE: An Element Manager application is not supported for the Sphereon 4300 Switch. The Element Manager application works in conjunction with the SAN management application and is a Java-based GUI for managing and monitoring a director or switch. The application operates locally on the management - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 80
and yellow diamond, or grey square) that indicate the status of the selected managed product. Messages display as required to the right of the icons. 2-20 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 81
metropolitan simple name server (mSNS). Through the mSNS, the application auto-discovers all SAN Routers, directors, and fabric switches in the mSAN; monitors product operational status, and reports problems in an event log. The application is opened from the management server Windows desktop - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 82
errors, warnings, and configuration changes transmitted from the SANvergence Manager application. For additional information about the application, refer to the McDATA SANvergence Manager User Manual (620-000189). An Element Manager application is provided for each managed SAN router. - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 83
Product Management 2 Figure 2-9 Device Window (Element Manager) The graphical representation of the product emulates the hardware configuration and operational status of the corresponding real product. For example, if all router ports are connected and functional, this configuration is reflected in - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 84
firmware Version 1.2 (or later) installed, administrators or operators with a browser-capable PC and an Internet connection can monitor and manage the director or switch through the SANpilot interface. The interface provides a GUI similar to the Element Manager application and supports product - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 85
Retrieve dump files, retrieve product information files, and perform product firmware upgrades. - Install optional feature keys. The SANpilot interface can task selection tabs allow users to perform director or switch-specific tasks and are a function of the menu selected as follows: Product - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 86
selection tabs appear. • Help - The Help selection opens online user documentation that supports the SANpilot interface. Command Line Interface The CLI provides a director, fabric switch, and SAN router management alternative to traditional SAN management GUIs. The interface allows users to access - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 87
SAN islands). • Planning for multiswitch fabric support. • General fabric design considerations. • Large fabric design considerations. • Mixed fabric design considerations. • Fibre connection (FICON) cascading. Fibre Channel Topologies Intrepid-series directors and Sphereon-series fabric switches - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 88
. Director or fabric switch elements receive data from a device and, based on the destination N_Port address, route the data through the fabric (and possibly through multiple switch elements) to the destination device. For additional information, refer to Planning for Multiswitch Fabric Support and - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 89
for Fibre Channel Topologies 3 This section focuses on loop operation for Sphereon 4300 (12-port) and 4500 (24-port) Fabric Switches that operate at 1.0625 or 2.1250 gigabits per second (Gbps) and support FC-AL operation using FL_Ports and public and private device connectivity. Shared Mode Versus - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 90
through multiple point-to-point connected pairs. Switched mode operation and its simplified logical equivalent are illustrated for a Sphereon 4500 Fabric Switch in Figure 3-2. Figure 3-2 Switched Mode Operation and Logical Equivalent 3-4 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 91
high-performance SAN for the department or workgroup. Consider the following when planning such a SAN: • Connect loop switch ports to servers and high bandwidth storage devices across several looplets to avoid performance problems associated with a single looplet. • Consider data traffic capacity of - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 92
can communicate with fabric-attached device D1. Figure 3-3 Public Device Connectivity Public devices support normal fabric operational requirements, such as fabric busy and reject conditions, frame multiplexing, and frame delivery order. 3-6 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 93
are partitioned into two separate address spaces defined in the Fibre Channel address. Private address spaces are isolated from a switched fabric. The switch does not support any other form of Fibre Channel address conversion (spoofing) that would allow private device-to-fabric device communication - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 94
Sphereon 4300 and 4500 Fabric Switches support operation of public and private loops director or switch connected to the Sphereon 4300 or 4500 Fabric Switch through any active E_Port. Public loop connectivity for a Sphereon 4500 Switch is illustrated in Figure 3-5. 3-8 McDATA Products in a SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 95
Planning Considerations for Fibre Channel Topologies 3 Figure 3-5 Public Loop Connectivity • Private loop - A private loop is not connected to a switched fabric and the switch's embedded FL_Port is inactive. All devices attached to the loop can only communicate with each other. Private loop - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 96
departmental SANs. This topology is well-suited to small and mid-sized configurations where modest connectivity levels and high data transmission speeds are required. The topology also supports low-cost switching and connectivity in environments where the per-port cost of a switched fabric director - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 97
or departmental SAN and a switched fabric, thus implementing connectivity of FC-AL devices to fabric devices at the core of the enterprise Switched Fabric Sphereon 4300 and 4500 Fabric Switches provide dynamic connectivity between FC-AL devices and directors or switches participating in a switched - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 98
Switch to provide loop-to-switched fabric connectivity and incorporate FC-AL devices into the enterprise SAN environment, attach the device to any switch Connecting another server to the switch would exceed the E_Port capability and adversely impact director-to-switch link performance. Other devices - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 99
solution is to consolidate the tape drives on an inexpensive loop switch, then connect the switch to a director E_Port. Figure 3-8 illustrates the consolidation of three tape drives through one E_Port connection to a fabric director. Each tape drive has a 30 MBps bandwidth, therefore the sum of - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 100
in this section include: • Mesh. • Core-to-edge. • Fabric (SAN) islands. Mesh Fabric There are two types of mesh fabrics: full mesh and modified (or partial) mesh. In a full-mesh topology, every director or switch is directly connected to all directors and switches in the fabric. The maximum hop - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 101
alternate path. Mesh fabrics also form effective backbones to which other SAN islands can be connected. Traffic patterns through the fabric should be used when the fabric is not expected to grow beyond four or five switches. The cost of ISLs becomes prohibitive for larger mesh fabrics. In addition, - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 102
(simple or complex). In a simple core topology as shown in Figure 3-10, core switches are not connected. In a complex core topology, core switches are connected. The figure also illustrates a topology where the core is a full-mesh fabric. 3-16 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 103
10/100 RST TM PWR ERR TM TM 10/100 RST 31 29 27 25 23 TM 21 19 17 15 30 28 26 24 22 20 18 13 11 9 7 5 3 1 16 14 12 10 8 6 4 2 0 PWR ERR Edge Switches Core Director Tier 1 Device TM TM 10/100 RST TM PWR ERR 10/100 RST 31 29 27 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 104
) to reach a device attached to a core director or switch. • Tier 3 - A Tier 3 device connects to an edge switch and Fibre Channel traffic from the device can traverse two ISLs (hops) to reach a device attached to a core director or switch. SAN Islands A SAN island is an isolated or geographically - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 105
to the fabric, handle flow control, and satisfy the requirements of the classes of Fibre Channel service that are supported. Fabric Topology Limits Operation of multiple directors or switches in a fabric topology is subject to the following topology limits. Consider the impact of these limits - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 106
Director supports 48 ISLs. The Intrepid 6140 Director supports 140 ISLs. The Intrepid 10000 Director supports seven ISLs per optical paddle pair. Sphereonclass switches support ). These factors, along with nondisruptive growth and service requirements, must be evaluated when planning an initial - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 107
Gbps), or 75 meters (at 10.2000 Gbps) any port transceiver (shortwave 75 and 150 meters (at 10.2000 Gbps) any port transceiver (shortwave ), or 150 meters (at 10.2000 Gbps) only longwave laser port transceivers Each director or switch retransmits , link errors occur. SAN Extension Transport Technologies. - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 108
can be used to increase the total bandwidth available for data transfer between two directors or switches in a fabric. Increasing the number of ISLs between elements increases the corresponding and General Fabric Design Considerations. 3-22 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 109
balance the load by assigning traffic from different ports to different minimum-hop paths (ISLs). When balancing a load across multiple ISLs, a director or switch attempts to avoid assigning multiple ports attached to a device to the same ISL. This minimizes the probability that failure of a single - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 110
with the Default setting and the lowest WWN becomes the principal switch. Note that at least one director or switch in a multiswitch fabric needs to be set as Principal or Default recommended to configure the switch priority as Default. 3-24 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 111
fabrics from joining. To prevent this problem, it is recommended that all directors and switches be assigned a unique preferred Domain_ID directors and switches supplied by multiple OEMs, be aware of the following: - For Intrepid 6000-series directors and Sphereon-series fabric switches, the firmware - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 112
through the fabric. These paths route Fibre Channel frames between devices attached to the fabric and enable operation of the fabric services firmware on each director or switch. Paths are determined when the fabric topology is determined and remain static as long as the fabric does not change. If - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 113
, firmware balances the data transfer load and assigns ISL as follows: - The director or switch assigns the old (longer) path. This causes problems because many Fibre Channel devices cannot receive director or switch provides correct frame order delivery. The delay period is equal to the error - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 114
fabric, director-provided services such as name service, registered state change notifications (RSCNs), and zoning are provided on a fabric-wide basis. For example, if a fabric-attached device queries a director or switch name server to locate all devices that support a specified protocol - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 115
connecting E_Ports segment and the fabrics remain independent. Zone sets for two directors or switches are compatible (the fabrics can join) only if the zone names for the fabric topology design must: • Solve the customer's business problem and provide the required level of performance. • Meet the - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 116
10000 Director) as SAN building blocks provides a larger number of non-blocking Fibre Channel ports. Large fabrics built around these directors require fewer additional fabric elements (smaller directors and fabric switches) and ISLs. The Intrepid 10000 Director also supports high-bandwidth (10.2000 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 117
Configuring Zones. McDATA directors and fabric switches are designed with nonblocking architecture; therefore any two switch ports can communicate at the full Fibre Channel bandwidth of 1.0625, 2.1250, or 10.2000 Gbps without impact to other switch ports. Because most SAN-attached devices are not - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 118
information about application I/O (in Gbps) and fabric performance problems due to ISL connectivity, refer to ISL Oversubscription. For serviced, ISL and fabric performance is reduced. Figure 3-12 illustrates ISL oversubscription. 3-32 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 119
1 NT Server 2 10 15 20 25 Time (Sec) Figure 3- directors and the congestion problem is mitigated. For additional information, refer to Device Locality. • Install an additional ISL - A second ISL can be installed to balance the traffic load between fabric elements. Two ISLs are sufficient to support - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 120
Topologies 3 • Upgrade the existing ISL - Fabric element software, firmware, and hardware can be upgraded to support a 2.1250 or 10.2000 Gbps bandwidth traffic load between fabric elements. A 2.1250 or 10.2000 Gbps ISL is sufficient to support the bandwidth of both NT servers operating at peak load - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 121
core-to-edge fabric, servers and storage devices that support such bandwidth-intensive applications should be attached to core directors variations are why multiple hosts can be serviced by a single storage port. This ratio is defined as the storage or array port IOPS divided by the attached host - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 122
5 3 1 16 14 12 10 8 6 4 2 0 PWR ERR 11 Total Servers 10 MBps 1,000 IOPS 10/100 RST TM PWR ERR 6 Total Servers 20 MBps 1,500 IOPS Tier 2 Servers Interswitch Link Fabric Connection Figure 3-15 Fabric Performance Tuning 3-36 McDATA Products in a SAN Environment - Planning Manual 10 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 123
MBps and 1,000 IOPS are fabric-attached through a 32-port edge switch. The primary applications are e-mail and online transaction processing (OLTP). Because bandwidth use is light and noncritical, the servers are connected to the core director with a single ISL that is intentionally oversubscribed - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 124
take one fabric offline for maintenance or upgrade without disrupting SAN operations. If high availability is important enough to require dual Figure 3-16 illustrates simple redundant fabrics. Fabric "A" and fabric "B" are symmetrical, each containing one core director and four edge switches. All - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 125
Interswitch Link Fabric Connection Figure 3-16 Redundant Fabrics Some dual-attached devices support active-active paths, while others support only active-passive paths. Active- to maintain that information online. To meet these requirements, Fibre Channel SANs provide the theoretical infrastructure - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 126
investment protection. If a core fabric switch is replaced with a newer or higher port count switch (such as the Intrepid 10000 Director), it is often valuable to use the existing switch elsewhere in the fabric (at the edge). Obtaining Professional Services Planning and implementing a multiswitch - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 127
and FICON in a Single Fabric Director or Switch Management Fibre Channel Layer 4 (FC-4) describes the interface between Fibre Channel and various upper-level protocols. FCP and FICON are the major FC-4 protocols. FCP is the Fibre Channel protocol that supports the small computer system interface - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 128
the director or switch level using the Configure Allow/Prohibit Matrix Active dialog box (Figure 5-4). For additional information, refer to PDCM Arrays. ATTENTION ! When configuring a PDCM array that prohibits E_Port connectivity, mistakes can render ISLs unusable and cause complex routing problems - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 129
and physical port number of the director or fabric switch port to which a device is 64 60 80 7C 78 74 70 6C 68 64 60 56 52 48 44 40 36 32 3C 38 34 30 2C 28 24 20 64 5C 58 54 50 4C 48 44 40 60 5C 58 54 50 4C 48 44 28 24 20 16 12 08 04 00 1C 18 14 10 0C 08 04 00 20 1C 18 14 10 0C 08 04 29 25 21 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 130
addressing for Intrepid 6140 Director ports accessed from the rear. UPM Cards 34 143 142 141 140 8F 8E 8D 8C 93 92 91 90 32 135 134 133 132 6064 Director (64 ports), Sphereon 3232 Fabric Switch (32 ports), Sphereon 4300 Fabric Switch (12 ports), and Sphereon 4500 Fabric Switch ( - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 131
or hardware enforced (depending on the director or switch firmware release level). - FICON architecture controls connectivity through a host-based HCD program, the CUP, and a director or switch-resident PDCM array. The CUP and PDCM array support hardware enforcement of connectivity control to all - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 132
protocol. Management server differences tend to complicate security and control issues. NOTE: The Intrepid 10000 Director and Sphereon 4300 and 4500 Fabric Switches do not support out-of-band management through FMS. Features that Impact Protocol Intermixing Each server provides facilities to - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 133
for attached devices to query the user-configured security level employed in a SAN. The feature significantly reduces the impacts of accidental or operatorinduced errors. Fabric binding defines the directors and switches allowed to participate in a fabric, thus preventing accidental fabric merges - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 134
to a common version - Ensure fabric elements are operating at a common firmware level. This reduces errors due to director or switch incompatibility. E/OS Version 4.0 or higher is required to support FICON cascading. E/OS Version 6.0 or higher is recommended. 2. Upgrade fabric element software - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 135
errors due to director or switch incompatibility. In addition, the SANtegrity Binding feature (with Enterprise Fabric Mode enabled) is required to support FICON devices must be attached to these assigned ports. In addition, PDCM arrays affect port connections at the hardware level, so a range of port - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 136
PDCM arrays - For each director or switch managed FCP devices. - Because PDCM arrays affect port connections at the hardware array to prohibit E_Port connectivity. For additional information, refer to PDCM Arrays of registered state change notification (RSCN) service requests to FICON devices. If a - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 137
configuring definitions in a PDCM array, all FCP devices are configured Switches support auto-sensing of 1.0625 and 2.1250 Gbps device connections. The Intrepid 10000 Director supports 1.0625, 2.1250, and 10.2000 Gbps device connections. The introduction of a higher data transmission speed to the SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 138
director or switch ports for device connectivity. When installing 10.2000 Gbps-capable fabric elements in a core-toedge topology, deploy the directors at the fabric core a unique domain (director or switch). The current FICON be configured using multiple directors and switches (FICON cascading). In - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 139
with Enterprise Fabric Mode enabled. High-integrity fabric architecture support includes: • Fabric binding - Only directors or switches with fabric binding installed are allowed to attach to specified fabrics in a SAN. Specifically: - Fabric elements without a SANtegrity Binding feature key are - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 140
a FICON-cascaded SAN: • A single-vendor switching environment with two or more of the following McDATA directors or switches: - Intrepid 6064 or 6140 Director. - Sphereon 3232 Fabric Switch. • E/OS Version 4.0 (or later) must be installed on all directors or switches. E/OS firmware Version 6.0 (or - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 141
follows: a. Ensure fabric elements are defined to the SAN management application. If the elements must be defined, refer to the appropriate switch or director installation manual for instructions. b. Ensure the preferred Domain_ID for each director or switch is unique and does not conflict with the - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 142
SANtegrity Binding feature at each director or switch as follows: a. At the Element Manager application, install the SANtegrity Binding PFE key. Refer to installation instructions in the product-specific Installation and Service Manual. b. At the SAN management application, configure fabric binding - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 143
verify FICON devices (channels and control units inspected in step 5) are still logged in to each director or switch. 8. Change switch binding enforcement if required - If the SAN environment is volatile (characterized by a high volume of optical cable connects, disconnects, and movement), change - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 144
Considerations for Fibre Channel Topologies 3 NOTE: An cascaded switch is a fabric director or switch connected to a destination control unit and an entry switch. c. Run the IOCP to create an input/output configuration data set (IOCDS). The switch ID (CHPID macroinstructions) and 2-byte link address - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 145
dictate data retention and security policies. The solution for these problems is to implement a internetworking strategy that consolidates IT resources for implementing SAN internetworking solutions using McDATA switch products. The chapter specifically describes: • SAN island consolidation. - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 146
applications must be purchased to administer each SAN. If high availability and non-blocking performance are required, director-class switches must be purchased for each SAN. • Complex interdependencies and data congestion because fabric switches are connected with multiple interswitch links (ISLs - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 147
selection process ensures each fabric element has a unique Domain_ID. This process determines which director or fabric switch acts as the master in a newly-configured SAN and allocates unique Domain_IDs to the remaining elements. Without this process, two elements could have the same Domain_ID - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 148
addition, protocol enhancements may force vendors to support multiple firmware versions for the same product. These issues make it difficult to connect directors or fabric switches from different original equipment manufacturers (OEMs) to build a large SAN. McDATA offers the following solutions for - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 149
, allowing management and administration from a single point of control. Figure 4-1 illustrates director FlexPar functionality. Figure 4-1 Intrepid 10000 Director FlexPar Functionality A SAN management application (SANavigator Version 4.2 or later, or Enterprise Fabric Connectivity Manager (EFCM - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 150
SAN Internetworking Solutions 4 • Create up to three additional FlexPars and assign resources to those FlexPars. • Perform director firmware upgrades to all Flexpars. • Enable or disable the protocol subsystem for any Flexpar. • Enable or disable switch or online, or when a local switch is - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 151
). When installing a new director or switch with E/OS 7.0 (or problems caused by human error increases significantly. Implementation of role-based access control (RBAC) through role-based FlexPars (available for McDATA products by mid-2005) can control and mitigate these problems. Through a SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 152
in such a manner are called SAN Routers. Routed SANs typically include directors and fabric switches from different vendors, operating in mixed modes, using different protocols (such as Fibre Channel and iSCSI), and using several firmware versions. Multi-protocol SAN routing provides larger-scale - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 153
information. • Tier 3 - To connect geographically remote fabrics or mSANs, the third tier consists of internetworked storage area networks (iSANs). SAN routers transmit data between mSANs through intelligent ports, using Internet Fibre Channel protocol (iFCP). Refer to iSAN Routing for additional - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 154
4 Figure 4-3 SAN Routing Concepts The following sections discuss SAN routing concepts, including: • R_Port operation. • Routed SAN zoning. • mSAN routing. • iFCP operation. • iSAN routing. • Inter-FlexPar routing. • Best practices. 4-10 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 155
E_Port, a SAN router R_Port behaves as a virtual one-port edge switch (with a unique Domain_ID) and terminates Class F traffic at the boundary of the connected fabric. Class F traffic provides control, coordination, and configuration of fabrics. Directors and fabric switches use Class F services to - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 156
cannot be changed, therefore an R_Port cannot become the principal switch in the fabric. The implication of a virtual edge switch is that each director or switch connected to a SAN router has no knowledge of other directors or switches (unless they are physically connected through E_Port ISLs). This - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 157
through an iFCP link. Figure 4-5 illustrates routing domains and shows the logical connectivity of Fabric 1 (one switch) and Fabric 2 (one director and one switch) through an Eclipse 2640 SAN Router. Figure 4-5 SAN Routing - Logical Connectivity Implementing SAN Internetworking Solutions 4-13 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 158
McDATA Fabric 1.0, Domain_IDs of 30 and 31 are recognized by SAN management applications and all attached devices. For attached fabrics in follows: • One Fibre Channel director (Domain_ID 7) with direct-attached devices D3 and D4. • One Fibre Channel switch (Domain_ID 8) with direct-attached - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 159
is recommended that insistent (unique) Domain_IDs be assigned to directors, fabric switches, and R_Ports in routed fabrics. Assigning Domain_IDs results in a SAN router connects to a Fibre Channel fabric, device information is mutually exchanged. The router and the fabric's principal switch register - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 160
fabric manager or not) participate in FSPF routing protocol and traffic forwarding. SAN Routing provides flexibility with respect to zoning behavior and interactions between a router visible to both fabrics through standard SW_RSCNs. 4-16 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 161
of use and retention of primary zoning control by Fibre Channel SAN management applications. Cross-fabric devices are zoned together (IPS zone to numerous fabrics, this policy is much easier than creating router zones manually (using the No Zone Synchronization policy). The IPS zone set appended to - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 162
all directors and switches in each routerattached fabric and appears as a virtual switch (with Domain_ID 30) to SAN management - 16 17 - 20 21 - 24 25 - 28 29 - 32 33 - 36 37 - 40 41 - 44 45 - 48 Fabric_ID 1 2 3 4 5 6 7 8 9 10 11 12 4-18 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 163
Implementing SAN Internetworking Solutions 4 During SAN router configuration, each R_Port is assigned (through the SANvergence manager application) a unique Fabric_ID between 1 and 12. Although the theoretical limit is 12 Fabric_IDs per mSAN, the supported limit is six. As shown in Table 4-1, four - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 164
services such as packet reordering, retransmission of lost packets, or detection of duplicate packets. Therefore, only direct, high-reliability fiber-optic cable connections between SAN routers are supported bytes for UDP versus 20 bytes for TCP) and potential performance problems. The header is - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 165
not affect this limit. Fibre Channel switches per fabric Maximum number of directors or fabric switches per fabric is 12. The number of SAN routers (one or two) does not affect this limit. Fibre Channel switches per mSAN Maximum number of directors or fabric switches per mSAN is 48. The number - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 166
a disruptive or nondisruptive build fabric event. In fact, a stretched E_Port is vulnerable to disruptions caused by events at each site and to disruptions caused by problems with the extended-distance TCP/IP link. 4-22 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 167
delivered to the destination device. iFCP can accommodate up to 64 TCP sessions per port. A TCP session opens for each pair of port WWNs that initiate a process login. SAN routers have both FCP and IP interfaces. The Eclipse 1620 SAN router has two ports that provide IP network connectivity at up - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 168
at 1000 Mbps. iFCP is optimized for TCP/IP-based Internet service provider (ISP) networks. Unlike conventional SAN extension, iSAN Routing terminates the stretched E_Port connection at each fabric complex, multi-site storage applications. 4-24 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 169
enables mSAN routing. When communicating with directors and switches in a specific fabric, SAN routers advertise devices associated with routing connected behind proxy Domain_ID 30 (fabric over mSAN). Therefore, if a problem occurs and there is no connectivity to routing domain 30 (hexadecimal 7E), - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 170
problem. Refer to Intelligent Port Speed for detailed information about rate limiting. • Data compression - SAN The algorithm is recommended when up to 64 TCP sessions are used and the average compression ratio increase of approximately 20% over LZO. The algorithm is SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 171
Implementing SAN Internetworking Solutions 4 and results in a lower compression bandwidth. The initiator to transmit an entire data set, then buffers the output data at the SAN router closest to the corresponding target device. This eliminates multiple XFR_RDY command transmissions and minimizes - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 172
LAN protocol to support short-distance SAN WAN Protocol to support extended-distance router connectivity SAN router connectivity User Director, the director is divided into multiple sub-directors, each operating with independent management and services. This consolidates application-based SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 173
B devices. An E_Port from each FlexPar is physically connected to a SAN router R_Port, and Flexpar C servers are zoned to communicate with Flexpar as follows: 1. Plan the configuration - Map and design the routed SAN configuration on paper, prior to installing and configuring real equipment. This - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 174
Channel directors, fabric switches, and SAN router R_Ports. Ensure the Insistent Domain_ID option is enabled at the SAN management From data center to remote site A: Zone_ID Range 1 to 20. From data center to remote site B: Zone_ID Range 21 to 40. From data center to remote site C: Zone_ID Range - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 175
router A to port 14 of SAN router B. 10. Track iFCP sessions - Every initiator-to-target device pair in a merged zone is assigned an iFCP session. Be aware of the number of active iFCP sessions. If approaching the per-port limit (64 sessions) un-export zones without active storage traffic to free - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 176
Implementing SAN Internetworking Solutions 4 Local mSAN Name: Boston Exported Zone_ID Range: 1 to 100 Local Zone_ID Range: 101 to 512 Local mSAN_ID: 20 Date: 1/12/ 23.1.1.1 3 15.2.3.7 8 15.1.1.1 Description To Chicago. To New York. 4-32 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 177
Implementing SAN Internetworking Solutions 4 Local mSAN Name: Chicago Exported Zone_ID Range: 1 to 100 Local Zone_ID Range: 101 to 512 Port External IP Address To Port Number Remote Mgmt IP Address 2 10.1.1.7 7 10.1.1.1 Description To Boston. Implementing SAN Internetworking Solutions 4-33 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 178
. c. The error detect time-out values (ED_TOVs) must be identical. This parameter is set at the director or fabric switch Element Manager application SAN routers support existing multivendor fabrics. However, when building a new fabric, it is good practice not to mix director and fabric switch - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 179
associated WWN-zoned device). e. If router-attached directors and fabric switches have zoning licences and the zone policy is switch binding), OpenTrunking feature, or Enterprise Fabric Mode enabled. These features must be disabled before connecting the router. In addition, SAN routers do not support - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 180
assets and protects against business disruptions caused by facility outages, IT or communication problems, natural disasters, or terrorism. • Provides real-time disaster recovery of with WANs introduces variable delays and high latency. 4-36 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 181
service and rely on upper-level protocols for end-to-end transport. Because of these differences, a protocol conversion approach is usually required to integrate Fibre Channel SAN technology (described in SAN Extension Transport Technologies) that best support the SAN distance-extension strategy. - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 182
if operation at the primary site is disrupted. The problem with SDR is distance limitation. Although propagation of laser light I/O operations resume. Replication software on the remote storage array controller ensures data is successfully written to the remote a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 183
to connect geographically-dispersed SAN islands, all of which by the service provider. The service lessee is 75 miles (120 km) with repeaters. The supported bandwidth is dependent on fiber-optic quality and the available through the Intrepid 10000 Director buffer pool). Refer to Distance - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 184
SAN Internetworking Solutions 4 • Creates one logical Fibre Channel fabric through a stretched E_Port connection. The connection is vulnerable to disruptions caused by events at each site or to disruptions caused by problems 4, 16, 32, 64, or eventually more). Technology that provides 64 wavelengths - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 185
Implementing SAN Internetworking Solutions 4 Light wavelengths used are typically around 1,550 nanometers (nm). Optical fiber performs well in this wavelength region, with very little attenuation. For CWDM, differing wavelengths are separated by multiples of 20.0 nm. For DWDM, differing wavelengths - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 186
caused by events at each site or to disruptions caused by problems with the extended-distance WDM link. Several network service providers provide metropolitan and longdistance (intercity) WDM transport services. WDM service can be purchased on a monthly basis in accordance with a negotiated - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 187
without user intervention. This makes SONET and SDH highly-available services. Generic Framing Procedure (GFP) is a protocol-independent SONET from 50 Mbps to full Fibre Channel rates. To support storage extension over long distances, GFP provides buffering and SAN Internetworking Solutions 4-43 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 188
by events at each site or to disruptions caused by problems with the extended-distance SONET link. - Native FCP (routed support native FCP or FICON operation. Several network service providers provide metropolitan and intercity SONET and SDH transport services in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 189
application support. The protocol can be used over the Internet or a dedicated GbE network (with IP traffic engineering). Each connected Fibre Channel fabric (or SAN) is maintained separately, while the IP or GbE network provides connectivity, congestion control, error detection, and error recovery - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 190
SAN connection ensures disruptions at one site are isolated and not allowed to propagate to other locations. This connection does not support native FCP or FICON operation. Figure 4-11 SoIP Extended-Distance Connectivity Several network service supports medium one or more SAN routers are included - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 191
than SONET or SDH. Unless one or more SAN routers are included in the extended-distance link (native FCP only), the technology is vulnerable to disruptions caused by fabric or link problems. • SONET and SDH - These technologies support mediumbandwidth, medium-latency applications with short-to-long - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 192
connected SANS and prevents disruptions caused by fabric or link problems. Table the highest level of long-distance connectivity but supports only low-bandwidth, high-latency applications. • hours over a 2 Gbps, 32-channel WDM connection. 4-48 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 193
(Gbps), one BB_Credit supports a two km transmission distance (1:2 ratio). • At 2.1250 Gbps, one BB_Credit supports a one km transmission distance (1:1 ratio). • At 10.2000 Gbps, six BB_Credits support a one km transmission distance (6:1 ratio). Implementing SAN Internetworking Solutions 4-49 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 194
key is enabled (refer toRemote Fabric for information). Each director line module (LIM) contains two scalable packet processors, each supporting two optical paddles. A paddle pair provides 16 ports (1.0625 or 2.1250 Gbps operation), four ports (10.2000 Gbps operation), or ten ports (mixed data rate - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 195
16 BB_Credits are assigned to the slowest eight short-link ports, and 96 BB_Credits are assigned to one 10.2000 Gbps short-link port (224 BB_Credits total). The remaining 1149 BB_Credits are assigned to the long-link port, supporting Rate Limiting) To prevent this problem, enable rate limiting to - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 196
SAN router for extended-distance operation over an IP WAN link, the peak available bandwidth must be determined or obtained from the network service connectivity. • Eclipse 2640 SAN Router - Four user-configurable intelligent ports (13 through 16) can be configured SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 197
SAN Internetworking Solutions 4 • Digital Signal 1 (DS1) - A framing and formatting specification that transmits 24 digital data channels on a T1 synchronous line. Each channel transmits at 64 22.7%, which provides a bandwidth of 34.59 Mbps (4.32 MBps) for storage traffic. • Optical Container 1 (OC - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 198
Implementing SAN Internetworking Solutions 4 • Fast Ethernet - A transmission medium specified by IEEE 802.3 that a backup requirement of 1.74 MBps. An DS3 link (ATM) with a bandwidth of 4.32 MBps is the appropriate choice. This link provides nearly 2.5 times the required bandwidth to account - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 199
dedicated bandwidth is not available, quality of service (QoS) processing applied to shared bandwidth by GbE switches in an extended-distance link, SAN routers negotiate the use of flow control with these switches. Whenever supported by all IP network equipment in the data link. Implementing - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 200
queues and drop thresholds allow the switch to prioritize output when faced with congestion. 3. Minimize fabric hop count - The maximum supported hop count in a fabric is SDR and ADR software OEMs do not support IP network link failover. 4-56 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 201
not supported between data replication - Storage array ports should be dedicated switches should be set to auto-negotiate with SAN routers to provide connectivity. The setting can be disabled only if both devices are set to not auto-negotiate. 11. Set data compression level to Auto - Two problems - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 202
gateways (such as Eclipse-series SAN routers). Server HBAs and storage array NICs connect iSCSI resources over an IP network. Core transport layers are managed with existing . • iSCSI server consolidation. • SCSI storage consolidation. 4-58 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 203
SAN inherent distance and device support limitations. For storage applications data. The target is a passive resource (such as a disk array) that responds to initiator requests. When a server application sends a in terms of distance extension and switching capabilities. Fibre Channel also preserves - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 204
are often very high in terms of dollars and personnel time. The decentralized infrastructure also causes availability and reliability problems. For example: • Many servers quickly run consolidation. Figure 4-15 iSCSI Server Consolidation 4-60 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 205
co-located. Servers can now access robust, scalable, and easily managed SAN storage that provides better data availability. In general, the largest expense to Fibre Channel servers. Figure 4-16 illustrates iSCSI storage consolidation. Figure 4-16 iSCSI Storage Consolidation As shown in the - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 206
Implementing SAN Internetworking Solutions 4 4-62 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 207
Ethernet local area network (LAN), and remote access support. • Security provisions for access to directors, switches, or the management server (password protection), and for customer data paths through directors, fabric switches, and SAN routers. • Optional feature keys. Port Connectivity and Fiber - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 208
both. - XPM cards provide one 10.2000 Gbps port connection and can be configured with shortwave or longwave transceivers. • Intrepid 6140 Director - The director is configured from a minimum of 16 UPM or XPM cards (64 ports total) to a maximum of 35 cards (140 ports total). - UPM cards provide four - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 209
that operate at 10.2000 Gbps provide two Fibre Channel port connections. A fully-populated director supports up to 64 connections and can be configured with shortwave or longwave transceivers, or a combination of both. • Sphereon 3232 Switch - The switch provides up to 32 duplex SFP fiber-optic - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 210
Distance between a director or fabric switch and the attached When using multimode cable, if the core diameter or data transmission rate increases, link errors or loss of signal occur. When using multimode cable, if the core in performance as the cable core diameter or data transmission rate - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 211
or 10.2000 Gbps (35-kilometer SFP optical transceiver) Unrepeated Distance 250 meters (820 feet) 120 meters (394 feet) 75 meters (246 feet) 500 meters (1,640 feet) 300 meters (984 feet) 150 meters (492 feet) 10.0 kilometers (6.2 miles) 20.0 kilometers (12.4 miles) 35.0 kilometers (21.7 miles) Link - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 212
multiplexing (WDM) equipment, directors and fabric switches (but not Sphereon 4300 or 4500 Switches) support Fibre Channel data transmission distances Cables for directors, fabric switches, and SAN routers. • Intrepid-series director, Sphereon-series fabric switch, and Eclipse-series SAN router - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 213
or 150 meters (10.2000 Gbps) and connects 20, or 35 kilometers and connects to longwave ports that transmit light at a 1300 nm wavelength. The cable typically has a yellow jacket. Multimode or singlemode cables attach to Intrepid-series director, Sphereon-series fabric switch, and Eclipse-series SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 214
(5 feet) of cable outside the cabinet to provide slack for service clearance, limited cabinet movement, and inadvertent cable pulls. • Cabling distance to servers, storage devices, and directors (for multiswitch fabric support). The need for additional fiber-optic cabling could grow rapidly. More - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 215
cabinet. The server supports up to 48 McDATA directors, fabric switches, or SAN routers (managed products). The server is used to configure the product and associated SAN management and Element Manager applications, monitor product operation, change configurations, download firmware updates, and - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 216
to an authorized support center (to report the occurrence of significant system events) using a call-home feature. The call-home feature is enabled in the Element Manager application and configured through the dial-up networking feature of Windows 2000. Directors, fabric switches, SAN routers, and - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 217
service clearance, limited cabinet movement, or inadvertent cable pulls. Store extra Ethernet cable in the cabinet or under the computer room raised floor. • Consolidating management server operation - For control and efficiency, all directors, fabric switches, and SAN SAN routers is not supported. - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 218
one Ethernet connection through the management server is shown in Figure 5-2. Intrepid 6064 Directors are used as an example. Figure 5-2 Typical Network Configuration (One Ethernet connections is shown in Figure 5-3. Intrepid 6064 Directors are used as an example. 5-12 McDATA Products in - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 219
ten or 100 Mbps. SNMP Management Workstations An SNMP agent that runs on the management server can be configured through the SAN management application. This agent implements Version 3.1 of the Fibre Alliance management information base (MIB) as follows: Physical Planning Considerations 5-13 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 220
that runs on each director, fabric switch, or SAN router (configured through the associated Element Manager application). The director or switch SNMP agent can be . NOTE: SANpilot interface access to SAN routers is not supported. 5-14 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 221
director, switch, or attached Fibre Channel devices. Access to the director or switch (through the SAN to the SAN management and Element Manager applications requires configuration of a user name and password. Up to 16 user ports and placing the product online or offline. The product administrator - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 222
SAN management application to assign remote workstation access to directors and switches addresses at the SAN management application, enhances SAN When accessing a director or fabric switch for the changed. When accessing a director or switch for the first time (director, fabric switch, or SAN router - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 223
once), an ID value (incremented at each login), and a shared CHAP secret (16-byte random value) to the server. The server concatenates the random value, ID secret is configured for each fabric-attached director or switch (because OSMS is a fabric service that assumes all attached fabric elements are - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 224
support - Remote authentication dial-in user service (RADIUS) is a client-server, UDP-based protocol that supports storage and authentication of passwords and CHAP secrets. Directors, fabric switches, and SAN routers support Enterprise Operating System (E/OS) firmware and does not require enablement - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 225
. Obtain planning assistance from McDATA's professional services organization before implementing the feature. SANtegrity Binding SANs. The feature allows or prohibits director or switch attachment to fabrics (fabric binding) and Fibre Channel device attachment to directors or switches (switch - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 226
the director or fabric switch level using the Configure Allow/Prohibit Matrix - Active dialog box (Figure 5-4), where the user specifies an array in which logical port addresses are allowed or prohibited from connecting with each other (including E_Port connectivity). 5-20 McDATA Products in a SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 227
box, ensure the FICON management style is enabled for the director or switch, then select the Allow/Prohibit and Active options from the Element array that prohibits E_Port connectivity, be aware that ISLs can be configured as unavailable to attached devices, causing complex routing problems that - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 228
Considerations 5 Figure 5-5 PDCM Array - Example Problem A PDCM array configured for Director A prohibits logical port address 05 from communicating with logical port addresses 0A, 0B, and 0C. No PDCM array is configured for Director B. The PDCM array configured for Director A prohibits the source - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 229
fabric element, a preferred path consists of a source port on the director or switch being configured, an exit port on the director or switch, and the Domain_ID of the destination director or switch. Each participating director or switch must be configured as part of a desired path. The following - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 230
from the source port, and if congestion is present on the path. To avoid problems in FICON environments, vary associated channel path identifiers (CHPIDs) temporarily offline, configure the preferred path, and vary the CHPIDs back online. 5-24 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 231
Directors and fabric switches support a user configuration that partitions attached devices into restricted-access groups called zones. Devices in the same zone can recognize and communicate with each other through switched For later versions of director or fabric switch firmware (E/OS Version 6.0 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 232
are configured through the SAN management application (SANavigator 4.2 or EFCM 8.6) by authorizing or restricting access to name server or route table information (depending on the firmware release level) associated with device N_Ports that attach to director or switch fabric ports (F_Ports). System - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 233
switches in a multiswitch fabric. Only one zone set can be enabled at one time. Zone members are defined and zones or zone sets are created using the SAN management application. McDATA products support is 64. • Active zone set - the zone set that is active across all directors and switches in - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 234
service requests - registered state change notification (RSCN) service requests are transmitted to all N_Ports or NL_Ports attached to the director or switch director or switch, regardless of zone membership. Directors and fabric switches directors and switches switches or switch in directors or switches - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 235
Obtain planning assistance from McDATA's professional services organization before implementing the director or switch zoning feature. Server and Storage- and network security provided by zoning through the director or fabric switch, security measures for SANs can also be implemented at servers and - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 236
different director or switch port. Access control can also be implemented at the storage device as an addition or enhancement to redundant array of LUN level and does not require configuration at the server. • Supports a heterogeneous server environment and multiple server paths to the storage device - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 237
the SAN management application) that allows only user-specified directors or switches to attach to specified fabrics in a SAN. - Switch binding device-level access control. However, a connection allowed through a PDCM array may be prohibited through SANtegrity Binding. 4. Hardware-enforced zoning - - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 238
fabric routing decisions on a switch-by-switch or port-by-port basis. The path instructs a fabric to use a preferred exit port out of a director or fabric switch for a specified receive port and target domain. If a preferred path is prohibited by SANtegrity Binding, PDCM arrays, or hard zoning, the - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 239
• SANtegrity Authentication - Purchase and enablement of this feature enhances security in SANs by restricting unregulated access to Fibre Channel directors and fabric switches. NOTE: SAN routers do not support SANtegrity Authentication. • SANtegrity Binding - Purchase and enablement of this feature - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 240
UltraNet Edge storage routers. NOTE: Directors and SAN routers do not provide CNT wide area network (WAN) support. • Element Manager application - This feature enables director or switch management through the Element Manager user interface. Directors and switches are delivered with the application - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 241
-compatible HBAs, third-party SAN management applications, and minimum OSI server specifications, refer to the McDATA website at www.mcdata.com. When the FMS feature key is enabled at the Element Manager application, host control and management of the director or switch is provided through a server - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 242
or from 24 to 32 ports. • Sphereon 4300 Fabric Switch from four to eight ports or from eight to 12 ports. • Sphereon 4500 Fabric Switch from eight to 16 ports or from 16 to 24 ports. Each port expansion kit includes four or eight SFP optical transceivers, upgrade instructions, and a feature key that - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 243
CT authentication for the OSMS interface; RADIUS server support; inband and out-of-band access controls lists; SAN data security. The feature includes: • Fabric binding - This portion of the feature allows only specified directors or fabric switches to attach to specified fabrics in a SAN. • Switch - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 244
and fabric switches with E/OS Version 6.0 and later) that supports military, classified, or other high-security environments that require Fibre Channel data not be retained by the director or fabric switch after power off or failure. 5-38 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 245
is provided only for the Sphereon 4300 Fabric Switch. Intrepid 10000 Director LIMs contain two scalable packet processors, each supporting an optical paddle pair. Each paddle pair provides 16 ports (1.0625 or 2.12500 Gbps operation), four ports (10.2000 Gbps operation), or ten ports (mixed data rate - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 246
SANs and consolidate computer resources through WAN extension technology. Therefore, edge switches deployed as part of a core-to-edge fabric often require WAN connectivity. This connectivity is provided by the CNT WAN support installed - Please follow up instructions to update permanent key appears - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 247
Physical Planning Considerations 5 Figure 5-10 Hardware View (with Element Manager Message) Physical Planning Considerations 5-41 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 248
Physical Planning Considerations 5 5-42 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 249
installing one or more McDATA Fibre Channel switching products in a storage area network (SAN) configuration. Table 6-1 summarizes planning tasks Task 4: Plan Console Management Support Task 5: Plan Ethernet Access Task 6: Plan Network Addresses Task 7: Plan SNMP Support (Optional) Task 8: Plan - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 250
director, fabric switch, SAN router, or FC-512 Fabricenter equipment cabinet installed, design a site plan that provides efficient work flow, operator convenience and safety, and adequate service service) for the management server to support the call-home feature or provide remote dial-in support. - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 251
director or switch. • Facility access and security clearances for installation personnel. • Equipment cabinet front and rear service clearances to meet the connectivity requirements for all fabric elements (directors, fabric switches, and SAN routers), Fibre Channel servers, and devices. Plan for - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 252
a substantial level of testing to ensure director, fabric switch, and SAN router interoperability with fabric elements and end devices fabric elements) is supported. Inband management through the open-systems management server (OSMS) is also supported. • When a director or switch is set to FICON - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 253
of the following to provide console management and support for directors, switches, and SAN routers: • Management Server - The 1U rack operating director, switch, or SAN router to fail. - The management server is fully operational, even if there is no user logged in to the Windows 2000 Professional - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 254
disabled if the management server is powered off. NOTE: Remote management server access to SAN routers is not supported. • Inband management support - If inband console management of a director or fabric switch is required, plan for a Fibre Channel port connection that communicates with the attached - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 255
switches, SAN routers, and the management server be installed on a dedicated Ethernet hub and LAN segment to avoid security, traffic, and fault isolation problems Depending on the configuration of the LAN on which directors, switches, SAN routers, and the management server are installed, plan - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 256
these devices connect to the LAN through a router or other gateway device. The Ethernet connections for the 1U management server, directors, fabric switches, and SAN routers have the following default network addresses: • 1U Management server: - Media access control (MAC) address is unique for each - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 257
Configuration Planning Tasks 6 • Eclipse 1620 SAN Router: - System addresses: • MAC address is unique for each External IP address is 0.0.0.0. • Internal IP address is 192.168.111.104. • Eclipse 2640 SAN Router: - System addresses: • MAC address is unique for each product. • Default IP address is - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 258
• Gateway address is 0.0.0.0. - Intelligent port (13 through 16) addresses: • Default IP address is 0.0.0.0. • Subnet mask Plan SNMP Support (Optional) As an option, network administrators can use the SAN management application that runs on each director, fabric switch, or SAN router. This agent can - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 259
as defined in RFC 821. NOTE: E-mail notification for SAN routers is not supported. Task 9: Establish Product and Server Security Measures Effective network security measures are recommended for directors, fabric switches, SAN routers, and the management server. Physical access to the network - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 260
voice technical support through a telephone connection. • A service representative may need to connect to the management server through the internal modem to access maintenance and utility functions, check status, and perform other tasks. 6-12 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 261
worksheet provided as part of Task 13: Complete the Planning Worksheet. Task 12: Assign Port Names and Nicknames Consider assigning names to director, switch, or SAN router ports based upon devices connected to the ports. Though not required, port naming provides convenience and ease of use. Port - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 262
Lab server. Test system-2. Printer_001. Nicknames can be up to 32 alphanumeric characters in length. Spaces, hyphens, and underscores are allowed task is an eight-page form that depicts port assignments for a director, switch, or SAN router. The worksheet lists 256 ports, equal to the capability of - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 263
Product Planning Worksheet (Page 1 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 Configuration Planning Tasks 6 IP Address Zone Configuration Planning - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 264
Planning Worksheet (Page 2 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 IP Address 6-16 McDATA Products in a SAN Environment - Planning Manual Zone - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 265
Product Planning Worksheet (Page 3 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model 40 41 42 43 44 45 46 47 48 49 50 51 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 266
Planning Worksheet (Page 4 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model IP Address Zone 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 6-18 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 267
Product Planning Worksheet (Page 5 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model 80 81 82 83 84 85 86 87 88 89 90 91 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 268
(Page 6 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model IP Address Zone 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 6-20 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 269
(Page 7 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 Configuration Planning Tasks 6 IP Address Zone Configuration Planning Tasks 6-21 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 270
(Page 8 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model IP Address Zone 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 6-22 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 271
Product Planning Worksheet (Page 9 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model 160 161 162 163 164 165 166 167 168 169 170 171 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 272
(Page 10 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model IP Address Zone 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 6-24 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 273
Product Planning Worksheet (Page 11 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 Configuration Planning Tasks 6 IP Address Zone - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 274
(Page 12 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model IP Address Zone 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 6-26 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 275
Product Planning Worksheet (Page 13 of 13) Switch Name Attached Devices IP Address Unit Name Port Port Name Location Type Model 240 241 242 243 244 245 246 247 248 249 250 251 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 276
63 Hz, 200 to 240 VAC, and requires a minimum dedicated 15-ampere service. • The Intrepid 10000 Director operates at 47 to 63 Hz, 200 to 240 VAC, and requires a minimum dedicated 20-ampere service. • Other directors, fabric switches, and SAN routers in the cabinet operate at 47 to 63 Hz, 100 to 240 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 277
growth requirements, and service requirements. Refer to Fabric Topologies, Planning for Multiswitch Fabric Support, and General Fabric paths that transfer data for critical operations directly through one director or fabric switch and not through the fabric. Planning and implementing a - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 278
zone operation, zoning by WWN is recommended. NOTE: SAN routers do not support port number zoning. • Zoning implications for a multiswitch fabric - To ensure zoning is consistent across a multiswitch fabric, directors and fabric switches must have compatible operating parameters and unique domain - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 279
cables with appropriate connectors must be routed between Fibre Channel elements (storage devices, servers, directors, and fabric switches) and the SAN router. Eclipse-series SAN routers support small form factor pluggable (SFP) optical transceivers with LC duplex connectors. Configuration Planning - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 280
SAN router. The Eclipse 1620 SAN Router supports SAN Router supports SFP optical transceivers with LC duplex connectors. • Establish operational mode and transport technology - Establish if the operational mode is expected to support SAN network service provider. To prevent this problem, enable rate - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 281
Negotiate SLA - Network service providers provide IP WAN transport services in accordance with a negotiated service level agreement (SLA). Ensure network between SAN routers must be configured, operational, tested, and able to support bidirectional storage traffic. Specifically: - SAN routers must - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 282
Planning Tasks 6 Task 18: Complete Planning Checklists As a guide for planning tasks, complete the planning checklists under this task cabling requirements, routing requirements, and to plan connectivity between directors, fabric switches, SAN routers, and attached devices. • Trainers to determine - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 283
connectors. Cables must support Fibre Channel network, management network, and IP WAN network (if SAN routing is supported) connectivity. Order local area network (LAN) connections for directors, fabric switches, SAN routers, and the management server. 10, 20, or 35 kilometers for 9/125 mm - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 284
Remote workstation access is supported for directors and fabric switches only. If SAN routing is supported, rate limiting must be configured and enabled based on peak available bandwidth. If SAN routing is supported, an SLA must be negotiated with a network service provider to ensure reliable - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 285
be used. Determine SNMP access to directors and switches. Due Date Comments Management server and core-to-edge, or fabric (SAN) island). Define the distance extension operational mode and transport technology. To support SAN routing, determine how zoning information is synchronized between a SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 286
Configure extended distance ports. Enable and configure optional feature keys. Configure link incident alerts. Configure Ethernet events. Task Owner Due Date Comments If SAN routing is supported, configure extended distance ports in accordance with IP WAN requirements. 6-38 McDATA Products in - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 287
, fabric switches, and SAN routers. Dimensions McDATA products have the following physical dimensions: Intrepid 6064 Director: Height: 39.7 centimeters (15.6 inches) or 9 rack units. Width: 44.5 centimeters (17.5 inches). Depth: 54.6 centimeters. (21.5 inches). Weight: 53.1 kilograms (117.0 pounds - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 288
(17.5 inches). Depth: 64.1 centimeters (25.2 inches). Weight: 16.8 kilograms (37.0 pounds). Sphereon 4300 Switch: Height: 4.1 centimeters (1.6 45.7 centimeters (18.0 inches). Weight: 5.9 kilograms (13.0 pounds). Eclipse 2640 SAN Router: Height: 4.1 centimeters (1.6 inches) or 1 rack unit. - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 289
must be connected directly to facility power outlets. The director draws a current of 32 amperes at power-on, and must not be connected to power strips in the FC-512 Fabricenter equipment cabinet. Input frequency: 47 to 63 Hz. Sphereon 3232 Switch: Input voltage: 100 to 240 VAC. Input current - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 290
Switch: 49 watts (167 BTU/hr). Eclipse 1620 SAN Router: 73 watts (239 BTU/hr). Eclipse 2640 SAN Router: 198 watts (676 BTU/hr). McDATA products have the following cooling airflow clearances. In addition, the Intrepid 10000 Director may require removal from an equipment cabinet (left-side service - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 291
(3.0 inches). NOTE: If the Intrepid 10000 Director is installed in a non-McDATA equipment cabinet Top and bottom: No clearance required. Sphereon 3232 Switch: Right and left side: No clearance required. and bottom: No clearance required. Eclipse 2640 SAN Router: Right and left side: No clearance - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 292
and vibration tolerances, and inclination tolerances for McDATA directors, fabric switches, and SAN routers. Acoustical noise generated: Intrepid 6064 Director: 55 dB "A" scale. Sphereon 4300 and 4500 Switches: 64 dB "A" scale. Intrepid 10000 Director: 75 dB "A" scale. All other products: 70 dB - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 293
specifications (dimensions, weight, power requirements, cooling airflow clearances, and service clearances) for the FC-512 Fabricenter equipment cabinet. An illustration (41.5 inches). Weight (no installed products): 153.2 kilograms (337.0 pounds). Weight (shipping container): 50.9 kilograms (112 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 294
63 Hz. Clearances The Fabricenter cabinet has the following cooling airflow and service clearances. Cooling airflow clearances: Right and left side: No clearance required. Front and (four total). 5. Power cable cutout (one). A-8 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 295
Product Specifications Figure A-1 Fabricenter Cabinet Footprint Product Specifications A-9 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 296
Product Specifications A-10 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 297
Operating System (E/OS) for Intrepid 6000-series directors and Sphereon-series fabric switches; Enterprise Operating System, nScale (E/OSn) for the Intrepid 10000 Director; and Enterprise Operating System, internetworking (E/OSi) for Eclipse-series SAN routers. The appendix includes tables that list - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 298
CTP card memory every hour then downloaded to FRU ROM upon FRU failure. Power-on-hour updates not applicable. 10.2000 Gbps port operation not 10.2000 Gbps port operation available. supported. 10.2000 Gbps port operation not available. B-2 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 299
FlexPars supported Flexpar feature not supported. for each Intrepid 10000 Director chassis. For directors, one 9-pin, RS-232 serial port shared between two CTP cards. Port-attached device communicates only with the active card. For fabric switches, one 9-pin, RS-232 serial port per switch. Each - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 300
staging not supported. staging The Intrepid 10000 Director supports E_Port staging. The director allows only one E_Port connection to a neighbor switch to of RSCNs generated. SAN routers coalesce all RSCN events. Generating fabric format RSCNs after CTP failover (directors) Does not replicate - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 301
port traffic and applies a delay to allow frames internal to the director to be transmitted. This delay during route reprogramming prevents frames being sent out of order. Reroute delay not supported. Switch internal link services (SW_ILS) during fabric build SW_ILS sequences transmitted on up to - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 302
support Port TTAs supported through the EFCM and CLI interfaces. Switch performance threshold alerts (SPTAs) not supported. Port TTAs supported through the Intrepid 10000 Director style (with associated PDCM array) not supported. B-6 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 303
redundant CTP card configuration. FICON management style (with associated PDCM array) not supported. Full volatility support Full volatility supported through PFE key. Full volatility always supported because the Intrepid 10000 Director does not persistently store data frame contents on any FRU - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 304
Firmware Summary Table B-6 E/OS versus E/OSn and E/OSi - Management-Related Differences (Continued) Feature E/OS 7.0 E/OSn 6.0 E/OSi 4.6 Port group online diagnostics (directors) Diagnostic errors for any single port in a group (port card) cause a group failure indication. Diagnostic errors - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 305
supported for one port or all ports on FPM, UPM, or XPM cards. Diagnostics supported for one port or all ports on an optical paddle pair. User provides a data pattern and duration through the CLI interface. Diagnostics supported for one port or all ports when the SAN router is offline. Firmware - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 306
BB_Credit value of 16. Intelligent ports support IP network connectivity and not assigned BB_Credits. Ports provide 96 MB of TCP packet buffering per transmission direction. When a user downloads firmware, performs a CTP card switchover, configures partitioning, or clears the system error light (or - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 307
management style not supported through the SANvergence Manager application. LED status indicators For director CTP and SBAR card switches: Green PWR LED indicates operational. Amber ERR LED indicates failed or beaconing. For CTP, SWM, or LIM card State LED (bicolor LED): Green indicates online - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 308
Firmware Summary B-12 McDATA Products in a SAN Environment - Planning Manual - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 309
3-31 arbitrated loop switch connectivity features 1-26 default network address 6-8 security features 1-28 serviceability features 1-29 arbitrated (SAN routing) 4-55 director ports 1-7 fabric switch ports 1-15 IP transport 4-48 IRL 4-25 ISL 3-22 rate limiting (SAN routing) 4-51 SAN router ports 1-21 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 310
setup tasks 6-36 planning and hardware installation tasks 6-35 class of service Class 2 1-8 Class 3 1-8 Class F 1-8 clearances directors A-4 fabric switches A-4 Fabricenter cabinet A-8 SAN routers A-4 CNT WAN support feature 5-40 command line interface 2-26 configuration diagram 6-13 connectivity - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 311
transport 4-47 data transmission distance cable type 5-4 multiswitch fabric requirements 3-21 transceiver type 5-4 default network addresses director or fabric switch 6-8 Eclipse 1620 SAN Router 6-9 Eclipse 2640 SAN Router 6-9 management server 6-8 device connectivity Tier 1 3-17 Tier 2 3-18 Tier - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 312
2-16 product overview 1-5 EFCM Lite application description 2-3 unsupported features 2-4 Element Manager application description (director and fabric switch) 2-19 description (SAN router) 2-22 feature key description 5-40 Hardware view 2-19 e-mail notification description 1-31 support planning - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 313
serviceability features 1-29 specifications A-1 Fabricenter cabinet footprint A-8 illustration 1-4 product overview 1-3 specifications A-7 fan-out ratio 3-35 FastWrite technology description 1-21 topology 3-2 core-to-edge fabric 3-16 mesh fabric 3-14 multiswitch fabric topology 3-2 SAN island 3-18 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 314
view 2-20 main window (director and fabric switch) 2-16 main window (SAN router) 2-21 SANavigator application 2-15 SANpilot View Panel 2-25 SANvergence Manager application 2-21 H Hardware view description 2-19 illustration 2-20 heat dissipation directors A-4 fabric switches A-4 SAN routers A-4 high - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 315
support 3-30 LIMs 5-2 Intrepid 6064 Director default network address 6-8 description 1-8 FRUs 1-9 illustration 1-9 port cards 5-2 Intrepid 6140 Director default network address 6-8 description 1-10 FRUs 1-11 illustration 1-11 port cards 5-2 IP address director or fabric switch 6-8 Eclipse 1620 SAN - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 316
4-36 reliability 4-37 logical port addressing 3-42 M MAC address director or fabric switch 6-8 Eclipse 1620 SAN Router 6-9 Eclipse 2640 SAN Router 6-9 management server 6-8 management server CHAP authentication 5-16 default network address 6-8 description 2-7 Ethernet connectivity 5-10 illustration - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 317
Manager 2-2 SNMP 2-3 oversubscription, ISL 3-32 P password authentication 5-16 protection 1-28, 5-15 PCP user database 5-17 PDCM arrays description 5-20 planning considerations 5-20 performance features directors 1-7 fabric switches 1-15 SAN routers 1-21 performance tuning a fabric 3-35 persistent - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 318
-any connectivity 1-26 Eclipse 1620 SAN Router 1-23 Eclipse 2640 SAN Router 1-24 Intrepid 10000 Director 1-14 Intrepid 6064 Director 1-10 Intrepid 6140 Director 1-12 port blocking 1-26 Sphereon 3232 Fabric Switch 1-16 Sphereon 4300 Fabric Switch 1-18 Sphereon 4500 Fabric Switch 1-19 zoning 1-26 port - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 319
routing 4-8 description 3-18 problems 4-2 SAN management application EFCM application 1-5 main window (director and fabric switch) 2-16 main window (SAN router) 2-21 product overview 1-5 SANavigator application 1-5 SANvergence Manager application 1-5 SAN router description 1-20 IRL optimization 4-25 - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 320
preparation 6-2 SNMP management workstations 5-13 MIBs 5-13 product management 2-3 support planning 6-10 software command line interface 2-26 EFCM application 2-15 Element Manager application (director and fabric switch) 2-19 Element Manager application (SAN router) 2-22 I-12 McDATA Products in - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 321
-home support 6-12 service support 6-12 Tier 1 fabric connections 3-17 Tier 2 fabric connections 3-18 Tier 3 fabric connections 3-18 topology arbitrated loop topology 3-2 core-to-edge fabric 3-16 fabric topology limits fabric elements 3-19 hop count 3-20 ISLs 3-20 vendor interoperability 3-20 mesh - HP StorageWorks 2/24 | FW 07.00.00/HAFM SW 08.06.00 McDATA Products in a SAN Env - Page 322
4-47 recovery time objective 4-47 weight directors A-1 fabric switches A-1 Fabricenter cabinet A-7 SAN routers A-1 wide area network comparison to joining 5-28 SAN router append IPS zones 4-17 no zone synchronization 4-16 SAN routing environment 4-34 zone policy (SAN routers) 4-16 zoning benefits 5-
McDATA
®
Products in a SAN
Environment
Planning Manual
P/N 620-000124-500
REV A