HP ProLiant DL380G5-WSS 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof
HP ProLiant DL380G5-WSS Manual
View all HP ProLiant DL380G5-WSS manuals
Add to My Manuals
Save this manual to your list of manuals |
HP ProLiant DL380G5-WSS manual content summary:
- HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 1
HP StorageWorks HP Scalable NAS File Serving Software provisioning guide for Oracle HP Scalable NAS 3.7 Part number: AG513-96013 Second edition: September 2009 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 2
L.P. Confidential computer software. Valid license from HP required for possession, use or copying. HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 3
instructions for Oracle Home 26 Configuring NLM for Oracle Home 27 Best practices for consistent user and group ids 27 Hosting Virtual NFS Services for high performance 28 Clearing NLM locks after a power failure on an NFS client 29 3 System Administrator: deploying database servers with HP - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 4
Oracle server operating system parameters 33 4 Oracle DBA: managing Oracle databases in a NAS environment 35 Configuring an Oracle database for HP Scalable NAS 35 NFS client I/O 35 Database writer processes 36 NFS client network performance considerations 37 Managing Virtual NFS Services using - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 5
23 5 Management Console showing four NAS heads and three Virtual NFS Services 24 6 Transitioning NFS heads by drag and drop 25 7 Management Console showing new primary server for VNFS 192.168.60.71 25 8 No direct NFS and no HP Scalable NAS cluster 40 9 Direct NFS introduced to the solution with - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 6
Oracle on an HP Scalable NAS cluster. Intended audience This guide is intended for NAS administrators, system administrators, and Oracle DBAs. HP technical support For worldwide technical support information, see the HP support website: http://www.hp.com/support Before contacting HP, collect the - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 7
://www.hp.com/support/manuals Documentation feedback HP welcomes your feedback. To make comments and suggestions about product documentation, please send a message to [email protected]. All submissions become the property of HP. HP Scalable NAS File Serving Software provisioning guide for - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 8
8 About this guide - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 9
NFS. Also beginning with 11g, Oracle has added support for access to storage for datafiles over NFS from Windows Oracle servers (both RAC and non-RAC databases) when using /deploy/performance/pdf/directnfsclient_11gr1_twp.pdf HP Scalable NAS File Serving Software provisioning guide for Oracle 9 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 10
Export Groups are presented to NFS clients via a Virtual NFS Service (or VNFS). A VNFS is a combination of a Virtual Host IP address and a proprietary enhancement to the NFS Server stack to support completely transparent NFS client failover. During VNFS service transitions from one 10 Introduction - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 11
more than two servers (in fact, up to 16) can be used to present any filesystem. Of course, HP Scalable NAS does support NLM locking to prevent accidental sharing of single instance datafiles by two Oracle servers simultaneously. HP Scalable NAS File Serving Software provisioning guide for Oracle 11 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 12
for Oracle RAC running over NFS. A base configuration of HP Scalable NAS can present filesystems on as many networks as the servers themselves can support, adding network bandwidth as necessary. Multiple interfaces per network are supported via network bonding or, when using Oracle's Direct NFS - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 13
HP Scalable NAS supports this feature. By combining the high availability features of direct NFS (multiple outbound paths to NFS servers) and the virtual server capability of HP //deploy/availability/pdf/OOW2000_same_ppt.pdf HP Scalable NAS File Serving Software provisioning guide for Oracle 13 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 14
14 Introduction - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 15
to be familiar with the administration of the HP Scalable NAS cluster. For information about installing HP Scalable NAS products, see the HP Scalable NAS File Serving Software installation guide. No added software module is needed to support Oracle. This chapter calls out the particular aspects - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 16
ports such as Solaris, even larger transfers are supported. In general, a 4MB volume stripe width see the HP Scalable NAS File Serving Software administration guide. PSFS filesystems document. The PSFS options refer to how the NFS Server cluster internally mounts devices that will be exported). - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 17
In the following example, the DB Optimized filesystem mount point on the Oracle server (NFS client) is /u02 and we have created the subdirectory /u02/oradata NFS servers that will be either primary or backup servers for this Oracle Base. HP Scalable NAS File Serving Software provisioning guide for - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 18
Figure 1 HP Scalable NAS Management Console mount dialog DB Optimized mount option Figure 2 shows a database optimized filesystem that is is intended for storage of Oracle databases and Oracle Clusterware files. This same 18 NAS Administrator: deploying HP Scalable NAS for use with Oracle - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 19
operation For more information about the DB Optimized mount flag, see the section "Server mount options" in Chapter 8, "Configure PSFS filesystems," in the HP Scalable NAS File Serving Software administration guide. 3To help determine what to place in PSFS DB Optimized filesystems, a good guideline - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 20
either (1) specifically name the IP address as the in Exports Records for Oracle servers needing for Linux" in the HP Scalable NAS File Serving Software administration guide.) Note that the default Service is created. 20 NAS Administrator: deploying HP Scalable NAS for use with Oracle - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 21
. Do not use the async option; this can result in a corrupted database. Figure 3 NFS Export Group options selection for Oracle Base, Oracle CRS, and datafiles HP Scalable NAS File Serving Software provisioning guide for Oracle 21 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 22
Figure 4 shows the HP Scalable NAS Management Console with an example of associating an Export Group with both a Virtual NFS Service and the NAS heads as the 1st backup. Two other NAS servers are available but are currently not supporting this Virtual NFS Service. • Because /u03/app/oracle was - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 23
or down. If the box is not checked, failover will not occur when the associated monitor is inactive or down on all of the backup servers and the Virtual NFS Service will not be made active anywhere. HP Scalable NAS File Serving Software provisioning guide for Oracle 23 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 24
Applications tab on the HP Scalable NAS Management Console. Represented in the rows are a set of three Virtual NFS Services. On the right-hand side above the columns are the NAS heads by name (tr6s15 though tmr6s18) indicating four NAS servers in this cluster. A Virtual NFS Service (VNFS) called 192 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 25
VNFS 192.168.60.71 After the transition, tmr6s17 is the primary server for VNFS 192.168.60.71 and the first backup is tmr6s18. If you performed the transition while a database was using this Oracle home, no one else would notice. HP Scalable NAS File Serving Software provisioning guide for Oracle 25 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 26
" in the HP Scalable NAS File Serving Software administration guide for activation details. Special instructions for Oracle Home As described in the next section, Oracle uses file locking at instance startup when not running Real Application Clusters. On NFS, this requires NFS Server support for the - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 27
about this command, see the HP Scalable NAS File Serving Software administration guide. Best practices for consistent user and or groups have been assigned those identifiers, either on the client or the server systems. To share filesystems such as $ORACLE_BASE, the Oracle owner (e.g., user - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 28
for oradata, then on any of the NFS servers run the following commands to set the proper HP X5500 Storage Gateway for Linux, HP Scalable NAS Clustered Gateway, and HP 4400 Scalable NAS File Services system parameters to support external applications such as . HP does not recommend manually editing - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 29
server reboot or virtual host failover, all lock holding NFS clients have a 45-second grace period to reclaim their locks. Should a new client machine be used to host the application, no locks will be available for this 45-second grace period. HP Scalable NAS File Serving Software provisioning guide - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 30
for your Oracle datafiles. In the case of Virtual IP addresses, the NAS Administrator should view the HP Scalable NAS Management Console to determine which NFS server is the current primary server for that address. Check your NFS client mount options in /etc/fstab and any Direct NFS configuration - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 31
Administrator: deploying database servers with HP Scalable NAS This chapter describes system configuration considerations for the NFS client (the Oracle server): • Mounting and linking filesystems for Oracle Home and Oracle data files • NFS mount options • Oracle server operating system parameters - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 32
your mount point is in the same subdirectory, anything else in that directory, including oraInventory, will be on local storage. 32 System Administrator: deploying database servers with HP Scalable NAS - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 33
servers using HP Scalable NAS, the most important document for configuring NFS Clients is the Oracle Database Installation Guide for your specific port of Oracle. The Oracle Database New Feature Guide server. Oracle server operating system parameters Documentation for each Oracle port supporting - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 34
rmem_max: 262144 • wmem_default: 262144 • wmem_max: 262144 See also the setting for aio_max_nr under NFS client I/O, page 35. See the Oracle Installation Guide for your specific Oracle port for any operating system configuration issues for Oracle on NAS. 34 System Administrator: deploying database - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 35
.102/b15658/appc_linux.htm#sthref895 http://download-west.oracle.com/docs/cd/B19306_01/server.102/b14237/ initparams072.htm#REFRN10061 http://download-west.oracle.com/docs/cd/B19306_01/server.102/b14211/ch23_os.htm#sthref749 HP Scalable NAS File Serving Software provisioning guide for Oracle 35 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 36
consider using asynchronous I/O as well as direct I/O. The instructions in this guide assume that you are using direct I/O. When you locate filesystemio_options = directIO For NFS clients such as Red Hat 5.2 running Oracle Server 10.2.0.4 or greater, you can specify direct IO and async IO using - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 37
will be serviced with roughly 200MB/s for such activity as Parallel Query, Backup/Restore, index creation and so on. Of course, larger Oracle servers may demand more throughput than 200MB/s and options such as three-way bonded NICs and multiple mount points should be considered. HP Scalable NAS - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 38
instead. However, in the case of Windows-based Oracle (which does not support Oracle over NFS prior to 11g) there is no other option that is define these paths, should all paths fail to the server, or should the VNFS server fail (unlikely if using HP Scalable NAS), the instance will shutdown. • The - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 39
.com localpath1 132.34.34.22 localpath2.customer.com localpath2 The /etc/hosts file for Oracle server, server 2 (having IP addresses 132.34.34.31 and 132.34.34.32) contains this: the oranfstab configuration file. Your System HP Scalable NAS File Serving Software provisioning guide for Oracle 39 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 40
network or one of the NIC connections at the Client or the Server. As more and more clients are added to this configuration, the NFS server is eventually limited in its ability to support them. Figure 8 No direct NFS and no HP Scalable NAS cluster 40 Oracle DBA: managing Oracle databases in a NAS - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 41
many connections. It can also survive a failure of all but the last working path. However, if the client fails or the server fails, the database will shutdown. Figure 9 Direct NFS introduced to the solution with single NAS server HP Scalable NAS File Serving Software provisioning guide for Oracle 41 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 42
Direct NFS, we introduce only HP Scalable NAS to the scenario in Figure 8. With the NFS cluster, the Oracle Server uses a Virtual NFS service to mount storage rather than the physical IP address of the actual NFS server (shown with a green line). Should a server fail or should the NAS administrator - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 43
(up to 15 servers in a 16-server cluster). The workload can be balanced on the fly by Direct NFS without the need to understand the workload. Figure 11 Direct NFS and HP Scalable NAS Cluster with one NFS server serving four paths HP Scalable NAS File Serving Software provisioning guide for Oracle 43 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 44
of the Virtual NFS Services can export the same filesystem, the same datafile can be hosted by different members of the HP Scalable NAS cluster at the same time (see Figure 12). All this happens, even though the Oracle server thinks it is connected to the same NAS server - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 45
The PolyServe File Serving Utility for Oracle, implemented on either IBM xSeries or HP Proliant Servers with a Storage Area Network (SAN) array, was certified for use www.oracle.com/technology/deploy/availability/htdocs/oscp.html HP Scalable NAS File Serving Software provisioning guide for Oracle 45 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 46
Today, Oracle tests validated configurations in which NAS devices are tested in various scenarios. There are validated configurations using HP Scalable NAS File Serving Software as well. See Appendix A, page 49, for more detail. 46 Oracle DBA: managing Oracle databases in a NAS environment - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 47
clusterware files are not supported over Direct NFS ( service provided with HP Scalable NAS, so if the iSCSI connection fails, there is no means to failover to another server node as can be done with a Virtual NFS Service guides and metalink articles listed in Appendix A, page 49, for more information - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 48
48 Direct NFS client considerations on Windows systems - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 49
NAS and earlier versions of the product ((previous product names include PolyServe Matrix Server CFS 3.x and HP StorageWorks Enterprise File Services Clustered Gateway G5). http://linux.oracle.com/pls/apex/f?p= 102:2:2193268017468798::NO::P2_VC_ID:455 http://www.oracle.com/technology/products - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 50
50 References - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 51
sizes (500GB) are not appropriate. (See "Add new filesystems" in Appendix C, "Initial configuration for HP 4400 Scalable NAS systems," in the HP Scalable NAS File Serving Software administration guide for more information.) After determining the filesystem to be used for Oracle datafiles, use the - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 52
system administrator. For more information about the DB Optimized mount flag, see "Server mount options" in Chapter 8, "Configure PSFS filesystems," in the HP Scalable NAS File Serving Software administration guide. For more information about the NAS Administrator's role in managing NFS filesystems - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 53
Console will report an alert as the filesystem is unmounted on each server. Next, delete the persistent mounts for the VOL003 filesystem. Select the Then, on the Edit Persistent Mounts window, select all servers and click Delete. HP Scalable NAS File Serving Software provisioning guide for Oracle 53 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 54
. Select the VOL003 filesystem on the Management Console, right-click, and select Add Mount. On the Mount Filesystem window, select all of the servers in the On Servers box. Next, specify /u02 as the mount point, check Create directory to create the mount point automatically, and then check the DB - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 55
OK, the filesystem will be mounted at /u02 on each server. Next, prepare the VOL002 filesystem, which will be used for , and select Add Mount. On the Mount Filesystem dialog, highlight of all the servers in the On Servers box. Specify /u01/app/oracle as the mount point and check Create directory. - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 56
Configure FS Option for Linux," in the HP Scalable NAS File Serving Software administration guide.) For Oracle, select these non-default not support using async for Oracle databases.) The no_root_squash option is needed to allow root actions during install to be executed from the Oracle server. - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 57
oracle for $ORACLE_BASE and /u02 for oracle datafiles under /u02/oradata. If the NAS administrator has used custom NFS server mount points, the system administrator would also use those for the /etc/fstab mount statements. Since HP Scalable NAS File Serving Software provisioning guide for Oracle 57 - HP ProLiant DL380G5-WSS | 3.7.0 HP StorageWorks HP Scalable NAS File Serving Sof - Page 58
can set up the proper mount points on the Oracle server. After those steps are completed, the Oracle DBA can install Oracle. DBAs should review Chapter 4 in this guide for additional information and considerations when using HP Scalable NAS for Oracle over NFS. 58 Provisioning Oracle on
HP StorageWorks
HP Scalable NAS File Serving Software
provisioning guide for Oracle
HP Scalable NAS 3.7
Part number: AG513-96013
Second edition: September 2009