Professional Documents
Culture Documents
Abstract
This guide describes how to use the HP Enterprise Backup Solution (EBS) to design a data protection solution.
Copyright 2012 Hewlett Packard. Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.21 1 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
Contents
1 Overview..................................................................................................5
Supported components..............................................................................................................6 Supported topologies................................................................................................................6 Direct-attach parallel SCSI.....................................................................................................6 Serial-attach SCSI (SAS)........................................................................................................6 Point-to-point.......................................................................................................................6 Switched fabric....................................................................................................................6 Platform and operating system support........................................................................................6 Use of native backup programs and commands............................................................................7
2 Zoning......................................................................................................8
Zone recommendations.............................................................................................................8
Red Hat and SUSE Linux..........................................................................................................22 Operating system notes......................................................................................................22 Installing HBA drivers and tools...........................................................................................22 Additional SG device files...................................................................................................23 Installation checklist............................................................................................................23 Linux known issues.............................................................................................................24 Rewind commands being issued by rebooted Linux hosts....................................................24 Tape devices not discovered and configured across server reboots.......................................24 Sparse files causing long backup times with some backup applications................................25 LUNs shifting after reboot...............................................................................................25 Oracle Solaris........................................................................................................................25 Configuring the SAN..........................................................................................................25 Oracle Solaris native driver configuration..............................................................................26 Troubleshooting with the cfgadm utility.................................................................................27 QLogic driver configuration for QLA2340 and QLA2342........................................................27 Emulex driver configuration for LP10000 and LP10000DC......................................................28 Configuring Oracle Servers for tape devices on SAN..............................................................30 Configuring switch zoning...................................................................................................31 Installation checklist............................................................................................................31 IBM AIX................................................................................................................................32 Configuring the SAN..........................................................................................................32 IBM 6228, 6239, 5716, or 5759 HBA configuration...............................................................32 Configuring switch zoning...................................................................................................34 Installation checklist............................................................................................................34 Installing backup software and patches.................................................................................34
Contents
1 Overview
The HP Enterprise Backup Solution (EBS) is an integration of data protection and archiving software and industry-standard hardware, providing a complete enterprise class solution. HP has joined with leading software companies to provide software solutions that support the backup and restore processes of homogeneous and heterogeneous operating systems in a shared storage environment. EBS software partners data protection solutions incorporate database protection, storage management agents, and options for highly specialized networking environments. Data protection and archiving software focuses on using an automated LTO Ultrium tape library and/or Virtual Tape and/or NAS backup technologies.. The EBS combines the functionality and management of Storage Area Network (SAN), data protection software, and scaling tools to integrate tape and disk storage subsystems in the same SAN environment. Enterprise data protection can be accomplished with different target devices in various configurations, using a variety of transport methods such as the corporate communication network, a server SCSI/SAS, SCSI, FCoE (Fibre Channel over Ethernet), or a Fibre Channel infrastructure. EBS typically uses a storage area network that provides dedicated bandwidth independent of the local area network (LAN). This independence allows single or multiple backup or restore jobs to run without the network traffic caused by data protection environments. Depending on the data protection/archiving software used, submitted jobs are run locally on the backup server to which the job was submitted. Data, however, is sent over the SAN backup/archive target to the tape library rather than over the LAN. This achieves greater speed and reduces network traffic. Jobs and devices can be managed and viewed from either the primary or any server or client connected within the EBS which has the supported data protection software solution installed. All servers within the EBS server group can display the same devices. Data protection and archiving software focuses on using an automated LTO Ultrium tape library and/or Virtual Tape and/or NAS backup technologies. The EBS combines the functionality and management of Storage Area Network (SAN), data protection software, and scaling tools to integrate tape and disk storage subsystems in the same SAN environment. Enterprise data protection can be accomplished with different target devices in various configurations, using a variety of transport methods such as the corporate communication network, a server SCSI/SAS, SCSI, FCoE (Fibre Channel over Ethernet), or a Fibre Channel infrastructure. EBS typically uses a storage area network that provides dedicated bandwidth independent of the local area network (LAN). This independence allows single or multiple backup or restore jobs to run without the network traffic caused by data protection environments. Depending on the data protection/archiving software used, submitted jobs are run locally on the backup server to which the job was submitted. Data, however, is sent over the SAN backup/archive target to the tape library rather than over the LAN. This achieves greater speed and reduces network traffic. Jobs and devices can be managed and viewed from either the primary or any server or client connected within the EBS which has the supported data protection software solution installed. All servers within the EBS server group can display the same devices. To implement an Enterprise Backup Solution: 1. Consult the HP Enterprise Backup Solutions Compatibility Matrix available at: http:// www.hp.com/go/ebs. 2. Consult the EBS design guide for EBS hardware configurations currently supported and how to efficiently provide shared tape library backup in a heterogeneous SAN environment. 3. Install and configure the backup application or backup software. Recommendations for individual backup applications and software may be found in separate implementation guides. For more information about EBS, go to http://www.hp.com/go/ebs.
Supported components
For complete EBS configuration support information, refer to the HP Enterprise Backup Solutions Compatibility Matrix located at: http://www.hp.com/go/ebs. You can also use the specific software vendors documentation.
Supported topologies
The following topologies are supported:
Point-to-point
Point-to-point, or direct-attach fibre (DAF), connections are direct Fibre Channel connections made between two nodes, such as a server and an attached tape library. This configuration requires no switch to implement. It is very similar to a SCSI bus model, in that the storage devices are dedicated to a server. There is also private loops, which is often used by default for a DAF link.
Switched fabric
A switched fabric topology is a network topology where network nodes connect with each other via one or more network switches NOTE: SAS switches are also implemented on a typically smaller scale as an option within HP blade servers NOTE: HP Virtual Connect FlexFabric switches are used as an option in C-series blade enclosures to support FCoE connectivity to the switched fabric. For standalone servers Converged Network Adapters are used to connect to the fabric through FCoE fabric switches.
Overview
Yes No No
No Yes No
No No Yes
* Make Tape Recovery - refer to Ignite-UX Administration Guide for HP-UX 1 1i for details of platform requirements and interface type support
2 Zoning
Zone recommendations
Due to complexities in multi-hosting tape devices on SANs, it is best to make use of zoning tools to help keep the backup/restore environment simple and less susceptible to the effects of changing or problematic SANs. Zoning provides a way for servers, disk arrays, and tape controllers to only see what hosts and targets they need to see and use. The benefits of zoning include but are not limited to: The potential to greatly reduce target and LUN shifting Reducing stress on backup devices by polling agents Reducing the time it takes to debug and resolve anomalies in the backup/restore environment Reducing the potential for conflict with untested third-party products
Zoning may not always be required for configurations that are already small or simple. Typically the bigger the SAN is, the more zoning is needed. HP recommends the following for determining how and when to use zoning. Use host-centric zoning. Host-centric zoning is implemented by creating a specific zone for each server or host by World Wide Port Name, and adding only those storage elements to be utilized by that host. Host-centric zoning prevents a server from detecting any other devices on the SAN or including other servers, and it simplifies the device discovery process. Disk and tape on the same HBAs is supported. For larger SAN environments, it is recommended to also add storage-centric zones for disk and backup targets. This type of zoning is done by adding overlapping zones with disk and backup targets separated. See example below.
NOTE:
NOTE: For HP StoreOnce Backup Systems zoning by World Wide Port Names is recommended, not Port ID's or Ports.
Zoning
RSM polling (This must always be disabled for tape and library devices). Qlogic QConvergeConsole (QCC)/SAN Surfer Emulex OneCommandManager (OCM)/HBAnywhere (HBA configuration utilities) Brocade Host Connectivity Manager (HCM) (HBA configuration utility) HP System Insight Manager (management agents) HP Library & Tape Tools (tape utilities): mt commands (Linux/Unix) mtx commands (Linux) Oracle Explorer (Solaris) EMS tape polling (HP-UX)
Emulex and Brocade tools mtx and HP-UX media changer applet
When run concurrently with backup or restore operations, these applications, utilities, and commands have been shown to interfere with components in the data path. Some specific recommendations are: SCSI Reserve & ReleaseIf your backup application supports the use of SCSI reserve and release, enable and use it. Reserve and release can prevent unwanted applications or commands from taking control of a device. SAN ZoningEBS recommends host-based SAN switch zoning by WWPN. When zoning is employed, these applications are much less likely to interfere with tape device operation.
HP-UX
The configuration process for HP-UX involves: Upgrading essential EBS hardware components to meet the minimum firmware and device driver requirements. NOTE: See the HP Enterprise Backup Solutions Compatibility Matrix for all current and required hardware, software, firmware, and device driver versions, including Hardware Enablement Kits and Quality Packs on the HP website: http://www.hp.com/go/ebs. Installing the minimum patch level support. Go to the following website to obtain the necessary patches: http://www.hp.com/support NOTE: See the installation checklist at the end of this section to ensure all of the hardware and software is correctly installed and configured in the SAN.
The following OS software bundles contain the drivers for the A6826A, A9782A, A9784A, AB378A, AB379A, AB465A, AD193A, AD194A, AD300A, and QMH2462 adapters: FibrChanl-01 B.1 1.23.08.02 HP-UX (B1 1.23 IA PA) and all patches the bundle requires per bundle installation instructions. FibrChanl-02 B.1 1.23.0712 HP-UX (B1 1.23 IA) and all patches the bundle requires per bundle installation instructions.
The following OS software bundles contain the drivers for the AD299A and AD355A adapters:
Patches and installation instructions are provided at the HP-UX support website: http://h20566.www2.hp.com/portal/site/hpsc NOTE: Accessing this site requires registration.
After the hardware is installed, proceed with the following steps: NOTE: QMH2462 adapter support will not be listed using the swlist utility; however, the current FibrChanl-01 bundle does support the adapter. 1. The drivers stape, sctl, and schgr must all be installed in the kernel. To see if these drivers are installed, enter the following command: # /usr/sbin/kcmodule schgr sctl stape The following example shows output from kcmodule where the stape driver is not installed:
Module schgr sctl State static static Cause explicit depend
10
Cause
best
If one or more of the above drivers is in the unused state, they must be installed in the kernel. If they are all installed (static state), proceed to the next section, Configuring the SAN. 2. Use kcmodule to install modules in the kernel, for example to install the stape module do the following: # /usr/sbin/kcmodule stape=static Enter Yes to backup the current kernel configuration file and initiate the new kernel build. 3. Reboot the server to activate the new kernel. # cd / # /usr/sbin/shutdown -r now The HP-UX 1 1iv2 Quality Pack (QPK1 123) December 2007 2010 (B.1 1.23.1012.086a) and Hardware Enablement Pack (HWEable1 1i) December 2010 (B.1 1.23.1012.085a) contain required software bundles. These patches and installation instructions are provided at the HP website: http://h20566.www2.hp.com/portal/site/hpsc NOTE: Accessing this site requires registration.
The following OS software bundles are required for the AD299A, AD355A, AD221A, AD222A, AD393A, AH402A, AH403A, 403621-B21, and 456972-B21 adapters: FibrChanl-02 B.1 1.31.0809 HP-UX (B1 1.31 IA PA) and all patches the bundle requires per bundle installation instructions.
Patches and installation instructions are provided at the HP-UX support website: http://h20566.www2.hp.com/portal/site/hpsc After the hardware is installed, proceed with the following steps: 1. The LPe1 105 adapters support will not be listed using the swlist utility. However, the current FibrChanl-01 and FibrChanl-02 bundles do support the adapters. 2. The drivers stape, sctl, and schgr must all be installed in the kernel. To see if these drivers are installed, enter the following command: # /usr/sbin/kcmodule sctl schgr eschgr stape estape
HP-UX
1 1
The following example shows output from kcmodule where the stape driver is not installed:
Module sctl schgr eschgr stape estape State static static static unused static best Cause best best best
If one or more of the above drivers is in the unused state, they must be installed in the kernel. If they are all installed (static state), proceed to the next section, Configuring the SAN. 3. Use kcmodule to install modules in the kernel, for example to install the stape module do the following: # /usr/sbin/kcmodule stape=static Enter Yes to backup the current kernel configuration file and initiate the new kernel build. 4. Reboot the server to activate the new kernel. # cd / # /usr/sbin/shutdown -r now The HP-UX 1 1i Version 3 March 2012 release contains the current software bundles. These patches and installation instructions are provided at the HP website: http://software.hp.com
HP-UX 1 1.31 can experience poor I/O performance on VxFS file systems due to memory blocking during high system memory usage
The HP-UX 1 1.31 kernel, subsystems, and file I/O data cache can consume up to 90 percent of system memory during normal operation. When a heavy file I/O application such as a data protection application starts, the memory usage can reach close to 100 percent. In such conditions, if VxFS attempts to allocate additional memory for inode caching, this can result in memory blocking and subsequent poor file I/O performance. In extreme conditions, this scenario can cause data protection applications to time out during file system reads, which could result in backup job failures.
To determine the current value of vx_ninode, run the following at the shell prompt: # /usr/sbin/kctune vx_ninode
12 Configuration and operating system details
To set vx_ninode to 32768, run the following command at the shell prompt: # /usr/sbin/kctune vx_ninode=32768 NOTE: The kernel tunable parameters filecache_min and filecache_max control the amount of physical memory that can be used for caching file data during system I/O operations. By default, these parameters are automatically determined by the system to better balance the memory usage among file system I/O intensive processes and other types of processes. The values of these parameters can be lowered to allow a larger percentage of memory to be used for purposes other than file system I/O caching. Determining whether or not to modify these parameters depends on the nature of the applications running on the system.
HP-UX
13
Installation checklist With a complete SAN configuration, review the questions below to ensure that all components on the SAN are logged in and configured properly. Are all hardware components at the minimum supported firmware revision, including: Server, HBA, Fibre Channel Switch, Fibre Channel to SCSI Router, Interface Manager, Command View TL, tape drives, library robot? Are all recommended HP-UX patches, service packs, quality packs or hardware ennoblement bundles installed on the host? Is the minimum supported HBA driver loaded on the host? Are all tape and robotic devices mapped, configured and presented to the host from the Fibre Channel to SCSI Router, or Interface Manager? Is the tape library online? Is the Fibre Channel to SCSI router correctly logged into the Fibre Channel Switch? Is the host HBA correctly logged into the Fibre Channel Switch? If multiple Fibre Channel switches are cascaded or meshed, are all ISL ports correctly logged in? If using zoning on the Fibre Channel Switch, is the server HBA and Tape Library's Fibre Channel to SCSI Router in the same switch zone (either by WWN or by switch Port)? If using zoning on the Fibre Channel Switch, has the zone been added to the active switch configuration?
Windows Server 2008/2003 on 32- and 64-bit platforms Data Protection software
See the following websites to obtain the necessary patches: For HP: http://www.hp.com/support For Microsoft: http://www.microsoft.com NOTE: See the HP Enterprise Backup Solutions Compatibility Matrix for all current and required hardware, software, firmware, and device driver versions at http://www.hp.com/go/ebs. See the Installation Checklist at the end of this section to ensure proper installation and configuration of the hardware and software in the SAN.
14
Storport considerations
EBS supports Storport configurations with the Brocade, Emulex and QLogic Storport mini-port drivers. Prior to installing the Storport HBA driver, the Storport storage driver (storport.sys) must be updated. Check the HP Enterprise Backup Solutions Compatibility Matrix for the currently supported version. CAUTION: Failure to upgrade the Storport storage driver prior to installing the HBA mini-port driver may result in system instability.
Installation checklist
To ensure that all components on the SAN are logged in and configured properly, review the following questions: Are all hardware components at the minimum supported firmware revision, including: Server, HBA, Fibre Channel Switch, Fibre Channel to SCSI/FC Router, Interface Manager, Command View TL, tape drives, library robot? Are all recommended Windows Server 2008/2003 patches and service packs installed on the host? Is the minimum supported HBA driver loaded on the Windows server? Is the tape library/VLS/D2D/NAS targets online? Is the host HBA correctly logged into the Fibre Channel Switch? If using zoning on the Fibre Channel Switch, is the server HBA and Tape Library's Fibre Channel Port(s) in the same switch zone (by WWN or PWWN)? Is the Removable Storage Manager (RSM) in Windows Server disabling Properly? (See Windows 2003 known issues for more information on RSM.) Is the Test Unit Ready (TUR) command stopped? (See Windows 2003 known issues for more information on TUR.) Has connectivity and performance been tested using HP Library and Tape Tools (L&TT)?
15
The Windows operating system can still have issues even when zoning and binding are used. The cause of many of these issues is due to the way that Windows enumerates devices. Windows enumerates devices as they are discovered during a scan sequence. They are enumerated with device handles such as such as TAPE0, TAPE1, and so on. The Windows device scan sequence goes in the order of bus, target, and LUN. Bus is the HBA PCI slot, then target, which is representative of a WWN, and LUN, which is representative of a device behind the WWN. The order will be the lowest bus, then a target and its LUNs, then on to the next target, until it sees no more on that HBA. Then on to the next HBA, and its targets and LUNs. A common cause for device shifting is when the tape device is busy and cannot respond in time for the OS to enumerate it. Each device after that shifts up a number. Note the target persistency in the Emulex One Connect Manager utility or QLogic's utility. The same applies to LUN binding in the Emulex full port driver utility. Some backup applications communicate with the tape device by using the Windows device name. As noted, the device name may shift and cause a problem for the backup application. Some applications monitor for this condition and adjust accordingly. Other applications must wait for a reboot and scan of devices, or the application must be manually reconfigured to match the current device list. What neither of the binding utilities do is affect Windows' device enumeration. NOTE: Some vendor applications use device serialization and are not affected by LUN shifting.
Interop issues with Microsoft Windows persistent binding for tape LUNs
Windows Server 2003 provides the ability to enable persistence of symbolic names assigned to tape LUNs by manually editing the Windows registry. Symbolic name persistence means that tape devices will be assigned the same symbolic name across reboot cycles, regardless of the order in which the operating system actually discovers the device. This feature was originally released by Microsoft as a stand-alone patch and was later incorporated into SP1. For more information, go to the following website: http://www.microsoft.com/ and search for support article KB873337 for details The persistence registry key is as follows: HKey_Local_Machine\System\CurrentControlSet\Control\Tape\Persistence NOTE: Persistence=1 symbolic tape names are persistent
Persistence=0 non-persistent Persistence is disabled by default. When you enable persistence, symbolic tape names (also referred to as logical tape handles) change significantly. For example, \\.\Tape0 becomes \\.\ Tape2147483646 . It is not possible to configure the new symbolic tape name. Some applications are unable to correctly recognize and configure devices that have these longer persistent symbolic names. As a workaround, persistent binding of Fibre Channel port target IDs, enabled through the Fibre Channel host bus adapter utilities (such as Emulex Once Connect Manager, Brocade (HCM), or QLogic (QCC)) can provide some benefit. Target ID binding assures that targets are presented in a consistent manner but cannot guarantee consistent presentation of symbolic tape names.
16
NOTE:
NOTE: Removable Storage Manager is no longer available as of Windows 7 and Windows Server 2008 R2.
Updating the HP Insight Management Agents for Microsoft Windows using the ProLiant Support Pack Version 7.70 (or later)
When updating the HP Insight Management Agents for Microsoft Windows using the ProLiant Support Pack Version 7.70 (or later) the Disable Fibre Agent Tape Support option is inadvertently unchecked by default. This occurs because the previous data in the registry is not saved during the software update from the Management Agents Version 7.60 (or earlier). Figure 4 shows the Disable Fibre Agent Tape Support option selected prior to the ProLiant Support Pack Version 7.70 (or later) update installation. Figure 2 Updating the HP Insight Management Agents for Microsoft Windows using the ProLiant Support Pack Version 7.70 (or later)
18
Follow the link below to see the full advisory: http://h20000.www2.hp.com/bizsupport/TechSupport/Document.jsp?lang=en&cc=us& obectID=c0122 9672
NAS and ProLiant Storage Server devices using Microsoft Windows Storage Server 2003
Server storage differs from direct-attached storage in several ways. Stored data can have multiple sets of file attributes due to heterogeneous access (NFS, SMB, Novel, Macintosh). The storage server is typically not supported by a console. Storage server vendors are often forced to use a common backup protocol, NDMP, because of lack of backup application support of the underlying or customized storage server OS. Storage servers using Data Protection Manager (DPM) provide administrative tools for protecting and recovering data on the file servers in the network.
HP NAS and HP ProLiant Storage Server devices are built on Windows Storage Server (WSS) 2003. Backup applications supported by Windows 2003 also run on WSS 2003, and the terminal services on the Microsoft based storage server supports backup application's GUI. The major backup vendors are actively testing their applications on the WSS framework. All tape devices (both SCSI and FC connected) supported by the Windows systems are automatically available on Windows Storage Server 2003 storage server solutions. Since most storage servers are built with a specialized version of the OS, some of the device drivers may be outdated or unavailable. Updates to the storage server product from HP may have more current drivers. These updates are available for download from the HP server website. Newer tape device drivers are made available from hardware and software vendors and are used on these platforms. See the following website for the HP Enterprise Backup Solutions Compatibility Matrix and certified Windows device drivers: http://www.hp.com/go/ebs.
Tru64 UNIX
The configuration process for Tru64 UNIX can be a somewhat seamless process. When firmware and driver revisions of the components are at minimum EBS acceptable levels, the integration process is as simple as installation of hardware and configuring devices to the SAN fabric. This is possible because Tru64 UNIX maintains driver and configuration parameters in the OS kernel and device database table. It is recommended, however, that if new console firmware is available, it is applied as outlined below to Tru64 UNIX servers in an EBS. NOTE: Refer to the HP Enterprise Backup Solutions Compatibility Matrix for all current and required hardware, software, firmware, and device driver versions at: http://www.hp.com/go/ ebs. To ensure correct installation and configuration of the hardware, see Installation checklist (page 14).
Tru64 UNIX
19
4.
20
a. b. c.
Contact Global Services to obtain the latest HBA driver. Upgrading the HBA driver may require building a new kernel. Create a backup copy of the kernel file (/vmunix) before building a new kernel. If building a new kernel was necessary, reboot the server. If building a new kernel was not necessary, at a Tru64 UNIX terminal window type: # hwmgr -scan scsi.
5.
Verify that the Tru64 UNIX host is logged in to the Fibre Channel switch. Make sure that the server logs in to the switch as an F-port.
Installation checklist
Are all hardware components at the minimum supported firmware revision, including: Server, HBA, Fibre Channel switch, Fibre Channel to SCSI router, Interface Manager, Command View TL, tape drives, library robot? Are the current Tru64 operating system patches installed, and is the server running the current console firmware?
Tru64 UNIX 21
Is the minimum supported HBA driver loaded on the host? Are all tape and robotic devices mapped, configured, and presented to the host from the Fibre Channel to SCSI Router, or Interface Manager? Is the tape library online? Is the Fibre Channel to SCSI router correctly logged into the Fibre Channel switch? Is the host HBA correctly logged into the Fibre Channel switch? If multiple Fibre Channel switches are cascaded or meshed, are all ISL ports correctly logged in? If using zoning on the Fibre Channel switch, is the server HBA and Tape Library's Fibre Channel to SCSI router in the same switch zone (either by WWN or by switch port)? If using zoning on the Fibre Channel switch, has the zone been added to the active switch configuration?
NOTE: See the HP Enterprise Backup Solutions Compatibility Matrix for all current and required hardware, software, firmware, and device driver versions at: http://www.hp.com/go/ebs.
22
7.
8.
Beginning with the driver kits that included the 8.01.06 QLogic driver and the 8.0.16.27 Emulex driver (both kits released October 2006), execute the following script found in the fibreutils directory: # cd /opt/hp/hp_fibreutils/pbl # ./pbl_inst.sh -i Reboot the server to complete the installation. NOTE: Step 7 of the above procedure was introduced to eliminate the need to have hp_rescan -a run as part of /etc/rc.local (or some other boot script). In previous versions of the driver kit, executing the hp_rescan utility was necessary to work around an intermittent issue with device discovery of SCSI-2 tape automation products. Executing the pbl script inserts the probe-luns utility into the boot sequence and identifies and adds SCSI-2 device strings for legacy tape products into the kernel's blacklist. The result is that all of the supported tape libraries and drives should be discovered correctly without any additional steps by the user.
9.
Verify that the host has successfully discovered all tape drive and library robotic devices using one of the following methods: Review the device listing in /proc/scsi/scsi Review the output from the hp_rescan command Review the output from the lssgcommand
If there are devices that have not been successfully discovered, review the HBA driver installation procedure above, particularly step 5, then proceed to the Installation checklist (page 14). HP's fibre utilities, located in the /opt/hp/hp_fibreutils directory, are installed as part of the driver kit and include the following: hp_rescan: used to force a rescan of all SCSI buses scsi_info: used to query a device adapter_info: displays HBA information (i.e. World Wide Names) lssd: lists disk devices (sd device files) lssg: lists online and nearline devices (sg device files) hp_system_info: lists system configuration information
Installation checklist
Are all hardware components at the minimum supported firmware revision, including: server, HBA, Fibre Channel switch, interface controller, Interface Manager, CommandView TL, tape drives, library robot? Are there any required Linux operating system patches missing (required patches are noted on the EBS Compatibility Matrix)?
Red Hat and SUSE Linux 23
Is the supported HBA driver loaded on the host? Are all tape and robotic devices mapped, configured, and presented to the host from the interface controller or Interface Manager? Is the tape library online? Is the FC-attached tape drive logged into the Fibre Channel switch (F-port)? Is the interface controller logged into the Fibre Channel switch (F-port)? Is the host HBA correctly logged into the Fibre Channel switch (F-port)? If multiple Fibre Channel switches are cascaded or meshed, are all ISL ports correctly logged in? If using zoning on the Fibre Channel switch, is the interface controller, or tape drive, configured into the same switch zone as the host (either by WWPN or by switch port number)? If using zoning on the Fibre Channel switch, has the host's zone been added to the active switch configuration?
24
Sparse files causing long backup times with some backup applications
Some Integrity and X64 64-bit HP Servers running the Red Hat Enterprise Linux 3 operating system (or later) may have longer than expected system backup times or appear to be stalled when backing up the following file: /var/log/lastlog This file is known as a "sparse file." The sparse file may appear to be over a terabyte in size and the backup software will take a long time to back up this file. Most backup software applications have the capability to handle sparse files with special sparse command flags. An example of this is the "tar" utility, which has the "-sparse" or "-S" flag that can be used with sparse files. If your backup application does not include support for backing up sparse files, then /var/log/ lastlog should be excluded from the backup.
Oracle Solaris
This section provides instructions for configuring Oracle Solaris in an Enterprise Backup Solution (EBS) environment. The configuration process involves: Upgrading essential EBS hardware components to meet the minimum firmware and device driver requirements. Installing the following minimum patches for Oracle Solaris:
Solaris 9 requires 1 12233-12, 1 12834-06, and 1 13277-51 Solaris 10 SPARC requires 1 18822-36 and 1 18833-36 Solaris 10 x86/64 requires 1 18855-36
Installing the minimum patch/service pack level support for the backup software
See the following websites to obtain the necessary patches: For HP: http://www.hp.com/support For Solaris: http://www.oracle.com NOTE: Refer to the HP Enterprise Backup Solutions Compatibility Matrix for all current and required hardware, software, firmware, and device driver versions at: http://www.hp.com/go/ ebs. See Installation checklist (page 14) to ensure that the hardware and software in the SAN is correctly installed and configured.
Oracle Solaris
25
Device binding can help resolve issues where device targets shift. Issues can arise when a given target or LUN changes number. In most cases, this can be controlled through the use of good zoning or persistent binding. When using QLogic or Emulex drivers, configuring for persistent binding is recommended. For the Oracle native driver, persistent binding is not necessary unless recommended by the backup application vendor or for an environment where tape devices will be visible across multiple hosts. For configuring persistent binding with the Sun native driver, see the Oracle document Solaris SAN Configuration and Multipathing Guide at http://docs.oracle.com/cd/E19253-01/820-1931/ index.html.
For Solaris 9, download the current Sun StorEdge SAN Foundation Software (SFS) from http:// www .sun.com/storage/san. Select the following files for download: Install_it Script SAN 4.4.x (SAN_4.4.x_install_it.tar.Z) Install_it Script SAN 4.4.x Readme (README_install_it.txt)
The README document explains how to uncompress the downloaded file and execute the Install_it Script. NOTE: From Oracle's site, the Install_it Script is considered an optional download, but does include all required SFS packages and patches for Solaris 9. The Install_it Script will identify the type of HBA and version of Solaris before installing the appropriate SFS packages and patches. 3. SFS functionality is included within the Solaris 10 operating system. The Solaris native SUNWqlc driver is included with Solaris 10. For Solaris 10 01/06 or later release, SUNWemlxs and SUNWemlxu driver packages are included. To obtain SUNWemlx packages, go to Oracles Products Download page at http://developers.sun.com/products/. Search for StorageTek Enterprise Emulex Host Bus Adapter Device Driver. Install the appropriate patch: 4. SUNWqlc on Solaris 10 SPARC, install patch 1 19130-33 or later SUNWqlc on Solaris 10 x86/64, install 1 19131-33 or later SUNWemlx on Solaris 10 SPARC, install patch 120222-31 or later SUNWemlx on Solaris 10 x86/64, install patch 120223-31 or later
Update the HBA fcode if needed using the flash-upgrade utility included in the appropriate patch. SG-XPCI1FC-QF2 (X6767A) and SG-XPCI2FC-QL2 Patch 1 14873-05 or later SG-XPCI2FC-QF2 (X6768A) and SG-XPCI2FC-QF2-Z Patch 1 14874-07 or later SG-XPCI1FC-EM2 and SG-XPCI2FC-EM2 Patch 121773-04 or later SG-XPCI1FC-QF4 (QLA2460) and SG-XPCI2FC-QF4 (QLA2462) Patch 123305-04 or later
5. 6.
Reboot the server with -r option: #reboot -- -r Use the cfgadm utility to show the HBA devices: #cfgadm -al
26
7. 8.
Use the cfgadm utility to configure the HBA devices. c2 is the HBA device in this example. #cfgadm -c configure c2 Use devfsadm utility to create device files: #devfsadm
This output shows a media changer at LUN 0 for the 100000e0022229fa9world wide name, and tape and disk devices at LUN 0 for other world wide names. The devices are connected and have been configured and are ready for use. The cfgadm -al -o show_FCP_dev command can be used to show the devices for all LUNs of each Ap_Id. Fixing a device with an unusable condition: If the condition field of a device in the cfgadm output is unusable, then the device is in a state such that the server cannot use the device. This may have been caused by a hardware issue. In this case, do the following to resolve the issue: 1. Resolve the hardware issue so the device is available to the server. 2. 2. After the hardware issue has been resolved, use the cfgadm utility to verify device status and to mend the status if necessary:
Use cfgadm to get device status: # cfgadm -al For a device that is unusable use cfgadm to unconfigure the device and then re-configure the device. For example (this is an example only, your device world wide name will be different): # cfgadm -c unconfigure c4::100000e0022286ec # cfgadm f -c configure c4::100000e0022286ec
Use cfgadm again to verify that the condition of the device is no longer unusable: # cfgadm -al
Oracle Solaris
27
1.
2.
Prepare the required rack mounted hardware and cabling in accordance with the specifications listed in backup software user guide as well as the installation and support documentation for each component in the SAN. After installing the HBA, verify proper hardware installation. At the OpenBoot PROM ok prompt, type: show-devs If the HBA is installed correctly, an entry similar to the following is displayed (the path will vary slightly depending on your configuration): /pci@1f,4000/QLGC,qla@5 Verify the HBA hardware installation in Solaris at the shell prompt by typing: prtconf -v | grep QLGC If the HBA is installed correctly, and the driver has not yet been installed, a device similar to the following is displayed: QLGC,qla (driver not attached) NOTE: To complete this installation, log in as root.
3. 4.
After installing the HBA, install the device driver. The driver comes with the HBA or can be obtained from http://www.qlogic.com. To ensure that no previous device driver was installed, at the prompt, type: #pkginfo | grep QLA2300 If no driver is installed, a prompt is returned. If there is a driver installed, verify that it is the correct revision by entering: #pkginfo -l QLA2300 If the driver needs to be removed, enter: #pkgrm <package name>
5.
Install the new driver. Navigate to the directory where the driver package is located and at the prompt, type: #pkgadd -d ./<package name> Make sure that the driver is installed. At the prompt, type: #pkginfo -l QLA2300 Look at /kernel/drv/qla2300.conf (the device configuration file) to make sure the configuration is appropriate. Fibre Channel tape support is enabled. An example follows: hba0-fc-tape=1; Persistent binding can be configured by binding SCSI target IDs to the Fibre Channel world wide port name of the router or tape device. To set up persistent binding, the persistent binding only option is enabled. An example follows. hba0-persistent-binding-configuration=1; After enabling persistent binding only, router or tape drive world wide port names (wwpn) is bound to SCSI target IDs. For example, if a router has a wwpn of 1 1 1 1222233334444 and is visible to hba0, bind it to SCSI target ID 64 as follows: hba0-SCSI-target-id-64-fibre-channel-port-name = 1111222233334444;
6. 7.
1.
Prepare the required rack mounted hardware and cabling in accordance with the specifications listed in backup software user guide as well as the installation and support documentation for each component in the SAN. NOTE: To complete this installation, a root login is required.
2.
After installing the HBA, verify proper hardware installation. At the OpenBoot PROM ok prompt, type: show-devs If the HBA installed correctly, devices similar to the following will be displayed (the path will vary slightly depending on your configuration). /pci@8,700000/fibre-channel@1,1 /pci@8,700000/fibre-channel@1 Verify the HBA hardware installation in Solaris at the shell prompt by typing: prtconf -v | grep fibre-channel
3. 4.
Install the HBA device driver. The driver can be obtained from http://www.emulex.com. To ensure that no previous device driver was installed, at the prompt, type: #pkginfo -l lpfc If no driver is loaded, a prompt is returned. If there is a driver installed, verify that it is the correct revision. If the driver removal is required, enter: #pkgrm <package name>
5.
Install the new driver. Navigate to one directory level above where the driver package directory is located and at the prompt, type: #pkgadd -d Select the lpfc package
6. 7.
Make sure that the driver is installed. At the prompt, type: #pkginfo -l lpfc Verify the HBA driver attached by typing: #prtconf -v | grep fibre-channel If the driver attached, devices similar to the following are displayed: fibre-channel, instance #0 fibre-channel, instance #1
8.
Look at /kernel/drv/lpfc.conf (the device configuration file) to make sure the configuration is appropriate. For World Wide Port Name binding, add the following line: fcp-bind-method=2; For FCP persistent binding, the setting fcp-bind-WWPN binds a specific World Wide Port Name to a target ID. The following example shows two NSR FC ports zoned in to the second interface on the HBA:
Oracle Solaris
29
NOTE: The interface definitions appear in /var/adm/messages. The interfaces lpfc0 and lpfc1 map to the following devices: lpfc0 is /pci@8,700000/fibre-channel@1 1lpfc1 is /pci@8,700000/fibre-channel@1,1 NOTE: Refer to comments within the lpfc.conf for more details on syntax when setting fcp-bind-WWPN. Add the following to item 2 within section Configuring Oracle Servers for tape devices on SAN: For LP10000 adapter: name="st" class="scsi" target=62 lun=0; name="st" class="scsi" target=62 lun=1; name="st" class="scsi" target=62 lun=2; name="st" class="scsi" target=62 lun=3;
NOTE: The tape-config list is composed of a group of triplets. A triplet is composed of the Vendor ID + Product ID, pretty print, and the data property name. The syntax is very important. There must be eight characters for the vendor ID (COMPAQ or HP) before the product ID (DLT8000, SDLT600, Ultrium, etc). In the above line, there are exactly two spaces betweenCOMPAQand DLT8000, and there are exactly six spaces between HPand Ultrium. The order of the triplets is also important for Ultrium tape drives for discovery. The pretty print value will be displayed in the boot log /var/adm/messages for each tape drive discovered that matches the associated vendor ID + product ID string. Below the tape config list is a list of data property names used to configure specific settings for each device type.
30 Configuration and operating system details
Some data protection applications handle the SCSI reservation of the tape drives and others require the operating system to do so. For a complete description of setting SCSI reservation, see the options bit flag ST_NO_RESERVE_RELEASE on the man page for st. The ST_NO_RESERVE_RELEASE flag is part of the fourth parameter in the data property name. For LTO1-data and LTO2-data, a value of 0x9639 means the operating system handles reserve/release and a value of 0x29639 means the application handles reserve/release. For LTO3-data and LTO-4 data, a value of 0x18659 means the operating system handles reserve/release and a value of 0x38659 means the application handles reserve/release. 2. Define tape devices for other adapters by adding lines similar to the following to the SCSI target definition section of the st.conf file. Example for QLogic adapters: name=st class=scsi parent=/pci@1f,4000/QLGC,qla@1 target=64 lun=0; name=st class=scsi parent=/pci@1f,4000/QLGC,qla@1 target=64 lun=1; NOTE: The parent is the location of the HBA in the /devices directory.
NOTE: The target can be chosen; however, it must not conflict with other target bindings in the st.conf and sd.conf files. 3. Perform a reconfiguration reboot (reboot ---r) on the server and verify that the new tape devices are seen in /dev/rmt.
Installation checklist
To ensure that all components on the SAN are logged in and configured properly, review the following questions: Are all hardware components at the minimum supported firmware revision, including: Server, HBA, Fibre Channel switch, Fibre Channel to SCSI router, Interface Manager, Command View TL, tape drives, library robot? Are all recommended Solaris patches installed on the host? Is the minimum supported HBA driver loaded on the host? Are all tape and robotic devices mapped, configured and presented to the host from the Fibre Channel to SCSI router, or Interface Manager? Is the tape library online?
Oracle Solaris 31
Is the Fibre Channel to SCSI router correctly logged into the Fibre Channel switch? Is the host HBA correctly logged into the Fibre Channel switch? If multiple Fibre Channel switches are cascaded or meshed, are all ISL ports correctly logged in? If using zoning on the Fibre Channel switch, is the server HBA and Tape Library's Fibre Channel to SCSI router in the same switch zone (either by WWN or by switch port)? If using zoning on the Fibre Channel switch, has the zone been added to the active switch configuration?
IBM AIX
The configuration process for IBM AIX in an EBS environment involves: Upgrading essential EBS hardware components to meet the minimum firmware and device driver requirements Installing the minimum patch level support for:
Refer to the following websites to obtain the necessary patches: For HP: http://www.hp.com/support For IBM: http://www.ibm.com NOTE: Refer to the HP Enterprise Backup Solutions Compatibility Matrix for all current and required hardware, software, firmware, and device driver versions at http://www.hp.com/go/ ebs. Refer to the Quick Checklist at the end of this section to ensure proper installation and configuration of all of the hardware and software in the SAN.
Prepare the required hardware and cabling in accordance with the specifications listed in chapter 2 of this guide as well as the installation and support documentation for each component in the SAN.
2. 3.
There is a line in the output similar to the following: fcs0 Available 1D-08 FC Adapter If the adapter is not recognized, check that the correct HBA driver is installed: 6228: #lslpp -L|grep devices.pci.df1000f7 6239: #lslpp -L|grep devices.pci.df1080f9 5716: #lslpp -L|grep devices.pci.df1000fa 5759: #lslpp -L|grep devices.pci.df1000fd 5773: #lslpp -L|grep devices.pciex.df1000fe 5774: #lslpp -L|grep devices.pciex.df1000fe There are lines in the output for lslpp similar to the following for a 6239 HBA: devices.pci.df1080f9.diag 5.1.0.1 C F PCI-X FC Adapter Device devices.pci.df1080f9.rte 5.1.0.1 C F PCI-X FC Adapter Device For AIX 5.1, the device drivers may need to be installed separately from the Maintenance pack. See the IBM installation guide for the 6239. 4. For information about the HBA, such as the WWN, execute the following command: #lscfg -vl fcs0 The output will look similar to the following:
5.
After the HBA has successfully logged into the SAN fabric and the necessary zoning is configured, configure the HBA and devices within the fabric. At the prompt, type: #cfgmgr -1 <devicename> -v Within the command, <devicename> is the name from the output of the lsdev command in step 3, such as fcs0.
IBM AIX
33
6. 7.
To ensure all tape device files are available, at the prompt, type: #lsdev -HCc tape By default, AIX creates tape devices with a fixed block length. To change the devices to have variable block lengths, at the prompt, type: #chdev -1 <tapedevice> -a block_size=0 Configuration of the tape devices (where tape devices are rmt0, rmt1, and so on) are complete. NOTE: HP tape drives (SDLT and LTO) use the IBM host tape driver. When properly configured, a device listing will show the tape device as follows: For IBM native HBAs: Other FC SCSI Tape Drive For non-IBM native HBAs: Other SCSI Tape Drive
Installation checklist
Are all hardware components at the minimum supported firmware revision, including: Server, HBA, Fibre Channel switch, Fibre Channel to SCSI router, Interface Manager, Command View TL, tape drives, library robot? Are all recommended AIX maintenance packages installed on the host? Is the minimum supported HBA driver loaded on the host? Are all tape and robotic devices mapped, configured and presented to the host from the Fibre Channel to SCSI router, or Interface Manager? Is the tape library online? Is the Fibre Channel to SCSI router correctly logged into the Fibre Channel switch? Is the host HBA correctly logged into the Fibre Channel switch? If multiple Fibre Channel switches are cascaded or meshed, are all ISL ports correctly logged in? If using zoning on the Fibre Channel switch, is the server HBA and Tape Library's Fibre Channel to SCSI router in the same switch zone (either by WWN or by switch port)? If using zoning on the Fibre Channel switch, has the zone been added to the active switch configuration?
34
Off-host backup server VMware: Yes (VADP) HPVM: Yes (ZDB) VMware: Yes (VADP) HPVM: Yes (ZDB) No Yes, with multiple backup servers
Yes (hot/cold)
Yes (hot/cold)
Yes (hot/cold)
*Not supported by all virtualization products VADP = vStorage APIs for Data Protection
NOTE:
See the backup software documentation for supported virtual machine backup methods. See the virtual machine documentation for supported backup devices. See the EBS Compatibility Matrix for backup application VM support and VM tape support.
35
VMware vStorage APIs for Data Protection at www.hp.com/go/storeonce under the White Papers link. For complete details on Zero Downtime Backup of an Oracle database running on a VMware virtual machine, see the HP Oracle on VMware ZDB Solution implementation guides at www.hp.com/go/ebs, under the EBS whitepapers link.
NOTE: VMware datastores residing on HP EVA storage arrays should use the Windows host profile mode for the VADP backup server.
36