IBM System p

Introduction to
PowerHA SystemMirror for AIX V 7.1
Managed with IBM Systems Director
IBM’s High Availability Software for
POWER Based Systems

Glenn Miller
Certified IT Specialist – Systems Software Architect
gemiller@us.ibm.com
(410) 332-2408

© 2007 IBM Corporation

10/21/2011 East Region Technical Sales Support

 IBM System p

Agenda/Objectives

ƒ PowerHA Product Overview

ƒ PowerHA Version 7 Differences

ƒ Installing and Configuring PowerHA

ƒ Live Demonstration using IBM Systems Director

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

IBM’s PowerHA Product

Overview

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

What is PowerHA?

ƒ High Availability and Disaster Recovery solutions from IBM for your
mission-critical AIX and i applications

ƒ Marketed since 1992, today PowerHA is

– SIMPLER to configure and more flexible to maintain
– FASTER event processing speeding application recovery
– GOES the DISTANCE to provide availability across multiple sites

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Cluster Design

ƒ Strive For “No Single Point Of Failure”

– Work from the cluster out to the clients

ƒ Automatic Recovery From Failure

– Human intervention not necessary

ƒ Recognize Cost Trade-Offs

– Capacity and performance
– Allow for growth

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Cluster Resources

ƒ Applications

ƒ Disk Drives

ƒ Volume Groups

ƒ File Systems

ƒ NFS File Systems

ƒ Tape Drives

ƒ IP Addresses

ƒ Replicated Resources

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Resource Groups

ƒ Resources are assigned to groups. A resource group consists of

an application and all of the resources it depends upon.

ƒ Resource groups are associated with a set of nodes that can

“host” all of the resources in the group

ƒ Resource groups have policies that determine where the group

moves when an event happens

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Resource Group's Behavioral Policies

ƒ Startup Policy (Select one):
– Online On Home Node Only
– Online On First Available Node
– Online Using Distribution Policy
– Online On All Available Nodes

ƒ Fallover Policy (Select one):

– Fallover to Next Priority Node in the List
– Fallover Using Dynamic Node priority
– Bring Offline (On Error Node Only)

ƒ Fallback Policy (Select one):

– Fallback To Higher Priority node in the List
– Never Fallback

The Resource Group Attributes SMIT screen displays only the valid attributes based on
the startup, fallover and fallback polices.

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

IBM’s PowerHA Product

Version 7 Differences

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Release Overview

ƒ Official new name is PowerHA SystemMirror for AIX v7.1

Pubs and menus have been changed to reflect the new name.

ƒ Offering has new product ID.

Standard Edition has “base” function plus Smart Assists (5765-H39)

ƒ Migration options – from 5.4.1, 5.5, or 6.1

Static (offline)
Snapshot
Rolling migration
(no non-disruptive upgrade option this release)

ƒ AIX Requisites
AIX 6.1 TL 6 with RSCT 3.1.0.0
AIX 7.1 with RSCT 3.1.0.0
(Notice no AIX 5.3 support!)

10 © 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

New features – Standard Edition

ƒ Cluster Aware AIX

Functions built in to base operating system

ƒ Simplified user interface

SMIT changes, new terminology

ƒ IBM Systems Director plug-in

Integrates SystemMirror management with Director

ƒ New Smart Assists

Expanded middleware support

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

New Features – Enterprise Edition

ƒ Hitachi TrueCopy® replication support
EE support for Hitachi replication
(already had support for EMC SRDF)

ƒ Global Mirror support

New framework enables Global Mirror as well as future technologies

ƒ Enterprise Edition 6.1 requires SystemMirror 6.1 with Service

Pack 3
SP3 and new install images available from FixCentral
http://www-933.ibm.com/support/fixcentral/aix/selectFixes

follow the links to select IZ84433 (packaging APAR)

Install new filesets for new features (not just update_all) !

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

PowerHA 7.1 Requirements

ƒ Software Requirements
– AIX 6.1 TL6 or AIX 7.1 (latest Service Packs recommended)
– Install new additional requisite filesets of:
• bos.cluster (.rte and .soliddb)
• bos.ahafs
• devices.common.IBM.storfwork (for SAN HB)
• cas.agent (for Systems Director plug-in)
• clic.rte (for secured encryption communication options of clcomd)
– RSCT 3.1 (latest Service Packs recommended)
– VIOS 2.2.0.11-FP24SP01 (For VIOS/NPIV repository disk support)
ƒ Hardware Requirements
– Repository Disk
• The repository is stored on a disk that must be SAN attached and zoned to be shared
by every node in the cluster and only the nodes in the cluster.
– Multicast enabled network/switches
• A multicast IP address is needed for the new monitoring technology.
• The product will assign multicast addresses, but you can explicitly specify multicast
addresses

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

PowerHA 7.1 Differences

ƒ Non-IP networks no longer exist.

– RS232,TMSCSI,TMSSA,Disk Heartbeat and MNDHB are no longer used.
(Replaced by SAN heartbeating and repository disk)

ƒ Removal of outdated network hardware – Ethernet only option (IB?)

– FDDI, ATM, X.25, and Token Ring are no longer supported. Clusters with only
these technologies will have to replace the hardware with Ethernet in order to
use version 7.1 of the product.

ƒ Additional CAA limitations and requirements

– MPIO requirement for cluster repository disk (no 3rd party)
– LVnames of fslv00, fslv01, caalv_private1, caalv_private2, caalv_private3,
powerha_crlv must not already be used
– IPV6
– Sites
– VLAN tagging
(If any of these options need to be used you can not migrate to 7.1)

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

PowerHA 7.1 Differences

ƒ More Depricated features

– IPAT via replacement
– HWAT
– Heartbeat over Aliasing
– Two-Node configuration assistant
– WebSMIT
• Online planning worksheets
• Cluster configuration html report
– Non-concurrent shared datavg support
ƒ Additional Limitations
– Site Support
– Cross-site LVM mirroring (mirror pools added in 7.1 SP3)
– IPV6 support
– 16-node tested cluster restriction as per the README7.1.0.UPDATE

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Cluster Aware AIX

ƒ Four services provided by CAA
– Clusterwide event management
• The AIX Event Infrastructure allows event propagation across the cluster so that
applications can monitor events from any node in the cluster.
– Clusterwide storage naming service
• When a cluster is defined or modified, the AIX interfaces automatically create a
consistent shared device view across the cluster. A global device name, such as,
cldisk1, would refer to the same physical disk from any node in the cluster.
– Clusterwide command distribution
• The clcmd command provides a facility to distribute a command to a set of nodes
that are members of a cluster. For example, the command clcmd date returns the
output of the date command from each of the nodes in the cluster.
– Clusterwide communication
• Communication between nodes within the cluster is achieved using multicasting
over the IP based network and also using storage interface communication through
Fibre Channel and SAS adapters. A new socket family (AF_CLUST) has been
provided for reliable, in-order communication between nodes. When all network
interfaces are lost, applications using these interfaces can still run.

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Cluster Aware AIX

ƒ Sites
– Does not support sites

ƒ Hostname
– CAA requires hostname and nodename must be the same

ƒ Boot IP or Base IP addresses not required

ƒ Can still use Persistent addresses, but host IP address serves the
same purpose.
ƒ Repository disk
– Can not LVM mirror it, SPOF
– Does not store PowerHA cluster configuration
– Requires 4GB or 8GB FC adapters
– Can not change repository disk w/o deleting the cluster
– Requires MPIO capable storage, today
– Size of disk - Min. 10 GB, Max. <100 GB

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Cluster Aware AIX

ƒ Builds special file system for Clusterwide Event Management

ƒ Requires specific vg and lv naming to be available

# lsvg -l caavg_private
caavg_private:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
caalv_private1 boot 1 1 1 closed/syncd N/A
caalv_private2 boot 1 1 1 closed/syncd N/A
caalv_private3 boot 4 4 1 open/syncd N/A
fslv00 jfs2 4 4 1 open/syncd /clrepos_private1
fslv01 jfs2 4 4 1 closed/syncd /clrepos_private2
powerha_crlv boot 1 1 1 closed/syncd N/A

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

IBM’s PowerHA Product

Installing and Configuring

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Preliminary Steps

ƒ Plan and create Cluster Diagram

ƒ Install AIX and additional PowerHA pre-requisites:

bos.adt.lib
bos.adt.libm
bos.adt.syscalls
bos.net.tcp.client
bos.net.tcp.server
bos.rte.SRC
bos.rte.libc
bos.rte.libcfg
bos.rte.libcur
bos.rte.libpthreads
bos.rte.odm
bos.cluster
bos.lvm.rte
bos.clvm.enh (Note: this fileset is not identified as a pre-requisite during HA7.1 installation)

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Preliminary Steps (continued)

ƒ Install PowerHA 7.1 and latest Service Pack

– (includes PowerHA SystemMirror agent for Systems Director)

ƒ Configure /etc/hosts
10.69.19.40 ha40.p.mcl.tecnet ha40
10.69.19.41 ha41.p.mcl.tecnet ha41
10.69.19.42 hasvc.p.mcl.tecnet hasvc

ƒ Configure /etc/netsvc.conf
hosts=local,bind4

ƒ Configure /etc/cluster/rhosts
10.69.19.40
10.69.19.41

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Preliminary Steps (continued)

ƒ Create Shared Volume Group

– Create log logical volume
– Create file systems
– Import on all nodes
– Varyon VG and mount file systems on one node

ƒ Install Application binaries (all nodes)

ƒ Test Start and Stop scripts

ƒ Test Application

ƒ Move shared volume group to other nodes, repeat tests

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

IBM Systems Director Setup

ƒ Assumes you have a working IBM Systems Director

ƒ Install PowerHA Plugin

Update Systems Director code to bring in latest plugin updates

ƒ Upgrade PowerHA agent on nodes:

opt/ibm/director/agent/bin/lwiupdatemgr.sh -listFeatures | grep systemmirror
com.ibm.director.power.ha.systemmirror.agent.feature_7.1.0.0 Disabled
com.ibm.director.power.ha.systemmirror.agent.feature_7.1.0.3 Enabled

ƒ Critical: Plugin and agent versions must match!

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

clstat

ƒ Out of the box, clstat probably won’t work at current code levels

Edit /etc/snmpdv3.conf file:

Add this line:
VACM_VIEW defaultView 1.3.6.1.4.1.2.3.1.2.1.5 - included -

Modify these lines to delete comments:

smux 1.3.6.1.4.1.2.3.1.2.1.2 gated_password # gated
smux 1.3.6.1.4.1.2.3.1.2.1.5 clsmuxpd_password # PowerHA SystemMirror

as:
smux 1.3.6.1.4.1.2.3.1.2.1.2 gated_password
smux 1.3.6.1.4.1.2.3.1.2.1.5 clsmuxpd_password

Then:
refresh -s snmpd

ƒ Alternative is qha script

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

IBM’s PowerHA Product

Demo

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Cluster Diagram
Critical Web Server Application Cluster
CLUSTER NAME: cwsa_cluster gateway
10.69.19.1

net_ether_01 network

cluster
ha40 repository ha41
10.69.19.40 10.69.19.41

rootvg rootvg
sharevg
/cwsa

Critical Web Server Application

Participating Nodes: ha40, ha41
Service Address: hasvc 10.69.19.42
Resources: hdisk2, sharedvg, /cwsa
IBM HTTP Server Application
Application Controller: /usr/local/bin/start_WebSrv.ksh
/usr/local/bin/stop_WebSrv.ksh

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems
 IBM System p

Questions ?

Thank You.

© 2007 IBM Corporation East Region Technical Sales Support IBM Systems