Professional Documents
Culture Documents
Joefon Jann,
Distinguished Engineer IBM T.J.Watson Research Center August, 2009
AIX Virtualization
Agenda
AIX Virtualization Features & the Values they bring to Customers: 1. (LPAR) Dedicated Static LPARs 2. (DLPAR) Dedicated Dynamic LPARs 3. (SPLPAR) Shared Processor LPARs 4. (SMT) Simultaneous MultiThreads 5. (WPAR) Workload PARtitions a) System WPAR, b) Application WPAR 6. Partition Mobility -- a) WPAR Mobility, b) LPAR Mobility 7. Latest Virtualization Features
VIOS Virtual Tape Support (NPIV) N_Port ID Virtualization for SAN (AMS) Active Memory Sharing
Industry-Leading UNIX Virtualization, Performance, Robustness, plus Security & a rich set of Systems Management Tools
Highlights of AIX Leadership Virtualization, Robustness & Performance Some handy AIX URLs
joefon@us.ibm.com
8/2009
AIX Virtualization
1973
IBM
announced 1st machines with physical partitioning
1987
IBM announced LPAR on the z-mainframe
2001
IBM announced LPAR on POWER4
2002
IBM announced DLPAR with AIX5.2 on POWER4
2004
IBM announced SPLPAR, SMT & VIOS with AIX5.3 on POWER5
2007
2008
2009
IBM announced AMS, NPIV, Virtual Tape
CP67-OS
that later became VM/370 on the z-mainframe
IBM IBM announced announced AIX6 on PowerVM POWER6, the 1st UNIX with Live Partition Mobility. WPARs avail.
In our opinion, the System p platform offers exceptionally high performance and availability in a very flexible package. We can quickly adapt to changing business conditions by activating additional processors or moving system resources from one partition to another all without the delay and complexity of installing new hardware.
-- Clive Taylor, Head of Operations, Metavante Technologies Ltd March 2008
Client quote source: Metavante Technologies Ltd case study published at http://www-01.ibm.com/software/success/cssdb.nsf/CS/STRD-7CAKTE?OpenDocument&Site=eserverpseries&cty=en_us
8/2009 joefon@us.ibm.com
AIX Virtualization
POWER5+
p5-595
POWER6
p6-595, p6-575
Future POWER7 . . .
P5-570
p6-570
p5-560Q
p5-550/550Q
p6-560 Express
p5-520/520Q
p5-510 & 510Q BladeCenter JS23, JS43 Express p5-505 & 505Q
8/2009
joefon@us.ibm.com
AIX Virtualization
1.
2. 3.
Application A on Sys1 Application B on Sys2 Application C on Sys3
Sys3
Sys2 Sys1
8/2009 joefon@us.ibm.com
AIX Virtualization
8/2009
joefon@us.ibm.com
AIX Virtualization
Then comes AIX pSeries Partitioning Innovations -- giving you more for your money
In 2001 IBM introduced static LPAR on P4 systems, enabling:
Servers Consolidation -- the workloads of several smaller servers can simply be placed into separate LPARs of an SMP, hence unifying and reducing system administration tasks. Workloads Separation -- Development, Testing, & Production Workloads can each run in its own Logical Partition. running an Application at its optimal performance with the right amount of resources -- without assigning excessive amounts of h/w resources e.g. the whole machine.
In 2002, IBM introduced DLPAR on P4 systems, enabling the following Autonomic features:
Self Protecting feature: Dynamic CPU Guard = graceful CPU de-configuration, for CPUs with intermittant errors. Self Healing feature: Dynamic CPU Sparing: This is "Dynamic CPU Guard" feature enhanced with automatic enablement of a spare CPU to replace a defective CPU. Future hot-repair: hot-plug MCM -- when the HW supports it in the future.
--- cont'd on next page --8/2009 joefon@us.ibm.com
AIX Virtualization
8/2009
joefon@us.ibm.com
AIX Virtualization
AIX
CPU CPU
AIX
CPU CPU CPU
AIX
CPU
IO
IO
LMB LMB
IO
IO
IO
IO
IO
LMB
Memory
LMB LMB LMB
LMB
LMB
LMB
LMB
HMC
Local-Firmware
Local-Firmware
Partition Manager, Hypervisor, ...
Local-Firmware
Global-Firmware:
DLPAR is the system technology that allows you to move selected HW resources (e.g. CPUs, memory-blocks, IO-slots) from 1 OS instance to another, on a pSeries SMP, without requiring reboots.
9/2009 joefon@us.ibm.com
AIX Virtualization
-- enables you to run more work with a single server than ever before.
SPLPARs automatically & rapidly responds to changing needs => less headaches
Micro
Application A Application B Application C
8/2009 joefon@us.ibm.com
10
AIX Virtualization
VIOS Server
(AIX 5.3)
AIX 5.3
Virtual Virtual Disks Disks IP Route
AIX 5.3
Linux
Virtual Ethernet
Hypervisor
I/O Storage Netwk
11
AIX Virtualization
VIOS1
VIOS2
Veth adapter
Veth adapter
Veth adapter
SEA
SEA
Veth adapter
Veth adapter
Veth adapter
POWER Hypervisor
LAN1 Veth. performs like a standard Ethernet. Reduces # physical adapters needed, hence saves you MONEY & headaches. Can have multiple Vethernets per LPAR.
IP forwarding / bridging is provided by VIOS LPAR. Each real adapter can support up to 16 virtual Ethernet LANs The Second VIOS is OPTIONAL, and provides connectivity even when the VIOS is down.
Supported since AIX 5.3 on P5 onward.
8/2009 joefon@us.ibm.com
IP network
LAN2
12
AIX Virtualization
How Virtual I/O Disks Saves Money & Provides High Availability
LPAR0 LPAR1 LPAR2 LPAR3 LPAR4
VIOS1
VIOS2
A
SCSI / Fiber disk
1A 2A 3A
1A 1B
Mirror
2A 2B
Mirror
3A 3B
Mirror
1B 2B 3B
B
SCSI / Fiber disk
VIO Saves You Money One VIOS real disk can appear as multiple logical disks to the client LPARs How VIO Provides High Availability: 1. Use Redundant VIOS LPARs to provide the logical disks. 2. Use LVM mirroring in a Client LPAR to replicate disks 3. Result: Client LPARs remain available when a disk, or even when one VIOS goes down.
9/2009 joefon@us.ibm.com
13
AIX Virtualization
# Logical Processors
SMT on: 2 to 1 ratio with \ Virtual processors
(80)
or
SMT off
or # Logical Processors
SMT off: 1 to 1 ratio with \ Virtual processors
(4)
SMT off
9/2009 joefon@us.ibm.com
14
PHYPs view
# Virtual Processors
(4)
# Virtual Processors
(40)
AIXs view
AIX Virtualization
AIX Evolution
1986-1992 1994-1996 1997-1999 2001-2002 2004-2005 2007-2009
AIX/6000
AIX 2 & 3
Establishment in the market: - RISC Support - UNIX credibility - Open Sys. Stds.. - Dynamic Kernel - JFS and LVM - SMIT
AIX 4.1/4.2
SMP Scalability: - POWERPC spt. - 4-8 way SMP - Kernel Threads - Client/Server pkg - NFS V3 - CDE - UNIX95 branded - NIM - > 2GB filesystems -HACMP Clustering - POSIX 1003.1, 1003.2, XPG4 - Runtime Linking - Java 1.1.2
AIX 4.3
Higher levels of scalability: - 24-way SMP - 64-bit HW support - 96 GB memory - UNIX98 branded - TCP/IP V6 - IPsec - Web Sys. Mgr. - LDAP Dir. Server. - WorkLoad Mgr - Java JDT/JIT - Direct I/O - Alt. Disk Install - Exp/Bonus CDs
AIX 5L 5.1/5.2
Flexible Resource Management: - POWER4+ spt. - Dynamic LPAR - DCUoD,
CPU Sparing
AIX 5L 5.3
Advanced Virtualization: - POWER5 support - 64-way SMP - SMT - MicroPartitions - VIOS - Partition Load Mgr - NFS Version 4 - Adv. Accounting - Scaleable VG - JFS2 Dyn.Shrink - SUMA - SW RAS features - POSIX Realtime
AIX 6.1
- POWER6 support
ContinuousAvailab.
-Storage Keys -Dynamic tracing -Software FFDC -Recovery Rtns -Concur.kern.Update - RBAC - Encrypting JFS2 - AIX Security Expert - Director Console
AIX 3.2.5
Maturity: - Stability - Quality
- New 64bit kernel - 512GB mem - JFS2 - 16 TB filesystems - UNIX03 branded - Concurrent I/O - MultiPath I/O - Flex LDAP Client - XSSO PAM spt
e-Business Computing
32-way SMP
On Demand Business
Dynamic InfraStructures
15
64/128-way SMT
joefon@us.ibm.com
AIX Virtualization
AIX instance
Workload Partition Workload Partition
Billing
Each sysWPAR is a separate administrative domain: Each sysWPAR can have its unique network, fileSystems, & security (i.e. loginids, groups, etc).
Test
Workload Partition
Workload Partition
BI
Web Server
8/2009
joefon@us.ibm.com
16
AIX Virtualization
and the appWPAR is dismantled when the Application stops. appWPARs share the global AIXs file systems. appWPARs are good candidates for HPC applications: For long-running HPC Applications that run for days Checkpoint/restart capability could be very useful.
8/2009
joefon@us.ibm.com
17
AIX Virtualization
It takes longer to create a sysWPAR than an appWPAR, because it builds its own fileSystems.
sysWPARs are removed only when requested.
sysWPARs can be stopped and restarted w/o AIX reboot. Has its Own system services e.g. inetd, cron, syslog Does not share writable fileSystems with other sysWPARs or the global AIX. Is Integrated with Role-Based Access Control (RBAC)
granular privilege & security controls within WPAR
8/2009 joefon@us.ibm.com
Create
Run Stop
Ch eck p
18
Remove
Re sta
oin t
rt
AIX Virtualization
Live WPAR-Mobility
- Enables you to Move non-disruptively a WPAR from 1 AIX Instance to another (even in a different CEC). - Application State (Memory and I/O) is fully Preserved
AIX OS Instance1 AIX OS Instance2
NFS
Workload Partition A Workload Partition B
Workload Partition S
Workload Partition Q
Workload Partition C
Application Partition D
Workload Partition E
Workload Partition R
Key scenarios:
Server Repair/Upgrade - needs to be shut down for service or upgrade Workload Balancing - Need to redistribute workloads to optimize resources Workload Growth - Growing SMP server workload to a more powerful SMP server
8/2009 joefon@us.ibm.com
19
AIX Virtualization
Virtualized SAN and Network Infrastructure Virtualized SAN and Network Infrastructure
8/2009
joefon@us.ibm.com
20
AIX Virtualization
LPAR4 Asia
WPAR #1
LPAR4 Europe
WPAR#1
LPAR5
Busns. Dev
VIO Server
Planning
WPAR #2
MFG
Test
WPAR #2
Development
WPAR #2
Billing
AMS Pool
POWER Hypervisor of the CEC
8/2009
joefon@us.ibm.com
21
AIX Virtualization
-- Its Rich set of options spans the 2-D space of workload-Isolation & Resource-Granularity
Increasingly-Finer Resource-granularity
WLM
AIX WorkLoad Manager [ for CPU & Mem ]
since AIX 4.3.3 !!
WPARs
[ Workload PARtitions ]
Dedicated LPARs
[ Dedicated CPU & Mem & IO ]
Workload Isolation
8/2009 joefon@us.ibm.com
22
AIX Virtualization
8/2009
joefon@us.ibm.com
23
AIX Virtualization
#4
#4
LPAR #3
LPAR #2
LPAR #1
SEA Driver
Ethernet Driver
Ethernet Driver
Ethernet Driver
Power Hypervisor
PHyp
24
AIX Virtualization
VIOS
Real SAS Adapter Virtual SAS Adapter Virtual SAS Adapter
Power Hypervisor
Statement of Direction IBM intends to support VIOS virtual tape capabilities with IBM i and Linux environments in 2009.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
8/2009
joefon@us.ibm.com
25
AIX Virtualization
VIOS
Real FC Adapter Virtual FC Adapter Virtual FC Adapter
Power Hypervisor
Enables use of existing storage management tools Simplifies storage provisioning Enables access to SAN devices including tape libraries Statement of Direction
IBM intends to support N_Port ID Virtualization (NPIV) on the POWER6 processor-based Power 595, BladeCenter JS12, and BladeCenter JS22 in 2009.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
8/2009
joefon@us.ibm.com
26
AIX Virtualization
Statement Of Direction:
27
AIX Virtualization
25 20 15 10 5 0 Time
25 20 15 10 5 0 time
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
9/2009 joefon@us.ibm.com
28
AIX Virtualization
PowerVM Editions
Delivering industrial-strength virtualization for AIX, Linux & i customers
Maximum LPARs Management Virtual I/O Server Lx86 Shared Dedicated Capacity* Multiple Shared Processor Pools* Live Partition MobilityP
Selected PowerVM technologies are not available on all models of Power systems
8/2009
joefon@us.ibm.com
29
AIX Virtualization
8/2009
joefon@us.ibm.com
30
AIX Virtualization
ITM
8/2009
joefon@us.ibm.com
31
AIX Virtualization
TUAM:
Reporting
Business Intelligence Reporting Tool Reports will be provided, with aggregation by userid within a given server Pre-Defined Accounting Schema Export to spreadsheet, comma delimited, & CSB
8/2009
joefon@us.ibm.com
32
AIX Virtualization
2. Near-Continuous Availability
Concurrent AIX Kernel Updates
3. Security
Memory Protection Keys Domains Dynamic Tracing with ProbeVue HACMP[/XD] (Hi Availability Cluster Managemt)
RBAC (Role Based Access Control) AIXpert -- choose lo, med, hi security Encrypting Filesystem EAL4+
4. Manageability
smitty, pConsole, NIM
HMC / IVM mgt AIX Enterprise Edition TSM & mksysb for backups
5. Leadership Performance
Scientific Workloads Commercial Workloads (TPCC, SAP, ..)
8/2009 joefon@us.ibm.com
33
AIX Virtualization
Leadership Performance
Leadership Continuous Availability in the UNIX Marketplace Leadership Virtualization & Scalability to save you money
- Concurrent kernel Update (hotpatch), Memory Protection Keys, ProbeView (Dynamic Trace), etc., and more are coming. - Leadership Virtualization with DLPAR, SPLPAR, SMT, Virtual ethernet,,disk,tape, WPAR, WPAR migration, LPAR migration, AMS, etc. - AIX is the forerunner UNIX to support Mutli-core since POWER4. - Scale-up, scale-out, scale within with a full range of small to huge servers. AIX has over 15 yrs. of advanced clustering technologies. - Maxima: 8K WPARs per LPAR, 254 LPARs per CEC => over 2 million WPARs per CEC, 64 cores/CEC. Soon: 4-SMTs per P7-core => 256 Logical CPUs per AIX instance (AIX architecture can support even more). - Very easy-to-use AIXpert (set security level to low/medium/high) that comes with AIX. - NFS4 ACL the First-to-market complete NFS4 Server & Client OS, since AIX5.3.0; offering fine grain industry-standard security. - Security -- RBAC (Role Based Access Control) since AIX 5300-005. - Achieved EAL4+ level, and more features are upcoming, e.g. AHAFS.
Manageability
- smitty, mksysb, NIM & NIM tools, IVM, Systems Director, Tivoli, dynamically shrinkable JFS2 filesystem (IBM invented JFS). - migration tools (mig2p5, Unix Configuration Migration tool, ), IBM Migration Factory, etc.
Linux Affinity
8/2009
online Docs (manuals, Red Books) - Free tools on Developerworks - User Groups (e.g. powerAix.org, power.org, IBM Power Systems Technical University, User Blue, etc), classes. AIX Toolbox for Linux comes with AIX distribution: (a) Run Linux tools on AIX, and/or (b) Use gcc on AIX to compile, then run in AIX. -- Related offering: Use Lx86 to run x86 executables directly on pLinux.
34
joefon@us.ibm.com
AIX Virtualization
PowerVM Virtualization on IBM System P: Intro & Config, 4ed (Red Book):
http://www.redbooks.ibm.com/redbooks/pdfs/sg247940.pdf
http://www.redbooks.ibm.com/redbooks/SG247559/wwhelp/wwhimpl/js/html/wwhelp.htm http://www.redbooks.ibm.com/abstracts/redp4367.html?Open
IBM AIX Continuous Availability Features (Red paper): IBM Systems Magazine Open Systems edition
http://ibmsystemsmag.com/opensystems/
AIX6 Advanced Security (Red book): http://www.redbooks.ibm.com/redpieces/abstracts/sg247430.html?Open IBM PowerHA/XD (High Availability / eXended Distance) for AIX ( HACMP/XD )
http://www-03.ibm.com/systems/power/software/availability/xd/index.html
http://www.ibm.com/developerworks/wikis/display/WikiPtype/Home
8/2009
joefon@us.ibm.com
AIX Virtualization
6. 7. 8. 9.
Component Trace Memory Overlay Protection Parallel Dump Lightweight Malloc debug
AIX - 2007
Lightweight Memory Trace Consistency Checkers Component RAS infrastructure AIX error log AIX 2005 AHAFS (Autonomic Health Advisor FileSystem)
36
AIX Virtualization
AIX 6.1
2005
Secure/Trusted Execution Trusted AIX (MLS) Long Pass Phrases Secure by Default CAPP, LSPP, RBPP EAL4+ Certification (AIX, WPAR, VIOS)
AIX 5.3
Active Directory Client Support IPSec: AES Support TCP Wrappers CAPP, LSPP EAL4+ Certification AIX 5.2/5.3
* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. 8/2009 joefon@us.ibm.com
37
AIX Virtualization
6/25/01
8/2009
joefon@us.ibm.com
38
AIX Virtualization
Thank you !
8/2009 joefon@us.ibm.com
39