Power8 Technology

WorkShop

Daniel Villacorta
Power Systems Consultant
IBM Systems Lab Services
danielvi@mx1.ibm.com
 Agenda

Power Systems E880 Overview

System Node & System Control Unit

HMC

PowerVM

LPARS

2 2014 International Business Machines Corporation

 New Power Systems

2013 Power Systems PowerLinux TM

PowerLinux TM

7R2
7R1
Power Power
750 760
Power 710 Power
730
PowerLinux TM

7R4 Power Power Power

Power 770 780 795
Power 740
720
Scale-out Systems (1 & 2 sockets) Enterprise Systems (4+ sockets)

Power E870 Power E880

2014 IBM Power Systems

Power Power
S812L S822L

Power S822

Power S814 Power S824

Announce: April 28, 2014

Announce: October 6, 2014
 Enterprise Power Scale-up Positioning

Power E880
Power E880
Power E870
Power E880
Power E870

Power 780 Power 795

Power 770
4
2014 International Business Machines Corporation 4
 Power E880
8 to 128 cores @ 4.35 GHz
Up to 192 cores in 2015*
256GB to 16TB* Memory
32 or 48* core nodes (5U)
1 to 4 nodes per system
8 PCIe adapter slots per node
System Control Unit (2U)
Up to 4 PCIe I/O drawers per Node*

2014 IBM Corporation

5
 Enterprise POWER8 system structure
EXP24S I/O Drawer(s)
2U Form factor
24 SFF SSD/HDD
Each connects via
2 SAS adapters
CEC Node(s)
5U form factor in an industry-
standard 19 rack
8 Low-profile PCIe Gen3 I/O
slots / node
32 DIMM slots / node
2014 IBM Corporation
6
PCIe I/O Expansion Drawer(s)
4U Form factor
12 PCIe Expansion Slots
Each connects via 2 PCIe adapter
slots in a node
System Control Unit
2U Form factor
One per system (required)
External FSP
Clock / Oscillator Support
Optional DVD
19 Form Factor
Connect multiple nodes
Required on all systems
POWER8 System Node (CEC Drawer)
8 PCIe Gen3 x16 Slots
(for LP PCIe adapter or
32 CDIMM slots Optical Interface to I/O drawer)
Up to 4TB

Fans

4 POWER8
SCMs

Power
Supplies
5U Enclosure

2014 International Business Machines Corporation 7

POWER8 System Node (CEC Drawer)

One to four nodes (E880)

32-core 4.35 GHz
See SOD for 48-core node *

All nodes in a server must have identical SCM processor

features

2014 International Business Machines Corporation 8

POWER8 System Node (CEC Drawer)

1-node 2-node 3-node 4-node

system system system system
E880
32-core node 32-core 64-core 96-core 128-core
(2015) (2015)
SOD 48-core 2015 2015 2015 2015

2014 International Business Machines Corporation 9

POWER8 System Node (CEC Drawer)

5U Enclosure

32 memory slots per node

8 PCIe Gen3 x16 low profile slots per node

----------------------

No integrated SAS bays or SAS controller in node

No integrated DVD bay or DVD controller in node
No integrated Ethernet port in node
No tape bay in node

2014 International Business Machines Corporation 10

System Control Unit (Midplane)

One system control unit per system

2U drawer

System control unit holds:

Service processors (FSPs)
HMC ports
Optional DVD

2014 International Business Machines Corporation 11

System Control Unit (Midplane)
Front View

Optional DVD

Fan Fan Fan Fan

Ops panel

Rear View
Redundant Hot
Redundant Power plug Clock Battery Redundant Power

Service Clock Clock Service

Processo Processo 2
2
r HMC r HMC
ports ports

2014 International Business Machines Corporation 12

 Power E870/E880 with 1 Node

Node

Sys Cntrl Unit

7U in 19 rack

2014 International Business Machines Corporation 13

 Power E870/E880 with 2 Nodes

Node

Sys Cntrl Unit

Node

12U in 19 rack

2014 International Business Machines Corporation 14

 Power E880 with 3 Nodes (2015)

Node

Sys Cntrl Unit

Node

Node
17U in 19 rack

2014 International Business Machines Corporation 15

 Power E880 with 4 Nodes (2015)

Node

Node

Sys Cntrl Unit

Node

Node
22U in 19 rack

2014 International Business Machines Corporation 16

 System Node PCIe slots

8 PCIe Gen3 x16 low

profile

Eight Low profile (LP) adapter slots

Used for PCIe adapters (Gen1, Gen2 or Gen3 LP adapters)
Or used to connect to PCIe Gen3 I/O Expansion Drawer

2014 International Business Machines Corporation 17

 PCIe Gen3 I/O Expansion Drawer

Front view

12 PCIe Gen3 slots

4U drawer
Rear view
6 PCIe Gen3 Slots
4x8 2x16

2014 International Business Machines Corporation 18

POWER8 CEC Drawer to Gen3 I/O Drawer Cabling

PCIe Optical
Cable
Max 20 meter

Dual
Modules Fan-out Module
Fan-out Module 6 PCIe G3
6 PCIe G3 Slots
Slots 4 x8 & 2 x16
2014 International Business Machines Corporation
4 x8 & 2 x16 19
 Min/Max PCIe I/O Drawer per System

Two system node Two system node Two system node

One system node One system node

+ + +
0 1 1
0 1
2 2
2
3
4
0 or 2 PCIe Gen3 I/O
Drawers in 2014 0, 2 or 4 PCIe Gen3 I/O Drawers in 2014
(max 2 per node)

2014 IBM Corporation

2014 International Business
Machines Corporation
 Power 870/880 PCIe Slot Math

-2 Uses 2 PCIe slots in system

node for attachment

12 PCIe slots in PCIe Gen3

+ 12 I/O Drawer
---------------
Net +10 additional slots to the system
with each PCIe3 I/O Drawer

Total PCIe slots Total PCIe slots

per 1-node server per 2-node server
With zero PCIe drawers on server 8 16
With two PCIe drawers on server 28 36
With four PCIe drawers on server n/a 56
Note 1 or 3 drawers per server not supported in 2014
2014 IBM Corporation
 Sample Rack Configurations

42 PDU PDU
41 PDU
40 location
39 for IO drws
38
37
36
35 12u available for
34
33
IO drws
32
31
30
29
28
27 5u space reserved for
26
25 System node
24
23 B
5 E E E E 5 B
22 ea 8 N N N N 8 ea
System
rp rp
21 9 0 0 0 0 9
20 w
a
w
a
node
9 B J J B 9 Drw 1
19
18 Sys Cntrl
17 FSP / Unit
16 B
5 E E Clk E E 5 B
15 ea 8 N N N N 8 ea System
14 rp rp
node
a 9 0 0 0 0 9 a
13
12
w
9 B J J B 9
w
Drw 2
11
10
9
5u space reserved for
8 System node
7
6
5 2u space reserved for PDUs
4 PDU
3 PDU
2
1 2u reserved
for
cable
handling
2014 IBM Corporation
Power8 Technology
WorkShop

HMC
 HMC

2014 IBM Corporation

 Login to the HMC Console

2014 IBM Corporation

 Login to the HMC Console

2014 IBM Corporation

 Login to the HMC Console

2014 IBM Corporation

 Login to the HMC Console

2014 IBM Corporation

 Login to the HMC Console

2014 IBM Corporation

 Login to the HMC Console

2014 IBM Corporation

 Login to the HMC Console

2014 IBM Corporation

 Create LPAR Shared or Dedicated?

2014 IBM Corporation

 Create LPAR Shared or Dedicated?

Specify minimum, desired,

and maximum Processing
Units, in 0.1 increments.

Specify minimum, desired,

and maximum Virtual
Processors, in whole
processor increments.

Select Uncapped if you

want this SPLPAR to utilize
spare processor cycles.

2014 IBM Corporation

 Memory configuration

Specify minimum,
desired, and maximum
Memory,

2014 IBM Corporation

 2014 IBM Corporation
 2014 IBM Corporation
 2014 IBM Corporation
Power8 Technology
WorkShop

PowerVM
 IBM PowerVM Virtualization Features

Processor
I/O
Shared or dedicated LPARs Shared and/or dedicated I/O
Capped or uncapped LPARs Virtual Ethernet, virtual SCSI
Multiple shared processor pools Dynamic LPAR operations
Dynamic LPAR operations Virtual FC (N_Port ID Virtualization)
Shared dedicated LPARs Virtual Tape Support

Memory
Other
Dedicated memory Integrated Virtualization Manager
Dynamic LPAR operations PowerVM Live LPAR mobility
Active Memory Expansion (AIX 6.1) Shared Processor Pools

Dedicated Shared Processor Pool

Processor LPARs
Pool 1 Pool 2
WPAR Virtual
OS OS I/O OS OS OS OS
Server
LPAR
LPAR LPAR LPAR LPAR LPAR LPAR LPAR LPAR

PowerVM Hypervisor

2014 IBM Corporation

 IBM PowerVM Virtualization Features

Virtual Processors
Physical processing cycles are presented to AIX through Virtual Processors

LPAR LPAR SPLPAR SPLPAR SPLPAR SPLPAR SPLPAR SPLPAR

#1 #2 #3 #4 #5 #6 #7 #8

V V V V V V V V V V V
1 Core 2 Cores
(dedicated) (dedicated)
Pool # 0

Hypervisor
Core Core Core Core Core Core Core Core Core Core Core Core Physical

2014 IBM Corporation

 IBM PowerVM Virtualization Features
Processing Units
Processing Units allow physical processors to be allocated in fractional increments

LPAR LPAR SPLPAR SPLPAR SPLPAR SPLPAR SPLPAR SPLPAR

#1 #2 #3 #4 #5 #6 #7 #8

V V V V V V V V V V V

PU = 1.2 PU = 0.5 PU = 1.5 PU = 0.1 PU = 0.8 PU = 0.8

1 Core 2 Cores
(dedicated) (dedicated)
Pool # 0

Hypervisor
Core Core Core Core Core Core Core Core Core Core Core Core Physical

2014 IBM Corporation

41
 IBM PowerVM Virtualization Features

Virtual Processor and Processing Unit relationship

Virtual Processors Range Of Processing
Assigned to LPAR Units that the LPAR
can utilize
1 0.1 - 1
2 0.2 - 2
Example: An LPAR has two virtual
processors. This means that the assigned
processing units must be somewhere
between 0.2 and 2. The maximum
processing units that the LPAR can utilize
is two.

3 0.3 - 3

4 0.4 - 4

x 0.1x - x

Learning point
The number of virtual processors establishes the maximum number of
processing units that an SPLPAR can access.

2014 IBM Corporation

 IBM PowerVM Virtualization Features

Logical Processors
Simultaneous Multi-Threading (SMT) threads are represented by logical processors

LPAR LPAR SPLPAR SPLPAR SPLPAR SPLPAR SPLPAR SPLPAR

#1 #2 #3 #4 #5 #6 #7 #8

SMT=On SMT=Off SMT=On SMT=Off SMT=On SMT=On SMT=On SMT=On

L L L L LLLLLL L L L L L L L L L L L L Logical

L L V V V V V V V V V V V Virtual
Weight = 255 Uncap = No Weight = 30 Weight = 10 Weight = 100 Weight = 100
1 Core 2 Cores PU = 1.2 PU = 0.5 PU = 1.5 PU = 0.1 PU = 0.8 PU = 0.8
(dedicated) (dedicated)
Pool # 0

Hypervisor
Core Core Core Core Core Core Core Core Core Core Core Core
Physical

2014 IBM Corporation

 IBM PowerVM Virtualization Features

2014 IBM Corporation

THANKS!