Professional Documents
Culture Documents
POWER8 Hardware
Dan Hurlimann
System p Hardware Architect
hurliman@us.ibm.com
POWER9
Extreme Analytics
Optimization
POWER8 Extreme Big Data
More Cores Optimization
SMT+++ On-chip accelerators
POWER7/7+ Reliability ++
FPGA Support
45/32 nm
Eight Cores Transactional Memory
POWER6/6+ On-Chip eDRAM PCIe Acceleration
65/65 nm Power-Optimized Cores
POWER5/5+ Memory Subsystem ++
130/90 nm Dual Core SMT++
High Frequencies Reliability +
Dual Core Virtualization + VSM & VSX
Enhanced Scaling Memory Subsystem + Protection Keys+
SMT Altivec
Distributed Switch + Instruction Retry
Core Parallelism + Dynamic Energy Mgmt
FP Performance + SMT +
Memory Bandwidth + Protection Keys
Virtualization
Accelerators
362 mm2
Core Core Core
22nm SOI w/ eDRAM
Strengthen Cores L2 L2 L2
8 Threads per Core 8M L3
Caches Region
L3 Cache & Chip Intercon MemCtrl
D Cache: 64KB
DDR Interfaces
DRAM Memory
Chips Buffer
POWER8 DCM
128 128
GB 16MB 16MB GB
Up to 1 TB / Socket
First P8 Systems:
512 GB /Socket
2014 IBM Corporation
POWER8 Integrated PCI Gen 3
POWER8
PCIe G2
PCI
Device
PCI
Devices
10
2014 IBM Corporation
CAPI - Coherent Accelerator Processor Interface
PCIe Gen 3
PSL Transport for encapsulated messages
Custom
Hardware
Application
Processor Service Layer (PSL)
FPGA or ASIC
Present robust, durable interfaces to applications
Offload complexity / content from CAPP
Customizable Hardware
Application Accelerator
Specific system SW, middleware, or user application
Written to durable interface provided by PSL
11
2014 IBM Corporation
CAPI Optimization Example (Flash Device)
Application
Read/Write
Syscall
FileSystem
strategy() iodone()
20K Application
Instructions Posix Async aio_read()
LVM I/O Style API aio_write()
strategy() iodone()
User Library
Disk & Adapter DD < 500 Shared
Memory
Pin buffers,
Translate,
Interrupt,
unmap,
Instructions Work Queue
Map DMA, unpin,Iodone
Start I/O scheduling
12
2014 IBM Corporation
POWER8 Multi-threading Options
4
SMT1: Largest unit of execution work
SMT2: Smaller unit of work, but provides 3.5
greater amount of execution work per
cycle 3
1000s of Transactions
2.5
1.5
0.5
0
SMT1 SMT2 SMT4 SMT8
2014 IBM Corporation
POWER8
Bandwidths
POWER8
POWER7+
POWER7
POWER6
POWER8
POWER7
POWER6
POWER5
PowerVC
PowerVP
Enterprise
Pools 2U System: S822
2 Socket 2 Socket
1 Socket 1 Socket 2 Socket
Opt 1S Opt 1S
4U 2U 4U 2U 2U
POWER8 Memory
2xHMC
Serial
PCIe G3 x8 USB-2
Memory HMC
POWER8
12 SFF Bays
USB-3
6 SSD Slots
Slim DVD
Hypervisor: PowerVM
OS: AIX, Linux (not IBM i)
3 Yr Warranty
2014 IBM Corporation
POWER8 2S2U Scale-Out Comparison - S822
Power 730 Power System S822
Processor POWER7+ POWER8
Sockets 2 1 (Upgradeable) / 2
Cores 8 / 12 / 16 6 / 10 or 12 / 20
Maximum Memory 512 MB @ 1066 MHz 256 / 512 GB @ 1600 MHz
Memory Cache No Yes
Memory Bandwidth 136 GB/sec 192 / 384 GB/sec
Memory DRAM Spare No Yes
System unit PCIe slots 6 PCIe Gen2 LP 6 / 9 PCIe Gen3 LP
CAPI (Capable slots) N/A Yes (one per socket)
PCIe Hot Plug Support No Yes
PCIe Expansion Drawers Optional PCIe Gen1 SoD Gen3
IO bandwidth 40 GB/sec 192 GB/sec
Ethernet ports Quad 1 Gbt in x4 slot Quad 1 Gbt in x8 slot
12 SFF-3
SAS bays in system unit 3 or 6 SFF-1
Or 8 SFF-3 + 6 SSD
Integrated write cache Optional 175MB Optional effectively 7GB
Easy Tier Support No Yes
Integrated split backplane Yes ( 3 + 3 ) Yes ( 6 + 6 )
NIC SRIOV Support No SoD
Service Processor Generation 1 Generation 2
PCIe G3 x16
2xUSB-3
Memory
Memory 2xHMC
POWER8 2xSerial
2xUSB-2
SSD Bays
Slim DVD
PCIe G3 x16
Memory
2xUSB-3
Memory
2xHMC
POWER8 PCIe G3 x8 2xSerial
2xUSB-2
Memory
POWER8
SSD Bays
18 SFF Bays
2xUSB-3
Slim DVD
Power S814
Form Factor: 4U or Tower
Single Socket
Cores: 6 or 8
Memory: Up to 512 GB
Slots: 7 PCIe Gen3 Full-high (Hotplug)
Hypervisor: PowerVM
OS: AIX, IBM i, Linux
3 Yr Warranty
Hypervisor: PowerVM
OS: AIX, IBM i, Linux
200 27%
Better
150
9
100
50
0 0
Performance Performance
per Core Dual Socket 24
Core
16
Core
16
16 Core
Core
32
1 2.5 2.5
0.8 24 2 2
0.4 1 1
8
0.2 0.5 0.5
0 0 0 0
P8 S824
P5+ 595
P4 690
4U 2U
1S 2S 1S 2S
4U 4U 2U 2U
Total PCIe slots
All hot swap
All Gen3
7 11 6 9
Use 1 of the above slots for a LAN adapter
Use 1 of the above for expanded function backplane
Though these cards physically look the same and fit in the same slots
Gen3 cards/slots have up to 2X more bandwidth than Gen2 cards/slots
Gen3 cards/slots have up to 4X more bandwidth than Gen1 cards/slots
More virtualization
More consolidation saving PCI slots and I/O drawers
More ports per adapter
18
16
14
Peak
12 Sustained A Gen1 x8 PCIe adapter has a theoretical max (peak)
10
bandwidth of 4 GB/sec.
8
6 A Gen2 x8 adapter has a peak bandwidth of 8 GB/sec.
4 A Gen3 x8 adapter has a peak bandwidth of 16 GB/sec.
2
0
x8 x16
2U server example
12 SAS bays base & split
Backplanes provide
High performance integrated SAS controller(s) built on IBM industry
leading PCIe Gen3 SAS adapter technology
All include RAID 0, 1, 5, 6, 10. Plus hot spare capability
Split backplane option with zero-write cache controllers
Easy Tier function*
8-18** SAS bays for 2.5-inch (SFF) HDD or SSD
6-8 SAS bays for 1.8-inch SSD*
One DVD bay Op-panel
Option for attaching one EXP24S drawer of HDD or SSD*
DVD
Expanded
Must select one Base Split Function *
12 SFF SAS bays 6+6 SFF SAS bays 8 SFF SAS bays
1 SAS controller 2 SAS controllers Dual SAS controllers
2U server No write cache No write cache 7.2**GB cache
RAID-0,1,5,6,10 RAID-0,1,5,6,10 RAID-0,1,5,6,10
DVD bay DVD bay DVD bay
6-bay SSD cage
External SAS ports
Easy Tier function
Availability plan:
- eConfig 15 July
- GA Sept
Expanded
Must select one Base Split Function *
12 SFF SAS bays 6+6 SFF SAS bays 18 SFF SAS bays
1 SAS controller 2 SAS controllers Dual SAS controllers
4U server No write cache No write cache 7.2**GB cache
RAID-0,1,5,6,10 RAID-0,1,5,6,10 RAID-0,1,5,6,10
DVD bay DVD bay DVD bay
8-bay SSD cage***
External SAS ports
Easy Tier function
Availability plan:
- eConfig 15 July
- GA Sept
IBM i essentially already has same kind of hot/cold function in OS for all SAS adapters, but could
this function via VIOS
IBM i 7.2
Max Scale = 32 cores (SMT4)
POWER7 Max Partition = 96 cores (SMT4)
Threads = ST, SMT2, SMT4 up to 384 threads in single partition
PowerKVM
PowerVM PowerKVM
GA Availability 2004 Q2 2014
All P6, P7, P7+, P8 PowerLinux P8 Systems
Supported Hardware
Systems S120L & S220L
Supported OS AIX, IBM i & Linux Linux
Supports AIX, IBM i &
Workload Mobility Linux
Linux
Basic Virtualization
IVM / HMC / FSM Virtman/libvirt
Management
Advanced Virtualization PowerVC, Vanilla
PowerVC/VMControl
Management OpenStack
Admin Type Power Centric Linux/x86 Centric
Established Security
Yes No
Track Record on Power
Open Source
No Yes
Hypervisor
AIX 7.1
AIX 7.1 AIX 7.1 AIX 7.1 AIX 7.1 AIX 7.1
AIX 6.1
AIX 6.1 AIX 6.1 AIX 6.1 AIX 6.1 AIX 6.1
AIX 5.3
AIX 5.3 AIX 5.3 IBM i 7.2 IBM i 7.2
Performance Monitoring
1. View System Performance Dashboard
2. View Resource Utilization Trends (Processor, Memory, Network, Storage)
Disk/HDD
New capacity - 600GB 15k rpm
New 4k block drives
SSD new 1.8-inch 387GB for