IBM® Edge2013 - Introduction To IBM XIV Storage System

Jack Arnold - IT Management Consultant 15 May 2013
Session 1029 Introduction to IBM XIV Storage System and What Makes It Unique
2013 IBM Corporation
IBM Presentation Template Full Version
XIV IBM System Storage
Founders are 5 graduates of Talpiot 14th class (XIV=14 in Roman numerals)
Chief Architect and IBM Fellow - Moshe Yanai

Formerly EMCs CTO Led the development of the Symmetrix and DMX systems
Founded in 2002 1st customer system installed in early 2005

http://funds.globes.co.il/serveen/globes/docview.asp?did=1000394326&fid=942
2 2013 IBM Corporation
Do It Yourself Supercomputers
1716 Sony PS3 processors35th or 36th most powerful supercomputer in the world
(Credit: Air Force Research Laboratory)
PlayStations power Air Force supercomputer http://news.cnet.com/8301-17938_105-20025680-1.html
http://www.af.mil/news/story.asp?id=123233543
Supercomputers
Climate change research gets petascale supercomputer 1.5-petaflop IBM Yellowstone system runs 72,288 Intel Xeon cores
Image courtesy of
http://www.computerworld.com/s/article/9232382/Climate_change_research_gets_petascale_supercomputer
Cache
24GB of per module x 15 modules 360 GB of cache 45 GB for Linux = 315 GB usable More than 1 GB of cache per usable TB!
Cache Is Distributed Not Centralized
IBM XIV Storage System 1TB
180 disks per rack (12 * 15), each disk is 1TB 7200 RPM Single rack provides 79TB usable capacity
Full Rack Power Consumption

7.7 KW, 180 1 TB spindles, 79 TB usable capacity, 97 W / TB 7.3 KW, 180 2 TB spindles, 161 TB usable capacity, 45 W / TB 6.7 KW, 180 2 TB spindles, 161 TB usable capacity, 42 W / TB 7.0 KW, 180 3 TB spindles, 243 TB usable capacity, 29 W / TB
XIV SSD Solution

High capacity SSDs used as secondary read cache 480 GB enterprise-class SSD device added to each module 7.2 TB of cache per full rack Housed in PCI caddy in rear of module Scales with the system 6 to 15 SSD drives Must be added to all modules together
Why 7200 RPM?
10
Storage Efficiency
Relative Power @ typical R/W operation load
500 400 300 200 100 0 100TB 200TB 400TB 800TB 15K 3.5" 7200 3.5" Tape
Source: IBM data, 2009

IBM XIV Storage System The Quest
Delivering Fibre Channel performance at 7200 RPM (SATA or NL SAS) cost
12
IBM XIV Storage System The Promise
Or put another way Tier 1 - Performance - Reliability - Capability At a Tier 2 price!
13
Industry Standard Components
Processors Intel Quad-Core (1 or 2) Connectivity 1Gb Ethernet or Infiniband Disks standard 7200 RPM (SATA or NL SAS) Rack was industry standard (APC), now IBM T42
14
Lower TCO
XIV Remote Replication Point in Time Copy Multi-path Drivers Management Software Host Attach Brand X (such as E** or H**) No additional charge No additional charge No additional charge (we use native drivers) No additional charge No additional charge $$$$ or $$$$ or $$$$ or $$$$ or $$$$ or
15
LUN Creation
LUNs are allocated in 17 GB chunks Volumes can be dynamically resized (increased only) Primary and Secondary in a synchronous mirroring relationship will be resized User does not plan the layout of the volumes relative to physical drive resources
16
LUN Creation
Decisions What type of disk (SATA, Fibre Channel) What size disk (73GB, 146GB, 300GB, 450GB) What speed disk (10K RPM, 15K RPM) What RAID level? Which set of disks (array)? Do I need tiers of storage?
XIV tierless (tear-less!) storage

On-going Management Effort: None
All spindles are always utilized No management effort or optimization No Hot-Spots
18
Global Hot Spare Storage Capacity Concept
Traditional approach Dedicated Hot spare drives With the IBM XIV Storage System, each disk is utilizing 95% of its space The system provides enough hot spare capacity to tolerate a sequence of three disk failures and one module failure, all while still providing redundancy Upon a failure, the system returns to redundancy
19
Reliability
20
XIV Disks
Drives 1-12
21
Drawers 1-15
Break data into 1MB chunks
How Do You Get From 180TB to 79TB?
180 TB -15 drives for redundant capacity for drive and drawer failures - 7 TB for a years worth of performance data, system dumps, metadata =158 158 / 2 (for duplicating data) = 79
22
All Drives Have Same Amount of Activity
Makes predictive analysis very good
23
Aggressive Monitoring of Drives
24
Aggressive Monitoring of Drives
X
80% of drives returned have been administratively failed
25
Performance
26
XIV Disks
Drives 1-12
180 MB LUN (not possible, illustrative purposes only)
27
Drawers 1-15
Disk Rebuild Times 1TB Drive
(30-35 minutes is maximum on a full system)

Hours
30 minutes! XIV Other
Rebuilds Take a Long Time
A 2 TB drive might take 40 hours or more to restore. RAID 5: theory & reality http://www.zdnet.com/blog/storage/raid-5-theory-reality/983
29
Traditional RAID-5 (IBM, EMC, HDS) Rebuild

Data Data Data Data Data Data Data Spare
X
6 drives read
Data Data
Cache
1 drive writes
Data Data Data
Data
Data
30
XIV Disks Participating in Rebuild
179!
(168 for reads)
Technically, not a rebuild but rather a re-gaining redundancy)
X
XIV Disks
Drives 1-12
180 -12 168

32
Drawers 1-15
Data is never duplicated inside the same drawer
Typical Rebuild
33
Smart Rebuild (regaining redundancy)
34
Adding more Storage Capacity
Data is automatically rebalanced
35
Managing Storage
Storage Pool Consistency group
Total Capacity
36
Storage Pools Regular and Thin Provisioning

256 pools maximum
37
Creating Point in Time Copies (Snapshots)
38
Restore From Point in Time Copies Brand X
39
Restore From Point in Time Copies XIV
40
XIV Space Efficient Snaps
41
IBM XIV Storage System GUI
42
Value of Redundancy
43
IBM XIV Data Migration Feature
Migrates data from brand x boxes to XIV - One outage to connect the box - Then transparent migration of LUNs (can be thin-provisioned) - Tunable: 300GB/hr -> 1TB/hr
EMC HDS
44
IBM XIV Data Migration Feature
One way transfer from brand x boxes to XIV Then two way communication with server - 512 LUNs from 4 different targets
EMC HDS
45
The Problem
Long distance and low bandwidth

The Solution - Offline Initialization
Tape
Tape
47
Web Hosting on VMware, Brand X
App App App App OS OS OS OS
App OS
Brand X Storage
48
Web Hosting on VMware with XIV
App App App App OS OS OS OS
App OS
49
Thank You!
The End
Session 1029 Introduction to IBM XIV Storage System and What Makes It Unique
2013 IBM Corporation 51

IBM® Edge2013 - Introduction To IBM XIV Storage System

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

IBM® Edge2013 - Introduction To IBM XIV Storage System

Uploaded by

Copyright:

Available Formats

Jack Arnold - IT Management Consultant 15 May 2013

2013 IBM Corporation

IBM Presentation Template Full Version

XIV IBM System Storage

Founders are 5 graduates of Talpiot 14th class (XIV=14 in Roman numerals)

Chief Architect and IBM Fellow - Moshe Yanai

Founded in 2002 1st customer system installed in early 2005

IBM Presentation Template Full Version

(Credit: Air Force Research Laboratory)

PlayStations power Air Force supercomputer http://news.cnet.com/8301-17938_105-20025680-1.html

IBM Presentation Template Full Version

IBM Presentation Template Full Version

2013 IBM Corporation

IBM Presentation Template Full Version

Cache Is Distributed Not Centralized

2013 IBM Corporation

IBM Presentation Template Full Version

IBM XIV Storage System 1TB

2013 IBM Corporation

IBM Presentation Template Full Version

Full Rack Power Consumption

2013 IBM Corporation

IBM Presentation Template Full Version

XIV SSD Solution

2013 IBM Corporation

IBM Presentation Template Full Version

Why 7200 RPM?

2013 IBM Corporation

IBM Presentation Template Full Version

Relative Power @ typical R/W operation load

Source: IBM data, 2009

IBM Presentation Template Full Version

IBM XIV Storage System The Quest

Delivering Fibre Channel performance at 7200 RPM (SATA or NL SAS) cost

2013 IBM Corporation

IBM Presentation Template Full Version

IBM XIV Storage System The Promise

Or put another way Tier 1 - Performance - Reliability - Capability At a Tier 2 price!

2013 IBM Corporation

IBM Presentation Template Full Version

Industry Standard Components

2013 IBM Corporation

IBM Presentation Template Full Version

2013 IBM Corporation

IBM Presentation Template Full Version

2013 IBM Corporation

IBM Presentation Template Full Version

XIV tierless (tear-less!) storage

IBM Presentation Template Full Version

On-going Management Effort: None

All spindles are always utilized No management effort or optimization No Hot-Spots

2013 IBM Corporation

IBM Presentation Template Full Version

Global Hot Spare Storage Capacity Concept

2013 IBM Corporation

IBM Presentation Template Full Version

2013 IBM Corporation

IBM Presentation Template Full Version

2013 IBM Corporation

Break data into 1MB chunks

IBM Presentation Template Full Version

How Do You Get From 180TB to 79TB?

2013 IBM Corporation