Texas Memory Systems

IBM Smarter Storage™ - Foundation for the Future

1

© 2012 IBM Corporation

Agenda
Why “Flash” Matters
IBM Texas Memory Systems (TMS)
RamSan Overview
Why TMS?

2

© 2012 IBM Corporation

5 reasons why RamSan is a “must” in every data center

What if you could…
1. Reduce DB and “per core”
licensing
2. Improve application efficiency

3. Improve server efficiency

4. Increase storage operations

efficiency

5. Lowest Latency!
3

© 2012 IBM Corporation

Why FLASH matters?

CPU, Network, SAN,
Memory and Bus are
getting faster…

Are you still waiting
for the 25K RPM
Disk?
Low Latency:
Do things faster
High Scalability: Do more things concurrently
Low TCO:
Save money and boost value

4

Flash delivers performance and value to boost the
applications running your business.

© 2012 IBM Corporation

Business Benefits of Flash
 Scale applications further
– Do more things with more people/customers/etc
– Increase "parallel" performance
 Speed up applications
– Do existing things faster
– Increase "serial" performance
 Create new applications
– Do more things with data
– More analytics -> more insight

Application
Benefits
Business
Benefits

 Make applications more efficient
– Do more with less spindles, CPU cores, license fees, etc
5

© 2012 IBM Corporation

Application Sweet Spots: Do More, Do it Faster!
OLTP Databases

– Financial, gaming, real-time billing, trading, real-time
monitoring, query acceleration (DB2/Oracle), etc.

Analytical applications (OLAP)

– Business intelligence, batch processing, ERP systems,
reporting, massive data feeds, etc.

Virtual Infrastructures

– VDI, Consolidated virtual infrastructures, user profiles,
etc.

HPC/Computational Applications

– Simulation, modeling, rendering, FS metadata, scratch
space, video on demand, thread efficiency, etc.

Cloud-scale Infrastructures

– On-demand computing, content distribution, web,
caching, metadata, GPFS, active file management,
etc.

6

© 2012 IBM Corporation

Server/Module Solutions

Storage System Solutions

Lots of Enterprise Flash Players

With the TMS acquisition, IBM can now
offer a complete set of server and storage
Flash products.

Niche & OEM Sales

7

Mainstream WW Direct Sales

© 2012 IBM Corporation

Agenda
Why “Flash” Matters
IBM Texas Memory Systems (TMS)
RamSan Overview
Why TMS?

8

© 2012 IBM Corporation

What is TMS?
PROVEN FLASH TECHNOLOGY
LEADER

9

© 2012 IBM Corporation

TMS History
RamSan-720: 5/10 TB SLC Flash, 4 FC (8
Gb)/IB
RamSan-710: 5 TB SLC Flash, 4 FC (8 Gb)/IB
(QDR)
RamSan-640: 8 TB SLC Flash, 10 FC (8 Gb)/IB
(QDR)
RamSan-620: 5 TB SLC Flash, 8 FC (4 Gb)
RamSan-440: 512 GB RAM, 8 FC (4 Gb)
RamSan-400: 128 GB RAM, 8 FC (4 Gb), 4 IB
(4x)

2012
2011
2010
2009
2008
2007
2006
2005
2004
2003
2002

RamSan-820: 12-24 TB eMLC Flash, 4 FC (8
Gb)/IB
RamSan-810: 10 TB eMLC Flash, 4 FC (8 Gb)/IB
(QDR)
RamSan-70: 900 GB SLC Flash, PCIe x8 2.0
RamSan-630: 10 TB SLC Flash, 10 FC (8 Gb)/IB
(QDR)
RamSan-20: 450 GB SLC Flash, PCIe x4
RamSan-500: 2 TB SLC Flash, 64 GB RAM, 8 FC (4
Gb)

RamSan-320: 64 GB RAM, 8 FC (2 Gb)
RamSan-210/220: 32 GB RAM, 4 FC (2 Gb)

SAM 500: DSP/SSD, 64 GB RAM, 15 FC (1 Gb)

1997
SAM-2000: DSP system
Company founded by Holly Frost
10

1990
1978

SAM-350/SAM-450: DSP system

Custom systems for seismic industry
CMPS: custom SSD for Gulf Oil
© 2012 IBM Corporation

Key References

11

© 2012 IBM Corporation

Agenda
Why “Flash” Matters
IBM Texas Memory Systems (TMS)
RamSan Overview
Why TMS?

12

© 2012 IBM Corporation

IBM and TMS: A Winning Combination
Key IBM-TMS Product Synergies Today

DB
DB2
2

GPFS

General
Power Systems
Accelerate
Parallel File
Leverage purpose-built
key
System
server and storage
databases
Accelerate
architectures.
with
metadata for
RamSan
high
sharedSTG Brands – Now and Future
performance
TMS Synergy Across
storage.
computing
These are general themes,
not specific or committed actions, programs,
or
(HPC).
intentions.

SAN Volume Controller
(SVC) & Storwize
V7000
Enterprise features—
tiering, replication, etc.

13

© 2012 IBM Corporation

Performance re-focus

IOPS Vs Latency
Time Processing Data Vs Waiting
Consistent Vs Variable Performance

14

© 2012 IBM Corporation

RamSan Competitive Positioning
ns

Lowest Latency
Very Expensive

us

Consistent Performance
Low Latency

Server-Side
Server-Side Flash
Flash //
HW-Based
HW-Based Flash
Flash Array
Array
SW-Based
SW-Based Flash
Flash Array
Array
Hybrid
Hybrid Array
Array

ms

Fair Latency
Expensive HDD

Disk
Disk Arrays
Arrays

Unbalanced Performance

Lowest Performance
sec
15

Lower Cost
© 2012 IBM Corporation

Flash Architectural Decisions & Guidelines

In-Server (DAS)

Shared (SAN)

 Single-instance applications
 Small capacity (> local DRAM)
 Absolute lowest latency

 Large, shared, protected capacity
 Clustered file systems
 Data Mobility
 Centralized Management
 Easy scalability

Not the best fit for:
 Shared data in clustered
environments
 Large capacities (lots of TB)
 Tiny capacities that fit in DRAM

16

Best fit for:
 Standard data center environments
(Fibre Channel, InfiniBand)
 Performance and capacity growth

© 2012 IBM Corporation

IBM/TMS Shared Flash Systems

SLC Flash

eMLC Flash

Model

710

720

810

820

Capacity

1-5 TB

5 or 10 TB

2-10 TB

10 or 20 TB

Latency (R/W)

90/25 us

90/25 us

110/25 us

110/25 us

IOPS

450K

500K

400K

450K

Bandwidth

4GB/s

5GB/s

4GB/s

4GB/s

Interfaces

4x 8Gb FC or 4x 40Gb IB

Data Protection

VSR™

2D Flash
RAID™
(inc. VSR™)

4x 8Gb FC or 4x 40Gb IB
VSR™

2D Flash
RAID™
(inc. VSR™)

All units 1U form factor, less than 500 Watts
17

© 2012 IBM Corporation

RamSan-720/820 Architecture
12 Flash Modules
(10+1+1)
(module + extension
board)
40 Flash Chips per
Module (4 x 9+1 VSR
groups)

Redundant
RAID controllers

Two Dual-Ported 8 Gb/s FC or
40 Gb/s QDR IB Interfaces
Redundant
Management
Control
Processors

1U Chassis

Redundant
Power
Supplies
Redundant
Fans

18

N+1 batteries
© 2012 IBM Corporation

Flash Module Architecture
RamSan-820

Primary Flash
Board
1TB eMLC Flash

Expansion Flash
Board
1TB eMLC Flash

19

© 2012 IBM Corporation

Flash Module Architecture
RamSan-820

Primary Flash Board
1TB eMLC Flash

Expansion Flash
Board
1TB eMLC Flash

20

Series-7 Flash Controller™
2 per Board
4 per Module

eMLC Flash Chips
20 per Flash Controller
40 per Board, 80 per

Interface Processor
Dual ports to
backplane© 2012 IBM Corporation

Flash Module Architecture

Primary Board

Series-7 Flash Controller™
2 per Board
2 or 4 per Module

Gateway Interface & Control PPC
Dual ports to backplane

21

Expansion Board (optional)

Flash Chips
20 per Flash Controller
40 per Board
40 or 80 per Module
data

XOR parity
Distributed across ALL Chips

© 2012 IBM Corporation

How to make ‘The World’s Fastest Storage’
 Hardware-only data path with extreme LOW latency
Custom FPGA-based data movement decreases latency
vs. software
 Distributed out-of-data-path CPU processing
 High Performance (IOPS), High Bandwidth
16 PPC CPUs
IO Modules
RAID
Controllers

Flash
Modules

23

12
x

Our Symmetrix-VMAX
Enginuity consists of
millions of lines of
code.”

© 2012 IBM Corporation

Flash Quality Matters!

24

© 2012 IBM Corporation

TMS Flash Nuance Protection

27

© 2012 IBM Corporation

Four Layers of Data Correction

2D Flash
TM
RAIDTM

* RamSan 720/820 Only

RamSan-720/820 introduce System-Level RAID 5 across Flash modules,
plus the other mechanisms found on all RamSan Flash storage systems.

28

© 2012 IBM Corporation

2D Flash RAID™ (RamSan 720 / 820)
External
Interfaces
(FC, IB)
RAID
Controllers

RAID 5 within
Flash Modules
(9 data + 1 parity)

TMS
2D Flash RAID™

RAID 5 across Flash Modules (10 data + 1 parity + 1 hot spare)
29

© 2012 IBM Corporation

Variable Stripe RAID™ (VSR)
 Patented VSR allows RAID stripe sizes to vary.
 If one die fails in a ten-chip stripe, only the failed die is bypassed,
then data is restriped across the remaining nine chips.
 VSR reduces maintenance intervals caused by Flash failures
10 Chips

16
Planes

30


FAIL
FAIL

© 2012 IBM Corporation

Agenda
Why “Flash” Matters
IBM Texas Memory Systems (TMS)
RamSan Overview
Why TMS?

31

© 2012 IBM Corporation

Why TMS?

32

© 2012 IBM Corporation

Improving Existing Infrastructure
• COCC, financial technology
provider
• Custom Oracle ATM processing
application
• Mirrored TMS hybrid Flash array
• CIO Chad Burney won InfoWorld
CTO 25 award for performance
and cost improvements

33

For Internal Customer Use Only - Texas Memory Systems Confidential

© 2012 IBM Corporation

RamSan Benefit
I/O Serviced by Disk
1. Issue I/O request
2. Wait for I/O to be serviced
3. Process I/O

(~ 100 μs)
(~ 5,000 μs)
(~ 100 μs)

• Time to process 1 I/O request = 200 μs + 5,000 μs =
5,200 μs
• CPU Utilization = Wait time / Processing time = 200 /
5,200 = ~4%
~100µs
~100µs
Processing
CPU State

Waiting

~5000 µs
Time

1 I/O Request
34

Texas Memory Systems, Inc. - The World's Fastest Storage®

© 2012 IBM Corporation

RamSan Benefit
I/O Serviced by Ramsan
1. Issue I/O request
2. Wait for I/O to be serviced
3. Process I/O

(~ 100 μs)
(~ 200 μs)
(~ 100 μs)

• Time to process 1 I/O request = 200 μs + 200 μs = 400
μs
• CPU Utilization = Wait time / Processing time = 200 /
400 = ~50%~100µs
~100µs
12X Application
Processing

CPU State

Waiting

~200 µs

benefit by only
changing
storage latency!

Time

1 I/O Request
35

Texas Memory Systems, Inc. - The World's Fastest Storage®

© 2012 IBM Corporation

Performance Scenario: Oracle RAC, 4 Nodes
RamSan

Enterprise Array, No Flash
22 million
million queries
queries
12.25
12.25 minutes
minutes to
to complete
complete

22 million
million queries
queries
1.3
1.3 minutes
minutes to
to complete
complete

16K
16K Total
Total IOPS
IOPS
4K
4K per
per RAC
RAC Node
Node

160K
160K Total
Total IOPS
IOPS
40K
40K per
per RAC
RAC Node
Node

[oracle]$
[oracle]$ time
time ./spawn_50.sh
./spawn_50.sh

[oracle]$
[oracle]$ time
time ./spawn_50.sh
./spawn_50.sh

real
real
user
user
sys
sys

real
real
user
user
sys
sys

12m15.434s
12m15.434s
0m5.464s
0m5.464s
0m4.031s
0m4.031s

1m19.838s
1m19.838s
0m4.439s
0m4.439s
0m3.215s
0m3.215s

A factor of over 9x improvement!
37

© 2012 IBM Corporation

Comparison- AWR

• Disk (13 ms per read):

9-10X
Improvement!

• RamSan (<1 ms per read):9-10X More

processing!

38

1/3 The
time!

© 2012 IBM Corporation

39

© 2012 IBM Corporation

Disclaimers
This information is provided on an "AS IS" basis without warranty of any kind, express or implied, including, but not limited to,
the implied warranties of merchantability and fitness for a particular purpose. Some jurisdictions do not allow disclaimers of
express or implied warranties in certain transactions; therefore, this statement may not apply to you.
This information is provided for information purposes only as a high level overview of what we have found from various
sources. There are no warranties, express or implied, regarding non-IBM products
Any information on possible future products is intended as a high level overview only. PRODUCT SPECIFICATIONS,
ANNOUNCE DATES, AND OTHER INFORMATION CONTAINED HEREIN ARE SUBJECT TO CHANGE AND WITHDRAWAL
WITHOUT NOTICE.
Important notes:
IBM reserves the right to change product specifications and offerings at any time without notice. This publication could
include technical inaccuracies or typographical errors. References herein to IBM products and services do not imply that IBM
intends to make them available in all countries.
IBM makes no warranties, express or implied, regarding non-IBM products and services, including but not limited to Year
2000 readiness and any implied warranties of merchantability and fitness for a particular purpose. IBM makes no
representations or warranties with respect to non-IBM products. Warranty, service and support for non-IBM products is
provided directly to you by the third party, not IBM.
All part numbers referenced in this publication are product part numbers and not service part numbers. Other part numbers
in addition to those listed in this document may be required to support a specific device or function.
MHz / GHz only measures microprocessor internal clock speed; many factors may affect application performance. When
referring to storage capacity, GB stands for one billion bytes; accessible capacity may be less. Maximum internal hard disk
drive capacities assume the replacement of any standard hard disk drives and the population of all hard disk drive bays with
the largest currently supported drives available from IBM.
IBM Information and Trademarks
The following terms are trademarks or registered trademarks of the IBM Corporation in the United States or other countries or
both: the e-business logo, IBM, xSeries, pSeries, zSeries, iSeries.
Intel, Pentium 4 and Xeon are trademarks or registered trademarks of Intel Corporation. Microsoft Windows is a trademark or
registered trademark of Microsoft Corporation. Linux is a registered trademark of Linus Torvalds. Other company, product,
and service names may be trademarks or service marks of others.

40

IBM and IBM Business Partner Internal Use Only
NOT to be distributed to customers or other third parties

© 2012 IBM Corporation