IBM Virtualized Storage V2

IBM Storage Certification
IBM Virtualized Storage V2 (C1000-021)

Module 3
IBM FlashSystem Storage
July 2018
© 2018 International Business Machines Last Update: July 2018

Introduction
About This Module
IBM has the largest flash-based storage portfolio within the storage industry. There is no doubt that everyone
clearly understands the performance benefits that flash brings to workloads, but there are additional benefits as
well. Flash storage helps lower the overall total cost of ownership of many business systems by allowing
customers to improve the utilization of their existing infrastructure thus reducing hardware, software, licensing,
power, cooling, administrative and other associated costs.
That is part of IBM’s IT Modernization story. It helps customer’s save money by using flash-based storage and
invest the savings into other areas of IT to help them prepare for next generation workloads that they will need in
order to competitive.
IBM FlashSystem is the cornerstone in IBM’s all-flash storage portfolio representing a family of products that
consistently provides the highest IOPs and the lowest latency. IBM FlashSystem is the most important product
set within IBM’s overall storage portfolio and as such there are FlashSystem specific questions on most of the
IBM Storage certification exams. This module covers the fundamentals of IBM FlashSystem products and their
underlying core technologies with emphasis on FlashSystem V9000.
This module will also cover the new FlashSystem 9100 which was recently announced by IBM. Even though the
FlashSystem 9100 is not covered on the certification exam itself, it was decided to included it within the
education because of it’s importance.
This module is one in a series of self-learning modules designed and developed to specifically help you prepare
for the IBM Virtualized Storage V2 storage certification exam.

Introduction
Meet the Team
IBM Storage Systems Certification Education Development Team
150+ Years
Professional IT Experience
Stefano Todini Andrew Greenfield Eladio Faigal
Earl Springer
espringer@us.ibm.com
Contact me with any:

Questions
Corrections
Darren Stallard Joshua Blumert Earl Springer
Feedback

Introduction
Core Topics
 Introduction to IBM Flash Storage

 Introduction to IBM FlashSystem
 IBM FlashCore Technologies
 Latency – What it Means
 IBM FlashSystem 900
 IBM FlashSystem V9000
 IBM FlashSystem 9100
 Resources

Introduction
IBM Storage Portfolio
IBM Storage Systems IBM Storage Software
Tier 0 Acceleration
 IBM Spectrum Accelerate
FlashSystem 900  IBM Spectrum Archive
 IBM Spectrum Control
Business Critical All-Flash High Performance Software Defined
 IBM Spectrum Copy Data Management
 IBM Spectrum Protect
 IBM Spectrum Protect Plus
 IBM Spectrum Scale
FlashSystem FlashSystem FlashSystem SAN Volume

 IBM Spectrum Virtualize
DS8880 Family 9100
A9000 | A9000R V9000 Controller (SVC)
 IBM Cloud Object Storage
Cost-Effective Hybrid Cost-Effective All-Flash  Security Key Lifecycle Manager
 Copy Services Manager
Storwize Storwize Storwize Storwize Storwize Storwize
V5010 V5020 V5030 V7000F V5030 V7000F Integrated Infrastructure Solutions
Tape and Virtual Tape Systems
Autoloaders / Tape Libraries Enterprise Tape Drives VersaStack Elastic Storage
Server (ESS)
TS1140 TS1150 TS1155

DSI420 LTO Tape Drives
TS4500 TS4300 TS2900 TS1070 TS2270 TS2360

TS7760 DSI425

IBM FlashSystem
Introduction
Storwize FlashSystem FlashSystem FlashSystem FlashSystem Elastic Storage DS8884F/86F/88

V5030F / V7000F V9000 9100 A9000 A9000R Server
Entry / Virtualizing the Multi-Cloud

Cloud service
Mid-Range Data Center Enabled Large High End Server
providers Big Data
deployments
Simplified management • Consolidates file and
• Full time data • Full time data • z/OS
Flexible consumption model object workloads
reduction reduction • Open Systems
Virtualized, enterprise-class, flash-optimized, modular storage • Faster data analysis
• Workloads: Cloud, • Workloads: Mixed • Large VMware
Enterprise class heterogeneous data services and selectable data reduction • Global sharing
VDI, VMware and cloud
FlashSystem 900 • Extreme performance

SVC Application acceleration • Targeting database
acceleration & Spectrum
• Enhanced data storage functions, economics Storage booster
and flexibility with sophisticated
virtualization IBM FlashCore™ Technology Optimized

IBM FlashSystem
Introduction

V5030F / V7000F V9000 9100 A9000 A9000R Server

Cloud service
providers Big Data
deployments


IBM FlashSystem
Introduction

V5030F / V7000F V9000 9100 A9000 A9000R Server

Cloud service
providers Big Data
deployments


IBM FlashSystem
Introduction
IBM FlashSystem 900 IBM FlashSystem V9000 IBM FlashSystem 9100

Tier 0 Storage Tier 1 Storage Tier 1 Storage
Designed For: Designed For: Designed For:
For application acceleration Mixed workload environments Mixed workload environments
Highlights: Highlights: Highlights:

All hardware-based storage Feature rich software stack - Feature rich software stack -
Hardware-level compression “Spectrum Virtualize” “Spectrum Virtualize”
Add to existing environments High scalability High scalability
Limited scalability Advanced efficiency features Advanced efficiency features
Typically dedicated to single Lots of “bells and whistles” Lots of “bells and whistles”
application Low latency Low latency
No “bells and whistles” – storage
services provided by application Ideal Workloads: Ideal Workloads:
Lowest latency possible ERP ERP
Big Data Big Data
Ideal Workloads: Cloud Cloud
OLTP / Database Virtualization Virtualization
High-Speed Analytics Transaction-based Transaction-based

IBM Flash Storage
Introduction
Storwize
V5030F/V7000F FlashSystem 900 FlashSystem V9000 FlashSystem 9100
Industry standard SAS SSDs IBM proprietary FlashCore IBM proprietary FlashCore IBM proprietary FlashCore
Industry-standard NVMe
Positioning Positioning Positioning enabled SSDs
“Good enough” performance Fastest performance possible Fast performance
space True application acceleration Low latency Positioning
Lowest latency possible Fast performance
Low latency
Spectrum Virtualize software Spectrum Virtualize software Spectrum Virtualize software
stack: stack: stack:
Manage Storage Growth  No software Manage Storage Growth Manage Storage Growth
Drive Efficiencies  No “bells and whistles” Drive Efficiencies Drive Efficiencies
Performance Enhancement Integrated: Performance Enhancement Performance Enhancement
Data Protection  hardware-level compression Data Protection Data Protection
Simplify Management  hardware-level encryption Simplify Management Simplify Management
High Scalability High Scalability High Scalability
Typically dedicated to single
Mixed Workload Environments applications Mixed Workload Environments  Mixed Workload
Virtualization  Database Workload Virtualization Environments
Databases  OLTP Databases  Multi-Cloud Environments
Analytics  Real-time Analytics Analytics  Virtualization
Infrastructure workloads Infrastructure workloads  Databases

IBM FlashSystem
IBM FlashSystem 900
IBM FlashSystem 900 is designed to address application

acceleration requirements in the most challenging and App Accelerator
mission-critical environments.
Workloads:
Oracle, DB2, MS-SQL
Highlights:
Server, MySQL,
IBM FlashCore technology, which is designed to deliver consistent high-performance Sybase, NoSQL,
Integrated hardware-level compression
(Storage services
IBM-Enhanced Flash for higher storage density and improved endurance than other flash provided by application)
NAND technologies
Improved availability with Variable Stripe RAID, redundant and hot-swappable components,
and concurrent code load
Encryption key management - local or Security key Lifecycle Manager (SKLM) IBM Offerings:
ENERGY STAR-certified efficiency FlashSystem 900
Speeds and Feeds

Usable Capacity from 14.4 TB to 180 TB
1.1 Million IOPs of Performance
<100 Microseconds of Latency

IBM FlashSystem
FlashCore
• Engineered for flash
• Hardware-based RAID
• Non-blocking Crossbar Switch
• Hardware-only data path
• High-availability Architecture
• Concurrent code load and maintenance
IBM FlashCore Technology

The DNA of the FlashSystem Family
• IBM Engineered
Hardware Accelerated I/O • Massively parallel design
• FPGAs in the data path
IBM MicroLatency Module • Distributed RAM
• High-speed interface
Advanced Flash Management • Line speed data-at-rest encryption
• Inline hardware compression
Industry Standard IBM Enhanced Micro

Chip Technology Technology
• IBM Variable Stripe RAID (VSR)

• IBM Engineered ECC
• IBM Optimized Overprovisioning
• Wear Leveling
• Write Buffer & Hardware Offload
• Garbage Collection

IBM FlashSystem
MicroLatency Modules
Maximum of 12 MicroLatency Modules

Max.10 are used for Capacity
1 is used for Parity
1 is used for Hot Spare

IBM FlashSystem
3D TLC Flash NAND
First array in the industry with custom 3D TLC flash modules.

Traditional 2D NAND has reached the physical limits of scalability
Shrinking flash cells and more bits per cell cause lower endurance, heavy error
correction, and degraded latency
3D NAND flash enables greater scalability.

Increases density without compromising latency or endurance
Stacks NAND cells vertically instead of shrinking size of each cell
Allows increased lithography size
Next generation FlashCore technology improves on native flash chip endurance

by up to 11x.
Combination of advanced flash management and inline hardware compression

IBM FlashSystem
Hardware Compression
First array in the industry with inline hardware compression

Modified dynamic GZIP algorithm implemented in FPGA hardware
IBM technology originated with Z and adopted to flash controller
Compression/decompression performed at line speed
Data protection (ECC) implemented on top of compressed data
End-to-end data integrity checking
No performance penalty

IBM FlashSystem
FlashCore: MicroLatency Module

IBM FlashSystem
IBM FlashSystem purpose-built MicroLatency modules are fast and efficient, designed using
hardware-only data paths.

IBM FlashSystem
Flash Chips (3D TLC Flash NAND)
Connectors for Expansion Board
FPGA FPGA
Primary Board
DRAM Write Buffers Field Programmable Gate Arrays (FPGA)

Multiple FPGAs on each Flash Module
Responsible for all housekeeping
Control Processor within FPGA

Garbage collection
Erasing (Flashing)
Error Handling
System Health
Wear Leveling
“Housekeeping” Tasks
Statistics
etc.

IBM FlashSystem
FlashCore: Data Protection
Error Correcting Codes (ECC)

Provide bit-level reconstruction of data from flash chips.
Checksums
Checksums and data integrity fields designed to protect all internal data transfers within the system.
Wear-Leveling Algorithms
Balance the number of writes among flash chips throughout the system.
Overprovisioning
To enhance write endurance and decrease write amplification. Space pool of flash cells are allocated
automatically as worn cell are decommissioned.
Sweeper Algorithms
Helps ensure that all data within the system is read periodically to avoid data fade issues.
Variable Stripe RAID (VSR)

A patented IBM technology that provides an intra-module RAID stripe on each flash module.
Two-dimensional RAID (2D) Flash

System-wide RAID 5 along with VSR helps reduce downtime and maintains performance and allows the
provisioning of an entire flash module as a spare to be used in another flash module failure.

IBM FlashSystem
FlashCore: Data Protection | Variable Stripe RAID (VSR)
How VSR works from a high-level
Chip Chip Chip Chip
Chip Chip Chip Chip Chip Chip
Chip Chip Chip Chip
A RAID set is defined using multiple flash chips.

IBM FlashSystem
Data is striped across the flash chips within the RAID set.

IBM FlashSystem
A flash chip fails.

IBM FlashSystem
The VSR technology will rebuild the failed chip’s data and stripe it across spare capacity
(from overprovisioning pool) of the remaining chips within the RAID set.
With a 5.7TB MicroLatency Module a quarter of the flash chips (16 chips) can fail without
affecting the production environment
Once the 17th chip fails the module is taken offline and the data is rebuilt on the hot spare
module (2D RAID)
At this point, the system is still online and rebuilding the parity protection
It would take another 17+ chip failures on a different module to see a dual module failure

IBM FlashSystem
FlashCore: Data Protection | Two-Dimensional (2D) RAID

IBM FlashSystem
10 Modules in RAID 5

IBM FlashSystem
Hot Spare
Parity

IBM FlashSystem
Hot Spare
Failed
Parity

IBM FlashSystem
Data Rebuilt
Failed
Parity

IBM FlashSystem
 MicroLatency Modules are configured in a RAID 5

 There is Designated Hot Spare Module
 When a module fails the designated Hot Spare module will take over and data will be rebuilt.
 That is called the second dimension of RAID protection

IBM FlashSystem
Compare and Contrast
Model AE2
Reference Only: Model AE2 has been Withdrawn from Marketing.
MicroLatency Module Capacities – Model AE2
 All modules covered under wear protection while under warranty

 Module sizes can’t be intermixed
 AE3 MicroLatency Modules can’t be used within AE2 models
 They must all be the same size.
 Expanding capacity is data destructive
Model AE3
MicroLatency Module Capacities – Model AE3
3.6TB 8.5TB 18TB
Quantity 6 8 10 12 8 10 12 8 10 12
Usable 14.44 21.6 28.8 36.1 51.3 68.4 85.5 108 144 180
Effective* 28 43 57 72 102 136 171 N/A N/A N/A
With DRP** 72 108 144 180 256 342 427 540 720 900

IBM FlashSystem
FlashSystem 900: Key Components
 Hot-swappable flash modules through the front panel

 Redundant hot-swappable components throughout
 Concurrent Code Updates - enabling client applications to remain online during firmware upgrades
to all components, including the flash modules
Power Supplies
Host
Connections
Batteries Flash Modules
Cooling Fans Controllers

IBM FlashSystem
FlashSystem 900: I/O Connectivity
IBM FlashSystem 900 (Model AE3) supports the following interface protocols and number of connections:
Protocol Ports Speed

Fibre Channel 16 8 Gbps (Downgrade to 4 Gbps)
Fibre Channel 8 16 Gbps (Downgrade to 8 Gbps and 4 Gbps)
QDR InfiniBand 8 40 Gbs
Compare and Contrast

Older AE2 model also
supports iSCSI and FCoE.
Model AE3
Notes:
All interface connections must be of the same type – they can’t be intermixed

IBM FlashSystem
FlashSystem V9000
Storage Enclosure + Control Enclosures

=
FlashSystem 900 SAN Volume Controller FlashSystem V9000
 All-Hardware Flash  15 year legacy of SDS  All-flash Software Define

 High Ops  Spectrum Virtualize Storage
 Low Latency  Efficiency Feature  High Performing
 Thin Provisioning  Up to 3 Million IOPs
 Automated Tiering  <200 microsecond
 Compression Latency
 Performance Features  Highly Scalable
 Easy Tier  Manage up to 32PB
 Clustering  Externally virtualize other
 Compression Offload vendors storage products
 Data Protection Features
 FlashCopy
 Remote Mirror
 HyperScale
 Manageability Features

IBM FlashSystem
IBM FlashSystem V9000
IBM FlashSystem V9000 offers the advantages of

Mixed Workload
Software-Defined Storage at the speed of flash
memory.
Database, Analytics, Virtual

Key Features Include: Environments
 Because of the FlashSystem 900 component, V9000 inherits all of the FlashCore
Oracle, DB2, SQL Server,
technologies such as Variable Stripe RAID / 2D RAID MySQL, NoSQL, SAP,
 Because of the Spectrum Virtualize software stack installed on the control Watson, Hadoop,
Spark, Tealeaf
enclosures, it inherits most of the capabilities of the IBM SAN Volume Controller
such as:
External storage virtualization, clustering, automated tiering (Easy Tier), data IBM Offerings:
SAN Volume Controller
reduction (Real-time Compression), data protection features (remote copy, FlashSystem V9000
FlashCopy, HyperSwap, data-at-rest encryption) Storwize V7000
Storwize V5000 Family
 Scale up to / manage up 32 PB of capacity with a single FlashSystem V9000
system
Speeds and Feeds
Usable Capacity from 14.4 TB to 900 TB (MicroLatency Module Capacity)
Scale / manage up to 32PB of capacity
3.0 Million IOPs of Performance (Clustered)
<200 Microseconds of Latency
IBM FlashSystem
External Storage Virtualization
Servers (Hosts)
VMware HP-UX
Single
Windows AIX IBM i Linux Solaris OS X
Host Host Host Host Host Host Host Host Management
FC, FCoE, iSCSI, SAS*
Storage Hypervisor Clustering (FC, FCoE, iSCI***)
Snapshots
V9000 V9000 V9000 V9000 Transparent

Cloud Tiering
FC, FCoE iSCSI Makes Existing Storage Better
Extend capabilities to volumes being managed:
HP, Dell, EMC, Sun, IBM Storwize, Efficiency features
Dell EqualLogic, EMC VNx IBM and non-IBM Arrays Performance enhancement features
Hitachi, Fujitsu, IBM,
etc. NetApp FAS Data Protection features
Over 400 flash, hybrid and disk storage systems supported by Spectrum Virtualize
Benefits:
Protects a customer’s existing storage investment(s)
Removes complexity of managing storage
Removes silos of storage
Customers can do more with less *V5000 Family Only
Makes existing storage infrastructure better **Migration Only
*** Software Only Version

IBM FlashSystem
IBM FlashSystem V9000 | Building Blocks
+ =
Storage Enclosure (AE3) Control Enclosures (AC3) Building Block
The IBM FlashSystem V9000 consists of two control enclosures (AC3), one storage enclosure (Model AE3) and
software / hardware features, to make up a building block.

IBM FlashSystem
 A building block can be either fixed or scalable

 Scalable building blocks can be combined to create larger clustered systems
Network Switches
Non-Scalable Scalable
Building Block Building Blocks Network Switches
Network Switches
Network Switches
Building Block Minimum Maximum

Scalable Building Block Configurations
IBM FlashSystem
Additional FlashSysem Storage Enclosures

Up to a maximum of four additional FlashSystem Storage Enclosures can be added to a V9000 system.
Additional FlashSystem
Storage Enclosures
Building Block

IBM FlashSystem
Regardless of how many building blocks are used, only a maximum of

four additional FlashSystem Storage Enclosures can be added to a
single V9000 system.
Minimum Maximum
Scalable Building Block Configurations
IBM FlashSystem
Each scalable building block can also have a maximum of 20 X 2U expansion enclosures.
Both 2.5” and 3.5” form factor expansion enclosures supported and can be intermixed
Min. Building Block

IBM FlashSystem
 Another expansion enclosure option is the newer 92

drive High-Density expansion enclosures
 Both LFF and SFF can be intermixed within the High- 5U
Density expansion enclosures
 A maximum of eight is supported on each scalable
building block
Min. Building Block

IBM FlashSystem Control Enclosure 1 Chain Expansion Enclosure Intermix Rules
IBM FlashSystem V9000 10 2U
9 2U
8 2U
7 2U 2U 2U
FlashSystem 6 2U 2U 2U
Storage 5 2U 2U 2U 2U
Enclosures
4 2U 2U 2U 2U HD 5U
3 2U 2U 2U HD 5U HD 5U
2 2U 2U HD 5U HD 5U HD 5U
1 2U HD 5U HD 5U HD 5U HD 5U
Control Enclosure 2 Chain

1 2U HD 5U HD 5U HD 5U HD 5U
A scalable V9000 Building Block
can have the following expansion 3 2U 2U 2U HD 5U HD 5U
enclosures: 4 2U 2U 2U 2U HD 5U
Up to 20 x 2U 2.5” / 3.5”
5 2U 2U 2U 2U
expansion enclosures
Or… 6 2U 2U 2U
Up to 8 x 5U HD expansion 7 2U 2U 2U
enclosures
Or… 8 2U 2U
If intermixing 2U and 5U 9 2U
enclosures see rules at right-side 10 2U
IBM FlashSystem
IBM FlashSystem V9000 | Scalability
+ + + +
+ + +
+
+ E x p a+ +s u r e s
nsIon Enclo +
Externally Virtualized Storage
32 PB
Max. Capacity Managed

IBM FlashSystem
IBM FlashSystem 9100

IBM FlashSystem
IBM FlashSystem 9100 : Full End-to-End NVMe Support

FC-NVMe
Drives Controllers I/O Adapters NVMe-oF
Switching
Full End-to-End NVME Support
“Future proofed” full end-to-end NVMe flash storage system.

IBM FlashSystem
IBM FlashSystem 9100 : Drive Types
Product Overview : Drive Types
Control Enclosure Supported Expansion Enclosure Supported
FlashCore Modules (NVMe Enabled) SSDs (NVMe-Enabled) SAS-based SSDs (Non-NVMe)
 IBM proprietary technology  Industry Standard SSDs  Industry Standard SSDs

 Dual port NVMe connectivity  Dual port NVMe  Dual port SAS connectivity
 Hardware-Level compression ((Modified connectivity
Dynamic GZIP algorithm)
 Hardware-Level encryption
 Uses 3D TLC (64 Layers)
 FIPS 140 Certification (U.S. government
computer security standard)

IBM FlashSystem
IBM FlashSystem 9100 : FlashCore Modules
IBM FlashCore technology delivers key differentiators

• Built-in, performance neutral hardware compression and encryption
• Using next gen 64 layer 3DTLC in just 9 months
• Outstanding data reliability
• Cognitive Algorithms for Wear Levelling, Health binning, Heat segregation
and media management
• Intelligent media management that intelligently keeps settings ideal to
prevent inconsistent performance.
• Endurance without latency penalty
• FIPS 140 certification 4.8TB, 9.6TB, 19.2TB capacity
options with up to 3:1 compression

IBM FlashSystem
IBM FlashSystem 9100 : Variable Stripe RAID (VSR)
• Maximum level of flash Advantages:

module data protection •Protects data from a chip failure
• Maximum wear life •Dynamically re-stripes data at a sub-chip level
• Fast writes •Preserves life, protection and performance
• Scalable
IBM VSR™ protected flash modules:
• Fast at reads
IBM builds our FlashCore modules using far
• Non-volatile more advanced technology than standard
• Very low power NVMe SSDs
P
3
2
1

IBM FlashSystem
IBM FlashSystem 9100 : 2D RAID
Employs a 2nd Dimension of RAID Protection

Advantages:
•Maximum level of system
•VSR protects from flash chip or
protection sub-chip issues
• Maximum level of FlashCore module •System-level DRAID protects
data protection against abrupt FlashCore module
• Maximum wear life failure and controller failure
• Fast writes • DRAID 6
• Scalable
• Fast at reads
• Non-volatile
• Very low power
2D RAID
across
modules
VSR within modules

IBM FlashSystem
IBM FlashSystem 9100 : Drive Capacities
Product Overview : Drive Capacities

Expansion Enclosure
Control Enclosure Supported
Supported
FlashCore Modules (NVMe Enabled) SSDs (NVMe-Enabled) SAS-based SSDs (Non-NVMe)
Capacities: Capacities: Capacities:

4.8TB 1.92TB 1.92TB
9.6TB 3.84TB 3.84TB
19.2TB 7.68TB 7.68TB
15.36TB 15.36TB

IBM FlashSystem
IBM FlashSystem 9100 : Control Enclosure Capacities
Capacities FlashCoreTM
TM Modules
Other
Drive Size 4.8TB 9.6TB 19.2TB 1.92 3.84 7.68 15.36
Array Usable 101TB 202TB 403TB 40TB 81TB 161TB 323TB
Array Effective* 202TB 403TB 806TB 81TB 161TB 323TB 645TB
Array Maximum** 504TB 1008TB 2016TB 202TB 403TB 806TB 1613TB
This shows the USABLE TB (ie after DRAID 6 and a spare drive) and average EFFECTIVE TB (ie using 2:1
compression) capacities in a single 24 drive enclosure. Do not size a system to exceed the MAXIMUM TB capacity
* Effective capacity assumes a 2:1 reduction in data, using inline hardware compression on the 3.6 and 8.5TB modules and DRP on the 18TB modules.
** Maximum DRP assumes a 5:1 reduction in data using Data Reduction Pools within the IBM Spectrum Virtualize software

IBM FlashSystem
IBM FlashSystem 9100 ; Control Enclosure Capacities
Today Five Years Ago

2 PB Over eight racks of Solid State Drives were required for 2 PB of storage capacity.
FlashSystem
9100

IBM FlashSystem
IBM FlashSystem 9100 : I/O Support
FC and iSCSI (with iSER support) connectivity with

intermix flexibility
Number of Cards Port Protocol Possible Slots FlashSystem 9100 systems include:
s Eight 10 Gb Ethernet ports standard for iSCSI
connectivity,
0-3 4 16Gb Fibre Channel 1, 2, 3
Two 1 Gb Ethernet ports for system management
0-3 2 25Gb Ethernet 1, 2, 3 (Technician port)
(iWarp) Can be configured with three I/O adapters to provide:
0-3 2 25Gb Ethernet 1, 2, 3 Up to twenty-four 16 Gb FC ports
(ROCE) Up to twelve 25 Gb Ethernet (iSCSI – iSER capable)
ports.
0-1 21 active12Gb SAS Expansion
1. Card is 4 port with only 2 ports 1, 2, 3
Intermix of 16Gb Fibre Channel and 25Gb Ethernet ports
2.
1.
Interface Card Slot (3) Tech Port 10GbE Ports (4)

IBM FlashSystem
IBM FlashSystem 9100 : Expansion Enclosures
FlashSystem 9100
Control Enclosure
+ 2U Model AFF
24 x SAS SSDs
FlashSystem 9100
Expansion Enclosures
12Gb SAS Connectivity
Expansion enclosures
daisy chained via 12Gb
SAS connectivity (quad
channels)
Single cable has

4x12Gb=48Gb
5U throughput
Dual SAS Connection =

Model A9F 96Gb of throughput
High-Density Expansion
92 x SAS SSDs 12Gb SAS
Maximums:
20 x 2U Expansion Enclosures per Control Enclosure (504 drive)
8 x 5U Expansion Enclosures per Control Enclosure (760 drives)

IBM FlashSystem
IBM FlashSystem 9100 : Expansion Enclosures
Node Canister 2 Chain

10 2U
9 2U
AFF/A9F Expansion 8 2U
Enclosure Intermix Rules 7 2U 2U 2U
6 2U 2U 2U
5 2U 2U 2U 2U
4 2U 2U 2U 2U HD 5U
FlashSystem 9100 2 2U 2U HD 5U HD 5U HD 5U
Node Canister 2
1 Canister 1 Chain
Node 2U HD 5U HD 5U HD 5U HD 5U
Node Canister 1 1 2U HD 5U HD 5U HD 5U HD 5U
4 2U 2U 2U 2U HD 5U
5 2U 2U 2U 2U
6 2U 2U 2U
7 2U 2U 2U
8 2U 2U
9 2U
10 2U

IBM FlashSystem
IBM FlashSystem 9100 : Clustering
1. FlashSystem 9100
Control Enclosure + 2. FlashSystem 9100
Control Enclosure
+ + + +
FlashSystem 9100 FlashSystem 9100 FlashSystem 9100 FlashSystem 9100
Expansion Enclosures Expansion Enclosures Expansion Enclosures Expansion Enclosures
Maximums:
4 x Control Enclosures
20 x 2U Expansion Enclosures per Control Enclosure or
8 x 5U Expansion Enclosures per Control Enclosure
3040 drives
Up to Latency will be Maximum

10 Million 25-50% 32 PB
IOPs. better than V9000. Manageable Capacity

IBM FlashSystem
IBM FlashSystem 9100 : Clustering
FlashSystem 9100
Control Enclosure + Storwzie V7000
Control Enclosure
+ +
Storwize V7000 Clustering Support
Clustering support with Storwize V7000
Minimum code level is Spectrum Virtualize V8.2 on both
V7000 must have Full Feature licensing
Once clustered the system will present itself as a 9100

IBM FlashSystem
IBM FlashSystem 9100 Included Software
IBM Multi-Cloud Starter Software for FlashSystem 9100

Upsell : Themed Offerings
Sales Motion BASE UPSELL UPSELL UPSELL
Software Offerings Orderable with Multi Cloud for Multi Cloud Private Cloud
FlashSystem 9100 Multi-Cloud Secondary Data Business Data
Enabled Base Reuse with Data Continuity Management
Software for Protection Agility
FlashSystem 9100 (per TB, >5TB) (per TB, >5TB) (per TB, >5TB)
Products
IBM Storage Insights 
Spectrum Connect 
Spectrum Virtualize 
Spectrum Protect Plus  (5TB Starter Kit) 
Spectrum CDM  (5TB Starter Kit)   
Spectrum Virtualize for Public Cloud  (5TB Starter Kit) 
Spectrum Access (Blueprint) 
Blueprint   
Lab Services  (optional)  (optional)  (optional)

IBM FlashSystem
IBM FlashSystem 9100 : Included Software
 Three Multi-Cloud Solutions Aligning with Multi-Cloud Patterns

 Based on IBM Validated Blueprints: On Premises and in the Public Cloud
IBM FlashSystem 9100 Multi-Cloud Solution for Data Reuse, Protection and Efficiency
This solution is comprised of IBM Spectrum Protect Plus and IBM Spectrum Copy Data Management, and is
designed to secure and reuse your company's most precious asset, protect your data, and drive secondary
data efficiencies within multi-cloud environments.
IBM FlashSystem 9100 Multi-Cloud Solution for Business Continuity and Data Reuse
This solution is comprised of IBM Spectrum Virtualize for Public Cloud and IBM Spectrum Copy Data
Management. Through the use of IBM Spectrum Virtualize for Public Cloud, you can use synchronous or
asynchronous real-time replication to copy primary data from FlashSystem 9100 to IBM Cloud. IBM Spectrum
Copy Data Management can be used to create secondary data
reuse snapshots of data managed by IBM Spectrum Virtualize for Public Cloud in IBM Cloud.
IBM FlashSystem 9100 Solution for Private Cloud Flexibility and Data Protection
This solution is comprised of IBM Spectrum Copy Data Management and is designed to simplify and transform
multi-cloud environments by combining

IBM FlashSystem
FlashSystem V9000 / 9100 Data Protection
IBM FlashSystem V9000 supports all of the data protection features provided by IBM Spectrum Virtualize
including (see SAN Volume Controller module for full details on each):
FlashCopy
Support for all FlashCopy pre-sets (Snapshot, Backup and Clone) and FlashCopy types; Incremental, Cascading,
Consistency Group, Multi-Target, etc.)
Transparent Cloud Tiering

Provides the ability to have FlashCopies reside in the cloud (Amazon S3, OpenStack, IBM Cloud).
Remote Mirror
Both synchronous copy (Metro Mirror) and a synchronous copy (Global Mirror) are supported. Global Mirror with
Change Volumes is supported as well.
Data-at-Rest Encryption
Encrypts storage pools / volumes residing on; MicroLatency modules, drives residing on expansion enclosures,
and any volume managed via external storage virtualization. Key management via USB or IBM Security Key
Lifecycle Manager (SKLM).
HyperSwap
Provides automated failover caused by node failures and or site failures.

IBM FlashSystem
IBM FlashSystem 9100 : Spectrum Virtualize
 FlashSystem 9100 will ship with Spectrum Virtualize v8.2

 Also available for Storwize V7000 (clustering support)
 Full capabilities of Spectrum Virtualize with the exception of no Real-time
Compression for FS9100
Licensing for FlashSystem 9100

 FlashSystem 9100 will be trust based and all-inclusive
 Features are all included as part of the base license
 Internal Storage will be licensed on a per enclosure basis
 Encryption which will use key based licensing for region controls
 Externally Virtualized storage will be SCU licensed (as with the SVC)

IBM FlashSystem
The Difference Latency Makes
CPU Utilization Application

Processing Time CPU Utilization
& App. Efficiency & App. Efficiency
4% 50%
Total Application Total Application
Processing Time Processing Time
5,200µs (5.2ms) 400µs (.4ms)
Time Waiting for I/0

5,000µs (5ms) (Waiting for Array)
200µs (.2ms)
200µs (.2ms) Time Processing Data 200µs (.2ms)
(Server CPU)
Hybrid - Disk/SSD IBM FlashSystem
EMC XtremeIO Cisco Server Cisco Server

IBM FlashSystem

Managing Complexity
Management GUI
New Graphical User Interface

Provides a new Dashboard view of the system
At a glance overview of performance, capacity and system
health
Enhancements for use with mobile devices
Including Event Flag based performance charts
Performance graphs overlaid with events
Improvements to “strongly encourage” enabling of Call
Home and Remote Access
“Open PMR” button
Capacity over time GUI
Will now give clients more insight on how they are using
their capacity over time
Support Compression additions
300 days of performance history
Fresh and modern look and feel.

IBM FlashSystem
IBM FlashSystem V9000 / 9100 | VMware Integration
VMware Integration
IBM FlashSystem V9000 supports integration with VMware, but requires the use of IBM Spectrum Control Base
Edition. Through unique credentials, storage array, and storage pool management options it facilitates the
integration of IBM storage system resources with the supported virtualization and cloud platforms such as
VMWare.
Virtual Volume (VVols)

VMware vSphere Virtual Volumes, sometimes referred to as VVols, allow VMware vCenter to manage storage
system objects like volumes and pools.
VASA (vStorage application programming interfaces for storage awareness)

IBM Storage Provider for VMware VASA improves the ability to monitor and automate storage-related operations
on VMware platforms.
Site Recovery Manager (SRM)

VMware and vSphere 6.0. IBM FlashSystem V9000 supports vCenter Site Recovery Manager (SRM)
vSphere Web Client

With the IBM Storage Enhancements for VMware vSphere Web Client, admins can discover data store
relationships down to the IBM Storage volumes and file shares. Admins can view native IBM storage arrays,
pools and volumes, or file share properties, and set provision volumes and file shares from delegated pools.

IBM FlashSystem
FlashSystem V9000 / 9100 - Peace of Mind Guarantee
IBM data reduction guarantee

Flexible guarantee: up to 5:1 data reduction
Express guarantee: 2:1 data reduction
IBM availability guarantee

IBM guarantees 100% data availability for systems using
HyperSwap and deployed by IBM Lab Services
IBM controller upgrade program

No up-front charges, no contractual commitment to buy
7 year 24x7 Support

Up to 7 years support available with flash media retention offerings
Endurance
Flash memory will be covered for read/write endurance while you are under warranty
or maintenance
Migration
Up to 45 day to migrate data at no extra charge

IBM FlashSystem
IBM FlashSystem V9000 / V9100 | Technical Advisor
IBM Storage Technical Advisor

The IBM Storage Technical Advisor (TA) enhances end-to-end support for complex IT
solutions.
Each IBM FlashSystem V9000 / 9100 includes an IBM TA for the initial hardware
warranty period (3 Year Warranty models only).
The TA service is built around three value propositions:

Proactive approach to ensure high availability for vital IT services
Client Advocate that manages problem resolution through the entire support process
A trusted consultant for both storage hardware and software Technical Advisors benefit
customers by providing a consultant for questions on the IBM FlashSystem V9000.

IBM FlashSystem
IBM Storage Utility Offering
IBM Storage Utility Offering provides businesses the ability to pay for storage capacity based
on actual monthly usage
•Ready capacity when business dictates
•Pay for what’s used, when used
•Flex-up and flex-down monthly costs
•Powerful management capabilities
of IBM Storage Insights for
predictability and forward planning
•Available for IBM Storwize family;
FlashSystem 900, A9000/R, 9100;
Cloud Object Storage and
DS8880 (limited availability)
* Assumes 42% average capacity utilization based on Industry data
Moves CAPEX to OPEX

IBM FlashSystem
The IBM Storage Utility Offering

Improves storage provisioning
Offers a new way to procure storage capacity by aligning costs directly to business needs
Can move CAPEX to OPEX
Process
Identify current and future capacity needs and agree on a “base” configuration
Entire future (typically 3 year) projected capacity is delivered to customer, ready for deployment
Customer pays monthly for base configuration capacity
Simply provision the storage needed as business needs grow or change
Costs are calculated monthly based on your usage - billed quarterly
Benefits:
Capacity is waiting ready to use on site
Procurement cycle is eliminated
Non-disruptive capacity updates to datacenter
Customer only pays for the capacity consumed each month
Move higher upfront costs to predictable quarterly charges

IBM FlashSystem
Storage Utility Offering is available with these products

IBM FlashSystem A9000
IBM FlashSystem A9000R
IBM Storwize® V7000
IBM Storwize V7000F
IBM FlashSystem 900
VersaStack
IBM Storwize V5000
IBM Storwize V5030F
IBM Cloud Object Storage (Limited availability)

IBM FlashSystem
Resources
IBM Flash Storage Website
https://www.ibm.com/storage/flash
IBM FlashSystem YouTube Videos

https://www.youtube.com/playlist?list=PLIbvgyHNmNr0SdfCpNBWafcDHJ53sH0kn
FlashSystem 900
Website
https://www.ibm.com/us-en/marketplace/flash-storage
Product Guide
http://www.redbooks.ibm.com/abstracts/tips1261.html
Knowledge Center
https://www.ibm.com/support/knowledgecenter/STKMQB
Redbook: Implementing IBM FlashSystem 900

http://www.redbooks.ibm.com/abstracts/sg248271.html
FlashSystem V9000
Website
https://www-03.ibm.com/systems/storage/flash/v9000/
Product Guide
http://www.redbooks.ibm.com/abstracts/tips1281.html
Knowledge Center
https://www.ibm.com/support/knowledgecenter/STKMQV
Redbook: Introducing and Implementing the IBM FlashSystem V9000

http://www.redbooks.ibm.com/redbooks/pdfs/sg248273.pdf

Legal Notices
Copyright © 2018 by International Business Machines Corporation. All rights reserved.
No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation.
Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. This document could include
technical inaccuracies or typographical errors. IBM may make improvements and/or changes in the product(s) and/or program(s) described herein at any time
without notice. Any statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives
only. References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services
available in all countries in which IBM operates or does business. Any reference to an IBM Program Product in this document is not intended to state or imply
that only that program product may be used. Any functionally equivalent program, that does not infringe IBM's intellectually property rights, may be used instead.
THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER OR IMPLIED. IBM LY DISCLAIMS
ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NONINFRINGEMENT. IBM shall have no responsibility to update
this information. IBM products are warranted, if at all, according to the terms and conditions of the agreements (e.g., IBM Customer Agreement, Statement of
Limited Warranty, International Program License Agreement, etc.) under which they are provided. Information concerning non-IBM products was obtained from
the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this
publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. IBM makes no representations or
warranties, ed or implied, regarding non-IBM products and services.
The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents or copyrights. Inquiries
regarding patent or copyright licenses should be made, in writing, to:
IBM Director of Licensing

IBM Corporation
North Castle Drive
Armonk, NY 1 0504- 785
U.S.A.

IBM Virtualized Storage V2

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

IBM Virtualized Storage V2

Uploaded by

Copyright:

Available Formats

IBM Storage Certification

IBM Virtualized Storage V2 (C1000-021)

IBM Storage Certification

© 2018 International Business Machines Last Update: July 2018

© 2018 International Business Machines Last Update: July 2018

IBM Storage Systems Certification Education Development Team

Stefano Todini Andrew Greenfield Eladio Faigal

Contact me with any:

© 2018 International Business Machines Last Update: July 2018

 Introduction to IBM Flash Storage

© 2018 International Business Machines Last Update: July 2018

FlashSystem FlashSystem FlashSystem SAN Volume

TS1140 TS1150 TS1155

TS4500 TS4300 TS2900 TS1070 TS2270 TS2360

© 2018 International Business Machines Last Update: July 2018

Storwize FlashSystem FlashSystem FlashSystem FlashSystem Elastic Storage DS8884F/86F/88

Entry / Virtualizing the Multi-Cloud

FlashSystem 900 • Extreme performance

© 2018 International Business Machines Last Update: July 2018

Storwize FlashSystem FlashSystem FlashSystem FlashSystem Elastic Storage DS8884F/86F/88

Entry / Virtualizing the Multi-Cloud

FlashSystem 900 • Extreme performance

© 2018 International Business Machines Last Update: July 2018

Storwize FlashSystem FlashSystem FlashSystem FlashSystem Elastic Storage DS8884F/86F/88

Entry / Virtualizing the Multi-Cloud

FlashSystem 900 • Extreme performance

© 2018 International Business Machines Last Update: July 2018

IBM FlashSystem 900 IBM FlashSystem V9000 IBM FlashSystem 9100

Highlights: Highlights: Highlights:

© 2018 International Business Machines Last Update: July 2018

© 2018 International Business Machines Last Update: July 2018

IBM FlashSystem 900 is designed to address application

Speeds and Feeds

© 2018 International Business Machines Last Update: July 2018

IBM FlashCore Technology

Industry Standard IBM Enhanced Micro

• IBM Variable Stripe RAID (VSR)

© 2018 International Business Machines Last Update: July 2018

Maximum of 12 MicroLatency Modules

© 2018 International Business Machines Last Update: July 2018

First array in the industry with custom 3D TLC flash modules.

3D NAND flash enables greater scalability.

Next generation FlashCore technology improves on native flash chip endurance

© 2018 International Business Machines Last Update: July 2018

First array in the industry with inline hardware compression

© 2018 International Business Machines Last Update: July 2018

© 2018 International Business Machines Last Update: July 2018

© 2018 International Business Machines Last Update: July 2018

DRAM Write Buffers Field Programmable Gate Arrays (FPGA)

Control Processor within FPGA

© 2018 International Business Machines Last Update: July 2018

Error Correcting Codes (ECC)

Variable Stripe RAID (VSR)

Two-dimensional RAID (2D) Flash

© 2018 International Business Machines Last Update: July 2018

How VSR works from a high-level

Chip Chip Chip Chip

Chip Chip Chip Chip Chip Chip

Chip Chip Chip Chip

A RAID set is defined using multiple flash chips.

© 2018 International Business Machines Last Update: July 2018

How VSR works from a high-level

© 2018 International Business Machines Last Update: July 2018

How VSR works from a high-level