You are on page 1of 33

Huawei OceanStor Smart Series Software

Pre-Sales Training

Security Level:
Content

1 Software Features Overview

2 Smart Series Introduction

www.huawei.com ▪ Huawei Confidential ▪ 1


Smart Series Software Overview
SmartVirtualization SmartMigration SmartQoS
Data movement across systems Logical Unit Number (LUN) Intelligent Quality of
migration Service (QoS) control

IBM
HDS
EMC
HW
SmartThin
Thin provisioning

SmartTier
Vertical data movement SmartDedupe &
SmartCompression
Intelligent data deduplication
and compression
SmartPartition
Intelligent cache partitioning APP APP APP

Partition 1

Partition 2 Partition 3

SmartCache SmartQuota
Partition Partition Partition
Intelligent Solid-State Drive 4 5 N File system quota management
(SSD) cache

www.huawei.com ▪ Huawei Confidential ▪ 2


Smart Series Software in Different Products
OceanStor 2600 V3 / OceanStor V5 Series
Smart Series Dorado V3 Series
SAN NAS
SmartThin √ √ √
SmartTier √ √ ×
SmartMigration √ × √
SmartCache √ √ ×
SmartVirtualization √ × √
SmartQoS √ √ √
SmartPartition √ √ ×
SmartDedupe √ √ √
SmartCompression √ √ √
SmartQuota × √ ×

www.huawei.com ▪ Huawei Confidential ▪ 3


Content

1 Software Features Overview

2 Detailed Smart Series Introduction

www.huawei.com ▪ Huawei Confidential ▪ 4


Dorado F V5/V5

SmartQoS Overview
Medium-priority High-priority Low-priority
applications applications applications  Service Quality Control
– SmartQoS helps mission-critical services obtain storage
resources in a timely manner to realize their performance goals.
 SLA-based Management of Storage Resources
– Monitors application performance and achieves performance
goals.
 Policy-based Performance Optimization
– Sets performance goals for mission-critical applications.
Performance

– Sets performance upper limits for low-priority applications,


preventing resource contention.
– Sets QoS policies and implements them at different intervals.

Application

Enables the optimum storage resources to serve the most important applications

www.huawei.com ▪ Huawei Confidential ▪ 5


Dorado F V5/V5

SmartQoS Principle: Priority


 Each LUN has a priority property, which
is configurable.

 I/O priority is scheduled based on:

• Front-end concurrency resources

• Computing resources

• Cache resources

www.huawei.com ▪ Huawei Confidential ▪ 6


Dorado F V5/V5

SmartQoS Principle: I/O Traffic Control

I/O traffic control


 Based on the user-defined performance
Token control goal (either IOPS or bandwidth), the
Host I/O
Scheduling process traditional token bucket mechanism is used
to control traffic.

 I/O control prevents specific services from


Token generating excessively large amounts of
I/O classification bucket
traffic, which undermines other services.
Queue waiting

www.huawei.com ▪ Huawei Confidential ▪ 7


Dorado F V5/V5

Effects of SmartQoS Priority Control and Traffic Control

Critical applications (high)


Start priority control Important applications (medium)
Normal applications (low)
Total performance

Start traffic control


Normal application performance is
too high, and critical applications are
Total performance
affected Limit the performance
of ordinary applications
Normal performance (media)

Critical performance (Oracle


OLTP)

www.huawei.com ▪ Huawei Confidential ▪ 8


Dorado F V5/V5

SmartQoS Competitive Positioning


Pure Storage HP 3PAR
Dorado F V5/V5 EMC VMAX-F EMC XtremIO NetApp AFF HP Nimble HDS F series IBM A9000R
Item Always-On Priority
SmartQoS SmartQoS QoS QoS FlexShare QoS QoS QoS
QoS Optimization

Priority policy √ √ √ X √ √ √ √ √ √

Request
throttling
policies
√ √ √ √ √ √ √ X √ √
(based on
IOPS and
bandwidth)
Lower

performance X √ X X X √ X √ X
limit

Service-Level
Objective X X √ X X √ X X X X
(SLO)

8,192 (VVset)
QoS policy
8,192 16,384 16,384 8,192 TBD 12,000 1,024 (virtual X TBD 1,000
quantity
domain)
QoS nesting X √ √
√ X X X X X X
policy (Cascade QoS) (Nested QoS)

www.huawei.com ▪ Huawei Confidential ▪ 9


Dorado F V5/V5

SmartPartition Overview

SmartPartition Brief
 Manages cache resources based on policies.
Cache partition 1 Cache partition 2 Cache partition 3
 Isolates caches for different services, preventing
Cache
... malicious cache contention.
partition 64
Default cache
 Ensures adequate cache resources for mission-
critical workloads to meet their performance goals.
Physical cache

www.huawei.com ▪ Huawei Confidential ▪ 10


Dorado F V5/V5

SmartQoS & SmartPartition Scenarios


Mixed applications with OLTP and backup Specific performance
varied importance levels co-exist requirements

Ensures performance of Restricts the maximum Allows users to set maximum or


mission-critical services in a performance of some services to minimum performance goals for
multi-service system prevent traffic burst from affecting the application.
the performance of other services

Do you know exactly how to allocate storage resources to different services?

NO YES
SmartQoS SmartPartition

Achieve specific performance goals for applications

www.huawei.com ▪ Huawei Confidential ▪ 11


Dorado F V5/V5

SmartPartition Competitive Positioning


Competitive Advantages:
 All of the OceanStor V5 storage systems support SmartPartition, allowing more clients to experience the cache
partition function using Huawei’s storage systems.

FV5/V5 EMC VMAX HDS VSP


Item
SmartPartition DCP VPM

Cache partition √ √ √

Maximum number of partitions 64 16 32

Partition type Static Dynamic Static

www.huawei.com ▪ Huawei Confidential ▪ 12


Dorado F V5/V5

SmartVirtualization Overview

SmartVirtualization Brief
 Simplified management of heterogeneous arrays
and reuse of legacy storage systems thanks to
the heterogeneous takeover function

 Non-disruptive migration among LUNs of


heterogeneous storage arrays

 Remote replication implements disaster recovery


for LUNs of heterogeneous storage arrays*

 Snapshot function implements rapid backup for


EMC HUAWEI LUNs of heterogeneous storage arrays*
IBM HP
HDS *Remote replication and snapshot of heterogeneous
storage arrays are only for V5/F V5

www.huawei.com ▪ Huawei Confidential ▪ 13


Dorado F V5/V5

SmartVirtualization Scenarios

Heterogeneous Data Migration Data Protection*


Takeover

Consolidates storage resources Works with SmartMigration to Works with HyperReplication/S,


and simplifies heterogeneous migrate data from LUNs of HyperReplication/A, HyperSnap,
array management legacy heterogeneous storage and HyperMirror to protect data
arrays to new storage arrays on storage arrays

Maximize ROI and simplify storage management

*Data Protection of heterogeneous storage arrays is only for V5/F V5

www.huawei.com ▪ Huawei Confidential ▪ 14


Dorado F V5/V5

SmartVirtualization Principle

External LUN Logical Disk Third-party LUN  Step 1: Users connect the third-party storage to
Huawei storage (direct attach or through SAN) in
single- or multi-path software.
 Step 2: Users configure the third-party storage,
I/O mapping the LUN from the third-party storage
I/O
system to Huawei storage device.
I/O
 Step 3: Huawei storage discovers the third-party
LUN and generates a logical disk.
Multi-pathing
 Step 4: Users create an external LUN on the
logical disk and then map it to the hosts. Now the
During the encapsulation process, the host can access the external LUN.
existing data on the third-party LUN is
preserved.

www.huawei.com ▪ Huawei Confidential ▪ 15


Dorado F V5/V5

SmartVirtualization Interoperability List (300+ Models)

See http://support-open.huawei.com/en/pages/user/compatibility/support-matrix.jsf
to get more information

www.huawei.com ▪ Huawei Confidential ▪ 16


Dorado F V5/V5

SmartVirtualization Competitive Positioning


IBM V7000
HDS VSP NetApp FAS F V5/V5
Application Scenario Feature storage
UVM FlexArray SmartVirtualization
virtualization
Intra-city, remote Synchronous replication √ √ √ √
DR and √ √
DR Asynchronous replication √ √
backup (for
Local HA Volume mirroring x √ √ √
users’ RPO
and RTO Active-active DCs Active-active √ √ √ √
needs) Snapshots √ √ √ √
Data protection
CDP X X X X
LUN copy √ √ √ X
Data migration
Online LUN migration √ √ X √
Concurrent data use Clone √ √ √ X
(development, testing,
Snapshots √ √ √ √
and analysis)
LUN takeover √ √ √ √
Simplified management
Pooling √ √ √ X
Striping √ √ √ X
Tiered storage √ √ √ X
Performance improvement Cache acceleration X √ √ √
QoS TBD √ √ √
Write cache (write back) √ √ √ √
Compression X √ √ X
Improved resource utilization
Thin provisioning √ √ √ X
Compatibility scope 215 401 192 357
*QoS and LUN migration features of Dorado are compatible with SmartVirtualization
www.huawei.com ▪ Huawei Confidential ▪ 17
Dorado F V5/V5

SmartDedupe & SmartCompression Overview


Host data Inline data deduplication and compression Data written
to disks

1. The host writes data to the 2. The data is duplicated. 3. The deduplicated data is
storage system.  Weak hash and fingerprint compressed for storage. Deduplication is performed
 Byte-by-byte comparison  Optimized LZ4 algorithm
before compression to
save more space.

Deduplication granularity: 4 KB/8 KB — Compression granularity: 4 KB/8 KB/16 KB/32 KB


The data block granularity is set when a storage LUN is created and cannot be modified after setting.
Inline deduplication and compression policies:
 Inline deduplication: When receiving user data, the storage system saves it in the cache and then deletes duplicate data globally before writing
it to SSDs. Deduplication is performed in real time, not after data has been written to SSDs. This helps extend the SSD service life.
 Inline compression: Dorado V3 adopts the enhanced LZ4 rapid compression algorithm. The unit for storing compressed data is 1 KB, which
significantly increases the data compression ratio. In addition, compression is performed after deduplication, ensuring that no duplicate data is
compressed and improving compression efficiency.
 LUN-specific configuration: Deduplication and compression can be enabled or disabled for each specific LUN.

Since deduplication and compression have a certain impact on the performance of OceanStor F
V5/V5, Dorado is recommended for projects that require deduplication and compression.
www.huawei.com ▪ Huawei Confidential ▪ 18
Dorado F V5/V5

SmartCompression & SmartDedupe Scenarios and


Restrictions

Saving OPEX Prolong SSD life

Saves capacity, power, maintenance, and OPEX Inline compression and deduplication reduce the data
from end to end written to SSDs, which prolongs SSD service life

Improving all-flash storage efficiency and extending lifespan

Some types of data cannot be reduced


The types include but are not limited to:
 Compressed data and databases, encrypted data
 Pictures, audio, and videos
 PDF and XML data

www.huawei.com ▪ Huawei Confidential ▪ 19


Dorado F V5/V5

SmartCompression & SmartDedupe Features


Inline Deduplication and Compression Enabling or Disabling Settings Based on Applications
 Before data is written to flash media, deduplication and compression  SmartDedupe and SmartCompression can be enabled or disabled
are performed to reduce the amount of data written into SSDs. In this based on business requirements.
way, the number of SSDs is reduced, saving space, power  When a LUN is created, enabling and disabling policies can be set.
consumption, cooling, and maintenance costs, as well as TCO from After the settings, the policies cannot be modified at any time (not
end to end, all while prolonging the service life of SSDs. when the LUN is working).

Granularity Adjustment Based on Applications Global Deduplication


 Different deduplication and compression granularities can be  The global deduplication mechanism is used to delete redundant data
selected for different business types to achieve optimal between multiple LUNs to achieve better data reduction effects.
performance for different application models.
 The deduplication granularity can be adjusted between 4 KB and
8 KB.
 The compression granularity can be adjusted among 4 KB, 8 KB,
16 KB, and 32 KB.

Highly Reliable Deduplication Algorithm Efficient Storage Granularity After Compression


 Deduplication uses weak hash and byte-by-byte comparison to  Storage units of compressed data are aligned with 1 KB, which can
resolve fingerprint hash collision problems and ensure reliability of effectively improve compression efficiency and reduce space for
customers’ data. storing compressed data.

Since deduplication and compression have a certain impact on the performance of OceanStor F V5/V5, Dorado
is recommended in projects that require deduplication and compression.
www.huawei.com ▪ Huawei Confidential ▪ 20
Dorado F V5/V5

SmartDedupe Competitive Positioning


EMC
Dorado F V5/V5 EMC VMAX-F Pure Storage NetApp AFF HPE 3PAR HPE Nimble HDS IBM A9000R
Item XtremIO
SmartDedupe SmartDedupe deduplication deduplication deduplication deduplication deduplication deduplication deduplication
deduplication
Inline
√ √ √ √ √ √ √ √ X √
deduplication

Configurable: If

deduplication is
The system
configured as post-
Post-process automatically starts
X X X X process deduplication, X X √ X
deduplication post-process
the system
deduplication as soon
automatically starts
as it detects pressure.
post-process
deduplication.
Deduplication
4 KB/8 KB 4 KB/8 KB 128 KB 8 KB Variable length 4 KB 16 KB 4\8\16\32 KB 16 KB 8 KB
granularity
Global
√ X √ √ √ √ √ √ X √
deduplication
Deduplication
Weak hash SHA1 SHA2 SHA1 Weak hash Weak hash SHA2 SHA2 TBD Strong hash
algorithm
Byte-by-byte
√ √ √ X √ √ √ X TBD X
comparison
Enabled or
disabled √ √ X X X √ √ X √ X
separately

Since deduplication and compression have a certain impact on the performance of OceanStor F V5/V5, Dorado is
recommended for projects that require deduplication and compression.

www.huawei.com ▪ Huawei Confidential ▪ 21


Dorado F V5/V5

SmartCompression Competitive Positioning


Dorado F V5/V5 EMC VMAX-F EMC XtremIO Pure Storage NetApp AFF HPE 3PAR HPE Nimble HDS IBM A9000R
Item
SmartCompression SmartCompression Compression Compression Compression Compression Compression Compression Compression Compression


Inline
√ √ √ √ √ √ √ √ Intra-disk √
compression
compression
√ √ √
Inline Inline Configurable: If
compression by compression by compression is
default: The default: The configured as
system system post-process
Post-process
X X automatically X automatically compression, X X X X
compression
starts post- starts post- the system
process process automatically
compression compression starts post-
when pressure is when pressure is process
heavy. heavy. compression.
Compression
4\8\16\32 KB 8\16\32\64 KB Multiple of 8 KB 8 KB Variable length 4 KB 16 KB 4\8\16\32 KB TBD TBD
granularity

Compression DEFLATE/
LZ4 LZ4 LZ LZO LZO LZ4 LZ4 TBD zlib
algorithm def9_128_SW
Enabled or
disabled √ √ X X X √ √ TBD √ X
separately

Since deduplication and compression have a certain impact on the performance of OceanStor F V5/V5, Dorado is
recommended for projects that require deduplication and compression.

www.huawei.com ▪ Huawei Confidential ▪ 22


Dorado F V5/V5

SmartTier Overview
SmartTier (automated storage tiering) is a data storage technology that automatically moves data
between high-cost and low-cost storage media. By reducing non-important data in high-cost media
space, SmartTier can also improve system storage performance.
Application

SmartTier Brief:
 Intelligently relocates data among different storage
SSD tiers based on statistics or customers’ policies

 Delivers the optimum storage performance resource


utilization while reducing the difficulties of management

SAS  Business is always online during adjustment

NL-SAS

www.huawei.com ▪ Huawei Confidential ▪ 23


Dorado F V5/V5

SmartTier Scenarios

Multiple Single
Data Lifecycle
Applications Application

A single application with a


Multiple applications running Data lifecycle management
clear distinction between hot
on one storage system
and cold data

Meet performance and capacity requirements and reduce TCO

www.huawei.com ▪ Huawei Confidential ▪ 24


Dorado F V5/V5

SmartTier Working Mechanism (Block)


1. The storage administrator adds different types of
Tiered storage pools disks to storage pools and starts SmartTier.

2. SmartTier identifies I/O activities on each data


I/O monitoring block based on a data relocation unit.

3. The data placement analysis module identifies


Data placement analysis hot data and cold data.

4. The data relocation module relocates data


Data relocation among storage tiers.

www.huawei.com ▪ Huawei Confidential ▪ 25


Dorado F V5/V5

SmartTier Competitive Positioning (Block)


Competitive Advantages:
 Configurable fine-grained data migration granularity, allowing flexible data capacity management
 I/O statistics containing I/O sizes and random/sequential types, optimizing the SSD utilization by recognizing the small
and random I/Os
 Configuration prediction analysis, providing storage tier capacity policy models, and balancing performance and costs

F V5/V5 EMC HDS HP Adaptive IBM


Item
SmartTier FAST VP HDT Optimization Easy Tier
Migration 4 MB (configurable from 512 KB to User data: 128 MB
42 x 128 KB 42 MB 1 GB
granularity 64 MB) Metadata: 32 MB
Backend I/O: 1.R/W,
I/O IOPS, I/O size, and I/O numbers and I/O Weighted average IOPH I/O numbers per
2. random/sequential, 3. I/O
statistics random/sequential R/W ratio for each page gigabyte per minute
latency, 4. I/O rate, 5. number
HDT Heat Map predicts
The prediction analysis module the information collected
Prediction The region I/O Storage Tier Advisor Tool
provides the storage tier capacity Uncertain from Vol and Pool using
tool density reports (STAT) or Disk Magic
policy model HTnM

www.huawei.com ▪ Huawei Confidential ▪ 26


Dorado F V5/V5

SmartTier Working Mechanism (File System)


NAS
Clients

NFS SMB Collects statistics file size/name/type/a-


File monitoring
time/c-time/m-time/uid/gid

Pre-analyzes file capacity distribution


OceanStor according to the file attributes to help
File placement analysis administrators understand space usage
Policy conditions: and determine better tiering policies
• Time-based
(creation, access,
modification) Relocates files on SSD or HDD according
SSDs HDDs • File names File relocation to the policies, automatically or manually
• File extensions
• File owner or group
• Quota tree
• File size
• SSD utilization

www.huawei.com ▪ Huawei Confidential ▪ 27


Dorado F V5/V5

SmartTier Competitive Positioning (File System)


F V5/V5 NetApp NetApp Isilon HDS
Item
SmartTier FlashPool FabricPool CloudPool Data Migrator

Tiering mode File Block Block File File

Automatic Snapshot-only
File type, size, File type, size, creation File access time,
adjustment based migration, no
Tiering policy creation time, and time, and modification creation time, file name,
on access migration, and cold
modification time time path, and user
frequency data migration

Media type SSDs and HDDs SSDs SSDs SSDs and HDDs SSDs and HDDs

Intra-system, inter- Intra-system and inter-


Tiering type Intra-system Intra-system Cloud
device, and cloud device
File system, catalog,
Tiering range File system None None Unknown
and qtree

Metadata tiering No Yes No No Yes

Recall Policy-based Not supported Not supported Supported Commands are required

Note: Cooperating with NTP, NetApp also supports file tiering and uses its E-Tiering Cloud Appliance (ETCA) solution.

www.huawei.com ▪ Huawei Confidential ▪ 28


Dorado F V5/V5

SmartCache Overview
 Principle
 SSDs are used as the secondary cache for RAM cache
LUN/File System  Reading acceleration available to LUNs and file systems
 Supports SSD cache partitioning
 Application scenarios
Dedupe Meta
 Random small-I/O read-intensive applications, such as
Oracle OLTP, SQL server, exchange, and file service
RAM Cache  Competitive advantages
 Dynamic expansion and reduction, SSD resource quota
management, flexible open policy
SmartCache
 Read-only cache, SSDs without RAID protection, so that
capacity can be fully utilized
 Restriction scenarios
HDD SSD
 Write-intensive business
 Large/sequential I/O application

www.huawei.com ▪ Huawei Confidential ▪ 29


Dorado F V5/V5

SmartCache Competitive Positioning


Competitive Advantages:
 Supports SSD cache partitioning, providing better QoS
 Read Cache, bringing higher utilization and better reliability
 Dynamic expansion and reduction, allowing convenient and flexible management

F V5/V5 EMC IBM XIV NetApp HPE


Item
SmartCache FAST Cache SSD Cache FlashCache Adaptive Flash Cache

Read/Write Cache R R&W R R R

4 KB to 128 KB
Cache block size 64 KB 64 KB 4 KB 16 KB
Self-adjustable

SSD cache partition √ X X X Uncertain

Dynamic expand
√ X X X X
and shrink

RAID Unnecessary RAID 1 Uncertain Unnecessary RAID 1

Note: Huawei SmartCache works like memory read cache, so it does not need to create RAID.
www.huawei.com ▪ Huawei Confidential ▪ 30
Smart Series Software Summary
Type Feature Name Description
SmartThin Thin provisioning: Provides capacity to users on demand
Capacity SmartDedupe Deduplication and compression: Inline and fixed data deduplication and
Efficiency & SmartCompression compression
SmartQuota Quota: A quota-management file system technology
QoS: I/O priority scheduling, I/O traffic control, and I/O performance
SmartQoS
assurance
Cache partitioning: Allocates a cache partition of a specific size to an
SmartPartition
application
Performance
Dynamic storage tiering: Identifies hot data and stores the right data to
SmartTier
right media at the right time
SmartCache SSD cache that accelerates read performance
Heterogeneous consolidation: Assumes control of third-party storage
Storage SmartVirtualization
products and migrates services
Consolidation
SmartMigration Migrates data from the source system to the targeted one

www.huawei.com ▪ Huawei Confidential ▪ 31


www.huawei.com

Copyright © Huawei Technologies Co., Ltd. 2019. All rights reserved.


All logos and images displayed in this document are the sole property of their respective copyright holders. No endorsement, partnership, or affiliation is suggested or implied. The
information in this document may contain predictive statements including, without limitation, statements regarding future financial and operating results, future product portfolio,
new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive
statements. Therefore, such information is provided for reference purposes only and constitutes neither an offer nor an acceptance. Huawei may change the information at any
time without notice.

You might also like