Professional Documents
Culture Documents
Notes:
To request a thin-provisioned volume copy, click the radio button for Thin-Provisioned in the
Volume Type box.
The target pool selected is the DS3K_SATApool (pool ID 1). The aim of this exercise is not only to
convert the volume to Thin-Provisioned, but also migrate it to a lower cost storage tier.
Study the addvdiskcopy command generated by the GUI. A thin-provisioned volume copy 1 is
being add to volume ID 9; using extents in pool ID 1 which is the DS3K_SATApool.
Not surprisingly, the GUI uses the Thin-Provision preset attributes for this copy - automatically
expand, real capacity as 2% of virtual capacity, and a warning threshold of 80%. The default grain
size is taken and is not be explicitly coded.
Uempty
Notes:
The volume details pane confirms two volume copies exist with copy 1 being very thin.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-69
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Thin-Provisioned
copy added for
APPVOL1
Notes:
Synchronization for volume copy 1 of the APPVOL1 volume is in progress.
Examine the Volume Allocation capacity bar for the DS3K_SATApool in the Volumes by Pool
view and note the capacity values displayed. In addition to the real capacity consumed by the
volumes of the pool: Two values for the pool capacity are displayed:
Capacity (atop the bar): This is the total capacity of the MDisks of the pool.
Virtual Capacity (beneath the bar): This is the total capacity of the volumes (based on the virtual
capacity of volumes).
Note that the virtual capacity of the pool might be greater than the actual or physical capacity of the
pool (referred to as overallocation). This is why storage pools might also be defined with a space
warning threshold. Pools created using the GUI have warning threshold default of 80% (of physical
capacity).
Uempty
Notes:
Review the used and real capacity values for volume copy 1. Recall the host capacity data: The free
capacity of the disk is around 38 GB of the 100 GB total capacity. SVC shows volume copy 1 is
using around 62 GB real capacity - pretty close to host capacity data.
SVC Volume Mirroring releases unused capacity during volume copy synchronization. Unused
capacity is defined to be a string of zeros - where the length of the string is defined by and aligned
with the grain size. In this example the grain size for copy 1 was defaulted to 256 K when copy 1
was added to the volume. Each 256 K grain of zeros found in volume copy 0 became free space
and does not use real capacity in copy 1.
As an aside, when host write activity to a thin-provisioned volume aligns to a grain sized area of
zeros, no real capacity is allocated/used when running with SVC models 2145-CF8 or 2145-CG8.
Also note that copy 1 has an Easy Tier status of inactive because it resides in a pool whose Easy
Tier status is inactive.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-71
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
copy 0
copy1
extents
extents
SWV7K_SASpool DS3K_SATApool
Notes:
Volume copy 0 (the extents in the SWV7K_SASpoo) will be deleted since the goal is to convert the
fully allocated volume to Thin-Provisioned in a lower tier storage pool based on life cycle objectives.
Take note that 22 extents of volume copy 0 had been moved by Easy Tier to the SSD-based MDisk.
These extents, along with all the extents on the other MDisks, will be freed once volume copy 0 is
deleted. Each volume copy is managed independently by Easy Tier; based on the activity
associated with extents of the individual volume copy.
Uempty
copy 0
copy1
extents
extents
SWV7K_SASpool DS3K_SATApool
Notes:
Right-click the volume copy 0 entry and select Delete this Copy. Extents associated with volume
copy 0 are freed in the SWV7K_SASpool. The APPVOL1 will no longer be a member of this pool.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-73
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Copy 1
APPVOL1
Figure 5-71. Volume details: After copy 0 has been deleted SNV13.0
Notes:
Only volume copy 1, the Thin-Provisioned copy, remains. It is using less storage capacity. The
volume also has been migrated to the DS3K_SATApool (lower cost storage tier) as part of its life
cycle management.
Uempty
11
9
Copy 1 Copy 1
APPVOLA
APPVOL1
SWV7K_SASpool
DS3K_SATApool
Notes:
From the host perspective, nothing has changed: The same two volumes are still mapped to the
host for both read/write access.
Recall the example environment from the beginning of this unit:
• APPVOL1 was a 100 GB fully allocated volume in the SWV7K_SASpool.
• APPVOLA was a 100 GB thin-provisioned volume in the DS3K_SASpool.
• And note now:
• APPVOL1 is a 100 GB thin-provisioned volume in the DS3K_SATApool.
• APPVOLA is a 100 GB fully allocated volume in the SWV7K_SASpool.
Both volumes obviously still have the same object IDs and UIDs: Preserving host access
transparency.
The magic of SVC virtualization (actually extent pointers) affords the freedom of changing the
backend storage infrastructure without host impact; and the opportunity to exploit newer technology
to optimize storage efficiency for better returns on storage investments.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-75
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
Nothing has changed from a host perspective.
Uempty
• Thin Provisioning
• Volume Mirroring
• Real-time Compression
• Comprestimator utility
Notes:
In this topic discusses, we will take a look a how Real-time Compression works in an SVC
environment.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-77
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
Beginning with v6.4.0, Real-time Compression (RtC) software is embedded in the SVC to address
the requirement of data reduction for active primary data while maintaining application
performance. With the v7.3 code, Real-time Compression has been enhanced to provide
improvements in performance with the delivery of SAN Volume Controller (2145-DH8) hardware
platforms, including use of the optional compression accelerator card feature. Updates to the cache
architecture provide further improvements to overall performance. However, in order to use the
compression function, you must obtain the IBM Real-time Compression license and the hardware
level for both nodes within the I/O group must be either SAN Volume Controller 2145-DH8,
2145-CG8, or 2145-CF8 for that I/O group to support compression.
Compression technology delivered by the Random Access Compression Engine (RACE) has been
integrated seamlessly in the Thin Provisioning layer of the node I/O stack so that existing SVC
functions and features are supported for compressed volumes.
A compressed volume is a variation of a thin-provisioned volume. Host servers and Copy Services
operate with uncompressed data. Compression occurs on the fly in the Thin Provisioning layer so
that physical storage is only consumed by compressed data.
Uempty For existing volumes, the Volume Mirroring function can be used to nondisruptively add a
compressed volume copy. The original uncompressed volume copy can then be deleted. A
compressed volume can also become uncompressed with the same volume copy functionality
provided by Volume Mirroring.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-79
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
SAN Volume Controller 2145-DH8 nodes must have two processors, 64 GB of memory, and at least
one Compression Accelerator adapter installed in order to use compression. Enabling compression
on SAN Volume Controller 2145-DH8 nodes does not affect non-compressed host to disk I/O
performance.
I/O group recommendations:
• It is strongly recommend to place Compression Accelerator cards into their dedicated slots 4
and 6. However, if there is no I/O card installed in slot 5, a compression card can be in any slot
connected to this second processor.
• Up to a total of two Compression Accelerator adapters can be installed. Each additional that is
installed improves the I/O performance and in particular the maximum bandwidth when using
compressed volumes.
• For an I/O group containing a 2145-DH8 with no Compression Accelerator, an attempt to create
a compressed volume fails. The addnode command will also fail if trying to add a 2145-DH8
without a Compression Accelerator to an I/O group or system which already has any
compressed volumes.
Uempty • An I/O group consisting of 2145-DH8 nodes with a single Compression Accelerator in each
supports a maximum of 200 compressed volumes, while a fully equipped I/O group with four
Compression Accelerators supports up to 512 compressed volumes.
In the previous SVC code, compression is supported for a maximum of 200 compressed volumes
per I/O group – this limit applies only to compressed volumes. A cluster with four (4) I/O groups can
support as many as 800 compressed volumes. With SVC v7.3 code using SAN Volume Controller
(2145-DH8), compression is supported for a new maximum of 512 compressed volumes per I/O
group.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-81
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
SVC embedded Real-time Compression (RtC):
• Provides high performance compression of active primary data
- Supports workloads off-limits to other alternatives
- Expands candidate data types for compression
- Derives greater capacity gains due to more eligible data types
• Operates transparently and immediately for ease of management
- Eliminates need to schedule post-process compression
- Eliminates need to reserve space for uncompressed data pending post-processing
• Enhances and prolongs value of existing storage assets
- Increases operational effectiveness and capacity efficiency; optimizing back-end cache and
data transfer efficacy
- Delays the need to procure additional storage capacity; deferring additional capacity-based
software licensing
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-83
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
2
Facilitates on the fly
data compression
Temporal and random access retrieval
3 Compression
Three compression actions Window One compression
(based on physical data location) action
1 2 3
# = File Update RACE compression
Time
© Copyright IBM Corporation 2011, 2014
Notes:
Traditional data compression is location-based. It compresses data by locating repetitions of bytes
within a given chunk of data to be compressed. The compression ratio is affected by how
repetitions can be detected and how much these bytes stored in the same chunk are related. The
relationship between bytes is affected by the format of the object (for example, text and graphics
embedded together); which might yield a lower compression ratio.
RACE offers an innovation leap by incorporating a time-of-data-access dimension into the
compression algorithm called temporal compression. When host writes arrive, multiple compressed
writes are aggregated into a fixed size chunk called a compressed block. These writes are likely to
originate from the same application and same data type, thus more repetitions can usually be
detected by the compression algorithm.
Due to the time-of-access dimension of temporal compression (instead of creating different
compressed chunks each with its unique compression dictionaries) RACE compression causes
related writes to be compressed together using a single dictionary; yielding a higher compression
ratio as well as faster subsequent retrieval access.
Uempty
Notes:
Not all workloads are good candidates for compression. The best candidates are data types that
are not compressed by nature. These data types involve many workloads and applications such as
databases, character/ASCII based data, email systems, server virtualization infrastructures,
CAD/CAM, software development systems, and vector data.
Use the IBM Comprestimator utility to evaluate workloads or data on existing volumes for potential
benefits of compression. Implement compression for data with an expected compression ratio of
45% or higher.
Do not attempt to compress data that is already compressed or with low compression ratios. They
consume more processor and I/O resources with small capacity savings.
RtC algorithms are optimized for application workloads that are more random in nature. Heavy
sequential read/write application access profiles might not yield optimal compression ratios and
throughput.
Refer to the Redpaper REDP-4859: Real-time Compression in SAN Volume Controller and the
Storwize V7000 for reference.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-85
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Compression Performance
Maximum performance (one I/O Group)
Notes:
The compression process on older 2145-CG8 and CF8 models was entirely software-based,
consuming some of the CPU resources, which lowered the maximum IOPS of the solution. With the
2145-DH8 compression using eight cores, more RAM, and hardware-assisted compression chips,
provides more IOPS than an older 2145-CG8 without compression. This example lists a range of
compressed IOPS that are based on one I/O group. For instance, the Read Miss IOPS between the
CG8 node versus the DH8 node shows that the DH8 more than doubled the performance in IOPS,
around 2x the IOPs and up to 3x the GB/sec.
Uempty
Notes:
For the compression-capable SVC CG8 or CF8 node models, if compression is not activated, each
node’s 4 CPU cores and 24 GB of cache memory are used for system processing. Compression is
activated on a per I/O group basis. When the first compressed volume is allocated for the I/O group,
a required amount of CPU cores and 2 GB of cache is reserved or dedicated to compression
processing on a per node basis.
For nodes shipped with 4 CPU cores, 3 of the 4 CPU cores are set aside for compression
processing, leaving only 1 CPU core for system processing. Therefore the existing CPU utilization
(before compression) should not exceed 25%.
For nodes shipped with 6 CPU cores, 2 of the 4 CPU cores are set aside for compression
processing; leaving 2 CPU cores for system processing. Therefore the existing CPU utilization
(before compression) should not exceed 50%. The 2 CPU cores taken from system processing
along with 2 reserved CPU cores provide 4 CPU cores for compression.
The Chubby node iRPQ is recommended - it provides an additional 24 GB of cache and 6 CPU
cores dedicated to compression; and returns 2 CPU cores to system processing.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-87
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Whereas with the 2145-DH8 node you have 16-cores (two 8-core processors), each with 32 GB of
memory. Without RtC activated, non-compressed volumes utilizes 8-cores for system processing.
When RtC compression is activated, the second 8-core is used only (at this time) to open the PCIe
lanes as well as schedule traffic into and out of the compression accelerator cards installed.
Uempty
Figure 5-82. SVC node hardware data and Chubby node iRPQ SNV13.0
Notes:
Node hardware data can be displayed from the GUI Monitoring > System view for a given node.
Within the node properties notebook, the Hardware tab displays the node hardware model, cache
memory amount, and the CPU core type.
In this example, an iRPQ (8S1296) is available to optionally add another CPU card to the
2145-CG8 CPU type 5645 node (if no internal SSDs are installed due to overlap in physical
location). This card provides 6 CPU cores and 24 GB cache memory dedicated to compression.
When installed, the CG8 node is fondly referred to as a Chubby node.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-89
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
1 RtC compression is
activated when the first
compressed volume is
created; and
deactivated when the
last compressed
volume is removed
from the I/O group.
Storage pool to
2 I/O group allegiance
due to Easy Tier
active pool using
internal SSDs from
io_grp0
Notes:
Select the Compressed preset to create compressed volumes. A warning message is
automatically displayed when the first compressed volume is to be created. Hardware resources
(CPU cores and cache) are reserved when compression is activated for an I/O group. These
resources are freed when the last compressed volume is removed from the I/O group.
Focus on the Preferred I/O group ID column for the listed storage pools. The DS3K_SASpool has
a preference or allegiance to I/O group 0 as it contains a SSD-based MDisk created from internal
drives of nodes in I/O group 0. By default the GUI assigns volumes being created in this pool to I/O
group 0.
Uempty
4
Compressed
8 preset defaults
(Thin-Provision preset
Click the Create button
minus grain size)
7
© Copyright IBM Corporation 2011, 2014
Notes:
Review the Summary statement resulting from this volume creation request. Notice that only 1 GB
of real capacity is to be allocated for this 50 GB volume.
To view the defaults for by the Compressed preset, click the Advanced button from the New
Volume pane then select the Capacity Management tab of the Advanced Settings - New
Volume pane. The Compressed radio button is selected by default with this preset.
Review the Options box for the Compressed preset: Its defaults are almost identical to that of the
Thin-Provision preset. A compress volume is a variation of a thin-provisioned volume. The only
difference between the two presets is the grain size attribute. Compressed volumes do not have an
externally controlled grain size.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-91
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Compressed 50 GB volume
in io_grp0
object ID 12 created
Notes:
Review the mkvdisk command generated by the GUI - the -compressed parameter defines the
volume being allocated as a compressed volume.
The -autoexpand, -rsize, and -warning parameters, used to define thin-provisioned volumes,
are also used to define compressed volumes.
A compressed volume, COMP1 of 50 GB, is created with an assigned object ID of 12 and a caching
IO group of 0. It is then mapped to host REDWIN1.
Uempty
Notes:
Examine the Copy 0 details of the COMP1 volume. The capacity bar has the appearance of a
thin-provisioned volume. Its capacity details contain statistics related to compression. At initial
creation, only capacity for volume metadata has been allocated.
A volume is owned by an I/O group and is assigned a preferred node within the I/O group at volume
creation. Unless overridden, the preferred node of a volume is assigned in round robin fashion by
the system.
This volume is owned by io_grp0 and NODE2 has been assigned as its preferred node. Data
compression is performed by the preferred node of the volume.
Beginning with v7.1, Easy Tier supports compress volumes. Only random read operations are
monitored for compressed volumes (versus both reads and writes). Extents with high random reads
(64 K or smaller) of compressed volumes are eligible to be migrated to tier 0 storage.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-93
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Compression Active –
node CPU cores +
cache are reserved
for I/O group
Notes:
In the Monitoring > System view, the system capacity column now offers a Compression View
option. The Storage Allocation status pod at the lower left corner of every GUI view now contains
a Compression option to display capacity savings related to compression.
Since compression is managed at the I/O group level, click the io_grp0 enclosure to open its
properties notebook. The Compression Active setting now contains a Yes to indicate
compression has been activated for the I/O group. Node CPU cores and cache memory are now
reserved for both nodes of the I/O group.
Uempty
Compression done
by volume’s
preferred node
Write
activity
Host sees
50 GB volume
Figure 5-88. Host view of (compressed) volume and host I/O SNV13.0
Notes:
Real-time Compression is totally transparent to the host. A compressed volume appears a standard
volume with its full capacity to the attaching host system. Host reads and writes are handles as
normal I/O.
Behind the scene, compression is managed by the preferred node of the volume. As data is written,
it is compressed on the fly by the preferred node before written to the storage pool.
In this example, the Window host “sees” a 50 GB volume. After some write activity, it has about 30
GB of free space.
Compression CPU utilization can be monitored from Monitoring > Performance. Use the
drop-down list to select and view CPU utilization data of the preferred node of the volume.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-95
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
As write activity occur, compression statistics are updated for the volume. In this example, the
folder written would have taken 19.45 GB of capacity. But due to compression, only 5.43 GB was
written, resulting in a capacity savings around 72% ((19.45-5.43)/19.45).
Beginning with v7, compressed volumes are eligible for Easy Tier management. With v6.4, a
compressed volume can reside in a hybrid storage pool, but its extents will not be migrated to/from
the SSD-based storage tier.
Uempty
Notes:
One way to view the details of the storage pool that contains the COMP1 volume is to go to
Volumes > Volume by Pools then click the pool name, DS3K_SASpool, in the Pool Filter list.
Upon the creation of the first compressed volume in a storage pool, the Compression Savings bar
is included in the pool details to display compression statistics at the pool level. In this case, the
total compression savings thus far is 72%. Using the numbers shown in the savings capacity bar
area, the 76% savings is derived from (14.02/(14.02+5.43)).
The compression statistics for the volume entry is displayed in the Compression Savings column.
The statistics related to compression are dynamically calculated by the GUI. These calculations of
percentages of savings are not available with the CLI.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-97
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
GUI provided
storage efficiency
savings due to
compression
(1 – (5.43/50.00)) = 89.14%
Figure 5-91. System level compression statistics and storage efficiency savings SNV13.0
Notes:
Go to the Monitoring > System view to obtain compression statistics and savings aggregated at
the system level. Given that only one 50 GB compressed volume has been allocated so far, it is a
bit easier to relate to the capacity values shown.
The Compression View of the system capacity column presents capacity utilization from three
different perspectives:
The total virtual capacity of compressed volumes and their capacity savings due to Thin
Provisioning (if no writes were issued from the host, due to being Thin-Provisioned, no real capacity
would be allocated for compressed volumes).
The total capacity that would have been written if compression wasn’t implemented
(Thin-Provisioned but not compressed) and the amount of capacity saved due to compression. This
data is also a display option in the Storage Allocation status pod.
The total actual capacity consumed to store the compressed data.
The Compressed Volumes section of the system Info notebook identifies the storage efficiency
savings due to compression. Only 5.43 GB, instead of 50 GB, has been used; resulting in a
capacity savings of 89%.
Uempty
• Thin Provisioning
• Volume Mirroring
• Comprestimator utility
Notes:
This topic discusses examines the benefits of the Comprestimator utility tool.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-99
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
Not all data types are suitable for compression. The Comprestimator utility is designed to estimate
expected compression rates for block-based volumes that contain existing data.
The Comprestimator is a host based command line executable available from the SVC support
website. The utility and its documentation can also be found by performing a web search using the
key words ‘IBM Comprestimator’.
The Comprestimator supports a variety of host platforms. It employs advanced mathematical and
statistical algorithms to efficiently perform read-only sampling and analysis of existing data volumes
owned by the given host. For each volume analyzed, it reports an estimated compression capacity
savings range; within an accuracy range of 5 percent.
Uempty
-n : Disk number
-P : Output in
paragraph format
Copy 1
APPVOL1
Notes:
Once the downloaded Comprestimator utility has been copied to a Windows system folder, it can
then be invoked as a program to scan an existing volume of this host.
This example shows how the Comprestimator is used to evaluate the APPVOL1 thin-provisioned
volume whose virtual size is 100 GB which comprises of JPEGs or already compressed data. The
output of the Comprestimator for the volume indicates the capacity savings of the volume is derived
mainly from Thin-Provisioning; the compression savings is not even one percent of the total
capacity. Based on this finding, this volume is definitely not a good candidate for compression.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-101
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
DBs = compression-friendly
11
Copy 1
APPVOLA
Notes:
In this example, the Comprestimator is used to evaluate the APPVOLA 100 GB, a fully allocated
volume that contains database-like files.
The Comprestimator output for this volume indicates that the real storage capacity consumption for
this volume would be reduced from 100 GB to 18.6 GB. This represents a saving of 79.1% within an
accuracy range of 5%. Only 11.2% of the capacity savings would be derived from
Thin-Provisioning.
The guideline for a volume to be considered as a good candidate is a compression savings of 45%
or more.
Uempty
11
Copy 1
APPVOLA
Notes:
Recall the APPVOLA volume was originally allocated as a thin-provisioned volume. When its
allocated capacity exceeded the default Thin-Provisioned warning threshold of 80%, it was
converted to a fully allocated volume using SVC Volume Mirroring. Then the thin-provisioned
volume copy 0 was deleted. Currently only the fully allocated volume copy 1 remains.
Volume copy 1 resides in an Easy Tier active pool therefore its volume Easy Tier status is active.
Presently 0.5 GB of its capacity has been migrated to the SSD-based storage tier.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-103
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
3 4
Notes:
As was done in earlier topics of this unit, add a volume copy to the APPVOLA volume by right click
its volume entry. In this case, we are using Volume ID 11. Next, select Volume Copy Actions >
Add Mirrored Copy.
Uempty
Add a compressed
volume copy in pool ID 2
for volume whose ID is 11
Notes:
In the Add Volume Copy pane, select the Compressed radio button in the Volume Type box to
request a compressed volume copy.
For the storage pool, choose the same pool as volume copy 1. After the compressed volume copy
is created (copy 0 in this case), the fully allocated volume copy (copy 1) is to be deleted.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-105
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
Volume copy 0 is created with the compressed attribute. Volume Mirroring proceeds to synchronize
copy 0 with copy 1. At the same time, RtC compresses the data read from copy 1 prior to storing it
for copy 0.
Note that the volume’s preferred node is NODE2. Recall compression is performed by the volume’s
preferred node.
Uempty
Compressed volume synchronization and data
compression
Notes:
Compression CPU utilization can be monitored from Monitoring > Performance.
The default view for this pane is System Statistics. The data presented is at the system level.
In the lower example, we have changed the System Statistics to NODE2 using the drop-down list
to view the compression CPU utilization of the preferred node of the APPVOLA volume.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-107
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
Both the storage pool and the volume entry are updated dynamically by the GUI with compression
savings statistics.
Uempty
Comprestimator estimates:
Notes:
The compression savings of 76% for volume copy 0 is derived from (89.73-21.24)/89.73. The
Comprestimator’s estimated compression savings of 79.1% for this volume is within the advertised
5% accuracy range.
In terms of storage consumption, volume copy 0’s total allocated capacity of 23.25 GB (includes the
autoexpand contingency buffer) is significantly less than the volume copy 1’s consumed real
capacity of 100 GB.
Notice that volume copy 0 also has an Easy Tier status of active. Easy Tier measures and manages
the extents of each volume copy independently. SSD resident extents of volume copy 1 does not
cause the corresponding extents of volume copy 0 to be moved to the SSD-based tier.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-109
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
3 Copy 1
Notes:
After the volume copies have been synchronized, volume copy 1 (the fully allocated copy) can be
deleted.
The remaining volume copy, copy 0, is a compressed volume. Through Volume Mirroring, a volume
with existing data has now become a compressed volume.
Uempty
Host Transparency
Copy 00 Copy 1
Copy Copy 0
APPVOLA
APPVOLA APPVOLA
APPVOLA
Notes:
As seen throughout this unit, changing the volume copy attribute from Thin-Provisioned to fully
allocated, or to compressed, can be achieved with SVC Volume Mirroring. It is a totally transparent
and nondisruptive process to host I/O activity.
The APPVOLA volume began as a thin-provisioned volume. Due to application write activity, its
capacity usage exceeded the default Thin-Provisioning warning threshold of 80% of its virtual
capacity. Volume mirroring was then used to convert the volume to a fully allocated copy with an
allocated capacity of 100 GB.
The Comprestimator utility ascertained that the data content of the volume is compression friendly.
Volume mirroring was invoked again to converted the volume to compressed; enabling the
installation to reclaim about 76% of its previously allocated capacity.
Higher storage efficiency benefits are derived with compression technology and due to Volume
Mirroring and SVC storage virtualization, host processing was oblivious to the transition of the
APPVOLA volume from Thin-Provisioned to fully allocated, then to compressed.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-111
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
In addition to the above statements, recall compression is performed by the volume’s preferred
node. The preferred node is assigned in round-robin fashion within the I/O group as each volume is
created.
Over time, as volumes are created and deleted, monitor and maintain the distribution of
compressed volumes across both nodes of the I/O group.
Note: In the example scenarios of this unit, compressed volumes and non-compressed volumes
share the same storage pool. For certain configurations and environments, it might be beneficial to
segregate compressed volumes into a separate pool to minimize impact on non-compressed
volumes. Review your environment with your IBM support representative when activating Real-time
Compression.
Uempty
• Thin Provisioning
• Volume Mirroring
• Comprestimator utility
Notes:
Our final topic examines the process of the Easy Tier STAT reporting.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-113
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Figure 5-107. Storage Tier Advisor Tool (STAT) for analysis SNV13.0
Notes:
As the v7.3 code level now supports 3 tiered storage using the Easy Tier functionality, STAT can be
used to determine the use of your tiered storage. The Storage Tier Advisor Tool (STAT) used in
conjunction with the Easy Tier function interprets historical usage information from SVC systems. It
can also help determine what if any benefit could be gained by adding SSDs to the system prior to
actually investing in them.
The IBM STAT utility provides information on how much value can be derived by placing “hot” data
with high I/O density and low response time requirements on SSDs while targeting HDDs for
“cooler” data that is accessed more often sequentially and at lower I/O rates.
The STAT tool can be downloaded from the SVC support website; or do a web search on ‘IBM Easy
Tier STAT tool’ for a more direct link.
Download the STAT tool and install it on a Windows workstation. The default directory is C:
\Program Files\IBM\STAT.
Uempty The program can also be invoked from a command line window with the downloaded heat file name
specified (see screen shot above). Ensure the heat file is in the same directory as the STAT
program when invoking from the command line. The output index.html file can then be opened with
a web browser.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-115
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
The Easy Tier v3 STAT Tool supports 3 tiered (SSD, ENT, NL) storage using the Easy Tier
functionality. STAT can be used to determine what application data can benefit the most from
relocation to SSDs, Enterprise (SAS/FC) drives or Nearline SAS drives. STAT uses limited storage
performance measurement data from a user's operational environment to model potential
unbalanced workload (skew) on disk and array resources. It is intended to supplement and support
but not replace detailed pre-installation sizing and planning analysis. It is most useful to obtain a
“rule of thumb” system-wide performance projection of cumulative latency reduction on arrays and
disks when a Solid State Drive configuration and the IBM Easy Tier function are used in
combination with handling workload growth or skew management.
With Easy Tier v3 STAT you can:
• Generate the skew report of the workload. This report can also be directly read by Disk Magic
• Review workload by categorization
• Generate a daily (24hours) CSV formatted report of Easy Tier data movements
• Review Storage Pool Performance Statistics and Improvement Recommendation
- Tier Status showing rank utilization for each tier
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-117
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
1
2
Notes:
After Easy Tier becomes active for a storage pool, it takes about 16 - 24 hours of data collection
and assessment for Easy Tier to determine the ‘heat’ of volume extents and implement its migration
plan.
The migration plan created by Easy Tier directs SVC to move hot extents to the SSD tier MDisks,
and move extents that have become cold from the SSD tier to the HDD tier MDisks.
The Easy Tier heat file is refreshed about every 24 hours. Go to Settings > Support and click
Show full log listing. Locate the heat file by entering ‘heat’ in the GUI search box. Right-click to
download the file from the SVC cluster.
Use the Open with option to browse and open with the stat.exe program, or.
Use the Save File option to download the binary file directly; then invoke the STAT.exe with host
command line interface (refer to previous page). This process converts the binary heat file into a
web browser file with a name of index.html.
Uempty
Notes:
The output html file from the STAT tool is stored in the same folder as the stat.exe. Open it with a
web browser to review the generated reports.
The System Summary report includes a brief inventory of volumes and capacity measured, amount
of detected hot data to be migrated, and an estimated amount of time for the migration to complete.
It also provides a recommendation of amount of SSD capacity to add, or to take advantage of
existing SSDs currently not in use, for possible performance improvement.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-119
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
The Storage Pool Recommendation report provides the measurement data by pools where Easy
Tier is either activated automatically (two-tiers of storage technology detected) or manually (single
tier pool where Easy Tier was turned on to run in evaluation mode).
Uempty
Notes:
The Volume Heat Distribution report provides a distribution of hot and cold data (in terms of
capacity) for each volume monitored; with the hot data capacity displayed in red.
Note STAT reporting displays the Volume ID, Copy ID, and Pool ID values are in hexadecimal
notation. The SVC uses decimal notation for the object IDs. For example, SVC volume ID 12 would
be listed in this report as volume ID 0x000c.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-121
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
Volume ID 0x000c from the Volume Heat Distribution report is SVC volume ID 12 or COMP1. It
resides in an Easy Tier active pool and 2.5 GB of its extents have been identified as eligible to be
migrated to the SSD-tier extents of the pool.
COMP1 is a compressed volume. The hot extents of compressed volumes are reported based on
random read operations only.
Uempty
Notes:
Volume ID 0x000b in the Easy Tier Volume Heat Distribution report, confirms that each volume
copy’s extents are managed independently by Easy Tier.
Volume copy ID 1 of 0x000b (ID 11 or APPVOLA) is the fully allocated 100 GB copy. Presently.5 GB
is in the SSD tier and Easy Tier has identified that a total of 11 GB of this copy is eligible to reside in
the SSD tier. Obviously when copy 1 is deleted (based on the prior example scenario), all its extents
become free space.
Volume copy ID 0 is the more recently added compressed copy. None of its extents have been
identified as eligible to be migrated to the SSD tier yet. Volume mirroring, which was used to create
volume copy 0, essentially performed sequential I/O operations to copy the content of copy 1 to
copy 0. Sequential I/O of 64 KB or greater is excluded from Easy Tier measurement.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-123
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Figure 5-115. Storage pool tier data after data relocation SNV13.0
Notes:
The CLI outputs for the lsmdiskgrp 0 and lsmdiskgrp 2 commands summarize the tier-related
capacities of the two pools with Easy Tier active. Data related to the Easy Tier setting of the pool (in
addition to the status) and the remaining free capacity by tier are available from the CLI.
Uempty
Figure 5-116. Turn off volume level Easy Tier data relocation SNV13.0
Notes:
Given Easy Tier is active at the pool level, use cases might exist where it is no longer desirable for
Easy Tier to perform dynamic extent relocation for a given volume within the pool.
The volume level Easy Tier setting can be turned off with the chvdisk -easytier off command.
This stops extent movement by Easy Tier for the volume.
The volume’s Easy Tier status becomes measured because the pool’s Easy Tier status is active.
The volume’s I/O activity is still measured and factored into the migration plan for the pool (though
none of this volume’s extents would be eligible for movement).
The Easy Tier setting for volume ID 8, ROXANNE, has been set to off, causing its Easy Tier status
to be changed to measured. Its current extent distribution, across both storage tiers, is frozen. I/O to
these extents are measured and included in the total statistics for the pool; but none of this
volume’s extents will be subject to migration.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-125
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Figure 5-117. Volume Easy Tier status and pool migration SNV13.0
Notes:
When a volume is migrated from one storage pool to another, its Easy Tier characteristics are
honored when they are consistent with the target pool’s Easy Tier attributes.
The ROXANNE volume has been migrated to an Easy Tier active pool with available SSD extents.
Consequently, its volume Easy Tier status remains as measured. Its data previously resident on
SSD-based extents of the source pool are migrated to SSD-based extents of the target pool.
More details about data migration will be discussed in the next unit.
Uempty
Figure 5-118. Easy Tier evaluation mode for single tier pools SNV13.0
Notes:
Changing the Easy Tier setting to on for a single tier storage pool activates Easy Tier to run in
evaluation mode. The temperature of volume extents is measured to produce the heat file. STAT
can then be used to obtain the recommended tier 0 capacity to be added to improve the I/O
performance of the measured workload.
Issue chmdiskgrp -easytier on x where x is the object ID of the storage pool. Repeat for all
storage pools where Easy Tier measurement is desired.
Note the DS3K_SATApool’s Easy Tier setting changed from auto to on, and the status changed
from inactive to active, even though this pool contains no SSD-based MDisks.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-127
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
Due to Easy Tier having been activated for the single tier DS3K_SATApool, the Easy Tier status for
the volumes of this pool have become measured automatically.
Uempty
Notes:
This is the summary of Easy Tier settings. Note the defaults:
With the default pool Easy Tier setting of auto and the default volume Easy Tier setting of on (for a
single tier pool) this causes both the pool and volume copy Easy Tier status to be inactive (due to
single tier pool).
If the single tier pool Easy Tier setting is changed to on, the pool Easy Tier status would become
active and the volume copy Easy Tier status would become measured. This enables Easy Tier
evaluation and analysis of I/O activity for volumes of this pool.
With the default pool Easy Tier setting of auto and the default volume Easy Tier setting of on (for a
two-tier or hybrid pool) this causes the pool and the volume Easy Tier status to become active.
Easy Tier automatic data placement becomes active automatically.
Note: The Easy Tier heat file is generated and continually updated as long as Easy Tier is active for
a storage pool.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-129
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Notes:
Uempty
Notes:
The key item to note is Easy Tier can be used for workload measurement. It can be used to assess
the impact of adding SSDs to the workload before the actual investment of SSD-based MDisks.
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-131
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Keywords
• Easy Tierv3
• Automatic data placement mode
• Evaluation mode
• Easy Tier indicators
• Drive use attributes
• Thin Provisioning
• Auto Expand
• Overallocation
• Volume Mirroring
• Real Time Compression
• Comprestimator utility
• Easy Tier STAT
• Data relocation
• Volume Heat Distribution report
• Storage Pool Recommendation report
• System summary report
Notes:
Uempty
Checkpoint (1 of 2)
1. True or False: A thin-provisioned volume is created with two
capacities, a virtual capacity as seen by host servers and a
real capacity defined by the amount of actual allocated
storage capacity.
Notes:
Write your answers here:
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-133
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook
Checkpoint (2 of 2)
4. True or False: Thin-provisioned volumes must all reside in a
dedicated storage pool.
Notes:
Write your answers here:
Uempty
Unit summary
Having completed this unit, you should be able to:
• Recognize Easy Tier settings and statuses at the storage pool and
volume levels
• Differentiate among fully allocated, Thin-Provisioned, and compressed
volumes in terms of storage capacity allocation and consumption
• Create thin-provisioned volumes and monitor volume capacity utilization
of autoexpand volumes
• Use Volume Mirroring to convert a volume to Thin-Provisioned or
compressed to reclaim allocated but unused capacity
• Itemize SVC hardware resources required for Real-time Compression
• Use the Comprestimator utility to identify suitable candidate volumes for
compression
• Analyze Easy Tier Storage Tier Advisor Tool (STAT) reports for volume
heat distribution and capacity recommendations
Notes:
© Copyright IBM Corp. 2011, 2014 Unit 5. SVC enhanced features 5-135
Course materials may not be reproduced in whole or in part
without the prior written permission of IBM.
Student Notebook