Professional Documents
Culture Documents
Table of contents
Introduction 3
Overview of HP 3PAR Thin Provisioning Software 3
When to use thin provisioning 4
Avoiding frequent storage capacity addition to servers 4
Accelerating time to market 4
Modeling chargeback 5
When not to use thin provisioning 5
Common provisioning groups 6
CPGs and workloads 6
Reasons to create multiple CPGs 6
CPG automatic growth 6
How TPVVs use CPG space 7
Changing LD characteristics within a CPG 7
Snapshot space within CPGs 7
Allocating CPG space to TPVVs 7
CPG performance considerations 8
TPVV sizing guidelines 8
Managing thin storage 9
Allocation warnings 9
Allocation limits 10
Remaining physical capacity alerts 10
Remaining CPG free space alerts 11
Viewing logged warning and limit alerts 11
Host system based quota 11
User recommendations 11
Tracking volume space usage 12
TPVVs 12
CPGs 12
System space 12
Total used space 13
Running out of space 13
Running out of space in a TPVV 13
Running out of space in a CPG 13
Running out of space on the system 13
Usage reporting and trend analysis 14
Additional HP 3PAR thin technologies 14
Reclaiming unused space 15
File system considerations 16
Thin provisioning efficiency on host file systems 16
File system fragmentation 16
Thin provisioning and applications 16
Databases 16
Microsoft Exchange 17
VMware vSphere 17
Migration to thin provisioned volumes 18
Migrating from fat to thin across arrays 18
Migrating from fat to thin on the same array 18
Storage Federation and Peer Motion 19
Licensing 19
Conclusion 19
Learn more 19
Introduction
Balancing the storage needs of new projects or unpredictable workloads against limited resources is the prime challenge
of IT managers today. Of the many proposed solutions for improving storage efficiency, few are actually implemented.
Of those implemented, fewer still achieve demonstrable success.
Thin provisioning has achieved widespread adoption as it dramatically increases capacity efficiencies. It has become a
data center “must have” for its ability to break the connection between logical and physical capacity. However, all thin
provisioning implementations do not deliver the same results. Some are complex to deploy, while others use coarse
allocation units and cannot deliver optimal savings.
Thin provisioning allows a volume to be created and made available as a Logical Unit Number (LUN) to a host without the
need to dedicate physical storage until it is actually written. The operating system (OS) on the host recognizes and can
consume the full size of the thin provisioned volume. HP 3PAR Thin Provisioning Software has long been considered the
gold standard in thin provisioning for its simplicity and efficiency. Unlike other “bolt-on” implementations, HP 3PAR Thin
Provisioning Software is simple and efficient, helps to start new projects more quickly and on demand and saves millions
of dollars to organizations. HP 3PAR Thin Provisioning leverages the dedicate-on-write approach of the HP 3PAR Utility
Storage platform, allowing enterprises to purchase only the disk capacity they actually need. HP 3PAR Thin Provisioning
integrates into Symantec’s Veritas Storage Foundation, VMware vSphere 4 and 5, Oracle ASM, and others greatly
enhancing the operative and administrative efficiency of these applications.
While HP 3PAR Thin Provisioning Software is extremely simple to deploy and use, a certain amount of planning is
advantageous to maximize its benefits. This paper documents best practices on thin provisioning on 3PAR systems and
is intended for administrators looking to get the most out of their HP 3PAR Utility Storage deployment. In addition, it
describes other HP 3PAR thin technologies that can be used in conjunction with HP 3PAR Thin Provisioning Software to
maximize its effectiveness. Unique to HP 3PAR Utility Storage, HP 3PAR Thin Conversion Software enables customers to
reduce capacity requirements by 50 percent or more 1 by deploying HP 3PAR Storage Systems in place of legacy storage.
HP 3PAR Thin Persistence Software and other thin reclamation solutions enable thin provisioned storage on HP 3PAR
arrays to stay thin over time by ensuring that unused capacity is reclaimed for use by the array on an ongoing basis.
1
Refer to the HP 3PAR Get Thin Guarantee for details: hp.com/storage/getthin
3
Figure 1: Overview of thin provisioned virtual volumes (TPVVs)
• The addition or expansion of storage provisioned to servers is not desired, for example in mission-critical
environments
• Relatively slow growth rates or unpredictable growth over time occurs. This can happen on large file systems used for
group shares, mailbox databases, or general database space.
4
Modeling chargeback
Thin Provisioning is ideal for service providers and others wishing to deploy a Utility Storage offering where
usage chargeback is an important component of the service. Thin provisioning offers service providers the
following benefits:
• Quick deployment
• Decoupling the charges for storage from the limitations of actual presented storage
• Removing the exposure to disruption of service during future capacity expansions
• Increasing profit margins based on the savings resulting from the difference in cost for provisioned storage compared
to actual physically used storage
• Collecting detailed charging data at the individual VV level (usage shown by the showvv –p –prov
[full|cpvv|tpvv|snp]or at the CPG level (usage shown by the showcpg –r <cpg> or showvv –p –cpg
<cpg>)
Note: When planning to collect charging data, it is recommended that the names chosen for objects like CPGs, VVs, snapshots and domains contain a
meaningful prefix or suffix referring to the project, application, line of business or department the objects belong to. This enables the grouping of objects
in the chargeback report. The InForm OS allows up to 31 characters for the name of an object.
5
Common provisioning groups
CPGs are policies for how free chunklets within the HP 3PAR array should be used when creating volumes. A CPG policy
contains parameters such as disk type, disk speed, RAID type, growth increment, chunklet radial placement, and
availability level. CPGs automatically grow according to the stated parameters. Within a growth increment, the InForm
OS allocates blocks of 16 KB on demand to store data in a TPVV. No administrator intervention is needed in this
provisioning operation.
• To define different service levels e.g. RAID 1, RAID 5 or RAID 6; use FC drives, NL drives, or Solid State
Drives (SSDs)
• To map TPVVs to specific controller nodes within the array (for example, associate some VVs with nodes 0 and 1 and
others with nodes 2 and 3)
• To isolate TPVVs onto a subset of the physical disks to minimize the interaction between workloads for performance
or availability reasons (for example separate database files and their transaction logs on different disk subsets)
• To map TPVVs belonging to different lines of business, departments, or customers onto particular CPGs for reporting
and management purposes. Creating CPGs with exactly the same characteristics but a different name is possible. This
allows a logical separation of resources and may help with chargeback models, as chargeback could be based on CPG
space usage rather than usage at an individual VV level.
6
Table 1: Default and limits for the growth increment per node pair
• The CPG growth increment can be changed at any time. This affects new LDs that are allocated from the CPG but does
not impact any LDs already allocated from it.
• A CPG always has a certain amount of growth space allocated to it. To determine the optimal growth increment for
your environment, review the following three factors influencing the value for it:
– The CPG growth increment should be as small as possible to minimize the amount of reserved growth space. This is
of particular importance for CPGs created on SSDs, the space on which is usually limited within the array.
– For optimal performance, the growth parameter of the CPG needs to be large enough to create new LDs from
chunklets coming from all physical disks of a particular type (FC, NL, or SSD) within the HP 3PAR Storage System. An
8 GB growth size with 256 MB chunklets using RAID 1 will use 64 chunklets hence touching 64 physical disks when
creating the LDs. If the 3PAR system has 480 disks, then the optimum CPG growth size to use all disks for RAID 1
would be 60 GB with 256 MB chunklets and 240 GB for 1 GB chunklets.
– If the environment is write-intensive, the rate of consumption of CPG space might be significant. In this case, it is
recommended that the growth increment be set to a value above the default value listed in Table 1.
• Unused SD and SA (Snapshot Admin) space in the CPG. The space of removed snapshots is left allocated to the TPVV
and selected as the primary source of space for expanding the TPVV. The LDs for expansion are mapped to snapshot
data and snapshot admin space of an associated VV and its snapshot descendents as needed. The space of removed
snapshots can be reclaimed using the freespace command. The reclaimed space is returned to the CPG.
7
• Unallocated LD space in CPGs. LD space is shared by all the TPVVs associated with the CPG. This space can grow to a
considerable amount since the SA and SD space of any VV associated with the CPG is returned to the CPG as
unallocated LD space upon VV removal or when the freespace command is issued for a TPVV. CPGs do not
automatically remove unused LDs; the returned, unallocated LDs are remapped to the SD space of associated TPVVs
or their snapshots as needed over time. To free this space for other uses (for example, for use by other CPGs), the
unused LDs must be manually removed from a CPG using the removeld command. Only LDs that are entirely unused
can be removed. Unallocated LD space for a CPG can be displayed using the command showld –cpg <CPG>. Please
note that the system will automatically create new LDs, which will show as unused initially, based on the CPG growth
size parameter.
• Free chunklets. Free chunklets available to a CPG for creating new LDs may be limited by the LD creation parameters
for the CPG. It is important to understand that, if different CPGs can draw from the same pool of chunklets, the
chunklets allocated to one CPG will reduce the pool of storage available to the other CPGs. It is recommended that
storage administrators implement the following strategies to stay abreast of available free space:
– Set the CPG allocation warnings (and limits, if necessary)
– Monitor the free space reduction rate using the command showspace –cpg <CPG> –hist
– Set the free space capacity warning with the setsys RawSpaceAlertXX command (as detailed in Allocation warnings
section on page 9)
– Monitor available free space alerts set by the showalert command
– Maintain a buffer of physical capacity
• CPG layout
– Use all physical disks of a particular type (FC, NL, SSD) present in the array when creating a
CPG to enable wide striping
– Use HP 3PAR Dynamic Optimization Software to rebalance the LDs when new disks are added
• CPG growth size
– Use a growth increment value that allocates exactly one, two, three, … chunklets from every physical disk of a
particular type in the system
• On the P10000 (V-class) system the minimum size for a TPVV is 1 GB, for other arrays it is 256 MB. The maximum size
for a TPVV is 16 TB for all InForm OS versions on all types of HP 3PAR systems.
• Thin provisioning demonstrates the most value in situations involving large scale consolidation. For small virtual
volumes (256 MB up to a few tens of GB), the growth increment of the CPG of the TPVV may be many times higher
than the TPVV size meaning that minimal benefit is realized after one growth increment was applied.
• It is possible to increase the size of a thin volume. This provides a significant amount of flexibility. However, the
impact of growing volumes for host-based OS needs to be considered. It is not possible to shrink a TPVV.
• When faced with a choice, it is preferable to make volumes larger than needed over making them too small. If the
volumes that are presented are too small for the ongoing requirements, then TPVV growth or additional volumes will
be required in the future, which is something that needs to be managed.
• If you create large volumes, space overconsumption by the host system or by users may happen. Using quota on the
host system is an elegant way to manage potential overuse.
8
Managing thin storage
Overprovisioning capacity to hosts is one of the prime reasons why people choose to create thin provisioned volumes.
Natural growth or a misbehaving process writing excessive amounts of data to VVs can cause a CPG or the entire array to
run out of space potentially causing an interruption of service for applications consuming space from that CPG or array.
While HP 3PAR Thin Provisioning Software is simple to use, a certain level of management is required to maximize its
benefits. The InForm OS provides multiple categories of alerts that notify storage administrators of important events to
ensure the smooth running of a HP 3PAR array. Figure 2 illustrates the categories for which warnings can be set.
These include:
Allocation warnings
Allocation warnings provide a mechanism for informing storage administrators when a specific capacity threshold is
reached. An allocation warning can be specified independently for each TPVV and each CPG. It is recommended that
allocation warnings be used, at least on the CPG level, and acted upon when they get triggered.
The relevant CLI commands for setting allocation and growth warnings are:
• setvv –usr_aw <percent> <TPVV>: sets the allocation warning for the user space of the TPVV
as a percentage of the TPVV size
• setvv –snp_aw <percent> <TPVV>: sets the allocation warning for the snapshot space of the TPVV
as a percentage of the TPVV size
• setcpg –sdgw <num> <CPG>: sets the growth warning for the CPG in MB (append to the
value num “g” or “G” for GB or “t” or “T” for TB)
9
These warnings can be changed at any time and are effective immediately. The CLI commands showvv –alert and
showcpg –alert lists the allocation warnings that were set per TPVV and CPG.
The following CLI commands set warnings for the remaining space on a particular drive type in the array:
• setsys RawSpaceAlertFC <num>: sets the allocation warning for FC drives where num is the
remaining raw capacity in GB on the FC drives in the array
• setsys RawSpaceAlertNL <num>: sets the allocation warning for NL drives where num is the
remaining raw capacity in GB on the NL drives in the array
• setsys RawSpaceAlertSSD <num>: sets the allocation warning for SSD drives where num is the
remaining raw capacity in GB on the SSD drives in the array
These warnings can be changed at any time and are effective immediately. The CLI command showsys -d lists the
warnings that were set per disk type.
Allocation limits
Applications sometimes get into an abnormal state writing data continuously to the storage device. Allocation
limits provide a mechanism to prevent such “runaway” applications from consuming disk capacity beyond a
specified threshold. Allocation limits can be specified independently for each TPVV and each CPG. For a TPVV,
once the allocation limit is reached, the capacity allocated to the TPVV stops growing and new application writes
fail. Similarly, for a CPG, once the allocation limit is reached, the automatic creation of new LDs, if configured,
is disabled.
The relevant CLI commands related to setting allocation and growth limits are:
• setvv –usr_al <percent> <TPVV>: sets the allocation limit for the user space of the TPVV
as a percentage of the TPVV size
• setvv –snp_al <percent> <TPVV>: sets the allocation limit for the snapshot space of the TPVV
as a percentage of the TPVV size
• setcpg –sdgl <num> <CPG>: sets the growth limit of the CPG in MB (append to the
value num “g” or “G” for GB, or “t” or “T” for TB)
These alerts can be changed at any time and are effective immediately. The CLI commands showvv –alert and
showcpg –alert list the allocation limits that were set per TPVV and CPG.
It is important to note that the growth limit for a CPG is a hard limit and the CPG will not grow beyond it. Any VVs that
require more space from the CPG once the hard limit is reached will not be able to grow and will eventually present write
errors to host systems until the CPG allocation limit is raised. Because of this, it is recommended that TPVV, CPG, and
free space warnings and limits be set to sensible levels and managed when they are triggered. As an example, the CPG
warning limit should be set sufficiently below the CPG allocation limit so that it alerts the storage administrator with
ample time to react before the CPG allocation limit is reached.
10
Remaining CPG free space alerts
A history of used and free CPG space is available. The InForm OS samples CPGs and the space available to the CPGs for
growth once per day. This history is stored in an internal table and can be displayed using the -hist option in the
showspace and showcpg commands. An alert is automatically generated if the available free space for a CPG falls
below the CPG warning limit or the CPG allocation limit.
• The CLI commands showalert and showeventlog list the alerts in various formats and with various options
• The HP 3PAR InForm Management Console shows the alerts in the “Events” section
• SMI-S integrated in InForm OS provides for asynchronous notification of events that indicate changes in the managed
elements controlled by the CIM server. A CIM client can subscribe to selected CIM Indications to receive event
notifications from the CIM server.
• The SNMP agent within the InForm OS allows for retrieving the alerts by remote SNMP clients
• Alerts can be forwarded (setsys) to a Log Host for viewing them in an Enterprise Management application like
HP OpenView
User recommendations
The monitoring of alerts for available capacity by storage administrators and internal business processes are a critical
component of a successful HP 3PAR Thin Provisioning management and administration strategy. In priority order, the
recommended level of process responsibility for customers to monitor thin provisioned HP 3PAR Utility Storage is:
• Customer should nominate a primary and if possible a backup storage administrator for each site with HP 3PAR
equipment. Nominated storage administrator roles are:
– Proactively monitor free space availability per TPVV and CPG
– Proactively monitor consumption rates for TPVVs and CPGs
– Proactively monitor used TPVV capacity and compare to licensed thin provisioning capacity
– Proactively monitor physical capacity thresholds for each disk type and for the entire array
– Ensure adequate purchasing and installation of additional physical disk capacity buffer and thin provisioning
license upgrades in a timely manner
– Customer should nominate an escalation contact who will have proper authority to drive the customer
responsibilities outlined in this document if the nominated storage administrator(s) fail to carry out their
responsibilities.
In the event that the customer implements all of the recommendations indicated above and has a network connection
with HP 3PAR Central via the Service Processor integrated in the array, the customer can request to receive thin
provisioning and other alerts forwarded to HP 3PAR Central also by mail to a specified email address or via phone. The
customer retains responsibility for managing thin provisioning capacity and CPGs, HP is not responsible for any failure
when thresholds are met or exceeded.
11
Tracking volume space usage
TPVVs consume user space, admin space, and possibly snapshot space on the disk array. The following sections provide
the CLI commands needed to determine how much space of every type is being consumed within the array. The output of
these CLI commands show the Reserved and the Raw Reserved space. The Reserved space is what is offered by
the array as usable space to the host. This value is also shown in the HP 3PAR InForm Management Console in the
Reserved User Size column for a TPVV and in the pie chart for the Logical option in the Summary tab for the
virtual volume details screen. The Raw Reserved space is calculated from the Reserved space by multiplying the
latter by its RAID overhead factor. For example, this factor is 2 for RAID 1 and 8/7 for RAID 5 with a SetSize equal to 8.
The InForm Management Console shows the Raw Reserved space in the pie chart for the Raw option in the Summary
tab for the virtual volume details. In chargeback models, most IT Departments bill their customers on the amounts of
Raw Reserved space consumed.
TPVVs
Use the showvv –r –p -prov tpvv command to see how much admin, user and snapshot space is used by each
TPVV. Columns 5 to 10 in the output of the command show these different types of space in their Reserved and Raw
Reserved amounts with totals in columns 11 and 12. Adding the user space and snap space CPG names to this output
for chargeback identification is possible using this CLI command:
showvv -showcols Id,Name,Prov,Type,UsrCPG,SnpCPG,Adm_RawRsvd_MB,
Adm_Rsvd_MB,Snp_RawRsvd_MB,Snp_Rsvd_MB,Usr_RawRsvd_MB,
Usr_Rsvd_MB,Tot_RawRsvd_MB,Tot_Rsvd_MB,VSize_MB
CPGs
Space in use on the array can be tracked by CPG. The showcpg –r command shows the user, snapshot, and admin
space in Used and Raw Used amounts. You can work out the unallocated space within the CPGs by subtracting the
used space from the Totals listed.
System space
Not all space on the physical disks can be used for storing customer data. A small portion of the space on the array is
dedicated to volumes with an administrative function. These volumes are described below.
At array initialization, the InForm OS creates a fully provisioned volume named admin that is used to store system
administrative data such as the System Event Log. This volume has 10 GB of usable space in RAID 1 with SetSize=2,
meaning the volume consumes 10*2=20 GB of raw space on the array. Details about the admin volume can be found in
the InForm Management Console (IMC) or with the CLI command showvv -r –p –baseid 0. From the IMC or the
output of showld –d –vv admin we see this volume does not belong to a CPG, it is created directly on the physical
disks. The 20 GB raw space of the admin volume is created on equally sized LDs, one on each controller node in the
system. On a four-node system we would have one LD with 5120 MB (5 GB) of raw space on every node making up the
admin volume.
The output of showld shows a few LDs starting with the name pdsld. These are the Preserved Data Space Logical
Disks (PDSLDs), created in RAID 1 with SetSize=3 which creates two copies of the data. They are created by the
InForm OS during initial system setup, do not belong to a CPG and do not show up as a virtual volume in the IMC or in the
output of showvv. Preserved Data is the data moved from the system’s cache memory to the PDSLD space when
multiple disk write failures occur. The total capacity of the PDSLDs is equal to the sum of all data cache memory located
in the controller nodes of the system.
Finally, the array deploys a number of logging LDs that make up the logging disks. These disks, starting with the name
log in the output of showld, are created during initial system setup, do not belong to a CPG and do not show up as a
virtual volume in the IMC or in the output of showvv. They store data temporarily during physical disk failures and disk
replacement procedures. Every node in the array has one logging LD comprised of 60 GB of usable space. The protection
level for the logging LDs is RAID 1 with SetSize=2 meaning the raw space per logging LD is 120 GB. The command
showld -d will show the usable and raw space used for these LDs.
12
Total used space
The showsys –d command gives the total raw space in use on the system on the line starting with “allocated
capacity”. This number is the sum of the raw space used by VVs, the space used by the admin volume, the PDSLDs, the
logging LDs, and by the spare chunklets. You can obtain this individual information from the output of the
showpd –space command, the last line in the output with the totals contains the numbers to use. The value in the
Volume column of the output is the raw space in use by the admin volume, the PDSLDs, the logging LDs, and the
volumes created by the customer. The individual sizes for the admin volume, the PDSLDs and the logging LDs can be
obtained from the output of showld; note that the values shown are for the usable space in use, not for the raw
space. The command showvv –r shows the raw space in use by the VVs in its 9th column. The Spare column of
showpd –space gives the space in use by the spare chunklets. All of this information can also be determined from the
Space Reports using the optional HP 3PAR System Reporter Software, which is licensed separately.
13
Usage reporting and trend analysis
The CLI command showcpg –hist <CPG> gives a daily account of CPG usage split into user, snapshot, and admin
space. The command showspace -cpg <CPG> -hist also shows this information. Additionally, the optional
HP 3PAR System Reporter Software has the ability to track TPVV usage for comprehensive usage and trend analysis.
This “thinning” of volumes enables data centers to meet green IT targets, eliminate wasted space, and increase
utilization rates. Because the fat-to-thin conversion mechanism is built into the array hardware, volume conversions
take place inline and at wire speeds, while preserving service levels, and without causing disruption to production
workloads when using host-based logical volume manager migration tools. The use of HP Thin Conversion Software is
supported across all HP 3PAR Storage Systems and requires that an HP 3PAR Thin Provisioning license is present on
the destination array. The zero-detect capability, required for thin conversion, has to be enabled on every
destination TPVV.
When combined with Thin Provisioning, Thin Conversion is so powerful that HP even guarantees the ability to reduce
storage capacity requirements by at least 50 percent with the Get Thin Guarantee 2. With this program, customers
deploying HP 3PAR Utility Storage as part of a storage technology refresh are guaranteed to reduce storage capacity
requirements by 50 percent or more when using HP 3PAR Thin Conversion Software to non-disruptively convert
legacy storage from fully allocated, traditional volumes to new thin volumes on the HP 3PAR Storage System. More
information on this Get Thin Guarantee program is available at hp.com/storage/getthin.
• HP 3PAR Thin Persistence Software. HP 3PAR Thin Persistence Software augments the benefits of HP 3PAR Thin
Provisioning Software and HP 3PAR Thin Conversion Software by ensuring that thin volume arrays stay as lean
and efficient as possible. To do this, HP 3PAR Thin Persistence Software leverages unique capabilities built into
the HP 3PAR ASICs within the controller nodes to power the ongoing, inline “thinning” of volumes on any model HP
3PAR array, also known as thin reclamation of allocated but unused capacity. Thin Persistence has a dependency on
the presence of the HP 3PAR Thin Conversion Software license. Without this license, large chunks of zeros will still be
written to the disks. A Thin Persistence license is also needed for reclamation of space when using Symantec’s Veritas
Storage Foundation, VMware’s vSphere, Oracle’s ASRU and others.
• HP 3PAR Thin Copy Reclamation. This license ensures the reclamation of unused space resulting from the
deletion of snapshots associated with virtual copy, full copy, and remote copy volumes. The HP 3PAR Thin Copy
Reclamation feature keeps your storage lean and efficient. Thin Copy Reclamation has a dependency on the presence
of the Thin Provisioning license.
2
The above is intended to highlight certain aspects of our Get Thin Guarantee and does not contain the full terms, conditions, limitations, definitions, and
other provisions (“Terms”) of the Get Thin Guarantee. The Terms shall be contained in a written Get Thin Guarantee Terms and Conditions which shall
take precedence over the above. Qualification for our Get Thin Guarantee is subject to your acceptance of a Get Thin Guarantee Terms and Conditions and
your satisfaction of those Terms.
14
Reclaiming unused space
When application data that reside on a thin provisioned volume is deleted by the host OS, the host system no longer
shows this space as allocated but its physical capacity will remain allocated on the HP 3PAR array. This allocated but
unused space is not available to the storage administrator when creating new volumes on the array. In other words:
deleting data on the host does not automatically result in reclamation of capacity on the array. With a lot of file
creations and deletions over time, the free space on the array may become depleted while in reality there is a great deal
of unused space on the system.
The storage administrator needs to reclaim that deleted space. The HP 3PAR Utility Storage platform provides tools to
reclaim this space under various conditions, as described below.
15
These changes result in the creation of allocated but unused disk space that can build up over time to account for a
considerable part of the total storage capacity available. This space is available for reuse but, in the absence of a control
communication protocol between the application, the file system and the block storage, the storage array is unable to
distinguish between capacity associated with deleted data and valid data. Therefore, the unused capacity remains
allocated within the storage volume(s) on the storage array. The end result is that the storage utilization on the array
eventually falls below desirable levels.
To solve this problem, HP 3PAR and Oracle have partnered to create the Oracle ASM Storage Reclamation Utility or ASRU
tool. This tool reclaims space from deleted blocks inside an Oracle database created on an ASM (Automatic Storage
Management) environment. The ASRU tool is a script that compacts the selected ASM disks, writes blocks of zeros to the
unallocated space on the disks and resizes them, all with a single command. The zeros written by the script are
intercepted by the HP 3PAR ASIC in each controller node so that each contiguous block of 16 KB of zeros is declared
unused to the array. These operations take place online and in a non-disruptive fashion. The use of ASRU is supported
across all models of HP 3PAR Storage Systems and requires that an HP 3PAR Thin Persistence Software license be
present on the array.
Databases
Some databases initialize their storage space by writing a pattern into the database space before it is used. In this case
Thin Provisioning will allocate the same physical space as a traditional or “fat” virtual volume. To make sure that the
value of thin provisioning is realized in database environments, it is important that the database space is initialized
without any pattern written to its thin provisioned volume. Also, keep the initial database tablespace marginally larger
than the current data size and create it with the autoextend option. Once configured with autoextend, the database
handles tablespace growth in small increments over time automatically and this is thin friendly.
16
Microsoft Exchange
With the email explosion happening, mailbox setups tend to grow rather quickly in used space. Thin provisioning handles
this problem by offering a large thin volume to the mail server software while only reserving storage capacity when data
is actually stored in a user’s mailbox.
Microsoft Exchange can be installed on thin provisioned volumes on a 3PAR array. When mailboxes are removed or
migrated, the reclamation of space is not trivial. Shrinking the mailbox database to recover the unused space is only
possible offline. The other option is to create a new mailbox database, copy all mailboxes into it, and delete the old
database. In both cases, the freed space will be reclaimed using the HP 3PAR ASIC once it is written with zeros. HP 3PAR
Thin Copy Reclamation will reclaim unused space from virtual copy, full copy, and remote copy snapshots of the
Exchange files.
3
At file system creation time, the capacity of the pool is consumed up to 100 percent of the thin volume capacity.
4
At file system creation time, the capacity of the pool is consumed up to 30 percent of the thin volume capacity.
5
The ZFS “zpool scrub” command is not recommended because it will force the volume to fully allocate.
VMware vSphere
VMware vSphere has been thin-provisioning aware since its version 3.0. Since the HP 3PAR array also supports thin
provisioning, the question often arises on which level to implement thin provisioning when using an HP 3PAR array as
the storage for VMware’s vSphere. HP recommends to implement it on both levels. However, there is one caveat: if
deploying thin provisioning simultaneously on VMware and on the HP 3PAR array, one has to set up, maintain, and
monitor two sets of warnings, alerts, and limits. This requires an agile and knowledgeable IT staff, but the benefits of
this strategy are beyond doubt.
17
HP recommends the use of “large” LUNs (1–2 TB) as datastores, created on thin provisioned volumes on the HP 3PAR
array. With HP 3PAR Thin Provisioning Software, one can allocate as much logical capacity to a VMFS volume as is
needed over the lifetime of that volume without actually dedicating any physical capacity upfront. Physical capacity is
allocated seamless on an as-needed basis and is consumed only when vSphere writes to the thin provisioned virtual
volume. This means that there is no wasted capacity in the LUN that is presented to the VMware host. Oversubscription
on the sizes of the VMDK files inside the datastore is possible.
When creating VMs, there are a number of options at creation time of the VMDK files, not all of which are “thin friendly”.
Since VMware vSphere 3.5, VMs are created by default with the “Thick Provision Lazy Zeroed” option which is
thin-friendly. With this option, when a new VM is created, the full size of the VMDK is not immediately zeroed. The ESX
server returns zeros when asked to read from unwritten areas of the VMDK but does not actually write the zeros to disk.
For performance-intensive environments, VMware recommends using “Thick Provision Eager Zeroed” (EZT) virtual disks.
EZT disks have the smallest overhead at runtime but require zeros to be written across all of the capacity of the VMDK at
the time of creation. On traditional arrays, this VMDK format would negate all the benefits of thinly provisioned LUNs
since all of the physical storage is allocated when the volume is zero-filled during creation. However, HP 3PAR Thin
Persistence Software allows clients to retain thin provisioning benefits when using EZT VMDKs without sacrificing any of
the performance benefits offered by this VMDK option. In this case, Thin Persistence ensures that, when a new fully
formatted EZT volume is created, the entire volume is not allocated from physical storage since all zeros that have been
written to the EZT VMDK were intercepted by the 3PAR ASIC.
When files are deleted inside a VM, HP 3PAR Thin Persistence Software also keeps the associated VMDK thin. Using
standard file system tools (sdelete in Microsoft Windows, dd in UNIX/Linux) to write zeros across deleted and
non-used space in a VM’s file system, the zeros are autonomically detected by the HP 3PAR ASIC and the disk space they
were consuming is freed up and returned to the thin provisioned volume.
Another benefit of the presence of an HP 3PAR Thin Persistence license happens when deleting a VM. With vSphere 5.0
and InForm OS version 3.1.1, the space reclamation takes place automatically upon deletion. With vSphere 5.0 and
Inform OS 2.3.1 MU2 and higher MU versions the same result is obtained when the HP 3PAR Management Software
Plug-In for VMware VAAI 2.2 is installed in vSphere. With older VMware solutions, a similar benefit can be achieved by
writing zeros to the VMDK and have the HP 3PAR zero detection ASIC release the storage. The HP 3PAR Management
Software Plug-In for VMware VAAI 1.1 needs to be installed in vSphere for this.
18
Storage Federation and Peer Motion
HP 3PAR Peer Motion Software enables customers to migrate storage volumes between any HP 3PAR Storage System
online, non-disruptively, and without complex planning or dependency on extra tools. HP Peer Motion leverages the
HP ASIC to power the simple and rapid inline conversion of legacy volumes on source arrays to more efficient,
high-utilization thin volumes on the destination HP 3PAR Storage System. The source array must be running InForm OS
2.2.4 or higher, the destination system has to run 3.1.1 or higher. An HP 3PAR Peer Motion license and an HP 3PAR Thin
Provisioning Software license are required on the destination system.
Licensing
The HP 3PAR Thin Provisioning Software license is needed to create TPVVs. Thin provisioning is licensed based on the
number of terabytes of raw capacity written to thin provisioned volumes. Space used by snapshots is also included in
this figure. Because of the “raw capacity written” metric, no fraction of the license is consumed by creating thin
provisioned volumes and not writing to them. The rate of consumption of a thin provisioning license will depend on the
RAID level of the TPVVs. Assume the array has a thin provisioning license for 1 TB and a 500 GB TPVV in a RAID 1 was
created. When the user writes 300 GB of data to it, the thin provisioning license is consumed for 300 GB * 2 = 600 GB.
The multiplier of 2 originates from the RAID 1 overhead factor. If the TPVV was created in a RAID 5 (3+1) CPG,
300 * 4/3 = 400 GB of space would have been consumed from the thin provisioning license.
When doing a remote copy of a thin volume, the destination array needs a thin provisioning license as well. Otherwise
the copy of a TPVV volume on the source array will create a fat volume at the target.
To simplify licensing, HP offers the HP 3PAR Thin Suite license. This license combines HP 3PAR Thin Provisioning,
Thin Conversion, and Thin Persistence Software into a single suite. This license is available for F- and T-Class models as
well as for the P10000 Storage Systems.
Conclusion
HP 3PAR Utility Storage is the only platform that offers a comprehensive thin strategy that not only allows storage to
start thin, but to get thin and stay thin. HP 3PAR Thin Provisioning Software is a simple yet powerful tool for improving
the efficiency of storage. Following the best practices outlined in this paper will allow IT staff to maximize the benefit of
HP 3PAR Thin Provisioning and do more with less. To supplement the dramatic savings of thin provisioning, HP 3PAR
Utility Storage features a unique HP 3PAR ASIC with thin capabilities built in and a range of software offerings that can
save enterprises 50 percent or more on the cost of a storage technology refresh.
Together, HP 3PAR Thin Provisioning and the accompanying 3PAR thin technologies not only minimize upfront and
ongoing storage costs, but also the cost of housing, powering, cooling, and managing storage so that enterprises can
shift resources away from operations and apply them to innovation.
Learn more
To know more about HP 3PAR arrays and HP 3PAR Thin Provisioning Software, visit hp.com/go/3PAR
Get connected
hp.com/go/getconnected
Current HP driver, support, and security alerts
delivered directly to your desktop
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only
warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein
should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
Microsoft and Windows are U.S. registered trademarks of Microsoft Corporation. Oracle is a registered trademark of Oracle and/or its affiliates.
UNIX is a registered trademark of The Open Group.