Professional Documents
Culture Documents
Volume Controller
Best Practices
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Document revision
Date Revision Comments
10/14/2011 A Initial Draft
11/21/2011 B Fixed typo with DP/DIR.
THIS WHITEPAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS
AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED AS IS, WITHOUT EXPRESS OR IMPLIED
WARRANTIES OF ANY KIND.
© 2011 Dell Inc. All rights reserved. Reproduction of this material in any manner whatsoever without
the express written permission of Dell Inc. is strictly forbidden. For more information, contact Dell.
Dell, the DELL logo, the DELL badge, and Compellentare trademarks of Dell Inc. Other trademarks and
trade names may be used in this document to refer to either the entities claiming the marks and names
or their products. Dell Inc. disclaims any proprietary interest in trademarks and trade names other than
its own.
Page 2
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Contents
Document revision ...................................................................................................... 2
General syntax .......................................................................................................... 5
Conventions .............................................................................................................. 5
Preface ................................................................................................................... 6
Audience ................................................................................................................. 6
Purpose ................................................................................................................... 6
Customer support ....................................................................................................... 6
Introduction ............................................................................................................. 7
Important Notes......................................................................................................... 7
Hardware/Software Versions ......................................................................................... 7
Terms ..................................................................................................................... 8
Configuring the Fabric ................................................................................................. 9
Configuring the Dell Compellent SAN Recommendations ...................................................... 10
Server Object Definitions for SVC ................................................................................. 11
Presenting Volumes to the SVC .................................................................................... 11
Solid-State Drive (SSD) usage with the SVC...................................................................... 11
Quorum Disks .......................................................................................................... 11
Import Volume to SVC using Image Mode ........................................................................ 12
Using SVC Volume Mirror Feature with Multiple Storage Center Systems ................................. 12
IBM SAN Volume Controller Recommendations .................................................................. 12
Mdisk Pools ............................................................................................................ 12
Host Connection to an SVC using a Dell Compellent Storage Center ....................................... 13
VDisk Setup using Storage Center MDisks ........................................................................ 13
Dell Compellent SAN Features with the IBM SVC ................................................................ 13
Data Progression ...................................................................................................... 14
Data Instant Replay .................................................................................................. 14
Thin Provisioning ..................................................................................................... 14
LUN Expansion......................................................................................................... 14
Copy/Mirror/Migrate ................................................................................................ 18
Volume Import ........................................................................................................ 18
Conclusion ............................................................................................................. 18
Tables
Table 1. Document syntax ........................................................................................... 5
Page 3
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Figures
No table of figures entries found.
Page 4
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
General syntax
Conventions
Timesavers are tips specifically designed to save time or reduce the number of steps.
Caution indicates the potential for risk including system or data damage.
Warning indicates that failure to follow directions could result in bodily harm.
Page 5
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Preface
Audience
The audience for this document is assumed to be mid-level and greater storage administrators who are
responsible for the management of IBM SAN Volume Controller systems that use Dell Compellent SANs
for back-end storage controller(s).
Purpose
This document provides an overview of the Best Practices advised by Dell Compellent when using
Storage Center v5.4.x and v5.5.x with IBM SAN Volume Controller (SVC) v6.2.
Customer support
Dell Compellent provides live support 1-866-EZSTORE (866.397.8673), 24 hours a day, 7 days a week,
365 days a year. For additional support, email Dell Compellent at support@compellent.com. Dell
Compellent responds to emails during normal business hours.
Page 6
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Introduction
This document contains best practices and recommendations when using the Dell Compellent Storage
Center (SC) SAN as backend storage for the IBM SAN Volume Controller (SVC). The intended audience
of this document is system administrators and/or storage administrators responsible for the
configuration and deployment of storage using the Dell Compellent SAN via the IBM SAN Volume
Controller. This document assumes the Storage Center SAN and SAN Volume Controller are already
configured and functional in the reader’s environment. This document does not cover the setup of the
Storage Center or SAN Volume Controller, and assumes the reader is familiar with the setup of each
platform respectively. This document is not intended to replace or take precedence over any IBM
resources or Dell Compellent product documents.
The IBM SAN Volume Controller is a storage virtualization platform that enables a single source for control of
storage resources to help support enhanced business application availability and improved resource
utilization. From a single management interface, the storage admin can deploy and manage storage
capacity to end-system hosts utilizing multiple backend storage platforms. The IBM SVC consists of at least
two nodes that comprise a clustered I/O group, and can scale up to four 2-node I/O group pairs.
For the Dell Compellent Storage Center to be utilized as storage by the SVC, the Storage Center must be
configured to present Volumes to the storage node clusters as if they were servers. The SVC then virtualizes
the storage for use by servers configured to connect to the SVC.
Important Notes
Compellent provides level 2 support for a Storage Center that is used with an IBM SVC. Therefore,
any issues with storage presentation to a server should generate a support call to IBM first. If the
issue turns out to involve the Storage Center, IBM will then involve Dell Compellent.
The customer must follow IBM guidelines and requirements for cabling and zoning the SVC. These
are spelled out in the IBM System Storage SAN Volume Controller Software Installation and
Configuration Guide and SAN Volume Controller Best Practices and Performance Guidelines.
These and other SVC documents can be obtained in PDF form for free from IBM by going to the IBM
support site for the SVC (www.ibm.com/storage/support/2145) under “Documentation” selection.
Please check the Dell Compellent Knowledge Center and review any Copilot Services Technical
Alerts (CSTA) for the IBM SVC and/or your specific Operating System BEFORE attempting any
configuration additions or changes.
Hardware/Software Versions
The utilization of the IBM SVC in front of a Dell Compellent Storage Center has been certified to work
by IBM on the following code releases:
Dell Compellent Storage Center v5.4.x and higher requires SVC v6.2.0.3 and higher.
Dell Compellent Storage Center v5.2 and v5.3 is supported on SVC v5.1.0.6 and higher.
In addition Dell Compellent has tested the above versions using Storage Center SAN models SC030 and
SC040 in both Legacy Port Mode and Virtual Port Mode (NPIV). The information in this paper is derived
from using the above hardware and software versions and configurations.
Page 7
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Terms
General
LUN – Logical Unit Number, a generic term for storage presented to a server via Fibre Channel.
Quorum Disk – Tie breaking device used when there are system clustered together.
IBM
Image Mode – any incoming LUN that is presented directly to a server without using any of the
SVC’s management features.
Managed Mode – any incoming LUN that is utilized inside an MDisk group that is not presented
directly to a server.
MDisk – “Managed Disk”, an incoming LUN presented by a storage system (e.g., Storage Center)
to the SVC.
VDisk – “Virtual Disk”, an outgoing LUN presented by an SVC to a host connected to an SVC.
Compellent
Front End Primaries – Fibre Channel port intended for active use with systems.
Front End Reserves – Fibre Channel port intended for standby use with systems.
NPIV - N_Port ID Virtualization. When this is enabled on the Dell Compellent Storage Center
SAN and connected Fibre Channel switches, all front-end Fibre Channel ports are in an active
state and utilized for I/O between the SAN and IBM SVC.
Volume – Logical volume created on a Dell Compellent Storage Center for use by a server.
Page 8
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
In order to insure proper discovery of the Dell Compellent SAN as a backend storage controller as well
as providing for failover redundancy, it is necessary to configure the fabric following the
recommendations below. There will need to be several fabric zones configured, and the exact zoning
will vary depending on the port mode in use with Storage Center. At a high-level the zone topology
includes an IBM SVC zone, a Storage Center zone, a “Disk Zone” which enables the connectivity
between the SVC and Storage Center, and a “Host Zone” which enables the connectivity between the
SVC and the host system(s).
There should be a fabric zone that contains just the IBM SVC fibre channel ports. There is no
requirement for hard or soft zoning, so either mode is acceptable.
For use with the SVC, Dell Compellent recommends a similar zoning approach for the Dell Compellent
Storage Center SAN. A zone should be configured that includes just the Storage Center front-end ports.
This zone can use either hard or soft zoning. In addition, Disk Zone between SVC and Storage Center
should not contain any other backend storage controllers.
SVC Port Zone Port Contains only the IBM SVC cluster ports
SVC WWN Zone WWN Contains the WWNs for the SVC cluster ports
The Dell Compellent Storage Center SAN supports two modes of front-end port configuration, legacy
and virtual (NPIV). Please refer to the section below titled Configuring the Dell Compellent SAN for
further information on these modes.
When zoning the Dell Compellent SAN to the IBM SVC a WWN zoning policy should be utilized. There
should be a zone in each fabric that contains the WWNs of the IBM SVC cluster in that fabric. When the
Page 9
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Storage Center is configured in Legacy port mode, the WWNs for the front-end primary ports should be
put into a zone. The WWNs for the front-end reserve ports should be put into a separate zone. The
zone containing the front-end primary WWNs should be zoned to the WWNs for the IBM SVC cluster to
complete the Disk Zone connectivity. Table 2 below provides some further information on this
configuration.
Storage Center – Frontend Contains only the WWNs for the front-end
WWN
Primary (FEP) primary Storage Center ports (Legacy mode)
Storage Center – Frontend Contains only the WWNs for the front-end
WWN
Reserve (FER) reserve Storage Center ports (Legacy mode)
SVC WWN Zone WWN Contains the WWNs for the SVC cluster ports
Storage Center FEP WWNs to Contains the WWNs for the front-end primary
WWN
SVC WWNs (legacy) ports and SVC cluster
When utilizing the Virtual Port Mode configuration of the Dell Compellent Storage Center SAN, the
zoning configuration is similar to the Legacy Port Mode above. However, the NPIV WWNs should be
zoned to the IBM SVC WWNs to complete the Disk Zone connectivity. Port zoning is not supported and
will result in controller discovery confusion. Also, please refer to the IBM SVC documentation regarding
NPIV support as well as the switch vendor regarding NPIV support.
Storage Center – Physical Contains only the WWNs for the front-end
WWN
Port WWN ports physical WWNs
Storage Center – Virtual Contains only the WWNs for the front-end
WWN
(NPIV) Port WWN ports virtual WWNs (NPIV)
SVC WWN Zone WWN Contains the WWNs for the SVC cluster ports
Storage Center NPIV WWNs Contains the WWNs for the front-end primary
WWN
to SVC WWNs (legacy) ports and SVC cluster
Page 10
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
proper zoning scheme to use for each of these port mode types. Please refer to the Dell Compellent
Storage Center User Guide or System Setup Guide for further details.
Legacy Port Mode consists of a configuration in which there is a primary (active) port that handles I/O
and then a corresponding reserve (passive) port on the other controller. This relationship is configured
by adding these ports to the same Fault Domain, which activates and assumes the WWN of the primary
port on the reserve port if the primary port goes offline.
Virtual Port Mode consists of a configuration in which all front-end ports are active and the WWN is
virtualized. This NPIV WWN can be associated with any physical port in the associated fault domain.
This is setup during the Storage Center configuration, and is accessed via the Storage Center
management GUI using the path: Storage Management System Setup Configure Local Ports
You can configure your environment so that other hosts can communicate with the Dell Compellent SAN
for storage requirements that fall outside of the SVC. You can also configure hosts that communicate
with the SVC directly for storage to also communicate directly with the Storage Center SAN for storage
as well. However, the SVC requirements for host connectivity should be considered and neither of
these scenarios should be configured without careful planning and suitable documentation
At this time volumes greater than 2 TB are not supported by SVC when using the Dell
Compellent Storage Center as backend storage. Volumes greater than 2TB will appear as
2TB when presented to the SVC. This is a limitation by the SVC and not Storage Center.
Dell Compellent is working with IBM to certify Storage Center with >2TB volumes presented
to SVC.
Quorum Disks
Since Storage Center is certified to be used with the SVC, you can use Storage Center LUNs as quorum
disks. IBM recommends at least three quorum disks from different arrays for each SVC cluster.
Page 11
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
This process has not been tested with boot-from-SAN volumes, thus is not currently
supported.
Using SVC Volume Mirror Feature with Multiple Storage Center Systems
When using the SVC Volume Mirror feature, assign one half of each volume mirror to Storage Pool(s)
mdisks associated with different backend Dell Compellent Storage Center systems. By doing this, if one
Storage Center cluster is taken offline for maintenance or a site failure occurs for that system, the SVC
volume will remain online and available for I/O. This result in a higher availability of the volume to
the host it is mapped to from SVC.
For example, an installation has two Storage Center SANs connected to a single SVC cluster; each
Storage Center is presenting a series of mdisks in pools associated with the individual Storage Center
(e.g. mdisk1 is in pool sc09-manage-mode on SVC which is storage presented from Storage Center sc1,
mdisk2 is in pool sc11-manage-mode on SVC which is storage presented from Storage Center sc2). A
volume (voltest1) is created using the SVC management GUI with mirrored properties. The primary
pool for voltest1 is sc09-manage-mode and the secondary pool for voltest1 is sc11-manage-mode. If
sc1 were to go offline, the voltest1 volume would remain available to the host as the other half of the
mirror to the volume is still available. When the sc1 system is returned to an online state to SVC, then
SVC will initiate the process to re-sync the volume’s mirror.
Mdisk Pools
It is recommended that volumes presented to SVC from the same Dell Compellent SAN be placed in the
same mdisk group. These should be separated out further based on whether the mdisk(s) will be used
as “managed” or “image” mode mdisks. For example, if mdisk1, mdisk2 and mdisk3 represented
“managed” mdisks presented from Storage Center alpha, these mdisks should be placed in the same
mdisk group (pool) for logical management of the mdisks. If mdisk4 is an image mode mdisk presented
from Storage Center alpha, it would be placed in a different pool. If there is another Storage Center
presenting volumes to SVC, for example named beta, any mdisks from that Storage Center should be
put into a different pool from alpha’s mdisks.
Page 12
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Note 1: When presenting this “image” mode LUN to your host, Dell Compellent recommends
turning off SVC based caching and striping.
Note 2: Thin provision reclamation (TPR) is not supported. The SCSI commands to initiate a
TPR event will not pass through the SVC to the Storage Center.
Note 3: Online LUN expansion will not work under any circumstance. If you have an “image”
mode MDisk and wish to expand it, you have to remove the MDisk from the SVC, expand it and
then re-present the LUN to the SVC. If you think you may ever need to do this, then Dell
Compellent recommends putting each of your “image” mode LUNs in its own MDisk group.
Note 4: LUN Expansion using SVC management GUI is possible, when the vdisk size is within the
total allocated size of the mdisk presented from Storage Center.
Page 13
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Data Progression
A core component of the Dell Compellent SAN platform is the Tiered Storage capabilities. This process
is referred to as Data Progression. When using the Dell Compellent SAN as a backend controller to the
IBM SVC, this feature is fully functional. This process occurs at the block-level by the Storage Center
OS and will function regardless of the volume mode on the SVC.
However, when volumes are used in image mode, Data Instant Replay works. Follow existing Dell
Compellent recommended best practices for setting up DIR profiles. When creating a View volume
based on a DIR, import the view volume as an image mode mdisk. This will preserve the data from the
DIR. The View volume can be mapped directly to the host or via SVC and the data on that DIR is
available.
Thin Provisioning
Thin provisioning works with both managed and image mode mdisks. However, Thin Provision
Reclamation does not work. This is due to the SCSI TPR command not being sent all the way back
through the SCSi stack to the Dell Compellent Storage Center. The Dell Compellent Storage Center SAN
uses Thin Provisioning by default, and this will function as expected as with native volume presentation
from Storage Center. In addition, SVC supports Thin Provisioning of managed volumes and this also
works when using the Dell Compellent SAN as the backend storage.
LUN Expansion
There are multiple points in which a LUN expansion can be performed so it is important to understand
where in the different platform interactions LUN expansion will and will not work. When a volume
from a Dell Compellent SAN is presented to SVC and is functioning in a managed mode capacity, LUN
expansion at the Storage Center layer will not work.
However, LUN expansion from the SVC layer will work with volumes that are managed by SVC and
presented from Storage Center. For example, if a 2TB volume is created on the Storage Center,
mapped to SVC and created as a managed mdisk, then a 100GB volume (vdisk) is created from that
mdisk and presented to a host, that vdisk can be expanded. The vdisk is expanded first from within
the SVC Management GUI, it is then necessary to perform host OS operations to expand the device and
file system. Using a Red Hat Enterprise Linux 6.0 system, the high-level process would be as follows:
1. Expand the 100GB vdisk using the SVC management GUI. For example a 100GB vdisk was
expanded to 125GB. Below is the size before the expansion process was started:
Page 14
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
/dev/mapper/svc-data-vol1
99G 99G 0 100% /svc-data-vol1
2. Perform a rescan of the SCSI device(s). The multipath –ll command can be used to determine
the physical paths:
{root@brock} {~} # for a in sdb sdd sdj sdl sdf sdh sdn sdp
<<<269>>> do
<<<269>>> echo 1 > /sys/block/${a}/device/rescan
<<<269>>> done
3. Re-load the multipathd service to trigger device-mapper-multipath to see the new size of the
devices.
Page 15
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
It is possible to expand a Storage Center volume and have this new size recognized by the IBM SVC
when it is used in image mode on the SVC. An example of this process is highlighted below when used
with a Red Hat Enterprise Linux 6.0 host. In the example below an image mode vdisk is expanded from
100GB to 150GB.
1. If mounted on the host as a file system, unmount on the host and flush the multipath maps.
2. From the SVC GUI, remove the host mapping and delete the volume.
3. Remove the devices from the Linux host by issuing the delete flag to each of the physical
device paths:
Page 16
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
{root@brock} {~} # for a in sds sdt sdw sdx sdq sdr sdu sdv; do echo 1 >
/sys/block/${a}/device/rescan; done
4. From the Storage Center GUI, remove the device mapping to SVC and then expand the volume
to the desired size. Remap the volume to the SVC.
5. Use the SVC management GUI to re-discover the volume and import as an image mode mdisk.
6. Map the image mode vdisk to the Linux host.
7. On the linux host, rescan for SCSI devices.
8. Update the /etc/multipath.conf file with the SCSI ID for the resized volume.
{root@brock} {~} # scsi_id -u -g /dev/sds
3600507680181053ad800000000000052
9. Reload the multipathd service. A multipathd –ll will show the new size of the volume
10. Re-mount the file system, run resize2fs to see the new size, and then you can now use the
volume with the expanded space available.
Page 17
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Copy/Mirror/Migrate
Dell Compellent Storage Center Copy/Mirror/Migrate functions will not work if a volume is being
managed by the SVC. If these features are required, then the volume(s) should be imported to the IBM
SVC as image mode mdisks. As image mode mdisks, the blocks are managed by the backend storage
system. This will allow for the ability to utilize the Dell Compellent advanced features.
For managed mode volumes that require replication type protection, it is necessary to
use the IBM SVC Flash Copy services to accomplish replication type services. Refer to
the IBM documentation for more information regarding Flash Copy Services located at
http://publib.boulder.ibm.com/infocenter/svc/ic/index.jsp
Volume Import
Also note that if volumes were previously presented to hosts from a Dell Compellent SAN and they are
now to be presented through the SVC to hosts, it is possible to preserve the data. Simply un-map the
volumes from the host, then map them to the IBM SVC Server Cluster folder and import the volume(s)
as image mode mdisk(s). Then, map these image mode mdisk(s) to the host and the data will remain
unaffected.
In addition, be cautious when importing these volumes to SVC. If these are mistakenly
configured as managed mdisk(s) then all data on the volume could be lost.
Conclusion
The Dell Compellent Storage Center SAN can be used to provide backend storage to the IBM SAN
Volume Controller platform. As a backend storage controller, the Dell Compellent Storage Center SAN
can provide core functionality to the IBM SVC. In addition, the Dell Compellent SAN can be used
alongside an IBM SVC providing storage to the SVC, and through the SVC to end-user host systems, as
well as providing storage directly to end-user host systems.
Page 18
Dell Compellent Storage Center and IBM SAN Volume Controller – Best Practices
Compellent does not recommend or endorse using the SVC in any way that may conflict with IBM’s
published requirements. If there are questions about usage that have not been addressed here,
reference the IBM documentation for standard practices.
Page 19