Professional Documents
Culture Documents
Administration Guide
P/N 300-011-720
REV A01
EMC Corporation
Corporate Headquarters:
Hopkinton, MA 01748-9103
1-508-435-1000
www.EMC.com
Copyright © 1993 - 2010 EMC Corporation. All rights reserved.
EMC believes the information in this publication is accurate as of its publication date. The information is subject to change
without notice.
THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” EMC CORPORATION MAKES NO
REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION,
AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR
PURPOSE.
Use, copying, and distribution of any EMC software described in this publication requires an applicable software license.
For the most up-to-date regulatory document for your product line, go to the Document/Whitepaper Library on EMC
Powerlink.
For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com.
All other trademarks used herein are the property of their respective owners.
2 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Contents
Preface
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 3
Contents
4 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
Contents
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 5
Contents
6 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
Contents
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 7
Contents
8 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
Contents
Appendix A Utilities
Explorer Add-ons .................................................................................................. 414
Understanding Explorer Add-ons functionality........................................ 414
Installing the Explorer Add-ons ................................................................... 414
Privileges required for the Explorer Add-ons ............................................ 416
Launching the Shell Xtensions Wizard........................................................ 416
Opening the Explorer Add-ons shortcut menu ......................................... 417
DXDiagnostics........................................................................................................ 419
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 9
Contents
Glossary
Index
10 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
Figures
Title Page
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 11
Figures
12 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
Figures
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 13
Figures
14 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
Tables
Title Page
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 15
Tables
16 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
Preface
As part of an effort to improve and enhance the performance and capabilities of its product
lines, EMC periodically releases revisions of its hardware and software. Therefore, some
functions described in this document may not be supported by all versions of the software or
hardware currently in use. For the most up-to-date information on product features, refer to
your product release notes.
If a product does not function properly or does not function as described in this document,
please contact your EMC representative.
Audience This document is part of the EMC DiskXtender for Windows documentation set, and
is intended for use by system administrators responsible for installing software and
maintaining the servers and clients on a network.
Readers of this document are expected to be familiar with the following topics:
◆ Microsoft Windows network administration
◆ Storage media and hardware device management
Conventions used in EMC uses the following conventions for special notices.
this document
Note: A note presents information that is important, but not hazard-related.
! CAUTION
A caution contains information essential to avoid data loss or damage to the system
or equipment.
! IMPORTANT
An important notice contains information essential to operation of the software.
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 17
Typographical conventions
EMC uses the following type style conventions in this document:
Normal Used in running (nonprocedural) text for:
• Names of interface elements (such as names of windows, dialog boxes, buttons,
fields, and menus)
• Names of resources, attributes, pools, Boolean expressions, buttons, DQL
statements, keywords, clauses, environment variables, functions, utilities
• URLs, pathnames, filenames, directory names, computer names, filenames, links,
groups, service keys, file systems, notifications
Bold Used in running (nonprocedural) text for:
• Names of commands, daemons, options, programs, processes, services,
applications, utilities, kernels, notifications, system call, man pages
Used in procedures for:
• Names of interface elements (such as names of windows, dialog boxes, buttons,
fields, and menus)
• What user specifically selects, clicks, presses, or types
Italic Used in all text (including procedures) for:
• Full titles of publications referenced in text
• Emphasis (for example a new term)
• Variables
Courier Used for:
• System output, such as an error message or script
• URLs, complete paths, filenames, prompts, and syntax when shown outside of
running text
Courier bold Used for:
• Specific user input (such as commands)
Courier italic Used in procedures for:
• Variables on command line
• User input variables
<> Angle brackets enclose parameter or variable values supplied by the user
[] Square brackets enclose optional values
| Vertical bar indicates alternate selections - the bar means “or”
{} Braces indicate content that you must specify (that is, x or y or z)
... Ellipses indicate nonessential information omitted from the example
Where to get help EMC support, product, and licensing information can be obtained as follows.
Product information- For documentation, release notes, software updates, or for
information about EMC products, licensing, and service, go to the EMC Powerlink
website (registration required) at:
http://Powerlink.EMC.com
Your comments Your suggestions will help us continue to improve the accuracy, organization, and
overall quality of the user publications. Please send your opinion of this document to:
SSGdocumentation@EMC.com
18 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
If you have issues, comments, or questions about specific information or procedures,
please include the title and, if available, the part number, the revision (for example,
A01), the page numbers, and any other details that will help us locate the subject you
are addressing.
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 19
20 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
1
Getting Started
Getting Started 21
Getting Started
22 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Getting Started
After these connections have been made, the Administrator displays information
relevant to each connected service. The items that appear in the tree view depend on
the DiskXtender configuration. You must create the extended drive, media folders,
media groups, and rules, and add media to the system before these items are listed.
24 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Getting Started
Advanced mode
The advanced mode is an option to display or hide advanced options and features
available in the user interface. You can enable the advanced mode from the Options
tab of the Service Properties dialog box.
When the advanced mode option is enabled, all the advanced features and options in
DiskXtender become available to the user, depending on the media services that are
configured. The advanced mode option is disabled by default, and should be enabled
only for advanced users.
To disable automatic refresh, open the Tree menu and select Auto Refresh to clear
the checkmark beside the command.
26 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Getting Started
To access the About dialog box, open the Help menu in the Administrator and select
About EMC DiskXtender Administrator.
Configuration When you open DiskXtender for the first time, the Initial Configuration Wizard helps
through the Initial you set up a media service, add a media folder, and set up a basic move rule and
Configuration migration. The Initial Configuration Wizard appears the first time you start
Wizard DiskXtender, and every time till you have configured a media service. You can use
the wizard to set up an EMC Centera or NAS media service.
If you have not yet set up a media service, you can access the Initial Configuration
Wizard from the Service menu > Quick Setup Wizard.
Note: The Initial Configuration Wizard is disabled for DiskXtender installations on a cluster.
The wizard does not pop up the first time the DiskXtender administrator window is opened on
a cluster node, nor can it be accessed from the Service menu.
28 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Getting Started
3. Identify or create the folders on the extended drive that will contain the files to
move to storage. These folders are called media folders in DiskXtender. A media
folder can be a subfolder on the extended drive, or you can manage all the files on
the extended drive by specifying the root of the drive as a media folder.
“Extended drive directory structure” on page 199 provides details on planning
for and creating media folders.
4. Configure file migration. In DiskXtender, the migration of a file is actually a copy.
When DiskXtender moves a file to storage, it is really copying the file data to
media and adding extended attribute information to the file on the drive. The file
is then managed by DiskXtender, and the data resides both on the extended drive
and on the media.
To enable file migration, specify the criteria that files must meet before
DiskXtender migrates them. You also must specify the media to which the files
should be moved. Details on the available options for file migration are provided
in Chapter 8, “File Migration.”
5. Configure file purging. When DiskXtender purges a file, it removes the file data
from the extended drive and leaves behind a file tag on the extended drive.
Purging files frees space on the extended drive, while maintaining the appearance
that the files are still on the drive. A purged file is still accessible, and to a user
machine, appears to reside on the extended drive.
You can choose to automatically purge files from the extended drive either:
• Immediately after they are moved to storage
• When extended drive space is low
• Each night during the next background scan
Chapter 11, “Purging Files,” explains how to develop an appropriate purging
strategy and enable purging.
6. (Optional) If you are planning to index and search for files on the extended drive
by using the DiskXtender Search Module, then configure file indexing.
Guidelines for developing an indexing strategy and instructions for enabling
indexing are available in Chapter 10, “Indexing Files.”
7. (Optional) Enable the DiskXtender Recycler to protect against the accidental
deletion of files from the extended drive. If the DiskXtender Recycler is enabled
and a user accidentally deletes a file, you can restore the file to the extended
drive. The DiskXtender Recycler functions similarly to the Microsoft Windows
Recycle Bin, but only affects files on a drive extended by DiskXtender.
“Recovering files from the DiskXtender Recycler” on page 328 provides details on
the Recycler.
Note: The Recycler resides on the extended drive. As a result, the disk space used by the
Recycler factors into the total available disk space for the extended drive. If you enable the
Recycler, set a schedule for emptying the Recycler on a regular basis to help maintain an
adequate amount of space on the extended drive.
If you are protecting files with retention for a period of time, you may want to
automatically delete the files when the retention expires and the files are no
longer needed.
“Automatically deleting files” on page 322 provides instructions on creating
delete rules.
9. Develop a comprehensive backup and recovery strategy for the DiskXtender
system. Chapter 15, “Backup and Recovery,” provides guidance on the aspects of
the DiskXtender system that must be protected, as well as best practices for the
tools needed for backup and recovery.
After you configure DiskXtender, monitor the system regularly by using the tools
discussed in Chapter 14, “Monitoring the System.”
30 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
2
Connecting to EMC
Centera
You can migrate files on a DiskXtender extended drive to an EMC Centera cluster.
The following topics provide details on configuring and managing the environment:
◆ How DiskXtender works with EMC Centera ........................................................... 32
◆ Prerequisite steps to connect to EMC Centera .......................................................... 50
◆ Adding an EMC Centera media service .................................................................... 53
◆ Managing the lifecycle of EMC Centera media ........................................................ 56
◆ Expectations for files migrated to EMC Centera ...................................................... 63
◆ Adding custom metadata to files on EMC Centera ................................................. 65
◆ Performance tuning for EMC Centera ....................................................................... 67
Access nodes Each EMC Centera cluster contains two or more nodes with the access role. You
should specify as many access nodes on the cluster in the connection string as
possible.
When the EMC Centera SDK attempts to open a connection to the cluster for
DiskXtender, it attempts to connect to the first access node listed in the connection
string. If the connection to the first access node is successful, the SDK queries for and
internally stores information about all available access nodes in the cluster.
Communication between EMC Centera and DiskXtender is then automatically
load-balanced across this set of nodes.
If the connection to the first access node fails, however, then the SDK attempts to
connect to the second access node listed in the connection string. If the connection to
the second access node fails, then the SDK attempts to connect to the third access
node listed in the connection string, and so on. This process continues until the SDK
is able to successfully connect to an access node. Once the connection is made,
information about all available access nodes is stored by the SDK, regardless of the
number of access nodes listed in the connection string.
This connection process occurs each time the DiskXtender service restarts and each
time the media service is set online. As a result, it is important to include as many
access nodes on the connection string as possible, to ensure that DiskXtender can
connect to EMC Centera even when one or more access nodes are offline.
In addition, you cannot edit access node information in DiskXtender after you create
the media service. As a result, you cannot add or remove node information for an
existing media service.
32 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
Because you cannot edit access node information in DiskXtender, equate each access
node IP address with a node name alias before you create the media service. To
configure node name aliases, either add the appropriate entries to a common DNS
server or edit the local HOSTS file on the DiskXtender server.
The connection string for a media service is limited to 512 characters. Keep this limit
in mind when defining node name aliases. The aliases should be kept to a reasonable
length. Otherwise, you may not be able to specify a sufficient number of access nodes
on the connection string to enable reliable connections in the event of a node failure.
You can then specify the aliases instead of the IP addresses when you create the
media service. If you later need to change the access node IP addresses, you only
need to change the HOSTS file or DNS entries. You might need to change the access
node IP addresses if it becomes necessary to replace an access node.
Note: If you add an access node to the EMC Centera cluster after you create the media service,
you cannot add the address information to the media service connection string. However,
DiskXtender can connect to the access node. This is because the EMC Centera SDK internally
discovers and stores information about all available nodes after a successful connection is
made to one of the current access nodes in the connection string.
If you use EMC Centera replication, do not specify connection information for the
access nodes of the target clusters. “Replication failover” on page 48 provides
additional details.
Pools and profiles EMC Centera security is based on pools and application profiles:
◆ An application pool, or virtual pool, is a logical area on an EMC Centera device
where applications can store their data. Virtual pools enable you to logically
separate data on an EMC Centera device. This is particularly useful if there are
multiple applications with different security needs writing data to an EMC
Centera device.
◆ Access profiles provide access to one or more EMC Centera pools. Pools grant
capabilities to applications that are accessing EMC Centera by using the profile.
For DiskXtender, the profile must have the Write, Read, Delete, and Query
capabilities. To allow privileged deletes of retained files, the profile should also
have the Privileged Delete capability.
◆ A .pea file, generated while creating or updating an access profile, is a clear text,
XML-formatted, nonencrypted file that can be used by system administrators to
communicate and distribute authentication credentials to application
administrators.
Each EMC Centera cluster can have multiple virtual pools and multiple access
profiles.
The EMC Centera online help provides information on pools, access profiles, and .pea
files, which should be configured by an EMC Centera technical representative.
When you create an EMC Centera media service in DiskXtender, specify a .pea file
when you create the media service. You cannot edit a media service later to add a .pea
file.
There should be a single .pea file for each EMC Centera media service. You cannot
specify multiple .pea files for a single EMC Centera media service. If the virtual pool
is being replicated to another EMC Centera cluster, the .pea files for the virtual pools
and access profiles on the two clusters are merged. This merged .pea file, which
enables access to both pools with a single profile, should be configured by an EMC
Centera technical representative.
If you have multiple, separate pools and access profiles—each pair with its own
corresponding .pea file—then you can create multiple EMC Centera media services.
Multiple media services enable you to further separate data you are writing through
DiskXtender.
If you do not specify a .pea file when you create an EMC Centera media service, then
DiskXtender uses the Anonymous profile to connect to EMC Centera.
Note: The Anonymous profile is disabled in EMC CentraStar® 3.1 and later. If CentraStar 3.1 or
later is installed on the EMC Centera cluster, you must use an access profile when you create a
media service in DiskXtender. If you use an earlier release of CentraStar with DiskXtender and
you upgrade to 3.1 or later, you can continue to use the Anonymous profile.
Note: Because space is not reserved on the EMC Centera device for virtual media, if you meet
the limit of 100,000 files before you meet the limit of 256 GB, the size of the piece of media is
limited to the size required for the 100,000 files. In other words, the difference between the total
size of the 100,000 files and 256 GB is not wasted space on the EMC Centera device.
The size limit for EMC Centera media is imposed so that finding a file associated with
a piece of media does not take an inordinate amount of time. When either threshold is
reached, the media is considered full and cannot receive any more files, although files
can be retrieved from the media when necessary. Full media appears with a blue label
in the File System Manager Administrator.
You can create as many pieces of virtual media as necessary. You are limited only by
the total amount of space available on the EMC Centera device.
When a piece of virtual media is created in DiskXtender, a corresponding EMC
C-Clip™ for the media is created on the EMC Centera device. Once the C-Clip is
created, the content address (CA) of the C-Clip is sent back to DiskXtender and is
stored in the Microsoft Windows registry on the DiskXtender server.
34 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
When DiskXtender migrates a file to a piece of EMC Centera media, a C-Clip for the
file is created on the EMC Centera device. Metadata about the piece of virtual media
associated with the file is stored with the file on the EMC Centera device.
In addition, DiskXtender creates a special C-Clip on the EMC Centera cluster daily at
midnight (EMC Centera cluster time). This new C-Clip contains a list of all media
C-Clips and folder rename C-Clips associated with those media currently on the
system. One C-Clip is created for each EMC Centera media service. The CA for the
C-Clip is stored in the DiskXtender event log when the C-Clip is created. If a disaster
occurs, an EMC Customer Support Representative can retrieve the C-Clip to develop
a list of media to restore to DiskXtender.
There are two ways to create virtual EMC Centera media through DiskXtender:
◆ Automatically through the media group, either when free space in the media
group falls below a certain number of megabytes or when the number of
available pieces of media falls below a certain level.
◆ Manually through the media service. Use this method to create individual pieces
of media. Then allocate the media to the extended drive and add it to a media
group to make it available for file migration. This option is not recommended for
most environments.
To avoid confusion and simplify media naming conventions, use only one media
creation method.
If you no longer need the files that have been written to a piece of EMC Centera
virtual media, you can run a Format media task on the media to clear the files from
the EMC Centera device. The EMC Centera Garbage Collection feature then reclaims
the space made available by the deleted files.
Note: The Format task may take a significant amount of time to complete for EMC Centera
media.
Note: You can also add custom metadata to CDFs by using DiskXtender media groups. This
custom metadata can be used to enhance EMC Centera Seek and Chargeback Reporter reports.
“Adding custom metadata to files on EMC Centera” on page 65 provides details.
Another CA for the CDF is generated, and then DiskXtender stores the CDF and the
file data in a package on the EMC Centera cluster. This complete package, which
contains both file data and metadata, is called a C-Clip and is illustrated in Figure 3
on page 36.
C-Clip
• CA for file
• Metadata (filename,
creation data, and
so on)
CA for CDF
3C08JM40C8AMMe0N8ATEJHC2DQN
GEN-000914
The CA for the CDF is returned to DiskXtender and stored for the file. When the file is
purged from the extended drive, this information can be used to retrieve the file data
from EMC Centera.
Note: Performance of EMC Centera media tasks may be affected as each of the media tasks
involve processing the folder rename transactions log and restoring files to the latest folder.
When the EMC Centera media is offline, you can continue to rename the folders in
the extended drive. However, the synchronization of folder names on the EMC
Centera will take place when the media is online. Because of the synchronization,
there might be a delay in performing the media tasks as well as file fetching
operation.
36 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
Renaming EMC Centera folder uses the EMC Centera and DiskXtender time for
logging the transaction and any change to the EMC Centera time or the DiskXtender
server time may result in files retrieved to a different folder when a media task is
performed.
IMPORTANT
Any system errors while processing folder rename transactions result in using the
original EMC Centera folders.
Note: While renaming a folder, if the recycler is enabled, and you delete or move the file under
this folder to recycle bin . When you try to restore the same file, the file is restored to the
original folder.
IMPORTANT
You must be a local administrator on the DiskXtender server to enable EMC Centera folder
rename.
When the EMC Centera media is full and you rename an EMC Centera folder, the
rename transaction is successful on the extended drive as well as on the EMC Centera
media.
Note: When multiple rename transactions are done on the extended drive and the user tries to
fetch a file, there will be a delay in accessing the file. This is because, logging all rename
transactions to the EMC Centera must be complete before fetching a file from the media.
However you can change this behavior in the Extended drive option.
When you rename a folder from a remote client that is being accessed in the local
server, the folder rename transaction fails. Similarly, when you rename a folder from
a local server that is being accessed from a remote client, the folder rename
transaction fails.
IMPORTANT
To enable folder renames on the Centera media after the upgrade, you must run the
DxDmChk utility after stopping DiskXtender service.Running DxDmChk utility
without stopping the DiskXtender service can result in loss of data, if the media is
removed.
Note: DiskXtender also works with both EMC Centera data protection mechanisms; Content
Protection Mirrored (CPM) and Content Protection Parity (CPP). The EMC Centera protection
mechanism (CPM or CPP) is transparent to DiskXtender.
38 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
Note: If you enable collision avoidance, each file is stored uniquely, even if you use Storage
Strategy Capacity (single-instance storage).
◆ Embedded BLOBs — You can set a threshold for embedding small BLOBs (file
data) in the CDF. Embedding file data in the CDF can decrease read and write
times, since the overhead required to manage two objects (CDF and BLOB) is
greater than the overhead required to manage a single object.
Figure 4 on page 39 illustrates an embedded BLOB, while Figure 5 on page 40
illustrates a separate CDF and BLOB.
• CA for file
• Metadata (filename,
creation data, and
son on)
BLOB
DiskXtender server
(file data)
EMC Centera
GEN-000918
• CA for file
• Metadata (filename,
creation data, and
so on)
EMC Centera
GEN-000919
Figure 5 Separate CDF and BLOB for a file stored on EMC Centera
To maximize the performance benefits of this feature, files smaller than 100 KB
(the maximum value for the option) should be embedded in the CDF.
If the EMC Centera is configured for Storage Strategy Capacity (single-instance
storage), embedding BLOBs for files smaller than 100 KB will not allow you to
realize the benefits of the storage strategy for these files. This is because the file
content is embedded in the CDF. If you embed the BLOBs for files smaller than
100 KB, then single-instance storage is applied only to files larger than 100 KB.
Note: The total file size (all streams and the stream tags) must be less than the embedded
BLOB threshold before the BLOB is embedded in the CDF.
Note: If you use CentraStar 3.0.2 or later, or 3.1.1 or later, additional configuration steps are
required on the EMC Centera device to enable client-side ID calculation. Contact an EMC
Centera technical representative for assistance in enabling this feature if you use one of the
specified CentraStar versions.
40 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
Garbage Collection When a file is deleted from the extended drive, a delete transaction is issued and
flushed to the target storage device. Delete transactions can flush every minute,
depending on what other transactions have been initiated.
When EMC Centera receives a delete transaction from DiskXtender, the CDF is
deleted from the EMC Centera device, and the BLOB is left there (orphaned). CDFs
not under retention can be deleted from any type of EMC Centera device.
If the EMC Centera Garbage Collection process is enabled, then the BLOBs with
deleted CDFs are removed from the EMC Centera device and space is recovered. The
file data for deleted files is removed from the EMC Centera device and is not
recoverable. If Garbage Collection is disabled, however, then the BLOBs with deleted
CDFs remain on the EMC Centera device and occupy space.
Communication threads
Each access node of an EMC Centera has a certain number of available
communication threads. The optimum performance level is reached when each EMC
Centera access node processes approximately 20 simultaneous connections. You can
exceed 20 connections for each access node. However, performance degradation
typically results.
When an application communicates with an EMC Centera cluster, it uses one or more
of these threads to pass data to and from the EMC Centera cluster. With DiskXtender,
these threads are used to read data from and write data to the EMC Centera cluster.
It is important to understand the communication process between DiskXtender and
EMC Centera so that you do not exceed the maximum number of available
communication threads. The following topics provide additional details and
guidance on configuring options that enable you to control the lines of
communication and maximize performance.
Virtual Media 1
Virtual Media 2
Step 2: After File G is migrated, then File A, which resides on Virtual Media 1, can be fetched
Virtual Media 1
Virtual Media 2
GEN-000583
In an active environment where file migration is necessary at the same time that file
fetches are likely to occur, you can configure DiskXtender to both read from and write
to a single piece of media at the same time. This functionality is available through the
Enable simultaneous moves and fetches feature, which appears on the Options tab of
the Service Properties dialog box. When simultaneous moves and fetches are enabled,
two EMC Centera threads may be occupied by DiskXtender communication with a
single piece of media—one for moves and one for fetches, as illustrated in Figure 7 on
page 43.
42 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
File G is migrated to Virtual Media 1 at the same time that File A is fetched from Virtual Media 1
File G
Virtual Media 1
Virtual Media 4
EMC Centera cluster
GEN-000585
With simultaneous moves and fetches enabled, DiskXtender will use only two
threads for a piece of media if it is both moving and fetching files. It will not open two
threads to a piece of media for moving files, nor will it open two threads for fetching
files.
If there are multiple pieces of virtual media in a media group—and even multiple
media groups with multiple pieces of media in each—then a single DiskXtender
installation can occupy numerous communication threads with an EMC Centera
cluster at any one time. DiskXtender can initiate and maintain as many as 256
simultaneous connections to EMC Centera, regardless of the number of configured
EMC Centera media services.
DiskXtender will not reserve a thread to a piece of media if it does not need to.
Communication threads to EMC Centera are initiated and maintained only if a file is
requested from media or if there are files that need to be migrated and the file
migration schedule is active.
DiskXtender writes files randomly to any piece of active media in a media group.
This enables DiskXtender to continue writing files to media at the same time that it is
fulfilling fetch requests for files on other pieces of media, as illustrated in Figure 8 on
page 44.
Communication threads
File A
EMC Centera cluster
Media group 1
Virtual Media 2
File C
Virtual Media 3
File D
Virtual Media 4
Media folder
Media group 2
Extended drive
Virtual Media 5
File E
Virtual Media 6
Virtual Media 7
File F
Virtual Media 8
File G
GEN-000586
File H
You can configure DiskXtender to write files to media sequentially rather than
randomly by using the Media fill method feature on the Options tab for each media
group. However, sequential fill is strongly discouraged for EMC Centera media
groups because it can lead to poor performance. “Media group considerations for
EMC Centera” on page 67 provides additional information.
where:
◆ N is the number of access nodes in the EMC Centera cluster.
◆ 20 is the optimal number of threads per node.
◆ A is the number of threads used by other applications, including other
DiskXtender installations.
◆ R is the number of threads used for EMC Centera replication, if replication is
enabled.
44 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
For example, if you are planning to write to an EMC Centera cluster with four access
nodes, the cluster is dedicated to the DiskXtender installation, and replication is
enabled and uses two threads, then the optimal number of threads available for file
activity is 78, or:
(4 access nodes x 20) - 0 - 2 = 78
The optimal number of available threads for DiskXtender can then be used when
determining the number of pieces of active media that should be maintained in each
media group. By controlling the number of active media, you are effectively
controlling the number of threads that can be used for file migration.
DiskXtender can automatically create EMC Centera media to maintain a specified
count of active media in a media group. Active media are media that are still
available for file writes. For EMC Centera media, this means that the media has not
yet reached the maximum of 256 GB or 100,000 files. “Automatically creating virtual
EMC Centera media” on page 57 provides details on automated media creation.
For example, if the DiskXtender installation has two extended drives, each extended
drive has two media folders, and each media folder has one EMC Centera media
group, then there are a total of four media groups targeting the EMC Centera cluster:
2 drives x 2 media folders x 1 media group (each) = 4 media groups
If there are 78 available threads for the installation and you anticipate that file
migration and fetch activity will be evenly distributed among the media groups, then
you can divide the number of threads by the number of media groups:
78 available threads / 4 media groups = 19.5 pieces of active media
Since it is not possible to have a half of a piece of media, you may want to round up to
20 pieces of active media for each media group.
Note: In an active environment where simultaneous moves and fetches are enabled and are
likely to occur, divide the number of active media by two. Remember that with simultaneous
moves and fetches, two threads are used by each piece of media.
◆ Schedule file migration so that it does not occupy the communication threads
when they are needed for file fetches. By default, the file migration schedule is
active at night, so that files are migrated when users are typically not fetching as
many files. You may need to customize this schedule for your environment.
◆ Reduce the number of fetch requests from media so that they do not occupy the
communication threads when they are needed for file migration. To reduce the
number of requests for files on the EMC Centera cluster, leave as much active
data on the extended drive as possible. Use DiskXtender purge rules to purge
only file data that is no longer likely to be requested. Chapter 11, “Purging Files,”
provides details on configuring file purging.
File retention EMC Centera can protect stored data through its retention feature, which is
complemented by the DiskXtender retention feature. Through DiskXtender, you can
apply a retention period automatically to files that qualify for move rules. You can
also apply retention to and extend retention periods for specific files by using the
DiskXtender Explorer Add-ons utility.
Once DiskXtender applies a retention period to a file, the file cannot be edited or
deleted from the extended drive until the retention period expires. (If you edit a
retained file, you must save the file with a new filename.)
If you have an EMC Centera GE or EMC Centera CE+ device, the file is also protected
on the EMC Centera device.
If you have an EMC Centera Basic Edition and you apply retention through
DiskXtender, the file is protected on the extended drive but is not protected on the
EMC Centera device.
Table 1 on page 46 lists the retention options for files written to EMC Centera through
DiskXtender.
Fixed retention period A specific period of time (in days) during which file retention is enforced.
Event-based retention Retention on a file is enforced when an event associated with the file occurs.
Retention class A symbolic representation of a retention period. When the retention class is defined, you
specify a name and a retention period (in days). If necessary, you can edit the retention
period for a retention class by changing the class definition, thereby changing the
retention period for a group of files. “Retention classes” on page 255 provides additional
details, including a list of restrictions that apply when you use retention classes.
If you set global retention on the EMC Centera device and then you configure a
different retention period through DiskXtender, the DiskXtender retention period
applies. This is true even if the DiskXtender retention period is zero days (no
retention). When you set a retention period of zero days through DiskXtender, then
the file is not protected on the EMC Centera device, even if EMC Centera is
configured for a global retention period of one or more days.
46 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
DiskXtender always applies a retention period to files written to EMC Centera, even if
the retention period is zero days (no retention). You cannot automatically apply the
global retention period set on the EMC Centera device to files on the extended drive.
To match the global retention period on EMC Centera with the retention set on files
on the extended drive, specify the same retention setting in DiskXtender as on EMC
Centera.
Chapter 9, “File Retention,” provides details on setting and editing retention on files.
Privileged delete If you have an EMC Centera Basic or EMC Centera GE device, you can delete
retained files by using privileged deletes. To delete retained files on a CE+ device,
contact an EMC Centera technical representative.
To perform privileged deletes through DiskXtender, use the Privileged Delete option
in the Explorer Add-ons utility.
Note: When you perform a privileged delete, and the DiskXtender Recycler is enabled, the file
is permanently deleted. It is not placed in the DiskXtender Recycler.
When you delete a retained file through DiskXtender, you must enter an audit string.
You can then view audit information by performing an EMC Centera query.
To use the Privileged Delete option, first grant the right to perform a privileged delete
to the profile that DiskXtender uses to connect to the EMC Centera device (either the
anonymous profile or, as recommended, an access profile/.pea file). The EMC
Centera online help provides additional information on profiles. Access profiles
should be configured by an EMC Centera technical representative.
In addition, privileged deletes are available only to users who are members of the
DxAdministrators group on the DiskXtender server.
Note: Consider the compliance regulations followed by your company before performing a
privileged delete.
Audited delete When you delete a file that is stored on an EMC Centera device, metadata about the
deleted file remains on the cluster. This metadata is called a reflection or tombstone.
Through DiskXtender, you can provide an audit string that is included in the
reflection. An EMC Centera query then enables you to search for the reflection and
view the audit string.
If retention has never been set for the file, or if the retention period for the file has
expired, the audit string can be provided automatically by DiskXtender through the
media service. The audit string enables you to identify the data as deleted
DiskXtender data.
If the file is still under retention (and you are, therefore, performing a privileged
delete through the Explorer Add-ons utility), then you must provide a custom audit
string through the utility.
If you provide an audit string through the media service but you delete the file by
using a privileged delete, the audit string entered for the privileged delete is used
instead of the media service audit string.
An EMC Centera query enables you to search for deleted data and view the audit
string. The EMC Centera documentation provides instructions on how to do this.
Replication
The EMC Centera replication feature protects against data corruption and loss by
automatically copying data from one EMC Centera cluster to another. As an EMC
Centera cluster acquires new content from an application, the replication mechanism
ensures that this new content is automatically and transparently transferred across a
WAN or LAN to a designated EMC Centera in another location.
Replication is used on an ongoing basis to keep two or more EMC Centera clusters
synchronized with new content. In a typical replication setup, the EMC Centera
clusters are geographically separate to ensure disaster recovery or to distribute the
content for access from another location. For example, a company may replicate to a
second EMC Centera cluster to enable recovery from the loss of the primary EMC
Centera or to avoid multiple requests for the same content across a WAN connection.
Files cannot be purged until all the files migrated to the media are replicated in the
EMC Centera replica media.
The majority of EMC Centera environments with replication are configured for
unidirectional replication. With unidirectional replication, one EMC Centera cluster
updates another cluster with its content. For example, if content is written to cluster
A, then unidirectional replication transfers the content to cluster B so that it is located
on both clusters. However, if content is written directly to cluster B, then the content
is not transferred to cluster A. As a result, there may be additional content on cluster
B that does not exist on cluster A.
The EMC Centera online help provides additional information on replication.
Replication and The replication process itself is transparent to DiskXtender. In other words, after
DiskXtender files DiskXtender migrates files to EMC Centera, the files are replicated from the source
cluster to the target cluster without any DiskXtender involvement.
Replication failover When the source EMC Centera cluster fails, DiskXtender automatically attempts to
set the failed media service online again. If DiskXtender is unable to set the media
service online, the EMC Centera SDK provides a read-only connection to the target
(replica) cluster after a brief pause. With read-only failover, files can be read from the
target cluster, but additional files cannot be written to the target cluster.
Once the source cluster is set online again, DiskXtender automatically resumes
normal read/write activity with the source cluster.
This scenario enables users to fetch files that have already been migrated and purged,
even when the source cluster fails. However, new file migration activity (from new
files that qualify for migration, as well as edits to and deletes of files that have already
been migrated) must wait until the source cluster comes back online.
Losing the read-only connection to the replica
If the DiskXtender service restarts or if the media service is set offline while
DiskXtender is connected to the target, then the connection to the target fails, and the
media service is set offline. Purged files cannot be fetched until the source cluster is
set online again.
This is because DiskXtender passes the connection string to the EMC Centera SDK,
and the connection string includes only addresses from the source cluster. If the
source cluster is offline, then no connection can be made—not even to the target
cluster. The address information for the target cluster is passed to DiskXtender only
after a successful connection to the source cluster.
48 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
If the source cluster is offline for an extended period of time, contact EMC Customer
Service. A Customer Support Representative can configure the environment to:
◆ Establish a read/write connection to the target cluster
◆ Ensure that files are replicated back to the source cluster once it is set online
Replicate Delete If you use EMC Centera replication and you delete file data from an extended drive,
you can choose whether the file data is deleted from only the source cluster or from
all eligible clusters (including both the source cluster and all target clusters).
When you delete file data from the extended drive and the Replicate Delete feature is
enabled as part of the EMC Centera configuration, the file is deleted from the source
cluster. The delete transaction is then placed in a queue, and eventually carried out on
the target clusters. Replicate Delete is also known as delete propagation.
When you enable Replicate Delete, the file data on all replicated clusters remains
more closely synchronized.
Note: When Replicate Delete is disabled, content deleted from the source cluster is not deleted
from the target. This may be required in some circumstances, but will result in uneven capacity
utilization.
Synchronous deletion DiskXtender also enables you to control delete propagation to the target EMC
Centera clusters.
If it is necessary for deletions to occur almost simultaneously on both the source and
target clusters, you can configure synchronous deletion through DiskXtender. When
synchronous deletion is enabled, DiskXtender processes each file deletion on all
eligible clusters.
Note: If one or more of the clusters is not available, then the file deletion fails and an error
occurs. When DiskXtender synchronous deletion is enabled, all eligible clusters must be
available for a deletion to succeed.
50 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
Note: If you do not need to segregate data, you can write all data to the default pool.
This practice is not recommended.
• Access profiles — Create one or more access profiles to provide access to the
pools. An EMC Centera technical representative should perform this step. The
profile must have the Write, Read, Delete, and Query capabilities. To allow
privileged deletes of retained files, the profile should also have the Privileged
Delete right.
This step should result in a .pea file. The EMC Centera technical representative
should provide the .pea file to you. Copy the file to a location on the
DiskXtender server. You then specify the .pea file when you add the media
service.
• Retention — Depending on the EMC Centera compliance model (Basic, GE, or
CE+), decide whether to enable retention, and if so, which retention setting to
use (fixed retention periods, retention classes, or infinite retention). To use
retention classes, have an EMC Centera administrator configure them for you.
“File retention” on page 46 provides more information.
• Replication and delete propagation — If you enable replication of data
between EMC Centera clusters, determine whether to use unidirectional or
bidirectional replication. In addition, decide whether to configure deletion of
files from both the source cluster and all target clusters. “Replication” on
page 48 provides more information.
On a single line in a text or word processor file, list the nodename aliases for the
access nodes on the primary EMC Centera cluster or the EMC Centera replica
address, separating the aliases with a comma. For example, if there are four access
nodes on the primary cluster and the nodename aliases for the nodes are defined
as Node1, Node2, Node3, and Node4, then type:
Node1,Node2,Node3,Node4
4. In the text or word processor file with the list of nodename aliases, add a question
mark (?) after the nodename aliases, and then include the path on the
DiskXtender server to the .pea file for the access profile that DiskXtender should
use to connect to the EMC Centera cluster.
For example, if the .pea file is located on the system drive at
C:\Centera\DXProfile.pea, then the connection string would appear as:
Node1,Node2,Node3,Node4?C:\Centera\DXProfile.pea
5. Ensure that the string with the nodename aliases and the path to the .pea file is
fewer than 512 characters.
6. The string should be entered on the Centera Information page when you create
the media service, as discussed in “Adding an EMC Centera media service” on
page 53.
52 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
2. Click Add.
The media service wizard appears, starting with the Select Media Service Type
page, as shown in Figure 10 on page 53.
4. In the Pool Address text box, type the connection string that the EMC Centera
SDK should use to open a connection to the EMC Centera cluster for DiskXtender.
“Building the connection string” on page 51 provides details on the appropriate
elements of a connection string.
The sample connection string in Figure 12 on page 54 creates an EMC Centera
media service that connects to the Node1 and Node2 access nodes of the EMC
Centera device by using the DXProfile.pea profile.
5. In the Replica Address text box, type the connection string that includes
information about the EMC Centera access nodes of replica EMC Centera, as well
as the access profile that should be used for the DiskXtender connection.
“Building the connection string” on page 51 provides details on the appropriate
elements of a connection string.
6. In the File Delete Audit String text box, type the custom audit string to attach to
file data when the file data is deleted from EMC Centera. “Audited delete” on
page 47 provides more information.
54 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
7. In the Embedded Blob Threshold text box, choose whether to embed file data in
the CDF:
• To embed the file data for smaller files in the CDF, type a file size threshold
between 1 and 100 KB that the file data must meet before the BLOB is
embedded.
• To store file data separately from the CDF regardless of the size of the file,
leave the default of 0 KB.
“DiskXtender options to tune CAS” on page 39 provides more information on the
Embedded Blob Threshold, Collision Avoidance, and Client-Side ID (hash)
Calculation settings.
8. Choose whether to enable collision avoidance.
Note: Collision avoidance should not be used in most environments because it eliminates
the benefits of single-instance storage.
9. Specify whether the EMC Centera API should calculate the CA for a piece of data
before the data is sent to EMC Centera:
• To calculate the CA before data is sent to EMC Centera, select the Client Side
ID (hash) Calculation checkbox.
• To calculate the CA when data is sent to EMC Centera, clear the checkbox.
Note: If you enable collision avoidance or specify an embedded BLOB threshold, do not
enable client-side ID calculation.
56 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
5. (Optional) If you removed the media from the media group and you do not want
to keep the files on the EMC Centera cluster, run a Format media task on the
media to clear the files. “Reclaiming deleted media space on EMC Centera” on
page 61 provides instructions.
6. (Optional) Deallocate the media from the extended drive, and delete it from the
media service. “Removing virtual EMC Centera media from the system” on
page 60 provides instructions.
Note: This option is recommended for most environments. When you maintain a
certain number of active media in each media group, you can optimize the number of
media that DiskXtender writes to and reads from simultaneously. This optimization
can be configured by using the Maximum media simultaneously receiving files option
for the media group. “Media group considerations for EMC Centera” on page 67
provides details.
3. Specify a naming convention and the media service for the media:
a. Name Prefix — Type a prefix for the media name in the text box. Each new
piece of media is named by using the prefix followed by a sequential number.
b. Number Width — From the drop-down list, select the number of digits to be
used to create the incremental numbering for the media name.
c. Media Service — From the drop-down list, select the media service in which
the new media will be created.
The Sample Name text box provides an example of what the media name will
look like based on the prefix and number width criteria you set.
For example, if you type Payroll as the prefix and select a number width of 3, the
first piece of automatically created media is named Payroll001, the second is
Payroll002, and so forth.
4. Click Next to proceed through the wizard and create the media group.
5. Repeat these steps to enable automatic media creation when you create each
media group for each media folder.
Note: You can enable automatic media creation or change automation settings after you
create the media group by opening the Media Group Properties dialog box and selecting
the Automation tab.
If you selected the Auto-create virtual media when free space falls below __ GB
option, then the media is created as needed based on when the amount of free space
falls below the number of gigabytes specified. The amount of free space on media in
the group, and therefore the need for media, is calculated after you create the media
group.
58 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
If you selected the Auto-create virtual media to maintain a count of __ active media
option, then the media is created, one piece at a time, after the wizard is completed.
After the specified number of active media are created, additional pieces are created
as needed based on the number specified.
4. Click Create.
The Create Centera Media dialog box appears, as shown in Figure 15 on page 59.
5. In the Name and Description text boxes, type a name and, optionally, a
description for the virtual piece of media.
The name is what appears in the File System Manager Administrator to identify
the media.
6. Click OK.
The Media Service Properties dialog box appears.
7. If you have created an extended drive, allocate the media:
a. Select the media and click Allocate.
The Select Extended Drive dialog box appears.
b. Select the extended drive and click OK.
Note: Media does not appear in the Administrator until it is allocated to an extended drive.
8. Click OK.
The Configure Media Services dialog box appears.
9. Click Close.
10. If you have created media folders and media groups, add the media to a media
group. “Adding media to a standard media group” on page 232 provides
instructions.
Do not delete a piece of EMC Centera media unless you are absolutely certain that
you no longer need the files on the media. If you think you might need the files,
compact the media before deleting it. Compaction writes the files on the media
back to the extended drive so that they can be migrated to another piece of media.
Note: If you automatically create media for a media group based on the number of media
in the group and you want to remove the media without replacing it with new media, then
temporarily disable the media auto-create function for the group.
60 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
2. To reclaim space on the EMC Centera by deleting the files that were written to the
media, run a Format media task on the media. The EMC Centera Garbage
Collection feature then reclaims the space made available by the deleted files.
“Reclaiming deleted media space on EMC Centera” on page 61 provides
instructions.
3. From the Service menu in the File System Manager Administrator, select
Configure Media Services.
4. Ensure that the EMC Centera media service is online. If the media service is not
online, select the media service and click Set Online.
Note: If you attempt to delete media while the media service is offline, the changes might
not take effect.
62 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
Note: If a file is updated on media for another reason, such as edits to file content or changes to
other file attributes, then all attribute changes for the file are updated on the media.
This restriction on recognition of attribute changes has been enforced because a new
CDF is created on the cluster each time an attribute change is propagated. Older
CDFs are not deleted, although the files on the extended drive no longer point to
them. When EMC Centera Chargeback reports are run, the reports include all of the
CDFs referencing the same data blob and cannot differentiate the old CDFs from the
current CDF.
This behavior is acceptable and has minimal impact when users change file
attributes, which is a relatively infrequent event. However, when system tools
periodically scan the file system and touch every file, the impact can be significant.
The issue is compounded in environments with a significant number of files.
If it is important in your environment to propagate attribute changes and you are
certain that there are no system tools installed on the system that perform attribute
changes during a scan, then you can enable recognition of file attribute changes by
editing the Recognize file attribute changes setting on the Options page for an EMC
Centera media group.
64 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
3. Click Next to proceed through the wizard and create the media group.
4. Repeat these steps for each media group in each media folder that contains files to
which to add custom metadata.
66 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
◆ If you are configuring multi-target migration through DiskXtender and the media
in two different targets are two EMC Centera clusters, do not use EMC Centera
replication. If you use both replication and multi-target migration, the CDF for
each file may be stored on each EMC Centera cluster twice. If single-instance
storage is disabled, then the file data will also be stored on each cluster twice.
68 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to EMC Centera
◆ You can use delete rules and retention periods to keep files protected under
retention for a specified period of time, then automatically delete them when
they are no longer needed. “Automatically deleting files” on page 322 provides
instructions on setting up delete rules to automatically delete files after a certain
period of time.
◆ You can prevent delete transactions performed on purged files on an extended
drive, from being propagated to EMC Centera device. “Prevent delete from
media” on page 325 provides details on how to control delete transactions done
on an extended drive from being propagated to the EMC Centera device.
70 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
3
Connecting to
Network-Attached
Storage
“Standard NAS” on page 72 Standard NAS share on a disk-based storage device or server on the network
“Aggregate NAS” on page 73 Media folder on another DiskXtender extended drive as part of tiered migration
Standard NAS
Standard NAS media can be created for any network share on any type of disk-based
device, like a RAID or a NAS device, or a server drive on the network.
DiskXtender treats Standard NAS media like any normal read/write magnetic
media. There are no restrictions on editing or deleting files, or renaming files or
folders.
72 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Network-Attached Storage
Aggregate NAS
Aggregate NAS is designed to be used in a tiered migration environment, in which
you are aggregating files before moving them (a second time) to tape. Files are
migrated from one DiskXtender extended drive to another extended drive, and then
from the second extended drive to tape, as shown in Figure 18 on page 73.
File
Extended drive on first
DiskXtender server
Tape
File
Extended drive on second
DiskXtender server GEN-000938
To accomplish this through DiskXtender, media folders on the second extended drive
are configured as aggregate NAS media on the first DiskXtender server. The files
from the first extended drive are migrated to the aggregate NAS media (the second
extended drive). The DiskXtender installation on the second server then moves the
files to tape media.
When files are saved to a media folder on the first extended drive that contains a
media group with aggregate NAS media, DiskXtender does not allow you to rename
the files or the folders in which they reside. This behavior mimics the behavior of the
second extended drive (the aggregate NAS media), because the second extended
drive is writing to tape, which also does not allow file or folder renames.
The restrictions on aggregate NAS media are designed to ensure that files and file
tags on both extended drives remain synchronized, and that the files on the
subsequent tape media are not orphaned.
Note: DiskXtender does not restrict you from using the second extended drive to write to
media other than tape. However, aggregate NAS media restricts file and folder renames,
operationally imitating extended drives that write to tape media.
Retained NAS
Some NAS devices can be configured to contain variable retention volumes,
including a Celerra Network Server with the File-Level Retention (FLR) file system
and Network Appliance (NetApp) NAS devices with SnapLock software.
With these retention-capable volumes, you can set retention on files written to the
volumes. Through DiskXtender, you can apply a retention period automatically to
files that qualify for move rules that write to these volumes.
When DiskXtender applies a retention period to a file, the file cannot be edited or
deleted from the extended drive until the retention period expires. You also cannot
change the retention period that has been applied to a file until the original retention
period expires.
When the file is moved to media, the retention period you set through DiskXtender
move rules is passed to the retained NAS device. As a result, the file is also protected
on the NAS device until the retention period expires.
Because retention periods are passed from DiskXtender to the retained NAS, do not
configure retention through the NAS device. Instead, configure retention through
DiskXtender.
Note: You cannot create a piece of retained NAS media unless you use a supported device:
either Celerra with FLR or NetApp with SnapLock. If you select the retained NAS option when
creating NAS media for a share that does not reside on a supported device, then DiskXtender
automatically converts the media to the Standard NAS media type.
To write to a retention capable device share without retention, use the Standard NAS option
when creating the NAS media that corresponds to the share.
74 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Network-Attached Storage
76 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Network-Attached Storage
Shared
A B C A B C A B C
directories
NAS device
GEN-000940
Note: You can create more than 256 pieces of NAS media, but no more than the maximum will
be online at the same time. You cannot write files to or read files from the media that
DiskXtender does not set online at initialization.
Even if the NAS media service is writing to a single device, create several partitions
and shares so that you can create multiple pieces of NAS media. This is important for
the following reasons:
◆ DiskXtender performance improves when the system can write to and read from
multiple media at once. Focusing all system activity on a single piece of media
can cause a performance bottleneck.
◆ You can take advantage of the flexible file migration features available in
DiskXtender. You can migrate data from multiple media folders to different
locations (pieces of media) by using customized migration rules.
◆ More files remain available if an error or other system problem occurs. If a piece
of media becomes inaccessible (for example, as a result of a failed transaction),
the files on other pieces of media remain accessible while the inaccessible media
is offline.
The number of media to create depends on your environment and your tolerance for
system downtime. For assistance in determining how many pieces of NAS media to
create, contact EMC Professional Services.
If a user saves, edits, or deletes a file directly on the NAS share instead of through the
extended drive, the files and file tags on the extended drive are not synchronized
with the files on media. If this occurs, users receive Access Denied errors when they
attempt to open those files from the extended drive.
If the file is renamed directly on the media, the file data (or file tag, if the file is
purged) on the extended drive becomes orphaned.
If you ever change the account that DiskXtender uses to log in as a service, you also
need to change the access permissions to any network shares that are being used as
NAS media.
78 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Network-Attached Storage
80 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Network-Attached Storage
5. Click Create.
The Create NAS Media dialog box appears, starting with the Select Network
Path tab, as shown in Figure 21 on page 82.
Figure 21 Create NAS Media dialog box – Select Network Path tab
6. Type or browse to the path to the network share to use as NAS media.
Note: If you are creating a piece of local NAS media, you may need to specify the server
name rather than localhost as the location. Some servers cannot use the localhost lookup
because of a change in Microsoft Windows. Microsoft KB article 254210, available on the
Microsoft website, provides details.
7. Click the Enter Media Information tab, shown in Figure 22 on page 82.
Figure 22 Create NAS Media dialog box – Enter Media Information tab
8. In the Media Name text box, type a name for the media. The name can be as
many as 32 characters. This is the name that identifies the media in the File
System Manager Administrator.
9. In the Media Description text box, type a description for the media. The
description can be as many as 128 characters.
10. In the Media Location text box, type a descriptive location for the network share.
The location can be as many as 128 characters.
82 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Network-Attached Storage
11. Click the NAS Options tab, shown in Figure 23 on page 83.
12. Select the type of NAS media to create: Standard, Aggregate, or Retained.
“How DiskXtender works with NAS” on page 72 provides details on each type.
13. Click OK.
14. If you have created an extended drive, allocate the media to the extended drive:
a. Select the media and click Allocate.
The Select Extended Drive dialog box appears.
b. Select the extended drive and click OK.
Note: Media does not appear in the Administrator until it is allocated to an extended drive.
Note: If you attempt to delete media while the media service is offline, the changes might
not take effect.
84 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Network-Attached Storage
All changes to the files and folders on the extended drive are propagated to the files
and folders on the Standard NAS media.
Note: You cannot rename files and folders in media folders that contain media groups with
aggregate NAS media. This restriction applies even if the files have not yet been migrated to
media.
86 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Network-Attached Storage
Note: Simultaneous moves and fetches are recommended for the EMC Centera media service.
However, the feature is a global setting; you cannot configure it differently for EMC Centera
than you do for NAS. If you are writing to both NAS and EMC Centera, carefully weigh the
performance advantages of enabling this feature for use with EMC Centera against the failure
risks of using it with NAS.
88 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Network-Attached Storage
90 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
4
Connecting to
Optical and Tape
Devices
You can migrate files on a DiskXtender extended drive to optical and tape devices.
The following topics provide details on configuring and managing the environment:
◆ Supported removable media types............................................................................. 92
◆ Setting up MediaStor .................................................................................................... 93
◆ Setting up Sun StorageTek ACSLS............................................................................. 112
◆ Managing the lifecycle of removable media ........................................................... 120
◆ Expectations for files migrated to removable media ............................................. 151
◆ Performance tuning for removable media............................................................... 155
DVD-RAM Read/write • Data can be written to and read from randomly, accessing
files and space wherever necessary.
• Does not require finalization.
Tape WORM Read/write • Supported by drives that have firmware for WORM media.
Contact the drive vendor to verify WORM support, and to
acquire the firmware version, if necessary.
• Data is written only once (sequentially), although it can be
written in multiple sessions.
• Tape WORM cannot be reformatted.
• After data is written, it cannot be altered.
Ultra-density optical (UDO) Read/write Similar to MO, but contains more space and has a larger sector
size (8k) than MO (4k). The differing sector sizes means that
unlike DVD media, UDO and MO cannot use the same drives for
reading/writing data. DiskXtender supports both UDO1 and
UDO2 media.
UDO WORM Read/write • Data is written only once (sequentially), although it can be
written in multiple sessions.
• After data is written, it cannot be altered.
• DiskXtender supports both UDO1 WORM and UDO2 WORM
media.
The MediaStor media service enables DiskXtender to write files to all supported
removable media types. You can also write files to tape media in a Sun StorageTek
library by using the Sun StorageTek ACSLS media service. “Setting up MediaStor” on
page 93 and “Setting up Sun StorageTek ACSLS” on page 112 provide details.
92 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Setting up MediaStor
You can migrate files on a DiskXtender extended drive to removable media in a
library or standalone drive if the library or drive is managed by MediaStor. The
following topics provide details on configuring and managing the environment:
◆ “How DiskXtender works with MediaStor” on page 93
◆ “Prerequisite steps for installing MediaStor” on page 99
◆ “Running the setup wizard to install MediaStor” on page 100
◆ “Adding a MediaStor media service” on page 111
Windows servers
Extended drives
You can also set up a single MediaStor server to manage multiple hardware devices
that are all available to a single DiskXtender server, as illustrated in Figure 25 on
page 94.
Setting up MediaStor 93
Connecting to Optical and Tape Devices
Tape library
DVD library
GEN-000915
94 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
GEN-000916
Note: If there are multiple MediaStor servers in an environment, you can manage each server
from any other server. You can also manage all servers from a separate computer without a
MediaStor installation by using the MediaStor Remote Administrator. The DiskXtender
installation guide provides details on remote administration.
Multiple DiskXtender servers can also connect to a single MediaStor server that
manages one or multiple hardware devices, as illustrated in Figure 27 on page 96. In
other words, multiple DiskXtender servers can share a hardware device. This is
because neither the library itself nor the drives within the library are assigned to
DiskXtender. Instead, it is the individual pieces of media within the library that are
assigned, or allocated, to an extended drive managed by a particular DiskXtender
server. MediaStor manages requests for media from multiple DiskXtender servers,
and mounts the media in drives as they become available. Keep in mind the potential
performance impact of sharing hardware devices among multiple DiskXtender
installations.
Setting up MediaStor 95
Connecting to Optical and Tape Devices
GEN-000917
Note: A single MediaStor installation must manage a hardware device. Multiple MediaStor
installations cannot share a device, and the device cannot be shared with other
non-DiskXtender applications.
Device requirements
The DiskXtender for Windows Supported Device List, available on the Powerlink
website, contains a complete list of supported storage devices.
Adapter requirements
The storage devices that MediaStor manages, such as drives or libraries, must be
connected to the MediaStor server by using one of more of the following interfaces
(Host Bus Adapter) depending on the device connection type:
◆ SCSI
◆ Fibre Channel
◆ iSCSI (IP over SCSI)
A separate adapter for each SCSI drive or library device improves MediaStor
performance. If, for example, there are three drives or libraries on one adapter, then
the three devices also share the adapter resources. If there is a 1:1 ratio, then all
devices have equal and optimal throughput.
96 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
The DiskXtender for Windows Supported Device List provides a list of the adapters you
can use to connect hardware devices to the MediaStor server.
EDL support
DiskXtender can migrate files to a virtual tape library system, such as an EMC Disk
Library (EDL) device, if the device is managed by MediaStor. The DiskXtender for
Windows Supported Device List, available on the Powerlink website, contains a
complete list of supported EDL devices.
To configure an EDL device for DiskXtender, install and configure the device as
discussed in the EDL documentation. Then, add the device as a library in MediaStor,
and proceed with normal DiskXtender configuration. DiskXtender treats the media in
the device as tape media.
Drive considerations
Carefully assess your hardware needs to determine what combination of storage
devices (drives and libraries) provide the greatest efficiency.
Number of drives
If you plan to keep only the most recent file data on the extended drive and purge the
rest, you might want to consider a library with many drives, so that multiple users
can retrieve purged files simultaneously.
However, if you plan to configure the system so that only older or infrequently
accessed files are purged from the extended drive, you might not need frequent
media mounts to access purged files, meaning that you might do better with a library
with only a few drives.
Mixing drives
Do not mix drive types within a single library unless support for the specific
combination is explicitly documented in the DiskXtender for Windows Supported Device
List, which is available on the Powerlink website.
Setting up MediaStor 97
Connecting to Optical and Tape Devices
In addition, DVD media in the library that is not of the same type as the drive
type selected for the library is set to be read-only media during library inventory.
For example, if DVD-RAM media is in the library, but DVD-R is set as the drive
type, all DVD-RAM media is read-only The same is true for DVD-R media in a
DVD-RAM library.
If there are combo drives, different drive types, or both, all media must be
readable in all library drives. For example, if a library contains both DVD-R and
DVD-ROM drives, you cannot insert DVD-RAM media into the library because
DVD-RAM media is not readable in DVD-ROM drives.
All read/write library media must be both readable and writable in all
read/write library drives.
◆ Unfinalized DVD-R media cannot be mounted in a read-only drive (a drive not
configured to write to media). If you intend to update copies of media before the
originals are finalized, you must have at least two write drives in the system: one
drive for the copy and one for the unfinalized original. This is not an issue if you
plan to update the copy only after the original is finalized.
◆ If the library contains both a read drive and a write drive, you must ensure that
the drives are on separate buses, according to typical manufacturer’s instructions.
Carefully follow all manufacturer recommendations for hardware before configuring
hardware in a DiskXtender system.
98 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Memory 1 GB 2 GB
The EMC DiskXtender Release 6.5 Microsoft Windows Version Installation Guide provides
details on the requirements for the server on which you install MediaStor 6.5.
Note: The MediaStor release number must match the File System Manager release number.
However, the patch number for each component may be different.
Setting up MediaStor 99
Connecting to Optical and Tape Devices
4. Check the Powerlink website for updates to the release notes for this release.
Review the release notes for information on the following topics:
• Installation tips
• Known issues
• Descriptions of features that have been added to DiskXtender, or that are
scheduled to be removed from the product in future releases
• Documentation discrepancies
5. Create a service account. The service account must meet the following
requirements:
• Be a member of the Administrators group on the server
• Have the Log in as a service right
Note: If you do not assign the Log on as a service right, the right is automatically
assigned to the service account during the installation.
Note: Assigning the Act as part of operating system right to the service account might be
necessary if the service fails to log in to the server after the installation.
100 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
6. Click Next, and then proceed through the remaining pages of the setup wizard.
The pages of the MediaStor setup wizard are the same as most of the pages of the
File System Manager setup wizard. The DiskXtender installation guide provides
details on each page.
7. When you finish running the installation, remember to check the Powerlink
website for any patches to this release. Download the patches and install them, if
necessary, by using the instructions in the patch documentation.
102 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
4. Open the iSCSI Initiator Properties dialog box to enable and configure the iSCSI
Initiator:
• If you use Windows 2003, open the Windows Start menu and select Programs
> Microsoft iSCSI Initiator > Configure iSCSI Initiator.
• If you use Windows Server 2008, open the Control Panel and double-click the
iSCSI Initiator icon.
Click Yes on the message that appears to ask whether to start the service and
set it to start automatically on system startup, and then click No on the
message that appears to ask whether to unblock the service so that it can
communicate with an Internet storage name service through Windows
Firewall.
5. (Optional) Provide a more user-friendly name for the device:
a. On the General tab of the iSCSI Initiator Properties dialog box, click Change.
The Initiator Node Name Change dialog box appears.
b. Type the IP address or name for the iSCSI device in the Initiator node name
text box.
c. Click OK.
6. Add the IP address for the device:
a. Click the Discovery tab on the iSCSI Initiator Properties dialog box.
b. Click Add Portal.
The Add Target Portal dialog box appears.
c. Type the target IP address for the device in the IP address or DNS name text
box and click Advanced.
The Advanced Settings dialog box appears.
d. From the Local adapter list, select Microsoft iSCSI Initiator.
e. From the Source IP list, select the source IP address and click OK.
f. Click OK on the Add Target Portal dialog box to return to the iSCSI Initiator
Properties dialog box.
7. Activate the connection to the iSCSI device and each of its drives:
a. Click the Targets tab on the iSCSI Initiator Properties dialog box.
The SCSI device and each of its drives are listed with a status of Inactive.
b. Select a target and click Log On.
The Log On to Target dialog box appears.
c. Select the Automatically restore this connection when the computer starts
checkbox.
d. Click OK to log in to the device.
e. Repeat step b through step d until all devices show a status of Connected.
8. Click OK.
104 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
4. In the Name text box, type the name to display for the library in the
Administrator interface.
5. From the Drive Type drop-down list, select the drive type (media) in the library.
If you are adding an optical library that contains multiple types of media, review
the information in “Drive considerations” on page 97 to ensure that you are
selecting the correct drive type.
6. Leave the default for the Set this device online when the server starts checkbox,
which is cleared.
7. Click Next.
The Library Drives page appears, as illustrated in Figure 32 on page 106.
106 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
14. Choose when to dismount idle media from the drives in the library, and how
many shelves in the library to use for inventories.
To configure an option, select the option in the list, and then edit the settings in
the lower part of the Options page.
15. Click Finish.
16. Restart the MediaStor server.
17. Perform a drive configuration test to determine if the order of the library drives in
the configuration is correct:
a. Verify that media is present in the library. Media must be present to test the
drive configuration.
If the library is a DVD library, ensure that there is no unformatted media in the
library. Place a piece of formatted media into the library before running the
test.
b. For tape libraries only, verify that the first shelf in the library contains a data
cartridge and not a cleaning cartridge.
c. Verify that the library is offline. If the library is online, right-click the library
and select Set Offline.
d. Right-click the library and select Modify.
e. Click Yes on the confirmation message.
The Library Configuration page of the Hardware Wizard appears.
f. Click Next to move through the Hardware Wizard until you reach the Library
Drives page.
g. Click Test Config.
A warning message appears.
h. Ensure that the first shelf in the library contains valid media and click Yes to
continue.
A status message appears while the library and its drives are assessed. After
the test is complete, a message appears to indicate whether the test succeeded.
i. Click OK.
If the configuration test fails, review the configuration verification steps in the
MediaStor Administrator online help to ensure that the configuration meets
the necessary requirements.
108 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Note: MediaStor stores which shelves contain media and the applicable media labels in the
Microsoft Windows registry on the MediaStor server. When a library inventory takes place,
MediaStor checks each shelf for changes in the status of the shelves or the media. For
shelves selected for inventory, MediaStor mounts the media and reads the labels.
3. If you do not want to perform a full inventory of all shelves, full and empty, upon
setting the library online, clear the Force a reset of hardware media inventory
checkbox.
4. Click OK. One of the following occurs:
• If you kept the defaults, the library is inventoried and set online.
• If you changed the defaults, a warning message appears. To return to the Set
Library Online dialog box and change the selections, click No. To continue
setting the library online, click Yes.
Note: During the inventory, media is not mounted to a library drive that is offline. This is
helpful for troubleshooting, repair, and maintenance of library drives without deleting the
library from MediaStor. Never service any device while it is online, including offline drives
that reside in an online library.
110 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
You may be required to restart the server to enable changes to be made to the SCSI
configuration.
8. If necessary, set the drive online:
a. Open the MediaStor Administrator.
b. Right-click the drive and select Set Online.
c. Click Yes on the confirmation message.
4. In the Computer Name text box, type the name of the MediaStor server, or click
Browse to browse for the server.
5. Click Next.
6. Review the summary information and click Finish.
A progress message appears, and then the media service is listed in the Configure
Media Services dialog box.
“Managing the lifecycle of removable media” on page 120 provides details on
adding media to the library and migrating files to the media with DiskXtender.
112 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
DiskXtender server
Extended drives (Microsoft Windows)
H:\NTFS
ACSLS installed
UNIX server
RPC connection
SCSI connections
When you configure an ACSLS media service in DiskXtender, you designate the
connected drives as the drives that should be used by DiskXtender. Other servers
cannot access that drive.
Certain pieces of media in the ACSLS system are assigned to DiskXtender by using
ACSLS.
When DiskXtender requires a particular piece of media, DiskXtender requests that
media from ACSLS. ACSLS retrieves the media and places it in the drive connected to
the DiskXtender server. DiskXtender then communicates directly with the drive and
initiates all media-related tasks without any involvement from ACSLS.
Note: If an error appears indicating that the library (in other words, the ACS) is offline when
DiskXtender tries to mount a piece of media in an LSM, clear the error state. This brings the
media back online even if the LSM is offline.
Note: If the ACSSS Console does not appear automatically, right-click the background and
select Terminal from the Tools menu.
114 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
The necessary drive information is in the first and last columns (the Identifier and
Type columns, respectively). The numbers listed in the Identifier column
represent the ACS, LSM, panel, and drive, in that order. The value in the Type
column represents the drive name.
2. Record the information from those columns for the drives attached to the
DiskXtender server.
3. On the DiskXtender server, open the Registry Editor:
a. Open the Windows Start menu and select Run.
The Run dialog box appears.
b. In the Open text box, type regedit and click OK.
The Registry Editor appears.
4. Navigate to HKEY_LOCAL_MACHINE\HARDWARE\DEVICEMAP\Scsi.
5. Select the SCSI key.
6. From the Edit menu, select Find.
7. In the Find What text box, type the drive name that you requested on the ACSLS
server (for example, 9840) and click Find Next.
8. Use one of the paths that you find to construct the device name in the following
format:
SCSI.Port.Bus.Target.LogicalUnit
where:
• Port is the value at the end of the Scsi Port key name.
• Bus is the value at the end of the Scsi Bus key name.
• Target is the value at the end of the Target Id key name.
• LogicalUnit is the value at the end of the Logical Unit Id key name.
For example, to construct the device name for drive 9840, you might find the
value 9840 in the following registry path:
HKEY_LOCAL_MACHINE\HARDWARE\DEVICEMAP\Scsi\Scsi Port 2\Scsi Bus
0\Target Id 2\Logical Unit Id 0
The device name that you would construct from this path would be SCSI.2.0.2.0.
This is the device name that you type in the Device Name text box of the ACSLS
Drive Properties dialog box when you configure the media service in
DiskXtender.
116 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
6. On the ACSLS server, verify the settings described on the Verify ACSLS
Configuration page.
7. Click Next.
The Configure ACSLS Drives page appears, as shown in Figure 40 on page 117.
8. Click Add.
The ACSLS Drive Properties dialog box appears, as shown in Figure 41 on
page 118.
9. Type the device name and SCSI address that you collected in “Gathering ACSLS
drive information” on page 114.
10. Click OK.
The Configure ACSLS Drives page appears with the drive listed.
11. Repeat step 7 through step 9 for each drive that is connected to the DiskXtender
server.
12. Click Next.
13. Review the summary information and click Finish.
A progress message appears, and then the media service appears in the
Configure Media Services dialog box.
14. Click Close.
118 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Note: To add DVD-ROM media to the system and make the files available on the extended
drive, create a standard media group and select DVD-R as the media type for the group.
5. DiskXtender moves files to the media until the media is considered full.
6. The full media remains in the media group. This enables continued access to the
files on the media.
7. (Optional) If necessary, rename the media. “Renaming media” on page 137.
120 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
8. (Optional) If the media is formatted with the UDF file system and it becomes
corrupt, you can attempt to repair the media by using Check Disk. “Repairing
corrupt media” on page 137 provides instructions.
9. (Optional) To reuse the media, compact and reformat the media. This may be
necessary if there is an excessive amount of wasted space on the media. “Reusing
media” on page 138 provides instructions.
10. If the media is DVD-R, finalize the media when it becomes full to stabilize the
media and purge the files from the extended drive. “Finalizing DVD-R media” on
page 145 provides details.
11. (Optional) If you no longer need the files that have been migrated to the media, or
if you want to move the files to a different piece or type of media, remove the
media from the media group. There are two ways to remove media from a media
group:
• To copy the files on the media back to the extended drive and move the files to
other media, compact the media. The media is automatically removed from
the media group during compaction. “Removing media but keeping the files
on the drive” on page 247 provides instructions.
• To remove the files on the media from the extended drive altogether, remove
the media from the media group. “Removing media and removing its files
from the drive” on page 249 provides instructions.
12. (Optional) Deallocate the media from the extended drive, and delete it from the
media service. “Deallocating media from an extended drive” on page 147
provides instructions.
13. (Optional) Remove the media from the hardware device. “Removing media from
a MediaStor library” on page 149 provides instructions.
Note: If you have a tape library, do not insert a data cartridge into a shelf that is reserved for
cleaning cartridges.
3. Click Insert.
The Insert Library Media dialog box appears, as illustrated in Figure 44 on
page 122.
4. Choose whether to insert the media to specific shelves or to the first available
shelves:
• To insert media to specific shelves, select Insert media to specified shelves,
and then type the shelf numbers in the Shelves text box.
• To automatically insert media to available shelves, select Insert media to first
available shelves, and then type the number of the shelves in the Quantity
text box.
5. Click OK.
6. Insert the media into the library, and then click OK on the confirmation message.
7. If necessary, set the library online again by using the instructions in “Setting the
library online and inventorying the library” on page 108.
122 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Figure 45 MediaStor Media Service Properties dialog box – Media List tab
Media that is not yet allocated to an extended drive appears with no entry in the
Application Pool column.
5. Select the media and click Allocate.
The Select Extended Drive dialog box appears, listing all available extended
drives.
6. Select the extended drive and click OK.
7. Click OK on the Media Service Properties dialog box.
The Configure Media Services dialog box appears.
8. Click Close.
Note: To allocate media to a DiskXtender extended drive from the MediaStor Administrator,
select the media from the Scratch Pool and drag it to the application pool for the extended
drive.
Note: If the ACSSS Console does not appear automatically, right-click the background and
select Terminal from the Tools menu.
2. In the ACSSS Command Processor Window, type the following command and
press Enter:
set owner "DX_ServerName_DriveLetter" VOL MediaRange
where ServerName is the name of the DiskXtender server, DriveLetter is the letter
of the extended drive to which you are assigning the media, and MediaRange is
the range of media numbers to assign.
The command should look similar to this:
set owner "DX_XtenderServer_E" VOL 060945-060948
124 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Note: Formatting double-sided optical media in a stand-alone drive formats only one side of
the media. You must dismount, flip, and format the reverse side as well. To avoid confusion,
always format both sides of double-sided media at the same time.
DVD-R UDF
DVD-RAM • OTG
• UDF
MO WORM • OTG
• UDF
Tape OTG
Tape-WORM OTG
Note: DVD-ROM can be read by DiskXtender only if it is written by using the UDF file system.
DVD-ROM must be created in another system. DiskXtender cannot write to DVD-ROM.
OTG file systems are sequential, meaning that files are written contiguously from the
beginning to the end of each piece of media, with single-seek read and write access.
As a result, runtime overhead is very low and data is sequentially organized,
enhancing overall performance.
When you edit a file that has been written to media formatted with an OTG file
system, DiskXtender does not edit the file data on the media. Instead, when a file is
edited, the file is written as a new file to the next blank area on the media, and the file
tag on the extended drive is updated to point to the new file. The old file data still
remains on the media, but is orphaned. The only exception to this is when a file is
renamed on rewritable media. In that case, the file trailer on the media, where the
filename is kept, is updated to reflect the new filename.
When you delete a file that has been written to media that has been formatted with
the OTG file system, the file and its data are deleted only from the extended drive.
They are not removed from the media. Deleting the file on the extended drive
removes the file tag, which contains the location information for the file on the media.
Without the file tag, DiskXtender can no longer track that file on the media (even
though the data is still there), and the file on the media is orphaned.
Overwritable • MO
• UDO
• DVD-RAM
Sequential • DVD-R
• MO WORM
• UDO WORM
126 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
With the overwritable UDF file system, DiskXtender writes files to any available
location on the media and can overwrite and delete files.
With the sequential UDF file system, DiskXtender writes files in sequential order on
the media, and does not edit files. Instead, DiskXtender adds edited files as new files
to the next blank space on the media (functioning much like the “OTG file systems”
on page 126). In addition, when you delete a file that has been written to media
formatted with the UDF sequential file system, the file and its data are deleted only
from the extended drive and are not removed from the media. Deleting the file on the
extended drive removes the file tag, which contains the location information for the
file on the media. Without the file tag, DiskXtender can no longer track that file on the
media (even though the data is still there), and the file is orphaned.
Note: When writing to media that is formatted with the UDF file system, DiskXtender supports
a shorter path and filename than the extended drive supports. DiskXtender supports 259
UTF-16 characters on the extended drive, but only 127 UTF-16 characters when writing files to
media with the UDF file system. “Path and filename length limitations” on page 190 provides
details.
Table 13 on page 128 lists the status of the media, depending on the Available Media
tree node under which it is listed.
Available Media
tree node Media status Required steps for the media
Original Media has been formatted and Media can be added to a media group for file migration
labeled. and file fetches.
Copy Media is a copy of a piece of DiskXtender updates the media as necessary to ensure
original media, with the same data that it matches the original. The copy can be promoted to
but a different serial number. an original if the original becomes unreadable. “Copying
removable media” on page 390 provides instructions for
copying media.
Duplicate Media has the same serial number The presence of duplicate media likely indicates a
as another piece of media. problem in the system. Contact EMC Customer Service
by using the Powerlink website for assistance.
Blank Media has been formatted but not Label the media to make it a piece of original media, or
yet labeled. label it as a copy of a piece of original media. You can
also reformat the media.
Foreign Media has been formatted for a file If DiskXtender supports the type of media, format foreign
system that is not supported for media with a supported file system, and then label the
that media type. media.
Unknown DiskXtender does not recognize The problem could be an unsupported media type or an
the media. unsupported file system. Ensure that the media type is
supported, and format the media with a supported file
system. Then label the media.
Corrupt DiskXtender recognizes the media Media corruption most often occurs as a result of a power
but cannot use it because of failure while files are being written to the media. Perform
problems with the media itself. a Check Disk media task on the media to attempt to find
and repair the errors.
Note: The Media Prepare Manager is available only for media in a library configured
through the MediaStor media service.
◆ To format and label a single piece of unformatted media, assign the Format and
Label media tasks to the media. “Assigning the Format and Label media tasks”
on page 133 provides details.
128 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
◆ To format but not label a single piece or multiple pieces of unformatted media,
assign a Format media task to the media. You can then enable automatic labeling
of the media through a media group, or you can label the media individually
later by assigning a Label media task. “Assigning the Format and Label media
tasks” on page 133 and “Automatically labeling media and adding it to a media
group” on page 135 provide details.
◆ To label a single piece of blank media, assign a Label media task. “Assigning the
Format and Label media tasks” on page 133 provides details.
◆ To set up automatic labeling and addition of blank media to a media group, use
the Automation tab of the Media Group Properties dialog box. “Automatically
labeling media and adding it to a media group” on page 135 provides details.
2. Select the library that contains the media and click Next.
The Media Prepare Manager – Select Media page appears, as illustrated in
Figure 48 on page 130.
Note: Double-sided media do not appear in the list if either side of the media is not
available for format or label (for example, one side is assigned to a media group, while the
other side is not).
130 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
132 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
8. Choose when to format and/or label the media; either as soon as possible or
when the media task schedule is active.
9. Click Next.
10. Review the summary information and click Finish.
Note: You can assign the Format task to multiple pieces of media at once. However, you
can assign the Label task to only one piece of media at a time. As a result, you can assign
both tasks at once to only a single piece of media.
4. From the File System drop-down list, select the file system with which to format
the media.
If the media is already formatted with a supported file system, the file system is
selected automatically in the File System drop-down list. Otherwise, the default
file system, which is the OTG file system, is selected.
10. Type a label for the media in the Media Name text box.
11. In the When To Process section of the Media Tasks dialog box, select the same
scheduling option that you selected for the Format media task.
134 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
12. (Optional) To add the media to a media group after it is labeled, assign an Add to
Media Group media task to the media:
a. Select ADD TO MEDIA GROUP from the Next Task drop-down list, and
then click Add Next Task.
The Add to Media Group task appears below the Label task in the task list of
the Media Tasks dialog box.
b. From the Media Folder drop-down list, select the media folder containing the
media group to which the media should be added.
c. From the Media Group drop-down list, select the media group to which the
media should be added.
d. In the When To Process section of the Media Tasks dialog box, choose the
same scheduling option that you selected for the Format and Label media
tasks.
13. Click Next.
The Order Media in Task Queue page appears with the recently added media at
the bottom of the media task queue list.
14. (Optional) Promote or demote the media in the list to change the order in which
tasks are processed by clicking the up or down arrow to the right of the list box.
15. Click Finish.
All media with tasks assigned appear in the Media Task Queue Manager until
they are processed. Media with tasks selected to process as soon as possible may
appear only briefly in the queue before the processing completes.
136 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Renaming media
You can rename media through the Administrator without the Format and Label
media tasks. The following topics provide details.
Note: Renaming original media does not rename any copy media associated with the original.
The copies are updated, but the media names no longer match. In addition, you cannot rename
copy media.
3. Choose whether to report errors to the media log or to both report and fix any
errors that are found.
4. Choose whether to process the media task as soon as possible or when the next
media task schedule is active.
By default, the media task schedule is active at the same time as the file migration
schedule (daily from 8 P.M. to 8 A.M). You can change the schedule by using the
instructions in “Scheduling file migration” on page 244.
5. Click Next.
The Order Media in Task Queue page appears with the recently added media at
the bottom of the media task queue list.
6. (Optional) Promote or demote the media in the list to change the order in which
tasks are processed by clicking the up or down arrow to the right of the list box.
7. Click Finish.
All media with tasks assigned appear in the Media Task Queue Manager until
they are processed. Media with tasks selected to process as soon as possible may
appear only briefly in the queue before the processing completes.
Reusing media
To ensure the most efficient use of media, you may want to eliminate wasted space on
the media by compacting and reformatting the media. The following topics provide
details:
◆ “When media reuse is necessary” on page 139
◆ “Understanding the media reuse process” on page 139
◆ “Automatically reusing media” on page 140
◆ “Monitoring and manually reusing media” on page 142
138 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
IMPORTANT
If you allow folder renames on media that does not support folder renames, then
do not compact the media. Data loss might occur because DiskXtender will not
find the corresponding file tags on the extended drive, so the files will not be
copied back to the drive.
DiskXtender then evaluates the file against configured move rules. Because the files
have already been written to media once, they usually qualify for migration as soon
as they are copied back to the extended drive. This means that the files are migrated
back to media as soon as the file migration schedule is active (and a background scan
occurs, if an age delay is configured for the assigned move rules).
When DiskXtender finishes evaluating each file on a piece of media during
compaction, the media is automatically removed from the media group to which it is
assigned. The media can then be reformatted, labeled, and assigned to a media group.
This enables DiskXtender to begin migrating new files to the media.
Note: You can compact other removable media types, including DVD-R, MO WORM, UDO
WORM, and tape-WORM. However, you cannot reformat those media types. After the files are
copied back to the extended drive through compaction and the media is removed from its
media group, it remains assigned to the extended drive. The files also remain on the media.
You can deallocate the media and remove it from the system. If you add the media to a media
group again instead, the files are restored—again—to the extended drive, and DiskXtender
continues writing files to the media from the point at which it last stopped. As a result, you
cannot reuse these media types.
You can configure DiskXtender to automatically reuse media based on the amount of
wasted space on the media. You can also monitor the media by using DiskXtender
reports, and then manually perform the steps to reuse the media at the appropriate
time.
140 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Note: If media compaction fails, some, all, or none of the files from the media might have
been moved back to the extended drive. If you can determine the cause of the compaction
failure, make the appropriate adjustments and reschedule the compaction. The compaction
process starts over, but any files already copied back to the extended drive are not
duplicated. In addition, all files that have been compacted are re-migrated to media as they
qualify for movement.
142 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
4. Choose whether to process the media task as soon as possible or when the next
media task schedule is active.
By default, the media task schedule is active at the same time as the file migration
schedule (daily from 8 P.M. to 8 A.M). You can change the schedule by using the
instructions in “Scheduling file migration” on page 244.
5. Select FORMAT from the Next Task drop-down list, and then click Add Next
Task.
The Format task appears below the Compact task in the task list of the Media
Tasks dialog box, as illustrated in Figure 58 on page 143.
6. From the File System drop-down list, select the file system with which to format
the media.
7. Leave the Force low-level SCSI format checkbox clear to perform a quick format
on the media. A low-level SCSI format is not necessary.
8. If the library and file system support it, choose whether to enable compression for
the media by selecting or clearing the checkbox.
9. To reformat a piece of tape media as tape-WORM, select the Convert this media
to WORM checkbox. This option is available only if you are formatting the media
in a Quantum DLT-S4 drive.
Note: Once tape has been formatted and converted to tape-WORM, it cannot be converted
back to tape. However, a tape can be reformatted and converted to tape-WORM.
10. In the When To Process section of the Media Tasks dialog box, select the same
scheduling option that you selected for the Compact media task.
11. Select LABEL from the Next Task drop-down list, and then click Add Next Task.
The Label task appears below the Format task in the task list of the Media Tasks
dialog box, as illustrated in Figure 59 on page 144.
Figure 59 Label media task after Compact and Format media tasks
12. Type a label for the media in the Media Name text box.
13. In the When To Process section of the Media Tasks dialog box, select the same
scheduling option that you selected for the Compact and Format media tasks.
14. Click Next.
The Order Media in Task Queue page appears with the recently added media at
the bottom of the media task queue list.
15. (Optional) Promote or demote the media in the list to change the order in which
tasks are processed by clicking the up or down arrow to the right of the list box.
16. Click Finish.
All media with tasks assigned appear in the Media Task Queue Manager until
they are processed. Media with tasks selected to process as soon as possible may
appear only briefly in the queue before the processing completes.
17. Add the media to a media group as discussed in “Adding media to a standard
media group” on page 232.
144 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
3. Choose whether to purge the file data for the files written to the media
immediately upon finalization by selecting or clearing the Purge Files checkbox.
If you leave the checkbox clear, the files remain on the extended drive until they
qualify for configured purge rules.
Chapter 11, “Purging Files,” provides details on choosing an appropriate purge
strategy for your environment.
4. Choose whether to set the Direct Read attribute for the piece of media by selecting
or clearing the Direct Read checkbox.
Direct Read is strongly discouraged in most environments. Review the
recommendations in “Reading files directly from media” on page 313 before
selecting this option.
5. Choose whether to process the media task as soon as possible or when the next
media task schedule is active.
146 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
By default, the media task schedule is active at the same time as the file migration
schedule (daily from 8 P.M. to 8 A.M). You can change the schedule by using the
instructions in “Scheduling file migration” on page 244.
6. Click Next.
The Order Media in Task Queue page appears with the recently added media at
the bottom of the media task queue list.
7. (Optional) Promote or demote the media in the list to change the order in which
tasks are processed by clicking the up or down arrow to the right of the list box.
8. Click Finish.
All media with tasks assigned appear in the Media Task Queue Manager until
they are processed. Media with tasks selected to process as soon as possible may
appear only briefly in the queue before the processing completes.
! IMPORTANT
If the Finalize task fails, do not attempt to retry the task. Media that fails
finalization might have a problem that will require it to be removed from the
system. If you remove media that has failed finalization, the files are
demigrated (migration information is stripped from them so that they appear
as if they have not been migrated), making them eligible for remigration to
other media.
Note: To deallocate media from a DiskXtender extended drive by using the MediaStor
Administrator, select the media from its application pool and drag it to the Scratch Pool.
The placeholder x represents the ACS ID. A list showing the owner of each piece
of media appears, as shown in the following example:
VOLUME REPORT UTILITY
2004-06-04 11:06:52
TOTAL VOLUMES: 2 SEQUENCE: sort by volume identifier
Volume Volume Owner
Label: Status: ID:
000182 VOLUME_HOME SYSTEM
004022 VOLUME_HOME DX_DXSERVER_E
In this example, the media with volume label 000182 is currently unassigned. The
media with volume label 004022 is currently assigned to DX_DXSERVER_E (the
extended drive E on the server DXSERVER).
3. In the ACSSS Command Processor Window, assign the media to the ACSLS
system. Type the following command and press Enter:
set owner "System" VOL MediaRange
In this command, the placeholder MediaRange represents the range of numbers for
the media to deallocate. The following example assigns the media numbered
from 060945 to 060948 to the system, which deallocates it from the extended
drive:
set owner "System" VOL 060945-060948
When the new assignment is completed, the following message appears in the
ACSSS Command Processor Window:
"Set: set completed, Success."
148 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Note: If a library has no mailslot, special considerations for ejecting media apply. Set the library
offline before you manually remove media from the shelf or magazine. After you remove the
media, set the library back online and reinventory the library.
Note: If specific shelves are selected in the Manage Library Media dialog box when you
click Eject, MediaStor automatically enables the Eject media from specified shelves
option and automatically enters those shelf numbers in the Shelves text box.
150 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Table 14 Extended drive operations for files migrated to MO and UDO media
When the MO or UDO media is formatted with the UDF file system, all changes to
the files and folders on the extended drive are propagated to the files and folders on
the media.
When the MO or UDO media is formatted with the OTG file system, file renames and
attribute changes are propagated to the files on the media. However, file edits and
deletions, as well as folder deletions, are not propagated. Instead, when a file is
edited, the file is written as a new file to the next blank area on the media, and the file
tag on the extended drive is updated to point to the new file. The old file data still
remains on the media, but is orphaned. Similarly, when a file is deleted on the
extended drive, the file and its data are deleted only from the extended drive. They
are not removed from the media. Deleting the file on the extended drive removes the
file tag, which contains the location information for the file on the media. Without the
file tag, DiskXtender can no longer track that file on the media (even though the data
is still there), and the file on the media is orphaned.
Note: For files that are moved to MO WORM or UDO WORM devices, you can prevent the
delete operations performed on the files in the extended drive from propagating to the media
devices. “Prevent delete from media” on page 325 provides details.
“Supported file systems” on page 125 provides details on system behavior in this
scenario.
Table 15 Extended drive operations for files migrated to MO WORM or UDO WORM media
When the MO WORM or UDO WORM media is formatted with the UDF file system,
file and folder deletions on the extended drive are propagated to the media. If you
rename a folder or set file attributes on the extended drive, however, then the rename
is not propagated.
When the MO WORM or UDO WORM media is formatted with the OTG file system,
file deletions and attribute changes are allowed on the extended drive. However,
these operations are not propagated to the media. When a file is deleted on the
extended drive, the file and its data are deleted only from the extended drive. They
are not removed from the media. Deleting the file on the extended drive removes the
file tag, which contains the location information for the file on the media. Without the
file tag, DiskXtender can no longer track that file on the media (even though the data
is still there), and the file on the media is orphaned.
“Supported file systems” on page 125 provides details on system behavior in this
scenario.
Table 16 Extended drive operations for files migrated to tape or tape-WORM media
152 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Attribute changes and file and folder deletions are allowed on the extended drive.
However, these operations are not propagated to the media. “Supported file systems”
on page 125 provides details on system behavior in this scenario.
Attribute changes and file and folder deletions are allowed on the extended drive for
files migrated to DVD-R and DVD-ROM media. However, these operations are not
propagated to the media.
When DVD-RAM media is formatted with the UDF file system, all changes to the
files and folders on the extended drive are propagated to the files and folders on the
media.
When DVD-RAM media is formatted with the OTG file system, attribute changes are
propagated to the files on the media. However, file and folder deletions are not
propagated. When a file is deleted on the extended drive, the file and its data are
deleted only from the extended drive. They are not removed from the media. Deleting
the file on the extended drive removes the file tag, which contains the location
information for the file on the media. Without the file tag, DiskXtender can no longer
track that file on the media (even though the data is still there), and the file on the
media is orphaned.
“Supported file systems” on page 125 provides details on system behavior in this
scenario.
What happens when you edit or move files that have been migrated to removable media
Keep in mind the following important points when working with files that have been
moved to removable media, and the folders in which those files are located:
◆ “Supported file systems” on page 125 provides details on system behavior when
files are edited on the extended drive. This behavior depends on the type of
media to which the file has been migrated, as well as the file system on the media.
◆ If you move a purged file to another location within the same media folder by
dragging and dropping the file in Microsoft Windows Explorer, then the file is
fetched to the extended drive. This behavior is caused by Windows Explorer. If
you move a purged file to another location within the same media folder by
using the command line, then the file is not fetched.
If you move a folder with purged files to another location within the same media
folder, however, then the files in the folder are not fetched.
154 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Option Description
Library mount - minimum This option controls the minimum number of KB of free space that must be available
free space on media (KB) on a piece of media for DiskXtender to request that the media service mount that
media to write files to it. The default value is 32 KB.
This setting only controls whether DiskXtender requests the media be mounted
specifically for media writes. If the media is already mounted when the file moves
are activated, DiskXtender attempts to write to the media regardless of the amount
of free space on the media.
Library mount - minimum This option controls the minimum number of files that must be on the move list
number of files before the media in the media group is mounted for file writes. The default value is
one file.
This setting only controls whether DiskXtender requests the media be mounted
specifically for media writes. If the media is already mounted when the file moves
are activated, DiskXtender attempts to write to the media regardless of the number
of files on the move list.
Media fill method Leave the media fill method set to sequential to fill media one at a time in the order
they appear in the tree view of the File System Manager Administrator or on the
Items tab of the Media Group Properties dialog box.
Sequential fill is designed to maximize file retrieval times for library media.
Option Description
Auto-finalize DVD-R media If you use DVD-R, this option controls whether you automatically finalize a piece of
after marking full media after it is marked as full. Media is automatically marked full when the amount
of free space falls below 1 MB, as configured on the Mark media full when free
space falls below option for media groups.
If you do not automatically finalize full media, you must manually assign a Finalize
media task to the media to finalize it.
“Finalizing DVD-R media” on page 145 provides details.
Purge files after If you choose to automatically finalize DVD-R media when it is full, you can
auto-finalizing media automatically purge all files on the media from the extended drive after the media is
finalized.
Purge files automatically after finalization only if it is likely they will no longer be
accessed. If users are likely to continue accessing the files on the finalized media,
then configure purge rules instead to purge the files when they are no longer being
used. Chapter 11, “Purging Files,” provides details.
Note: Even if you enable automatic purging of files after finalization, you should still
configure purge rules. If a purged file is fetched from finalized media, it cannot be
purged again unless it qualifies for a purge rule.
Direct read files after If you choose to automatically purge files after DVD-R is automatically finalized,
auto-finalizing media then you can also mark those files for Direct Read. Direct Read is strongly
discouraged in most environments. Review the recommendations in “Reading files
directly from media” on page 313 before enabling this option.
156 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
Note: Even if you enable automatic purging of files after finalization, you should still
configure purge rules. If a purged file is fetched from finalized media, it cannot be purged
again unless it qualifies for a purge rule.
Note: Some of the options listed above are available only when Advanced mode is turned on.
The options apply at the service level. This means that you cannot customize the
option for each media service configured. For example, if you configure multiple
MediaStor media services with different DVD libraries connected to each media, the
drive saver setting applies for all of them.
Drive saver The drive saver options enable you to specify how long DiskXtender waits after
media becomes inactive before it automatically spins down the media. The default
value is 5 minutes.
Automatically spinning down media means that the media is still mounted but lies
idle until the media is requested by DiskXtender or dismounted.
Timeslice - minimum The minimum mount timeslice options enable you to specify the minimum amount
mount of time DiskXtender keeps removable media in a drive after it has been mounted.
This means that the media is mounted for at least the amount of time you specify.
DiskXtender does not automatically dismount the media, and you cannot dismount
the media before the time limit is up.
158 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Optical and Tape Devices
For DVD and optical media, the default value is 30 seconds. For tape media, the
default value is 300 seconds.
Timeslice - last fetch The last fetch timeslice options enable you to specify the amount of time removable
media must remain mounted in a drive after DiskXtender has fetched data from that
media.
This means that the media is not dismounted immediately after a fetch. Instead,
DiskXtender waits at least the entered amount of time before dismounting the media.
For DVD and optical media, the default value is 5 seconds. For tape media, the
default value is 60 seconds.
Timeslice - maximum The maximum mount timeslice options enable you to limit the amount of time that
mount removable media can stay mounted in a drive if it is inactive and has no pending
fetches, and if there is other media that has pending fetches.
This enables DiskXtender to dismount inactive media in favor of other media that is
being requested.
The default value for DVD and optical media is 60 seconds. The default value for tape
media is 1,200 seconds.
Tape block size The tape block size default value enables you to configure the size settings
default value DiskXtender uses for formatting tape and tape-WORM media.
The value you use dictates the default block size of tape and tape-WORM media that
DiskXtender uses to format the media when the Media Prepare Manager or the
Format media task are run.
The default value is 64 KB.
Use hardware If the tape hardware device you use supports data compression, you can configure
compression DiskXtender to compress data with the Use hardware compression option.
Data compression enables DiskXtender to store data in a format that requires less
space than usual.
160 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
5
Connecting to Tivoli
Storage Manager
If you use IBM Tivoli Storage Manager (TSM) as a data storage or data backup
system, you can migrate files on a DiskXtender extended drive to the TSM server.
TSM can subsequently move the files to storage devices managed by the TSM server.
The following topics provide details on configuring and managing the environment:
◆ How DiskXtender works with TSM ......................................................................... 162
◆ Installing the TSM Backup/Archive Client............................................................. 163
◆ Adding a TSM media service .................................................................................... 165
◆ Managing the lifecycle of TSM media...................................................................... 168
◆ Expectations for files migrated to TSM.................................................................... 172
◆ Performance tuning for TSM ..................................................................................... 173
DiskXtender server
Extended drives (Microsoft Windows)
DiskXtender installed
G:\NTFS Tivoli Storage Manager
Backup/Archive Client installed
H:\NTFS
TSM server
TCP/IP connection
SCSI connection
Storage device
GEN-000944
After you create a TSM media service in DiskXtender to create the connection
between DiskXtender and a TSM server, you must create virtual TSM media. The
virtual media does not correspond to a physical piece of media in the TSM system,
such as a tape cartridge. Instead, the virtual media is designed to simulate divisions
of the larger repository (the TSM server) and corresponds to a filespace on the TSM
server. The maximum size of a piece of virtual TSM media is 256 GB. This enables you
to take advantage of the flexible file migration features available in DiskXtender.
The TSM server manages the actual physical removable media in the storage device
attached to the TSM server. Tasks like formatting, labeling, and copying media in the
storage device attached to the TSM server are performed by TSM rather than by
DiskXtender.
162 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Tivoli Storage Manager
Note: If you install DiskXtender in a Microsoft clustering environment, perform this step
and the next step on all nodes of the cluster where DiskXtender is installed.
3. In the TSM Backup/Archive Client, set the Allow Backup Delete option to Yes.
Otherwise, you receive an error when you attempt to create the TSM media
service in DiskXtender (or when you try to set the service online, if the setting is
changed after the service is created).
4. Copy the dsm.opt file from the BACLIENT subdirectory of the TSM client
installation directory to the BIN subdirectory of the DiskXtender installation
directory (Drive:\Program Files\EMC\DiskXtender\BIN, where Drive is the
system drive on the DiskXtender server).
If you are planning to connect to multiple TSM servers, or if you are planning to
use multiple TSM media services based on different profiles (policies) created on
the same TSM server, then create a uniquely named dsm.opt file (such as
dsm1.opt and dsm2.opt) for each TSM server or media service.
If you are preparing an active Microsoft cluster node, and there are multiple
active nodes in the cluster, then create a uniquely named dsm.opt file for each
node. This allows for cluster failover, where one dsm.opt file is failed over and
moved to another node. Naming the files differently prevents each file from being
overwritten. You do not need to prepare a dsm.opt file for passive nodes.
5. Edit the copied dsm.opt file and change the information in Table 20 on page 163
in that file.
tcpserveraddress Type the IP address or symbolic DNS name of the TSM server.
Note: If the tcpserveraddress information in the dsm.opt file on the TSM server changes, the
change must also be made to the dsm.opt file on the DiskXtender server. The information in
the dsm.opt files must be identical. Differences between the dsm.opt files impact whether
DiskXtender can migrate files to and fetch files from the TSM server.
nodename Type the client nodename configured on the TSM server for DiskXtender.
If you are preparing an active cluster node, type the virtual server name.
In the following example, 99.9.99.999 is the IP address of the TSM server, and
DX-DXSERVER is the client nodename:
*==================================================
* tcp/ip
*==================================================
commmethod TCPIP
tcpport 1500
tcpserveraddress 99.9.99.999
nodename DX-DXSERVER
passwordaccess prompt
6. Repeat step 5 for each option file in the BIN subdirectory of the DiskXtender
installation directory.
7. Stop and restart the DiskXtender service to enable the changes to take effect.
“Starting and stopping the service” on page 339 provides instructions.
If you are adding the TSM media service to DiskXtender in a clustering
environment, the dsm.opt file on each node is automatically replicated to all other
nodes.
164 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Tivoli Storage Manager
2. Click Add.
The media service wizard appears, starting with the Select Media Service Type
page, as shown in Figure 64 on page 166.
4. In the Options File text box, specify the options file that identifies the TSM server
to connect to with this media service:
• To use the default options file, Drive:\Program
Files\EMC\DiskXtender\BIN\dsm.opt, leave the text box blank.
• To use a different options file, in the Drive:\Program
Files\EMC\DiskXtender\BIN directory, type the filename.
166 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Tivoli Storage Manager
Note: For cluster configurations, this step is necessary if you renamed the dsm.opt files as
instructed.
5. In the Client Password text box, type a client password. This is the password the
DiskXtender service uses to log in to the TSM client defined in the dsm.opt file.
Note: If necessary, you can edit the password after you create the media service by using
the TSM Information tab of the Media Service Properties dialog box. To access the TSM
Information tab, open the Service menu in the File System Manager Administrator and
select Configure Media Services. Select the TSM media service and click Properties. Then
click the TSM Information tab.
6. Click Next.
7. Review the summary information and click Finish.
A message appears to ask whether to create the media for the TSM media service
now.
8. Choose whether to create the TSM media:
• Click Yes to create the TSM media now.
The Media Service Properties dialog box appears. “Creating TSM media” on
page 169 provides details on creating the media.
• Click No to create the TSM media later.
168 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Tivoli Storage Manager
5. In the Name and Description text boxes, type a name and a description for the
virtual piece of media. The name identifies the media in the File System Manager
Administrator.
6. Select a management class from the Management Class drop-down list.
The management class you select associates the media with a policy domain,
policy set, and migration destination on the TSM server. The TSM documentation
provides more information on the use of management classes in Tivoli Storage
Manager.
7. Click OK.
8. If you have created an extended drive, allocate the media to the extended drive:
a. Select the media and click Allocate.
The Select Extended Drive dialog box appears.
b. Select the extended drive and click OK.
Note: Media does not appear in the Administrator until it is allocated to an extended drive.
170 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Tivoli Storage Manager
9. Click OK.
The Configure Media Services dialog box appears.
10. Click Close.
11. If you have created media folders and media groups, add the media to a media
group as discussed in “Adding media to a standard media group” on page 232.
Do not delete a piece of TSM media unless you are absolutely certain that you no
longer need the files on the media. If you think you might need the files, compact
the media before deleting it. Compaction writes the files on the media back to the
extended drive so that they can be migrated to another piece of media.
Note: If you attempt to delete media while the media service is offline, the changes might
not take effect.
All changes to the files and folders on the extended drive are propagated to the files
and folders on the TSM server.
Keep in mind the following important points when working with files that have been
moved to TSM, and the folders in which those files are located:
◆ When you edit a file on the extended drive, the new (edited) file is migrated to
TSM, and the original version of the file is deleted. In this way, only the newer
version of the file remains on the TSM server.
◆ If you move a purged file to another location within the same media folder by
dragging and dropping the file in Microsoft Windows Explorer, then the file is
fetched to the extended drive. This behavior is caused by Windows Explorer. If
you move a purged file to another location within the same media folder by
using the command line, then the file is not fetched.
If you move a folder with purged files to another location within the same media
folder, however, then the files in the folder are not fetched.
172 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Tivoli Storage Manager
174 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
6
Connecting to Cloud
Storage
The cloud storage can be used as a data backup system or data storage and files can
be migrated from the DiskXtender extended drive onto the cloud. The following
topics provide details on configuring and managing the environment:
◆ How DiskXtender works with cloud storage ......................................................... 176
◆ Configuring DiskXtender with EMC Atmos........................................................... 177
◆ Adding the cloud media service ............................................................................... 178
◆ Managing the lifecycle of cloud media .................................................................... 181
◆ Expectations for files migrated to cloud media ...................................................... 185
◆ Performance tuning for cloud media ....................................................................... 186
176 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Cloud Storage
How DiskXtender DiskXtender serves as a front-end and communicates with EMC Atmos using the
works with Atmos REST API, as illustrated in Figure 68 on page 177. Data is migrated to Atmos as per
the Move rules set in DiskXtender, and files are fetched back from Atmos to
DiskXtender when requested.
DiskXtender Server
Steps to connect to Perform the following steps to prepare Atmos for use with DiskXtender:
Atmos 1. Obtain the Atmos user credentials from the Atmos administrator.
The Atmos administrator needs to provide an account using which the
DiskXtender administrator can log in to the Atmos infrastructure. Multiple
accounts can be created by the Atmos administrator for various DiskXtender
users. EMC Atmos documentation provides details on how to create accounts.
2. Obtain details of the private/in-premises cloud settings if you are connecting to a
private cloud media.
Private or in-premises cloud network is an internal network which is installed
and managed within an organization. Before configuring DiskXtender with a
private cloud network, ensure you have obtained the hostname or an alias name
of the cloud service, subtenant ID, user ID, and the shared secret from the Atmos
administrator.
3. Obtain details of Atmos online/Public cloud settings if you are connecting to a
public cloud media.
A Public cloud connection is the cloud infrastructure which is used by the
organization, but managed by an external service provider. Obtain the token ID
and shared secret from the Atmos online administrator before configuring
DiskXtender with the cloud storage.
4. Perform the following steps to configure DiskXtender with Atmos:
• “Adding the cloud media service” on page 178
• “Creating cloud media” on page 181
2. Click Add.
The media service wizard appears, starting with the Select Media Service Type
dialog box, as shown in Figure 70 on page 178.
Figure 70 Media service wizard – Select Media Service Type dialog box
178 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Cloud Storage
The Select Cloud Service dialog box appears, as shown in Figure 71 on page 179.
4. In the Cloud Service Provider field, select EMC Atmos and click Next.
The Cloud Connection Parameters dialog box appears, as shown in Figure 72 on
page 179.
5. In the Cloud service URL/IP text box, type the hostname of the node of the cloud
service to connect to. You can provide hostnames of multiple access nodes,
separated by a comma. This ensures load-balancing of the storage.
Note: If you are specifying the IP address of the nodes, provide the IP address without
‘http’ or ‘https’ preceding the address.
6. In the Cloud Type option, select the type of cloud storage you are connecting to.
A Private cloud connection is a cloud network which is used and managed by an
organization internally. A Public cloud connection is the cloud infrastructure
which is used by the organization, but managed by an external service provider.
In both cases, the connection details to the cloud network are provided by the
cloud administrator.
If you are connecting to a private cloud network:
• Type the subtenant ID in the Subtenant ID field.
• Type the user ID in the UID field.
• Type the shared secret in the Shared Secret field.
If you are connecting to an Atmos online network, obtain the full token ID from
the Atmos administrator. Token ID is in the format of xyz/abc; the first part of the
token ID preceding / is the subtenant ID and the second part of the token ID
following / is the user ID:
• In the Subtenant ID field, type the first part of the Token ID.
• In the UID field, type the second part of the Token ID.
• Type the shared secret in the Shared Secret field.
7. Click Next.
8. Review the summary information and click Finish.
The media service is created.
180 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Cloud Storage
5. In the Name and Description text boxes, type a name and a description for the
virtual piece of media. The name identifies the media in the File System Manager
Administrator.
6. Click OK.
182 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Cloud Storage
7. If you have created an extended drive, allocate the media to the extended drive:
a. Select the media and click Allocate.
The Select Extended Drive dialog box appears.
b. Select the extended drive and click OK.
Note: Media does not appear in the Administrator until it is allocated to an extended drive.
8. Click OK.
The Configure Media Services dialog box appears.
9. Click Close.
If you have created media folders and media groups, add the media to a media group
as discussed in “Adding media to a standard media group” on page 232.
Do not delete a piece of media unless you are absolutely certain that you no longer
need the files on the media. If you think you might need the files, compact the
media before deleting it. Compaction writes the files on the media back to the
extended drive so that they can be migrated to another piece of media.
Note: If you attempt to delete media while the media service is offline, the changes might
not take effect.
Managing Atmos The Atmos connection parameters need to be updated in DiskXtender every time
configuration there is a change in the Atmos side.
Change shared secret Whenever there is a change in the shared secret, the new shared secret must be
updated in the cloud connection parameters, failing which, the connection to the
cloud media cannot be established. You should receive the new shared secret
periodically from the cloud administrator.
To change shared secret:
1. In the Change Shared Secret dialog box, type the new shared secret in the New
Shared Secret field.
2. Click OK to change the shared secret.
184 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Connecting to Cloud Storage
186 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
7
Extended Drive
Management
188 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
Note: The DiskXtender Search Module can index a majority of the common file types in this
list. “Supported file types for indexing” on page 273 provides a complete list of the file types
that can be indexed.
Files that are frequently accessed or changed could result in the production of lock
files or temporary files. A lock file is a file produced by an application to prevent
write access when it is already open by another user. A large number of such files can
clog the DiskXtender system or inadvertently fill the DiskXtender Recycler if it is
enabled. Therefore, the following file and data types are not recommended for use
with DiskXtender:
◆ Frequently accessed files, such as email files or files in user home directories or
temporary directories
! IMPORTANT
If you must manage these types of files with DiskXtender, then use a media
type that allows renames and provides faster performance, such as NAS.
If the sixth character in a filename is a tilde and the eighth character is either null or a
period (for example, filen~2.doc), then you can save the file to the extended drive, but
DiskXtender does not move the file to media. This typically occurs in files with
filenames that have been automatically shortened to an 8.3 format.
Files and folders with names containing these special characters - , + ; = [ ] - are not
managed by DiskXtender. Though Windows Explorer allows for these special
characters to be included in file and folder names, DiskXtender skips all the files and
folders with these special characters in their names during a background scan.
Zipped folders and files that are managed by DiskXtender do not get purged, but are
fetched back to the extended drive. This is seen when DiskXtender is installed on
Microsoft Windows 2008, and is a behavior of files and folders zipped using
Microsoft Windows Explorer. DiskXtender does not have control over this.
Files managed by DiskXtender mapped to an extended drive on a Microsoft
Windows 7 computer, do not get compressed into a folder when they are compressed
using Windows Explorer. This is seen when DiskXtender is installed on Microsoft
Windows 2008.
International DiskXtender can manage files with Unicode characters in either the filename or the
character support file data. However, characters may display incorrectly if the correct language code
pages are not installed. In addition, the application that displays DiskXtender logs
and reports (RtfPad) is not Unicode compliant. Filenames in logs and reports may
display incorrectly, even though the file data remains intact.
Some applications used with DiskXtender do not provide the same level of
international character support. Table 23 on page 190 lists some of the supported
applications with these limitations.
EMC NetWorker® PowerSnap™ Supports file system backup if filenames and directory names are ASCII
characters.
Note: If you use the DiskXtender Search Module to index and search for files on a DiskXtender
extended drive and the files include ANSI character encoding, such as Big5 (Chinese) or
Shift-JIS (Japanese), then the corresponding code page must be installed and set as the default
code page on the ISE server. If a different code page is set as the default on the ISE server, then
perform the steps in the EMC DiskXtender Search Module Release 2.0 Release Notes to enable
proper indexing and search of the ANSI-encoded files.
Verify international character support statements for all applications installed on the
DiskXtender server before you configure file migration.
Path and filename The full path and filename for a file on the extended drive should total no more than
length limitations 259 UTF-16 characters. The full path and filename includes the following
components:
Drive:\Directory1\Directory2\Filename.Extension
where Drive is the assigned volume drive letter, Directory1 and Directory2 are optional
folders on the drive, Filename is the name of the file, and Extension is the file
extension.
Note: Japanese path and filenames are limited to 145 characters or less.
190 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
DiskXtender does not prevent users from saving a file to the extended drive when the
character count for the path and filename exceeds 259 characters. However, files with
excessive paths and filenames may not be migrated to media, depending on the type
of media and the file system with which it is formatted. In addition, if the filepath for
a file on the extended drive exceeds 259 characters and the DiskXtender Recycler is
enabled, then you cannot delete the file. You must shorten the filepath or disable the
Recycler in order to delete the file.
Most types of media and media file systems support at least the same number of
characters as DiskXtender. However, when writing to media that is formatted with
the UDF file system, DiskXtender supports a shorter path and filename: only 127
characters.
Most NAS file systems support filepaths of 259 UTF-16 characters. However, if
DiskXtender is writing to a share on the NAS device, the character count of the full
filepath on the device is included in the maximum number of characters allowed. In
other words, the total character count includes the path and filename on the extended
drive and the full path to the share on the device.
Note: If the sixth character in a filename is a tilde and the eighth character is either null or a
period (for example, filen~2.doc), then DiskXtender does not move the file to media. This
typically occurs in files with filenames that have been automatically shortened to an 8.3 format.
File stream support File streams contain the data that is written to a file and give more information about
a file than attributes and properties. For example, you can create a stream that
contains search keywords or the identity of the user account that creates a file. The
NTFS file system uses file streams to store private data. Because NTFS supports file
streams, many applications now take advantage of file streams to store their data.
DiskXtender can manage files with file streams as long as the media supports file
streams. All DiskXtender media types support file streams except for some NAS
devices. In general, file streams are supported on NAS devices that use Common
Internet File System (CIFS) or Server Message Block 2.0 (SMB). If a NAS device uses a
different protocol, consult the manufacturer for guidance on file stream support.
DiskXtender support for file streams ensures that you can protect all application data
in files, not just the primary data. File streams are moved and fetched along with the
primary file data. In addition, file streams can be restored from storage media, along
with primary file data, for disaster recovery purposes.
Note: You cannot directly read files with streams from media by using the Direct Read feature
in DiskXtender. You can set the Direct Read attribute for these files. However, when the file is
requested, it is fetched to the extended drive instead of being read directly from the media. In
addition, the Direct Read attribute is removed.
If a NAS device configured with DiskXtender does not support file streams, then the
file is not moved to media. In addition, a warning message is listed in the event logs
to notify you that the file could not be moved to media.
Encryption DiskXtender can manage encrypted files on the extended drive as long as the files are
not encrypted with an on-the-fly encryption (OTFE) method, also called real-time
encryption. This type of encryption prevents DiskXtender—specifically the
DiskXtender service account—from gaining access to the files to manage them.
Microsoft Windows DiskXtender supports the offline files feature available in several Windows operating
offline files systems. When users access the extended drive, they can configure files or folders on
the extended drive as offline files. This enables users to access the files when their
machines are not connected to the network. When the machines reconnect to the
network, any changes that were made to the files are updated on the extended drive.
When you configure a purged file as an offline file, the file is fetched.
DiskXtender continues to migrate, fetch, index, purge, and otherwise manage files
that are configured as offline files. The files are updated on media and on the ISE
server, if necessary, when they are synchronized back to the extended drive and are
no longer offline.
Note: When you rename an offline file and the file contains file streams, then the file streams
are lost when you reconnect to the network and update the file on the extended drive. This
issue occurs regardless of whether DiskXtender is installed on the server.
Microsoft Windows DiskXtender is supported in a Microsoft Windows Distributed File System (DFS)
DFS links environment. However, DiskXtender manages only the files that are physically
located on the server where it is installed. It does not manage files on other servers
that are connected to it by DFS links. For example, the following configurations are
supported:
◆ The DFS link is on a server where DiskXtender is not installed (Server A), and the
link points to an extended drive on a server where DiskXtender is installed
(Server B).
Users can use the DFS link on Server A to access the files on Server B, even if the
files have been purged.
DiskXtender manages only the files on Server B.
◆ The DFS link is on an extended drive on a DiskXtender server (Server A), and the
link points to another server (Server B).
Users can use the DFS link on Server A to access the files on Server B.
The DiskXtender installation on Server A manages all of the files that are saved
locally to its extended drive. However, it does not manage the files on Server B.
192 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
4. To assign media to the extended drive, select the media and click Next. Or, click
Next without selecting media.
The Settings page appears, as shown in Figure 77 on page 194.
194 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
5. Click Schedule to configure the following schedules for the extended drive:
• Migration of files from the drive to storage media
• Media task processing (formatting, labeling, and so on)
• Updates to copies of removable media
• File fetch activity
“Scheduling file migration” on page 244 provides instructions for configuring the
schedules.
Note: Most environments do not require extended drive metadata exports. Review the
information in “When to use metadata exports” on page 385 to determine whether
metadata exports are an appropriate part of the backup strategy for your DiskXtender
environment. If so, you can schedule metadata exports after you create the extended drive.
“Scheduling metadata exports” on page 386 provides instructions.
6. Click Default Exclude Rules to select the default file types to exclude from
migration to media. You can select the following file types to exclude from
migration:
• .EXE (executable files)
• .PST files
• Desktop configuration file, desktop.ini
• System files (files whose ‘system’ attribute is set)
• Files of zero byte size
7. Click Next.
The Options page appears, as shown in Figure 78 on page 195.
8. Review the list of options, and make any necessary changes to the defaults. To
configure an option, select the option from the list, and then type or select a new
value for the option in the controls below the list.
The File System Manager Administrator online help provides details on each of
the options.
You can also configure the options after you create the extended drive by opening
the Extended Drive Properties dialog box and selecting the Options tab.
9. Click Next.
The Indexing page appears, as shown in Figure 79 on page 196.
The Indexing page enables you to configure a connection to the Index and Search
Engine (ISE) server if you are planning to index and search for files on the
extended drive by using the DiskXtender Search Module.
10. If you have already installed and configured the DiskXtender Search Module,
configure the connection to the ISE server. Otherwise, proceed to the next step.
a. In the Index Server Name text box, type the name of the ISE server.
b. In the Index Collection text box, type the name of the index collection for the
extended drive.
c. Select the Enable content indexing of files on this extended drive checkbox.
d. Set a schedule for when files should be submitted to the ISE server for
indexing.
Chapter 10, “Indexing Files,” provides details on enabling indexing.
11. Click Next.
12. Review the summary information and click Finish.
196 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
Note: After you create an extended drive, you can edit it by right-clicking the drive in the
File System Manager Administrator and selecting Properties. The Extended Drive
Properties dialog box appears, and contains tabs that correspond to the pages of the
wizard you used to create the drive. The Extended Drive Properties dialog box also
contains two additional tabs that provide general information about the extended drive, as
well as statistics related to file activity on the drive. The File System Manager
Administrator online help provides details on each tab in the dialog box.
Note: The steps to deallocate Sun StorageTek ACSLS media are different from the steps
listed here. “Deallocating ACSLS media from an extended drive” on page 148 provides
instructions.
198 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
2. Choose whether to create the media folder by using a new folder or an existing
folder on the extended drive:
• To create a new folder on the extended drive, type the media folder name (up
to 64 characters) in the Enter Folder Name text box.
• To use an existing folder on the extended drive, click Browse, select a folder,
and click OK.
3. Click OK.
Note: If you develop a complex file management strategy involving overlapping media folders
and rules, use the Rule Evaluation Tool, available on the right-click menu for the rules, to verify
how and whether a file will qualify for applicable rules.
200 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
To edit the priority for a media folder, right-click the folder and select either Promote
or Demote.
Background scans
Background scans enable DiskXtender to verify that all files on the extended drive
that need to be managed are being managed. The following topics provide details on
when and how background scans occur, as well as the settings available to customize
a background scan.
202 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
Background scans are designed to run in the background so that you can continue to
manage the system while they take place. Files are still accessible on the extended
drive and on media, and you can continue to use the File System Manager
Administrator to monitor and configure the system.
However, background scans do consume processor resources, which may affect the
performance of other processes. If necessary, you can adjust the speed of the
background scan, altering the processor resources needed to run the scan. “Tuning
background scan speed” on page 205 provides details.
2. In the Schedule section of the Settings tab, select one of the schedule options
listed in Table 24 on page 204.
Once Schedules a one-time background scan to start at the time and date specified.
Note: This is a one-time scan. Any later scans will have to be scheduled or started
manually. “Forcing a standard background scan” on page 207 provides instructions on
starting a scan manually.
Daily Schedules a background scan to start each day at the time specified. Every day at
midnight is the default schedule for background scans.
Weekly Schedules a background scan to start at the specified time, on the specified day or days
of each week.
Monthly Schedules a background scan to start at the specified time on the specified day of the
month. Choose any day between the 1st and 31st of each month.
Note: If the date you select does not occur for a given month, then the scan occurs on
the last day of the month. For example, if you select the 31st for the schedule, then the
scan occurs on the 30th in April.
3. Click OK.
204 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
4. Select or clear the checkboxes listed in Table 25 on page 206 to configure the tasks
that will be performed by the scan.
Perform index rule Qualifies files against index rules (when content indexing is enabled).
evaluation
Perform synchronization Fetches files for either multi-target migration synchronization or content indexing
fetching (when content indexing is enabled):
• Multi-target migration sync-fetch — If you add a media group to a multi-target
media group that already contains other media groups, the purged files on the
media in the other media groups are fetched to the extended drive and then
migrated to the new group.
• Content indexing sync-fetch — In most cases, files that qualify for index rules are
indexed before they are purged. However, if a qualifying file is purged first, then the
file must be fetched to the extended drive so that it can be indexed.
Note: When you enter a limit for the number of files that are added to the move list and to
the ITL, the limit applies only during a background scan. If real-time moves are enabled so
that files are qualified against move rules and index rules when the files are saved to the
drive, there is no limit to the size of the move list and the ITL.
6. Click OK.
The Extended Drive Background Scan dialog box appears.
7. Click OK.
206 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
4. Select the checkbox for one or more of the special maintenance options listed in
Table 26 on page 208.
Option Description
Build new sync-fetch list (truncate Creates a new sync-fetch list and deletes the existing sync-fetch list. The
existing) sync-fetch list contains a list of all purged files that must be fetched back
to the extended drive so that they can either be indexed or synchronized
between media groups in a multi-target media group.
Strip direct-read attribute from all files Removes the Direct Read attribute from any files managed by
DiskXtender.
Strip indexed attribute from all files Removes the Indexed attribute from any files managed by DiskXtender.
The Indexed attribute identifies files that have qualified for index rules and
have been full-text indexed.
Note: This option should be used only if you no longer use the
DiskXtender Search Module. Otherwise, all previously indexed files will
be subject to re-indexing.
Strip not indexed attribute from all files Removes the Not Indexed attribute from any files managed by
DiskXtender. The Not Indexed attribute identifies files that qualified for an
index rule but could not be full-text indexed—for example, because the
ISE does not support a specific file type.
This option is useful if you want to re-qualify files in the media folder
against index rules—for example, if the DiskXtender Search Module adds
support for a certain file type.
Recalculate licensed capacity usage Recalculates the total license capacity used by all files managed by
DiskXtender on the extended drive. The updated value is reflected in both
DiskXtender and License Server. This option is used when the value of
the total licensed capacity usage is known to be incorrect.
The options available on the Scan Maintenance Options dialog box expose
functionality that should be used only in extraordinary situations. Selection of
one or more of these options can result in permanent, system-wide changes.
208 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
Note: These settings apply only to this special scan. To apply these settings to any future
scans, configure the options each time and force a special scan.
5. Click OK.
The Extended Drive Background Scan dialog box appears.
6. Click OK to force the special scan.
The background scan might take as much as one minute to begin. After the scan
completes, the special scan settings are cleared. Future scheduled scans are
performed with the default settings.
Note: If a background scan is aborted, another scan will automatically begin according to the
schedule on the Extended Drive Background Scan dialog box.
Virus scans
Anti-virus protection is critical to any system. However, when you use an anti-virus
program to scan files on a DiskXtender extended drive, review and follow the
guidelines in the following topics to maximize DiskXtender performance by
preventing unnecessary moves and fetches.
210 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Extended Drive Management
Note: Not all anti-virus software is qualified for use with DiskXtender. The EMC DiskXtender
Software Compatibility Guide provides details.
DiskXtender prevents the executables for each of these programs from fetching
purged files to the extended drive during a virus scan.
5. Click Add.
The Special Application Settings dialog box appears, as shown in Figure 86 on
page 212.
6. In the Application Executable text box, type the executable filename, including
the .exe extension, for the application.
Note: Wildcards are not supported when adding or editing applications in the special
application filtering list.
212 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
8
File Migration
The following topics discuss when and how to move files from the extended drive to
storage media:
◆ Understanding the file migration process ............................................................... 214
◆ Developing a file migration strategy........................................................................ 217
◆ Enabling file migration............................................................................................... 226
◆ Scheduling file migration........................................................................................... 244
◆ Disabling file migration.............................................................................................. 246
7. If necessary, adjust the file migration schedule. By default, file migration takes
place between 8 P.M. and 9 A.M. “Scheduling file migration” on page 244
provides details on how to adjust the schedule.
214 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
When a file meets the rule criteria for migration, the file is written to the move list for
the media group. The move list contains a list of:
◆ New files that need to be migrated to media
◆ Edited files that need to be remigrated to media
Even if a file meets the criteria for more than one move rule, the file is written to the
move list based on only one of the move rules—the one that is listed first in the File
System Manager Administrator.
DiskXtender, by default, excludes migrating the following files to the media during a
file migration activity:
Note: For extended drives created by using previous versions of DiskXtender, these default
exclude rules are disabled by default. However, they can be enabled.
Note: If the file migration schedule is active when the file qualifies for a move rule, the file is
written to media as soon as the target media becomes available. In other words, the file
migration process may occur quickly after the file is saved to the extended drive, depending on
the system configuration and the availability of the media.
The piece of media a file is written to is determined by the move rule for which the
file qualifies. Each move rule must identify a target media group for the qualifying
files. Files are written to the first available piece of media that belongs to the media
group.
Extended attribute information is added to files that are successfully migrated to
media. This information includes details about the media to which the file was
written.
To determine whether a file has been migrated, use the DiskXtender Explorer
Add-ons to view the properties for the file or to run a file report for the file. “Explorer
Add-ons” on page 414 provides details on performing these tasks.
216 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
Criteria Details
Filename You can specify a particular filename, which may be useful for excluding a file from migration.
You can also use the asterisk (*) symbol as a wildcard to substitute for one or more
characters in a filename. For example:
• Specify *.* to target all files in a media folder.
• Specify *.doc to target all files with a .doc extension.
• Specify Payroll* to target all files with a filename that begins with the word Payroll,
regardless of the file’s extension.
• Specify *.tmp to target temporary files for exclusion from migration.
File size You can target files smaller than a certain size in KB, larger than a certain size in KB, or
within a range of sizes in KB.
File age Age criteria enable you to specify the number of days that must pass since the file was
created, last edited, or last accessed before DiskXtender migrates the file.
File attributes You can target certain files with the Read-only, Archive, Compressed, Hidden, or System
attributes. File attribute criteria are most effectively used to exclude files with certain
attributes, such as the System attribute, from being moved.
number of times frequently changing files are written and rewritten to the media. To
specify an age delay, select the Apply rule to files of age greater than option on the
Age page for the move rule, specify the number of days (typically 30 or 60), and then
select Last write time from the drop-down list.
Note: DiskXtender, by default, excludes migrating the following files to the media during file
migration, if you have set the default exclude rule:
- Files of zero bytes size
- Windows system files (files whose ‘system’ attribute is set)
- Files with extension .PST
- Executable files with extension .EXE
- Desktop configuration file named desktop.ini
218 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
◆ If the file qualifies for migration based on the first rule, then the file is migrated,
even if it is excluded from migration based on the second rule.
As a result of the last two guidelines, exclusive rules and rules with more specific file
criteria should generally appear first in the list of rules. This enables exclusions and
special conditions to take effect, while more general criteria in the later rules in the list
can capture any remaining files.
Standard migration
With the standard migration model in DiskXtender, files that are written to a media
folder on the extended drive are qualified against the move rules configured for the
media folder. If the file qualifies for migration, the file is written to the move list for
the media group to which the move rule points. (The media group contains only one
type of media and is called a standard media group. The standard media group
belongs to the media folder in which the file is located.) When the file migration
schedule is active, the file is migrated to a single piece of media in the media group,
as illustrated in Figure 88 on page 220.
File Media
Extended drive on
DiskXtender server GEN-000936
Multi-target migration
With multi-target migration, each file is migrated from the extended drive to multiple
targets (pieces, and even different types of media), as illustrated in Figure 89 on
page 220.
Tape
File
Extended drive on
DiskXtender server
Disk array
GEN-000937
220 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
Multi-target
media group
GEN-000942
A multi-target media group can contain as many as four standard media groups.
When you create move rules for a multi-target environment, you select a multi-target
media group to receive the qualifying files—not the standard media groups within
the multi-target group. When a file qualifies for movement to media based on move
rules associated with a multi-target group, the file is moved to a piece of media in each
target.
Because the capacity and availability of the different types of media in each group are
likely to vary, a piece of media in one target group is not likely to contain the same
files as a piece of media in another target group. In other words, the media in target
groups are not copies or duplicates of each other.
Figure 91 on page 222 illustrates a scenario where File A and File B are migrated to
the same piece of media in one media group, but to different pieces of media in
another media group.
NAS share 1
File A
NAS share 2
Tape 1
File B
Tape 2
GEN-000943
A scenario such as the one illustrated in Figure 91 on page 222 is possible because
different types of media have different maximum capacities. For example, the
maximum capacity of a piece of tape media is likely to be smaller than the maximum
capacity of a share on a NAS device, which is limited only by the size of the partition
on which the share resides. As a result, File A and File B may be written to the same
NAS share. However, File A may be the last file written to Tape 1 because it fills the
tape, so File B would be written to Tape 2.
Multi-target migration and media transactions
The migration to media in a multi-target group actually takes place as the media in
each target group becomes available, meaning that there might be some delay in a file
being written to all targets.
Similarly, if all of the media types in the multi-target group support file deletions,
then a file that is deleted from the extended drive is deleted from the media as the
media becomes available.
222 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
Tiered migration
With tiered migration, also called hierarchical storage management (HSM), each file
is migrated twice: from one extended drive to another extended drive, and then from
that extended drive to tape media, as illustrated in Figure 92 on page 224.
File
Extended drive on first
DiskXtender server
Tape
File
Extended drive on second
DiskXtender server GEN-000938
To accomplish this through DiskXtender, media folders on the second extended drive
are configured as Aggregate NAS media on the first DiskXtender server. The files
from the first extended drive are migrated to the Aggregate NAS media (the second
extended drive) by using a standard migration process. In other words, the
Aggregate NAS media belongs to a standard media group in a media folder on the
first extended drive.
The DiskXtender installation on the second server then moves the files to tape media,
also with a standard migration process. In other words, the tape media belongs to a
standard media group in the media folder configured on the second extended drive.
When files are saved to a media folder on the first extended drive that contains a
media group with Aggregate NAS media, DiskXtender does not allow you to rename
the files or the folders in which they reside. This behavior mimics the behavior of the
second extended drive (the Aggregate NAS media), because the second extended
drive is writing to tape, which also does not allow file or folder renames.
The restrictions on Aggregate NAS media are designed to ensure that files and file
tags on both extended drives remain synchronized, and that the files on the
subsequent tape media are not orphaned.
Tiered migration is supported only through the use of the Aggregate NAS media type
and tape media. DiskXtender does not support tiered migration from one extended
drive to another media type (such as EMC Centera) before a final migration to tape.
Migration from Aggregate NAS to media other than tape (such as EMC Centera or
optical) is also not supported.
Media fill methods You can control the way in which DiskXtender selects the media in a media group
when it writes files to the media. Media can be filled either sequentially or randomly.
224 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
With the sequential media fill method, DiskXtender fills media one at a time-based on
the order in which they are listed for the media group in the File System Manager
Administrator. In other words, DiskXtender continues writing files to a piece of
media until it is full, and then it moves on to the next piece of media. Sequential fill is
designed for use with removable media, such as optical or tape.
With the random media fill method, DiskXtender writes files to any available media
in the media group. Random fill is designed for use in environments where you are
writing to disk-based media, such as EMC Centera, NAS, or TSM. With the random
fill method, DiskXtender can write to multiple pieces of media at once. You can also
select the number of media that DiskXtender can write to simultaneously.
To select either the random or sequential media fill method for a media group, use the
Media fill method setting on the Options page when you add or edit a media group.
If you select the random fill method, you should also specify the number of media
that can receive files simultaneously. This is configured with the Maximum media
simultaneously receiving files setting, which is also on the Options page for media
groups.
Marking media as full When the amount of free space on a piece of media falls below a specified number of
megabytes, then DiskXtender marks the media as full. When media is marked as full,
DiskXtender no longer writes files to the media, although the media is left in its
media group. This enables users to continue to access files on the media. Full media
appears with a blue label in the File System Manager Administrator.
By default, DiskXtender marks media as full when the amount of free space on the
media falls below 1 MB. If you use EMC Centera, then the virtual media is marked as
full when it reaches the free space threshold or when the maximum file count for the
media (100,000 files) is reached. For NAS, remember that the capacity of a piece of
media is limited by the capacity of the device on which the share configured as media
resides.
You can adjust the free space threshold for marking a media as full by configuring the
Mark media full when free space falls below setting on the Options page for a media
group.
Note: Free space on media might fall below the configured level. This occurs because
DiskXtender monitors media free space on a timed interval of every 15 minutes, and
DiskXtender might continue to write files to the media in between the timed monitoring. After
the timed verification occurs, the media is marked as full. However, at that point, the media
free space might be less than the amount specified.
You can also manually mark a piece of media as full by selecting the Media Full
checkbox on the General tab of the Media Properties dialog box for the media. To
access the Media Properties dialog box, right-click the media and select Properties.
226 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
3. In the Media Group Type drop-down list, leave the default of Media. This is the
option for creating a standard media group type.
4. From the Media Type drop-down list, select the type of media you plan to add to
the group.
Note: If you are creating the media group for DVD-ROM media, select DVD-R as the
media type.
5. Click Next.
The Automation page appears.
6. If necessary, choose the automation settings for the media group:
• If you selected EMC Centera as the media type for the group, you can select
options to automatically create virtual media for the media group based on the
amount of available free space on the media in the group or based on the
number of active (not full) media in the group, as illustrated in Figure 94 on
page 227. “Automatically creating virtual EMC Centera media” on page 57
provides additional information.
• If you use NAS or TSM media, then the Automation page appears, but the
options are dimmed.
7. Click Next.
If you use EMC Centera, then the Metadata page appears, as shown in Figure 96
on page 228.
Otherwise, the Options page appears, as shown in Figure 97 on page 229.
Proceed to step 11 .
228 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
The Metadata page enables you to specify custom metadata that is stored with
each file that is written to the EMC Centera media in the group. The custom
metadata can be used to enhance EMC Centera Seek and Chargeback Reporter
reports.
8. In the Name text box, type a name for the type of custom metadata to add to the
CDF.
9. In the Value text box, type the value that should appear for the type of custom
metadata.
10. Click Next.
The Options page appears, as shown in Figure 97 on page 229.
11. To configure an option, select the option from the list, and then type or select a
new value for the option in the controls below the list. Table 28 on page 229
provides details on the options to consider, which depend on the type of media in
the group.
Table 28 Recommended media group options for each media type (page 1 of 3)
Maximum media simultaneously The default value for this option is the media count
receiving files threshold that you type on the Automation page.
You can tell DiskXtender to write to as many pieces
as is appropriate for the best system efficiency. The
number you enter depends on the optimal number of
media that should receive files at any given time, as
discussed in “Communication threads” on page 41.
Table 28 Recommended media group options for each media type (page 2 of 3)
Maximum media simultaneously Set this value to the total number of media that you
receiving files plan to add to the media group. This enables
DiskXtender to write to all media as necessary.
Warn when group free space falls Since you must manually create NAS and TSM
below (MB) media when it is needed, enable this option so that
you are notified when the media in the media group
is starting to run out of space.
You can then configure the warning to be sent out as
an email alert. “Sending email alerts for errors and
warnings” on page 346 provides details.
230 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
Table 28 Recommended media group options for each media type (page 3 of 3)
Warn when group free space falls If you use the automation features for the media
below (MB) group to automatically label and add media to the
group when it is needed, then you do not need to
enable this option.
However, if you do not enable automation, then you
should enable this option so that you are notified
when the media in the media group is starting to run
out of space.
You can then configure the warning to be sent out as
an email alert. “Sending email alerts for errors and
warnings” on page 346 provides details.
Mark media full when free space falls If you plan to enable auto-finalization of DVD-R
below (MB) media, leave this option enabled. Otherwise,
auto-finalization is not available.
Purge files after auto-finalizing media Choose whether to purge all files on DVD-R media
from the extended drive after it is finalized.
If you leave this option disabled, then files are purged
based on configured purge rules. “Developing a
purging strategy” on page 295 provides details.
Direct read files after auto-finalizing Choose whether to mark files for Direct Read after
media they are automatically purged after automatic
finalization. Direct Read is strongly discouraged in
most environments. “Reading files directly from
media” on page 313 provides details.
For all other options, the default value is recommended. The File System Manager
Administrator online help provides details on each option.
12. Click Next.
13. Review the summary information and click Finish.
The Select Extended Drive dialog box appears, listing all available extended
drives.
6. Select the extended drive and click OK.
7. Click OK.
8. Click Close.
Allocated media appears in the appropriate node of the Available Media tree for
the extended drive.
Note: If there are multiple EMC Centera media services, you can add media from only one
media service to a media group. A single media group cannot contain media from different
EMC Centera media services. You must create at least one media group for each EMC Centera
media service.
3. Set the appropriate restore options for any media that currently contain files:
232 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
• Log Duplicates — Choose whether to keep a count of files on the media that
were already resident on the extended drive by selecting or clearing the
checkbox. The count appears in the media log for the piece of media.
• Direct Read — Choose whether to apply the Direct Read attribute to all
restored files by selecting or clearing the checkbox. Direct Read means that
when accessed by a client, the file is read directly from media rather than
fetched to the extended drive and read from there.
• Restore older files to recycler — Choose whether to restore any older versions
of files to the DiskXtender Recycler, if the media supports multiple file
versions. The most recent version of a file is restored to the extended drive.
Multiple file versions might occur in the following situations:
– Media is formatted with an OTG file system. In this case, deleted versions
of a file, as well as file versions resulting from file edits, remain on the
media but are no longer available on the extended drive.
– File attributes are changed for a file that is written to EMC Centera media.
If you do not want to restore older versions of files to the Recycler, then the
older versions remain only on the media. The most recent version can still be
restored to the extended drive.
• Process as soon as possible — Choose whether to restore the media
immediately, rather than as a scheduled File Restore media task (which is
processed when the media task schedule is active), by selecting or clearing the
checkbox.
4. Click Next.
5. Review the summary information and click Finish.
2. Select criteria on each page of the wizard, and then click Next to access the next
page of the wizard. Table 29 on page 234 provides details on the criteria you can
specify on each page.
Type Whether the rule qualifies files for migration or excludes files from being migrated.
File Name The location (folder and/or subfolder) and filename (typically extension or file type)
specifications for the files this rule targets for migration. You can use the standard Microsoft
Windows asterisk (*) wildcard, which represents one or more characters in the name or
extension part of the filename.
Note: You can target only one filename specification per move rule. To apply the rule to
different kinds of files in the same folder, create separate rules.
Size Whether the rule applies to files of all sizes or only files of a certain size (in KB). You can
specify an upper size limit and a lower size limit. If both limits are specified, then only files
whose size falls between the two limits are subject to the move rule.
Attributes Whether the rule applies to files with any attribute or only files with certain attributes,
including the Read-only, Archive, Compressed, Hidden, and System attributes.
Note: Files possessing any of the selected attributes will qualify for the rule, as opposed to
files needing to possess all of the selected attributes to qualify, or files needing to possess
only the selected attributes to qualify.
Age Whether files of any age qualify for migration, or if some period of days must pass after the
file was created, last accessed, or last written to (modified).
Note: If you choose to migrate files based on the last access time for the file, be aware that
files can be accessed by applications as well as by users. For example, a virus scan of the
extended drive might access a file to evaluate whether it is infected with a virus.
The File System Manager Administrator online help provides additional details
on selecting the options for each page of the wizard.
3. On the Settings page, choose or create the media group to which qualifying files
should be migrated, as shown in Figure 99 on page 235.
If you are creating an exclusive move rule, the Settings page appears, but the
options are dimmed. Proceed to step 6 .
234 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
4. Choose whether to immediately purge qualifying files (after they are moved to
media) and mark them for Direct Read by selecting or clearing the Mark files for
direct read after move checkbox.
If you select this option, the Purge files immediately after move option becomes
selected and dimmed. This is because the Mark file for direct read after move
option automatically purges files.
! IMPORTANT
Direct Read is strongly discouraged in most environments. Review the
recommendations in “Reading files directly from media” on page 313 before
selecting this option.
! IMPORTANT
If you select either the Purge files immediately after move or the Mark files for
direct read checkbox, files moved by this rule are purged and are not subject to
any exclusion purge rules.
Even if you plan to purge files immediately after they are moved by using the
move rule option, you should still configure purge rules. If you do not
configure purge rules and the purged files are fetched, the files may not be
purged again.
7. Select a retention setting for files that qualify for the rule, and click Next.
Chapter 9, “File Retention,” provides details on available retention settings.
8. Review the summary information and click Finish to complete the wizard and
create the rule.
9. Once you finish creating move rules, you must order them to set the priority in
which DiskXtender qualifies files for migration, particularly in cases where rules
may overlap (for example, if a file qualifies for two different rules). Keep in mind
the following guidelines:
• If a file qualifies for two different move rules, the file is migrated based on the
rule that is listed first in the tree view of the Administrator.
• If the file fails to qualify for migration based on the first rule, the file is
evaluated against the second rule.
• If the file is excluded from migration based on the first rule, then the file is not
migrated, even if it qualifies based on the second rule.
• If the file qualifies for migration based on the first rule, then the file is
migrated, even if it is excluded from migration based on the second rule.
As a result of the last two guidelines, exclusion rules should generally appear first
in the list of rules. This enables the exclusion to take place.
To edit the priority for a move rule, right-click the rule and select either Promote
or Demote.
Note: After you create a move rule, you can edit it by right-clicking the rule and selecting
Properties. The Move Rule Properties dialog box appears, and contains tabs that
correspond to the pages of the wizard you used to create the rule.
To delete a move rule, right-click the rule and select Delete. Then click Yes on the
confirmation message.
236 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
Note: If you are adding two or more EMC Centera media groups to a multi-target group,
then the media in those media groups must be from the same media service. A multi-target
media group cannot contain media groups with media from different EMC Centera media
services.
4. Allocate media from the media service to the extended drive. “Allocating media
to the extended drive” on page 231 provides details.
5. Add the allocated media to the standard media groups. “Adding media to a
standard media group” on page 232 provides details.
6. Create move rules to specify which files should and should not be migrated to
media, selecting the multi-target media group as the target media group on the
Settings page for the move rule. “Creating a move rule” on page 233 provides
details on creating a move rule.
7. (Optional) Configure an expiration policy to automatically delete files from
standard media groups once the files meet certain age criteria. “Specifying
expiration policies for target groups” on page 238 provides instructions.
4. Repeat step 1 through step 3 for any remaining standard media groups to add to
the multi-target group. You can add as many as four standard media groups to a
multi-target group.
Note: If you are adding two or more EMC Centera media groups to a multi-target group,
then the media in those media groups must be from the same media service. A multi-target
media group cannot contain media groups with media from different EMC Centera media
services.
5. Choose the priority in which DiskXtender selects the target (standard media
group) from which it is going to fetch a purged file that has been requested by a
user. To change the order, drag-and-drop the media groups within the
multi-target group.
Note: You cannot control the order in which each file is written to each target. Files are
moved to media as the media is available.
If you have already been migrating files to other targets in a multi-target media
group and you add another target (standard media group) to the multi-target
group, the files on the other targets are automatically moved/synchronized to the
new target during the next background scan.
Note: If a file has been migrated to EMC Centera or Retained NAS media and retention has
been applied, then the file cannot be expired from the media until the retention expires.
However, the file can be expired from media in other media groups that do not support
retention.
238 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
10. Repeat these steps for each target group from which to expire files.
You can define expiration policies for all but one of the target groups. In other
words, you cannot expire files from all target groups in a multi-target group.
Note: If a file has been expired from all target media groups but the last group, and then
you remove the media from the media group, then the file is no longer available on the
extended drive.
11. (Optional) To configure automatic deletion of files from the final target group,
create a delete rule that targets the files and uses an appropriate age delay after
the files are expired from the other targets. Keep in mind, however, that once a file
is deleted from the final group, it can no longer be accessed.
Note: The file migration schedule must be active during the sync-fetch process. This
enables files to be written to the tape media and re-purged.
7. Plan to enable multi-target migration for only one extended drive at a time. You
may want to further limit the impact and duration of sync-fetch by setting a limit
for the number of files that can be fetched and re-migrated. The steps for limiting
sync-fetch are discussed in the topic that follows.
240 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
7. Click Yes.
The move rules that originally wrote files to the standard media group are edited
to write files to the multi-target group (and therefore the standard media groups
within the multi-target group).
8. Add the standard media group for the new media to the multi-target media
group by dragging and dropping the media group into the multi-target group.
Note: If you are adding two or more EMC Centera media groups to a multi-target group,
then the media in those media groups must be from the same media service. A multi-target
media group cannot contain media groups with media from different EMC Centera media
services.
The background scan starts. DiskXtender qualifies the files on the extended drive
against the move rules, fetches the files from the original media, and writes them
to the new media so that the files exist on both the original and the new media. As
the free space on the extended drive diminishes and reaches the purge start
watermark, DiskXtender automatically begins purging the files that have been
synchronized.
242 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
Note: The media task and copy update schedules are active at the same time as the file
migration schedule. The file fetch schedule is active 24 hours a day, seven days a week. You can
configure these schedules along with the file migration schedule.
Within the scheduler, colored lines represent each activity, enabling you to
quickly see which activities are scheduled for each hour of each day of the week.
4. To change schedule settings, select the area of the grid that corresponds to the
time period during which you would like to schedule or clear an activity.
5. Select or clear the checkboxes in the Activities section to specify the activities for
which you are changing the schedule.
! IMPORTANT
Any time the file fetch (Allow Fetches From Media) schedule is not active,
client fetch requests for purged files, including files marked for Direct Read,
are not honored. Changing the schedule for this activity might prevent users
from having access to necessary files. Retain the default setting for fetches
244 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
246 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
6. Deallocate all media from the extended drive, and delete the media services:
a. From the Service menu, select Configure Media Services.
b. Select the media service and click Properties.
c. Click the Media List tab.
d. Select all the media and click Deallocate.
e. Click OK to return to the Configure Media Services dialog box.
f. Select the media service and click Set Offline.
g. Click Delete to delete the media service.
h. Repeat these steps for each media service.
7. Delete the extended drive:
a. Right-click the extended drive and select Delete Extended Drive.
b. Click Yes on the confirmation message.
If the extended drive becomes so full during the compaction that it cannot receive
any more files, the compaction goes into a suspended state for one hour. In
addition, no compactions for other media are processed until the original hour
(for which the attempted compaction was suspended) has expired. After an hour
has passed, DiskXtender retries the original compaction, and if it is successful,
processes any remaining compactions.
This suspension accomplishes two things: it enables DiskXtender to move and
purge files to clear needed extended drive space, and it ensures that drives, which
might be needed to complete other media functions, are not being used to attempt
other compactions that cannot succeed until there is sufficient space on the
extended drive.
◆ If a compaction fails, some, all, or none of the files from the media might have
been moved back to the extended drive. If you can determine the cause of the
compaction failure, make the appropriate adjustments and reschedule the
compaction. The compaction process starts over, but any files already copied
back to the extended drive are not duplicated. In addition, all files that have been
compacted are remigrated to media as they qualify for movement.
◆ If you allow folder renames on media that does not support folder renames, then
do not compact the media. Data loss might occur because DiskXtender cannot
find files on the extended drive that correspond to the files on the media. As a
result, the file data for purged files cannot be copied back to the drive.
In addition, if there are one or more of these files on the extended drive during the
compaction, the media is placed in an error state and is not removed from the
media group after compaction is complete. If the number of these errors exceeds
the maximum specified in the Number of non-fatal errors before task is aborted
option for the extended drive, then the compaction is stopped and the media
enters an error state.
In either of these cases, you must resolve the issues with the files by using the
following procedure before the compaction task can resume:
1. Remove the media from the media group.
2. Manually delete any remaining files that were migrated to the media from the
extended drive.
3. Add the media back to the media group, restoring the files on the media to the
extended drive.
4. Resubmit or restart the compaction task.
248 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
Note: You can also remove media from a media group by using a Remove from Media Group
media task. The options available on the media task are the same as the options available in the
wizard. The media task method is best used to remove a single piece of media from a media
group in conjunction with other media tasks. To launch the media task process, right-click the
piece of media and select Edit Tasks.
This is true even if a retention period has been applied to a file. The file is removed
from the extended drive, but it remains protected on the media and can be restored to
the extended drive along with the rest of the files on the media, if necessary.
There are two exceptions to this scenario:
◆ When you are removing media from a standard media group that belongs to a
multi-target media group with other standard media groups, then files are not
removed from the extended drive because they are also stored on another piece
of media in the multi-target media group.
◆ If there is an unrecoverable problem with the media you are removing, then you
cannot retrieve purged files from the media. These files are permanently lost,
unless you can recover the full file data from a backup. When you are removing
this damaged media, an EMC Customer Support Representative might
recommend that you attempt to salvage as many files as possible from the media.
During the salvage process, migration information is stripped from fetched files
(files that have been migrated to media but where the file data is on the extended
drive). Any purged files, where only a file tag for the file is on the extended drive,
are deleted from the extended drive. This enables you to remove the media from
the system and remigrate the salvaged files to another piece of media.
250 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Migration
Figure 103 Remove Media From Media Groups Wizard – Migrated File Options page
5. If you are removing multiple pieces of media from the media group, select the
media from the list.
6. If necessary, choose whether to remove all files on the media from the extended
drive or, if the media is unrecoverable, to salvage as many files as possible from
the media:
• (Recommended for most scenarios) Select Delete files from extended drive
upon media removal. This option leaves the files on the media and removes
them from the extended drive. You can restore the media to the media group,
thereby restoring the files to the extended drive, at a later date, if necessary.
• If the media has encountered an unrecoverable error and you are removing it
from the system, select Salvage files back to extended drive upon media
removal. This option strips the migration information from all fetched files on
the extended drive, and deletes any file tags for purged files.
When you select the salvage option, purged files are deleted from the
extended drive and cannot be recovered. These files are logged to the event
log.
7. Click Next.
If you selected the salvage option, a series of warning messages appear.
Otherwise, the summary page appears.
8. If necessary, review and respond to the salvage warnings.
9. Review the summary information and click Finish.
A message appears stating that the media will be removed at the conclusion of
the next background scan.
Note: If you do not force a background scan, the media will be removed during the next
scheduled background scan for the extended drive.
252 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
9
File Retention
The term retention or file retention refers to the placement of an attribute on a file that
restricts anyone from editing or deleting the file, effectively making the file read-only.
The following topics provide details on retaining files in a DiskXtender environment:
◆ Understanding file retention ..................................................................................... 254
◆ Enabling file retention ................................................................................................ 259
◆ Changing file retention............................................................................................... 261
◆ Deleting retained files................................................................................................. 264
◆ Triggering retention event.......................................................................................... 266
Types of retention
Table 30 on page 254 lists the three types of retention settings that are available in
DiskXtender.
Fixed retention or A specific time period (in days) during which file retention • EMC Centera
Time-based retention is enforced. • Retained NAS
Event-based retention Retention period on a file is applied when the event occurs • EMC Centera
at some indeterminate time after the original C-Clip
creation.
254 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Retention
Retention period A retention period is the numerical representation of the number of days for which
the file cannot be modified or deleted. Although EMC Centera allows retention of
files for less than one day, DiskXtender does not recognize the retention period less
than one day. Hence a minimum retention period on EMC Centera using
DiskXtender is one day.
Retention classes A retention class is a symbolic representation of a retention period. When you define
the retention class on EMC Centera, you specify a name and a retention period (in
days). If necessary, you can edit the retention period for a retention class by changing
the class definition, thereby changing the retention period for a group of files.
The list of retention classes and their definitions in DiskXtender is refreshed every
time the EMC Centera media service is refreshed. This occurs approximately every
two minutes. The list is stored and updated locally on the DiskXtender server (in
addition to the definition on the EMC Centera). This enables retention enforcement
on the extended drive even if the EMC Centera device is unavailable.
Note: Retention is applied on only those files that reside on the extended drive. When the file is
set offline, retention settings do not apply to that file.
Event-based retention
Retention is a powerful feature of EMC Centera and DiskXtender leverages that
feature to retain files on media for a specific period. An event defined in the EMC
Centera can be associated to a file. The retention on a file is applied when the
specified event occurs. The event however must be triggered by a qualified
DiskXtender administrator. The retention period is specified while setting retention
on a file. An event can be associated to more than one file and can be triggered at
different times.
A file can have both time-based and event-based retention applied. Time-based
retention is a fixed retention period. The retention on the selected file applies from the
time the retention is set on that file till the retention period expires. Event-based
retention uses either the retention period or the retention class defined in the EMC
Centera. The file with event-based retention can be manually removed from the
extended drive when both of the following conditions are met:
◆ Time-based retention associated with the file has expired
◆ Event associated with the file has occurred and the retention associated with the
event has expired
256 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Retention
Note: Event-based retention can be used only if the Advanced Retention Management feature
in EMC Centera is enabled. Advanced Retention Management is a licensed feature of EMC
Centera and is disabled by default. It can be enabled on GE and CE+ models, only by EMC
service personnel.
retention). When you set a retention period of zero days through DiskXtender, then
the file is not protected on the EMC Centera device, even if EMC Centera is
configured for a global retention period of one or more days.
Note: DiskXtender always applies a retention period to files written to EMC Centera, even if
the retention period is zero days (no retention). You cannot automatically apply the global
retention period set on the EMC Centera device to files on the extended drive. To match the
global retention period on EMC Centera with the retention set on files on the extended drive,
specify the same retention setting in DiskXtender as on EMC Centera.
In the unlikely event that there is a delay between the time that the file qualifies for a
move rule and the time that the file is actually migrated, then the total retention
period is equivalent to the retention setting in the move rule plus the amount of time
that the file was protected on the extended drive before it was migrated.
For example, assume that the retention period on a move rule is 30 days. A file
qualifies for the move rule as soon as it is saved to the extended drive on Monday at 9
A.M. The file is immediately protected on the extended drive starting at 9 A.M.
However, the file is not migrated to media until Wednesday at 1 P.M. because the
media is offline. When DiskXtender migrates the file on Wednesday, it passes the
retention period of 30 days to the media. The file is then protected on the media for 30
days after it is migrated to the media. DiskXtender updates the retention information
for the file so that it is synchronized with the media for 30 days of retention.
However, the file has already been protected on the extended drive for two days. As a
result, the file is protected on the extended drive for a total of 32 days, and not the 30
days specified in the move rule.
258 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Retention
Note: Retention classes of less than one day do not appear in the drop-down list.
• To apply retention based on an event, select Event-based Retention.
– Select Retention Period for which the file will be retained once the event
occurs and then specify the retention period in days in the text box.
– To apply a retention class, select Retention Class and then select the
retention class from the drop-down list.
Note: Retention classes of less than one day do not appear in the drop-down list.
260 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Retention
Note: Retention classes of less than one day do not appear in the drop-down list.
If you use EMC Centera, you can extend the retention period or change the retention
class. You cannot, however, reduce a retention period or switch from a retention class
to either a fixed retention period or infinite retention. If you have EMC Centera CE+,
then you cannot reduce the time period assigned to a retention class.
In addition, you cannot edit the name of a retention class. To change the name of a
retention class, you must create a new retention class with the new name, and then
switch the retention setting on the files to the new retention class.
Table 31 on page 262 lists the options for editing retention on files migrated to EMC
Centera.
If you use this retention option Then you can switch to this retention option
A fixed retention period • A different fixed retention period, as long as you are extending the
retention period.
• A retention class, as long as the retention class definition is for a
time period that is greater than the current fixed retention period.
• Infinite retention.
Note: The new retention class definition can be a shorter time period
than the previous retention class definition.
Infinite retention Not applicable. If you use infinite retention, you cannot switch to a
different retention option.
Event-based retention Retention period on a file is applied when the event occurs at some
indeterminate time after the original C-Clip creation.
262 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Retention
• To apply a retention class, select Retention Class and then select the retention
class from the drop-down list.
Note: Retention classes of less than one day do not appear in the drop-down list.
Note: Consider the compliance regulations followed by your company before you perform a
privileged delete.
4. Type an audit string explaining why you are deleting the file.
The audit information can later be viewed by performing an EMC Centera query.
264 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
File Retention
5. Click Next.
6. Review the summary information and click Finish.
7. Click Yes on the confirmation message.
8. The file is permanently deleted. Even if the DiskXtender Recycler is enabled, the
file is not placed in the Recycler.
Note: Once you trigger the event-based retention on a file, you cannot modify or remove the
retention parameters, and you cannot re-trigger the event.
In a multi-target media group, DiskXtender does not allow the use of retention classes for an
event-based retention.
266 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
10
Indexing Files
268 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
Microsoft Windows
server with DiskXtender
Indexing
Indexing
You can install the DiskXtender Search Module along with DiskXtender version 6.3 or
above (6.3, 6.4, 6.3 SP1, 6.4 SP1, 6.5, 6.5 SP1) in a new environment. You can also
install the DiskXtender Search Module in an environment where DiskXtender is
already managing files, provided DiskXtender is upgraded to release 6.3 or later.
The ISE can index new files that are saved to the extended drive, as well as files that
were on the extended drive prior to the DiskXtender or DiskXtender Search Module
installation.
The DiskXtender Search Module installation guide provides detailed system
requirements and procedure to log in to the web user interface.
An index collection is a set of all index files for an extended drive. Index collection
information is stored in a database on the ISE.
2. On the DiskXtender server, enable content indexing for each extended drive that
contains files to index. You must specify:
• The ISE server that should index the files on the extended drive.
• The index collection that should receive the files.
• A schedule for when indexing should occur. Indexing can be scheduled to
occur regularly on a daily, weekly, or monthly basis. You can also manually
force indexing to occur once at a certain date and time. To maximize system
performance, schedule indexing to occur at a time when there is minimal
system activity.
3. On the DiskXtender server, in each media folder, create DiskXtender index rules
to identify which files you do—and which files you do not—want to index. If you
do not want to index any files in the media folder, do not create an index rule.
The rule criteria you can use to select files for indexing or exclusion from indexing
include file location, name, type, size, attributes, and age.
270 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
When a file meets the rule criteria for indexing, the file is written to the Index
Transaction Log (ITL) for the extended drive. The ITL contains a list of:
◆ New files that need to be indexed.
◆ Edited files that need any corresponding index information to be updated.
◆ Deleted files that need any corresponding index information to be deleted.
There is one ITL for each extended drive with indexing enabled.
If a file is purged when it qualifies for indexing, the file is fetched to the extended
drive before it is written to the ITL. File data must be present on the extended drive
during the indexing process so that the ISE can scan the file. In existing systems with
a significant number of files, the process of indexing purged files can significantly
impact DiskXtender performance. “Developing an indexing strategy” on page 274
provides guidance on maximizing performance in such a scenario.
Note: After the file is indexed, the file is automatically purged again. You do not need to wait
until the extended drive reaches the purge start watermark or until the next background scan
occurs (whichever is appropriate, depending on your purge settings).
If a file qualifies for both indexing and purge at the same time, the file is indexed
before it is purged. Files that qualify for index rules are not written to the purge list
until after they are submitted for indexing—even if they qualify for both an index rule
and a purge rule at the same time (during a background scan). As a result, it is
critically important that indexing takes place successfully on a regular basis.
Otherwise, files may never be written to the purge list, meaning there may not be any
files to purge if the extended drive begins to run out of disk space.
encounters a file on the ITL that has been deleted from the extended drive, it removes
the file index information from the ISE database so that searches will no longer return
the deleted file in their results. The ISE continues processing the ITL until there are no
more entries left on the ITL, or until the process is interrupted (for example, if the
indexing process is paused on the ISE server).
Note: If users are saving files to the extended drive while indexing is taking place, and the files
qualify for index rules, then the files are added to the ITL and are processed during the current
active schedule.
If the connection between the DiskXtender server and the ISE server is not
successful—for example, because there are already 25 other extended drives
submitting files to the ISE server for indexing—then the connection is retried after 30
minutes and the files are then indexed. This process is repeated till files from all the
extended drives are indexed.
Files that are successfully indexed are marked with the Indexed attribute on the
extended drive. Files that have qualified for indexing and been submitted to the ISE
for indexing, but that the ISE cannot index—for example, because the file is not a
supported file type—are marked with the Do Not Index attribute.
To determine whether a file is marked with the Indexed attribute or the Do Not Index
attribute, or to manually mark a file with the Do Not Index attribute so that it is not
indexed, use the DiskXtender Explorer Add-ons to view the properties for the file.
The Indexed and Do Not Index options appear in the middle of the DiskXtender File
Properties dialog box, as illustrated in Figure 108 on page 272.
Figure 108 Indexing attributes on the DiskXtender File Properties dialog box
“Explorer Add-ons” on page 414 provides details on how to view file properties.
Note: Files that qualify for exclusive index rules, as well as files that have not qualified for any
index rules at all, are marked with neither the Indexed nor the Do Not Index attribute. No
content indexing attribute is assigned to these files.
About fifteen minutes after all the files on an extended drive are indexed, the files are
available for searches. This is because the all the files have to be present on the ISE
database to be available for searches.
272 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
Note: To index Visio files, you must install the Visio IFilter 2003 Add-in on the ISE server.
Download the add-in from the Microsoft website, and install it before you begin indexing
files.
◆ HTML
◆ JPEG (Exchangeable Image File Format, or EXIF, markers only)
◆ Adobe PDF (Portable Document Format)
◆ Text files
Note: The ISE cannot index a text file unless it contains either several hundred characters,
or a carriage return or line feed at the end of each line.
Note: The ISE indexes only supported file types within the ZIP file. However, all ZIP files
are marked with the Indexed attribute, even if the ZIP file does not contain any supported
file types.
The ISE supports the indexing and search of files with Unicode characters in the
filename, file metadata, and file data. If the files include ANSI character encoding,
such as Big5 (Chinese) or Shift-JIS (Japanese), then the corresponding code page must
be installed and set as the default code page on the ISE server.
If a different code page is set as the default on the ISE server, then perform the steps
in the EMC DiskXtender Search Module Release 1.2 Release Notes to enable proper
indexing and search of the ANSI-encoded files.
! IMPORTANT
You may want to create separate purge rules for files that are excluded from
indexing. Excluded files are eligible to be purged as soon as disk space is
needed. They do not need to be indexed first.
274 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
! IMPORTANT
You may want to create separate purge rules for files that are excluded from
indexing. Excluded files are eligible to be purged as soon as disk space is
needed. They do not need to be indexed first.
◆ Do not submit all files on the extended drive for indexing at once. Stagger the
indexing of files over time. Some strategies to accomplish this include:
• Create index rules for one media folder at a time over the course of an
appropriate time period. For example, create the index rules for one media
folder on one night. The files in that media folder are then qualified against the
rules during the next background scan and submitted for indexing based on
the indexing schedule. On the next night, create the index rules for the next
media folder, and so on.
• Target specific, high-priority files for the initial indexing effort by creating an
index rule with a File Name specification based either on the file type or
filename. For example, index all Microsoft Word files first. Then add index
rules over time to include the remaining files on the extended drive.
• Index all the most recent—or the oldest—files on the extended drive first.
Then change the age specification incrementally over time to include more
files. For example, index all files that have been created within the last 30 days.
(On the Age page of the Index Rule Wizard, select the Less than option, type
30 in the Days text box, and select Create time from the Since drop-down list.)
After all of the qualifying files have been indexed, change the rule to files
created within the last 60 days, then 90 days, and so on.
• Use the advanced background scan option to limit the number of files that are
added to the ITL during a single scan. (Edit the Max pending files value next
to the Perform index rule evaluation option on the Advanced Scan
Configuration dialog box. The default value is 100,000 files.) “Running an
advanced scan for troubleshooting” on page 205 provides details.
◆ If this is a new DiskXtender installation, wait to purge files until after they have
been indexed. File data must be present on the extended drive to be indexed. If a
file is purged when it qualifies for an index rule, the file is fetched to the extended
drive before it is written to the ITL and submitted for indexing. The file is then
automatically purged again after it is indexed. In systems with a significant
number of files, this process can significantly impact performance.
To delay purging, wait to configure purge rules until after all files in a media
folder have been indexed. Alternatively, configure an appropriate age delay on
the purge rules. Do not use the Purge files immediately after move option on
move rules. Chapter 11, “Purging Files,” provides details on configuring purging.
◆ If this is an existing DiskXtender installation, prefetch purged files when you are
ready to index them. During a prefetch, DiskXtender retrieves files from media
and writes the file data to the extended drive. File data must be present on the
extended drive to be indexed. For example, if you are indexing a single media
folder at a time, create a prefetch request for all files in the media folder before the
background scan occurs to qualify the files for indexing. “Prefetch requests” on
page 307 provides instructions on creating a prefetch request.
Determine the amount of available free space on the extended drive before
prefetching files. You do not want to fill the extended drive with the
prefetched files.
◆ If a single ISE server is indexing files for two or more DiskXtender servers, do not
submit all files on all servers for indexing at once. Balance the processing
requirements for the ISE server by staggering the indexing schedules. Index the
files on only one server at a time. After the indexing process for the first server is
complete, then index the files on the second DiskXtender server, and so on.
Errors may occur if more than one DiskXtender server submits all files for the
initial indexing process at the same time. The DiskXtender Search Module
installation guide provides details on troubleshooting the errors.
Note: Each ISE server can index files from no more than 10 DiskXtender servers. Each
DiskXtender server submitting files for indexing should manage no more than five
extended drives.
Once the initial indexing process for all servers is complete, the ISE server can
index files from no more than 25 extended drives at one time. (Requests from
additional extended drives are denied. The connection between the ISE server
and the additional extended drives is retried after 30 minutes.) In addition, errors
can occur when the ISE server is required to process too many requests at the
same time.
276 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
rules and index rules as soon as the files are saved to the extended drive (in real
time). If there are a significant number of users saving files to and accessing files
on the extended drive during a certain period of time, you can change this default
behavior so that files are qualified for migration only during a background scan.
To disable real-time moves, select Disable real-time moves option for the Enable
real-time moves option on the Options tab of the Service Properties dialog box,
as illustrated in Figure 107 on page 271.
◆ If a single ISE server is indexing files for multiple DiskXtender servers and
extended drives, balance the processing requirements for the ISE server by
staggering the indexing schedules. The ISE server can index files from no more
than 25 extended drives at one time. (Requests from additional extended drives
are denied. The connection between the ISE server and the additional extended
drives is retried after 30 minutes.) In addition, errors can occur when the ISE
server is required to process too many requests at the same time. The
DiskXtender Search Module installation guide and online help provide details on
troubleshooting the errors.
Note: Each ISE server can index files from no more than 10 DiskXtender servers. Each
DiskXtender server submitting files for indexing should manage no more than five
extended drives.
278 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
Enabling indexing
To enable indexing for files on an extended drive:
1. On the ISE, create an index collection for each extended drive that contains files to
index. An index collection is a set of all index files for an extended drive.
“Creating an index collection for each extended drive” on page 279 provides
detailed instructions.
2. (Optional) If you plan to index Microsoft Visio files, download the Visio IFilter
2003 Add-in from the Microsoft website and install it on the ISE server.
3. In DiskXtender, enable content indexing for each extended drive that contains
files to index. Specify the ISE that should index the files on the extended drive,
and set a schedule for when indexing should occur. “Enabling indexing on the
extended drive” on page 281 provides detailed instructions.
4. Create DiskXtender index rules to identify which files you do—and which files
you do not—want to index. You can index new files that are saved to the extended
drive, as well as files that are already being managed by DiskXtender. “Selecting
files for indexing” on page 282 provides detailed instructions.
Note: Be sure that you have reviewed the guidelines in “Developing an indexing strategy” on
page 274 before you enable indexing. The guidelines are designed to assist you in maximizing
DiskXtender performance during indexing.
2. In the Index Collection text box, type a name for the collection.
Hint:Use the hostname of the
DiskXtender server and the
extended drive letter to form
an index collection name.
! IMPORTANT
Each index collection name should be unique. Otherwise, connection
problems between the ISE and the DiskXtender server may occur.
3. (Only for non-administrator users) In the Share Name text box, type the name of
the share with which the administrator has shared the extended drive to you.
4. (Only for non-administrator users) In the DX Server IP or hostname text box,
type the IP address or the host name of the DiskXtender server.
5. Click Add.
6. Repeat step 2 through step 5 to create an index collection for each extended drive
to index.
280 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
Note: To delete an index collection, select the index collection from the list and click
Remove. (Use caution when deleting an index collection that contains index files. You can
no longer index or search files on the extended drive associated with the deleted index
collection.)
3. In the Index Server Name text box, type the hostname for the ISE server.
Administrators also have the option of typing the IP address of the computer
where DiskXtender Search Module is installed.
Note: The ISE server must be in the same domain as the DiskXtender server.
4. In the Index Collection text box, type the name of the index collection for the
extended drive.
This name must match the name of the index collection that you specified in
“Creating an index collection for each extended drive” on page 279.
5. Click Test Connection to test for:
• A successful connection between the DiskXtender server and the ISE
• Successful authentication to the index collection
6. Select the Enable content indexing of files on this extended drive checkbox. If
this option is not selected, the Index Rules option is not enabled in the
DiskXtender Administrator, and index rules cannot be defined.
Note: If you clear the Enable content indexing of files on this extended drive checkbox,
files are not qualified against index rules. Therefore, they are not written to the ITL.
7. In the Index Scheduling section, choose how often indexing should occur.
Table 32 on page 282 explains the scheduling options.
Disable Disables the index schedule. When the schedule is disabled, the ITL is not processed
and files are not indexed.
Note: If the Enable content indexing of files on this extended drive checkbox is selected,
files are still qualified against index rules and written to the ITL, even if the indexing
schedule is disabled.
Once The ITL is processed and files are indexed once at the time and date specified.
Daily The ITL is processed and files are indexed once each day at the specified time.
Weekly The ITL is processed and files are indexed weekly on the day(s) and at the time
specified.
Monthly The ITL is processed and files are indexed at the specified time on the specified day of
the month. Choose any day between the 1st and 31st of each month.
Note: If the date you select does not occur for a given month, then the ITL is processed
on the last day of the month. For example, if you select the 31st for the schedule, then
the scan occurs on the 30th in April.
When the schedule is active, the ITL is processed and files on the ITL are
submitted to the ISE for indexing. The ITL is processed until all files on the ITL
have been submitted.
8. Click OK.
Note: The Resync Options button is not used to enable content indexing. Resynchronization is
necessary only as a repair process in the unlikely event that the files on the extended drive are
not synchronized with the indexes on the ISE. “Resynchronizing the index files and the
extended drive” on page 287 provides details.
282 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
Type Whether the rule qualifies files for indexing or exclusion from indexing.
File Name The location (folder and/or subfolder) and filename (typically extension or file type)
specifications for the files this rule targets for indexing. You can use the standard Windows
asterisk (*) wildcard, which represents one or more characters in the name or extension part
of the filename.
Note: You can target only one filename specification per index rule. To apply the rule to
different kinds of files in the same folder, create separate rules.
Size Whether the rule applies to files of all sizes or only files of a certain size (in KB). You can
specify an upper size limit and a lower size limit. If both limits are specified, then only files
whose size falls between the two limits are subject to the index rule.
Attributes Whether the rule applies to files with any attribute or only files with certain attributes,
including the Read-only, Archive, Compressed, Hidden, and System attributes.
Note: Files possessing any of the selected attributes will qualify for the rule, as opposed to
files needing to possess all of the selected attributes to qualify, or files needing to possess
only the selected attributes to qualify.
Age Whether files of any age qualify for indexing, or if some period of days must pass after the file
was created, last accessed, or last written to (modified).
If you do not set an age specification for the index rule and it is an inclusive index rule,
qualifying files are written to the ITL immediately when they are saved to the media folder on
the extended drive. If you set an age specification for an inclusive index rule, files are written
to the ITL during a background scan after the appropriate time has passed. If you disable the
real-time moves option on the Options tab of the Extended Drive Properties dialog box, files
are evaluated against index rules (and move rules) only during a background scan.
Note: If you choose to index files based on the last access time for the file, be aware that files
can be accessed by applications as well as by users. For example, a virus scan of the
extended drive might access a file to evaluate whether it is infected with a virus.
The File System Manager Administrator online help provides additional details
on selecting the options for each page of the wizard.
When you reach the end of the wizard, a summary page provides a listing of the
criteria you selected.
3. Click Finish to complete the wizard and create the rule.
4. Once you finish creating index rules, you must order them to set the priority in
which DiskXtender indexes files, particularly in cases where rules may overlap
(for example, if a file qualifies for two different rules). Keep in mind the following
guidelines:
• If a file qualifies for two different index rules, the file is written to the ITL
based on the rule that is listed first in the tree view of the Administrator.
• If the file fails to qualify for indexing based on the first rule, then the file is
evaluated against the second rule.
• If the file is excluded from indexing based on the first rule, then the file is not
written to the ITL, even if it qualifies based on the second rule.
• If the file qualifies for indexing based on the first rule, then the file is written to
the ITL, even if it is excluded from indexing based on the second rule.
As a result of the last two guidelines, exclusion rules should generally appear first
in the list of rules. This enables the exclusion to take place.
To edit the priority for an index rule, right-click the rule and select either Promote
or Demote.
Note: After you create an index rule, you can edit it by right-clicking the rule and selecting
Properties. The Index Rule Properties dialog box appears, and contains tabs that
correspond to the pages of the wizard you used to create the rule. Keep in mind, however,
that if there are files already on the drive when you edit an index rule, the files are not
qualified against the edited rule until the next background scan occurs.
To delete an index rule, right-click the rule and select Delete. Then click Yes on the
confirmation message.
284 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
Disabling indexing
If necessary, you can disable content indexing either for a single extended drive or for
all extended drives that are submitting files to an ISE for indexing. The following
topics provide details:
◆ “Disabling indexing for an extended drive” on page 285
◆ “Disabling all content indexing” on page 286
◆ The indexing schedule (processing of the ITL and submission of files to the ISE for
indexing).
To disable this indexing feature, select the Disable option in the Index
Scheduling section on the Indexing tab of the Extended Drive Properties dialog
box in the File System Manager Administrator, as illustrated in Figure 112 on
page 286.
Note: If you disable the indexing schedule while the schedule is active and processing the ITL,
then DiskXtender does not stop the ongoing processing of the ITL. Once the ongoing process is
complete, the indexing schedule is disabled and the ITL is no longer processed. To stop
DiskXtender from processing the ITL while it is ongoing, clear the Enable content indexing of
files on this extended drive checkbox.
If you disable rule qualification, then the indexing schedule is also disabled. If you
disable the indexing schedule but do not disable rule qualification, however, files
continue to be written to the ITL as they qualify for configured index rules. This is
useful to temporarily disable the indexing process; for example, to perform
maintenance on the ISE. However, keep in mind that the ITL for each extended drive
is kept as a file on the extended drive of the DiskXtender server. The file will continue
to grow, occupying additional space on the drive, until you either delete the index
rules or disable rule qualification as well.
In addition, files that qualify for index rules cannot be purged. If the indexing
schedule is disabled for a significant amount of time, extended drive space issues are
likely to occur.
286 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
IMPORTANT
Resynchronization is designed to repair a damaged system. It is a system-intensive
process and should be scheduled accordingly to accommodate the necessary
system resources for an appropriate duration of time.
288 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Indexing Files
Troubleshooting
◆ If indexing of files is taking too much time, make sure you have no more than
50,000 files in a batch.
◆ Before indexing files, make sure the files marked for indexing are fetched on to
the extended drive.
◆ If you encounter ScanDoc error while index synchronization is in progress, and
indexing stops, create a new index collection and map it to the extended drive.
Restart all ISE services, remove indexed attribute from all the files that are
already indexed, and start indexing again.
Troubleshooting 289
Indexing Files
290 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
11
Purging Files
The following topics discuss when and how to purge files from the extended drive, as
well as how to manage user access to purged files:
◆ Understanding the purge process............................................................................. 292
◆ Developing a purging strategy.................................................................................. 295
◆ Enabling purging......................................................................................................... 300
◆ Controlling user access to purged files .................................................................... 305
◆ Controlling third-party software access to purged files ........................................ 317
Unmigrated or fetched file Standard Windows icon for the associated file type.
Purged file (file tag) in Windows Vista The standard file icon appears to have a dimmed
and Windows Server 2008 “X” in the lower left corner.
Purged file (file tag) in earlier Windows The standard file icon appears to have a clock
versions attached to the lower left corner.
A purged file is still accessible, and to a user machine, appears to reside on the
extended drive. When the user requests the file, DiskXtender accesses the media
where the file is stored and retrieves the file data, displaying it for the user.
When a file has been migrated to a single piece of media, a file tag consumes between
0 bytes and 1 cluster of disk space. (On Microsoft Windows NTFS systems, a cluster
of disk space averages approximately 4 KB, although the size depends on a number
of variables.) When a file has been migrated to multiple pieces of media through
multi-target migration, then a file tag is likely to consume 1 cluster of disk space.
Note: If you enable multi-target migration and then later decide to remove a file from one or
more media targets so that the file is on only a single piece of media, the file tag size remains
the same size that it was when it was on multiple targets. In other words, you cannot decrease
the size of a file tag by removing a file from media targets.
Although the size of a file tag is likely much smaller than the size of the full file data,
the file and the folder in which the file is located appear with the original file size in
Windows Explorer. To view the effects of purged files on disk space, view the
properties for the entire extended drive through Windows Explorer.
Because space and file retrieval requirements vary, DiskXtender provides several
different ways to purge files from the extended drive, enabling you to be very specific
as to when files are purged from the extended drive.
292 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
Files cannot be purged from the extended drive until they are moved to media and
indexed, if indexing is enabled. If a file is being moved to multiple pieces of media as
part of a multi-target migration strategy, then the file must also be moved to all target
media before it can be purged.
However, once a file is moved to media, you can choose whether to automatically
purge that file from the extended drive either:
◆ Immediately after it has been moved
◆ When extended drive space is low
◆ During the next background scan (after the file qualifies for a purge rule)
You can also select specific files and purge them manually by using the DiskXtender
Explorer Add-ons.
There may even be some files that you do not want to purge at all.
The purge options you choose are likely determined by a number of factors,
including the type of storage media, how much space is on the extended drive, how
often files are accessed, and how long files are normally active. “Developing a
purging strategy” on page 295 provides recommendations for selecting a purging
strategy that is appropriate for your environment.
Note: Retention on files does not affect whether a file can be purged. Files under retention can
be purged from the extended drive because the data resides on the media; however, you cannot
delete the file tag.
Purging based on disk space 1. Configure purge rules that select the files to purge, and select the Do not
force purges during background scans option for the rules.
2. Adjust the purge watermarks for the extended drive to specify when purging
should begin and end to maintain a reasonable amount of free space on the
extended drive.
Purging immediately after Select the Purge files immediately after move option for the move rules that are
migration used to select files for migration.
Purging during background 1. Configure purge rules that select the files to purge, and select the Force files
scans to purge during background scans option for the rules.
2. Adjust the purge watermarks for the extended drive to specify when purging
should begin and end to maintain a reasonable amount of free space on the
extended drive.
Purging files moved to DVD-R Finalize the media by using one of the following methods:
media • Automatically based on media group settings
• Manually with a Finalize media task
Purge method How files qualify for purging and when purging takes place
Purging based on disk space 1. Files qualify for purging when they qualify for purge rules during a background
scan.
2. Qualifying files are written to the purge list in the order determined by the
priorities set in the purge rules.
3. When the amount of used space on the extended drive reaches the purge
start watermark, DiskXtender begins purging files on the purge list.
4. Purging continues until the amount of used space on the extended drive is
reduced to the purge stop watermark.
Purging immediately after Files qualify for purging when they qualify for a move rule with the Purge files
migration immediately after move option selected. Once the file is successfully moved to
media, the file is purged.
Purging during background 1. Files qualify for purging when they qualify for purge rules during a background
scans scan.
2. Qualifying files are purged during the background scan unless they also
qualify for indexing. If they qualify for indexing, then the files are indexed
according to the indexing schedule. Once indexing of the file is complete, the
file is automatically purged, even if the indexing takes place while a
background scan is inactive.
Note: Files might be purged before a background scan takes place (regardless of
purge rule settings) if disk space is needed before the next background scan
starts.
Purging manually by using 1. Files qualify for purging when you issue the purge command from the
the Explorer Add-ons Explorer Add-ons.
2. Files are purged immediately.
Purging files moved to DVD-R You can choose to automatically purge all files on the media when it is finalized. If
media you select this option for the finalization process, then files are purged as soon as
the finalization process is complete.
If you do not purge all files after finalization, the files must qualify for purge rules.
They are then purged either when disk space is needed or during background
scans, depending on purge rule settings.
Note: 1. If you are migrating files to multiple media targets and the file qualifies for purging,
the file is not purged until it has been moved to all targets within the multi-target group.
2. If you are migrating files to EMC Centera in a replication environment and the file qualifies
for purging, the file is not purged until it has been moved to the replica EMC Centera.
294 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
Purging based on disk space • Environments with media types that have a slower file retrieval time, such
as removable media, which must be mounted in a drive
• Environments with EMC Centera, which has a limited number of
communication threads available for total file activity
• High-volume environments, where a significant number of files are being
moved to media and then accessed for viewing or editing
• Environments where DiskXtender is managing user home directories
• Environments where the DiskXtender Search Module is indexing files on
the extended drive
Purging during background scans • Environments with media types that have a faster file retrieval time, such
as NAS or TSM
• Environments where DiskXtender is being used to archive files that are
infrequently or never accessed again for viewing or editing
• Environments where the volume of file activity is such that file migration
must be scheduled to take place at a different time than file purging
(background scans)
• Environments that need to maintain a high volume of free space on the
extended drive—even if it means sacrificing system performance during
file retrieval
Purging immediately after • Environments with media types that have a faster file retrieval time, such
migration as NAS or TSM
• Environments where DiskXtender is being used to archive files that are
infrequently or never accessed again for viewing or editing
• Low-volume environments where file migration can take place at the same
time as file purging with a minimal impact to system performance
• Environments that need to maintain a high volume of free space on the
extended drive—even if it means sacrificing system performance during
file retrieval
Purging manually by using the Small environments where an administrator is responsible for manually
Explorer Add-ons monitoring the capacity of the extended drive and can target certain inactive
files for purging
Criteria Details
Filename You can specify a particular filename, which may be useful for excluding a file from being
purged. You can also use the asterisk (*) symbol as a wildcard to substitute for one or more
characters in a filename. For example:
• Specify *.* to target all files in a media folder.
• Specify *.doc to target all files with a .doc extension.
• Specify Payroll* to target all files with a filename that begins with the word “Payroll,”
regardless of the file’s extension.
• Specify *.tmp to target temporary files for exclusion from purging.
File size You can target files smaller than a certain size in KB, larger than a certain size in KB, or
within a range of sizes in KB.
File age Age criteria enable you to specify the number of days that must pass since the file was
created, last edited, or last accessed before DiskXtender moves or purges the file.
File attributes You can target certain files with the Read-only, Archive, Compressed, Hidden, or System
attributes. File attribute criteria are most effectively used to exclude files with certain
attributes, such as the System attribute, from being purged.
296 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
IMPORTANT
Even if you plan to purge files immediately after they are moved by using the
move rule option, you should still configure purge rules. If you do not configure
purge rules and the purged files are fetched, the files may not be purged again.
298 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
Enabling purging
The following topics provide instructions for enabling purging:
◆ “Purging files as disk space is needed” on page 300
◆ “Purging files during background scans” on page 302
◆ “Purging files immediately after migration” on page 304
◆ “Purging individual files” on page 304
Type Whether the rule qualifies files for purging or excludes files from being purged.
File Name The location (folder and/or subfolder) and filename (typically extension or file type)
specifications for the files this rule targets for purging. You can use the standard Microsoft
Windows asterisk (*) wildcard, which represents one or more characters in the name or
extension part of the filename.
Note: You can target only one filename specification per purge rule. To apply the rule to
different kinds of files in the same folder, create separate rules.
Size Whether the rule applies to files of all sizes or only files of a certain size (in KB). You can
specify an upper size limit and a lower size limit. If both limits are specified, then only files
whose size falls between the two limits are subject to the purge rule.
Attributes Whether the rule applies to files with any attribute or only files with certain attributes,
including the Read-only, Archive, Compressed, Hidden, and System attributes.
Note: Files possessing any of the selected attributes will qualify for the rule, as opposed to
files needing to possess all of the selected attributes to qualify, or files needing to possess
only the selected attributes to qualify.
Age Whether files of any age qualify for purging, or if some period of days must pass after the file
was created, last accessed, or last written to (modified).
Note: If you choose to purge files based on the last access time for the file, be aware that
files can be accessed by applications as well as by users. For example, a virus scan of the
extended drive might access a file to evaluate whether it is infected with a virus.
The File System Manager Administrator online help provides additional details
on selecting the options for each page of the wizard.
300 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
4. On the Settings page, select Do not force purges during background scans, as
shown in Figure 114 on page 301.
Figure 114 Purge rule settings for purging as disk space is needed
5. From the Priority drop-down list, select the priority in which files that qualify for
this rule are written to the purge list.
Priorities can be used to ensure that certain files, such as larger files or files that
are accessed less frequently, are purged first when disk space is needed. This
optimizes the purge process.
6. Click Next.
7. Review the summary information and click Finish to complete the wizard and
create the rule.
8. Once you finish creating purge rules, you must order them to set the priority in
which DiskXtender qualifies files for purging, particularly in cases where rules
may overlap (for example, if a file qualifies for two different rules). Keep in mind
the following guidelines:
• If a file qualifies for two different purge rules, then the file is purged based on
the rule that is listed first in the tree view of the Administrator.
• If the file fails to qualify for purging based on the first rule, then the file is
evaluated against the second rule.
• If the file is excluded from purging based on the first rule, then the file is not
purged, even if it qualifies based on the second rule.
• If the file qualifies for purging based on the first rule, then the file is purged,
even if it is excluded from purging based on the second rule.
As a result of the last two guidelines, exclusion rules should generally appear first
in the list of rules. This enables the exclusion to take place.
To edit the priority for a purge rule, right-click the rule and select either Promote
or Demote.
Note: After you create a purge rule, you can edit it by right-clicking the rule and selecting
Properties. The Purge Rule Properties dialog box appears, and contains tabs that
correspond to the pages of the wizard you used to create the rule.
To delete a purge rule, right-click the rule and select Delete. Then click Yes on the
confirmation message.
9. (Optional but recommended) Adjust the purge watermarks for the extended
drive:
a. Right-click the extended drive and select Properties.
The Extended Drive Properties dialog box appears.
b. Click the Options tab.
c. Scroll through the list and select the Purge start watermark option.
d. Change the value from the default of 95 percent to a new percentage. A value
of 80 percent may be more appropriate, especially if you are running
DiskXtender in a high-volume environment.
e. Select the Purge stop watermark option from the list of options.
f. Change the value from the default of 90 percent to a new percentage. A value
of 70 or 75 percent may be more appropriate, especially if you are running
DiskXtender in a high-volume environment.
g. Click OK.
302 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
Figure 115 Purge rule settings for purging during background scans
5. Click Next.
6. Review the summary information and click Finish to complete the wizard and
create the rule.
7. Once you finish creating purge rules, you must order them to set the priority in
which DiskXtender qualifies files for purging, particularly in cases where rules
may overlap (for example, if a file qualifies for two different purge rules). Keep in
mind the following guidelines:
• If a file qualifies for two different purge rules, then the file is purged based on
the purge rule that is listed first in the tree view of the Administrator.
• If the file fails to qualify for purging based on the first purge rule, then the file
is evaluated against the second purge rule.
• If the file is excluded from purging based on the first purge rule, then the file is
not purged, even if it qualifies based on the second purge rule.
• If the file qualifies for purging based on the first purge rule, then the file is
purged, even if it is excluded from purging based on the second purge rule.
As a result of the last two guidelines, exclusion rules should generally appear first
in the list of rules. This enables the exclusion to take place.
To edit the priority for a purge rule, right-click the rule and select either Promote
or Demote.
Note: After you create a purge rule, you can edit it by right-clicking the rule and selecting
Properties. The Purge Rule Properties dialog box appears, and contains tabs that
correspond to the pages of the wizard you used to create the rule.
To delete a purge rule, right-click the rule and select Delete. Then click Yes on the
confirmation message.
IMPORTANT
Even if you plan to purge files immediately after they are moved by using the
move rule option, you should still configure purge rules, as discussed in either
“Purging files as disk space is needed” on page 300 or “Purging files during
background scans” on page 302. If you do not configure purge rules and the
purged files are fetched, the files may not be purged again.
304 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
Note: When you disable the file fetch schedule, you prevent only client fetches from occurring.
Prefetch media tasks and prefetch requests continue.
Within the scheduler, colored lines represent each activity, including the file
migration, media task, and copy media update schedules. This enables you to
quickly see which activities are scheduled for each hour of each day of the week.
4. Select the area of the grid that corresponds to the time period during which you
would like to disable file fetches.
5. Clear the Allow fetches from media checkbox in the Activities section.
6. Ensure that the checkboxes are selected or cleared appropriately for the file
migration, media task, and copy media update activities.
7. Click Set.
8. Click OK.
9. Click OK again to close the Extended Drive Properties dialog box.
306 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
If you prefetch a file marked for Direct Read, the file is fetched and the Direct Read
attribute is removed from the file. Depending on how you choose to mark files for
Direct Read, the file might be marked for Direct Read again when it is purged.
“Reading files directly from media” on page 313 provides details on Direct Read.
Prefetch requests To select specific files for retrieval from storage media, you can set up either a direct
or indirect prefetch request:
◆ Create a direct prefetch request to browse to and select certain files and folders.
You can also select files for a direct request by using a text file that lists specific
files, and save the list of files you select to a text file for use again later.
Note: If the contents of a file list loaded for a direct request changes, DiskXtender does not
register those changes for resubmission. For this reason, direct requests should not be used
for recurring prefetches where file lists are regenerated each time. Instead, save the
recurring file list for use later in an indirect prefetch request.
◆ Create an indirect prefetch request to load an existing file list. This option is
intended for re-occurring batch prefetches where the list of files being prefetched
might change. You designate the name of the file containing the file list, and then
rebuild that list if needed. With an indirect request, DiskXtender registers only
the name of the file that contains the list of files to be prefetched. As long as that
list is saved under the specified filename, the contents of the list can change as
often as required.
The following topics provide details on creating and managing prefetch requests.
2. Click New.
The Prefetch Information page of the Prefetch Wizard appears, as illustrated in
Figure 119 on page 308.
308 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
3. In the Tracking Details text boxes, type the identifying information listed in
Table 40 on page 309 for the request. This information appears in the Prefetch
Properties page after the request is complete.
Item Description
Scheduling
option Prefetch frequency Settings to configure
Scheduling
option Prefetch frequency Settings to configure
Daily Every x days at the specified time, where x is a number • Daily frequency
between 1 and 365. • Time
Weekly Every x weeks on the specified days (Monday through • Weekly frequency
Sunday) and time, where x is a number between 1 and • Time
52. • Days of the week
Monthly Every x months on the specified date (1st through 31st) • Monthly frequency
and time, where x is a number between 1 and 12. • Time
• Day of the month
Note: If the date you select does not occur for a given
month, then the prefetch occurs on the last day of the
month. For example, if you select the 31st for the
schedule, then the scan occurs on the 30th in April.
310 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
Note: You can also load a list of files from a prefetch request (.dxp) file. To load a list of
files, click Load From File, navigate to the prefetch request file and click Open. The file
must meet the requirements that are listed in “Creating an indirect prefetch request” on
page 311.
8. (Optional) To prefetch the same files again at a later date, save the list to a file by
clicking Save To File and selecting a location and filename for the list.
Prefetch request files are saved by default with a .dxp extension on the extended
drive.
9. Click Finish.
When a request is pending, you can edit or delete the request. When a request is
in progress, you can abort the request or view a log of the request activity. When a
request is completed, you can edit the request, resubmit it, delete it, or view a log
of the final request activity. The File System Manager Administrator online help
provides details.
2. From the Tools menu in the File System Manager Administrator, select Prefetch
Request Manager.
The Prefetch Manager dialog box appears, as illustrated in Figure 118 on
page 308.
Prefetch media task To prefetch all files from a certain piece of media, you can assign a Prefetch media
task. This task is particularly useful if you know a specific piece of media will not be
available for file retrieval for an extended period of time. It makes it possible to set
the media offline and physically remove the media from the system without the risk
that it might be needed to provide file data for client requests.
To assign a Prefetch media task:
1. Right-click one or more pieces of media and select Edit Tasks.
The Media Tasks dialog box appears.
2. Select PREFETCH from the Next Task drop-down list, and then click Add Next
Task.
The task is added to the task list in the Media Tasks dialog box, as illustrated in
Figure 123 on page 313.
312 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
Note: Byte Offset Read enables an application to read a very small portion of a file rather
than reading the entire file.
◆ Files with fixed content (read-only files, or files that are not edited once they are
created) that are not accessed frequently
◆ Files that are permanently archived and are not accessed frequently
Note: This option does not change the Direct Read attribute for a file. Rather, it overrides
the attribute. Therefore, you can view the results of changing this setting relatively quickly.
You might want to use this option to evaluate the performance impact of implementing
Direct Read before you configure move rules with Direct Read.
314 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
• When finalizing DVD-R media with the Finalize media task, select the Mark
files for direct read option. “Manually finalizing DVD-R media” on page 146
provides details.
• When automatically finalizing DVD-R media, select the Direct read files after
auto-finalizing media option in the media group. “Automatically finalizing
DVD-R media” on page 145 provides details.
Note: The Direct Read file attribute is enabled when you use any of these four options. As a
result, if later you decide to disable the Direct Read option, the change can take a
significant amount of time to complete. This is because DiskXtender must edit the
attributes for each file. If you are unsure whether Direct Read is appropriate for your
environment, use the extended drive option listed previously instead of these options.
Note: This option is available only when the Advanced Mode is enabled.
316 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
Note: The special application filtering option applies only to applications that run on the
DiskXtender server. Contact EMC Customer Service by using the Powerlink website for details
on the limitations and special situation configurations for special application filtering.
318 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Purging Files
• To edit an application or the action for purged file access, select the executable
and click Edit.
• To delete an application from the list, select the executable and click Delete.
• To reset the list of applications to the original defaults, click Reset Defaults.
When the list is reset, all of the applications you added since DiskXtender
installation are removed, all of the applications you deleted are reinstated with
their original settings, and all of the applications you changed are reset to their
original values.
6. Click OK.
320 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
12
Deleting Files
The following topics discuss when and how you can delete a file from the extended
drive, and if necessary, how you can restore the file:
◆ Deleting files from the extended drive..................................................................... 322
◆ Deleting files from media........................................................................................... 327
◆ Recovering deleted files ............................................................................................. 328
322 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Deleting Files
Never extend a system drive or a drive that contains application files. However, if
there are system or application files on the extended drive, whose system attributes
is set are excluded by default. This prevents the application and system files from
being deleted. You can view file attributes through Microsoft Windows Explorer.
Note: To clear space on the extended drive but leave files accessible on the drive, purge the files
instead of deleting them.
Type Whether the rule qualifies files for (includes) or excludes files from being deleted.
File Name The location (folder and/or subfolder) and filename (typically extension or file type)
specifications for the files this rule targets for deletion. You can use the standard Microsoft
Windows asterisk (*) wildcard, which represents one or more characters in the name or
extension part of the filename.
Note: You can target only one filename specification per delete rule. To apply the rule to
different kinds of files in the same folder, create separate rules.
Size Whether the rule applies to files of all sizes or only files of a certain size (in KB). You can
specify an upper size limit and a lower size limit. If both limits are specified, then only files
whose size falls between the two limits are subject to the delete rule.
Attributes Whether the rule applies to files with any attribute or only files with certain attributes,
including the Read-only, Archive, Compressed, Hidden, and System attributes.
Note: Files possessing any of the selected attributes will qualify for the rule, as opposed to
files needing to possess all of the selected attributes to qualify, or files needing to possess
only the selected attributes to qualify.
Age Whether files of any age qualify for deletion, or if some period of days must pass after the file
was created, last accessed, or last written to (modified).
Note: If you choose to delete files based on the last access time for the file, be aware that
files can be accessed by applications as well as by users. For example, a virus scan of the
extended drive might access a file to evaluate whether it is infected with a virus.
The File System Manager Administrator online help provides additional details
on selecting the options for each page of the wizard.
When you reach the end of the wizard, a summary page provides a listing of the
criteria you selected.
3. Click Finish to complete the wizard and create the rule.
4. Once you finish creating delete rules, you must order them to set the priority in
which DiskXtender qualifies files for deletion, particularly in cases where rules
may overlap (for example, if a file qualifies for two different rules). Keep in mind
the following guidelines:
• If a file qualifies for two different delete rules, then the file is deleted based on
the rule that is listed first in the tree view of the Administrator.
• If the file fails to qualify for deletion based on the first rule, then the file is
evaluated against the second rule.
• If the file is excluded from deletion based on the first rule, then the file is not
deleted by DiskXtender, even if it qualifies based on the second rule.
• If the file qualifies for deletion based on the first rule, then the file is deleted,
even if it is excluded from deletion based on the second rule.
As a result of the last two guidelines, exclusion rules should generally appear first
in the list of rules. This enables the exclusion to take place.
To edit the priority for a delete rule, right-click the rule and select either Promote
or Demote.
Note: After you create a delete rule, you can edit it by right-clicking the rule and selecting
Properties from the shortcut menu. The Delete Rule Properties dialog box contains tabs
that correspond to the pages of the wizard you used to create the rule.
To delete a delete rule, right-click the rule and select Delete. Then, click Yes on the
confirmation message.
324 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Deleting Files
Administrators should use this option judiciously. Leaving this option enabled
might mean that even files that are not required and have been deleted from the
extended drive will continue to occupy space on the media. Usage of this option
should be reviewed from time to time.
Retrieving files that When the Prevent delete from media operation is enabled, files that are deleted from
are not deleted from the extended drive, are not deleted from the backend media. These files can be
the media retrieved from the media using these options:
◆ File restore - Use this media task to retrieve the file from the backend media to the
extended drive. In case of a scenario where multiple files with same name have
been deleted (after enabling Prevent Delete From Media), File Restore media task
restores the latest file to the extended drive. The older files can be obtained from
the Recycler (if Recycler is enabled). To recover files from Recycler Bin see
“Recovering deleted files” on page 328.
◆ You can also retrieve files using stubs backed up before deletion. Restore the stubs
from the back up to the extended drive, and double-click the stub to access a file.
326 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Deleting Files
Note: If you have an EMC Centera Basic or Governance Edition device and you set
retention, you can delete retained files by using a privileged delete. “Deleting retained
files” on page 264 provides details.
◆ TSM
With the media types in the following list, however, DiskXtender cannot delete the
file from media:
◆ DVD-R and DVD-ROM
◆ DVD-RAM, MO, MO WORM, UDO, and UDO WORM media formatted with the
OTG file system
◆ Tape and tape-WORM
Instead, the file is marked for deletion. It still exists on the media, but it becomes an
orphaned file and is no longer recognized or tracked by DiskXtender. The deleted
files are not actually removed from the media until the media is reformatted.
IMPORTANT
When a significant number of delete transactions are sent to some types of media,
including EMC Centera or removable media libraries, the completion of those
transactions may take a long time. During that time, file fetches may be delayed or
even canceled due to timeout issues. Do not empty the DiskXtender Recycler when
users are most likely to access the system. Or, if the Recycler is disabled, do not
delete a significant number of files from the extended drive when users are most
likely to access the system.
Note: You cannot rename a file or folder on the extended drive if there is a file or folder with
the same name in the Recycler. An error message appears to notify you that the rename could
not proceed.
In addition, if the filepath for a file on the extended drive exceeds 259 characters and the
Recycler is enabled, then you cannot delete the file. This is because DiskXtender cannot
manage files with filepaths that exceed 259 characters. You must shorten the filepath or disable
the Recycler in order to delete the file.
IMPORTANT
The Recycler is not a substitute for regular backups of the extended drive. It is
intended only for short-term storage of deleted files to provide rapid recovery
when an accidental deletion takes place. As a result, the Recycler is located on the
extended drive, and it factors into the total amount of space on the extended drive.
To avoid filling the drive with deleted files, empty the Recycler on a regular basis.
You can schedule the Recycler to empty automatically, or you can manually empty
the Recycler as needed.
328 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Deleting Files
Note: Attempting to use the Microsoft Windows Recycle Bin as well as the DiskXtender
Recycler can result in Access Denied errors when users try to delete files from the extended
drive.
2. Double-click the DiskXtender Recycler in the tree view of the File System
Manager Administrator.
The Recycler Properties dialog box appears, as illustrated in Figure 126 on
page 329.
These exclusions are intended to save space on the extended drive by preventing files
from being placed in the Recycler when you are certain that they will never need to
be restored.
You can exclude files based on the location and name of the file. Certain files, like
Windows and shell temporary files, database lock files, and utility files, are excluded
by default.
In addition, you can specify whether files of a certain migration status (migrated,
purged, or fetched) are excluded from the Recycler.
A specific file Specify the name of the file, including the name, extension, and \MediaFolder\File.txt
full path on the extended drive to the file. You do not need to
specify the drive letter for the extended drive. DiskXtender
appends the extended drive letter to the exclusion when you add
it.
Files of a certain type Specify an asterisk for the filename, and then include the file *.log
extension.
Files in a certain folder Specify the path to the folder from the root of the extended drive. \MediaFolder\
Include a backslash (\) to indicate that you are specifying a
folder. You do not need to specify the drive letter for the extended
drive. DiskXtender appends the extended drive letter to the
exclusion when you add it.
330 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Deleting Files
4. (Optional) To delete a file exclusion from the list, select the exclusion and click
Delete.
5. (Optional) To edit a file exclusion in the list, delete the exclusion and then re-add
it.
6. Click OK.
Note: The DiskXtender Recycler appears as a folder on the extended drive and is visible
through Microsoft Windows Explorer. However, you cannot open files or delete files from the
Recycler by using Microsoft Windows Explorer. You must use the File System Manager
Administrator.
To open the Recycler, right-click the Recycler in the tree view of the File System
Manager Administrator and select Open. The Recycler is illustrated in Figure 127 on
page 331.
You can perform the tasks listed in Table 44 on page 331 from within the Recycler.
Empty the entire Recycler From the File menu, select Empty.
Permanently delete individual Select the files. Then from the File menu, select Delete. “Deleting files from the
files Recycler” on page 334 provides details.
Restore files from the Select the files. Then from the File menu, select Restore. “Restoring files from
Recycler to the extended drive the Recycler” on page 335 provides details.
Note: To open a file listed in the Recycler dialog box, you must restore the file.
Sort the list of files in the Select the column heading by which to sort.
Recycler
Note: Depending on the number of files you have in the Recycler, the sort
process might take several minutes.
332 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Deleting Files
2. In the Emptying Schedule region of the dialog box, choose when to empty the
Recycler. Table 45 on page 333 lists the available scheduling options.
Once Once on the specified date and time. Note that the • Time
default date and time are the current date and • Date
12:00 A.M., respectively. Because this default time most
likely occurs in the past, the Recycler will not be emptied
unless you change this to a date and/or time in the
future.
Monthly Every month on the specified date (1st through 31st) and • Time
time. • Day of the month
Note: If the date you select does not occur for a given
month, then the Recycler is emptied on the last day of
the month. For example, if you select the 31st for the
schedule, then the scan occurs on the 30th in April.
Quarterly Each quarter of the year in the specified month of the • Time
quarter (1st through 3rd), on the specified day of the • Day of the month
month (1st through 31st), and at the specified time. • Month in the quarter
3. If you choose to empty the Recycler (by selecting an option other than Disable in
the previous step), choose whether to remove only files of a certain age or greater:
a. In the Days text box, type the number of days that must have passed since the
specified age criteria.
To remove all files from the Recycler, do not change the default of zero days.
b. From the Since drop-down list, choose whether the file age is calculated from
the time the file was created, last written, last accessed, or deleted from the
extended drive.
4. Click OK.
Note: To sort the list of files in the Recycler, select the column heading by which to sort.
Depending on the number of files in the Recycler, the sort process might take several
minutes.
334 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Deleting Files
Note: To sort the list of files in the Recycler, select the column heading by which to sort.
Depending on the number of files in the Recycler, the sort process might take several
minutes.
Media types that allow recovery of the file tag Media types that require recovery of the full file
These requirements are necessary because the type of media determines whether a
file can be deleted from the media when it is deleted from the extended drive. Files
that have been migrated to the media types in the first column of Table 46 on
page 335 cannot be deleted from the media when they are deleted from the extended
drive. In that scenario, the file remains on the media until the media is compacted and
reformatted. Since the file remains on the media, you can restore the file tag from the
backup, and the connection between the file tag on the extended drive and the file on
the media is restored, as long as the backup software supports EAs.
If a file is deleted from the media when it is deleted from the extended drive (which
happens with the media types in the second column of Table 46 on page 335), then
you must restore the full file with all of its data to the extended drive. The file can
then be re-migrated to media and purged, if necessary.
If you use a media type that requires recovery of the full file, then you must ensure
that there is at least one backup set with a copy of the full file. In addition, you must
be able to easily identify which backup set contains the copy of the full file. Backup
sets from backup software that supports EAs (which includes most backup software)
are likely to contain file tags for some files and the full file data for other files. This
can make the process of tracking the backup location of the full data for each file quite
complex. As a result, the use of the DiskXtender Recycler is recommended for
restoring accidentally deleted files from the media types in the second column of
Table 46 on page 335.
IMPORTANT
If the DiskXtender Recycler is enabled, do not restore a file from a backup set
unless you are certain that the file is not in the DiskXtender Recycler and that the
file in the backup set is a full version of the file (not a file tag). Data loss can occur
when you restore a file tag from a backup set but the file data is no longer on the
media.
336 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
13
Service
Management
IMPORTANT
Because the service continues to run as long as the server is running, if you are
planning to shut down the DiskXtender server, stop the DiskXtender service
before doing so. This enables the service to complete whatever function it was
performing before the system shuts down. When DiskXtender is writing a file to
media, stopping the service before shutting down the server reduces the
possibility of file write errors or media errors occurring during shutdown.
338 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Service Management
340 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Service Management
! IMPORTANT
Unless you have specific reason to do so, do not select the System Account
option for logon. The local system account might not have all of the rights
necessary to perform all DiskXtender functions, particularly if the media
service resides on a different computer. In addition, the service account must
have full access permissions on all media folders and subfolders. Without
proper access rights, DiskXtender cannot move or purge files.
7. Click OK.
8. Click Close.
342 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
14
Monitoring the
System
DiskXtender provides several functions that enable you to monitor, diagnose, and
troubleshoot the system. The following topics provide more information:
◆ Monitoring service events, errors, and warnings................................................... 344
◆ Monitoring file activity............................................................................................... 352
◆ Monitoring media ....................................................................................................... 356
◆ Monitoring licensing................................................................................................... 361
◆ Reports .......................................................................................................................... 363
◆ Audit logs ..................................................................................................................... 365
In addition, the number of errors and warnings since the service was last started is
listed in the status bar at the bottom of the Administrator.
For further notification, you can configure automatic communication of warnings
and errors through email alerts.
Event Viewer
The Event Viewer displays all events for the extended drive. If you do not want to
automatically save a record of the events on the extended drive, you can disable
event logging in the Service Event Configuration dialog box and monitor events in
the Event Viewer. “Configuring event logging” on page 348 provides more
information on disabling event logging.
To open the Event Viewer, select Event Viewer from the Service menu.
You can also take a snapshot of the contents of the Event Viewer and save it for later
use. A snapshot is a capture of up to the last 4,096 lines of the Event Viewer.
To take a snapshot of the Event Viewer, select Snapshot from the File menu in the
Event Viewer. The snapshot appears in RtfPad. You can save, print, and email the
snapshot from RtfPad.
344 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
Event logs
In addition to the viewing capabilities offered by the Event Viewer, there are three
DiskXtender event logs:
◆ The All Events Log lists all activities for the DiskXtender service. Event logging is
useful to trace service events of interest to you. You can configure which events
are traced.
◆ The Errors Only Log lists only DiskXtender system errors and is a useful tool for
detecting and diagnosing those errors.
Note: You can use the System Error Lookup feature to obtain additional information about
each error, including the error name and description, and to quickly translate error codes
that appear in DiskXtender. “Looking up errors” on page 347 provides more information.
◆ The Warnings Only Log lists only DiskXtender system warnings to warn you of
possible problems, such as:
• Requests for media (either to read or write to a file) that could not be satisfied
because the media was not present in DiskXtender (not in any drive or library)
• Files that could not be migrated because media was full or because there were
no more media available in a media group
• Disk full warnings for the NTFS volume on the extended drive
The purpose of this list is to provide a simpler means of discovering problems
that are hindering DiskXtender performance.
Errors and warnings also appear in the Event Viewer, but the Errors Only Log and
Warnings Only Log provide a more precise focus on these important events. You can
also configure errors and warnings to be sent out automatically as email alerts.
“Sending email alerts for errors and warnings” on page 346 provides more
information.
Because they are necessary for system diagnostics, error and warning logging cannot
be disabled. If technical support is needed, you might be asked to open these logs and
specify the information reported.
When opened, the logs slow down DiskXtender performance. When closed, the
impact they have on performance is insignificant. The logs should be opened and
used only for debugging purposes.
Note: Because tracing events impedes system performance, no events are traced by default.
Errors and warnings are logged automatically because of their necessity for troubleshooting.
“Configuring event logging” on page 348 provides more information.
To view a log, open the Service menu, select Event Logs, and then choose the log to
view (All Events, Warnings Only, or Errors Only). The selected log appears in
RtfPad.
The log displays both the time and a message for each event. The most recent events
are last on the list. (The list automatically scrolls the event viewer to display the most
current events.)
You can save, print, and email the log from RtfPad.
4. In the Alert email address text box, type the email address to which the alert
should be sent.
346 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
5. Choose whether to send the alert for warnings errors, or both. You can also
temporarily disable the alert by clearing both checkboxes.
6. Click Add.
7. In the Mail Server text box at the bottom of the Alerts tab, type the name of the
mail server to use to deliver the alerts.
The DiskXtender server should have relay permissions on the mail server. This
enables DiskXtender to connect to the mail server and send the alert messages.
Note: You do not need to configure a mail client on the DiskXtender server to send email
alerts.
Looking up errors
Each DiskXtender error is displayed as an error number. The error lookup feature
enables you to obtain additional information about the error, including the error
name and description, and to quickly translate the error codes provided in
DiskXtender messages. You can look up errors from either the DiskXtender
Administrator or from the event log in RtfPad.
To scroll through the list of system errors, click the forward or backward arrow
buttons.
348 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
2. In the Line Format section, specify logging of particular event attributes. These
options are enabled by default:
• To disable logging the time each event occurs, clear the Time checkbox.
• To disable logging the date each event occurs, clear the Date checkbox.
• To disable logging the thread the event used to communicate with the
processor, clear the Thread ID checkbox.
3. In the Event Log section, configure the All Events Log. Event logging is enabled
by default; however, no events are traced. “Event tracing configuration” on
page 350 provides more information on selecting events to trace:
• To change the maximum size for the log file, type a new value in the
Maximum Log Size text box. The default size is 5 MB. After the maximum log
size is reached, the log is truncated from the beginning of the file (oldest
events).
• To disable logging to the All Events Log, select the Disable log file (viewer
only) checkbox. Events are still logged to the Event Viewer.
• To automatically initiate event logging when the DiskXtender service is
started, select the Trace messages on startup checkbox.
5. In the Error Log section, configure logging to the Errors Only Log:
• To change the maximum size for the log file, type a new value in the
Maximum Log Size text box. The default size is 5 MB. After the maximum log
size is reached, the log is truncated from the beginning of the file (oldest
events).
• To enable logging of DiskXtender errors to the Microsoft Windows
Application Log, select the Write to Windows Application Log checkbox.
Because DiskXtender error logs are cleared when the service is restarted, this
enables the Microsoft Windows Application Log to maintain a running log for
DiskXtender errors outside of the DiskXtender service.
Note: Event tracing configuration affects events only; errors and warnings relating to events of
the types listed are logged regardless of event tracing settings.
350 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
3. From the System drop-down list, select whether to trace Server Processing (local
computer service events) or Remote Procedure Calls (remote administration
service events).
4. In the Options list, select the checkbox next to an event to begin tracing that
event.
5. Click OK.
Note: You might want to save the log before clearing it. To save a log, open it and then select
Save from the File menu in RtfPad.
Note: Indexing statistics are available only if you use the DiskXtender Search Module and you
have enabled indexing for the extended drive.
Note: Because the move list might contain multiple entries for any given file, the actual
count for files queued for a move represents an approximation rather than an exact count.
(Duplicate entries are discarded when moves are processed.) The statistics are intended to
provide a window into DiskXtender system activity to indicate that file migration and
purging is occurring. They are not intended to provide an exact count of files awaiting
migration or purging.
These statistics enable you to verify that files are qualifying for configured rules.
You can also verify that files are qualifying for configured index rules by ensuring
that the ITL file is being updated. To check for updates, monitor the date on the file.
The ITL for an extended drive is located in the \DxLogs\Transaction Logs folder on
the extended drive.
352 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
Note: The statistic for indexed files is reset each time the DiskXtender service is restarted.
354 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
Events that indicate that indexing is successfully occurring appear similar to the
following examples:
MSG 01/17 16:57:05 (0DA0) Index synchronization for extended drive
D: has started.
MSG 01/17 16:57:05 (0DA0) Index synchronization for extended drive
D: has completed successfully.
Note: To enable more detailed tracing of content indexing events on the DiskXtender
server, select the Content Indexing option on the Trace tab of the Service Event
Configuration dialog box. (From the Service menu in the File System Manager
Administrator, select Event Settings.) Keep in mind, however, that enabling event tracing
can impact system performance.
◆ Check the index root directory on the ISE server, and ensure that index files are
being created and updated.
◆ Check the ISE event log.
Use a text viewer to open the ISE000number.log file in the C:\Program
Files\EMC\Index and Search\logs directory on the ISE server. (C:\Program
Files\EMC\Index and Search is the DiskXtender Search Module installation
directory, and number is a number such as 1, 2, 3, and so on. Open the log file with
the highest number. This is the log file with the most recent events.)
To monitor whether specific files have been successfully indexed, run a detailed file
report or view file properties by using the DiskXtender Explorer Add-ons. Files that
have been successfully indexed are marked with the Indexed attribute. Files that have
qualified for indexing and been submitted to the ISE for indexing, but that the ISE
cannot index—for example, because the file is not a supported file type—are marked
with the Do Not Index attribute. Files that qualify for exclusive index rules, as well as
files that have not qualified for any index rules at all, are marked with neither
attribute. (In other words, no content indexing attribute is assigned to these files.)
“Explorer Add-ons” on page 414 provides additional details on the use of the utility
to run a detailed file report or view file properties.
Monitoring media
The following topics provide information on the DiskXtender options available for
monitoring media and clearing errors when they occur:
◆ “Media status indicators” on page 356
◆ “Media task queue” on page 356
◆ “Media group free space” on page 358
◆ “Media logs” on page 358
◆ “Media properties” on page 359
◆ “Clearing media error status” on page 360
Black Online
Blue Full
Red Error
Note: “Clearing media error status” on page 360 provides instructions for clearing media errors.
Yellow Offline
You can change tree view so that all media appears with a black label.
To disable media status indicators, open the View menu and select Enable Color.
This clears the checkmark next to the option.
Note: Media tasks are assigned to media either individually, by using a right-click menu
option, or in groups, by using features such as the Media Prepare Manager and the Copy
Media Manager.
356 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
You can change the processing order of the media in the queue by using the arrow
buttons on the right side of the Media Task Queue Manager dialog box, which are
selected in Figure 136 on page 357.
Because all assigned tasks for a piece of media are processed together, moving a piece
of media in the queue also moves all tasks assigned to that media.
If necessary, you can stop, or abort, a media task that is currently in progress.
To abort pending or suspended media tasks, use the Edit Tasks option and delete the
appropriate tasks from the media. You can abort all media tasks with the exception of
the Format, Finalize, Label, and Label Copy tasks.
If the aborted task remains in the task queue as a failed task, clear the error status to
process the remaining tasks (if any) for that piece of media. “Clearing media error
status” on page 360 provides instructions.
You can also remove pending tasks for a piece of media from the media task queue.
When all tasks are deleted from a piece of media, the media is removed from the
media task queue.
Note: Because you cannot delete a task if it is already in progress, you must first abort any tasks
that are currently processing before deleting them. The File System Manager Administrator
online help provides details on aborting media tasks.
Media logs
DiskXtender maintains a log of activity for each piece of media. These logs are useful
for viewing task processing information and error codes/status for failed tasks.
In addition, if a media task is suspended, an entry in the media log notes when the
task will be retried.
Opening a media log To open a media log, right-click the piece of media and select View Log.
The media log appears in RtfPad. As with any information appearing in RtfPad, you
can save, print, or email the log.
Clearing a media log While media log size is regulated through automatic truncation, the log might
become long and difficult to navigate. If necessary, you can clear the log so that it is
easier to find new information.
To clear the log for a piece of media, right-click the media and select Clear Log. Then
click Yes on the confirmation message.
Note: You might want to save the log before clearing it. To save a log, open it and select Save
from the File menu in RtfPad.
358 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
Media properties
The Media Properties dialog box enables you to view detailed information about a
piece of media, including the type, file system, location, number of files, amount of
free and used space, number of file reads, writes, and errors, and the status of a media
task, if one is in progress.
To view media properties, double-click the piece of media.
The Media Properties dialog box appears, with the General tab selected, as illustrated
in Figure 137 on page 359.
Depending on the type of media and its status, the tabs in Table 49 on page 359 are
available on the Media Properties dialog box.
General Provides identifying information for the media, such as the name, serial number, type, file system,
and status of the media. For original, copy, and duplicate media, you can use this tab to provide a
brief description of the media. This description is then used for media reports.
You can also use the General tab to manually mark the piece of media as full. When media is marked
as full, DiskXtender no longer writes files to the media, although the media is left in the media group
so that users can continue to access files on the media. Full media appears with a blue label in the
Administrator interface.
Location Provides information about the physical and logical location of the media. You can also provide an
offline location for the media, which is used for mount requests and media reports. This location is
also shown when a MEDIA NOT FOUND error appears.
Space Provides statistical information on the physical and logical capacity of the media.
Statistics Appears only for original and copy media, and provides statistics relating to mounts, file input and
output, and errors for the media.
Progress Appears only during certain system activities, and provides the progress of the current activity.
The File System Manager Administrator online help provides detailed information
on the data available on each tab.
Choose whether to cancel all pending tasks and clear the error status, or to
clear the error status and continue processing assigned tasks.
• If the media has encountered a write error, the Clear Media Write Error Status
dialog box appears, as illustrated in Figure 139 on page 360.
Choose whether to mark the media as full or to continue writing files to the media
after clearing the error. When media is marked as full, DiskXtender no longer
writes files to the media.
2. Click OK or OK All, if you are clearing the error status for multiple pieces of
media.
360 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
Monitoring licensing
As files are added to the extended drive for DiskXtender to manage, you can monitor
the DiskXtender license to ensure that you do not exceed the capacity allotted by the
license.
By default, DiskXtender sends a warning if the amount of data that DiskXtender
manages exceeds 80 percent of the licensed capacity. The warning appears in the
event logs and as an email alert, if alerts are configured. If necessary, you can disable
the alert by using the Enable high license capacity usage warning setting on the
Options tab of the Service Properties dialog box.
If you exceed the storage capacity of the license, a 90-day grace period commences.
You must update the license with additional storage capacity before the grace period
expires. Otherwise, file migration is disabled. Contact the EMC Licensing Support
team at licensing@emc.com for assistance with updating the license.
You can monitor license usage for a single DiskXtender installation from the File
System Manager Administrator. The License Server Administrator enables you to
monitor total license usage by all DiskXtender installations.
You should also regularly review the License Server event logs to ensure that the
License Server service and the licenses it manages are healthy and available to the
DiskXtender servers that rely on them.
Table 50 on page 362 lists the information provided on the Licensing Information tab
of the Service Properties dialog box.
Item Description
License Server The name of the server containing the installation of License Server that is currently
administering the licenses for this DiskXtender installation.
Licensing Details Detailed description of the license configured in License Server. This includes the
number of DiskXtender servers, the storage capacity available for use with
DiskXtender, and whether the license is cluster-enabled. The number of DiskXtender
server licenses currently in use and the total capacity current in use are also listed.
362 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
Reports
The DiskXtender reporting feature is a useful tool for tracking system statistics. The
following topics provide a description of each of the reports available, as well as
instructions for running a report.
Types of reports
Table 51 on page 363 lists the reports available in DiskXtender.
Table 51 Reports
Extended Drive Information Displays information about the extended drives you select, including properties
and assigned media.
Full reports also display additional information, including schedule information,
metadata export statistics, move statistics, and fetch statistics.
Media Files Provides information about the files on the selected pieces of media.
Note: You can also run a file report (for a selected group of files rather than for a
piece of media) by using the Explorer Add-ons. The Explorer Add-ons online help
provides more information.
Media Services Provides information on the media services configured on the selected
DiskXtender servers.
Media Tasks Displays a list of media tasks that are pending, are in progress, or that have failed
for selected media on the selected extended drives.
Product Registry Information Provides a complete listing of all information contained in the Microsoft Windows
registry about the DiskXtender service on the selected servers.
Reports 363
Monitoring the System
If you choose multiple report types, the appropriate Report Wizard pages for
each report are merged to form one wizard to lead you through the report
generation process.
4. On the Select Computer(s) page, select the DiskXtender servers for which to
generate a report, and then click Next.
The remaining pages of the Report Wizard depend on the type of report you are
running and enable you to customize the report. You can select additional criteria,
such as extended drives and media, to narrow the statistics that are displayed. You
can also create custom layouts to define the font, font sizes, tab stops, and header and
footer contents used when the report is displayed. The File System Manager
Administrator online help provides details on the options available for each page of
the wizard.
When you complete the Report Wizard, the report appears in RtfPad. You can save,
print, or email the report.
364 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
Audit logs
An audit log is a secure log file that functions independently of the existing
DiskXtender logs (event and warning logs) and Microsoft Windows system logs.
The purpose of the audit log is to provide a secure, access-controlled means for
monitoring change events to the DiskXtender service, and whether each event
succeeds or fails.
An audit log enables you to monitor important DiskXtender events, including:
◆ Addition, editing, and deletion of configuration objects (extended drives, media
folders, media groups, rules, and so on)
◆ Media management tasks
◆ Service stops and starts
The performance impact caused by audit logging is minimal.
Audit logging is available on both the DiskXtender server and on the MediaStor
server.
Note: If the log file reaches its maximum size, a warning message appears and the audit
log is disabled. You must either clear the log or increase the maximum file size for the
log, and then re-enable audit logging.
Note: Because the audit log is a text file, it can be compressed to save disk space.
5. In the Audit Log Location section, type the path where the audit log should be
stored, or click Browse to navigate to and select a location.
The path can be either a local path or a UNC path.
If you specified an unlimited file size in step 4 , then you should change the
default location from the DiskXtender installation directory. If the system drive
becomes full, your system might crash.
If there are multiple DiskXtender servers in the environment, select a different
audit log location for each server.
Note: If you change the location of the audit log after audit logging has begun, the old log
remains in the original location, but is no longer updated.
366 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
7. To log DiskXtender audit operations to the Windows event log as well as to the
DiskXtender audit log, select the Send messages to Windows event log (in
addition to audit log) checkbox.
8. Click OK.
The MediaStor Administrator online help provides details on the MediaStor events
that are logged when you select each checkbox.
Only the service account is added to the security administrators group by default. No
users are added to the monitors group by default. You can add users to either group
by using Windows group management features.
368 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
Figure 142 Select an Output Filename to Display the Audit Data dialog box
3. Enter a filename for the audit log output file (saved as an HTML file) and click
Save.
The audit log appears in HTML format in the default HTML viewer for the server.
Typically, the default HTML viewer is a web browser, such as Microsoft Internet
Explorer.
A sample audit log is illustrated in Figure 143 on page 370.
Note: If you upgrade DiskXtender and then you open the audit log, the audit log displays the
version number before the upgrade. To reset the version number to the current version, clear
the audit log of all events, as discussed in “Clearing the audit log” on page 371.
Field Description
Index Number (#) The index number for the logged entry.
User The user name or ID for the user initiating the event.
Note: If the event is system-generated (for example, saving the registry log), "Internal" is
displayed as the user.
Action The action performed on the specified object, such as create, modify, delete, and so on.
Item Type The object type accessed, such as move rule, media, extended drive, and so on.
370 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Monitoring the System
Field Description
Item ID The object ID (as a hexadecimal number, or a zero if the user is "Internal") used by
DiskXtender.
Error Code The error code that corresponds with a failed action.
Note: If you upgrade DiskXtender and then you open the audit log, the audit log displays the
version number before the upgrade. To reset the version number to the current version, clear
the audit log of all events, as discussed in “Clearing the audit log” on page 371.
IMPORTANT
Once you export the data, it is no longer protected by DiskXtender. In other words,
users who are not members of the security administrators group can view and edit
the information. You must implement other protective measures (such as password
protection, available in many spreadsheet applications) to maintain security of the
information.
3. Navigate to and select a location in which to store the text file and click Save.
If the export was successful, a message appears indicating such success.
4. Click OK to complete the export.
Note: If you remove all users from the security administrators group (DxSecurityAdmins on
the DiskXtender server and MsSecurityAdmins on the MediaStor server), then the audit log is
automatically disabled.
372 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
15
Backup and
Recovery
The following topics provide details on backing up and recovering the DiskXtender
system:
◆ Developing a backup strategy................................................................................... 374
◆ Backing up the extended drive ................................................................................. 376
◆ Ensuring storage redundancy ................................................................................... 390
◆ Backing up the DiskXtender server.......................................................................... 400
◆ Protecting against accidental deletion of files......................................................... 404
◆ Recovering deleted files ............................................................................................. 405
◆ Recovering the system after a failure ....................................................................... 407
374 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
◆ Ensure that there is an additional copy of the secondary storage to which you are
migrating files through DiskXtender. Table 55 on page 375 provides details for
each type of storage.
EMC Centera Enable EMC Centera replication to another EMC Centera cluster.
Removable media Create copies of each piece of media by using the DiskXtender Copy Media
(tape or optical) Manager, or configure multi-target migration to another type of media.
(Available for both the MediaStor and Sun StorageTek ACSLS media
services.)
These best practices are discussed in the remainder of this chapter, as well as
recommendations for alternative backup procedures when you are unable to follow
these best practices.
Note: Ensuring high availability of the DiskXtender system through the use of Microsoft
clustering is discussed in the DiskXtender installation guide. Replicating the extended drive
through products like RepliStor, SRDF, or MirrorView is also covered in the DiskXtender
installation guide.
Note: Even if the backup software is capable of successfully backing up file tags, you may want
to back up a full version of each file before it is migrated and purged to ensure that there is a
full copy of each file available in one of the backup sets.
When backup software is not EA-aware, such as IBM Tivoli Storage Manager, file tags
are backed up as zero byte files, and the migration information for a file is not
captured. Therefore, if you restore a zero-byte file from backup, the file is
re-migrated, and data loss can occur. To prevent this situation, you must include the
full file data in each backup. Purged files must be read from media so that they can be
included in the backup. This slows system performance and requires more disk space
for the backup set.
If you use backup software that does not support EAs, follow the specific backup
process discussed in “Creating extended drive backups with software that is not
EA-aware” on page 381 to minimize the performance impact and ensure that you do
not encounter data loss by restoring incomplete files.
The DiskXtender metadata export feature can be used to supplement backups from
software that is not EA-aware. Metadata exports capture the file migration
information that cannot be captured by backup software that is not EA-aware.
“Metadata exports” on page 385 provides details.
If necessary, EMC Professional Services staff can assist you in choosing the
appropriate backup software for your environment and developing a custom backup
solution for you.
376 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
Note: You may want to back up a full version of each file before it is migrated and purged to
ensure that there is a full copy of each file available in one of your backup sets. To do this,
configure purge rules with an age delay that is sufficiently longer than the time between
backups.
Note: The DxLogs directory includes the DiskXtender Recycler and all of the files within
the Recycler. The Recycler should be restored from a backup only if you must restore the
entire extended drive. In other words, do not restore individual files from a backup to the
Recycler. Otherwise, data loss may occur. “Recovering deleted files” on page 405 provides
details on recovering individual files that have been accidentally deleted.
◆ Schedule backups for times of minimal system activity to minimize the impact to
system performance. Consider all system activity on the DiskXtender server,
including anti-virus scans, background scans, file migration, file fetch activity,
and so on.
Note: Do not select the full backup option. When this option is selected, the backup
includes the full file data for all files, even if the files are purged. This option is
recommended only for backup applications that do not support EAs, such as TSM.
378 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
5. Click OK.
6. Repeat these steps for each extended drive.
Note: If you cannot increase the retention delay due to file retention procedures at your
company, you can avoid file restore issues with retention by restoring files from the backup to
an alternate location and then copying the restored files back to the extended drive.
Note: The backup software used to back up the VSS snapshot, such as NetWorker or
NTBackup, must be licensed and enabled for use with VSS. It also must be EA-aware. Do
not use IBM Tivoli Storage Manager, which does not support EAs, to back up VSS
snapshots.
◆ NetWorker PowerSnap Module for CLARiiON and the PowerSnap Module for
EMC Symmetrix DMX™
! IMPORTANT
EMC SnapImage™ is not qualified with DiskXtender when setting retention
on files migrated to EMC Centera and Retained NAS media.
Updates to this list (including supported versions) are provided in the EMC
DiskXtender Software Compatibility Guide, available on the Powerlink website.
380 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
To delay file migration, set an age delay for the move rule by selecting the Apply
rule to files of age option on the Age page of each move rule, and then choosing
the age criteria.
4. Change the default setting for the 3rd party backup mode setting:
a. In the File System Manager Administrator, right-click the extended drive and
select Properties.
b. Click the Options tab.
c. Select the 3rd party backup mode for managed files option from the list.
d. In the bottom portion of the dialog box, select Full backup - read all file data,
including migration info.
e. Click OK.
f. Repeat these steps for each extended drive on the DiskXtender server.
5. Delay file purging until it is absolutely necessary.
This increases the likelihood that file data will be resident on the extended drive
when the backup occurs. If the file data is on the extended drive, it does not need
to be retrieved from media during the backup.
a. Configure an age delay for purge rules by selecting the Apply rule to files of
age option on the Age page of each purge rule, and then choosing the age
criteria.
b. Leave the default setting on the Settings page for each purge rule.
With the default setting of Do not force purges during background scans,
files are purged based on the extended drive used space percentages
configured in the purge watermarks.
6. Configure a separate purge rule that prevents files with the Archive attribute
enabled from being purged:
a. On the Type page of the new purge rule, select Exclude.
b. On the Attributes page of the purge rule, select Apply rule to files with the
following attributes, and then select the Attributes checkbox.
c. Complete the wizard.
d. Reorder the list of purge rules so that the exclusive purge rule is listed first.
This ensures that files are qualified against the exclusive purge rule before the
other purge rules.
7. Enable the DiskXtender metadata export feature to periodically export files that
are managed by DiskXtender (in other words, migrated to media):
Note: The DxLogs and Recycler directories on the extended drive are not included in a
metadata export. In addition, the size of a metadata export depends on the size of the
extended drive and the data included in the export (files managed or not managed by
DiskXtender), as well as the type of export (incremental or full). In general, the size of a
metadata export is 1,500 bytes per file in the export. If the files on the extended drive have
been migrated to a multi-target media group, then the size of the export increases to 2,000
bytes per file.
382 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
d. Click the Browse button to the right of the UNC Path text box, and browse to
the folder in which to save the export sets. Or, type the path in the text box.
The metadata export should not be stored on the extended drive. Instead, it
should be stored at a network location. In addition, archive the metadata
export as you would any other backup data for disaster recovery.
e. In the Scheduling section, select the frequency with which incremental
exports should be performed.
f. To perform a full export the next time that the incremental export schedule is
active, select the Force next export to be full checkbox.
g. To perform regular full exports, select the Perform at scheduled interval
checkbox.
h. Click Full Export Frequency.
The Full Meta-Data Export Frequency dialog box appears, as illustrated in
Figure 145 on page 384.
IMPORTANT
The four TSM backup executables in the special application filtering list on the
Options tab of the Service Properties dialog box (dsm.exe, dsmc.exe, dsmcsvc.exe,
and dsmagent.exe) are set to Direct Read by default and should remain that way.
This behavior enables TSM to read file data directly from media during a backup,
if necessary, rather than fetching the file to the extended drive and reading it there.
If DiskXtender is required to fetch files to the extended drive, there may not be
enough space on the extended drive to accommodate the file data. In addition, if
you use removable media in a library, thrashing may occur as DiskXtender
attempts to mount the media in the drives to fetch the file data.
10. When using Symantec NetBackup as the third party backup application, the Full
Backup option does not fetch files back to the extended drive.
384 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
Metadata exports
The following topics provide an overview of the DiskXtender metadata export
feature, including when to use it, what is included in an export, how to enable
exports, and where to store exports.
IMPORTANT
Metadata exports should not be enabled if you already use backup software that is
EA-aware. If the EA-aware backup software relies on the Archive attribute to
determine which files should be included in an incremental backup, then a
metadata export can interfere. This is because the metadata export process clears
the Archive attribute. If the attribute is cleared by a metadata export, then the file
is not included in the next incremental backup by the backup software because the
backup software sees the cleared attribute and skips the file, assuming that the file
was backed up in a previously scheduled process.
Once Once on the specified date and time. Note that the • Date
default date and time are the current date and 12:00 • Time
a.m., respectively. Because this default time likely
occurs in the past, the export will not run unless you
change the defaults to a date and/or time in the future.
Monthly Every month on the specified date (1st through 31st) and • Time
time. • Day of the month
Note: If the date you select does not occur for a given
month, then the export occurs on the last day of the
month. For example, if you select the 31st for the
schedule, then the scan occurs on the 30th in April.
6. To force DiskXtender to create a full metadata export the next time the
incremental export schedule is activated, select the Force next export to be full
(setting cleared upon completion) checkbox.
After the export completes, this setting is cleared. Selecting this option does not
affect any scheduled full exports described in the next step.
386 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
7. (Optional) Set a regular schedule for DiskXtender to create full metadata exports:
Note: Logically, you cannot schedule full exports more frequently than incremental
exports. For this reason, certain options might be dimmed when you try to set a schedule
for full metadata exports, depending on the incremental export schedule.
a. Select the Perform at scheduled interval checkbox. Selecting this option does
not affect a forced full export described in the previous step.
b. Click Full Export Frequency.
The Full Meta-Data Export Frequency dialog box appears, as illustrated in
Figure 145 on page 384.
c. Choose the frequency with which to perform full metadata exports:
– Select Always to create a full metadata export every time the incremental
export schedule is active. If you select this option, DiskXtender always
creates a full export and never creates incremental exports.
– Select Once per week on ____ to create a full metadata export once per
week on the day you select from the drop-down list. If you select this
option, DiskXtender creates a full export on the selected day and creates
incremental exports at the times configured for the incremental export
schedule.
– Select Once per month on the ___ (1st – 4th) ______ (day) to create a full
metadata export once a month on the day of the month you select from the
drop-down list. For example, you can select the 1st Sunday of each month.
If you select this option, DiskXtender creates a full export on the selected
day and creates incremental exports at the times configured for the
incremental export schedule.
d. Click OK.
8. Select which files should be included in or excluded from the export. By default,
all of these options are selected, meaning that all files on the extended drive are
included in each export. You can restrict which file information is captured by
DiskXtender by clearing one or more of the following checkboxes:
• Export Dx-managed files (meta-data only) — Leave this option selected to
ensure that DiskXtender captures all the necessary information to restore the
file tags for migrated files.
• Export non-Dx-managed (unmigrated) files (all file data) — Select this
option to export information for files located in media folders that have not yet
been migrated to media.
• Include files not in media folders (all files on drive) — Select this option to
export information for all files located on the extended drive outside of
DiskXtender media folders.
9. Click OK.
10. Click OK again to close the Extended Drive Properties dialog box.
Each time a new full export is created, a new dated folder is created that replaces the
old one. This means that only the current full and associated incremental exports are
resident in the UNC path at any given time.
The metadata export should not be stored on the extended drive. Instead, it should be
stored at a network location. In addition, protect and back up the metadata export as
you would any other backup data for disaster recovery.
The size of a metadata export depends on the size of the extended drive and the data
included in the export (files managed or not managed by DiskXtender), as well as the
type of export (incremental or full). In general, the size of a metadata export is 1,500
bytes per file in the export. If the files on the extended drive have been migrated to a
multi-target media group, then the size of the export increases to 2,000 bytes per file.
388 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
390 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
Note: You can set the block size for tape or WORM-tape media by using the Tape block size
default value setting on the Options tab of the Service Properties dialog box.
UDF DVD-RAM
UDF Magneto-optical
UDF • Magneto-optical
• Magneto-optical WORM
UDF UDO
UDF • UDO
• UDO WORM
392 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
Note: Select the front and back of two-sided media to copy the media in this wizard. To
copy a single side of a piece of media, use the Label Copy media task.
394 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
3. From the Original Media drop-down list, select the piece of original media to
copy.
! IMPORTANT
If you use two-sided media, be sure that the original media you select is not the
flip side of the media to which you are assigning the Label Copy task.
DiskXtender must be able to read the original at the same time it is updating
the copy, and the software cannot read both sides of a single piece of media at
once.
Note: Regardless of the remote media copy method you choose, it might be helpful to use the
editable Offline Location text box located on the Location tab of the Media Properties dialog
box to more specifically identify the location of all remote media.
Updating copy media When the copy update schedule is active, DiskXtender evaluates each copy against its
original to determine whether any updates should be made to the copy. DiskXtender
searches for the number of sectors written, and knows how much of the media it has
left to copy. If updates are required, DiskXtender updates the copy. When
DiskXtender updates a piece of copy media, it copies the data from the original media
to the copy. In other words, files are not fetched to the extended drive during a copy
update.
By default, the copy update schedule is active at the same time as the file migration
and media task schedules (between 8 P.M. and 9 A.M). If necessary, you can edit the
copy update schedule at the same time that you edit the other schedules. “Scheduling
file migration” on page 244 provides instructions.
396 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
Any piece of copy media that is offline at the time the copy schedule is active is not
updated. Those copies are updated the next time the schedule is active, if they are
online at that time.
If the copy is of DVD media and the original is finalized, DiskXtender automatically
finalizes the copy as soon as the update of the copy is complete.
You can view the percentage at which the copy is currently synchronized to the
original by opening the Copy Media Manager. (From the Tools menu, select Copy
Media Manager.) The Copy Media Manager also displays the number of copies there
are for a piece of original media.
Note: In some cases, the update status for a copy might appear as 100 percent, but the written
bytes between the copy and the original are different. If this happens, open the media
properties for the copy and clear the statistics on the Statistics tab. This enables DiskXtender to
reset the tally for written bytes and update the copy appropriately.
Promoting copy media is intended only for disaster recovery, in the event an
original is lost or damaged beyond repair. After a copy has been promoted to
original, it must remain as an original. Attempting to demote the copy and return
the original back to the system is not supported and might result in data loss.
Note: This process removes the files on the media from the extended drive.
Note: Because DiskXtender cannot change the serial number on write-once media (such as
DVD-R or WORM-tape), DiskXtender tracks the serial number internally and equates the copy
serial number with the original when copies of these media types are promoted. For this
reason, if you promote a piece of write-once copy media, remove it from the DiskXtender
system, and then re-add it later, the media is again seen as a copy and must be re-promoted.
398 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
Backing up NAS
Use dedicated backup software to back up files on the NAS device shares configured
as NAS media in DiskXtender. Because the full file data (and not file tags) are stored
on the shares, the extended attribute restrictions that apply to backing up the
extended drive do not apply to backing up NAS.
Full and incremental backups of the NAS shares should be performed on a regular
basis according to your company’s recommended backup policies.
IMPORTANT
Only the DiskXtender service account and any accounts required for backups
should have full access to the share that corresponds to a piece of NAS media. No
other user accounts or applications should have write access to the share.
Backing up TSM
Follow recommended TSM procedures to back up the TSM system, including the
TSM server and client configuration, as well as the media to which the TSM server
ultimately writes.
Multi-target migration
Regardless of the type of media, you can ensure redundancy of files on media by
migrating files on the extended drive to multiple pieces of media with the
DiskXtender multi-target migration feature. With multi-target migration, you can
migrate a single file to different pieces—and even different types—of media at the
same time.
Note: If there are two standard media groups in the multi-target group, each pointing to two
different EMC Centera media services, then you cannot apply retention classes to files that are
written to the media in the multi-target group. This restriction is intended to protect against the
scenario where the retention class on one EMC Centera is applied to files that have been
migrated to a different EMC Centera.
Note: Each DiskXtender installation creates its own registry log file. You cannot restore a
registry log file from one server to another server in order to move or reuse a DiskXtender
configuration. The server to which you are restoring a registry log file must have the same
name as the server from which the registry log file was generated. In addition, you must restore
a registry log file to a DiskXtender installation that is the same release as the one that created
the registry log file.
400 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
2. Select Set the automatic registry log location and click Next.
The Automatic Registry Log Location page appears, as illustrated in Figure 152
on page 401.
Figure 152 Registry Log Wizard – Automatic Registry Log Location page
3. Type or browse to the UNC path to which the registry log should be saved.
To ensure fail-proof disaster recovery, the backup location should be a separate
volume from where the Microsoft Windows server files are located. You might
want to save the registry log files to a different computer.
4. Click Next.
5. Review the summary information and click Finish.
A warning message appears, as illustrated in Figure 153 on page 402.
6. Click OK.
Figure 154 Registry Log Wizard – Registry Log Image Retention page
402 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
3. Type the number of days automatically saved registry log files should be kept.
Note: Setting this to zero days disables the versioning function. The original .rlog file is
saved and overwritten each time the registry log information is updated, but no previous
versions are saved.
4. Click Next.
5. Review the summary information and click Finish.
Figure 155 Registry Log Wizard – Copy Registry Log Information page
404 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
Note: If the file is not in the DiskXtender Recycler, you may be able to restore the file from a
backup. The type of media determines whether it is necessary to restore the full file data or the
file tag from the backup. “Recovering from a backup” on page 405 provides details.
Note: If you use Avamar to back up files on the extended drive and the RA (Read-only and
Archive) attributes are enabled for a file, then the file cannot be overwritten during a restore to
the original location of the file. The file can only be restored to an alternate location. This is a
known issue with the Avamar Windows File System client and is not specific to DiskXtender.
The type of media to which the files are migrated determines whether it is necessary
to restore the file tag or the full file with all of its data. Table 58 on page 405 lists the
media types that require recovery of the file tag or the full file.
Media types that allow recovery of the file tag Media types that require recovery of the full file
These requirements are necessary because the type of media determines whether a
file can be deleted from the media when it is deleted from the extended drive. Files
that have been migrated to the media types in the first column of Table 58 on
page 405 cannot be deleted from the media when they are deleted from the extended
drive. In that scenario, the file remains on the media until the media is compacted and
reformatted. Since the file remains on the media, you can restore the file tag from the
backup, and the connection between the file tag on the extended drive and the file on
the media is restored, as long as the backup software supports EAs.
If the media to which the file was written has been compacted, then you must
restore the full file, and not just the file tag.
If a file is deleted from the media when it is deleted from the extended drive (which
happens with the media types in the second column of Table 58 on page 405), then
you must restore the full file with all of its data to the extended drive. The file can
then be re-migrated to media and purged, if necessary.
If you use a media type that requires recovery of the full file, then you must ensure
that there is at least one backup set with a copy of the full file. In addition, you must
be able to easily identify which backup set contains the copy of the full file. Backup
sets from backup software that supports EAs (which includes most backup software)
are likely to contain file tags for some files and the full file data for other files. This
can make the process of tracking the backup location of the full data for each file quite
complex. As a result, the DiskXtender Recycler is recommended to restore
accidentally deleted files from the media types in the second column of Table 58 on
page 405.
IMPORTANT
If the DiskXtender Recycler is enabled, do not restore a file from a backup set
unless you are certain that the file is not in the DiskXtender Recycler and that the
file in the backup set is a full version of the file (not a file tag). Data loss can occur
when you restore a file tag from a backup set but the file data is no longer on the
media.
406 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
Note: If the volume serial number and the drive letter have been changed, then use the
Change Extended Drive Serial Number Wizard to change the extended drive ID and the
drive letter. The wizard launches automatically when necessary. The online help for the
wizard provides assistance in completing the wizard.
408 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
Figure 156 Extended Drive Meta-Data Import Wizard – Provide Meta-Data Set Location page
3. To change the export from which the extended drive is restored, type or browse to
the path in the UNC Path text box.
You must select the same UNC path that you specified for the metadata export.
Do not attempt to specify the DiskXtender-created metadata export folder
(identified by date) for the restore. The Extended Drive Meta-Data Import
Wizard finds the most recent exports automatically and enables you to select
the correct one.
4. Click Next.
The Select Meta-Data Set page appears, as illustrated in Figure 157 on page 409.
Figure 157 Extended Drive Meta-Data Import Wizard – Select Meta-Data Set page
Because you can create export sets for more than one extended drive and
maintain them in the same UNC path, you might have multiple export sets from
which to choose. However, DiskXtender retains only the most recent exports for
each extended drive, so only one export set appears within each metadata export
folder.
Note: To view the folder and date information for an export set, select the export set and
click Details. The Meta-Data Set Details dialog box appears. When you finish viewing the
details, click Done.
5. Click Next.
6. Review the summary information and click Finish.
The extended drive files are restored to the point at which the export was created.
If you exported only files that had not been migrated, then the metadata exports do
not contain file tags for files that are on media. If this is the case with the export you
are restoring, you also need to restore files that were migrated to media. To restore
files from media, run the File Restore media task for each piece of media.
If the meta-data export contains both migrated and non-migrated files, the files in the
export that had been migrated to media are not restored unless that media is in the
media group at the time the export is restored.
If you have unfinalized DVD media and the metadata import restores the file tags for
managed files, running a File Restore task on the unfinalized media does not retrieve
the file data because the tags are already on the drive. You must run a Prefetch media
task on the unfinalized DVD media to fetch the file data to the extended drive and
keep it there until the media is finalized. “Prefetch media task” on page 312 provides
instructions for running the task.
3. Type the path and filename for or browse to the registry log file.
410 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Backup and Recovery
When browsing to the registry log file, select the directory where the registry log
files are located and click OK. Then select the registry log file from the Registry
Log Images dialog box and click OK.
In most cases, select the registry log file named DiskXtender.rlog, which has the
most recent updates.
However, if the system corruption took place sometime before the most recent
registry log file was saved, you might want to restore an earlier version of the file.
In this case, choose the registry log file with the most recent date.
4. Click Next.
The Restore Registry Log – Warning page appears to warn you that restoring the
registry log will overwrite the current configuration.
5. Click Next.
The Restore Registry Log – Note page appears with a final warning that restoring
the registry log will overwrite the current configuration.
6. Click Next.
7. Review the summary information and click Finish.
The registry log information is copied, and the backup configuration is restored to
the server. Then a message appears to prompt you to restart the server.
8. Click OK.
412 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
A
Utilities
Utilities 413
Utilities
Explorer Add-ons
Installed either on their own or with DiskXtender, the Explorer Add-ons connect to
the extended drive through Microsoft Windows Explorer so that users without a full
installation of DiskXtender can perform individual file management.
Note: When you perform a privileged delete, the file is permanently deleted. Even when
the DiskXtender Recycler is enabled, the file is not placed in it.
The Explorer Add-ons also provide a client fetch notification feature. When a client
with the Explorer Add-ons installed requests a file that must be fetched from media
and the retrieval takes more than a few seconds, a progress message appears to note
that file retrieval is taking place. This situation occurs most often when a requested
file exists on a piece of media that must be mounted in a drive.
You can access the Explorer Add-ons by using a wizard or by right-clicking files in
Microsoft Windows Explorer and selecting DiskXtender. The advantage of the wizard
is the ability to select multiple files from multiple directories. To select files from a
single directory, it might be faster to use the shortcut menu.
The Unload Shell Xtensions option, which is listed on the Microsoft Windows Start
menu for File System Manager or the Explorer Add-ons, enables you to remove the
Explorer Add-ons wizard information from operating system memory. This
information is reloaded the next time any Explorer Add-ons function is called. You
should not need to remove the wizard information from memory unless instructed to
do so by an EMC Customer Support Representative.
414 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Utilities
where n is the release number and drive is the drive holding the installation CD.
6. Click OK.
The setup wizard appears, starting with the Installation page.
7. Click Next.
The Installation Options page appears.
8. Select Install new product and click Next.
The License Agreement page appears.
9. Scroll to the bottom of the license agreement as you read the agreement.
The Accept terms of agreement checkbox is enabled.
10. Select the checkbox and click Next.
The Registration page appears.
11. Type an appropriate name in the Customer Name text box, and the company
name in the Organization text box.
12. Click Next.
The Target Computers page appears.
13. Select the computers on which to install the Explorer Add-ons.
The local computer is listed by default. You can browse to additional computers,
or select them by clicking Add and then typing in the name or IP address.
Note: The Explorer Add-ons are installed to the system drive for each computer listed. You
cannot change the installation drive or directory.
Note: If you installed the Explorer Add-ons on one or more remote computers, in addition
to or instead of the local computer, the Setup Result dialog box appears before the final
confirmation. Take note of any computers listed in the dialog box that require a restart, or
computers where the installation failed, and then click OK.
17. Review the privileges required for each Explorer Add-ons feature, listed in
“Privileges required for the Explorer Add-ons” on page 416, to determine
whether it is necessary to adjust the privileges for any users that will be running
the Explorer Add-ons.
All features The DiskXtender service account must have full access permissions on all media
folders and subfolders. The Explorer Add-ons features will not function properly if the
service does not have full access to the files.
View file reports The logged on Explorer Add-ons user must be a member of the DxUsers group on
the DiskXtender server.
View file properties The logged on Explorer Add-ons user must be a member of the DxUsers group on
the DiskXtender server.
Set Direct Read The logged on Explorer Add-ons user must be a member of the DxAdministrators
group on the DiskXtender server.
Purge files The logged on Explorer Add-ons user must be a member of the DxAdministrators
group on the DiskXtender server.
Edit retention The logged on Explorer Add-ons user must be a member of the DxAdministrators
group on the DiskXtender server.
Privileged delete The profile that DiskXtender uses to connect to the EMC Centera cluster must have
the Privileged Delete right. The EMC Centera online help provides additional
information on access profiles, which should be configured by an EMC Centera
technical representative.
The logged on Explorer Add-ons user must be a member of the DxAdministrators
group on the DiskXtender server.
416 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Utilities
2. Choose the function for which to use the wizard and click Next to proceed.
The Explorer Add-ons online help provides details on each page of the wizard.
Note: When you select a directory, all files in the directory and its subdirectories are subject
to the actions performed through the Explorer Add-ons.
The Explorer Add-ons online help provides details on the tasks required once you
select an option on the menu.
418 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Utilities
DXDiagnostics
If you encounter issues that necessitate EMC Customer Service assistance, you might
be instructed to run the DXDiagnostics utility. The DXDiagnostics utility automates
the collection of information required by an EMC Customer Support Representative
to perform advanced troubleshooting on the DiskXtender system.
DXDiagnostics 419
Utilities
420 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
B
Relocating Migrated
Files
The following topics provide details on moving files after they have been migrated to
media:
◆ Understanding the options for relocating migrated files ...................................... 422
◆ Moving files on the same extended drive................................................................ 423
◆ Moving files to a different extended drive .............................................................. 425
◆ Moving files to a different server.............................................................................. 429
◆ Adding storage to an environment .......................................................................... 431
◆ Replacing storage hardware or media ..................................................................... 437
422 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
Standard NAS ✔ ✔
Aggregate NAS
EMC Atmos ✔ ✔
Tape/tape-WORM
DVD-R
DVD-ROM
TSM ✔ ✔
If you cannot move the files or folders within a media folder, then you can compact
the media with the files and then move the files to the new location. “Moving files by
compacting media” on page 426 provides details.
424 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
Note: You can copy the files from one extended drive to another. When you copy the files, the
files are fetched to the original extended drive. Then, when they are copied to the new
extended drive, the migration information is not included. As a result, the files can be moved to
media from the new extended drive. Then you can delete the files from the original extended
drive, if the media to which they have been migrated allows it. Keep in mind, however, that
copying files from one extended drive to another may take a significant amount of time and
cause a severe performance impact in large environments.
However, if the files that have all been migrated to the same piece(s) of media, and
there are no files on the media that you want to leave in the current media folder, then
you can perform the steps in “Moving files by moving media to a different extended
drive” on page 425 to move the media to a new extended drive.
Alternatively, you can compact the media with the files, and then copy the files to the
new extended drive. “Moving files by compacting media” on page 426 provides
details.
Note: A file is considered active when there is a file or a file tag associated with the file still
on the extended drive. In other words, the file has not been deleted from the extended
drive. With some media types, the file is deleted from the extended drive but is not deleted
from the media itself. Those files, where the file remains on the media but is not on the
extended drive, are not returned to the extended drive during compaction.
• If the file on the extended drive is purged—in other words, there is a file tag
on the extended drive—then the file data is written back to the extended drive,
and the migration information is removed.
• If the file on the extended drive is fetched—in other words, the file data is still
on the extended drive—then the Compact task only removes the migration
information.
2. The compacted media is automatically removed from the media group.
3. You move the files to the new extended drive.
4. The files qualify for move rules on the new extended drive.
If any files from the compacted media remain on the original extended drive, the
files qualify for move rules again.
5. DiskXtender remigrates the files on both the original and new extended drives to
different pieces of media.
The compaction and remigration process is time-consuming and system-intensive.
The following topics provide details on managing the process:
◆ “Ensuring sufficient free space on the extended drive” on page 426
◆ “Prerequisite steps for moving files by compaction” on page 427
◆ “Running the compaction and moving files” on page 427
◆ “Verifying that files are moved and resetting the system” on page 428
426 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
428 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
Note: You can copy the files from the extended drive on one server to the extended drive on
another server. When you copy the files, the files are fetched to the original extended drive.
Then, when they are copied to the new server, the migration information is not included. As a
result, the files can be moved to media from the new server. Then you can delete the files from
the original server, if the media to which they have been migrated allows it. Keep in mind,
however, that copying files from one location to another may take a significant amount of time
and cause a severe performance impact in large environments.
3. If you use NAS media, make a note of the path to the share, and then delete the
media from the media service by selecting the media on the Media List tab and
clicking Delete.
! IMPORTANT
Do not delete TSM or MediaStor media from the media service.
430 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
Note: You cannot add a second EMC Centera cluster to an existing media service.
2. Create one or more new media groups to contain the media for the new media
service. “Creating a standard media group” on page 226 provides details on
creating the media group, and “Automatically creating virtual EMC Centera
media” on page 57 provides details on enabling automatic media creation for the
media group.
Note: You cannot add media from a second EMC Centera media service to an existing
media group.
Note: You can create more than 256 pieces of NAS media, but no more than the maximum will
be online at the same time. You cannot write files to or read files from the media that
DiskXtender does not set online at initialization.
To add NAS media for DiskXtender file storage after the new hardware is installed
and configured:
1. Create one or more shares on the new drive or device. “Creating the shares for
NAS media” on page 76 provides a list of requirements for the shares.
2. Create one piece of NAS media for each new share by following the steps in
“Creating NAS media” on page 81.
3. Allocate the new media to the extended drive by following the steps in
“Allocating media to the extended drive” on page 231.
4. Edit file migration settings to use the new media:
• To continue migrating files to the current NAS media in addition to the new
media, add the new media to the current NAS media groups by following the
steps in “Adding media to a standard media group” on page 232.
Alternatively, you can create new media groups for the new media, as well as
new move rules that select files for migration to the new media in the groups.
• To discontinue file migration to the current NAS media and migrate files to
only the new media:
a. Mark the current media as full by opening the Media Properties dialog box
for the media and selecting the Media Full checkbox on the General tab.
b. Add the new media to the media group by following the steps in “Adding
media to a standard media group” on page 232.
432 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
Note: If the new media is a different type of media, then you must create a new media
group for the media, add the media to the group, and then edit the move rules to point
to the new media group.
434 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
tcpserveraddress Type the IP address or symbolic DNS name of the TSM server.
Note: If the tcpserveraddress information in the dsm.opt file on the TSM server changes, the
change must also be made to the dsm.opt file on the DiskXtender server. The information in
the dsm.opt files must be identical. Differences between the dsm.opt files impact whether
DiskXtender can migrate files to and fetch files from the TSM server.
nodename Type the same client nodename configured on the TSM server for DiskXtender as in the file
on the original DiskXtender server.
In the following example, 99.9.99.999 is the IP address of the TSM server, and
DX-DXSERVER is the client nodename:
*==================================================
* tcp/ip
*==================================================
commmethod TCPIP
tcpport 1500
tcpserveraddress 99.9.99.999
nodename DX-DXSERVER
passwordaccess prompt
4. Repeat step 3 for each option file in the BIN subdirectory of the DiskXtender
installation directory.
5. Stop and restart the DiskXtender service to enable the changes to take effect.
“Starting and stopping the service” on page 339 provides instructions.
6. Perform the steps in “Adding a TSM media service” on page 165 to add a new
media service in DiskXtender for the new TSM server.
7. Create one or more new pieces of TSM media in DiskXtender for the new media
service. “Creating TSM media” on page 169 provides details.
8. Allocate the new media to the extended drive by following the steps in
“Allocating media to the extended drive” on page 231.
9. Edit file migration settings to use the new media:
• To continue migrating files to the current TSM media in addition to the new
media, add the new media to the current TSM media groups by following the
steps in “Adding media to a standard media group” on page 232.
Alternatively, you can create new media groups for the new media, as well as
new move rules that select files for migration to the new media in the groups.
• To discontinue file migration to the current TSM media and migrate files to
only the new media:
a. Create one or more new media groups for the new media. “Creating a
standard media group” on page 226 provides details.
b. Add the media to the new media group by following the steps in “Adding
media to a standard media group” on page 232.
c. Edit the current move rules to use the new media group as the target media
group by selecting the new media group from the Media Group To
Receive Files list on the Settings tab of the Move Rule Properties dialog
box.
436 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
Note: A file is considered active when there is a file or a file tag associated with the file still
on the extended drive. In other words, the file has not been deleted from the extended
drive. With some media types, the file is deleted from the extended drive but is not deleted
from the media itself. Those files, where the file remains on the media but is not on the
extended drive, are not returned to the extended drive during compaction.
• If the file on the extended drive is purged—in other words, there is a file tag
on the extended drive—then the file data is written back to the extended drive,
and the migration information is removed.
• If the file on the extended drive is fetched and the file data is still on the
extended drive, then the Compact task only removes the migration
information.
2. The compacted media is automatically removed from the media group.
3. The files on the extended drive that were compacted qualify for move rules and
are moved to other media. During the media transition process, this other media
is the new media to use.
438 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
Force moves when nothing to purge Select Force file moves when there is Remember that DiskXtender does not purge files from the
nothing to purge extended drive until they have been moved to media. After being
moved, files qualifying for configured purge rules are written to the
purge list. If the extended drive gets filled to the purge start
watermark but there are not enough files on the purge list to free
up the space needed to reach the purge stop watermark,
DiskXtender needs to move files to media to make them eligible for
purge. Enabling this option forces DiskXtender to migrate files so
that it can then purge them to create the necessary extended drive
space.
Purge start watermark Increase the default amount of free space This helps maintain enough extended drive space during the
after which purging begins from 95% to compaction. When this watermark is reached, DiskXtender
90% or even lower, depending on the automatically begins purging files from the extended drive until the
speed of the storage type to which you are purge stop watermark is reached.
transitioning.
Note: If you choose to purge all files as soon as they are migrated
to media by enabling the purge after move option in the move
rules, this setting change is probably not necessary, but making
the change helps ensure that adequate free space is maintained.
Warn when free space is getting low Increase the default amount of free space If you properly set up the system for the transition of files from the
after which a warning is sent from 10 MB to old to the new storage, this warning should not appear. However, if
a size in MB that is at least 10% of the total you enable the warning, you can intervene if necessary and
size of the extended drive. ensure that files are being purged so that the media compaction
and file transfer can continue without interruption.
The media task and file migration schedules (Process Scheduled Media Tasks
and the Move Files to Media schedules) should be active for the time period
during which you are compacting the old media type, and the copy media update
schedule should be inactive during the compaction.
The aggressiveness of the transition dictates the appropriate schedule settings.
For example, if the goal is to have files transitioned over a weekend, set the media
task and file migration schedules to run 24/7 over the weekend. This allows the
assigned Compact tasks and the move of the compacted files to the new media to
take place continuously over the time allotted for the transition.
If the goal is to transition the files incrementally over several days or weeks, you
can set these schedules to run only in the evenings or during other periods of low
system use.
3. Point the existing move rules to the new media groups you created for the new
media type.
You can change the media group that a move rule points to by using the Settings
tab of the Move Rule Properties dialog box. Be sure to change the media groups
for all of the move rules currently pointing to the media groups containing the old
media type. This ensures that the new files written to the extended drive are
written to the new media, not the old.
! IMPORTANT
If you configured the move rules with an age delay based on Last Access Time
(in other words, the files are moved to media only after a certain number of
days have passed since they were last accessed), disable the age delay on the
move rules for the duration of the media transition. The Last Access Time for
the files might change as a result of the compaction, and therefore, the
compacted files would not be written to the new media until after the age
delay has passed, resulting in extended drive space issues.
! IMPORTANT
Even if you select the Purge files immediately after move option, you should
still configure purge rules. If you do not configure purge rules and the purged
files are fetched, the files may not be purged again.
5. Assign the Compact media task to all pieces of media from which to transition
files. Be sure to determine ahead of time whether to compact the media as a
scheduled event (when the media task schedule is active) or ASAP, and select the
appropriate option when assigning the task.
440 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Relocating Migrated Files
Do not reformat the old media or remove it from the extended drive until you
are completely satisfied that the transition of files was successful.
442 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
C
Archiving
ApplicationXtender
Documents
IMPORTANT
To run DiskXtender 6.x with ApplicationXtender, at least two License Server
installations are necessary. DiskXtender 6.x requires License Server 6.x.
ApplicationXtender requires License Server 5.x. The Documentum
ApplicationXtender release notes provide details on the releases of License Server
that are supported with each release of ApplicationXtender.
444 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Archiving ApplicationXtender Documents
5. On each ApplicationXtender user machine, map a drive letter for the appropriate
shares.
446 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Archiving ApplicationXtender Documents
448 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Glossary
This glossary contains terms and definitions found in this document. Many of these
terms are specific to DiskXtender for Windows.
A
ACSLS Device management software product from Sun StorageTek that runs on a UNIX
platform. DiskXtender can use an ACSLS installation as a media service. ACSLS has
the ability to manage retrieval of media in some Sun StorageTek tape libraries.
age delay A time period, configured through DiskXtender rules, that must elapse before a file
can be moved, indexed, purged, or deleted.
aggregate NAS A type of NAS media designed for a Hierarchical Storage Management (HSM)
environment to aggregate files before moving them (a second time) to tape. Files
moved to aggregate NAS media cannot be renamed.
allocate The process of assigning media from the media service to the extended drive. Media
can then be added to a media group so that files can be moved to the media. See also
deallocate.
application pool In MediaStor, a reserve of pieces of media allocated for use with a particular extended
drive.
B
background scan A scan of the extended drive that evaluates the files on the drive against configured
rules, and performs any necessary system activity resulting from that evaluation
(such as writing files to the move or purge list, or deleting files). The scan takes place
in the background so that it does not prevent further monitoring and configuration of
the system.
C
Centera See EMC Centera.
compaction The process of reclaiming used storage media by eliminating wasted space taken up
by outdated copies of files or files marked for deletion. This process copies all active
(non-deleted and current version) files from media back to the extended drive, and
449
then removes the media from the media group so that it can be reformatted and used
again. The files that were copied to the extended drive are ultimately moved back to
media based on the move rules for the media folder in which they reside.
D
de-migration The process of leaving migrated files on the extended drive and marking them as not
migrated when a piece of media is removed from its media group. This enables the
files to be written to another piece of media.
deallocate The process of assigning a piece of media from the extended drive back to the media
service. Media must be removed from a media group before it can be deallocated.
delete rule A rule defining which files should or should not be automatically deleted from the
extended drive (and from media, if the media allows it).
device Hardware. This term is used most often to describe drives and libraries connected
through MediaStor.
Direct Read A way of marking files that have been migrated to media so that they are opened
directly from the media when requested rather than being copied back to the
extended drive. Direct Read is strongly discouraged in most environments.
dismount The process of removing media from a drive. In the case of a stand-alone drive, the
media is dismounted when you manually remove it from the drive. In the case of a
library, the media is dismounted by an internal mechanism in the library that
removes the piece of media from the drive and places it on a shelf in the library.
drive A hardware device through which media can be read or written to.
E
EMC Atmos A multi-petabyte platform for information storage and distribution. It combines
massive scalability with automated data placement to efficiently deliver content
worldwide.
EMC Centera A line of disk-based storage devices deployed on a Redundant Array of Independent
Nodes (RAIN). EMC Centera devices use unique, permanent content addresses to
store and retrieve data. DiskXtender can use an EMC Centera installation as a media
service.
Explorer Add-ons A utility that enables DiskXtender file and folder management functions to be
performed from Windows Explorer, without having to go through the File System
Manager Administrator.
extended drive An NTFS volume, such as a hard drive or partitioned part of a hard drive, for which
DiskXtender provides file migration services by moving files to media and fetching
files from media according to user-configured parameters.
F
fetch The process of retrieving file data from storage media back to the extended drive
when a user requests the file.
450 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
file mIgration The movement of files and file data from one type of media (a hard drive) to other
types of media (such as optical, tape, EMC Centera, or NAS).
file restore The process of placing file tags on the extended drive for files that are on a piece of
media. This enables users to access the files.
file system The software interface used to save, retrieve, and manage files on storage media by
providing directory structures, data transfer methods, and file association.
File System Manager The DiskXtender module that enables you to extend the storage capabilities of NTFS
volumes by using file migration services to move files from the NTFS volume to other
storage media.
file tag The identifying information for a file. The file tag includes such information as file
location, file attributes, file size, and file age.
finalization The process of closing a piece of DVD media when writing to it is finished. Finalizing
DVD media makes the media read-only, effectively closing the media from receiving
any more data. Finalization also stabilizes the media, better protecting the data
written to it.
format The process of verifying the integrity of a piece of removable media and making it
available for use with system hardware. The media is prepared for file writes by the
creation of a specified file system on the media.
For EMC Centera virtual media, a format clears the files on the media so that you can
reclaim space on the device.
H
hardware device A device that contains drives where media can be accessed.
Hierarchical Storage A data storage strategy in which new and frequently used data is stored on the
Management (HSM) fastest, most accessible media (such as NAS) and older, less frequently used data is
stored on slower media (such as tape). See also aggregate NAS.
I
Index and Search A DiskXtender Search Module component that performs content indexing.
Engine (ISE)
index collection The set of all index files for a specific extended drive.
indexing The process of evaluating files and storing information about the files so that a
full-text search for the file can be performed.
Index Transaction Log A list of files that have qualified for index rules but have not yet been submitted to
(ITL) the ISE for indexing. The files are submitted for indexing when the indexing schedule
begins.
J
jukebox See library.
451
L
label The process of assigning a name and serial number to a piece of media so that
DiskXtender can track it.
library A hardware device containing one or more removable media drives, as well as slots
for pieces of media, media access ports, and a robotic mechanism for moving pieces
of media between these components. Libraries automate media loading and
mounting functions. The term library is synonymous with autochanger, autoloader,
carousel, datawheel, jukebox, and near-line storage. In most instances, the term library is
used to refer to libraries or jukeboxes.
M
managed files Files for which DiskXtender has moved the file data to media. Even if a file is saved to
a media folder on an extended drive, DiskXtender does not assume responsibility for
management of the file data until it has moved the file data to external storage media.
media The physical storage on which data is written and from which data can be retrieved.
Depending on the type of media, the medium may be different and the information
may be recorded in different ways. In most instances, the term media refers to the
storage media to which DiskXtender files are migrated.
media activity An activity that requires the establishment of a connection between DiskXtender and
a storage hardware device. For removable media, a piece of media must be mounted
in a drive. Examples include file migration, file fetches, and copy media updates.
media folder A directory that defines a point in the directory tree (from the root of the extended
drive) where the files on a piece of media are located. This folder is created as a
physical folder (or subfolder) on the extended drive, and can be viewed as such
through Windows Explorer.
media group A specific grouping or pool of media within a media folder. Move rules specify the
media group to which files in the media folder are moved.
media pool A reserve of pieces of media available for use with a particular extended drive.
media service An access provider to media. In some cases, the media service is a connection to a
network share. In other cases, a media service is a device management service that
retrieves a specific piece of media and mounts the media in a device, such as a library,
when requested.
media task A media activity that can be assigned to a specific piece of media. Examples include
Format, Label, File Report, Compact, and Check Disk.
MediaStor A device management package that can be used as a media service by DiskXtender.
MediaStor has the ability to manage retrieval of media in a wide variety of hardware
devices.
mount The process of inserting media into a drive. In the case of a stand-alone drive, the
media is mounted when a user manually inserts it in the drive. In the case of a library,
the media is mounted by an internal mechanism in the library that retrieves the piece
of media from a shelf and inserts it in the appropriate drive.
452 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
move list A list of files that have qualified for move rules but have not yet been moved to
media. The files are moved to media when the file migration schedule is active.
move rule A rule that defines which files should or should not be moved to media.
multi-target migration The process of migrating a file from the extended drive to multiple “targets” (pieces,
or even types, of media in two different media groups) by using a single move rule.
N
network-attached A drive or folder on a drive that has been shared to the network to allow DiskXtender
storage (NAS) access to the share. DiskXtender can point to any network share through a configured
NAS media service.
NTFS volume A piece of stationary media or a partition on a piece of stationary media that has been
formatted with the NTFS file system.
P
prefetch The process of automatically retrieving purged files from media and writing them
back to the extended drive. Prefetch is designed to reduce fetch requests and the
impact on system performance through the retrieval of files that are likely to be
needed.
purge The removal of file data from the extended drive (after the file has been moved to
media), while leaving a file tag behind. The file appears as if it is still on the drive.
purge list A list of files that have qualified for purge rules but have not yet been purged from
the extended drive. Files on the purge list are purged either when a background scan
occurs or when extended drive used space reaches a certain level, depending on the
configuration.
purge rule A rule that defines which files should or should not be purged from the extended
drive.
R
Recycler A safety net for files that have been manually deleted from an extended drive. Files
are placed in the Recycler instead of being permanently deleted. They can be restored
to the extended drive, if necessary, or deleted permanently. The functionality is
similar to that of the Windows Recycle Bin.
registry log A backup of the DiskXtender settings that are stored in the Windows registry.
removable media Media that must be mounted in a drive before it can be accessed. Removable media
can be inserted and removed as needed to allow for access to multiple pieces of
media.
retained NAS A type of media defined in DiskXtender that can take advantage of the file retention
feature available through the File-Level Retention (FLR) file system on a Celerra
Network Server or the Snaplock software on a supported NetApp NAS device. See
also retention.
453
retention The protection of files from edits and deletion for a specified period of time.
Retention is available for EMC Centera and retained NAS media. DiskXtender
enforces retention only after files qualify for a move rule with a configured retention
period.
S
Scratch Pool In MediaStor, a reserve of pieces of media that have not been allocated for use with a
particular extended drive.
T
Tivoli Storage An IBM storage product that DiskXtender can use as a media service or to back up
Manager (TSM) the extended drive. Similar to EMC Centera, TSM uses virtual media when it is used
as a media service.
V
virtual media A piece of media defined in DiskXtender that does not specifically correspond to a
physical piece of media (like a tape cartridge). Instead, the virtual media is designed
to simulate divisions of the larger repository, and can take advantage of the flexible
file migration features available in DiskXtender (media folders, media groups, and
rules). You create virtual media with the EMC Centera, TSM media services, and the
cloud media.
454 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Administration Guide
Index
A disabling 204
aborting forcing 207
background scan 209 halting 202
meta-data exports 388 risks of disabling 204
access profile (EMC Centera) 33, 47 tuning 205
credentials 54 viewing scan activity 209
PEA file 54 backup
account, service 76, 78, 341, 399 audit log 372
ACSLS DiskXtender configuration (registry settings) 374, 400
adding a drive 117 DiskXtender server 277, 400
deallocating media 148 EMC Centera 48
hardware configuration 112 extended drive 374, 376 to 388
LibAttach 112 File System Manager configuration, copying 403
removing a drive 119 File System Manager configuration, location 401
Administrator File System Manager registry, keeping versions 402
automatically refreshing 25 media 375, 390 to 399
refreshing 25 meta-data export, forcing full 386
searching 26 meta-data export, location 386
Adobe Acrobat PDF file support 273 meta-data export, scheduling 386
Aggregate NAS 73 meta-data export, stopping 388
alias, EMC Centera node name 33 scheduling 378, 386
All Events Log 345 select files for backup 387
anonymous profile (EMC Centera) 34, 47 snapshot 380
application pool, EMC Centera 33 strategy 374 to 375
ApplicationXtender 443 to 447 supported software 376
Archive attribute 385 Backup Exec 377
ArcServe 377 BakBone NetVault 377
attribute, file barcodes, using to label media 132
Do Not Index 272 BLOBs
Indexed 272, 273 deleting from EMC Centera 41
audit logs embedding in the CDF 39, 55
backing up 372 block size
clearing 371 setting for tape media 159
disabling 372 setting for WORM-tape media 159
exporting 371 BrightStor ArcServe 377
resetting 371
audit string for file deletes 47, 54 C
auto refresh frequency 25 cache, Direct Read 315
capacity
B EMC Centera media 34
background scans 202 NAS media 72
aborting 209 C-Clip (EMC Centera)
configuring 205 file 36
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 455
media 34 deleting
CDF (C-Clip Descriptor File) 35, 39, 55 ACSLS media 119
Celerra cloud media 183
as NAS media 72 EMC Centera media 60, 84
FLR file system 76 extended drives 198
CentraStar 35 files 321
character count (filepath limitation) 74 files from media 327
check disk 137, 397 files from the extended drive 322
CLARiiON files from the Recycler 334
as extended drive 188 files on replicated EMC Centera devices 49
as NAS media 72 files on the extended drive 271, 272
PowerSnap module 380 index collection 281
clearing the audit log 371 media folders 201
client-side ID calculation 40, 55 retained files 47, 264
cloud storage 175, 176 TSM media 171
add media service 178 with audit strings 47, 54
create media 181 Direct Read 313
delete media 183 exceptions 316
EMC Atmos 177 memory cache 315
media lifecycle 181 performance 313
removing media 183 recommended uses 314
cloude storage setting for specific files 414
create media 181 when not to use 314
cluster disaster recovery
EMC Centera. See EMC Centera EMC Centera 48, 407
preparing TSM for use 163 extended drive 408
collision avoidance 39, 55 MediaStor 407
communication threads (EMC Centera) 41, 46 disbling the audit log 372
CommVault Galaxy 377 Do Not Index file attribute 272
compaction 138 DSM.OPT file 163
compliance, EMC Centera 46, 47 duplicate Content Address, preventing 39
compression DVD
disabling/enabling 131 drive saver 158
hardware 159 last fetch timeslice 159
Computer Associates BrightStor ArcServe 377 maximum mount timeslice 159
Content Address (EMC Centera) 35 minimum mount timeslice 158
calculating 40, 55 DXAdministrators 47
duplicate 39 DXNASVerify utility 89
file 35
media 34
E
content indexing 267
EDL 97
content-addressed storage (CAS) 35, 39
embedded BLOB threshold 39, 55
converting from one media type to another 437
EMC Atmos 177
copy media 390
add media service 178
Copy Media Manager 392
change shared secret 184
copying media
configuring 177
choosing media to use 391
configuring DiskXtender 177
promoting originals 397
create media 181
scheduling creation 392
delete media 183
updating 396
media lifecycle 181
using media tasks 394
EMC Avamar 377
using the Copy Media Manager 392
EMC Centera
corrupt media, repairing using check disk 137, 397
anonymous profile 34, 47
audit string for file deletes 47, 54
D backing up media 398
delete rules 322 Basic Edition 46, 254
and Recycler 322 CDF (C-Clip Descriptor File) 35, 39, 55
deleting 324 CentraStar 35
editing 302, 324 client-side ID calculation 40, 55
suggested uses 322 collision avoidance 39, 55
456 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
communication threads 41, 46 filepath length limitations 74
Compliance Edition (CE) 46, 254 free space 426, 438
Compliance Edition Plus (CE+) 46, 254 meta-data export location 386, 408
Content Address 35 meta-data export, forcing full 386
Content Address, calculating 40, 55 meta-data export, restoring 408
Content Address, duplicate 39 meta-data export, scheduling 386
content-addressed storage (CAS) 35, 39 meta-data export, select files to export 387
disaster recovery 407 meta-data export, stopping 388
editing files and folders 63 purging files from 292
embedding BLOBs 39, 55 recovering 408
file Content Address 35
Garbage Collection 35, 41, 61
F
Governance Edition (GE) 46, 254
fetching files
media capacity 34
notification 414
media C-Clip 34
prefetch 307
media Content Address 34
file report 414
media service, configuring 53
file restore 75
media, adding automatically 35
file retention. See retention
media, adding manually 35
file streams 191, 316
media, creating 35
file systems
media, defined 34
OTG 126
media, formatting 35, 61
supported 125
media, reclaiming 35, 61
UDF 126
media, removing 60, 84
file tag 292
metadata 35
file types
node name alias 33
supported for indexing 273
preparation steps 50, 51
supported on the extended drive 189
privileged delete 47, 264, 414
filename length limitation 74
profiles 33, 47, 51, 54
filepath limitations 74
replication 48, 398
filtering applications 317
retention 46, 253
finalizing 145
Seek and Chargeback Reporter 35
find 26
simultaneous writes to media 42
forcing
single-instance storage 38
background scan 207
single-instance storage exceptions 39, 40
full meta-data exports 386
Storage Strategy Capacity 38
formatting media
Storage Strategy Capacity exceptions 39, 40
double-sided optical 125
Storage Strategy Performance 38
EMC Centera 35, 61
synchronous deletes 49
enabling/disabling compression 131
virtual pool 33
using a media task 133
EMC Disk Library (EDL) 97
when to format 124
emptying the Recycler 332 to 334
frozen interface (server busy timeout) 26
errors
log 345
repairing with check disk 137, 397 G
event log 350 Galaxy, CommVault 377
event viewer 344 Garbage Collection (EMC Centera) 35, 41, 61
Excel, Microsoft (file type) 273 graphics file support 273
exceptions
Direct Read 316
EMC Centera single-instance storage 39, 40
H
Explorer Add-ons 414 hardware compression 159
exporting the audit log 371 Hierarchical Storage Management (HSM) 76
extended attributes (EAs), DiskXtender 376, 381, 384, 385 host adapter, recommendations 96
extended drive HP OpenView Storage DataProtector 377
background scans 202 HTML file support 273
backup 374, 376 to 388
deallocating ACSLS media from 148 I
deleting 198 image file support 273
deleting files 322 index collection
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 457
creating 269, 279,?? to 281 formatting 133
definition 269, 279 inserting into library 121
deleting 281 labeling 125, 132
index rules moving files between types 138
deleting 284 NAS Aggregate 73
editing 284 NAS options 72
Index Transaction Log (ITL) 271, 282, 284, 285 NAS, defined 72
Indexed file attribute 272, 273 NAS, security 76, 78, 399
indexing 267 NAS, share requirements 76
disabling 285 prefetching files from 307
enabling 269 promoting copies 397
pausing 286 removing from media groups 249
schedule 270, 271, 274, 279, 282, 285 renaming 36, 137
strategy 274 repairing using check disk 137, 397
synchronization 282, 287 Retained NAS 74
understanding the process 268 simultaneous writes (EMC Centera) 42
when it occurs 271 spinning down 158
inserting media in a library 121 Standard NAS 72
IP address, EMC Centera node 33 supported file systems 125
updating copies 396
media folders
J
deleting 201
JPEG file support 273
planning 199
setting priority 200
L media groups
labeling media 125 adding media to 232
renaming 36, 137 metadata 35
using barcodes 132 multi-target 220, 237, 399
using the standard method 132 planning 219
length limitations, filepath 74 removing media from 246, 249
LibAttach 112 specifying in a move rule 234
library media services
inserting media 121 EMC Centera 53
licensing 361 MediaStor 93
limitations, filepath length 74 NAS, adding 79
load balancing DiskXtender and EMC Centera 32, 431 media tasks
logs check disk 137, 397
audit 365 to 372 compact 138
clearing 351 finalize 145
configuring 348 to 351 format 133
event 344 to 345 label copy 394
ISE events 355 monitoring 356
media 358 MediaStor
disaster recovery 407
media service 93
M memory cache, Direct Read 315
media metadata export, DiskXtender 376, 378, 381, 382, 385 to
adding manually for EMC Centera 35 388
backup 375, 390 to 399 metadata, EMC Centera 35
capacity (EMC Centera) 34 Microsoft
capacity (NAS) 72 Excel support 273
C-Clip (EMC Centera) 34 PowerPoint support 273
choosing to use as copies 391 RTF support 273
compacting 138, 142 Visio support 273, 279
compression 131 Word support 273
Content Address (EMC Centera) 34 move rules
copying 390, 392, 394 creating 233
creating (EMC Centera) 35 strategy 217 to 219
EMC Centera, defined 34 multi-target migration 220 to 223, 237 to 243, 314, 399
filepath limitations 75
finalizing 145
458 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
N privileged delete 47, 264, 414
namespace table 279,?? to 281 profile (EMC Centera)
NAS access 33, 47, 51, 54
adding a media service 79 anonymous 34, 47
Aggregate NAS 73 promoting
backing up 399 copy media to original media 397
deciding when to purge files to media 293 media folders 200
editing files and folders 85 propagation of deletes on EMC Centera 49
media capacity 72 purge rules
media, defined 72 creating 300
media, security 76, 78, 399 deleting 302, 303
media, share requirements 76 editing 303
options 72 with backups 382
Retained NAS 74, 253 purging
Standard NAS 72 enabling 300
troubleshooting 89 how and when 294
Navisphere 188 individual files 304
NetBackup 377 move rules setting 304
NetVault 377 prerequisite steps 293
Network Appliance (NetApp) 76 strategy 295
NetWorker PowerSnap 380 understanding the process 292
node, EMC Centera
alias 33 R
IP address 33 recovery
NTBackup 377 meta-data export 408
promoting copy media to original media 397
O restoring files from media 410
optical media restoring files from the Recycler 335
drive saver 158 Recycle Bin, Windows 329
formatting double-sided 125 Recycler 47, 322, 328 to 335, 374, 404 to 405
last fetch timeslice 159 and delete rules 322
maximum mount timeslice 159 backing up 378
minimum mount timeslice 158 deleting files from 334
OTG file systems 125, 126 emptying 332 to 334
enabling/disabling 329
opening 331
P opening a file 331
path length, file 74 restoring files from 335
pausing indexing 286 sorting 331
PDF file support 273 when files are deleted from media 327
PEA file (EMC Centera) 54 refreshing 25
performance registry backup 374, 400
Direct Read 313 registry log 374, 400
SCSI device host adapter 96 copying 403
storage strategy (EMC Centera). See Storage Strategy keeping versions of 402
(EMC Centera) specifying location of 401
photo file support 273 release number, DiskXtender 27
pool address (EMC Centera) 54 renaming media 36, 137
pool, virtual (EMC Centera) 33 repairing media using check disk 137, 397
PowerPoint, Microsoft (file type) 273 replication
PowerSnap 380 EMC Centera 48, 398
Prefetch Request Manager 307 of file deletes on EMC Centera 49
prefetching files 307 reports
.DXP files 311 EMC Centera 35
direct request 307 file 414
file format for indirect requests 311 Seek and Chargeback Reporter 35
indirect request 307 system 363
planning 307, 311 resetting the audit log 371
using media tasks 312 restoring
using Prefetch Request Manager 307 deleted files 328 to 336, 405 to 406
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 459
files from media 75, 410 Capacity, exceptions 39, 40
meta-data export location 408 Performance 38
meta-data exports 408 storage transition
resynchronization 282, 287 resetting the system 428, 441
Retained NAS media 74, 253 running 427, 439
retention verifying 428, 441
changing 261 streams, file 191, 316
delaying 257 Sun StorageTek ACSLS
enabling 259 adding a drive 117
expiration 258 deallocating media 148
file deletion 264 hardware configuration 112
impact on file and folder editing 63, 85 LibAttach 112
on media 257 preparing 114
precedence 46 removing drives 119
restrictions 256 Symantec 377
types 254 Symmetrix
understanding 254 as NAS media 72
with EMC Centera 46 PowerSnap module 380
RTF, Microsoft (file type) 273 synchronization
between EMC Centera devices 48, 398
indexing 282, 287
S
of file deletes on replicated EMC Centera devices 49
scheduling
of the extended drive and media 63, 85, 151
background scans 203
backups 378, 386
copy media creation 392 T
copy media updates 396 tape
file migration 244 block size default value 159
indexing 270, 271, 274, 279, 282, 285 cleaning cartridge 121
indexing resynchronization 287 last fetch timeslice 159
meta-data exports 386 maximum mount timeslice 159
search minimum mount timeslice 158
Administrator interface 26 virtual library 97
extended drive data 267 text file support 273
security threads, communication (EMC Centera) 41, 46
EMC Centera 33 TIFF file support 273
index collection 280 timeout, server 26
NAS media 76, 78, 399 timeslice
Seek and Chargeback Reporter (EMC Centera) 35 last fetch 159
server busy timeout 26 maximum mount 159
service minimum mount 158
account 76, 78, 341, 399 Tivoli Storage Manager (TSM)
managing 339 as a media service 161 to 174
understanding 338 client password 167
use special application filtering 317 DSM.OPT 163
shares, NAS media 76 for backups 381 to 384
Shell Xtensions Wizard 414 management class 170
simultaneous writes to EMC Centera media 42 preparing for use in a cluster 163
SnapLock 76 preparing for use with DiskXtender 163
snapshot backups 380 removing media 171
special application filtering 210, 317 requirements 163
spinning down media 158 using in a cluster 163
Standard NAS 72 troubleshooting
statistics check disk 137, 397
background scan 209 media 356
file activity 352 NAS 89
media 359 unresponsive server 26
reports 363 TSM. See Tivoli Storage Manager (TSM)
storage media. See media
Storage Strategy (EMC Centera)
Capacity 38
460 EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide
U
UDF file systems 125
Unload Shell Xtensions 414
unresponsive server 26
use hardware compression 159
user home directories 314
utilities 413
DXNASVerify 89
Explorer Add-ons 414
V
Veritas Backup Exec 377
Veritas NetBackup 377
version number, DiskXtender 27
virtual EMC Centera media
capacity 34
C-Clip 34
Content Address 34
creating 35
defined 34
formatting 35
virtual NAS media
capacity 72
defined 72
security 76, 78, 399
share requirements 76
virtual pool, EMC Centera 33
virtual tape library 97
virus scans 317
Visio, Microsoft (file type) 273, 279
Volume Shadow Copy Services (VSS) 380
W
wasted space, compacting 138
wizard
Extended Drive Restore 408
Label New Copy 392
Registry Log 401, 402, 403
Word, Microsoft (file type) 273
X
XML file support 273
Z
ZIP file support 273
EMC DiskXtender Release 6.5 Service Pack 1 Microsoft Windows Version Installation Guide 461