This action might not be possible to undo. Are you sure you want to continue?
Symantec NetBackup OpenStorage
Data Domain Deduplication Storage Best Practices Guide
Conceptually understanding OpenStorage software and the API-based integration with Symantec NetBackup provides a clear view of the business value and technical merits of the integration. This guide moves past the conceptual stage to solution planning and deployment. Best practice guidelines are covered with the goal of eliminating implementation challenges. Knowledge and experience gained from assisting early adopters is logically presented for the overall benefit of those deploying an OpenStorage solution.
. . . . . . . . . . . . . . . . . . 10 8 . . . . 9 8 . . . . . . . . 3 2 . . . . . 10 8 . . . .1 TARGET AUdIENCE .4 OPTIMIzEd dUPlICATION FAIlURES . . . . . 14 3 . . . . . . . . . 12 4 . . . . . . . . . . . . . . .5 lEGACY REPlICATION . . . . . . . . . . .2 ExECUTIvE SUMMARY . . . . .5 SEEdING REMOTE dATA dOMAIN SYSTEMS . . . . . 14 3 . . . . . . . 8 3 OPTIMIzEd dUPlICATION . . . . . . . . . . . . . . . . . 12 4 . . 14 8 . . . . . . . . . . . . 15 3 . . . . . . . . . . . . .Symantec NetBackup OpenStorage Data Domain Deduplication Storage Best Practices Guide Table of Contents 1 INTROdUCTION . 10 3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6 dUPlICATION JOB CONFIGURATION OPTIONS . . . . . . . . . . . . . . . 5 2 . . .2 TO A dIFFERENT NETBACKUP dOMAIN . . . . . 13 CONClUSION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 STORAGE UNITS ANd STORAGE SERvER ACCESS . . . . . . . . . . . 9 8 . . . . . . . . . . . . . . . . . . . . . . . .2 TAPE CREATION FROM A NON-PRIMARY NETBACKUP COPY . . . . . . . . . . . . . . . . . 15 3 . . . .2 ExISTING BACKUPS – RETAIN OR dUPlICATE? .4 NETBACKUP POlICY MOdIFICATION .3 ThROTTlING OPTIMIzEd dUPlICATION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 TAPE CREATION FROM ThE PRIMARY NETBACKUP COPY . 13 AddITIONAl REFERENCES .1 MUlTIPlE PROTOCOlS ON ONE dATA dOMAIN SYSTEM . . .3 ARE STORAGE lIFECYClE POlICIES REqUIREd? . . . .2 NETwORK CONSIdERATIONS . . . . 14 APPENdIx – MIGRATION TO OPENSTORAGE . . . . . . . . . . . . 13 5 . . . . . . . . . 10 8 . . . . . . . . . . . . .6 dElETING lEGACY STORAGE UNITS . . . . . . . . 13 5 . . . . . . . . . . . . . . . . . . . . . . . . . 3 2 PlANNING . 3 1 . .3 dOCUMENTATION . . . . . . . . . . . . . . . . . . . . . 3 2 . . . . .1 wIThIN ThE SAME NETBACKUP dOMAIN . . . . 12 6 7 8 5 dISASTER RECOvERY . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 NAMING CONvENTIONS . . . . . . . . . . . . . . . 14 3 . . . . . 14 2 SYMANTEC NETBACKUP OPENSTORAGE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2 NETwORKS . . . . . . . . . 3 1 . . . . . . . . . . . . . . . . . 11 4 dUPlICATION TO TAPE . .
2. OpenStorage best practices are examined and discussed to assist in eliminating the bottlenecks associated with deployment and functional testing of the solution. OpenStorage enabled Data Domain storage systems and the Symantec NetBackup OpenStorage Option provide key enhancements for disk-based data protection strategies: 4 NetBackup optimized duplication . 4 Tape consolidation – Backup images from remote locations and branch offices can be replicated to a centralized location where they can be duplicated to tape under the control of NetBackup. Likewise.Backup image duplication based on Data Domain deduplication and WAN efficient replication that is controlled. OpenStorage implementations should be well planned and documented so that they can be deployed more quickly with fewer challenges when compared to the use of ad-hoc techniques. 4 Sharing of OpenStorage storage units among heterogeneous NetBackup media servers.1 Naming Conventions Nomenclature. 4 Recovery of replicated backup images in their entirety or at a granular level via the NetBackup user interface. monitored. However. and disaster recovery are examined. Combining name changes with network changes is made worse when nothing is properly documented. and cataloged by NetBackup. Deployment is straightforward in most environments. Network configurations. Creating a plan and documenting the configuration forms the foundation for a successful deployment and subsequent test phases. is considered important for numerous reasons. Production environments differ from lab environments in that the severity of a situation is likely to be less pronounced in the lab. In this guide. a production environment may not be the best place to learn these techniques for the first time.1 Target Audience System users and vendor staff associated with and performing the OpenStorage deployment are encouraged to use this guide to take advantage of substantial real world knowledge gained from assisting other customers. 4 Integrated NetBackup reporting of Data Domain replication job status. deployments involving multiple sites and a complex environment may experience issues with naming conventions. 1. as well as strategies that are not recommended are covered with the goal of enhancing OpenStorage solution planning and deployment. Supported with NetBackup 6. Deployment is often followed by a series of trials or a period of testing intended to prove that the solution is functioning as planned. 2 Planning Deciding to change naming conventions halfway through a deployment can be painful. even more painful if production backups were executed to previously named components that later need to be deleted such that they can be renamed. The theme is to use a naming convention that will be easily understood by the user. Therefore. network infrastructure. control of the backup images stored in the system and Wide Area Network (WAN) efficient replication to remote Data Domain storage systems. system engineer. The API gives NetBackup visibility into the properties and capabilities of the Data Domain storage system. Recommended best practices. optimized duplication. SYMANTEC NETBACKUP OPENSTORAGE 3 .2 Executive Summary Backups and the creation of duplicate backup copies with OpenStorage are the focus of this document. the assigning of names to OpenStorage specific components. and potentially any support personnel involved with the OpenStorage solution. While configuration changes are both possible and supported. reconfiguring portions of the IP network that connect NetBackup media servers and Data Domain deduplication storage systems halfway through a deployment can also create a less than optimal experience when testing with production backups. 1. OpenStorage software provides API-based integration between Data Domain storage systems and NetBackup.5 and higher. A prerequisite understanding of OpenStorage terms and concepts is recommended and can be gained by reviewing the following documentation: 4 Data Domain OpenStorage Primer 4 Data Domain OpenStorage (OST) User Guide 4 Veritas NetBackup™ Shared Storage Guide 4 NetBackup media server load balancing. eliminating the need to manually divide client backups across NetBackup media servers utilizing OpenStorage storage units. or site generated documentation detailing the installation.1 Introduction Data Domain deduplication storage with OpenStorage software is not difficult to install or configure.
2. this is an unsupported configuration. The selection of multiple media servers within the storage unit definition effectively enables media server load balancing. 4 Use the Data Domain system’s fully qualified hostname as the storage server name. 4 Name the object with a “-lsu” extension to allow for easy identification as a logical storage unit object. Hostnames are resolved via DNS or Hosts files.1.1. Client backups that can potentially connect to two or more media servers can take advantage of media server load balancing. and is not recommended.1. Currently. Symantec NetBackup operates under the premise that a NetBackup master 2. At present.3 Logical Storage Unit Also referred to as an “LSU”.4 Disk Pool A disk pool is a NetBackup object that correlates to one or more LSU’s. High performance Data Domain systems can accommodate data transfer rates in single or multi-stream modes that exceed the maximum performance of 1 GbE (Gigabit Ethernet) networks.1. 4 The OpenStorage plug-in uses standard TCP/IP name resolution to find the corresponding Data Domain system. Explicitly not recommended is the use of hostnames based on different network interfaces so as to increase the total available bandwidth to a single Data Domain system configured as a storage server. but when used as storage server names they are used to tell the media servers at the TCP/IP level how to connect to the storage server. 4 Generally speaking. 4 Name the object with a “-dp” extension to allow for easy identification as a disk pool object. a Logical Storage Unit is a disk target within a storage server: 4 Create one LSU per Data Domain system. 4 Do not use IP addresses in place of hostnames when registering storage servers as this will limit the ability to route optimized duplication traffic exclusively through the registered interface. this can negatively impact the ability of NetBackup to effectively take advantage of such advanced features. 4 Create one storage unit per disk pool. 4 Create one disk pool per LSU. When combined with other illegal configurations such as multiple storage servers on a single Data Domain system.6 Storage Unit Group This is a logical target that is created within NetBackup. 4 Select either “use any available media server” or a specific list of media servers as appropriate.2 Storage Server This is a logical object defined within NetBackup that “points” to a Data Domain system. 4 Use the assigned fully-qualified hostnames. 4 There should be only one storage server defined per Data Domain system. where the least loaded media server (best candidate media server) is selected for use by the NetBackup master server.5 Storage Unit This is a logical target that is created within NetBackup. a single Data Domain system can be illegally configured as a storage server on more than a single NetBackup installation. 4 Use Hosts files to resolve those same hostnames to non-routable IP addresses. server “owns” the storage capacity associated with a specific Data Domain system configured as a storage server. NetBackup communicates with the storage server and uses credentials supplied by the tpconfig utility to request use of a disk pool for backup and restore operations. 4 To allow for N+1 redundancy consider the optional use of storage unit groups. This can create conflicts for advanced NetBackup features such as media server load balancing. 4 SYMANTEC NETBACKUP OPENSTORAGE . multiple LSUs can be configured on a single Data Domain system. 4 Only media servers that have credentials defined for the storage server can use the storage unit. 4 Do NOT create secondary hostnames to associate with alternate or local IP interfaces. 2. etc. 2. A storage unit that is created of the type “disk” and the disk type of “OpenStorage (Data Domain)” has three properties: a storage unit name. 4 Name the object with a “-su” extension to allow for easy identification as a storage unit object type. and a list of media servers.1 Data Domain Hostname This is the hostname used to identify a system. a single Data Domain system can potentially be configured as a storage server more than once within a single NetBackup domain. Hostnames are not specifically NetBackup objects.1. The reasoning behind this as well as the recommended best practice remedy is covered in the “Networks” section of this document. intelligent capacity planning. The recommended best practice to this challenge is covered in the “Networks” section of this document. 2. At present.1. 2. use DNS to resolve hostnames to IP addresses that are routable through the environment. a disk pool target. This would be true in cases where a given NetBackup media server could connect to the Data Domain system using different network names over different interfaces. 4 This name must be unique across the enterprise. A storage unit group is a collection of storage units that can be used based on selection criteria. Additionally.
4 The preferred storage unit could be the first storage unit in the list of storage units. backups will be sent to an alternate storage unit. In this use case both backup and optimized duplication traffic use the same NIC (Network Interface Card) on a given Data Domain system. 4 Select the “Failover” storage unit selection algorithm. Optimized duplication traffic uses a separate NIC on each Data Domain system. 4 A second storage unit can be added to the group for use should the first storage unit be rendered non-operational. This enables NetBackup media server load balancing. this configuration allows NetBackup to bypass an offline media server when fulfilling a backup or restore request.4 Create one storage unit group per OpenStorage storage unit using a “-sug” extension. 4 NetBackup media servers and Data Domain systems in geographically different locations configured for optimized duplication. Additionally. Use of the “Failover” selection algorithm is a best practice as it facilitates sending the same backups to the same Data Domain OpenStorage Server which will equate to a higher data deduplication ratio. LAN NetBackup Master Server NetBackup Media Server LAN NetBackup Media Server LAN WAN Data Domain OpenStorage Storage Units Figure 2: Geographically dispersed configuration Figure 2 shows a configuration with two NetBackup media servers and two Data Domain systems. In the event that the preferred storage unit enters a non-operational state. This methodology may be of interest for mission critical or otherwise important backup jobs.2 Networks Varying degrees of network complexity are associated with a given OpenStorage deployment. Figure 1: Optimized duplication with a common LAN Figure 1 shows a simple example of a NetBackup master/media server LAN connected to two Data Domain systems. Each NetBackup media server has a local network connection to a co-located Data Domain system. This configuration may be preferred in cases where backup and restore data transfer rates require the use of a 10 GbE network. NetBackup Media Servers NetBackup Client LAN LAN Data Domain OpenStorage Storage Unit NetBackup Media Server LAN Data Domain OpenStorage Storage Units Figure 3: NetBackup media server load balancing Figure 3 shows a NetBackup client that can be backed up through a number of different NetBackup media servers. SYMANTEC NETBACKUP OPENSTORAGE 5 . you may elect not to use storage unit groups for backups that do not require N+1 redundancy. NetBackup optimized duplication adds additional requirements as does a configuration that leverages media server load balancing. a single Data Domain system configured as a storage server is network connected to a NetBackup media server. This section reviews sample network topologies: 4 NetBackup media server and Data Domain systems sharing a common LAN configured for optimized duplication. Alternatively. At a minimum. The use of storage unit groups is optional. 2. The OpenStorage storage unit has been configured so that each NetBackup media server can access its resources. 4 NetBackup media server load balancing with a Data Domain system. where the least loaded media server is used to fulfill a backup request. Backup traffic uses the local network connection between a given NetBackup media server and its co-located Data Domain system. and a lower bandwidth network is able to accommodate optimized duplication traffic. A WAN also connects the Data Domain systems.
2. As a result it also requires four unique storage server instances within NetBackup. The four disk pools are used in configuring four storage units. Other solutions that may pose similar issues are worth noting. Storage unit groups can be created that utilize “load balance” selection criteria to overcome this challenge. 4 NetBackup media server load balancing does not function normally.2. 4 Administrative complexity and overhead is increased with additional network names. NetBackup Media Server Data Domain OpenStorage Storage Unit Disk Pool = DataDomain-dp Basic Disk = /backup/nfs Basic Disk = /backup/cifs LSU = DataDomain-lsu NFS Export = /backup/nfs CIFS Share = /backup/cifs Figure 5: Combining OpenStorage and basic disk storage units Using a single Data Domain system as an OpenStorage storage unit and a basic disk storage unit (NFS mount or CIFS share) is not recommended. NetBackup intelligent capacity management will not be aware of space allocated to basic disk or VTL (Virtual Tape Library) operations. 4 Combining an OpenStorage storage unit and a basic disk storage unit on the same Data Domain system can create capacity reporting issues. 4 Manual assignment of NetBackup policies to one of four storage units are required in order to route backups over a specific network interface. the potential aggregate data transfer rate would be much greater. which include OpenStorage storage units. NetBackup assumes complete and total ownership of any OpenStorage storage unit space. NetBackup Media Server Eth0 Eth1 Eth2 Eth3 Data Domain OpenStorage Storage Unit Figure 4: Attempting to overcome the single 1 GbE bottleneck This configuration requires using four unique network names for a single Data Domain system.0 through 6. 2. This example is also applicable to the sharing of a Data Domain system between OpenStorage and VTL protocols.1 Problematic Configurations The high data transfer rates achievable with Data Domain DD690 systems can easily exceed the available bandwidth of a single 1 GbE network connection. storage servers. To date. 4 Capacity reporting within NetBackup is skewed as NetBackup believes that there are four separate physical storage servers.5. challenges have been associated with attempts to achieve high data transfer rates while circumventing the need for a 10 GbE backup network. The limitation may eventually be removed in a future version of NetBackup. and possibly storage unit groups. disk pools. While the simultaneous use of all Data Domain supported protocols is possible. Although single stream performance would still be bound to the 1 GbE limitations of approximately 125 MB/s. 4 Using an OpenStorage Storage Unit for NetBackup catalog backups. LSUs. This configuration results in numerous issues and should be avoided. storage units.Typical deployments may employ a combination of local and geographically dispersed components that leverage NetBackup media server load balancing as well as optimized duplication. Figure 6: NetBackup limitations NetBackup catalog backups cannot be written to “DiskPool” type storage units. This NetBackup limitation is known to exist in product versions 6. One creative solution utilizes multiple 1 GbE network connections from a NetBackup media server to a single DD690 system. 6 SYMANTEC NETBACKUP OPENSTORAGE . Adding four unique LSUs to the configuration yields the ability to create four unique disk pools on the single Data Domain system.5.
as only one NetBackup master server can effectively own or control a given storage server. Single stream performance that exceeds 125 MB/s dictates the need for a 10 GbE network connection. Simplicity is preferred over complexity. The network connecting NetBackup media servers to a given Data Domain system can incorporate the use of multiple 1 GbE interfaces so long as there is only one connection per NetBackup media server. While not always possible based on customer criteria and preexisting NetBackup media server and network infrastructure deployments. 4 Network topology without a 10 GbE infrastructure As discussed previously in the naming conventions section of this document. Whenever possible. 4 Dedicated backup networks lay the foundation for a scalable infrastructure should data protection network bandwidth requirements change over time. 2. The configuration is not supported by NetBackup however. SYMANTEC NETBACKUP OPENSTORAGE 7 .2 Recommended Configurations Best practice recommendations are based on known reference deployments that exhibit desirable behavior and performance characteristics.2. 4 Data Domain recommends the use of a 10 GbE network infrastructure in cases where single stream or aggregate data transfer rates in excess of 125 MB/s are required between a single NetBackup media server and the Data Domain system. NetBackup Master Server 1 Multiple NetBackup domains LAN NetBackup Master Server 2 10 GbE Private Network Storage server conﬁgured for use in multiple NetBackup domains Data Domain OpenStorage Storage Unit Figure 8: Dedicated backup network Dedicated backup networks provide a number of tangible benefits.4 Using an OpenStorage Storage Unit in more than one NetBackup domain. the network used for NetBackup media server to Data Domain system communications should be segregated from other production networks. There is no fundamental reason to commingle NetBackup client network traffic with the network that connects NetBackup media servers and storage servers. Contention issues are constrained to backup and recovery jobs. Figure 7: Unsupported storage server in multiple NetBackup domains Using OpenStorage storage units in a multiple NetBackup master server configuration appears attractive as two sites could potentially replicate to each other and effectively serve as disaster recovery vehicles for each other. This restricts the ability to use multiple 1 GbE interfaces between a single NetBackup media server and a single Data Domain system configured as a storage server. When deploying a Data Domain system that can accommodate data transfer rates exceeding the capabilities of 1 GbE networks. Ease of deployment. and predictable results have yielded these general themes: 4 Data Domain recommends interconnecting NetBackup media servers and Data Domain systems using a dedicated backup area network. 4 Dedicated backup networks segregate NetBackup media server and storage unit traffic from other network traffic. Aggregate performance that exceeds 125 MB/s from a single NetBackup media server also dictates the need for a 10 GbE network connection. strongly recommended is the use of only one storage server and LSU per Data Domain system. Known available bandwidth can be managed from the perspective of achieving aggressive data protection and recovery service levels. the use of a 10 GbE infrastructure overcomes data transfer rate bottlenecks. simplified administration. the use of a dedicated backup network is preferred when compared to mixed use network configurations.
On the NetBackup master server and each NetBackup media server used for the OpenStorage solution the following commands (or their equivalent) should be executed: 4 Optimized duplication traffic can use the same network connection as the NetBackup media server. User requirements to track WAN link usage may also prefer this approach. In cases where optimized duplication traffic flows between geographically different locations. By default the storage unit is defined to allow all four NetBackup media servers to use the shared disk pool resource. This connection links source and destination Data Domain systems specifically for the purpose of replication controlled by NetBackup initiated optimized duplication. and is usually deployed in cases where the source and destination Data Domain systems reside in geographically different locations. multiple Data Domain systems.1 GbE Private Network 1 GbE Private Network 1 GbE Private Network 1 GbE Private Network 10 GbE Private Network 10 GbE Private Network 1 GbE Public Network Figure 10: Separate replication network for optimized duplication Using a separate network for replication controlled by NetBackup optimized duplication is optional. Backup and recovery data streams are fully inflated. 4 Data Collection: Collecting and recording relevant configuration information is consistent with the creation of best practice documentation. Should the need arise to modify. Optimized duplication replicates deduplicated data between source and destination targets. some customers have chosen to use a separate dedicated network connection. documentation lays the groundwork for moving forward. and typically requires only a fraction of the network bandwidth consumed by backup or recovery jobs. each of four NetBackup media servers connects to a specific NIC on a Data Domain system configured as a single storage server. The choice in deciding what network interface to use for optimized duplication is usually based on deployment requirements. This configuration accommodates NetBackup media server load balancing as it utilizes a single storage server. This common sense approach makes it possible for others within or outside of the organization to quickly understand the overall view of the deployed solution should one person be on vacation or otherwise unable to assist when needed. Figure 9: Recommended use of multiple 1 GbE networks In the example shown in figure 9. This 1 GbE topology imposes limits on maximum single stream as well as aggregate data transfer rates from any single NetBackup media server to the Data Domain system. 2. 8 SYMANTEC NETBACKUP OPENSTORAGE . and a single storage unit. alter. Should the need for technical support or other assistance be required. or enhance the solution. data protection administrators. documentation can assist in rapid problem isolation and resolution. where every byte of the stream passes over a network connection. Also included are the individual networks and IP addresses of the components. single disk pool. Each NetBackup media server is configured to use DNS or a local host file such that the storage server name resolves to a specific interface on the Data Domain system. Proper documentation enables various site and vendor groups including management. and the potential use of multiple networks combined with different geographical locations. the importance of documenting the deployed solution cannot be overemphasized.3 Documentation With multiple NetBackup media servers. and network administrators to understand and maintain the deployed solution. 4 Topology Diagram: This basic diagram consists of a map of physical components labeled using the recommended naming conventions. Note this also serves to separate regular backup and restore network traffic from replication traffic that may be a traveling over a wide area network. The combined data transfer rate of all NetBackup media servers can result in an aggregate data transfer rate that seeks to better utilize resources and achieve the maximum throughput possible on the Data Domain system. or it can use an alternate NIC.
optimized duplication is also simple to configure once requirements are understood.conf 3. the NetBackup media server initiating the optimized duplication job requires credentials to access both the source and destination storage servers. as well as for optimized duplication.conf 4 grep hosts /etc/nsswitch. that NetBackup media server needs credentials to access both the source and destination Data Domain OpenStorage servers. In cases where optimized duplication uses a destination OpenStorage storage unit that may be geographically distant from the NetBackup media server initiating optimized duplication.For host configuration: 4 uname –a 4 hostname 3 Optimized Duplication Simple in principle. What this means is that even though a particular NetBackup media server may never directly backup to or recover from a particular Data Domain OpenStorage server. When the source and destination storage units reside on different NetBackup media servers.conf 4 cat /usr/openv/netbackup/bin/version For OpenStorage configuration: 4 /usr/openv/netbackup/bin/admincmd/bpstsinfo –pi –stype DataDomain 4 /usr/openv/netbackup/bin/admincmd/nbdevquery –listdp 4 /usr/openv/netbackup/bin/admincmd/nbdevquery –listdv –stype DataDomain 4 /usr/openv/netbackup/bin/admincmd/nbdevquery –liststs 4 /usr/openv/volmgr/bin/tpconfig –dsh –all_hosts 4 /usr/openv/volmgr/bin/tpconfig –dsh –stype DataDomain On each Data Domain system the following commands should be executed: NetBackup Media Server NetBackup Media Server 10 GbE Private Network 10 GbE Private Network For host configuration: 4 hostname 4 system show version 4 user show list 1 GbE Public Network Optimized duplication source storage unit Optimized duplication destination storage unit Figure 11: Separate source and destination NetBackup media servers Figure 11 depicts optimized duplication between two OpenStorage storage units. it still needs access credentials when the Data Domain OpenStorage server is an optimized duplication destination. This allows the NetBackup media server to use the OpenStorage storage unit for backup and recovery jobs. If both reside on the same NetBackup media server. For network configuration: 4 net show settings 4 net show hardware 4 net show dns 4 net hosts show 4 net aggregate show 4 net config For OpenStorage configuration: 4 ost status 4 ost lsu show 4 ost show user-name 4 ost show connections Credentials are set by means of the NetBackup tpconfig command on each NetBackup media server requiring access to a given OpenStorage storage unit. For NetBackup configuration: 4 /usr/openv/netbackup/bin/admincmd/bpstulist –L 4 cat /usr/openv/netbackup/bp. The NetBackup media server initiating an optimized duplication job needs to have credentials to access both the source and destination OpenStorage storage units. the storage unit definition should not SYMANTEC NETBACKUP OPENSTORAGE 9 . For network configuration: 4 ifconfig 4 cat /etc/hosts 4 route 4 cat /etc/resolv.1 Storage Units and Storage Server Access The first item to consider is source and destination storage units.
The network used for optimized duplication is based on network name resolution on the source Data Domain system. duplication job retry will attempt to use conventional duplication. If this value is not present. Other effects might include the queuing of jobs as optimized duplication jobs contribute to destination storage unit concurrent jobs. Populating the source Data Domain systems hosts file with the desired IP address of the destination Data Domain system is all that is required to use a specific NIC and network. The challenge this presents is that while the remote system is in transit optimized duplication failures may occur. The net effect of network bandwidth throttling may impact recovery point objectives for disaster recovery. Caution should be exercised as throttling back network bandwidth consumption may elongate optimized duplication job run times. The destination Data Domain system is known to the source Data Domain system based on the IP address supplied by DNS. where incremental backups are not duplicated.allow the geographically distant NetBackup media server to use the storage unit for backup or recovery jobs. Once a storage unit’s maximum concurrent jobs parameter has been reached. Different storage lifecycle policies can be employed for full and incremental backups should this methodology align with service level objectives. The NetBackup media server named “NBU65OST_Media1” has credentials to access the storage unit for the purpose of initiating optimized duplication jobs. By setting the storage unit “maximum concurrent jobs” parameter to a value equal to zero. as shown in figure 13. NetBackup will perform optimized duplication using the same network it uses to access the source and destination Data Domain systems. This equates to sending the fully inflated complete backup image from the source OpenStorage storage unit through one (or possibly two) NetBackup media server(s) to the destination OpenStorage storage unit.3 Throttling Optimized Duplication Throttling is controlled at a global level on each Data Domain system. and then after a week or so relocate the Data Domain system to the intended site. Based on service level requirements. One solution to this dilemma is to seed the remote Data Domain OpenStorage Server locally. new jobs requiring the use of the storage unit will be queued as they await storage unit resource availability. A solution is to adjust the appropriate NetBackup storage unit so that no failures occur. Figure 12: Storage Unit dialog – Use only specific media servers In the example shown in figure 12. However. The ability to limit the rate of network bandwidth used by the replication process can be implemented based on various criteria such as a scheduled or temporary rate. a manually driven NetBackup utility “nbstlutil” can be used to cancel pending duplication operations. or to use a different network. At present there is no known way to configure a NetBackup storage lifecycle policy such that a failed optimized duplication job will not be retried.5 Seeding Remote Data Domain Systems New deployments looking to utilize optimized duplication may have network bandwidth limitations between sites that could cause the first week of jobs to elongate substantially. 3. 3. or by a local hosts file entry.4 Optimized Duplication Failures When an optimized duplication job fails. optimized duplication jobs will enter a queued state instead of failing. 10 SYMANTEC NETBACKUP OPENSTORAGE . 3. One possibility worth considering is the optimized duplication of only full backups. 3. it might be possible to limit the quantity of network bandwidth required by limiting the amount of data that needs to be replicated.2 Network Considerations Replicating backup images under the control of NetBackup optimized duplication includes the ability to use the same network that is used for backup and restore operations. the NetBackup storage unit named “dd120b-stu” has been configured to allow only the NetBackup media server named “NBU65OST_Media2” to use it for backup and restore jobs. This is easily accomplished from within the NetBackup storage unit dialog window as shown in figure 12.
In some environments the default settings may be appropriate.6 Duplication Job Configuration Options NetBackup storage lifecycle policies provide an ideal vehicle for initial backups as well as the ability to create duplicate backup images. 3. In a “test only” environment it may make sense to alter the default value for the “MAX_MINUTES_TIL_FORCE_SMALL_ DUPLICATION_JOB” to a value of less than 30 minutes. The storage unit “maximum concurrent jobs” parameter however. does not distinguish between backup and duplication jobs. and replication stream counts. Restore jobs are not considered in this setting as they are typically performed infrequently as required. and restore operations. memory. SYMANTEC NETBACKUP OPENSTORAGE 11 .5 include: 4 MIN_KB_SIZE_PER_DUPLICATION_JOB 8192 4 MAX_KB_SIZE_PER_DUPLICATION_JOB 25600 4 MAX_MINUTES_TIL_FORCE_SMALL_DUPLICATION_JOB 30 Optimized duplication testing with backup images less than 8 GB in size may be delayed by up to 30 minutes as a result of the default settings. The best practice recommendation is to set the NetBackup storage unit “maximum concurrent jobs” parameter to equal the combined backup and replication stream count values for a given Data Domain system based on NVRAM. Figure 14: Storage lifecycle policy The example shown in figure 14 contains a backup storage destination equal to storage unit “dd120a-stu” with a fixed retention period of one week. Monitored jobs include backup. When the duplication task is executed it will result in an optimized duplication job that appears in the NetBackup activity monitor. There is no facility within NetBackup that can be used to limit backup and duplication jobs separately. 3. NetBackup monitors the number of jobs running on a particular storage unit in order to enforce the maximum number of current jobs value. 4 Storage lifecycle policies facilitate setting different retention periods for backup and duplication jobs. Solution architects should be cautious and monitor the number of simultaneously executing backup and duplication jobs based on prescribed limits in order to assure optimal performance. The example also includes a duplication destination equal to “dd120b-stu” with a fixed retention period of six months. The default settings can be adjusted by creating a “LIFECYCLE_ PARAMETERS” file. duplication. Storage lifecycle policy duplication relies upon certain default settings that control the point at which a duplication job will be launched. An optional configuration file can be created to customize lifecycles to run duplication jobs based on customer requirements. The storage lifecycle policy has optionally been assigned a data classification value equal to “Platinum”. Figure 13: Storage Unit dialog – Maximum concurrent jobs Figure 13 shows the storage unit “Maximum concurrent jobs” parameter set to a value of zero. read. model.4 Data Domain recommends using NetBackup storage lifecycle policies to control optimized duplication. Volume I” should be consulted for additional information before adjusting these values. and DD OS version.5. model and DD OS (Data Domain Operating System) dependant recommendations regarding maximum write. Use this technique when relocating a Data Domain system from a local site to a final destination site so that related optimized duplication jobs will enter a queued state instead of failing. Stream count information is available from Data Domain for setting the NetBackup storage unit ‘maximum concurrent jobs parameter”. Storage lifecycle policy duplication tasks initiate optimized duplication jobs on OpenStorage storage units. Out of the box defaults for NetBackup version 6. memory. The “Veritas NetBackup™ Administrator’s Guide. but doing so is not a requirement for optimized duplication.1 Storage Unit Maximum Concurrent Jobs Data Domain systems have NVRAM. 4 Data Domain recommends using “Fixed” retention periods versus “Staged capacity managed” and “Expire after duplication” retention period types. 4 Data classification can be used in conjunction with storage lifecycle policies if desired.
Take for example the execution of a storage lifecycle policy used in conjunction with optimized duplication. 4 The “Maximum backup copies” parameter can be adjusted with the NetBackup administrative GUI via “Host Properties > Master Servers > Global Attributes. The criteria for configuring a NetBackup Vault Policy that accomplishes this objective is based on criteria that selects backups which occurred in the past. to expire. 4 The default value for “Maximum backup copies” is two. Four basic methods of initiating a duplication job using the primary copy currently exist within NetBackup: 4 Ad-hoc GUI based duplication job initiation using the NetBackup catalog utility 4 Command line or script driven “bpduplicate” commands 4 Storage lifecycle policies 4 NetBackup Vault Option The underlying requirement for these techniques is that the desired source backup image is the primary NetBackup copy. “Copy 2” will be a non-primary copy as long as “copy 1” is still being retained. and tracking of up to ten copies of a particular backup image. 4 NetBackup supports the duplication of backup images. or until “copy 2” is manually set to primary. which may not always be the case. See the NetBackup Command Guides for additional information. Optimized duplication of this copy to a second Data Domain OpenStorage Server will result in the creation of “copy 2”.4 Duplication to Tape Requirements to retain long term copies of backup images on removable tape media are easily integrated with OpenStorage solutions. In the example shown above. Regardless of backup image copy number. This enables the creation of tape based duplicate backup images from non-primary NetBackup image copies. the primary copy (by default) will be used to fulfill the duplication request. and “copy 2” (which has been set to primary by NetBackup) to be used to fulfill a duplication request. This strategy allows “copy 1” of a backup image to expire.1 Tape Creation from the Primary NetBackup Copy The default NetBackup behavior in versions 6. Execution of a properly configured NetBackup Vault Option policy will then use “copy 2” to create “copy 3”.2 and prior is to create all duplicates using the primary backup image copy as source data.2 Tape Creation from a Non-Primary NetBackup Copy The “bpduplicate” command can be executed via command line or a script based solution with the copy number (cn) parameter. Figure 16: NetBackup Vault Option profile Figure 15: Maximum backup copies By default the NetBackup global attribute “Maximum backup copies” is set to a value of two. cataloging. The NetBackup Vault Option provides the ability to specify granular selection criteria of backup images for duplication. such that “copy 1” no longer exists. The initial backup to the first Data Domain OpenStorage Server will be “copy 1”. and it will also be the primary copy. 12 SYMANTEC NETBACKUP OPENSTORAGE . not media or specific tape cartridges. with additional functionality likely to be forthcoming in new NetBackup versions. 4. At the point where “copy 1” expires. Users seeking to create tape-based copies from “copy 2” may elect to allow “copy 1”. altering the value to accommodate additional copies is easily performed via the administrative GUI. 4. As shown in figure 15.5. the primary copy. Multiple means of accomplishing this objective currently exist. backups started between 16 and 15 days prior to the execution of a Vault job will be selected for inclusion. 4 NetBackup supports the creation. “copy 2” is set to primary by NetBackup.
5. Figure 18: NetBackup catalog “copy 2” – not primary The NetBackup catalog utility can be used to select “copy 2” of a backup image. Setting a particular copy to primary can be performed via the NetBackup GUI catalog utility.1 From a Non-Primary Backup Copy Assuming a particular backup image has been duplicated. at which point “copy 2” will become the primary copy. “copy 1” will be the primary copy until it expires.com/business/support/documentation. 5. “copy 1” is also known as the “primary copy”.1. 6 Additional References Data Domain secure access customer support site: https://my. When initially written. Setting a non-primary copy to primary is easily accomplished by right-clicking the image and then selecting “Set Primary Copy” from the pop-up menu. In the case where “copy 1” has not expired and is still the primary copy. SYMANTEC NETBACKUP OPENSTORAGE 13 . the primary copy is the copy that is used to fulfill duplication requests as well as restore requests. “copy 2” can be queried using the same methodology. This enables the use of a particular backup image to fulfill restore requests. Similar to the way “copy 1” can be queried from the NetBackup catalog utility.com/ Figure 17: NetBackup catalog “copy 1” – primary copy The NetBackup catalog utility can be used to select the primary copy of a backup image. and a need arises to recover data from “copy 2”.1 Within the Same NetBackup Domain This scenario assumes that the NetBackup instance in which recovery is to be performed is the same NetBackup instance that performed the initial backup and subsequent optimized duplication job. An optimized duplication job will create “copy 2” of the backup image. OpenStorage (OST) User Guide OpenStorage (OST) Quick Start Symantec: http://www. 5. If “copy 1” has a retention period of two weeks and “copy 2” has a retention period of one year. OpenStorage backups can be imported into foreign NetBackup domains using standard NetBackup import procedures.jsp? language=english&view=manuals&pid=15143 NetBackup Administration Guides NetBackup Shared Storage Guide NetBackup Vault Administrators Guide NetBackup Command Guides 5. This can be useful in cases where recovery from a specific geographical location is desired or in cases where the original primary copy is not available. “copy 2” can be used to fulfill a restore request if it is the primary copy.2 and prior. “copy 2” must be set to primary such that it can be used to fulfill the restore request.5 Disaster Recovery Using optimized duplication to create duplicate backup images assists in accommodating a variety of disaster recovery scenarios.symantec.2 To a Different NetBackup Domain OpenStorage currently provides no automated ability to synchronize or share NetBackup catalog data across multiple NetBackup domains.datadomain. The first copy of a backup image created by NetBackup is known as “copy 1”. As of NetBackup version 6. Figure 19: Setting primary copy Setting a non-primary backup image copy to primary can be accomplished via a pop-up menu.
This functionality is particularly useful when migrating from basic disk or VTL usage to an OpenStorage solution. 8. Disaster recovery copies of backup images are created faster. Backups performed to legacy basic disk or VTL media manager storage units will still exist based on the retention periods of the backup policies used to perform the backups. or where optimized duplication between storage servers will be performed using alternative means. natural expiration may be the logical choice as it imposes no additional administrative overhead into the migration process.3 Are Storage Lifecycle Policies Required? Storage lifecycle policies provide a plan based view of backup and duplication jobs. and are available at the disaster recovery location sooner when compared to tape-based solutions.7 Conclusion Data Domain support for Symantec NetBackup OpenStorage advances the ability to use disk as disk. 8. the simultaneous use of multiple protocols on the same Data Domain system is supported.2 Existing Backups – Retain or Duplicate? At some point during the migration process. Change existing NetBackup policies by selecting the appropriate OpenStorage storage unit or storage lifecycle policy as appropriate and save the NetBackup policy. Other factors to consider are the number of backups that would need to be duplicated. Optimized duplication will be invoked automatically by NetBackup if configured within a selected storage lifecycle policy. all ongoing backup jobs will theoretically use newly configured OpenStorage storage units. Duplicating existing backups to new OpenStorage storage units has they key advantage of allowing the legacy infrastructure to be deleted. store more data on disk with inline deduplication. While not explicitly required they provide a simple and effective vehicle to perform backups followed by optimized duplication between two storage servers. In cases where a single Data Domain system is configured as a storage server. Once all backup images on basic disk or VTL media manager storage units have been duplicated to OpenStorage storage units. 14 SYMANTEC NETBACKUP OPENSTORAGE . Creating duplicate backup copies with optimized duplication enables advanced disaster recovery strategies. and can be associated with a data classification rank. This appendix item explores the questions and strategies involved with migration.1 Multiple Protocols on One Data Domain System While not specifically recommend. Should these backups be duplicated to new OpenStorage storage units and then be expired. 4 Can a Data Domain system be used simultaneously as both an OpenStorage storage unit and a basic disk storage unit? 4 Can a Data Domain system be used simultaneously as both an OpenStorage storage unit and a VTL media manager storage unit? 4 Should existing backup images be retained until their expiration.4 NetBackup Policy Modification Once OpenStorage storage units are configured. and VTL. the use of a storage lifecycle policy is optional. All backups performed with the NetBackup policy from this point moving forward will use the new OpenStorage storage unit. 8. or should they be duplicated to a new OpenStorage storage unit? 4 Are storage lifecycle policies required for use with OpenStorage? 4 How are existing NetBackup policies modified to use OpenStorage storage units? 4 Should legacy Data Domain replication be de-configured? 4 Can existing replicas be imported into the NetBackup catalog? 8. and simplifies the creation of backup copies with optimized duplication. Duplicating a large number of backup images or a large quantity of backup data may not be realistic based on the additional workload it will impose on the backup infrastructure. One Data Domain system can simultaneously serve as a storage server. basic disk storage unit. existing NetBackup policies that use basic disk or VTL media manager storage units can be updated to use the OpenStorage storage units. and the quantity of data that would need to be duplicated. the old storage units can be deleted. 8 Appendix – Migration to OpenStorage Existing deployments using Data Domain systems as basic disk storage units or VTL media manager storage units may at some point be migrated to an OpenStorage solution. or should they simply be left to expire naturally? When the retention period of backups written to legacy basic disk or VTL media manager storage units is relatively short.
Inc. Inc. Inc. OpenStorage optimized duplication requires that the Data Domain replication license remain intact on both source and destination storage servers. Changes are periodically added to the information herein. Data Domain. the legacy storage unit components can safely be deleted from the NetBackup configuration.datadomain. Data Domain and Global Compression are trademarks of Data Domain. All other brands. may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time.1 Can Legacy Replicas Be Imported? Existing replicated backup images that were created without OpenStorage continue to have the same limitations they had before the OpenStorage solution was implemented. CA 95054 | 866-WE-DDUPE. with respect to the information in this publication. and specifically disclaims implied warranties of merchantability or fitness for a particular purpose.5. service names. These replicas were created without the knowledge of NetBackup and have the same backup identifier as the source image. Inc. makes no representations or warranties of any kind. Reproduction of this publication without prior written permission is forbidden. 8. The information in this publication is provided “as is”. or registered service marks are used to identify the products or services of their respective owners. it can be disabled.WP-OSTBPG-1208 DEDUPLICATION STORAGE www.8.com . believes information in this publication is accurate as of its publication date. Data Domain | 2421 Mission College Blvd.. these changes will be incorporated in new additions of the publication. This publication could include technical inaccurancies or typographical errors. Note that duplicate copies of backup images created with OpenStorage optimized duplication do not need to be imported because the NetBackup catalog is already aware of their existence and is tracking them accordingly.6 Deleting Legacy Storage Units Once the OpenStorage solution has been implemented and all pre-existing backup images have expired. Inc. any replica copies of the backup image are in effect already cataloged and cannot be imported. All rights reserved. Data Domain. Data Domain. The information is subject to change without notice. 408-980-4800 Copyright © 2008 Data Domain. trademarks. 8. Santa Clara.5 Legacy Replication At the point where legacy replication is no longer required. It is important to note that legacy replicas are not known to NetBackup as “copy 2” of a particular backup image. If the source copy of a particular backup image is cataloged by NetBackup. products.
This action might not be possible to undo. Are you sure you want to continue?
We've moved you to where you read on your other device.
Get the full title to continue listening from where you left off, or restart the preview.