Professional Documents
Culture Documents
IT Challenges
Internal Data Center Failures
NetApp solutions protects against internal and external data center failures
Source: Forester / Disaster Recovery Journal Global Disaster Recovery Preparedness Online Survey, Oct, 2007
2009 NetApp. All rights reserved. NetApp Confidential - Limited Use 2
Continuous Availability extends HA by providing protection from external events such as power, cooling and network failures, eliminating planned and unplanned downtime and data loss NetApp MetroCluster Disaster Recovery provides site resiliency protecting against failures that affect an entire datacenter NetApp SnapMirror
Can I leverage my DR solution for other business purposes without increasing risk and complexity?
SnapMirror Overview
SnapMirror is a thin replication solution based on Data ONTAP Snapshot technology
Replicates volumes or qtrees from source to destination NetApp storage systems Transfers only changed unique blocks in 4KB increments Supports synchronous, semi-synchronous, and asynchronous modes Reduces bandwidth requirements by 70% with native network compression Works with NetApp deduplication for FAS on source Supports dissimilar systems and disk types
Blocks in a File
Take snapshot 1
Copy pointers only No data movement
A B C
A B C
Snap 1
Blocks in a File
A B1 B C
A B C B1
A B C
Snap 1
Blocks in a File
A B B1 B1 C
A B C B1
A B C
A B C
2 Snap 1 Snap 1
10
Blocks in a File
Take snapshot 1 4Continue writing data 4Take snapshot 2 4Continue writing data
Write data anywhere
A B1 B C2 C
A B C B1 C2
A B C
A B1 C
Snap 1 Snap 2
11
Blocks in a File
Take snapshot 1 4Continue writing data 4Take snapshot 2 4Continue writing data 4Take snapshot 3
A B1 B C2 C
A B C B1 C2
A B C
A B1 C
A B1 C2
4Simplicity of model =
Best disk utilization Fastest performance Unlimited snapshots
12
Snapshot Comparison
NetApp Others
A B C B1 C2
A B1 C2 B C C
No data movement
Guarantees disk performance Enables more snapshots
14
Block C2 is bad
A B1 B C2 C
A B C B1 C2
A B C
A B1 C
A B1 C2
15
A B1 B C2 C .snapshot directory A B C
A B C B1 C2
A B1 C
A B1 C2
16
Block C2 is bad 4Let users self-restore from .snapshot directory 4Restore from snapshot with SnapRestore
Move pointers from good snapshot to file system
SnapRestore
A B1 B C2 C
A B C B1 C2
A B C
A B1 C
A B1 C2
17
Block C2 is bad 4Let users self-restore from .snapshot directory 4Restore from snapshot with SnapRestore
A B1 B C2 C
A B C B1 C2
A B C
A B1 C
A B1 C2
18
Block C2 is bad 4Let users self-restore from .snapshot directory 4Restore from snapshot with SnapRestore
SnapManager
A B1 B C2 C
A B C B1 C2
A B C
A B1 C
A B1 C2
19
Blocks in a File
A B1 B C2 C
A B C B1 C2
A B C
A B1 C
A B1 C2
20
Blocks in a File
A B1 B C
A B C B1
Block C2 is bad; you want to restore & reproduce the error 4Restore file system from snap 2
A B C
A B1 C
A B1 C2
21
Blocks in a File
A B1 C
A B1 B C
A B C B1
Block C2 is bad; you want to restore & reproduce the error 4Restore file system from snap 2 4Clone file system from snap 2
A B C
A B1 C
A B1 C2
22
Blocks in a File
A B1 C4 C
A B1 B C3 C
A B C B1 C3 C4
Block C2 is bad; you want to restore & reproduce the error 4Restore file system from snap 2 4Clone file system from snap 2 Results:
Both file systems can make edits Both file systems share common blocks Enables large-scale parallel testing
23
A B C
A B1 C
A B1 C2
24
A B C A B C
Snap 1
A B C
WAN
SnapMirror
A B C
Snap 1
4Copying snapshot 1
25
A B1 B C2 C A B C
Snap 1
A B C B1 C2
A B C
WAN
A B C
Snap 1
4Copying snapshot 1 4Data copied in background 4Primary still changing 4Snap 1 identical
26
A B1 B C2 C A B B1 C C2
Snap 1 2
A B C B1 C2
A B C
WAN
SnapMirror
A B B1 C C2
Snap 1 2
27
A B1 B C2 C A B C
Snap 1
A B1 C2
Snap 2
A B C B1 C2
WAN
A B C B1 C2
A B1 C2
Snap 2
A B C
Snap 1
4Copying snapshot 2 4Copy only new data 4Snapshot 1 data safe during copy
28
29
All Snapshots
A B C B1 C2
WAN
A A B1 B C2 C
Selected Snapshots
All Snapshots
A B C B1 C2
WAN
A A B1 B C2 C
Selected Snapshots
All Snapshots
A B C B1 C2
WAN
A A B1 B C2 C
Selected Snapshots
All Snapshots
A B C B1 C2
LAN
A A Selected B1 Snapshots B C2 C
All Snapshots
A B C B1 C2
SnapVault
WAN
A A B1 B C2 C
4SnapVault : an asynchronous SnapMirror for archival 4One archive target can support multiple sites
34
All Snapshots
A B C B1 C2
WAN
4LockVault: allows vaulted SnapLock volumes to inherit the lock properties 4Guarantees compliance in archival storage 4No user interventiontamperproof & totally automatic
2009 NetApp. All rights reserved. 35
SnapMirror Details
2009 NetApp. All rights reserved. 2008 NetApp. All rights reserved.
36
NetApp SATA
Single replication solution for disaster recovery, business intelligence, data distribution, and dev/test Replicate across all tiers of NetApp and non-NetApp storage (V-Series) Tune your RPO to meet your business requirements, choose from sync, semi-sync or async replication Supports all applications and protocols Works equally well in virtual and traditional environments
37
Synchronous
1 4
Semi-Synchronous
Every Write
No data loss exposure Replication distance < 100 km Some performance impact
1 2
Asynchronous
Every Write
4 3 A
Changed blocks
1 2
1 2
Set intervals
SnapMirror
Enable a single disaster recovery solution through support of the NetApp Unified Architecture Provide simple management & automated recovery Leverage efficient storage utilization Lower RPO with SnapMirror native compression 65K+ licenses deployed over 650PB protected
NetApp FC
NetApp SATA
It was impressive to see that when we had problems with the fiber or other things, we never did have problems with SnapMirror. Its been pretty bulletproof. Monte Watembach Data Center Supervisor City of Sioux Falls
39
DR Site
VM 1
VM 2
VM 3
VM VM 1 1
VM VM 2 2
VM 3
Site Failure
Storage Partition
D at a D at a D at Virtuala
SnapMirror
D at a D at a D at a
of minutes we can be up and running at the DR facility. And it costs us about 50% less than before. Dale Martinson Manager of Systems and Security DCI
40
DR Site
DR Testing
FlexClone
Conduct DR testing any time without interrupting business operations Create instantaneous, spaceefficient, writeable replicas to perform DR testing with FlexClone Easy to highlight needed changes, fix problems and retest
SnapMirror
"We can schedule a DR test without interrupting production - or IT administrators' regular activities. This capability gives us added security and confidence knowing we can recover because we perform the tests more frequently. Rick Stuart Manager, UNIX and Storage Systems Anadarko Petroleum Corp
41
FlexClone
Test on the most up-to-date data with instantaneous copies Create as many copies as needed, whenever they are needed with virtually no additional space Achieve faster time to production and faster time to revenue Share costs/budgets and increase utilization by co-locating dev/test with DR site
SnapMirror
They [developers] no longer have to wait for database copies or request copies from IT operations staffthey now get daily clones of the current production database as standard procedure. FlexClone is accelerating our development efforts and helping us bring new features to market faster. Rodrigo Benzaquen Director of Infrastructure and Operations MercadoLibre
42
DR Site
Achieve a competitive advantage using the latest data and generating ondemand results Eliminate impact to users or applications on production site Utilize instant, space-efficient clones to create an independent database for data mining and to maximize underutilized resources on the DR site
FlexClone
SnapMirror
Data mining
NetApp Confidential - Limited Use 43
Remote Site 1
Remote Site 2
SnapMirror
Remote Site 3
Provide remote sites with latest catalogs, pricing, customer information, orders, etc Enable remote sites to replicate more efficiently with lower bandwidth consumption Consolidate data to primary data center for analysis and protection One-to-many and many-toone flexibility Leverages storage efficiencies, primary, secondary and network
44
Efficiency: Storage
SnapMirror extends the 90% primary storage efficiency
Extend the storage efficiencies on the primary storage across the network to secondary storage Cost savings for DR with deduplication Remove redundant data blocks regardless of application or protocol Provision storage as fast as you can create virtual machines Dedupe can recoup 30% of capacity on average and up to 90% for some data sets in virtual environments Only NetApp offers deduplication for primary, secondary, and archival storage tiers
Do I think we buy less storage on a yeartoyear basis because of how we use NetApp thin provisioning? I certainly do. We probably buy 20% to 25% less storage per year. That saves us between $75,000 and $100,000 annually. It allows us to give an application the illusion of having more space than it does, while properly allocating the storage for it behind the scenes. - Peter Allen Director of IT Operations, Nixon Peabody
2009 NetApp. All rights reserved. NetApp Confidential - Limited Use 45
Efficiency: Management
SnapMirror reduces management overhead by 50%
Independent study concludes that SnapMirror async operational cost 50% less than EMC SRDF/A* Policy-based software that automates data replication and failover Protection Manager Faster set-up, more reliable end-to-end data protection Optimize your secondary storage resources Increase storage efficiency, utilization, and flexibility Reduce administrator burden Standardized solution to reduce management overhead
NetApp Snapshot, SnapMirror, and NetApp Protection Manager work seamlessly together to simplify and automate all the mundane work of managing storage. - John Saley, IT Architect RMT
NetApp Confidential - Limited Use 46
* Mercer Consulting Cost and Risk Management in Disaster Recovery, Jan 2007)
2009 NetApp. All rights reserved.
Compression
Decompression
Prerequisites
Volume SnapMirror Generally available starting Data ONTAP 7.3.2 Over 24K installs in first 6 weeks of GD Exception: Data ONTAP 8.0 7-Mode Obtain NetApp approval for earlier versions Qtree SnapMirror Requires NetApp approval SnapMirror Sync and SnapMirror Semi-Sync No support All platforms are supported including V-Series and N series Requires The /etc/snapmirror.conf file A connection name
Configuration
When using single path
name = multi (src,dest) name:src_vol dest:dest_vol compression=enable * * * *
Compression can be disabled by removing the compression=enable option Cannot be enabled or disabled for an active transfer Transfer must be aborted
Configuration
SnapMirror compression cannot be configured by Protection Manager It is possible to import the relationship with compression into Protection Manager SnapManager products SM-VI unable to recognize connection names and therefore cannot make use of compression Other SnapManager products use SnapDrive to perform updates They can make use of compression when configured in snapmirror.conf
Solution
Solution
Solution
Solution
Performance
Compression Ratios
Compression ratio depends on the data set Range varies quite a lot Following table shows achieved ratios in our lab Customers have seen as high as 13:1 for their data sets
Exchange Home DB OracleDir DB 1.5:1 2.7:1 3.5:1 Compression Ratio 34% 62% 71% Percent Bandwidth Savings
Above numbers are some samples from our customers NetApp does not guarantee similar compression ratios
FAS3170, FAS3040, and FAS3140, FAS3020 FAS6030, and and FAS6070 FAS6040
In general, it is not a good idea to combine SnapMirror network compression and WAN optimization device
71
0%
20 04 20 03 20 05 20 06 20 07 20 08 YT D '0 9
Sync replication Async replication Cloud replication Multi Data Center replication
72
Virtualization
ses
73
Boot LUN
FAS System
Database
Logs
SnapMirror
Enables mirroring of database and logs at different frequencies Lowers network bandwidth utilization
74
76
Focus:
To deliver the highest efficiency, productivity and flexibility to IT operations
Approach:
Deliver best in class data and storage management
77
NetApp Approach
Server Admin
78
Centralized Management:
Provides wizard-based GUI integrated with MMC V3.0 Manage multiple SnapManager for Exchange Server instances from one console Wizard-based UI for migrating Exchange data from DAS and thirdparty SANs to NetApp storage system
Data Migration:
Leverages NetApp Snapshot technology for superior performance and efficient disk space utilization Backup and restore from/to Exchange 2010 Active/Replica in the Database Availability Group (DAG)
79
Volume Shadow Copy Services (VSS) with Windows Server 2003 and Windows Server 2008 R2 Microsoft Management Console V3.0 Microsoft Cluster Server Local Continuous Replication (LCR), Cluster Continuous Replication (CCR) and Standby Continuous Replication (SCR)
80
Integrated with NetApp SnapMirror (Sync and Async) and SnapVault for Disaster Recovery/Business Continuity & archiving backups Automates complex, manual effort:
Single button push failover and failback Large scale Exchange deployment Online backup Point and click granular restore Rapid recovery from disasters (minutes versus hours/days) Concurrent verification of multiple backups
81
SnapManager backs up in seconds Snapshot copies verified for integrity and stored
Fastest and most storage efficient backups No performance degradation from online backups More frequent backups due to speed and efficiency Instantaneous access to backup data
Snapshot
Near instantaneous restores from Snapshot Dramatically shortened recovery with automated log replays App/DB Server Automated recovery tasks Extremely fast and accurate data restore and recovery Reduce downtime from outages Automation saves administrative time
Snapshot Roll transaction logs
85
NetApp solution: Use NetApp Single Mailbox Recovery with SnapManager for Exchange
Primary Data Center
NetApp Single Mailbox Recovery (SMBR) restores individual mailboxes from snapshots in minutes
DAG
Mailbox Servers
SnapManager Exchange+SMBR
SnapManager Exchange+SMBR
Active DB
Replica DB
2 weeks Snapshots
Short Term Backups
2009 NetApp. All rights reserved.
Enterprise-Class Deployments
France Telecom 1,200,000 users PetroChina 200,000 users US Navy/Marine Corps 100,000 users Large US Defense Contractor 133,000 users Telstra 64,000 users Finance Police- Italy 60,000 users Siemens AG 200,000 users Toronto Dominion Bank 55,000 users Southwest Airlines 33,000 users US State Department 30,000 users IKON Office Solutions 30,000 users Barry University 28,000 users
88
Reduced disaster recovery (DR) test process by 80% Shorten time from a new idea to new revenue stream by at least 99%
2009 NetApp. All rights reserved. NetApp Confidential - Limited Use 89
Thank you
Copyright 2009 NetApp, Inc. All rights reserved. No portions of this document may be reproduced without prior written consent of NetApp, Inc. Specifications are subject to change without notice. NetApp, the NetApp logo, Go further, faster, FlexClone, SnapManager, SnapMirror, SnapRestore, and Snapshot are trademarks or registered trademarks of NetApp, Inc. in the United States and/or other countries. Oracle is a registered trademark of Oracle Corporation. Microsoft and SQL Server are registered trademarks and Hyper-V is a trademark of Microsoft Corporation. All other brands or products are trademarks or registered trademarks of their respective holders and should be treated as such.
2009 NetApp. All rights reserved.