Oracle Exadata

Data Protection and

Migration Accelerator

Greg Drobish / Joe Pichette

ZFS Application Integration Engineering
October 2nd, 2014

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

 Oracle ZS3 Enables Simple, Fast Data Migration
from Legacy SAN Storage to a High-Performance
Exadata Environment

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Session Agenda

1 Accelerating Exadata Migration

2 Data Protection with ZFS Storage
3 Configuration Best Practices

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 5

Exadata Database Machine

• Most advanced hardware

– Fully scale-out servers and intelligent storage with unified
InfiniBand connectivity and PCI flash

• Most advanced software

– Database optimized compute, storage, and networking
algorithms dramatically improve performance and cost

• The ultimate platform for all database workloads

– OLTP, Warehousing, Database as a Service

• Standardized, optimized, hardened end-to-end

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Pre-built and Optimized Out-of-the-Box
100%
Custom Configuration
Test & debug
failure modes
Performance Achievement

Performance Achievement
Measure,
diagnose, Multi-
Assemble tune and
dozens of vendor
reconfigure finger
components
pointing

Time Time
(Days) (Months)

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Accelerating Exadata Migration with
the Oracle ZS3 Enterprise Storage

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

 Questions When Migrating to Exadata
What people are asking

• How can I get my Exadata up and

running sooner rather than later?
• Are there best practices for migrating
data from a legacy FC array?
• What is Oracle’s recommendation for
migrating FC data?
• How should I backup my Exadata?

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Challenges Migrating FC Databases to an Exadata Environment
• What are the challenges?
– Fibre Channel only storage network data path
– Large databases
– Downtime is not an option

Traditional Solution Pain Points

Use Existing Network Architecture
– Slower Ethernet networks are dedicated to clients
– Not designed to handle large database migrations
• Upgrade existing database servers with Infiniband
– Reconfiguring is disruptive and complex

Implement Data Guard Solution for migration

– Data Guard solution are complex
– Designed for disaster recovery, not migration

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

 Oracle ZS3 Accelerated Exadata Data Migration
Solution:
• Utilize Oracle ZFS Storage as an intermediary
• Seamlessly bridge Fibre Channel to InfiniBand
for a fast, efficient, and non-disruptive solution

Benefits:
• Reduce a Data Guard migration of a production
databases by as much as 10x
• No down time to configure database servers for
InfiniBand network connectivity
• Integrate RMAN backup procedures over existing
FC networks
• Simple and easy IB connectivity between the
Exadata and Oracle ZFS Storage Appliance

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Best Practices
Technical details of implementing database migration solution

Key Steps For a Successful Migration

1. Configure Fibre Channel storage

2. RMAN backup to Oracle ZS3
3. Configure Infiniband storage
4. RMAN duplication from ZFSSA to Exadata

*effective throughput may be lower due to overhead from

other devices, link layer protocols and inter-frame gap

Reduced Network Load Faster Migration

• Limits load on network resources • Dual FC HBAs in each ZS3 controller is up
by performing migration over SAN to 10x faster than a Data Guard migration
using existing network infrastructure

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Ongoing Oracle ZFS Storage Utilization
Post-migration use cases

 Data protection
– Leverage InfiniBand interconnect for Oracle RMAN backup and restore
 Test and development
– Thin clone database from Oracle RMAN backup for use in new
development
 Offload nonproduction databases
– Migrate lower priority databases to the Oracle ZS3 Storage Appliance
 Data masking
– Oracle ZFS Storage ZS3 series appliances can be used as a compliance
staging area for data masking
 Other Oracle and Non-Oracle software environments
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Exadata Data Protection with the
Oracle ZFS Storage Appliance

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle ZFS Storage: An Ideal Solution

 Superior Performance  Powerful Features

 Enhanced Reliability  Simplified Management

 Extreme Network  Cost Effective

Bandwidth Configuration

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

 Oracle ZS3-4 delivers world-record performance

17,224 SPC-2 MBPSTM

$22.5 SPC-2 Price PerformanceTM

15,423 SPC-2 MBPSTM

IBM DS8870 $134.2 SPC-2 Price PerformanceTM

13,147 SPC-2 MBPSTM

VSP
$95.3 SPC-2 Price PerformanceTM

13,147 SPC-2 MBPSTM

P9500 XP $131.2 SPC-2 Price PerformanceTM

Results as of September 10, 2013, for more information go to www.storageperformance.org/results SPC-2. Results for Oracle ZFS Storage ZS3-4 are 17,244.22 SPC-2 MBPS™, $22.53 SPC-2 Price-
Performance. Full results at www.storageperformance.org/results/benchmark_results_spc2#b00067. Results for IBM DS8870 are 15,423.66 SPC-2 MBPS, $131.21 SPC-2 Price-Performance. Full results at
ww.storageperformance.org/results/benchmark_results_spc2#b00062. Results for Hitachi VSP are 13,147 SPC-2 MBPS, $95.38 SPC-2 Price-Performance. Full results at
www.storageperformance.org/results/benchmark_results_spc2#b000600. Results for HP P9500 XP Disk Array are 13,147.87 SPC-2 MBPS, $88.34 SPC-2 Price-Performance. Full results at
www.storageperformance.org/results/benchmark_results_spc2#b00056.

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle ZFS Storage Appliance for RMAN Backup
Benefits

Performance Capacity Simplification

World Record Hybrid Columnar
Snap Management Utility
Performance Compression
Enterprise Manager
Immensely Scalable
DTrace Analytics Integration
Architecture

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

RMAN Backup Options
Image Copy Backup Backup Set Backup
• RMAN disk destination only • RMAN disk or tape destinations
• Block to block copy of database except for temp • Most widely deployed backup type
files
• Can leverage RMAN compression or encryption
• Level 0 backup (Base Image) used with an capabilities
Incrementally Updated Backup Strategy (synthetic
• Smaller backup size than an image copy backup
fulls)
due to RMAN null and unused block compression
• Cannot be compressed or encrypted by RMAN
• Most common use cases:
• Most common use cases:
• Full / incremental backup strategy
• Incrementally Updated Backup Strategy
• Tape or cloud backups
• Cross platform migration
• Long-term retention on disk
• ZFS cloning solution (Snap Management
Utility)

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

RMAN Incremental Backup Strategies
Built-In Backup Deduplication

Incremental Forever Strategy Full / Incremental Strategy

• Uses Image Copy method • Uses Backup Set method
• Initial RMAN image copy backup to disk • RMAN backup set backup operation to:
• Subsequently, backup only the changes  Disk - retention from days to weeks
(incremental) Tape – retention from weeks to years
• Merge the incremental with the base image  Cloud – retention from weeks to years
• Allows “SWITCH TO COPY” capability
• RMAN compression applicable to full ,
• On-disk retention of 1-7 days incremental and/or archived log backups
• RMAN compression applicable to the • RMAN “BACKUP BACKUPSET” to make
incremental and archived log backups additional copy of the backup to disk or tape
• RMAN “BACKUP RECOVERY AREA” or
BACKUP COPY OF to make addition copies

High Availability Space Optimization

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Exadata Backup with ZFS Storage:
Configuration Best Practices

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle ZFS Storage Appliance Backup Test Results
Controllers • Peak Sustained Backup: 29 TB/hr
• Clustered ZS3-4 • Peak Sustained Restore: 40 TB/hr
• 1 TB DRAM
• InfiniBand Connectivity
• ZFS Storage OS8 Software
• No Read Optimized Flash

Enclosures
• 8 High Capacity Disk Shelves
• 7200 RPM drives
• No Write Flash Accelerators

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

 Oracle Direct NFS
OISP
• dNFS provides integrated performance tuning when
• Oracle Intelligent Storage Protocol (OISP)
backing up an Oracle database to ZFS Storage integrated with dNFS in 12c dynamically
tunes record size and logbias variables on
– Bypasses the operating system Oracle ZS3 Enterprise Storage to optimize
performance
– Data is cached just once in user space with no 2nd copy in kernel space
– New in 12c dNFS over RDMA provides increased network bandwidth and
reduced CPU overhead

• Distribute throughput across multiple network interfaces

and stripe buffers over up to 4 addresses

Example: Oracle Direct NFS Striping

Number of Addresses 1 2 4
Backup 4209 MB/s 5261 MB/s 5417 MB/s

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Superior RAID-Z Performance
Disk Capacity Utilization
Mirrored 46%
• High performance RAID-Z gives customers the
Single Parity 70% choice of mirrored or striped parity based on
Double Parity 74% their needs
RAID-Z Parity
• Variable stripe width means every write is a
A1 A2 A3 Ap
full stripe write
B1 B2 Bp B3

C1 Cp C2 C3
• RAID-Z reduces the IOPS overhead
Disk1 Disk2 Disk3 Disk4

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

 RAID-Z1 vs Mirror: Calculating IOPS Overhead
Example Backup – Why is RAID-Z1 Faster?
Single Parity
Single Parity 3419 MBPS • IOPS per disk correlate to AWR
average wait time
Mirrored 3337 MBPS
• Single Parity Mirroring
• IOPS per disk correlate to AWR
– 158.2 IOPS per every 100 MBPS average wait time
– Average disk IO size: 700.8 KB
• Mirrored Conclusion
• Mirroring generates 58% more
– 250.6 IOPS per every 100 MBPS IOPS
– Average disk IO size: 841.1 KB • 5x higher DB wait time

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

 Choosing a Storage Profile 100%

Mirrored, Single Parity or Double Parity 80%

Reserved
60% Spare

• Mirrored: 1:1
Parity
40%
Data
20%
– Restore performance, Incremental forever 0%
backup strategies, cloning for dev/test Mirrored Single Parity Double Parity

provisioning
• Single Parity: Narrow stripe width
– Backup performance, Traditional RMAN
backup/restore strategies
• Double Parity: Wide stripe width
– Only suitable for large sequential streaming IO
– Lengthy resilvering times are possible

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

 Optimization For Image Copy or Backupset
Image Copy: Image Copy Tuning
• Incrementally updated backup, synergies with • More channels
• Align number of channels to
cloning, superior performance, generally accessible datafiles in backup job

Backupset:
Backupset Tuning
• Tape support, bypasses unused datafile blocks,
• Fewer channels
RMAN default, multi-section backup • Use multi-section backup

General Performance Recommendations

Image Copy 4-10 channels per database server, align channels to datafiles
Backupset 2-4 channels per database server, specify section size (32-100GB)
Incremental Merge Limit read-modify-write penalty (mirrored storage, write-optimized flash)

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Optimizing for Incrementals Forever Active Datafile
Ideal for large databases with small daily change rates
Initial Data
1st daily change
2nd daily change
• Mirrored storage profile
• Write flash accelerators 3
• Multi-share configuration 2 Daily
1 Incremenals
– Daily Incrementals
• synch write bias = throughput 3
• large record size (1MB)
– Backup copy Backup Copy

• synch write bias = latency Initial Backup

• align record size to db_block_size 1st daily change

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Key Takeaways: Oracle ZS3 Enterprise Storage

• Seamless, fast and non-disruptive platform for

migrating legacy SAN databases to Exadata

• Ideal solution for protecting mission-critical data

residing in Oracle Exadata databases

• Superior performance and hardened data protection

solutions to meet the most demanding requirements

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

For More Information – MOS 1354980.1

• FAQ: Exadata RMAN Backup with The Oracle ZFS Storage Appliance
– MOS Document 1354980.1

• Whitepaper: Exadata Migration with The Oracle ZFS Storage Appliance

– Migration Whitepaper

• Engineered Systems Backup Utility (ESBU)

– ESBU Download Page

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |