Oracle Cloud Project

Management for Partners

Module 14 – Data Management and
Migration Plan

Student Guide
S105465GC10

Learn more from Oracle University at education.oracle.com

Copyright © 2020, Oracle and/or its affiliates.
Disclaimer

This document contains proprietary information and is protected by copyright and other intellectual property laws. You may copy and print this document solely for your own use in an Oracle training
course. The document may not be modified or altered in any way. Except where your use constitutes "fair use" under copyright law, you may not use, share, download, upload, copy, print, display,
perform, reproduce, publish, license, post, transmit, or distribute this document in whole or in part without the express authorization of Oracle.

The information contained in this document is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

Restricted Rights Notice

If this documentation is delivered to the United States Government or anyone using the documentation on behalf of the United States Government, the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of
such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial computer software" or "commercial computer software
documentation" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, reproduction, duplication, release, display, disclosure,
modification, preparation of derivative works, and/or adaptation of i) Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered
hardware, and modifications of such programs), ii) Oracle computer documentation and/or iii) other Oracle data, is subject to the rights and limitations specified in the license contained in the applicable
contract. The terms governing the U.S. Government's use of Oracle cloud services are defined by the applicable contract for such services. No other rights are granted to the U.S. Government.

Trademark Notice

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Inside are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc.
AMD, Epyc, and the AMD logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group.

Third-Party Content, Products, and Services Disclaimer

This documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all
warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not
be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Module 14 – Data Management and
Migration Plan
Oracle Cloud Project Management Training for Partners

Oracle Alliances & Channels

Safe harbor statement

The following is intended to outline our general product direction. It is intended for information
purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any
material, code, or functionality, and should not be relied upon in making purchasing decisions. The
development, release, timing, and pricing of any features or functionality described for Oracle’s
products may change and remains at the sole discretion of Oracle Corporation.
Statements in this presentation relating to Oracle’s future plans, expectations, beliefs, intentions and
prospects are “forward-looking statements” and are subject to material risks and uncertainties. A
detailed discussion of these factors and other risks that affect our business is contained in Oracle’s
Securities and Exchange Commission (SEC) filings, including our most recent reports on Form 10-K and
Form 10-Q under the heading “Risk Factors.” These filings are available on the SEC’s website or on
Oracle’s website at http://www.oracle.com/investor. All information in this presentation is current as of
September 2019 and Oracle undertakes no duty to update any statement in light of new information or
future events.

2 Copyright © 2020, Oracle and/or its affiliates.

 Costin Chirculescu, PMP, TOGAF

ISV/OEM Sales Consultant

Oracle Corporation

3 Copyright © 2020, Oracle and/or its affiliates.

Module 14 – Data Management and
Migration Plan
Oracle Cloud Project Management Training for Partners

Part 1
Oracle Alliances & Channels
Learning Objectives
Data Management and Migration Plan

By the end of this module, you should be able to:

• Identify the reasons why to migrate data and define the key drivers of data complexity
• Explain the target-driven data migration approach
• List the golden rules for successful data migration
• Describe the migration strategy and methods
• Explain the difference between the various migration tools
• Describe the database types for data management and migration purposes
• Use Autonomous Database for Autonomous Data Warehouse (ADW) and Autonomous Transaction Processing
(ATP)
• Explain the key considerations to prepare for data transformation strategy and migration management in cloud
project delivery
• Identify the key steps in developing data migration strategy and tactics
• Get familiar with data governance through DAMA DMBoK

5 Copyright © 2020, Oracle and/or its affiliates.

Oracle Cloud Delivery Framework
Analyze & Plan & Configure & Validate & Transition & Sustain &
Prepare Design Build Test Go Live Realize

Project Management and Governance

Cloud Provisioning & Cloud Security,
Environments Identity & User Continuous Testing Sustainment Plan &
Knowledge Areas

Management Management Strategy & Plan Adoption Strategy

Project Management Implementation

Cloud Architecture Data Management
Plan & Delivery Approach for Cloud
Envisioning & Planning & Migration Plan
Approach Solutions in Scope

Training & Knowledge

Aligning Business Goals Cloud Risk Organizational Change &
Transfer Strategy &
& Project Objectives Management Communication Mgmt.
Plan

Project Artifacts, Deliverables, and Milestones

SaaS PaaS OCI

6 Copyright © 2020, Oracle and/or its affiliates.
Oracle Cloud Delivery Framework
Knowledge Area – Data Management and Migration Plan

Analyze & Plan & Configure & Validate & Transition & Sustain &
Prepare Design Build Test Go Live Realize

Project Management and Governance

• Define and implement the data transformation and

Data
migration strategy, plans, methods, different tools and
Management &
Migration Plan paths to be used for applications and databases data
migration applicable for the project in scope.

Project Artifacts, Deliverables, and Milestones

SaaS PaaS OCI

7 Copyright © 2020, Oracle and/or its affiliates.
Why Migrate Your Data?

• Introduction of a new system:

• Application migration
• Consolidation of legacy systems
• Deployment of additional system
• Retention and archiving of historical data
• Upgrading infrastructure
• Retiring servers
• Moving, lifting, and Shifting to cloud

Ultimate Goal: Improve corporate performance

and deliver competitive advantage.

8 Copyright © 2020, Oracle and/or its affiliates.

Key Drivers of Data Complexity
Effective Corporate Data Quality Strategy

Corporate Data
Compliance
Growth Volume

Data
Data Decay Data Denial
Diversity

Technical Economic
Advances Factors

9 Copyright © 2020, Oracle and/or its affiliates.

 Analyze &
Data Management and Migration Plan Prepare

Analyze and prepare life cycle Data Management

and Migration Plan

Major Activities
> Define and agree upon data migration scope, strategy, plan, and approach.
> Verify scope of extraction, transformation, loading, and reconciliation.
> Analyze the nature of data being transferred among different applications and source and target databases.
> Audit and profile the data, develop mapping specifications and migration code to be written.
> Identify mode of transfer (file or data) with/without transformation from source to target.
> Identify the data sources what is achievable, supportable, reasonable.
> Identify the volume and frequency of the data exchange.
> Define data transformation and migration responsibilities.
> Identify the IT landscape and business dependencies.
> Identify the SOW for data management (OLTP use case or DW use case).
> Determine data connections, data security, and import model (direct, flat files, no-SQL, FS, HFS).
> Determine data models, data retrieving, and aggregation rules.

Key Deliverables / Artifacts

✓ Project Management Plan
✓ Data Migration Strategy Plan

10 Copyright © 2020, Oracle and/or its affiliates.

Target-Driven Approach
An effective data migration project

SOURCES
Sales Customer Service Billing

Extract
Project Planning Profile & Project
Design Transform Test
Start Audit Sign-off
Load (ETL)
• Define Scope • Full Volume
• Establish Data Analysis
Governance • Understanding
Data Quality
procedures of all resources Check

• Cleanse
• Match
TARGET • Parse

CRM/ERP/DW

11 Copyright © 2020, Oracle and/or its affiliates.

Data Management and Migration Plan
Golden rules for successful data migration

• Clearly define the scope of the project.

• Actively refine the scope of the project through targeted profiling
and auditing.
• Minimize the amount of data to be migrated.
• Profile and audit all source data in the scope before writing
mapping specifications.
• Define a realistic project budget and timeline, based on knowledge
of data issues.
• Secure sign-off on each stage from a senior business
representative.
• Prioritize with a top-down, target-driven approach.
• Aim to volume-test all data in the scope as early as possible at the
unit level.
• Allow time for volume testing and issue resolution.
• Segment the project into manageable, incremental chunks.
• Keep a total focus on the business objectives and cost/benefits
throughout the migration period.
12 Copyright © 2020, Oracle and/or its affiliates.
Migration Strategy
Assess a suitable approach for the customer
Big Bang Migrations
• Entire data migration
• Defined processing window
• Shortest possible time
• Data verification and sign
off on critical path
• At least one dry run needed
• Quality of data migrated
compromised
• One-off requiring shutdown
13 Copyright © 2020, Oracle and/or its affiliates.
Trickle Migrations
• Incremental Approach
• Old and new systems running
in parallel
• Migrating data in phases
• Real time processes to move
data
• Applicable for Zero-down time
mission critical operations
• Real-time processes to move
data
• Adds some complexity to the
design
 Choosing a Migration Method
Evaluation and planning checklist

Work with database admins, network admins, and system admins to determine the strategy
for the migration. Some of the characteristics and factors to consider when choosing a
migration method are

• Down Time and Outage • Databases Patches

• Database Schema Size • DB Name
• Network Bandwidth • DB Block Size
• Cross-Platform Migration • DB Time Zone
• Database Character Set • DB Users, Privileges, and Objects
• Data Encryption • Sizing
• Data Type and Quality • Storage for Data Staging
• Database and OS Versions and Edition • Target Database

14 Copyright © 2020, Oracle and/or its affiliates.

 Plan &
Design
Data Management and Migration Plan
Plan and design phase Data Management
and Migration Plan

Major Activities
> Provide orientation to data migration tools and templates.
> Review initial data migration sample (30-40%): Extract, Transform, Load and Key Deliverables / Artifacts
Reconciliation. • Confirmed data sheets (templates)
> Build data transformation and cleansing rules to load and test the data. • Cut over plan
> Identify / design data sources and their type (file transfer only or data • Data cleansing approach
transfer with/without transformation) and Nature (Oracle or third party) • Database migration plan and
being transferred among different applications from source to target. method
> Identify the volume and frequency of the data exchange, arrive at sizing • Cloud architecture
requirement for PaaS/Integration services.
> Design data acquiring model from data sources (data integration, data
migration, data backup, file system, etc).
> Develop rules for transferring all designated source data to fit the target.
> Finalize SOW for data management (OLTP use case or DW use case).
> Assess cloud readiness.
> Develop cloud architecture.
> Develop a migration path.

15 Copyright © 2020, Oracle and/or its affiliates.

 Determining Migration Method
Migrating databases

1. Identify the database version of the “source” Conduct an online migration

and “destination” on-premises database. path assessment
2. Determine the migration method for the
specific scenario.
3. The architecture for on-premises Oracle
database
4. Endian format (byte ordering) of your on-
premises database’s host platform
5. Database character set of the on-premises
database and the OCI Database
6. Database version of the Oracle Cloud
infrastructure database migrating to
Cloud Migration Advisor

16 Copyright © 2020, Oracle and/or its affiliates.

Oracle Database Migration Tools
Evaluating the different migration paths

Plug/Unplug
Zero Down time
Data Pump
Migration (ZDM)

Recovery Manager
MV2ADB
Maximum Availability
Architecture

Oracle SQL
OCI Data Transfer Remote Cloning
Developer
Appliance

17 Copyright © 2020, Oracle and/or its affiliates.

Migration Methods: Overview
Data Loading Tool Recommended for Input Formats Third- Object Store
Large Data Sets Supported Party DB Support
Support
SQL Developer Data YES (1) Flat files YES
import Wizard
SQL Developer YES (1) Third-party DBs YES
Migration Workbench
Oracle Data Pump YES Oracle DBs YES

SQL*Loader Flat files

Database Link Oracle DBs YES

DBMS_CLOUD Package YES Flat files YES

External Tables YES Flat files YES

Data Sync YES (1) DBs, Flat files YES YES

Other ETL Tools/Scripts YES (1) DBs, Flat files YES Some
18 Copyright © 2020, Oracle and/or its affiliates.
Migration Methods
References and links

• Oracle Zero Downtime Migration on Oracle.com

• Move to the Oracle Cloud on Oracle.com
• Migrating Databases to the Cloud - Migration Methods – MUST REVIEW
• Cloud Migration Advisor

• Zero Downtime Database Migration to the Oracle Cloud - Short OOW

• Zero Downtime Database Migration to the Oracle Cloud - OOW
• Options for Migrating your Database to the Oracle Cloud - Deep Dive OOW

19 Copyright © 2020, Oracle and/or its affiliates.

Use Cases
For data migration and management
Autonomous Database
Fully Self-Driving Database Oracle Builds and
Operates Exadata Infrastructure and Databases User
runs SQL, no Access to OS or Container DB
Oracle Database Cloud Services
Automated database cloud oracle builds and operates
infrastructure user operates databases using provided
lifecycle Automation user has full control, including
DBA and Root Access
Exadata
Database Platform. Oracle builds,
optimizes, and automates infrastructure.
All in-database automation features included.
Oracle Database
Database runs anywhere user builds and operates
databases and infrastructure
20 Copyright © 2020, Oracle and/or its affiliates.
Cloud elasticity, machine learning, self–driving.
Instant provisioning, always online operation.
All workloads, JSONDocuments, graphs, and more.
Use Cases
Availability, flexible version andfeatures, small to
large DBdeployment, single instance or RAC,
automated backup, patching, customer controls
Use Cases
Private/public cloud, on-premises, consolidation,
highest performance, scalability formission-critical
workload
Use Cases
Small to big database transactional needs
DWH needs, Customer data center, DIY model
Autonomous Database
Two deployment options

ORACLE
CLOUD

Autonomous Database Automated DB Services

• All database operations fully automated • Database lifecycle automation provided
• User runs SQL, no access to OS or CDB • User operates, has DBA and OS root access
• Exadata performance and availability • Runs older database versions
• Customizable for DW or TP workload • ALL database features ( e.g., Java)

Serverless Dedicated ExaCS DBCS

Ultra-Simple Customizable Scale, Performance, VM or bare metal,
and Private Cloud Availability single server or RAC
elastic
21 Copyright © 2020, Oracle and/or its affiliates.
Autonomous Database: Target Database Types
Choice of cloud deployment

Exadata Cloud
DBaaS Autonomous Autonomous
Service or Cloud
VM or BareMetal Serverless Dedicated
Customer
Management Customer Customer Oracle Oracle

Private Network Yes Yes No Yes

Single/Multi Tenant Single/Multi Single/Multi Single Single/Multi

Software Updates Customer Initiated Customer Initiated Automatic Customer Policy Control

Private Cloud No Yes No Yes

Offers Availability
No 99.95% SLO SLO
SLA
Database Versions 11g,12c,18c,19c 11g,12c,18c,19c 18c 19c
Yes Yes
Disaster Recovery Across ADs & Regions Across ADs & Regions
No No

Hybrid DR Yes Yes No No

Consolidation Yes Yes No Yes

22 Copyright © 2020, Oracle and/or its affiliates.

 Migration Options
Managing and migrating data

Migration Option Autonomous BM/VM Database Benefits

Exadata Versions
Restore from object store ✓ ✓ All Supports all database editions
(online or sync data transfer) Data Pump RMAN based and platforms along with full and
Restore incremental backups
Restore from object store ✓ ✓ All Same as restore from object store.
(offline data transfer using Additionally supports low
Data Transfer Service) bandwidth/high volume scenarios
Data Guard NA ✓ Enterprise Minimal down time
Edition & Above
Oracle SQL Developer ✓ NA All Quick and simple; suitable for
migrating database objects of
small to medium size

23 Copyright © 2020, Oracle and/or its affiliates.

Module 14 – Data Management and
Migration Plan
Oracle Cloud Project Management Training for Partners

Part 2
Oracle Alliances & Channels
Autonomous Database
Optimized by workload

ORACLE
AUTONOMOUS
DATABASE

Autonomous
Data Warehouse (ADW)
Best for all analytic workloads:
• Data warehouse, Data Mart
• Data lake, machine learning
Autonomous
Transaction Processing
(ATP)
Best for TP and mixed workloads:
• Transactions, batch, reporting, IoT
• Application dev, machine learning

25 Copyright © 2020, Oracle and/or its affiliates.

Autonomous Optimizations
Specialized by workload

Autonomous Data Autonomous

Warehouse Transaction Processing

Optimizes Complex SQL Optimizes Response Time

Columnar Format Row Format

Creates Data Summaries Creates Indexes

Plan Stability and Runaway Query Prevention

27 Copyright © 2020, Oracle and/or its affiliates.

 Autonomous Data Warehouse Cloud
Key use cases: Determine workload characteristics for the DB

Connect and Integrate Store and Process Analyze and Visualize

• Quick and actionable

Data marts / business insights
warehouses • Easily start new
analytical projects
Structured • Focus on algorithms,
Data
Varying data not infrastructure
types
1010101
01010 Sandboxes for data • Easy ML testing and
scientists adaptation
• Data available from
Unstructured structured and
Data Data lakes unstructured sources
• Store and process
massive data sets

28 Copyright © 2020, Oracle and/or its affiliates.

Autonomous Data Warehouse
Architecture: Overview

29 Copyright © 2020, Oracle and/or its affiliates.

Autonomous Transaction Processing
Key use cases: Determine workload characteristics for the DB
Develop
Develop Database Microservices Apps
Centric Apps

What for? What for?

• Extend Enterprise Apps • Quickly adapt to business

• Replace Oracle Forms processes integration.
• Rapid App (Visual) • Multi-cloud including PaaS and
Development for Data Entry, SaaS
Reporting • Capture streaming data by using
JSON and REST formats using
• Replace Spreadsheets ATP as the back end.

Low Code App Developer Full Stack App Developer

Autonomous Transaction Processing

AUTONOMOUS, DEPLOY, ACCESS, MONITOR, SECURE

30 Copyright © 2020, Oracle and/or its affiliates.

Autonomous Transaction Processing
Architecture: Overview

31 Copyright © 2020, Oracle and/or its affiliates.

 Autonomous Data Warehouse and Autonomous Transaction Processing
Project objectives
Lower Cost
• Reduce admin costs up to 80% with complete automation of operations and tuning.
• Reduce runtime costs up to 70% by dynamically adjusting resources, eliminating underutilization.
• Deploy new apps in minutes: faster TTI/TTD.
• Reduce labor cost and lower risk of Human error by automated provisioning, patching, tuning, securing, monitoring.
• Consume fewer resources with higher performance database and platform.

Reduce Risk
• Be protected from attacks by automatically applying security updates.
• Mitigate breach impact by avoiding reputational damage, associated breach costs, and revenue losses.
• Eliminate human intervention and remove the most common cause of systems/data errors.

Improve Productivity and Increase Agility

• Gain insights from data in few minutes (provision, load data and start running queries in minutes).
• Find patterns through AI and ML to identify and discover anomalies or new trends that open up new opportunities.
• Drive innovation and gain a competitive advantage from your data instantly.
• Scale compute and storage while the system is still running to meet the varying seasonal demands of the business.
• Manage the compute and storage resources costs by using idle shut off.

32 Copyright © 2020, Oracle and/or its affiliates.

Loading Architecture Diagram
Migrating to ADB: Workflow

Manual data export/extract

from on-premises database,
system, or data source

Manual data export/extract

from SaaS Applications Import to ADB
Storage OR read
directly from
Manual export/extract from Object Storage
third-party data source

Manual export/extract from

data lake (Hadoop)

33 Copyright © 2020, Oracle and/or its affiliates.

 Target Cloud Database Types
Oracle Autonomous Database: Key attributes

Self-Driving Self-Securing Self-Repairing

Automates all database and Protects from both Protects from all
infrastructure management, external attacks and downtime including
monitoring, tuning malicious internal users planned maintenance

Spend Less, Reduce Risk, Innovate More

34 Copyright © 2020, Oracle and/or its affiliates.
Full Database Lifecycle Management and Automation
Everything is automatic

• Provisioning
• Scale-up and Scale-out
• Tuning
• Security and patching
• Fault tolerance
• Optimized
• Protection (backup and restore)

35 Copyright © 2020, Oracle and/or its affiliates.

 Migration to Autonomous Database
Manual steps for migration
• Check compatibility of your environment by using ADB
Advisor.
• Export data using data pump to .dmp file.
‒ Eliminate legacy formats, upgrades version, encrypts
data, removes admin privileges.
‒ GoldenGate replication can be used to keep database
online during process.
• Upload dump file(s) to Object storage (Oracle, Amazon,
Azure).
• Initiate import of dump file to Autonomous Database.
• Download log file to check for errors.
More automated solution
• MV2ADB script from MyOracle Support
• After you have run the ADB Advisor
36 Copyright © 2020, Oracle and/or its affiliates.
Migrating to ABD: Key Considerations
• Database must be converted to PDB,
upgraded to 19c, and encrypted.
• Any changes to Oracle shipped stored
procedures or views must be found
and reverted.
• All uses of CDB admin privileges must
be removed.
• All legacy features that are not
supported must be removed (e.g.
legacy LOBs).
• Use data Pump (Exdp/imdp) for
exporting Oracle DBs Version 10.1 and
above.
Migration to Autonomous Database
ADB Advisor check: Discover problems before migration

Download ADB Advisor from MOS (2462677.1)

• Always download latest version.
• Install in separate schema on your environment.
• See direct results after running the tool.

37 Copyright © 2020, Oracle and/or its affiliates.

 Migration to Autonomous Database
ADB Advisor check: Discover problems before migration

ADB Advisor checks

==========================================================================================
current environment. == ATP SCHEMA MIGRATION REPORT FOR HR
==========================================================================================
------------------------------------------------------------------------------------------
-- ATP MIGRATION SUMMARY
------------------------------------------------------------------------------------------
• Object compatibility Object Type Count Not Migrated With Changes Migrated
------------------------- -------------- -------------- -------------- --------------
• Character set CONSTRAINT
DIRECTORY
34
5
0
5
0
0
34
0
• Tablespace setup INDEX
PROCEDURE
18
2
0
0
0
0
18
2
SEQUENCE 3 0 0 3
• Profiles SYNONYM 6 0 0 6
TABLE 7 0 7 7
• Parameters TRIGGER
VIEW
2
1
0
0
0
0
2
1
------------------------------------------------------------------------------------------
-- ATP OBJECTS NOT MIGRATED
------------------------------------------------------------------------------------------
1. Database Directory Objects not migrated (Count=5):
-----------------------------------------------------
Note: Database Directory objects are not allowed in ATP and ADW.
DATA_FILE_DIR LOG_FILE_DIR MEDIA_DIR
SS_OE_XMLDIR SUBDIR

38 Copyright © 2020, Oracle and/or its affiliates.

MV2ADB Migrate to Autonomous Database
Move data to Autonomous Database in "one-click" (Doc ID 2463574.1)

Create configuration file:

• Local DB information
• Object storage information
• Target ADB information
• Proxy settings
Start tool and wait:
• Execute separate steps.
• Execute all at once.

39 Copyright © 2020, Oracle and/or its affiliates.

 Loading and Import Options to ADB
Choose based upon data size, load time requirements, frequency, and update/refresh

Load data into ADB Cloud using Oracle database tools and third-party integration tools. Loading data can be achieved:
• From files local to your client computer, or
• From files stored in a cloud based object store
Option Loading & Import
Loading Data (for accessing directly) From Oracle Object Store. Data from
to ADB from cloud-based object store any application or data source export
(DBMS_Cloud) PREFERRED METHOD to text (.csv or JSON); Output from 3rd
party data integration tools. Flexibility
to access data stored on object
storage from other clouds (AWS, S3
and azure blob Storage *)
Loading using SQL*loader Loading Data file (Oracle data) from
local files on client local machine
Importing Data using Oracle Data Using Data Pump Export from existing
Pump Oracle Database (version 12.2.0.1 and
Earlier
Importing Data Using import Wizard Using SQL Developer import wizards
from Desktop tool: SQL Developer from Local Desktop (CSV, Excel, TXT)
* Project will need to consider and may incur outbound data transfer costs
40 Copyright © 2020, Oracle and/or its affiliates.
Performance Factors & Considerations Volume of Data
• Copying files to Object Storage (size & Unlimited Volume
network bandwidth from source)
• Importing from Object Store (time &
parallelism) to ADB storage
• Querying directly from Object Storage from
ADB (external tables)
• Use Data Transfer Service (HDD)* for very
large initial, one time bulk load
• Load performance depends on the network Limited to OS and Client
bandwidth between your client and machine
Autonomous Data Warehouse Could
• Copying.dmp file to Object Storage (size & Medium/large Volumes
network bandwidth)
• Size of .dmp file (processing)
• Increase CPUs dynamically to meet loading
time requirements
• Import .XLS files (limited to row limited in Local Desktop – Limited to
excel version) Desktop resources
Moving Existing Data Marts or DWs to the Cloud
Typical activity list

1a. Move on-premises DW to

ADWC.
1b. Dedicated migration tools for
seamless migration
2. High-performance analytics
queries
3. Self-serve customizable
analytics.
4. Present actionable insight.
5. Seamlessly integrate any data.
6a. Stage data OR
6b. Load data directly into ADW.
7. Use for raw data for data lakes.

41 Copyright © 2020, Oracle and/or its affiliates.

Leveraging the Autonomous Database Tools: Starting, Stopping, Scaling
Manage costs of the projects!

• Scale the autonomous database instance on

demand without tedious manual steps: Monitoring Performance
Through Cloud Console
• Independently scale compute or storage. • Storage
• Resizing occurs instantly, fully online. • CPU Utilization (%)
• Memory, I/O bandwidth, concurrency scales • Running SQL Statements
linearly with CPU. • Average SQL statement
• Stop the instance on demand to conserver response time
• SQL statements executed
resources. per second
• Start the instance instantly on demand.

42 Copyright © 2020, Oracle and/or its affiliates.

 Configure &
Data Management and Migration Plan Build
Configure and build Data Management
& Migration Plan

Major Activities
> Second iteration of data migration (up to 60%): Map, load, validate
> Review progress (extract, transform, load, and reconciliation scope).
> Provision the cloud data stores in Oracle cloud (ATP, ADW or BDS).
> Transfer the data to the respective cloud service.
> Design and implement the mechanisms for data usage (in and out of oracle cloud data stores).
> Transfer the application and database data from the on-premises location to cloud tenancy.
> Migrate data to cloud database repository (from on-premises or from other locations).

Key Deliverables / Artifacts

✓ Second iteration of data loaded
✓ Updated template sheets
✓ Updated cut over plan
✓ Loaded data into test
✓ Migrated database on TEST environment

43 Copyright © 2020, Oracle and/or its affiliates.

 Implementing Autonomous Database
Leverage autonomous database with customer data

1 2 3 4 5
Autonomous
Database DataLoad Analytics/Application Run Monitor
Setup Setup

• Discovery (DBsources, • Identify dataloading Analytics • TestScenarios • Manage and

size,etc) tools • Identify AnalyticsTool Monitor Database
• Identify data set/ Define • Import/ Integratedata • Discovery (Dashboards)and • Documentresults
ApplicationFlows/Testing • Configureintegration selection of top 3 reports/ Achieved
queries Manage and
Scenarios points
• Oracle Analytics intro and Monitor Database
• Run ADB assessment tool
• Create instance andintro setup or 3rd partyAnalytics
onADB connection toADW
• Obtain Security ATP/App
credentials • Connect App toATP
• Connect to Database
• Scale the Database

44 Copyright © 2020, Oracle and/or its affiliates.

Provisioning Databases

Provisioning Autonomous Databases

• Provisioning requires only 5 simple questions:
✓ What is the Database name?
✓ Which is the data center?
✓ How many CPUs?
✓ How many TBs?
✓ What is the admin password?
• New service created in minutes (regardless of size)
• Database is open and ready for connections

Provisioning Other Cloud Databases

• Provisioning Autonomous Transaction Processing
• Provisioning Autonomous Data Warehouse Cloud
• Provisioning Exadata Cloud at Customer
• Creating Exadata DB Systems
• Creating Bare Metal and Virtual Machine DB Systems

45 Copyright © 2020, Oracle and/or its affiliates.

 Migrating Application Data Files
Assess the migration tools and templates

Leverage the SaaS

applications migration tools
such as FBDI, import and
export management
framework, and web services
to map and conduct data
migration to the cloud.

46 Copyright © 2020, Oracle and/or its affiliates.

 Migrating Database Data Files
Leveraging storage gateway from OP to CLOUD migration

NFSv4
NFSv4

Storage Gateway Use

On-Premises OCI Database Cases
Storage Storage
Oracle
Gateway Gateway System • Backup
Database
• Archive
• Disaster Recovery
• Data Migration
Database Database • Cloud Tiering
Data Data
• Nearline Content
Repositories

Object Storage

Storage Gateway is an efficient tool to move data from your on-premises data center to the cloud.

47 Copyright © 2020, Oracle and/or its affiliates.

 Validate &
Test
Data Management and Migration Plan
Validate and test Data Management
& Migration Plan

Major Activities
> Load full-volume data on TEST Environment before testing commences
> Conduct unit, system, volume, online application, and batch application tests.
> Full Data Migration, transformation and loading with baselining time estimates for production preparation
> Data reconciliation and validation
> Review the progress and revalidate the cutover dates and customer readiness.
> Run data validation scripts against all data sources.
> Check and resolve ADB restrictions before transferring the data.
> Perform functional and performance tests during UAT project.
> Obtain end-client UAT final acceptance.

Key Deliverables / Artifacts

✓ Third iteration of data loading
✓ Fully loaded into test environment
✓ Reconciled data
✓ Updated cutover plan

48 Copyright © 2020, Oracle and/or its affiliates.

 Transition &
Go Live

Data Management and Migration Plan Data Management

& Migration Plan

Major Activities
> Load, reconcile, and validate full data in production.
> Data is extracted from the source system, transformed, cleansed, and loaded into the
target system, using the migration rules.
> Transfer existing historical data to cloud database repository.
> Transfer current data to cloud database repository and create the online transfer
process.
> Conduct audit on the migrated database or application data.
> Connect the application package / analytics layer to ADB and test the connection.

Key Deliverables / Artifacts:

✓ Production data loaded in full with no issues or gaps.
✓ Reconciled data with legacy

49 Copyright © 2020, Oracle and/or its affiliates.

 Sustain &
Realize

Data Management and Migration Plan Data Management

& Migration Plan

Major Activities:
> Reconcile transactional data (payroll, financial period closure).
> Plan for additional data loads for subsequent phases/releases.
> Manage and monitor the autonomous database through the cloud console.
> Stop, start, and scale the ADB to manage costs effectively.

50 Copyright © 2020, Oracle and/or its affiliates.

Data Governance
Guide to the data management body of knowledge from the Data Management Association.

51 Copyright © 2020, Oracle and/or its affiliates. Source: http://www.dama-dmbok.org

Useful Documents/Links/Training Assets

Learning
• Oracle Autonomous Database 2019 for SE-L3
• Oracle Autonomous Database Cloud 2019 Specialist
• Oracle Autonomous Database Training and Certification
Documentation
• Autonomous Data Warehouse Tools and Application Test Matrix
• MOS Note: Oracle Autonomous Database Schema Advisor (Doc ID 2462677.1)
• Autonomous Data Warehouse Service Documentation
• Autonomous Transaction Processing Documentation
• Successful Data Migration - Oracle White Paper
References
• What Is Oracle Autonomous Database?
• Think Autonomous
• Database Migration to Oracle Cloud Infrastructure: Evaluation and Planning Checklist

52 Copyright © 2020, Oracle and/or its affiliates.

Detailed Tasks and Key considerations
Example Use Case: Migrate and manage large data in Oracle cloud using autonomous database services
(ATP/ADW).

Analyze the on-premises deployment architecture
• Infrastructure and Security layer
- Determine machine deployment type (bare metal / Virtualized)
- Determine network and security topology
- Determine user management type (federated/SSO/Application only)
- Determine disk storage topology (network, external, VM hosted, etc)
• Database layer
- Determine database type, version and location (OLTP, DW+ETL, Data lake,
etc)
- Determine data connections, data security and import model (direct, flat
files, no-SQL, FS, HFS)
- Determine data models, data import/export rules,
• Database version upgrade process
- Plan version upgrade process (to 19c)
- Plan migration to autonomous respecting the ADB restrictions
Create the cloud deployment architecture for new automated DB
• Create deployment architecture (PreProd/Dev/test/UAT/Prod) + replication
rules
• Create infrastructure ADB deployment model
- Determine number of ADB instances
- Determine the compartments, network topology, security lists, routing
tables, network gateways, etc
- Determine the users access and roles
- Determine Object storage / Files storage architecture and security
53 Copyright © 2020, Oracle and/or its affiliates.
• Determine the DB type (ATP /ADW)
• Determine the connection type (for application layer (ATP) or for analytics
(ADW))
Provision / install the cloud instances for the created architecture
• Provision IaaS OCI resources (VCN, compartments, etc)
• Create network topology
• Create the security and access rules
• Provision ADB PaaS instances
Migrate data to cloud database repository (from on-premises or from other locations)
• Run data validation scripts against all data sources
• Check and resolve ADB restrictions before transferring the data
• Transfer existing historical data to cloud database repository
• Transfer current data to cloud database repository and create the online
transfer process
Connect the Application package / Analytics layer to ADB and test the connection
Test deployed analytics application package
• Functional testing (availability tests, scaling tests, replication tests, etc)
• Performance testing
Conclusion
Data Management and Migration Plan

Now that you have completed this module, you should be able to:
• Identify the reasons why to migrate data and define the key drivers of data complexity
• Explain the target-driven data migration approach
• List the golden rules for successful data migration
• Describe the migration strategy and methods
• Explain the difference between the various migration tools
• Describe the database types for data management and migration purposes
• Use Autonomous Database for Autonomous Data Warehouse (ADW) and Autonomous Transaction Processing
(ATP)
• Explain the key considerations to prepare for data transformation strategy and migration management in cloud
project delivery
• Identify the key steps in developing data migration strategy and tactics
• Get familiar with data governance through DAMA DMBoK

54 Copyright © 2020, Oracle and/or its affiliates.

Thank You

Oracle Cloud Project Management Training

Oracle Partner Network

55 Copyright © 2020, Oracle and/or its affiliates.