WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

Title WI – Reconfigure Oracle TSM Database Backups To Use DDBoost

Author Paul Scotto
References N/A
Document Version 4.0
Last Revision Date 08 September 2015

PURPOSE
The purpose of this Article is to define the procedures for converting the Oracle database backups
on a host from TSM/TDPO to Data Doman Boost (DDBoost). The procedures outlined in this
document are intended for use by the Database Operations team.

PREPARATION

1. Get the DDBoost “storage-unit-on-Data-Domain-system” and “hostname-of-Data-Domain-

system” from the spreadsheet provided or request from Backup Team.

2. Request allocation of /opt/oracle/libs file systems @ 4g owned by ormerck:dbmerck

3. Create links to DDBoost libs in (HPUX) /usr/lib/hpux64 (Solaris) /usr/lib/sparcv9. Required

for running backups from OEM.

ln -s /opt/oracle/libs/DDBoost/v1.2/lib/libDDBoost.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/lib/libddobk.so .

4. Make sure “ormerck” and any other database accounts are unlocked.

INSTALL DDBOOST PLUGIN – ONCE PER HOST

1. Create DDBoost Plugin Directory under /opt/oracle/libs

$ cd /opt/oracle/libs
$ mkdir DDBoost
$ mkdir DDBoost/v1.1
$ mkdir DDBoost/v1.2
$ mkdir DDBoost/v1.1/lib
$ mkdir DDBoost/v1.2/lib

2. Change directories to /tmpdump/ormerck/ddboost

$ cd /tmpdump
$ cd ormerck  Create if necessary
$ mkdir -p DDBoost11
$ mkdir -p DDBoost12
WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

3. Get the RMAN plugin for the target platform (UNIX or LINUX) from the software depot

LINUX (Install both v1.1 & 1.2)

scp ormerck@dbadepot:/opt/oracle/install/DDBoost/RMAN_1.1.1.0-378849_RMAN_linux_64.tar
DDBoost11
scp ormerck@dbadepot:/opt/oracle/install/DDBoost/RMAN_1.2.1.0-436349_RMAN_linux_64.tar
DDBoost12

HP-UNIX (Install 1.2 Only)

scp ormerck@dbadepot:/opt/oracle/install/DDBoost/RMAN_1.2.1.0-436349_RMAN_hp_ia64.tar
DDBoost12

Solaris-UNIX (Install 1.2 Only)

scp ormerck@snwpdv41:/opt/oracle/install/DDBoost/RMAN_1.2.1.0-
436349_RMAN_solaris_sparcv9.tar DDBoost12

4. Use tar commands to uncompress the v1.1 file: (LINUX Only)

$ cd /tmpdump/ormerck/DDBoost11
$ tar vxf filename

5. Set ORACLE_HOME to DDBoost v1.1 Plugin Directory: (LINUX Only)

$ export ORACLE_HOME=/opt/oracle/libs/DDBoost/v1.1

6. Run v1.1 install/setup as an Oracle user, enter: (LINUX Only)

$ ./install.sh

7. Use tar commands to uncompress the v1.2 file:

$ cd /tmpdump/ormerck/DDBoost12
$ tar vxf filename

8. Set ORACLE_HOME to DDBoost v1.2 Plugin Directory

$ export ORACLE_HOME=/opt/oracle/libs/DDBoost/v1.2

9. Run v1.2 install/setup as an Oracle user, enter:

$ ./install.sh

10. Open permissions on install libraries:

$ cd /opt/oracle/libs
$ chmod -R 755 DDBoost

11. Clean up temporary install files:

$ rm –rf /tmpdump/ormerck/DDBoost*
WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

CONFIGURE ORACLE HOME FOR DDBOOST – ONCE PER HOME

1. Login as the Oracle database owner and ensure that ORACLE_HOME and ORACLE_SID
are set for any database in the target home.

2. Create links to DDBoost plugin in ORACLE_HOME/lib

LINUX v1,1 (Oracle 10g)

cd $ORACLE_HOME/lib
ln -s /opt/oracle/libs/DDBoost/v1.1/lib/libccme_base.so .
ln -s /opt/oracle/libs/DDBoost/v1.1/lib/libcryptocme2.sig .
ln -s /opt/oracle/libs/DDBoost/v1.1/lib/libcryptocme2.so .
ln -s /opt/oracle/libs/DDBoost/v1.1/lib/libCSP-lb.so .
ln -s /opt/oracle/libs/DDBoost/v1.1/lib/libCSP-Security.so .
ln -s /opt/oracle/libs/DDBoost/v1.1/lib/libDDBoost.so .
ln -s /opt/oracle/libs/DDBoost/v1.1/lib/libddobk.so .

LINUX v1,2 (Oracle 11g & 12c)

cd $ORACLE_HOME/lib
ln -s /opt/oracle/libs/DDBoost/v1.2/lib/libddobk.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/lib/libDDBoost.so .

cd $ORACLE_HOME/config  Create config if necessary

ln -s /opt/oracle/libs/DDBoost/v1.2/config/libccme_base_non_fips.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libccme_base.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libcryptocme.sig .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libcryptocme.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libCSP-lb.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libCSP-Security.so .

HP-UNIX v1.2 (Oracle 10g, 11g & 12c)

cd $ORACLE_HOME/lib
ln -s /opt/oracle/libs/DDBoost/v1.2/lib/libDDBoost.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/lib/libddobk.so .

cd $ORACLE_HOME/config
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libCSP-Security.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libCSP-lb.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libccme_base.sl .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libccme_base_non_fips.sl .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libcryptocme.sig .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libcryptocme.sl .

Solaris-UNIX v1,2 (Oracle 10g, 11g)

cd $ORACLE_HOME/lib
ln -s /opt/oracle/libs/DDBoost/v1.2/lib/libDDBoost.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/lib/libddobk.so .

cd $ORACLE_HOME/config  Create config if necessary

ln -s /opt/oracle/libs/DDBoost/v1.2/config/libCSP-Security.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libCSP-lb.so .
WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

ln -s /opt/oracle/libs/DDBoost/v1.2/config/libccme_base.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libccme_base_non_fips.so .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libcryptocme.sig .
ln -s /opt/oracle/libs/DDBoost/v1.2/config/libcryptocme.so .

3. Set library path to current ORACLE_HOME/lib

$ export LD_LIBRARY_PATH=$ORACLE_HOME/lib

4. Register Each Data Domain Installation (once)

rman target /

(Linux Oracle 10g)

run {
allocate channel dd0 type 'SBT_TAPE'
parms='BLKSIZE=1048576,SBT_LIBRARY=/opt/oracle/libs/DDBoost/v1.1/lib/libddobk.so';
send 'set username ddboost password DDb00st servername hostname-of-Data-Domain-
system';
release channel dd0;
}

(All except Linux Oracle 10g)

run {
allocate channel dd0 type 'SBT_TAPE'
parms='BLKSIZE=1048576,SBT_LIBRARY=/opt/oracle/libs/DDBoost/v1.2/lib/libddobk.so';
send 'set username ddboost password DDb00st servername hostname-of-Data-Domain-
system';
release channel dd0;
}

CONFIGURE RMAN FOR DDBOOST – ONCE PER DATABASE

1. Ensure that ORACLE_HOME and ORACLE_SID are for the target database.

2. Configure backup channels for the target database.

rman target /

CONFIGURE DEVICE TYPE 'SBT_TAPE' PARALLELISM 1 BACKUP TYPE TO BACKUPSET;

CONFIGURE CHANNEL DEVICE TYPE 'SBT_TAPE' PARMS 'BLKSIZE=1048576,

SBT_LIBRARY=<ORACLE_HOME>/lib/libddobk.so,ENV=(STORAGE_UNIT=storage-unit-on-
Data-Domain-system,BACKUP_HOST=hostname-of-Data-Domain-system)';

Note: For parallelism, use 1 channel for every 1.2tb of database size on UNIX (2tb on Linux).

3. Run a test backup to DDBoost

WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

rman target /

backup current controlfile format 'ddBoost_ctl_%d_%t_%s';

CONFIGURE DDBOOST BACKUP JOBS IN OEM

1. Login to correct OEM

Login as NONPROD in http://emnonprod.merck.com:7778/em if database is non

production.

Login as PROD in http://emprod.merck.com:7778/em if database is production.

Login as EMOPER in http://emprod2.merck.com:7788/em if database is production.

Login as EMOPER in http://emnonprod2.merck.com:7788/em if database is

production.

2. Clone EM Group with new name – DDB

o Click Targets (12c: Enterprise->Targets)

o Click Groups
o Choose Group name from the list
o Click Create Like
o Type group name in the Name field
Same name with new DDB qualifier:
Example
UXWSDV01_HOT becomes UXWSDV01_DDB_HOT
o Click OK

3. Create/Submit new backup jobs for DDBoost with new name, save new job to library and
cancel previously scheduled (TSM) jobs.

o Click Jobs (12c: Enterprise->Jobs->Activity)

o Click Job Activity
o Enter host name in Name filter (eg. UXWSDV01%) and set Status filter to “All”
o Make sure backups are not currently running
o For each SCHEDULED Job:
o Select scheduled Job
o Click Create Like
o Enter new job name <New_Group_Name>_<Type> (eg.
UXWSDV01_DDB_HOT_FULL)
o Remove old group from Targets (select radio button, click Remove)
o Add new group to Targets (click Add, Search for new group, Select)
o Click Parameters
o In RMAN Script add “filesperset 1” to backup incremental level 0
o Click Schedule
o Set Start Date to tomorrow’s date
o Click SUBMIT
WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

o Re-Select scheduled Job

o Click Copy To Library
o Re-Enter job name (same as above)
o Click Save To Library

o Re-Select original scheduled Job (with the old name)

o Click Delete
o Select Delete all runs of job
o Click OK

4. Remove Old Jobs from Library

o Click Job Library (12c: Enterprise->Jobs->Library)

o Enter host name in Name filter (eg. UXWSDV01%)
o For each old (non-DDB) Job:
o Confirm that there is a DDB version in the library
o Select Job
o Click Delete
o Click Yes

RUN INITIAL DDBOOST FULLBACKUP JOBS IN OEM

1. Run full one time full backup

o Click Job Activity (12c: Enterprise->Jobs->Activity)

o Enter host name & FULL in Name filter (eg. UXWSDV01%FULL%)
o For each scheduled Job:
o Select scheduled Job
o Click Create Like
o Enter new job name <New_Group_Name>_<Type>_ONCE (eg.
UXWSDV01_DDB_HOT_FULL_ONCE)
o Click Parameters
o In RMAN Script remove CROSSCHECK and DELETE commands at the bottom
o Click Schedule
o Select One Time (Immediately)
o Click SUBMIT

ADDENDUM A – BACKOUT PLAN

KBA00054586 - Oracle Reconfigure Backups For TSM (backout)

ADDENDUM B – GET LATEST PLUGIN FROM SHARE

An alternative to the software depot for downloading the RMAN plugin for the target platform
(UNIX or LINUX)

\\usdm2112\esr\Software\EMC\DDEBoost
WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

ADDENDUM C – KNOWN ERRORS

ORA-06594
ORA-06594: ICD is unable to compute a result
ORA-03113: end-of-file on communication channel

1. Make sure that environment variable LD_LIBRARY_PATH is set to current

ORACLE_HOME/lib.
2. If this is 10g on LINUX, make sure you are using DDBoost v1.1

ORA-027211
ORA-27211: Failed to load Media Management Library

Make sure that environment variable LD_LIBRARY_PATH is set to current

ORACLE_HOME/lib

ORA-027211 (UNIX in OEM Job)

ORA-27211: Failed to load Media Management Library

Additional information: 3971

Make sure /usr/lib/hpux64 contains links to libddobk.so and libDDBoost.so

ORA-27211: Failed to load Media Management Library

Additional information: 3978

Make sure /usr/lib/sparcv9 contains links to libddobk.so and libDDBoost.so

ORA-19511 - Could not create file

ORA-19511: Error received from media manager layer, error text:
sbtbackup: Could not create file ddBoost_ctl_DBFS_862310352_41175 on host
ctcddr7056.merck.com, error 5034

Make sure storage unit and host match each other and what was registered.

ORA-19511 - clb_mount failed

ORA-19511: Error received from media manager layer, error text:
sbtinit2: clb_mount failed setting /opt/oracle/ormerck/product/11.2.0.4_CDA/config/
as CLB mount directory, error The Lockbox or cryptography library could not be found.

Make sure links to the ddboost libraries ($ORACLE_HOME/lib & ORACLE_HOME/config) are
pointing to the correct file names (and extensions “.sl” or “.so”) for your platform. Linked file
must exit in /opt/oracle/libs/DDBoost.

Misc Troubleshooting

1. Database accounts have read permissions on the /opt/oracle/libs file system

2. Links in $ORACLE_HOME/lib point to /opt/oracle/libs/DDBoost/v1.2/lib
WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

3. Links in $ORACLE_HOME/config point to /opt/oracle/libs/DDBoost/v1.2/config

4. Channel is configured with “SBT_LIBRARY=<ORACLE_HOME>/lib/libddobk.so”, where
<ORACLE_HOME> is replaced with the current $ORACLE_HOME and path includes “lib”
subdirectory.
5. Look for sbtio.log in background_dump_dest for additional error messages
WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

VERSION CONTROL
Version Date Author Description of Change Section
1.0 17/Sep/2014 Paul Scotto Initial Document ALL

1.1 29/Sep/2014 Paul Scotto Set start date of next CONFIGURE

scheduled backup to at least DDBOOST
one day in future. BACKUP JOBS IN
OEM

1.2 01/Oct/2014 Paul Scotto Updated for first run through ALL

1.2 01/Oct/2014 Paul Scotto Added Addendum B to get ADDENDUM B

files from software depot
1.2 01/Oct/2014 Paul Scotto Corrected Linux linked file CONFIGURE
names ORACLE HOME
FOR DDBOOST –
ONCE PER HOME

1.3 02/Oct/2014 Paul Scotto Fixed OEM job configuration CONFIGURE

steps after first run through DDBOOST
BACKUP JOBS IN
OEM

1.3 02/Oct/2014 Paul Scotto Added fixes for some known ADDENDUM C –
errors encountered so far KNOWN ERRORS

1.3 02/Oct/2014 Paul Scotto Removed CROSSCHECK RUN INITIAL

and DELETE from initial DDBOOST
backup FULLBACKUP
JOBS IN OEM

1.3 03/Oct/2014 Paul Scotto Added step to check PREPERATION

connectivity to database
accounts.
1.3 03/Oct/2014 Paul Scotto Fixed Typos, dashes for cut-n- ALL
paste, enhanced OEM
instructions, switched to
getting plugins from depot,
changed backout doc to KBA
name
1.4 05/Oct/2014 Paul Scotto Changed plug-in install to use INSTALL
/tmpdump DDBOOST
PLUGIN – ONCE
PER HOST
WI – RECONFIGURE ORACLE TSM DATABASE BACKUPS TO USE DDBOOST

2.0 05/Oct/2014 Paul Scotto Changed to use version INSTALL,

number in DDBoost plugin CONFIGURE
library names ORACLE_HOME

2.0 05/Oct/2014 Paul Scotto Changed to Install v1.1 for INSTALL

Linux
2.0 05/Oct/2014 Paul Scotto Changed to use v1.1 for Linux CONFIGURE
Oracle 10g ORACLE_HOME

2.1 05/Oct/2014 Paul Scotto Added fix for media manager ADDENDUM C –
error in OEM jobs on HP KNOWN ERRORS
UNIX
2.2 07/Nov/2014 Paul Scotto Fixed syntax for links to v1.1 INSTALL
(version was missing) DDBOOST
PLUGIN – ONCE
PER HOST

3.0 14/Jan/2015 Paul Scotto Added Solaris (UNIX) Host Install &
Home Install

3.0 14/Jan/2015 Paul Scotto Added link to backup space PREPARATION

request document
3.1 16/Jan/2015 Paul Scotto Added link requirements for PREPARATION
UNIX to run OEM jobs
3.1 16/Jan/2015 Paul Scotto Added fix for media manager ADDENDUM C –
error in OEM jobs on Solaris KNOWN ERRORS
UNIX
4.0 17/Jul/2015 Paul Scotto Updating for Phase 2 (12c ALL
OEM, number of channels)
4.0 03/Sep/2015 Paul Scotto Added ORA-19511 “Could ADDENDUM C –
not create file” and “CLB KNOWN ERRORS
mount” errors to known issues
4.0 08/Sep/2015 Paul Scotto Added cleanup of temporary INSTALL
installation files. DDBOOST
PLUGIN – ONCE
PER HOST