IBM Tivoli Support Technical Exchange Web Seminar:

Journaling for TSM (Windows)

August 23rd, 2007

IBM Software Services for Tivoli

Agenda:
• Introduction
• Objectives
• Where to Find More Information
• Presentation
• Requirements
• Usage
• Installation
• Configuration
• Cluster Consideration
• Troubleshooting
• Q&A

IBM Software Services for Tivoli 2

Introduction:

This Tivoli Support Technical Exchange web seminar will

cover the installation, configuration, and troubleshooting of
the journal based backup capabilities provided for Windows
based TSM clients.

IBM Software Services for Tivoli 3

Objectives:
Upon completion of this Tivoli Support Technical Exchange
web seminar, you will be able to:

• 1. Determine if journaling is a suitable solution

• 2. Install one or more journaling services on a TSM node
• 3. Configure the TSM journal service appropriately in both
clustered and non-clustered environments
• 4. Troubleshoot common issues that may occur

IBM Software Services for Tivoli 4

IBM Tivoli Support Technical Exchange Web Seminar:
Journaling for TSM (Windows)

August 23rd, 2007

IBM Software Services for Tivoli

 Requirements

IBM Software Services for Tivoli 6

Requirements
• TSM Client 5.4.x • TSM Client 5.3.x
• Windows Vista • Windows 2000
• Windows XP • Windows XP
• Windows 2003 • Windows 2003
• Windows 2003 R2 • Windows 2003 R2

*Note: No journaling support for IA64

5.3.2 or above required for multiple services

IBM Software Services for Tivoli 7

 Usage

IBM Software Services for Tivoli 8

What is Journaling

• Service runs in the background that monitors and

records changes to a file system
• Traditional incremental backups scan and compare all
files on a file system
• Journal based backups only backs up files on the
Journal change log
• Greatly reduces length of backups
for large file systems

IBM Software Services for Tivoli 9

When to Use

• Large file systems with small

to moderate amounts of
activity
• Not intended to be a
complete replacement for
traditional incremental
backups

IBM Software Services for Tivoli 10

 Installation

IBM Software Services for Tivoli 11

Installation Options

• Journaling is enabled by installing the journal based

backup service
• 2 Ways to install
• GUI setup wizard
• Dsmcutil command line

IBM Software Services for Tivoli 12

GUI Setup Wizard

IBM Software Services for Tivoli 13

GUI Setup Wizard (continued)

IBM Software Services for Tivoli 14

GUI Setup Wizard (continued)

IBM Software Services for Tivoli 15

GUI Setup Wizard (continued)

•Creates a separate directory on each file system

using journaling to store journal database
•Example: Using path above to journal C: and D:
•C:\TSM\Journal\tsmC__.jdb.jbbdb
•D:\TSM\Journal\tsmD__.jdb.jbbdb

IBM Software Services for Tivoli 16

GUI Setup Wizard (continued)

• Determines what types of changes to a file are

recorded by the journal service

IBM Software Services for Tivoli 17

GUI Setup Wizard (continued)

IBM Software Services for Tivoli 18

TSM Journal Database
•Journal Database needs to be validated before use
•Full Incremental Backup
•Full Incremental by date Backup

IBM Software Services for Tivoli 19

 TSM Journal Database (continued)
After JBB Backup –
50,000 Entries 0 Entries 25,000 Entries

Journal Initialized 450MB 450MB

450MB
1kB

After JBB Backup –

75,000 Entries 0 Entries 25,000 Entries

After JBB Backup –

0 Entries

675MB 675MB
450MB
675MB

IBM Software Services for Tivoli 20

GUI Setup Wizard (continued)

IBM Software Services for Tivoli 21

GUI Setup Wizard (continued)

IBM Software Services for Tivoli 22

Dsmcutil command line

•Utility used to create and modify TSM services from a

command prompt
•Needed to create multiple journal services
•Refer to DCF 1155524 for instructions

http://www-1.ibm.com/support/docview.wss?uid=swg21155524

IBM Software Services for Tivoli 23

Dsmcutil command line (continued)
•Syntax: dsmcutil install journal
•Options:
•/name:”<journal service name>”
•/jbbconfigfile:”<path and config file>”

IBM Software Services for Tivoli 24

Dsmcutil command line
•Query: dsmcutil query /name:”<journal service name>”

IBM Software Services for Tivoli 25

Dsmcutil command line (continued)

•Update: dsmcutil update

•Options:
•/name:”<journal service name>”
•/jbbconfigfile:”<path and config file>”

IBM Software Services for Tivoli 26

Dsmcutil command line (continued)

•Remove: dsmcutil remove

•Options:
•/name:”<journal service name>”

IBM Software Services for Tivoli 27

 Configuration

IBM Software Services for Tivoli 28

GUI Wizard Update

•Modify settings via GUI wizard

•Options:
•File systems to monitor
•Size of Journal DB
•Service account

IBM Software Services for Tivoli 29

 Configuration File: tsmjbbd.ini

•tsmjbbd.ini
•[JournalSettings]
•[JournalExcludeList]
•[JournaledFileSystemSettings]

•Default location
•C:\Program Files\Tivoli\TSM\baclient\tsmjbbd.ini
•Semi-colon to comment out lines

IBM Software Services for Tivoli 30

 tsmjbbd.ini: [JournalSettings]

•[JournalSettings]
•Nlsrepos
•Nlsrepos=dscameng.txt

•Errorlog
•Errorlog=jbberror.log

•JournalDir
•JournalDir=C:\Program Files\Tivoli\TSM\baclient

•Tracefile, Traceflags, Testflags

IBM Software Services for Tivoli 31

 tsmjbbd.ini: [JournalExcludeList]
•[JournalExcludeList]
•Excludes files from being monitored by the journal
•Different than dsm.opt exclude list
•Uses DOS wildcards and environment variables
•Default values excludes temporary and system files
•Refer to DCF 1141631 for more details
•http://www-1.ibm.com/support/docview.wss?uid=swg21141631

IBM Software Services for Tivoli 32

tsmjbbd.ini: [JournaledFileSystemSettings]
•[JournaledFileSystemSettings]
•JournaledFileSystems=C: D:
•Space delimited list of file systems to journal

•NotifyBufferSize=0x00100000
•Size of the memory buffer receiving file change notifications
(Hexadecimal). Not reccomended above 10MB.

•DirNotifyBufferSize=0x00100000
•Size of the buffer to record directory change (Hexadecimal). Not
recommended above 2MB.

•NotifyFilter=0x00000117
•Specifies what types of change actions generate notifications to
the journal service. (Hexadecimal)
•See DCF 1191643 for configuration details

IBM Software Services for Tivoli 33

tsmjbbd.ini: [JournaledFileSystemSettings]
•[JournaledFileSystemSettings] (Continued)
•PreserveDbOnExit setting=0
•Allows a journal to remain valid when a journaled file system goes
offline (Boolean)
•deferFSMonStart setting=0
•Defers bringing a file system online (Seconds)
•deferRetryInterval setting=60
•Value in seconds that a deferred file systems with the
deferRetryInterval setting enabled are checked for availability
•JournalDbSize=0x00000000
•Maximum size the journal database can grow (Hexadecimal)
•logFSErrors setting=0
•Specifies whether errors encountered while accessing a journaled
file system or journal directory are logged in the jbberror.log and the
event log (Boolean)

IBM Software Services for Tivoli 34

tsmjbbd.ini: [JournaledFileSystemSettings]
•[JournaledFileSystemSettings.X:\]
•Specifies different settings for each file system
•Any of the options under [JournaledFileSystemSettings]
can be used

IBM Software Services for Tivoli 35

Cluster Considerations

IBM Software Services for Tivoli 36

Cluster Considerations
• In the following example, the Journal service is installed
in a Cluster system; notice the similarity with the
Scheduler service installation in the same Cluster:

• Journal Service
• dsmcutil install journal /name:"TSM Journal service: group-a"
/clientdir:"c:\Program Files\tivoli\tsm\baclient"
/jbbconfigfile:q:\tsm\tsmjbbd.ini /optfile:q:\tsm\dsm.opt /node:mscs-cluster-
group-a /autostart:yes /startnow:yes
• Scheduler Service
dsmcutil install SCHEDuler /name:"TSM Scheduler service"
/clientdir:"c:\Program Files\tivoli\tsm\baclient" /optfile:q:\tsm\dsm.opt
/node:mscs-cluster-group-a /password:nodepassword /validate:yes
/autostart:no /startnow:no /clusternode:yes /clustername:mscs-cluster

IBM Software Services for Tivoli 37

Cluster Considerations (continued)

• The DSMCUTIL program should be used to install

multiple JBB services on the same machine (this is valid
only for TSM v5.3.2 and above). Currently, the GUI does
not have that feature.

• Each file system or clustered group is backed up to a

specific node, each fs uses a specific dsm.opt file.

Note: Journaling the same file system with multiple journal

services may produce unpredictable results, each journal
service should be configured to journal different file
systems.

IBM Software Services for Tivoli 38

Cluster Considerations (continued)
• In the following slides, we are assuming that the option
files for the local disks and clustered disks (shared
resources) already exist:

C:\Program Files\Tivoli\TSM\Baclient\dsm.opt (nodeC)

M:\TSM\dsmCG1.opt (nodeCG1)
T:\TSM\dsmCG2.opt (nodeCG2)

• Install the first Journal service to journal the local disks.

Use the GUI and the dsm.opt file locate in the default
Baclient directory.
• The default JournalPipe value will be used with that file:
JournalPipe \\.\pipe\jnlServer1

IBM Software Services for Tivoli 39

Cluster Considerations (continued)
• Add the appropriate JournalPipe option to the options files:

JournalPipe \\.\pipe\jnlServiceCG1
(in the M:\TSM\dsmM.opt file where M: is a disk owned by Cluster Group 1)

JournalPipe \\.\pipe\jnlServiceCG2
(in the T:\TSM\dsmT.opt file where T: is a disk owned by Cluster Group 2)

• Create and setup a seperate tsmjbbd.ini for each Cluster Group,

example:

• M:\TSM\tsmjbbdCG1.ini
• T:\TSM\tsmjbbdCG2.ini

IBM Software Services for Tivoli 40

Cluster Considerations (continued)

• Edit the .ini files to add the JournalPipe to the

[JournalSettings] stanza:

JournalPipe=\\.\pipe\jnlServiceCG1
(in the M:\TSM\tsmjbbdCG1.ini)

JournalPipe=\\.\pipe\jnlServiceCG2
(in the T:\TSM\tsmjbbdCG2.ini)

IBM Software Services for Tivoli 41

Cluster Considerations (continued)
• Adjust the tsmjbbd.ini definitions on each file (journaled
file system, notify buffer size, notify filter, etc.). Locate the
journal data bases on the shared resources (e.g. M:\TSM,
T:\TSM directories).

• Install the second journal service:

dsmcutil install journal /name:"TSM Journal Service CG1“

/optfile:M:\TSM\dsmCG1.opt /node:nodeCG1 /autostart:yes /startnow:yes
/jbbconfigfile:M:\TSM\tsmjbbdCG1.ini

• Install the third journal service:

dsmcutil install journal /name:"TSM Journal Service CG2“

/optfile:T:\TSM\dsmCG2.opt /node:nodeCG2 /autostart:yes /startnow:yes
/jbbconfigfile:T:\TSM\tsmjbbdCG2.ini

IBM Software Services for Tivoli 42

Cluster Considerations (continued)

• Once the TSM Journal has been configured on the first

cluster node, the Cluster Groups will need to be moved
over to the next owner and repeat the previous
configuration steps

• Repeat for all other cluster nodes in the cluster

IBM Software Services for Tivoli 43

 Cluster Considerations (continued)
• Finally, each journal service needs to be added as a Resource of
type Generic for it’s respective cluster group in Cluster
Administrator”

• After clicking Next, select update the “Possible Owners” as necessary

then Next
• Use a drive in the group as a dependency, click on Next

IBM Software Services for Tivoli 44

Cluster Considerations (continued)
• Then enter the service name as it was entered when
creating the service with dsmcutil.
• Then click on Next followed by finish.

IBM Software Services for Tivoli 45

Troubleshooting

IBM Software Services for Tivoli 46

Troubleshooting - Tools to support JBB
• Avaliable at:
• 5.3.x
• ftp://ftp.software.ibm.com//storage/tivoli-storage-management/patches/client/v5r3/Windows/unsupp
• 5.4.x
• ftp://ftp.software.ibm.com//storage/tivoli-storage-management/patches/client/v5r4/Windows/unsupp
• Display Disk Volume Characteristics
• Volinfo.exe
• Notification Filter tool
• Qfilter.exe
• Journal Database Viewer
• DBviewB.exe
• File System Monitor
• Filemon.exe

IBM Software Services for Tivoli 47

Troubleshooting – Volinfo.exe

• Volinfo.exe
• Displays information about a specified drive/disk volume

IBM Software Services for Tivoli 48

Troubleshooting – qfilter.exe

• qfilter.exe
• Display notification filter information in a readable manner.

IBM Software Services for Tivoli 49

Troubleshooting – qfilter.exe (continued)
• Using qfilter.exe to create a filter value

• Using qfilter.exe to decode a value

IBM Software Services for Tivoli 50

Troubleshooting – filemon.exe

• filemon.exe
• Displays information about a specified drive/disk volume
• Options
• -buffer=nnn
• Notification Buffer Size in Bytes
• -filter=0xnnn
• Notification Filter Value
• -quiet
• Suppress Change Notification Output
• Example:
• Filemon –buffer=0x100000 –filter=0x15b –quiet C: D:

IBM Software Services for Tivoli 51

Troubleshooting – filemon.exe (continued)
• filemon –buffer=0x100000 –filter=0x15b –quiet c:

IBM Software Services for Tivoli 52

Troubleshooting – filemon.exe (continued)
• Press ‘s’ to view statistics

IBM Software Services for Tivoli 53

Troubleshooting – dbviewb.exe
• dbviewb.exe
• Display information about a specified journal database, list,
find, or delete journal date base entries.
• Usage
• Dbviewb C:\TSM\JBB\tsmc__.jdb

IBM Software Services for Tivoli 54

Troubleshooting – Is Journaling Running?

• Check Services

• Task Manager

• Verify DB is valid with dbviewb.exe

• Check dsmsched.log
• Querying Journal for '\\sacfps003x\g$'

IBM Software Services for Tivoli 55

Troubleshooting – Buffer Overflow

• Errors on jbberror.log

• Increase size of notify buffers if needed

• Review Notifyfilter

• Use filemon.exe to determine amount of drive activity

IBM Software Services for Tivoli 56

Troubleshooting – DB Size

• If JournalDbSize option is set:

handleExceedUserLimit(): Restarting the journal db in the invalid state.
Joural Size Exceeded Error for fs 'D:', size exceeds maximum of 16
Journal Size Exceeded Error for fs 'D:', size exceeds maximum of 0x00000010

• When journal size is unlimited:

• Errors not necessary indicative of journal db size
• Problems usually seen above 2GB
• Monitor size of DB between backups
• Filemon.exe and dbviewb.exe can be used to monitor

IBM Software Services for Tivoli 57

Troubleshooting – Communication Error

• ANS1575E Jouranl Daemon Communications Error

• Usually caused by timeout from client

• Use testflag to Increase timeout in dsm.opt

• testflag jnlinbnptimeout:1800
• Value in seconds

IBM Software Services for Tivoli 58

JBB and Norton Antivirus
• The following DWORD registry value should be set:
• HKLM\Software\Intel\LANDesk\VirusProtect6\CurrentVersion
• NoFileMod = 1

IBM Software Services for Tivoli 59

References
• Windows Backup-Archive Clients Installation and User’s
Guide v5.3
• IBM Tivoli Storage Manager Version 5.3 Technical Guide
(redbook).
• Technotes:
• 1155524 - TSM Journal Based Backup FAQ.
• 1213920 - Journal-based backup - estimating the size of the journal
database
• IC48119: TSM 5.3.2 Client Supports Multiple Journal Service Instances
On One System
• 1167834 - What steps are needed to setup the TSM Journaling Service in
a MSCS environment?
• There are several others and new ones get added when necessary. You
can consult the TSM Support page and search for “TSM and Journal”.

IBM Software Services for Tivoli 60

Q&A:

IBM Software Services for Tivoli 61