IBM Tivoli Support Technical Exchange Web Seminar: Journaling for TSM (Windows

)
August 23rd, 2007
IBM Software Services for Tivoli

Agenda:
• Introduction • Objectives • Where to Find More Information • Presentation
• • • • • •

Requirements Usage Installation Configuration Cluster Consideration Troubleshooting

• Q&A

IBM Software Services for Tivoli

2

Introduction:
This Tivoli Support Technical Exchange web seminar will cover the installation, configuration, and troubleshooting of the journal based backup capabilities provided for Windows based TSM clients.

IBM Software Services for Tivoli

3

Objectives:
Upon completion of this Tivoli Support Technical Exchange web seminar, you will be able to: • 1. Determine if journaling is a suitable solution • 2. Install one or more journaling services on a TSM node • 3. Configure the TSM journal service appropriately in both clustered and non-clustered environments • 4. Troubleshoot common issues that may occur

IBM Software Services for Tivoli

4

IBM Tivoli Support Technical Exchange Web Seminar: Journaling for TSM (Windows)
August 23rd, 2007
IBM Software Services for Tivoli

Requirements

IBM Software Services for Tivoli

6

Requirements
• TSM Client 5.4.x
• Windows

• TSM Client 5.3.x
• Windows

Vista • Windows XP • Windows 2003 • Windows 2003 R2

2000 • Windows XP • Windows 2003 • Windows 2003 R2

*Note: No journaling support for IA64 5.3.2 or above required for multiple services

IBM Software Services for Tivoli

7

Usage

IBM Software Services for Tivoli

8

What is Journaling
• Service runs in the background that monitors and records changes to a file system • Traditional incremental backups scan and compare all files on a file system • Journal based backups only backs up files on the Journal change log • Greatly reduces length of backups for large file systems

IBM Software Services for Tivoli

9

When to Use
• Large file systems with small to moderate amounts of activity • Not intended to be a complete replacement for traditional incremental backups

IBM Software Services for Tivoli

10

Installation

IBM Software Services for Tivoli

11

Installation Options
• Journaling is enabled by installing the journal based backup service • 2 Ways to install
• GUI

setup wizard command line

• Dsmcutil

IBM Software Services for Tivoli

12

GUI Setup Wizard

IBM Software Services for Tivoli

13

GUI Setup Wizard (continued)

IBM Software Services for Tivoli

14

GUI Setup Wizard (continued)

IBM Software Services for Tivoli

15

GUI Setup Wizard (continued)

•Creates a separate directory on each file system using journaling to store journal database •Example: Using path above to journal C: and D: •C:\TSM\Journal\tsmC__.jdb.jbbdb •D:\TSM\Journal\tsmD__.jdb.jbbdb

IBM Software Services for Tivoli

16

GUI Setup Wizard (continued)

Determines what types of changes to a file are recorded by the journal service
IBM Software Services for Tivoli 17

GUI Setup Wizard (continued)

IBM Software Services for Tivoli

18

TSM Journal Database
•Journal Database needs to be validated before use •Full Incremental Backup •Full Incremental by date Backup

IBM Software Services for Tivoli

19

TSM Journal Database (continued)
50,000 Entries After JBB Backup – 0 Entries 25,000 Entries

Journal Initialized 1kB

450MB

450MB 450MB

75,000 Entries After JBB Backup – 0 Entries

After JBB Backup – 0 Entries

25,000 Entries

675MB 450MB

675MB 675MB

IBM Software Services for Tivoli

20

GUI Setup Wizard (continued)

IBM Software Services for Tivoli

21

GUI Setup Wizard (continued)

IBM Software Services for Tivoli

22

Dsmcutil command line

•Utility used to create and modify TSM services from a command prompt •Needed to create multiple journal services •Refer to DCF 1155524 for instructions
http://www-1.ibm.com/support/docview.wss?uid=swg21155524

IBM Software Services for Tivoli

23

Dsmcutil command line (continued)
•Syntax: dsmcutil install journal •Options: •/name:”<journal service name>” •/jbbconfigfile:”<path and config file>”

IBM Software Services for Tivoli

24

Dsmcutil command line
•Query: dsmcutil query /name:”<journal service name>”

IBM Software Services for Tivoli

25

Dsmcutil command line (continued)

•Update: dsmcutil update •Options: •/name:”<journal service name>” •/jbbconfigfile:”<path and config file>”

IBM Software Services for Tivoli

26

Dsmcutil command line (continued)

•Remove: dsmcutil remove •Options: •/name:”<journal service name>”

IBM Software Services for Tivoli

27

Configuration

IBM Software Services for Tivoli

28

GUI Wizard Update

•Modify settings via GUI wizard •Options: •File systems to monitor •Size of Journal DB •Service account

IBM Software Services for Tivoli

29

Configuration File: tsmjbbd.ini
•tsmjbbd.ini •[JournalSettings] •[JournalExcludeList] •[JournaledFileSystemSettings] •Default location •C:\Program Files\Tivoli\TSM\baclient\tsmjbbd.ini •Semi-colon to comment out lines

IBM Software Services for Tivoli

30

tsmjbbd.ini: [JournalSettings]
•[JournalSettings] •Nlsrepos
•Nlsrepos=dscameng.txt

•Errorlog
•Errorlog=jbberror.log

•JournalDir
•JournalDir=C:\Program Files\Tivoli\TSM\baclient

•Tracefile, Traceflags, Testflags

IBM Software Services for Tivoli

31

tsmjbbd.ini: [JournalExcludeList]
•[JournalExcludeList] •Excludes files from being monitored by the journal •Different than dsm.opt exclude list •Uses DOS wildcards and environment variables •Default values excludes temporary and system files •Refer to DCF 1141631 for more details
•http://www-1.ibm.com/support/docview.wss?uid=swg21141631

IBM Software Services for Tivoli

32

tsmjbbd.ini: [JournaledFileSystemSettings]
•[JournaledFileSystemSettings] •JournaledFileSystems=C: D:
•Space delimited list of file systems to journal

•NotifyBufferSize=0x00100000
•Size of the memory buffer receiving file change notifications (Hexadecimal). Not reccomended above 10MB.

•DirNotifyBufferSize=0x00100000
•Size of the buffer to record directory change (Hexadecimal). Not recommended above 2MB.

•NotifyFilter=0x00000117
•Specifies what types of change actions generate notifications to the journal service. (Hexadecimal) •See DCF 1191643 for configuration details
IBM Software Services for Tivoli 33

tsmjbbd.ini: [JournaledFileSystemSettings]
•[JournaledFileSystemSettings] (Continued) •PreserveDbOnExit setting=0
•Allows a journal to remain valid when a journaled file system goes offline (Boolean)

•deferFSMonStart setting=0
•Defers bringing a file system online (Seconds)

•deferRetryInterval setting=60
•Value in seconds that a deferred file systems with the deferRetryInterval setting enabled are checked for availability

•JournalDbSize=0x00000000
•Maximum size the journal database can grow (Hexadecimal)

•logFSErrors setting=0
•Specifies whether errors encountered while accessing a journaled file system or journal directory are logged in the jbberror.log and the event log (Boolean)

IBM Software Services for Tivoli

34

tsmjbbd.ini: [JournaledFileSystemSettings]
•[JournaledFileSystemSettings.X:\] •Specifies different settings for each file system •Any of the options under [JournaledFileSystemSettings] can be used

IBM Software Services for Tivoli

35

Cluster Considerations

IBM Software Services for Tivoli

36

Cluster Considerations
• In the following example, the Journal service is installed in a Cluster system; notice the similarity with the Scheduler service installation in the same Cluster: • Journal Service

dsmcutil install journal /name:"TSM Journal service: group-a" /clientdir:"c:\Program Files\tivoli\tsm\baclient" /jbbconfigfile:q:\tsm\tsmjbbd.ini /optfile:q:\tsm\dsm.opt /node:mscs-clustergroup-a /autostart:yes /startnow:yes dsmcutil install SCHEDuler /name:"TSM Scheduler service" /clientdir:"c:\Program Files\tivoli\tsm\baclient" /optfile:q:\tsm\dsm.opt /node:mscs-cluster-group-a /password:nodepassword /validate:yes /autostart:no /startnow:no /clusternode:yes /clustername:mscs-cluster

• Scheduler Service

IBM Software Services for Tivoli

37

Cluster Considerations (continued)
• The DSMCUTIL program should be used to install multiple JBB services on the same machine (this is valid only for TSM v5.3.2 and above). Currently, the GUI does not have that feature. • Each file system or clustered group is backed up to a specific node, each fs uses a specific dsm.opt file. Note: Journaling the same file system with multiple journal services may produce unpredictable results, each journal service should be configured to journal different file systems.

IBM Software Services for Tivoli

38

Cluster Considerations (continued)
• In the following slides, we are assuming that the option files for the local disks and clustered disks (shared resources) already exist:
C:\Program Files\Tivoli\TSM\Baclient\dsm.opt M:\TSM\dsmCG1.opt T:\TSM\dsmCG2.opt (nodeC) (nodeCG1) (nodeCG2)

• Install the first Journal service to journal the local disks. Use the GUI and the dsm.opt file locate in the default Baclient directory. • The default JournalPipe value will be used with that file:
JournalPipe \\.\pipe\jnlServer1

IBM Software Services for Tivoli

39

Cluster Considerations (continued)
• Add the appropriate JournalPipe option to the options files:
JournalPipe \\.\pipe\jnlServiceCG1 (in the M:\TSM\dsmM.opt file where M: is a disk owned by Cluster Group 1) JournalPipe \\.\pipe\jnlServiceCG2 (in the T:\TSM\dsmT.opt file where T: is a disk owned by Cluster Group 2)

• Create and setup a seperate tsmjbbd.ini for each Cluster Group, example:
• •

M:\TSM\tsmjbbdCG1.ini T:\TSM\tsmjbbdCG2.ini

IBM Software Services for Tivoli

40

Cluster Considerations (continued)
• Edit the .ini files to add the JournalPipe to the [JournalSettings] stanza:
JournalPipe=\\.\pipe\jnlServiceCG1 (in the M:\TSM\tsmjbbdCG1.ini) JournalPipe=\\.\pipe\jnlServiceCG2 (in the T:\TSM\tsmjbbdCG2.ini)

IBM Software Services for Tivoli

41

Cluster Considerations (continued)
• Adjust the tsmjbbd.ini definitions on each file (journaled file system, notify buffer size, notify filter, etc.). Locate the journal data bases on the shared resources (e.g. M:\TSM, T:\TSM directories). • Install the second journal service:
dsmcutil install journal /name:"TSM Journal Service CG1“ /optfile:M:\TSM\dsmCG1.opt /node:nodeCG1 /autostart:yes /startnow:yes /jbbconfigfile:M:\TSM\tsmjbbdCG1.ini

• Install the third journal service:
dsmcutil install journal /name:"TSM Journal Service CG2“ /optfile:T:\TSM\dsmCG2.opt /node:nodeCG2 /autostart:yes /startnow:yes /jbbconfigfile:T:\TSM\tsmjbbdCG2.ini

IBM Software Services for Tivoli

42

Cluster Considerations (continued)
• Once the TSM Journal has been configured on the first cluster node, the Cluster Groups will need to be moved over to the next owner and repeat the previous configuration steps

• Repeat for all other cluster nodes in the cluster

IBM Software Services for Tivoli

43

Cluster Considerations (continued)
• Finally, each journal service needs to be added as a Resource of type Generic for it’s respective cluster group in Cluster Administrator”

• •

After clicking Next, select update the “Possible Owners” as necessary then Next Use a drive in the group as a dependency, click on Next

IBM Software Services for Tivoli

44

Cluster Considerations (continued)
• Then enter the service name as it was entered when creating the service with dsmcutil. • Then click on Next followed by finish.

IBM Software Services for Tivoli

45

Troubleshooting

IBM Software Services for Tivoli

46

Troubleshooting - Tools to support JBB
• Avaliable at:
• 5.3.x • 5.4.x

• ftp://ftp.software.ibm.com//storage/tivoli-storage-management/patches/client/v5r3/Windows/unsupp

• ftp://ftp.software.ibm.com//storage/tivoli-storage-management/patches/client/v5r4/Windows/unsupp

• Display Disk Volume Characteristics
• Volinfo.exe

• Notification Filter tool
• Qfilter.exe

• Journal Database Viewer
• DBviewB.exe

• File System Monitor
• Filemon.exe

IBM Software Services for Tivoli

47

Troubleshooting – Volinfo.exe
• Volinfo.exe • Displays information about a specified drive/disk volume

IBM Software Services for Tivoli

48

Troubleshooting – qfilter.exe
• qfilter.exe • Display notification filter information in a readable manner.

IBM Software Services for Tivoli

49

Troubleshooting – qfilter.exe (continued)
• Using qfilter.exe to create a filter value

• Using qfilter.exe to decode a value

IBM Software Services for Tivoli

50

Troubleshooting – filemon.exe
• filemon.exe
• Displays • Options

information about a specified drive/disk volume

• -buffer=nnn • Notification Buffer Size in Bytes • -filter=0xnnn • Notification Filter Value • -quiet • Suppress Change Notification Output
• Example:

• Filemon –buffer=0x100000 –filter=0x15b –quiet C: D:

IBM Software Services for Tivoli

51

Troubleshooting – filemon.exe (continued)
• filemon –buffer=0x100000 –filter=0x15b –quiet c:

IBM Software Services for Tivoli

52

Troubleshooting – filemon.exe (continued)
• Press ‘s’ to view statistics

IBM Software Services for Tivoli

53

Troubleshooting – dbviewb.exe
• dbviewb.exe
• Display

information about a specified journal database, list, find, or delete journal date base entries. • Usage • Dbviewb C:\TSM\JBB\tsmc__.jdb

IBM Software Services for Tivoli

54

Troubleshooting – Is Journaling Running?
• Check Services • Task Manager • Verify DB is valid with dbviewb.exe • Check dsmsched.log
• Querying

Journal for '\\sacfps003x\g$'

IBM Software Services for Tivoli

55

Troubleshooting – Buffer Overflow
• Errors on jbberror.log

• Increase size of notify buffers if needed • Review Notifyfilter • Use filemon.exe to determine amount of drive activity

IBM Software Services for Tivoli

56

Troubleshooting – DB Size
• If JournalDbSize option is set:
handleExceedUserLimit(): Restarting the journal db in the invalid state. Joural Size Exceeded Error for fs 'D:', size exceeds maximum of 16 Journal Size Exceeded Error for fs 'D:', size exceeds maximum of 0x00000010

• When journal size is unlimited:
• Errors

not necessary indicative of journal db size usually seen above 2GB

• Problems

• Monitor size of DB between backups • Filemon.exe and dbviewb.exe can be used to monitor

IBM Software Services for Tivoli

57

Troubleshooting – Communication Error
• ANS1575E Jouranl Daemon Communications Error

• Usually caused by timeout from client • Use testflag to Increase timeout in dsm.opt
• testflag • Value

jnlinbnptimeout:1800

in seconds

IBM Software Services for Tivoli

58

JBB and Norton Antivirus
• The following DWORD registry value should be set:
HKLM\Software\Intel\LANDesk\VirusProtect6\CurrentVersion • NoFileMod = 1

IBM Software Services for Tivoli

59

References
• Windows Backup-Archive Clients Installation and User’s Guide v5.3 • IBM Tivoli Storage Manager Version 5.3 Technical Guide (redbook). • Technotes:
• • • • •

1155524 - TSM Journal Based Backup FAQ. 1213920 - Journal-based backup - estimating the size of the journal database IC48119: TSM 5.3.2 Client Supports Multiple Journal Service Instances On One System 1167834 - What steps are needed to setup the TSM Journaling Service in a MSCS environment? There are several others and new ones get added when necessary. You can consult the TSM Support page and search for “TSM and Journal”.

IBM Software Services for Tivoli

60

Q&A:

IBM Software Services for Tivoli

61