You are on page 1of 26

EMC Avamar Installation and Configuration

Lab Guide

Lab Exercise 4-1: Node Replacement
Purpose:

Objectives:

In this lab, you will incorporate a ‘Spare’ storage node as an
active member of the Avamar server to replace a node that
‘failed’.

In this lab you will
‰
‰
‰
‰

References:

‘Fail’ a node
Perform data recovery
Decommission the failed node
Add a replacement data node

EMC Avamar Installation and Configuration Student Guide

DISCLAIMER: The node replacement
procedures in this lab are provisional and
should not be used at a customer site.

Copyright © 2010 EMC Corporation. All Rights Reserved.

Version E

Page 1 of 26

EMC Avamar Installation and Configuration

Lab Guide

Desired Architecture
Simulate storage4 failure.
Add storage5 as a replacement node.
Avamar Utility
Node

Avamar Data
Node

Avamar Data
Node

Avamar Data
Node

Avamar Data
Node

Avamar Data
Node
(Spare)

utilitynode

storage0

storage1

storage2

storage3

storage4

192.168.100.2

192.168.100.3

192.168.100.4

192.168.100.5

192.168.100.6

192.168.100.7

Avamar 1X4 Server Configuration

Copyright © 2010 EMC Corporation. All Rights Reserved.

Version E

Page 2 of 26

Copyright © 2010 EMC Corporation. All Rights Reserved. Version E Page 3 of 26 . Login as user root with password: changeme.EMC Avamar Installation and Configuration Lab Guide Lab Exercise 4-1 Part 1: Fail a node Step Action 1 Open a PuTTY session to your utility node by clicking the PuTTY icon.

EMC Avamar Installation and Configuration Step 2 Type: nodenumbers Make note of the output 3 Lab Guide Action Start anAvamar Administrator in Windows. All Rights Reserved. click Log On. Accept any JRE warnings. Enter the following information: User Name: MCUser Password: MCUser1 Domain Name: / Administrator Server: utilitynode Then. Version E Page 4 of 26 . click the Avamar Administrator shortcut on the desktop or from the Windows Start menu. Copyright © 2010 EMC Corporation.

EMC Avamar Installation and Configuration Step 4 Click on Server. 7 Kill the storage node’s gsan process in order to cause the node to fail. Version E Page 5 of 26 . Lab Guide Action Observe that all nodes are online. 5 Close all Avamar Administrator windows 6 Open a PuTTY session to storage3. Copyright © 2010 EMC Corporation. Type: killall gsan 8 Close the PuTTY session to the storage node. All Rights Reserved. Accept any warnings and login as user root password: changeme.

EMC Avamar Installation and Configuration Lab Guide Step Action 9 To start Avamar Administrator in Windows. Accept any JRE warnings. Copyright © 2010 EMC Corporation. Version E Page 6 of 26 . click Log On. please be patient. click the Avamar Administrator shortcut on the desktop or from the Windows Start menu. All Rights Reserved. Enter the following information: User Name: MCUser Password: MCUser1 Domain Name: / Administrator Server: utilitynode Then. Note: It may take several minutes for the log on.

All Rights Reserved. Copyright © 2010 EMC Corporation. Study the information in the Event Detail window. Then. Click OK on the Avamar Alert popup to close the window. Version E Page 7 of 26 . Click View Details.EMC Avamar Installation and Configuration Lab Guide Step Action 10 You will see an Avamar Alert popup that informs you that a node has gone offline. click Close.

Copyright © 2010 EMC Corporation. End of Lab 4-1 Part 1. click Server. Note that Node 0. Close the Avamar Administrator menu.3 is red (offline). Version E Page 8 of 26 . The following screen appears. Close the Avamar Administrator Server window.EMC Avamar Installation and Configuration Lab Guide Step Action 11 From the Avamar Administrator menu. All Rights Reserved.

open Windows Explorer and navigate to C:\WINDOWS\Fonts.TTF file. All Rights Reserved. Delete the ariblk. Copyright © 2010 EMC Corporation.EMC Avamar Installation and Configuration Lab Guide Lab Exercise 4-1 Part 2: Perform Recovery When Avamar Server is Running in Degraded Mode Step Action 1 On your client machine. Version E Page 9 of 26 .

All Rights Reserved. Click Backup & Restore. Copyright © 2010 EMC Corporation.EMC Avamar Installation and Configuration Lab Guide Step Action 2 Launch Avamar Administrator. Version E Page 10 of 26 .

ttf file. All Rights Reserved.EMC Avamar Installation and Configuration Lab Guide Step Action 3 Expand the tree in the left pane and select your client. Version E Page 11 of 26 . Copyright © 2010 EMC Corporation. Browse through your backup and select the C:\WINDOWS\Fonts\ariblk. Click the Select for Restore tab in the right pane.

Click OK to confirm. Copyright © 2010 EMC Corporation.EMC Avamar Installation and Configuration Lab Guide Step Action 4 Select Actions > Restore Now from the menu bar. All Rights Reserved. click OK to begin the restore. Version E Page 12 of 26 . Then.

EMC Avamar Installation and Configuration Lab Guide Step Action 5 Monitor the progress of the restore by clicking Navigation > Activity. End of Lab 4-1 Part 2.ttf file was restored by checking the contents of the C:\WINDOWS\Fonts folder on your client. All Rights Reserved. Verify that the restore completes successfully. Copyright © 2010 EMC Corporation. Version E Page 13 of 26 . 6 Verify that the ariblk.

Version E Page 14 of 26 .EMC Avamar Installation and Configuration Lab Guide Lab Exercise 4-1 Part 3: Perform Node Replacement Step Action 1 Open a PuTTY session to your utility node and login as user root password changeme. Type: nodenumbers and study the output. Copyright © 2010 EMC Corporation. All Rights Reserved.

ssh/admin_key passphrase: P3t3rPan Suspend all Avamar client activities.EMC Avamar Installation and Configuration Lab Guide Step Action 2 In Avamar Administrator. Ensure that a checkpoint that is acceptable as a suitable rollback point (if required) exists and has been validated (hfs checked). 3 Back in the PuTTy session for the utilitynode. Version E Page 15 of 26 . change users to admin.admin Load the admin SSH keys. All Rights Reserved. Type: su . and click the Checkpoint Management tab. select Navigation Æ Server. Type: avmaint suspend Suspend all maintenance jobs. Type: avmaint sched suspend --avamaronly Copyright © 2010 EMC Corporation. Type: ssh-agent bash ssh-add ~/.

7 --replace --node=0. All Rights Reserved. Verify that the info on node 0.168. Version E Page 16 of 26 .spare.3 in the probe.0 Replace the failed node with a storage node using the same information as the spare node: nodedb add node --addr=192.EMC Avamar Installation and Configuration Lab Guide Step Action 4 Type the following to display information about the spare node: nodedb print --nodes=0.3 --type=storage Copyright © 2010 EMC Corporation.spare.100.3 Remove the entry for the spare node: nodedb delete node --node=0.xml file matches the node that has failed: nodedb print --nodes=0.0 5 Update the /usr/local/avamar/var/probe.xml file using the nodedb command as shown below.

EMC Avamar Installation and Configuration Lab Guide Step Action 6 Verify that the probe. Version E Page 17 of 26 . Copyright © 2010 EMC Corporation.xml file contains information reflecting the replaced node: nodedb print 7 Exit out of the admin user shell (twice). All Rights Reserved.

EMC Avamar Installation and Configuration Step 8 Change users to user dpn.ssh/dpnid export SYSPROBEUSER=root 9 To synchronize time on the new storage node. Version E Page 18 of 26 . type: ssh-agent bash ssh-add ~/. type: asktime Enter y to use the timeservers specified. All Rights Reserved. Type: Lab Guide Action su .dpn Load the dpn SSH keys. Copyright © 2010 EMC Corporation.

All Rights Reserved. 12 Enter y to configure the default set of nodes. Copyright © 2010 EMC Corporation.EMC Avamar Installation and Configuration Lab Guide Step Action 10 Enter n to the question Do you have a dedicated Avamar Subnet? 11 Enter y to use the previously specified time zone. Version E Page 19 of 26 .

EMC Avamar Installation and Configuration Lab Guide Step Action 13 Enter y to proceed with the installation. Copyright © 2010 EMC Corporation. Version E Page 20 of 26 . All Rights Reserved. 14 Check the time displayed and confirm by entering y.

enter y to see the results.EMC Avamar Installation and Configuration Lab Guide Step Action 15 Enter y to watch for time synchronization. After completion. 16 This next step takes about 10 minutes. Version E Page 21 of 26 . All Rights Reserved. Copyright © 2010 EMC Corporation.

NOTES: * Time on this host is: Thu Mar 18 14:41:46 EDT 2010 18 Exit out of the dpn user shell (twice).s) ssh -x root@192.489 +10.168.000 4000.000 0.7 '/usr/sbin/ntpq -pn 2>&1' remote refid st t when poll reach delay offset jitter ============================================================================== *10.168.053 36. 16 u 16 64 0 0.1 6 u 13 64 377 99.1) ssh -x root@192.168.xml (0.2 10.100. Version E Page 22 of 26 .536 41.168.000 0.100.7 '/bin/date' Thu Mar 18 14:41:46 EDT 2010 Thu Mar 18 18:41:46 UTC 2010 Thu Mar 18 18:41:46 UTC 2010 Thu Mar 18 18:41:46 UTC 2010 Thu Mar 18 18:41:46 UTC 2010 -------------------------------------------------------Done.1 10.201 5 u 22 64 377 99.168.0) ssh -x root@192.2 .000 4000.884 30.00 192.100.3) ssh -x root@192.127.175.100.3) ssh -x root@192.168.100.5 '/bin/date' (0. All Rights Reserved.3 . Copyright © 2010 EMC Corporation.00 Using /usr/local/avamar/var/probe.4 '/bin/date' (0.100.499 192.100.127.INIT.3 '/bin/date' (0.175.964 21.168.168.127.210.2 '/bin/date' (0.INIT.127.2) ssh -x root@192. 16 u 16 64 0 0.175.EMC Avamar Installation and Configuration Step 17 Results: Lab Guide Action (0.100.

admin ssh-agent bash ssh-add ~/. Type: rebuild.3 Copyright © 2010 EMC Corporation.3 --clean --tag=0.node command. Rebuild the new node using the rebuild. All Rights Reserved.node --nodes=0.EMC Avamar Installation and Configuration Lab Guide Step Action 19 Change user to admin and load the admin SSH keys. Version E Page 23 of 26 . Type: su .ssh/admin_key passphrase: P3t3rPan 20 Note: This task must be performed as the admin user.

Monitor the status of the new node by typing: status. All Rights Reserved. Version E Page 24 of 26 . Copyright © 2010 EMC Corporation.dpn <Number of seconds to refresh> Ensure that the new node comes online.EMC Avamar Installation and Configuration Lab Guide Step Action 21 Launch a new PuTTY session to your utility node and login as user root password changeme.

Version E Page 25 of 26 .EMC Avamar Installation and Configuration Lab Guide Step Action 22 Go back to the SSH session running as the admin user and type: nodenumbers 23 In the PuTTY session to your utility node (host 1) logged on as root. All Rights Reserved. monitor the status of your nodes by typing: status.dpn Copyright © 2010 EMC Corporation.

26 View the Server Monitor in Avamar Administrator to see that the new node is online. End of Lab 4-1 Part 3 End of Lab 4-1.EMC Avamar Installation and Configuration Lab Guide Step Action 24 Restart server operations and scheduled cron jobs. All Rights Reserved. Version E Page 26 of 26 . type: avmaint resume avmaint sched resume --avamaronly 25 Exit all PuTTY sessions. Copyright © 2010 EMC Corporation. In the PuTTY session running as the admin user.