VMmark Bench Marking Guide 2.1-20110310 | V Mware | Virtual Machine

VMware VMmark® Benchmarking Guide

VMmark 2.1 Revised March 10, 2011

EN-000006-03

VMware VMmark® Benchmarking Guide

You can find the most up-to-date technical documentation on the VMware Web site at: http://www.vmware.com/support/ The VMware Web site also provides the latest product updates. If you have comments about this documentation, submit your feedback to: docfeedback@vmware.com

Copyright © 2007-2011 VMware, Inc. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. VMware products are covered by one or more patents listed at http://www.vmware.com/go/patents. VMware is a registered trademark or trademark of VMware, Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies. Revision: 20110310

VMware, Inc. 3401 Hillview Ave. Palo Alto, CA 94304 www.vmware.com

2

VMware, Inc.

Contents

Overview

13

Why Virtualization? 13 Why a Multi-Host Virtual Machine Benchmark? 13 Intended Audience 14 Legal Notice 14

Preparation Checklists and Worksheets
Infrastructure Preparation 15 Virtual Machine Preparation 15 Standby Virtual Machine 15 Mail Server Virtual Machine 15 Olio Database Virtual Machine 16 Olio Web Virtual Machine 16 DVD Store 2 Database Virtual Machine DVD Store 2 Web Virtual Machine 16 Deploy Template Virtual Machine 16

15

16

What is the VMmark Benchmark? 19
Overview of VMmark 2.1 Benchmark 19 VMmark Benchmark Workloads 21 Mail Server Virtual Machine 21 Standby Virtual Machine 22 Web 2.0 Simulation 22 E-Commerce Simulation 22 Virtual Machine Cloning and Deployment 23 Dynamic Virtual Machine Relocation 23 Dynamic Storage Relocation 24 Automated Load Balancing 24 VMmark Client Systems 25 VMmark Harness 26 Contents of VMmark Kit 27 VMmark 2.1 Benchmark Scoring Methodology 28 Example One: Single-Tile Benchmark Scoring 29 Example Two: Multiple-Tile Benchmark Scoring 30 Reference Scores 32 VMmark Version Notes 33 VMmark 2.0 Vs. VMmark 2.1 33 VMmark 1.x Vs. VMmark 2.0 33 VMmark 1.1 Vs. VMmark 1.1.1 33 VMmark 1.0 Vs. VMmark 1.1 33 VMmark Run and Reporting Rules 33

VMmark Benchmark Requirements 35
VMmark Version and Settings Requirements 35 VMmark Hardware Requirements 35 Server Hardware Requirements 35 Server Storage Requirements 35

VMware, Inc.

3

exe to Pass Through 69 4 VMware. . Inc.VMware VMmark Benchmarking Guide Server Memory Requirements 35 Other Server Requirements 36 Client Hardware Requirements 36 Hardware Requirements for Physical Clients 36 Hardware Requirements for Virtual Clients 36 vCenter Hardware Requirements 37 Network Requirements 37 Network Hardware 37 Network Topology 37 VMmark Software Requirements 39 Workload Software Requirements 39 Client Software Requirements 39 Software Versions 40 Software License Summary 40 Free Software 40 Evaluation Software 40 Purchased Software 40 Preparing the Infrastructure for VMmark 2.1 Benchmark Tests 43 Create the Virtualization Infrastructure 43 Install vSphere vCenter 43 Install VMware ESX 43 Configure vCenter 44 Configure Time Synchronization on the ESX Hosts and the vCenter Server 44 Configure Time Synchronization for ESX Hosts 44 Configure Time Synchronization for the vCenter Server 44 Prepare the vSphere vCenter Server for the Deploy Infrastructure Operations 46 Create the VMmark Tiles 47 Create the Mail Server Virtual Machines 49 Create the Standby Virtual Machines 51 Create the Olio Database Virtual Machines 53 Create the Olio Web Virtual Machines 55 Create the DVD Store 2 Database Virtual Machines 57 Create the DVD Store 2 Web Virtual Machines 59 Configuring the Client Systems 61 Prepare the Client Machine 61 Prepare a Client Physical Machine 61 Prepare a Client Virtual Machine 61 Install Microsoft Windows Server on the Client Systems 63 Install Microsoft Windows Server on a Physical System 63 Install Microsoft Windows Server on a Virtual System 63 Install the VMware Tools Package in Microsoft Windows 64 Enable Time Synchronization in VMware Tools 65 Install Windows Updates 65 Configure Microsoft Windows on the Client Systems 66 Install Windows Server Components 66 Disable Data Execution Prevention (DEP) on the Client 67 Install or Update Windows PowerShell and vSphere PowerCLI 67 For Windows Server 2003 67 For Windows Server 2008 68 Install the General Software 69 Install and Configure the STAF Package 69 Install the STAF Package 69 Configure the Windows Server 2008 Firewall to Allow STAFProc.

HTML File 97 Submit the Full Disclosure Report for Review 97 Running VMmark without STAXMonitor 98 Creating the Workload Virtual Machines 99 Create and Configure the Standby Virtual Machines 100 Create the Standby Virtual Machine 100 Install Microsoft Windows Server 2003 Enterprise Edition 101 Install the VMware Tools Package in Microsoft Windows 102 Install Windows Updates 103 Install and Configure the STAF Package 103 Install the STAF Package 103 VMware.conf File 79 Edit Registry Settings in the Client System 79 Automatically Apply the Registry Settings 79 Manually Apply the Registry Settings 80 Update the hosts File 81 Obtain Exchange Server 2007 and LoadGen 81 Configure Windows to Not Use a Proxy Server 82 Create Additional Client Systems 83 Copying the Disk Image 83 Cloning a Virtual Machine 83 Configuring Additional Clients Manually 83 Install and Configure the Workload Client Software 84 Install the Standby Client Software 84 Install the Olio Client Software 84 Install the DVD Store 2 Client Software 84 Install and Configure the Mail Server Client 84 Set the Client’s Preferred Domain Name Server 84 Make the Client System a Domain Member 85 Install Exchange Server 2007 Tools 86 Install and Configure LoadGen on the Client 87 Backup the Microsoft Exchange Server 2007 Database 88 Running the VMmark Benchmark 91 Tile Placement 91 Running the VMmark Harness 91 Running Multiple-Tile Benchmarks 93 Configuring the VMmark Harness for Multiple-Tile Benchmarks 93 Starting Multiple-Tile Benchmarks 93 VMmark Results Files 94 Creating and Submitting a VMmark Full Disclosure Report 95 Configure the Prime Client to Log Into Virtualization Hosts Without a Password 95 Enable Reporting in the VMMARK2.Contents Configure STAF to Start Automatically 69 Create a Customized STAF.cfg File 71 Install the STAX Execution Engine 71 Install the STAF EVENT Service 71 Install a Java JRE 72 Install the Cygwin Environment 73 Install and Configure the VMmark Harness 75 Install the VMmark Harness Package 75 Configure the VMmark Harness 75 Edit the cygserver. 5 .CONFIG File 96 Create a Name-Mapping File 96 Generate an HTML-Formatted Table of Results and Ratios 97 Edit the disclosure. Inc.

VMware VMmark Benchmarking Guide

Create a Customized STAF.cfg File 104 Configure STAF to Start Automatically 104 Update the HOSTS File 104 Create and Configure the Mail Server Virtual Machines 105 Create the Mail Server Virtual Machine 105 Install Microsoft Windows Server 2008 Enterprise Edition 106 Install the VMware Tools Package in Microsoft Windows 107 Install Windows Updates 108 Create the Database and Backup Drives 108 Create a Second Virtual Disk 108 Create and Format the Database Partition 108 Create and Format the Backup Partition 109 Install and Configure the STAF Package 109 Install the STAF Package 109 Create a Customized STAF.cfg File 110 Configure the Windows Server 2008 Firewall to Allow STAFProc.exe to Pass Through 110 Update the hosts File 110 Install Windows Server Components and Windows Support Tools 110 Install Windows PowerShell 110 Install Windows Server Components 111 Configure Internet Explorer to Not Use a Proxy Server 111 Create and Configure the SLES Virtual Machines 112 Create the Virtual Machine 112 Install and Configure SUSE Linux Enterprise Server 11 113 Install the VMware Tools Package in the Linux Virtual Machine 114 Install and Configure the STAF Package 115 Install the STAF Package 115 Create a Customized STAF.cfg File 116 Set Open File Limits 116 Disable Persistent Network Adapter Name Rules 116 Configure the Linux System to Automatically Start STAFProc 116 Update the hosts File 116

Installing Applications in the Workload Virtual Machines
Prepare the Mail Server Virtual Machines 119 Clone the Mail Server Virtual Machines 119 Make the Mail Server Virtual Machine a Domain Controller 120 Install Microsoft Exchange Server 2007 121 Configure Microsoft Exchange Server 121 Update Exchange Server 2007 122 Increase the Transport Database Cache Size 122 Configure STAF to Start Automatically 123 Prepare the Standby Virtual Machines 124 Clone the Standby Virtual Machine 124 Prepare the Template for the Deploy Operation 124 Prepare the Olio Database Virtual Machines 125 Customize the SLES 11 Virtual Machine Template 125 Clone the SLES11 Template Virtual Machine 125 Customize the Virtual Machine for Olio Database 125 Create a Second Virtual Disk 125 Install the Software for the Olio Database Virtual Machines 126 Partition, Format, and Mount the Olio Database Disk 126 Install MySQL 126 Install Tomcat and Java 127

119

6

VMware, Inc.

Contents

Copy Files 127 Configure the Olio Database 128 Clone the Olio Database Virtual Machine 128 Prepare the Olio Web Virtual Machines 129 Customize the SLES 11 Virtual Machine Template 129 Clone the SLES11 Template Virtual Machine 129 Customize the Virtual Machine for Olio Web 129 Create a Second Virtual Disk 129 Install the Software for the Olio Web Virtual Machines 130 Partition, Format, and Mount the Olio Filestore Disk 130 Tune TCP/IP 130 Edit the /etc/HOSTNAME and /etc/hosts Files 130 Install Memcached 131 Copy the Fileloader 131 Install a 64-bit Java JRE 131 Install tc Server Application Server 132 Install Spring Framework 132 Install EclipseLink 132 Install MySQL Connector/J 133 Install JSTL 133 Configure tc Server 133 Clone the Olio Web Virtual Machine 134 Prepare the DVD Store 2 Database Virtual Machines 135 Customize the SLES 11 Virtual Machine Template 135 Clone the SLES11 Template Virtual Machine 135 Customize the Virtual Machine for DVD Store 2 Database 135 Create a Second Virtual Disk 135 Create a Third (Temporary) Virtual Disk 136 Install the Software for the DVD Store 2 Database Virtual Machines 136 Configure the Network and Set the Hostname 136 Partition, Format, and Mount the DVD Store 2 Database Disk 136 Partition, Format, and Mount the DVD Store 2 Temporary Disk 137 Install MySQL 137 Prepare the DVD Store 2 Database 138 Clone the DVD Store 2 Database Virtual Machine 139 Prepare the DVD Store 2 Web Virtual Machines 140 Customize the SLES 11 Virtual Machine Template 140 Clone the SLES11 Template Virtual Machine 140 Customize the Virtual Machine for DVD Store 2 Web 140 Install the Software for the DVD Store 2 Web Virtual Machines 140 Configure the Network 140 Install Apache and PHP 140 Untar, Edit, and Move the DVD Store 2 Files 141 Copy and Clone the DVD Store 2 Web Virtual Machine 141

Optional Configurations and Settings

143

Running a Subset of the Workloads (a Partial Tile) 143 Optional Windows System Settings 144 Disable the Manage Your Server Window 144 Set the System to Autologon 144 Disable the <Ctrl> <Alt> <Del> Prompt 144 Disable Password Protection on Resume 144 Disable Internet Explorer Enhanced Security 145 Disable the Shutdown Event Tracker 145
VMware, Inc. 7

VMware VMmark Benchmarking Guide

Using a PVSCSI Virtual Device Driver 146 Configuring Network Settings in SLES 11 147

Troubleshooting

149

Workload Troubleshooting 149 Mailserver Troubleshooting 149 Error Validating State of Active Directory 149 Microsoft Exchange Load Generator -- Error 1722 149 Correcting Mail Server Drive Letters and Names 149 LoadGen Log File Errors 150 Mailserver Virtual Machines Produce No Results 150 No Exchange Window Visible 151 LoadGen Can’t Connect to Active Directory 151 LoadGen Crashes If Exchange Server Transport Service Stops 151 Deleting the Microsoft Exchange Database 152 DVD Store 2 Troubleshooting 153 (504) Gateway Timeout Error 153 Miscellaneous Troubleshooting 154 Out of Bounds Error by Harness During Time Sync 154 Popup: “Space Allocated for Logging PowerShell Events is Nearly Full” 154 Infrastructure Operations Troubleshooting 154 STAF Complains About Trust Level 155 STAF is Unable to Connect to a Particular Server 155 The VMmark Harness Complains That Clients Are Out of Sync 155 VMware vSphere PowerCLI Snap-In Loads Slowly 155 PowerCLI Snap-In Takes About 20 Seconds to Load 155 PowerCLI Snap-In Takes About Two Minutes to Load 156 Error: “File C:\VMmark2\tools\VMmarkPScli.ps1 cannot be loaded.” 156 Networking Issues 157 Setting the Number of Ports on a Virtual Switch in ESX 157 Setting the Network Name 157 Setting Network to Connect at Power-on 157 Performing a Short Run 158 Testing a Single Failing Client-Workload Pair 159 The VMmark2ConfigChecker Script 160 Running the VMmark2ConfigChecker Script 160 The VMmark2ConfigChecker script is supplied as part of the VMmark kit (in the C:\VMmark2\tools directory). The script can be run in two modes: on a running ESX/ESXi host or on previously-collected reporter results. Both methods are described below. 160 Running the VMmark2ConfigChecker Script on an ESX/ESXi Host 160 Running the VMmark2ConfigChecker Script on Previously-Collected Results 160 Customizing the VMmark2ConfigChecker Script 161 Recovering Data from Abnormal Runs 162 Recovering Data From An Aborted Run 162 Recovering Data if the Harness Hangs 162 Manually Running the vSphere-get-config.sh Script 163

8

VMware, Inc.

Overview of Virtual Machine Creation for Standby Workloads 52 Figure 3-3. Overview of Virtual Machine Creation for Olio Database 54 Figure 3-4. Overview of Virtual Machine Creation for Mail Server Workloads 50 Figure 3-2. 9 .Figures Figure 1. Sample VMmark Benchmark Network Configuration (Not Shown: vCenter Server. Dedicated vMotion Network) 38 Figure 3-1. Example Organization of a Virtual Environment 13 Figure 1-1. Conceptual Example of a Single Server Running One VMmark Tile (Eight Virtual Machines) 20 Figure 2-1. Inc. Overview of Virtual Machine Creation for DVD Store 2 Database 58 Figure 3-6. VMmark 2. Overview of Virtual Machine Creation for Olio Web 56 Figure 3-5.1 Multi-Host Setup. Overview of Virtual Machine Creation for DVD Store 2 Web 60 VMware.

Inc.VMware VMmark Benchmarking Guide 10 VMware. .

Reference System Workload Scores 32 Table 3-1. VMmark 2.Tables Table 1. Microsoft Windows Virtual Machine Worksheet 18 Table 2. Single-Tile Example Test System Workload Scores (Artificial Data) 30 Table 1-6. Registry Entry to Modify 81 Table D-1. Inc. VMmark Client Summary 25 Table 1-3. Individual VMmark Workload Metrics 28 Table 1-4. Linux Virtual Machine Worksheet 18 Table 1-1. 11 . Registry Entries to Add 80 Table 4-3.1 Workload Summary 21 Table 1-2. Registry Entry to Modify 80 Table 4-2. Registry Entries to Change 45 Table 4-1. Example Reference System Workload Scores (Artificial Data) 29 Table 1-5. Registry Entries to Change 45 Table 3-2. Mail Server Virtual Machine Disk Partitions 150 VMware. Multiple-Tile Example Test System Workload Scores (Artificial Data) 31 Table 1-7.

. Inc.VMware VMmark Benchmarking Guide 12 VMware.

it provides instructions for configuring a system for VMmark testing.tpc. it details the steps required to perform such a test. and it discusses the interpretation of the data acquired. Why a Multi-Host Virtual Machine Benchmark? It is crucial for users to have meaningful and precise metrics in order to effectively compare the suitability and performance of different platforms for virtual environments. each virtual machine is fully isolated from other virtual machines and executes a separate operating system instance and separate application software. Virtual machine environments provide a software layer that enables users to create multiple independent virtual machines on the same physical server. were developed with neither virtual machines nor VMware. Although the underlying physical resources are shared. as shown in Figure 1.Overview This document describes a virtual machine benchmarking utility called VMmark®. Figure 1. In many cases.spec. 13 . such as those available through SPEC® (see http://www. As recent industry developments such as multi-core processors become commonplace. Inc. applications do not fully utilize these systems. Traditional single-workload performance and scalability benchmarks for non-virtualized environments. These realities have led to renewed interest in virtual machines for server consolidation.org). the degree of underutilization should increase.org/) or TPC (see http://www. Example Organization of a Virtual Environment Virtual Machine Virtual Machine Virtualization Layer Physical Hardware By running multiple virtual machines simultaneously. albeit with some virtualization overhead. a physical server can be driven to much higher utilizations. Why Virtualization? Trends in computer hardware have led to the proliferation of powerful yet relatively inexpensive multiprocessor servers.

multi-workload server consolidation benchmarks. including direct. and memory subsystems is generated by the underlying infrastructure operations. a significant portion of the stress on CPU. dynamic virtual machine relocation (vMotion™). These benchmarks measure single-host performance in virtualized environments. its affiliates or subsidiaries (“VMware”) are not responsible for any Modifications made to the published version of this documentation unless performed by VMware. consequential damages. indirect. familiarity with virtualization software and with benchmarking methodology is not assumed. even if VMware has been advised of the possibility of such damages. Inc. dynamic datastore relocation (storage vMotion). . Intended Audience This document is written for users with a relatively advanced understanding of system administration. Load balancing across multiple hosts can also greatly affect application performance. Any relevant benchmarking methodology must still focus on user-centric application performance while accounting for the effects of this infrastructure activity on overall platform performance.VMware VMmark Benchmarking Guide server consolidation in mind. deletions or other updates (“Modifications”) to the information may be incorporated in future releases. have been released. additions.. 14 VMware. Inc. and the automation of many provisioning and administrative tasks across large-scale multi-host environments. In this paradigm. All information is provided “as is” and is believed to be accurate at the time of publication. However. Legal Notice This documentation contains information including but not limited to the installation and operation of the Software. disk. VMware®. network. These types of benchmarks do not provide sufficient insight into the scalability of virtual environments supporting multiple simultaneous workloads. However the rapid pace of innovation has quickly transformed typical server usage by enabling easier virtualization of bursty and heavy workloads. VMware shall not be liable for any damages arising out of or in connection with the information and recommended actions provided herein (if any). such as VMmark 1.1 and SPECvirt_sc™2010. Modifications. loss of business profits or special damages. These metrics focus on achieving maximum system performance for a single workload by driving at least one of the underlying hardware resources to saturation. More recently.

Virtual Machine Preparation This section summarizes the preparation of the virtual machines used as VMmark 2. Install VMware Tools (on page 102). Prepare the vCenter server (on page 46). Install VMware ESX®/ESXi® (on page 43). Infrastructure Preparation Install VMware vCenter™ Server (on page 43). More information about this methodology can be found in “Performing a Short Run” on page 158. while the operating system is being installed in one virtual machine. Install and configure the STAF package (on page 103). Create clones of the standby virtual machine for additional tiles (on page 124). These checklists and worksheets are designed to help track which tasks have been completed and which remain to be done. Standby Virtual Machine Create the standby virtual machine (on page 100). NOTE It can be useful to create one complete tile (i. 15 . The checklists and worksheets are highly abbreviated and are intended for use in conjunction with the detailed material elsewhere in the book.Preparation Checklists and Worksheets Many of the operations required to configure a VMmark Benchmark test system can be performed in parallel to save time (for example.e. tile 0) and make sure it’s working smoothly.. “on page 100”) brings you to the cross-reference target. Mail Server Virtual Machine Create the mail server virtual machine (on page 105). Inc. Install VMware Tools (on page 107). you can be installing applications in another). Configure vCenter (on page 44). NOTE When this document is viewed electronically. clicking on the cross references (for example. Install 64-bit Microsoft Windows Server 2008 (on page 106). then make backups of this working configuration before cloning the workload virtual machines to create the additional tiles.1 workloads. VMware. Create the database and backup drives (on page 108). Install 32-bit Microsoft Windows Server 2003 (on page 101).

Update Microsoft Exchange Server (on page 122). Configure Microsoft Exchange Server (on page 121). Increase the transport database cache size (on page 122). starting with making the mail server virtual machine a domain controller (on page 120). Create clones of the DVD Store 2 database virtual machine for additional tiles (on page 141). Create the 20GB temporary disk (on page 136).VMware VMmark Benchmarking Guide Install and configure the STAF package (on page 109). (Alternatively: Create the virtual machine from scratch (on page 112) and configure it (on page 140). Configure STAF to start automatically (on page 123). Create clones of the DVD Store 2 database virtual machine for additional tiles (on page 139). 16 VMware. Create clones of the Olio database virtual machine for additional tiles (on page 128). Create clones of the Olio web virtual machine for additional tiles (on page 134). Olio Database Virtual Machine Download and uncompress the Olio database template virtual machine (Step 1 through Step 3 on page 53). Install an outdated copy of VMware Tools (beginning with Step 2 in “Prepare the Template for the Deploy Operation” on page 124).) Add the virtual machine to your vSphere inventory (Step 4 and Step 5 on page 57). DVD Store 2 Web Virtual Machine Download and uncompress the DVD Store 2 web template virtual machine (Step 1 through Step 3 on page 59). Make the mail server virtual machine a domain controller (on page 120).) Add the virtual machine to your vSphere inventory (Step 4 and Step 5 on page 59). (Alternatively: Create the virtual machine from scratch (on page 112) and configure it (on page 125). Deploy Template Virtual Machine Clone the standby virtual machine as a deploy template (Step 1 in “Prepare the Template for the Deploy Operation” on page 124). Install Windows Server Components and Windows Support Tools (on page 110).) Add the virtual machine to your vSphere™ inventory (Step 4 and Step 5 on page 53). Create clones of the mail server virtual machine (on page 119). Prepare the DVD Store 2 database (on page 138). (Alternatively: Create the virtual machine from scratch (on page 112) and configure it (on page 135). Repeat the previous five steps for each additional mail server virtual machine. (Alternatively: Create the virtual machine from scratch (on page 112) and configure it (on page 129). Install Microsoft Exchange Server (on page 121). .) Add the virtual machine to your vSphere inventory (Step 4 and Step 5 on page 55). Olio Web Virtual Machine Download and uncompress the Olio web template virtual machine (Step 1 through Step 3 on page 55). DVD Store 2 Database Virtual Machine Download and uncompress the DVD Store 2 database template virtual machine (Step 1 through Step 3 on page 57). Inc.

Disable data execution prevention (on page 67). Prepare the client machine (on page 61). Configure Windows to not use a proxy server (on page 82). Install Microsoft Windows Server (on page 63). Install the VMmark Harness (on page 75). Edit registry settings (on page 79). Inc. Install the STAF EVENT service (on page 71). Create a backup of the mail server database (on page 88). Make the client system a domain member (on page 85). Install a Java JRE (on page 72). 17 . Install or update Windows PowerShell and vSphere PowerCLI (on page 67).Preparation Checklists and Worksheets Client Preparation This section summarizes the preparation of the VMmark 2.) Set the client’s preferred domain name server (on page 84). VMware. Install Windows Server components (on page 66).1 clients. Install Exchange Server 2007 Tools (on page 86). Edit the cygserver. Install and configure LoadGen (on page 87). Install the STAX execution engine (on page 71). (Note that this must be done before the mail server client is installed and configured.conf file (on page 79). Install the Cygwin environment (on page 73). Obtain Exchange Server 2003 and LoadGen (on page 81). Update the HOSTS file (on page 81). Configure the VMmark Harness (on page 75). Create any additional client systems you will need (on page 83). Install and configure the STAF package (on page 69).

Table 1. It may be helpful to photocopy this page and fill out one copy for each tile being prepared. Linux Virtual Machine Worksheet Virtual Machine Name OlioDBN Function Olio Database (64-bit SLES 11) Configuration 2 vCPU 2GB RAM 10GB boot disk 4GB data disk 4 vCPUs 6GB RAM 10GB boot disk 70GB data disk 4 vCPUs 4GB RAM 10GB boot disk 35GB data disk 2 vCPUs 2GB RAM 10GB boot disk 2 vCPUs 2GB RAM 10GB boot disk 2 vCPUs 2GB RAM 10GB boot disk Hostname IP Address OlioWebN Olio Web (64-bit SLES 11) DS2DBN DVD Store 2 Database (64-bit SLES 11) DS2WebAN DVD Store 2 Web (64-bit SLES 11) DVD Store 2 Web (64-bit SLES 11) DVD Store 2 Web (64-bit SLES 11) DS2WebBN DS2WebCN 18 VMware. should be named Mailserver0. NOTE Virtual Machine Name should be in the format of WorkloadNameN where N is the tile number. For example. . Inc.VMware VMmark Benchmarking Guide Virtual Machine Worksheets These worksheets provide a place to record information about the virtual machines used in a VMmark Benchmarking setup. Microsoft Windows Virtual Machine Worksheet Virtual Machine Name MailserverN Function Mail server (64-bit Windows Server 2008) Configuration 4 vCPUs 8GB RAM 32GB boot disk 40GB data disk 1 vCPU 512MB RAM 4GB boot disk Hostname IP Address StandbyN Standby system (32-bit Windows Server 2003) Table 2. the Mail server in the first tile. Tile0.

1 Benchmark State-of-the-art server consolidation typically collects several diverse workloads onto a virtualization platform—a collection of physical servers accessing shared storage and network resources. 19 . The VMmark 2.1 Benchmark” on page 19 “VMmark Benchmark Workloads” on page 21 “VMmark Client Systems” on page 25 “VMmark Harness” on page 26 “Contents of VMmark Kit” on page 27 “VMmark 2. Dynamic load balancing techniques ensure that all system resources such as CPU. However. Tiles are relatively heavyweight objects that cannot by themselves capture small variations in platform performance. both the number of tiles and the performance of each individual workload determine the overall benchmark score. that scale the workload in a step-wise fashion to increase the system load. such as TPC-C. However the workload throttling forces the use of additional tiles for large jumps in platform performance. The chapter consists of the following sections: “Overview of VMmark 2. and disk are more efficiently utilized.What is the VMmark Benchmark? 1 This chapter provides an overview of the VMmark Benchmark and describes how it works. This concept is similar to some server benchmarks. Inc. Each workload within a tile is constrained to execute at less than full utilization of its virtual machine. the performance of each workload can vary to a degree with the speed and capabilities of the underlying platform. To address this. the addition of a fast disk array might result in disk-centric workloads producing a more favorable score.1 Benchmark follows the convention of VMmark 1. The unit of work for a benchmark of virtualized consolidation environments can be naturally defined as a collection of virtual machines executing a set of diverse workloads. For instance. In fact.x and refers to this unit of work as a tile. virtual environments tend to function more smoothly when resource demands are balanced across multiple resources. The total number of tiles that a multi-host platform can accommodate gives a coarse-grain measure of that platform's consolidation capacity. VMware.1 Benchmark Scoring Methodology” on page 28 “Reference Scores” on page 32 “VMmark Version Notes” on page 33 “VMmark Run and Reporting Rules” on page 33 Overview of VMmark 2. These variations can capture system improvements that do not warrant the addition of another tile. network.

1 generates a realistic measure of platform performance by incorporating a variety of platform-level workloads in addition to traditional application-level workloads. the aggregate score. VMmark 2. Live migration both of virtual machines and of their underlying disk files has quickly become a powerful and commonplace tool in virtualized datacenters. Additionally. Likewise. If the system has not been overcommitted. Each of these operations place non-trivial resource demands on the underlying computational infrastructure and must be included in order to accurately characterize platform performance. however. the ability to quickly clone and deploy virtual machines onto available resources has transformed traditional server provisioning. The result is a flexible benchmark metric that provides a measure of the total number of workloads that can be supported by a particular multi-host platform as well as the overall performance level within the virtual machines. Conceptual Example of a Single Server Running One VMmark Tile (Eight Virtual Machines) ESX Server One VMmark tile (eight virtual machines) 20 VMware. and storage migration operations are repeatedly performed on a set of the workload virtual machines to simulate the additional resource demands typical in production datacenters. . should increase. and the minimum quality-of-service metrics are met. Inc. Figure 1-1. VMware VMmark is designed to benchmark the performance of the virtualization software and hardware and is not designed as a benchmark of any other software component.VMware VMmark Benchmarking Guide When a tile is added the performance of workloads in existing tiles might decrease. including the new tile. Virtual machine migration. automated load balancing is enabled to ensure application-level workloads are relocated to satisfy their resource needs as the computational loads vary among the individual hosts over time. clone and deploy.

In its default configuration LoadGen requires too much disk space for our purposes.0 E-Commerce Application Exchange 2007 None Olio DVD Store 2 Virtual Machine Platform Windows 2008 64-bit. 10GB boot & 70GB data disks Back end: SLES 11 64-bit. 2 vCPU. A survey of datacenter applications led to the inclusion of the following workloads: Mail server Standby system Web 2.Chapter 1 What is the VMmark Benchmark? VMmark Benchmark Workloads A meaningful tiled consolidation benchmark is based on a set of relevant datacenter workloads. 4 vCPU. Mail Server Virtual Machine Most businesses today provide employees with email as a means for communicating. 4GB disk Back end: SLES 11 64-bit. but also for their strict response-time requirements. 4GB RAM. This reduces implementation effort and provides a well-understood foundation upon which to build. 6GB RAM. Inc. For consistency with VMmark design we made a few changes in how we implement this utility. 2 vCPU. 2GB RAM. For this reason. 4 vCPU. 512MB RAM. 2GB RAM. individual loads were tuned to generate load levels that were representative of workloads in a consolidation environment. 10GB disk The design of some of the workloads did not completely align with the design goals for VMmark 2. Table 1-1. The workloads chosen for use in VMmark are representative of popular applications commonly run by VMware customers. which include: Dynamic storage relocation Dynamic virtual machine relocation Virtual machine cloning and deployment Automated load balancing The following sections discuss each workload and any necessary modifications. The most common mail server deployed among VMware customers is Microsoft Exchange. VMware. mail servers are important workloads in modern datacenters. However. 10GB boot & 4GB data disks Front end: SLES 11 64-bit. These four workloads are summarized in Table 1-1. Additionally. not just for their often large resource requirements. 32GB boot & 40GB data disks Windows 2003 32-bit. 10GB boot & 35GB data disks Front end (3): SLES 11 64-bit. VMmark 2. We therefore chose to use Microsoft Exchange 2007 to represent the mail server workload in VMmark. Some modifications to the workloads were thus required in order to make them suitable for a multi-workload data center benchmark. 21 . 1 vCPU. Microsoft provides a well-known load generation utility called LoadGen that simulates users of the Exchange mail server.0 load simulation E-Commerce simulation Rather than develop workloads from scratch.1. 4 vCPU. so we reduced the initial mailbox sizes of the simulated users. existing workloads or benchmarks were used wherever possible. VMmark leverages components of these workload virtual machines to run some common virtualization procedures. 8GB RAM. the inclusion of any particular application does not imply that the vendor claims support for running their application in virtual machines.1 Workload Summary Workload Name Mail server Standby system Web 2.

Inc. We periodically measure the throughtput and quality of service for each operation. VMmark 2. . TagSearch. Rather than using the number of users as a metric. or for workloads with bursty behavior. VMmark design also requires a periodic rate metric for each workload. This does not cause the Exchange virtual machine to be bottlenecked on any resource. The standby virtual machine runs 32-bit Microsoft Windows Server 2003 Enterprise Edition and has one virtual CPU and 512MB of memory.0 applications such as social networking have become ubiquitous in recent years. Databases tend to be resource intensive and exercise most server and infrastructure components. PersonDetail. The Olio workload (http://incubator. Web 2. The Microsoft Exchange Server 2007 workload is run in 64-bit Microsoft Windows Server 2008 Enterprise Edition on a virtual machine with four virtual CPUs and 8GB of memory. Transaction processing often exhibits bursty behavior. AddPerson. and AddEvent. we periodically measure the number of transactions executed by the mail server and use that as our metric. We also replaced the default Glassfish application server with the Tomcat-based tc Server. However. EventDetail.VMware VMmark Benchmarking Guide We fix the load by limiting our configuration to 1000 heavy profile users with a more limited mailbox size compared to the default to fix the load. Login. The Olio database tier runs the MySQL database on a virtual machine with two virtual CPUs and 2GB of memory. Even when idle. and Ruby on Rails. For this reason. each running 64-bit Novell SLES 11. as is typical. Olio has been implemented in a variety of technologies. Berkeley (http://radlab. E-Commerce Simulation Databases running transactional workloads support a wide array of applications. including PHP. Standby Virtual Machine Many computing environments contain standby systems ready for new workloads. Java EE. The Rain framework and tc Server application server provided greater flexibility and easier maintenance when adapting the Olio workload for use within VMmark 2.0 Simulation Web 2. The OlioWeb tier runs the tc Server Java EE container application on a virtual machine with four virtual CPUs and 6GB of memory. The load is fixed at 400 concurrent users.cs. it is required to answer a periodic heartbeat for the VMmark test to be considered valid.1. We subsequently adapted the Java implementation of Olio to the Rain framework for use within VMmark 2. these systems still place resource demands on the virtualization layer and can impact the performance of other virtual machines. resulting in widely varying resource demands over time. database systems also face strict response-time demands.1.berkeley. These applications tend to be built from a wide range of open-source tools and applications running in a distributed fashion. We use the total of completed operations per minute as the primary metric in VMmark 2. Minimum quality-of-service metrics must also be met. Olio was originally designed to use the Faban benchmark driver framework from Sun Microsystems. typically as part of a multi-tier architecture. 22 VMware. The ability of the underlying platform to support usage spikes is critical to maintaining acceptable performance. The Ruby on Rails implementation of Olio was modified to use the Rain benchmark framework from the RAD Lab at the University of California. These extremely lightly loaded (essentially idle) systems are attractive targets when consolidating servers.org/olio/) mimics a Web 2.1 includes a two-tier Java-based implementation of the Olio workload. The standby virtual machine does not produce a metric that affects the benchmark score.0 application supporting the following common operations: HomePage.1.apache.1 tile utilizes two virtual machines.edu).0 application focused on social networking and events. however. The Olio workload used in each VMmark 2. In many cases. one standby virtual machine is included in the benchmark tile. Olio defines an example of a Web 2.

) The DS2 driver simulates users logging into a Web server and browsing a catalog of products using basic queries. The benchmark then waits five minutes and repeats this process. and DS2WebC) each run the Apache 2. The number of concurrent clone and deploy operations increases with the number of tiles and the number of hosts in the benchmark cluster. particularly the storage subsystem as the virtual machine files are copied. Virtual Machine Cloning and Deployment Creating a new virtual machine and installing a guest operating system and applications can be time consuming. each running 64-bit Novell SLES 11. then destroys the new virtual machine. Cloning. followed by the deployment of a functional virtual server. The performance metric for this workload is the total number of transactions per minute. configuration. Each Web server communicates with a database server that maintains user account and inventory data.Chapter 1 What is the VMmark Benchmark? DVD Store Version 2 (DS2) is a complete online e-commerce test application with a back-end database component. One Web server delivers a constant load to the database throughout each benchmark interval. VMmark 2. a Web application layer. The performance metric used is the number of relocations per hour.1. VMmark 2. VMmark 2.1 mimics the manual relocation of a virtual machine. Users may select items for purchase then proceed to check out or continue shopping. The performance metric used is the number of clone and deploy operations per hour. This transition can result in bursty loads on platform resources. administrators can make many copies of a virtual machine using a single installation and configuration process.1 clones this template. storage. continuing for the duration of the benchmark period.delltechcenter. The DS2 database tier runs the MySQL database on a virtual machine with four virtual CPUs and 4GB of memory.1 tile utilizes four virtual machines. Dynamic Virtual Machine Relocation Live migration technology such as VMware vMotion® leverages the complete virtualization of servers. Using virtual machine cloning technology. This infrastructure workload acts on the Olio database virtual machines. VMware. the active memory and precise execution state of a virtual machine is rapidly transmitted over a high speed network from one physical server to another and access to the virtual machine’s disk storage is instantly switched to the new physical host.1 implements a workflow involving the cloning of a virtual machine. and driver programs. The two remaining Web servers deliver periodic load to the database during the benchmark interval to create a bursty overall load profile and varying resource demands.com/page/DVD+Store for additional information. The DS2 workload used in VMmark 2. Minimum quality-of-service metrics must also be met.1 utilizes four virtual machines in each tile—three Web servers and one database server. the subsequent upgrade of the new virtual machine's paravirtualized drivers and tools. and the virtual machine is moved to the destination host. This infrastructure workload acts on a copy of the standby server virtual machine containing an outdated copy of the VMware Tools suite. continuing for the duration of the benchmark period. DS2WebB. and networking to move an entire running virtual machine seamlessly from one server to another. which can be a common task performed by an administrator. The DS2 workload used in each VMmark 2. and deployment operations create bursty loads on platform resources. An Olio database virtual machine is selected in a round-robin fashion from among all the tiles. The number of concurrent relocation operations increases with the number of tiles and the number of hosts in the benchmark cluster. each Web server is driven by 10 driver threads when active. The three virtual machines in the DS2 Web tier (DS2WebA. During a vMotion operation.1 then waits three minutes and repeats this process. customizes the operating system. particularly the networking subsystem.2 Web server on virtual machines with two virtual CPUs and 2GB of memory. upgrades VMware Tools on the newly-created virtual machine. 23 . a destination host is selected at random from among all hosts in the benchmark cluster (other than the virtual machine’s current location). Inc. VMmark 2. (See http://www. verifies successful deployment. For VMmark 2.

Storage relocations can create bursty loads on platform resources. Inc. 24 VMware. The number of concurrent storage relocation operations increases with the number of tiles and the number of hosts in the benchmark cluster. This infrastructure workload acts on the standby server virtual machines. A standby server virtual machine is selected in a round-robin fashion from among all the tiles.1 then waits five minutes and repeats this process. upgrades. Intelligently allocating and balancing resources allows the underlying platform to respond effectively to bursty load conditions even when utilizations are high. VMmark 2. .1 implements a scenario involving the relocation of a virtual machine's disk files to a maintenance partition followed by a return trip of the files to their original location. and load balancing. particularly the storage subsystem. This round-trip approach models an administrator temporarily evacuating a disk partition and subsequently returning the system to its initial state after completing maintenance on the storage system.VMware VMmark Benchmarking Guide Dynamic Storage Relocation Live migration of virtual machine disk files across or within storage arrays enables enormous flexibility for storage maintenance.1 requires that DRS be enabled and running at the “aggressive” level (or higher) to insure that rebalancing occurs in a timely manner when utilizations are high. This should improve overall performance by addressing load imbalances occurring during the benchmark interval. The performance metric used is the number of relocations per hour. VMmark 2. then the files are moved back to their original location. VMmark 2. Automated Load Balancing Automatically balancing resource demands among multiple physical servers using technology such as VMware's Distributed Resource Scheduler (DRS) has become a fundamental part of modern virtualized datacenters. continuing for the duration of the benchmark period. the virtual machine’s files are moved to a maintenance partition.

Cygwin.Chapter 1 What is the VMmark Benchmark? VMmark Client Systems Each tile requires a client system. VMmark Client Summary Workload Name Mail server Standby system Web 2. Table 1-2 provides a summary of the client software associated with each workload. Inc. These systems run software that provides loads for most of the workloads.0 Simulation E-Commerce Simulation Client Software LoadGen IdleVMTest Olio client DVD Store 2 client In addition to the software listed above. all client systems must also be running the STAF software package. a Java JDK. Table 1-2. The prime client also runs the VMmark Harness software that can start. stop. 25 . and Microsoft Exchange management tools. The prime client must also be running the STAX software package and up-to-date versions of PowerShell and the VMware vSphere PowerCLI. VMware. and measure the performance of the workloads.

the VMmark Harness simultaneously initiates the individual workloads in all the tiles.php) and its companion execution engine. Each workload has its own <workload>_functions. The main STAX module. When the workload runs have completed. vmmark2_main. The VMmark Harness is based on the open-source Software Testing Automation Framework (STAF. run the test. The VMMARK2.CONFIG file has been processed. identifying all the clients and server virtual machines involved in the test. .xml module that contains the workload-specific code needed to initialize the test. see http://staf. the VMMARK2. then collects the results into a results directory. and collect the results. These tools support the development and running of distributed coordinated tests across heterogeneous machines and operating systems. processes the VMMARK2.sourceforge. After the VMMARK2. and the workloads within each tile.CONFIG file defines the actual test. Inc.CONFIG file to configure the test to be run. and several workload-specific configuration files. the number of tiles to be run. the harness again validates the timing. STAX.xml. 26 VMware. the VMmark Harness performs pre-run system and timing validation and initiates the setup phase for the VMmark infrastructure operations and for each workload in each tile.CONFIG file. After the setup has completed.VMware VMmark Benchmarking Guide VMmark Harness The VMmark Harness is a utility run on the prime client system that can start and stop the applications running on the workload virtual machines and can report the results of a test run. The VMmark Harness consists of several STAX XML modules.net/index.

When extracted. the contents can be found in the following directories: docs This directory contains documentation files. the script used to collect host system information for reporting. including the VMmark EULA and the VMmark Run and Reporting Rules. NOTE The VMware VMmark Benchmarking Guide (this book) is now available as a separate download at http://www.zip (where version is the version of VMmark included in the kit and date is the date of release).com/products/vmmark/ (the same place from which the VMmark kit can be downloaded). tools used by the harness to generate infrastructure operations.jar files used by the harness. Inc. VMmark2 This directory contains the STAX driver code. a results directory where timestamped results files are saved. VMware. vclient0 This directory contains some of the client-side elements and templates required for each workload (additional software must be acquired and installed separately). and tools for generating VMmark metrics and ratios in both text and HTML formats. vserver This directory contains elements that need to be installed on the workload-specific virtual machines after the installation of each virtual machine’s application or benchmark software (some of which must be acquired and installed separately). .vmware.Chapter 1 What is the VMmark Benchmark? Contents of VMmark Kit VMmark is distributed as a compressed file named VMmark2-version-date. 27 .

1 workload is designed to run for at least 3 hours with workload metrics reported every 60 seconds. The DVD Store implementation in VMmark 2. This approach provides a clearer understanding of platform behavior. Individual VMmark Workload Metrics Workload Name Mail server Olio server Standby server DS2WebA DS2WebB DS2WebC Clone and deploy vMotion Storage DRS vMotion® Application(s) Microsoft Exchange tc Server. . For each of the 40-minute sections we compute the overall result for the platform and select the median score of the three as the reported score. A reference system is commonly used for normalization when computing benchmark scores. Normalization allows the integration of the different component metrics into an overall score.VMware VMmark Benchmarking Guide VMmark 2. The steady state is further divided into three 40-minute sections. DRS does not produce a metric but will affect the performance of other workloads by managing the overall resource allocations to improve performance and provide stability. each webserver generates a separate results file to be processed independently from the others. Table 1-3. 28 VMware. MySQL None Apache. MySQL None None None N/A Metric Actions/minute Operations/minute None Transactions/minute Transactions/minute Transactions/minute Clones/hour VM migrations/hour VM migrations/hour None NOTE The standby server workload does not produce a metric that affects the benchmark score. MySQL Apache.spec. MySQL Apache. each individual application and infrastructure workload reports its relevant performance metric. using a Sun Ultra5_10 with a 300Mhz processor as its reference platform. The scoring methodology is conceptually straightforward despite the underlying complexity and large scope of the benchmark. The first and last half hours are the ramp-up and ramp-down times. These metrics are collected at frequent intervals during the course of the run.1 is a multi-tier workload containing three webserver virtual machines with varying load patterns accessing a single database virtual machine. However. DRS must be enabled to allow the platform to automatically balance resources during the benchmark run. respectively.1 score aggregates the throughput metrics of all application and infrastructure workloads to create a single overall benchmark score that can be used to quickly compare different platform configurations. the user will have a series of numbers for each of the workloads. However the standby server is required to answer to a periodic heartbeat request in order for the VMmark test to be considered valid. After a VMmark Benchmark test run completes. SPEC CPU2000 (see http://www.1 Benchmark Scoring Methodology A VMmark 2. These performance metrics are shown in Table 1-3. each workload score is defined as a single number: the average of a consecutive subset of the series of datapoints for that workload.org/cpu2000/) takes this approach. The steady state for the benchmark is defined as the middle two hours of the three-hour run. For example. For scoring purposes. Every workload must also pass its minimum quality-of-service requirements for the benchmark result to be considered compliant. VMmark 2. This means that rather than having a single number upon completion of a test run.1 measures consolidation workloads within virtual environments and therefore requires a reference platform capable of successfully running a single tile. The standard VMmark 2. Inc. Likewise.

the versions of the benchmarks. Then a geometric mean of the normalized scores is computed as the final score for the tile.1 gives weights of 80% to the application-workload component and 20% to the infrastructure-workload component. 29 . or fails its minimum quality-of-service requirement. Consequently. while the second example demonstrates how to compute the scores for a multiple-tile benchmark run. and select the median of the three results to obtain the scores shown in Table 1-5. Also. The resulting per-tile scores are then summed to create the application-workload portion of the final metric. produces errors during a run. calculate results for each of the three 40-minute sections. If any of the workloads within any tile fails to run. The first example demonstrates how to compute the score for a single tile benchmark run. the individual scores for each of the tiles. you remove the first and last thirty minutes. VMware. These weights were chosen to reflect the relative contribution of infrastructure and application workloads to overall resource demands. the infrastructure workloads are compiled as a single group and no multi-tile sums are required. Therefore results for multi-tile runs are reported as the aggregate score for all tiles. The final benchmark score is then computed as a weighted average of the application-workload component and the infrastructure-workload component. the metrics of the application workloads within each tile are computed and aggregated into a score for that tile. This applies to programs running on both the servers and the client systems. tools. according to the methodology described earlier. This aggregation is performed by first normalizing the different performance metrics (such as Actions/minute and operations/minute) with respect to a reference platform. To illustrate the scoring methodology. Example Reference System Workload Scores (Artificial Data) Workload Name Mail server Standby Olio DS2WebA DS2WebB DS2WebC Clone and deploy vMotion Storage vMotion DRS Score 1000 actions/minute None 1000 operations/minute 1000 Transactions/minute 1000 Transactions/minute 1000 Transactions/minute 10 clones/hour 10 VM migrations/hour 10 VM migrations/hour None Example One: Single-Tile Benchmark Scoring Suppose you perform a single-tile VMmark run and. that entire VMmark run is considered to be invalid. the configuration of the workloads. and all other software used must conform to the specifications in the VMmark documentation. Inc. consider the following two examples. Unlike the application workloads. The metrics for the infrastructure workloads are aggregated separately using the same mathematical technique of normalization with respect to a reference platform followed by the computation of the geometric mean. VMmark 2. assume the reference system had the scores shown in Table 1-4. Table 1-4. and the scores for the workloads within the tiles as well as the individual scores for each infrastructure workload. The benchmark helps measure the virtualization overheads of the individual workloads as well as the scalability of the entire system.Chapter 1 What is the VMmark Benchmark? After a valid run. operating systems. the infrastructure workloads are not scaled explicitly by the user. For these examples.

VMware VMmark Benchmarking Guide Table 1-5. Example Two: Multiple-Tile Benchmark Scoring This example demonstrates the scoring for multiple tiles. you would combine the geometric means with a weighted average (80% for application workloads. include this score as well as the individual scores for all of the workloads (both raw and normalized).02 = 0. .94 * 1.98 * 0.97 = 0.333333) = 0.97) + (0. 20% for infrastructure workloads): (0.97 The score for this tile is 0. you would combine the normalized scores for the infrastructure workloads using a geometric mean: (1.98 = 0.90 * 0.8 * 0.10 * 0.02 * 0.90 n/a You would then combine the normalized scores for the application workloads using a geometric mean: (0.97 Next.90 = 1.94 = 1. Suppose you perform a VMmark run containing four tiles and obtain the scores shown in Table 1-6. For reporting.96 Finally.2) = 0.96) = 0.90)^(0.10 = 0.97.2 * 0.95 n/a = 0. Single-Tile Example Test System Workload Scores (Artificial Data) Workload Name Mail server Standby Olio DS2WebA DS2WebB DS2WebC Clone and deploy vMotion Storage vMotion DRS Score 950 actions/minute None 940 operations/minute 1020 Transactions/minute 980 Transactions/minute 970 Transactions/minute 9 clones/hour 11 VM migrations/hour 9 VM migrations/hour None To compute the score for this tile. 30 VMware. you first compute each workload's normalized scores by dividing the score for each workload by the reference score for that workload: Mail server: Standby: Olio DS2WebA DS2WebB DS2WebC Clone and deploy vMotion Storage vMotion DRS 950/1000 n/a 940/1000 1020/1000 980/1000 970/1000 9/10 11/10 9/10 n/a = 0.95 * 0.97)^(0. Inc.

31 .95) + (0.95 The score for the infrastructure workloads would be: Normalized score: 1. a valid test report must include both the individual tile scores and the workload scores (both raw and normalized).97 1. VMware.00 = 3. Multiple-Tile Example Test System Workload Scores (Artificial Data) Workload Name Mail server Standby Olio DS2WebA DS2WebB DS2WebC Clone and deploy vMotion Storage vMotion DRS Tile 1 Score 1100 n/a 940 950 940 930 Tile 2 Score 1050 n/a 950 1000 1010 1020 21 22 11 n/a Tile 3 Score 990 n/a 890 990 1020 960 Tile 4 Score 1080 n/a 940 970 970 1050 The scores for the application workload tiles would be: Normalized scores: 0.01 0.72) = 3.72 The overall score for the system would be the weighted average of these scores: (0.50 Along with the overall score.97 + 1.97 1.2 * 1.8 * 3.01 + 0.Chapter 1 What is the VMmark Benchmark? Table 1-6.97 + 1. Inc.00 The overall application component to the score would be the sum of these scores: 0.

18 operations/minute 1518. Inc. The load-generating client was an HP ProLiant DL360 G5 with one 2. and was configured with 32GB of memory.VMware VMmark Benchmarking Guide Reference Scores A pair of identical HP ProLiant DL380 servers running VMware ESX Server 4.55 operations/minute 1058. Storage was provided by an EMC Clariion CX3-20 disk array connected via a 4Gb/s fiber channel link and containing eight 15.0 U1.0 vMotionedVMs/Hour 9.0 DeployedVMs/Hour 16. The servers were connected to the disk array using a Brocade DS-5000 fiber switch.43 operations/minute 2199.16 GHz quad-core Intel Xeon X5460 CPUs. The systems were managed by a Virtual Center 4.0 U1 system.66 GHz quad-core Intel Xeon X5355 CPU and 8GB of memory running 32-bit Microsoft Windows Server 2003 R2 with Service Pack 2. Network connectivity was provided by an HP ProCurve 5406zl switch.0 Storage vMotionedVMs/Hour 32 VMware. Each server used a single 1Gigabit Ethernet link for vMotion. The client and the reference system were connected through a single 1 Gigabit Ethernet link. Table 1-7. . The reference scores obtained on this system are shown in Table 1-7.25 send mail actions/minute 4641. build 208167 were used in the reference platform.000 RPM disks configured in RAID0. Reference System Workload Scores Workload Name Standby server Mail server Olio DS2WebA DS2WebB DS2WebC Clone and deploy vMotion Storage vMotion Score None 330.05 operations/minute 4. Each server contained two 3.

0 were completely changed from VMmark 1.vmware.com/products/vmmark and select the Download button.1 Vs.x was designed as a single-system consolidation benchmark consisting of six isolated single-tier workloads. Web server.1 benchmark scores were thus considered directly comparable. VMware. The benchmark harness now scales the storage relocation workload in the same fashion as the other infrastructure workloads.1 was a minor maintenance release.0 benchmark scores are considered directly comparable to VMmark 2.x Vs.0) as well as support for virtualized clients (subject to certain conditions).1 scores. VMmark 1. VMmark 1. 33 . The workloads and load levels of VMmark 2. and for the results of that test to be publishable. VMmark Run and Reporting Rules In addition to the guidelines presented above. It included updates to the VMmark Benchmarking Guide. Visit: http://www. VMmark 1. and Database server). VMmark 2. specific run and reporting rules must be followed for a VMmark test to be considered valid. Inc.1 adds support for client systems running certain versions of Windows Server 2008 (in addition to Windows Server 2003.1 VMmark 1. VMmark 1.1. updated reporting script and disclosure template. All published VMmark 2. VMmark 1.0 While VMmark 1. VMmark 1. and new versions of the Run and Reporting Rules and Review Panel Guidelines and Procedures.1 used 64-bit operating systems and applications in three of the workload virtual machines (Java server. NOTE You should also check the VMmark download page for any later release of the run and reporting rules. and the VMmark 1.0 Vs. VMmark 2. VMmark 1. and four infrastructure-level workloads. VMmark 2.0 consisted of two single-tier application workloads. These run and reporting rules are included in the \docs directory of the VMmark kit.0 Vs.x and the benchmark scores were in no way considered comparable.0 and 1. VMmark 2. however.1 benchmark scores. The VMmark Benchmarking Guide is updated to reflect these changes. which was supported in VMmark 2.0.0 was designed as a multi-host benchmark reflecting typical.Chapter 1 What is the VMmark Benchmark? VMmark Version Notes VMmark 2.1 scores were considered directly comparable to VMmark 1.1 VMmark 2.1 In order to reflect the increasing use of 64-bit operating systems in data centers.0 and 1. The workloads and load levels were unchanged from VMmark 1.1. modern-day usage of virtualized infrastructure. two multi-tier application workloads.1.

Inc. .VMware VMmark Benchmarking Guide 34 VMware.

VMmark Benchmark Requirements 2 This chapter describes the hardware and software required in order to perform VMmark benchmark testing. Server Storage Requirements Configure the servers with enough datastore capacity to hold all the virtual machines required for the VMmark Benchmark runs. NOTE In order to support the dynamic storage relocation operations performed by VMmark 2. iSCSI. Inc. Server Hardware Requirements The server hardware must be supported by the hypervisor being used and must be configured to meet or exceed the minimum CPU. No DRS rules are allowed. VMware. This capacity can be in one or multiple datastore partitions and can be any hardware type supported by the hypervisor for datastore use. It consists of the following sections: “VMmark Version and Settings Requirements” on page 35 “VMmark Hardware Requirements” on page 35 “VMmark Software Requirements” on page 39 “Software License Summary” on page 40 VMmark Version and Settings Requirements Both vCenter and ESX versions must be currently available or planned to be generally available within 90 days. SAN. Server Memory Requirements The VMmark Benchmark uses approximately 27GB of physical RAM per tile. and NFS. Using resource pools is not allowed. the benchmark requires that all ESX hosts used in a test have access to the same shared storage. The test might not run smoothly with less than this amount of memory. and other basic requirements for that product and version. VMmark Hardware Requirements This section describes the hardware required in order to run VMmark. minimum memory. The DRS aggressiveness level must be 3 or higher.x. including SCSI. 35 . This is approximately 300GB per tile (plus an additional 20GB during the initial configuration).

that result could be deemed non-compliant. 36 VMware. suggest that client resource constraints affected a benchmark result. client systems can be either physical systems or virtual machines. These client machines must meet or exceed the specifications detailed in the sections below. “virtual clients”) the conditions detailed in the following sections must be met. NOTE This means the sum of the vCPUs configured for all the virtual machines running on a host must not exceed the number of logical CPUs that host contains.or 84xx-series (“Istanbul”) NOTE Each hyper-threaded core can be considered two CPUs when calculating the level of CPU commitment. NOTE This means the sum of the memory allocated to all the virtual machines running on a host must not exceed the amount of physical memory that host contains. One of the client machines (the prime client) must be a physical system. Hardware Requirements for Physical Clients When client functions are run directly on a physical system (“physical client”). These conditions are intended to ensure that virtual client systems introduce no resource constraints that might affect the benchmark results. or if you have questions regarding anything not addressed. Client Hardware Requirements Each VMmark tile requires its own client machine. The memory in the servers hosting the virtual clients must not be overcommitted.1 or later. The CPUs in the servers hosting the virtual clients must not be overcommitted. If benchmark output files. The hosts’ physical processors must be equivalent to or faster than: Intel: Xeon 5400-series (“Harpertown”) AMD: Opteron 24xx. Virtualization Platform for Virtual Clients The hosts must be running VMware ESX/ESXi 4..x. 32GB of available disk space (for Windows Server 2008) Physical client systems should not be resource constrained and should not be running services or applications unrelated to the benchmark.VMware VMmark Benchmarking Guide Other Server Requirements In order to support the vMotion and DRS infrastructure operations included in VMmark 2. Hardware Requirements for Virtual Clients Other than the prime client (which must be a physical system). the system must meet or exceed the following requirements: Four CPU cores 4GB of RAM 15GB of available disk space (for Windows Server 2003). including the results of time synchronization checking performed by the VMmark harness. . the benchmark requires a minimum of two ESX hosts and requires that all ESX hosts used in a test be vMotion compatible. Inc. This specification should not be considered exhaustive. despite meeting the conditions detailed below. When client functions are run in a virtual machines (i. contact VMware at vmmark-info@vmware. For clarification of the details addressed below.e.com.

and switches) should be at least gigabit rated. vCenter Hardware Requirements The vCenter Server can be run on either a physical system or a virtual machine. minimum memory. though the VMmark test systems may be connected to a company-wide network during setup. Network Hardware All components of this network (network interface cards. 37 . Network Requirements VMmark tests require a dedicated private gigabit (or faster) network between the server system and the client machine (or machines) and a separate dedicated vMotion network for infrastructure operations. The physical network infrastructure used for virtual machine traffic should be typical of a modern datacenter and should offer performance sufficient to meet the client virtual machines’ resource requirements without introducing delays that might affect the benchmark results. Configure the servers. In either case the underlying system (whether physical or virtual) must be supported by the vCenter version being used and must be configured to meet or exceed the minimum CPU. NOTE If the vCenter Server is run on a virtual machine. and all should be set to at least gigabit speeds. All virtual clients must have identical resource.Chapter 2 VMmark Benchmark Requirements The physical storage used for the virtual machines should be typical of a modern datacenter and should offer performance sufficient to meet the client virtual machines’ resource requirements without introducing delays that might affect the benchmark results. that virtual machine must not be on a host that is part of the cluster under test. Virtual client systems should not be resource constrained and should not be running services or applications unrelated to the benchmark. and each client system with a static IP address. whether an internal company network or the external Internet. Inc. and tuning configurations. 32GB of available disk space (for Windows Server 2008) One virtual network adapter per virtual client. Additionally. Virtual Hardware for Virtual Clients When client functions are run in a virtual client. Network Topology Connect the client system (or systems) to the server system through switches that are dedicated to the benchmark tests and are not shared with any other systems. during the VMmark tests. Figure 2-1 illustrates a sample network configuration. cables. thus artificially skewing the benchmark results. Some configurations might need multiple network links for optimal performance. scheduling. Use of a completely private network facilitates the configuration of the domain controller which is part of each tile and ensures that extraneous network traffic does not impact the VMmark tests. neither the client system (or systems) nor the server systems should have a network connection to any other network. This is to ensure that the system performance is not limited by network bandwidth constraints. and other basic requirements for that product and version. Four virtual CPUs 4GB of RAM 15GB of available disk space (for Windows Server 2003). This can be whatever virtual device type desired. each virtual system must meet or exceed the following requirements: Virtual hardware version 7 or later. VMware. each workload virtual machine.

Sample VMmark Benchmark Network Configuration (Not Shown: vCenter Server. Inc.1 Multi-Host Setup. VMmark 2. . or NFS (SAN shown) SAN 38 VMware.VMware VMmark Benchmarking Guide Figure 2-1. Dedicated vMotion Network) Prime Client Private Gigabit Ethernet switch One client per tile Client Client Server Private Fibre Channel switch Optional SAN. iSCSI.

Chapter 2 VMmark Benchmark Requirements VMmark Software Requirements This section describes the software required in order to run VMmark. 39 . These client machines run Microsoft Windows Server 2003 Enterprise Edition (32-bit) or Microsoft Windows Server 2008 Enterprise Edition (64-bit) with the following applications: NOTE The prime client must be a physical system. The other client systems can be either physical or virtual. Workload Software Requirements Each VMmark tile consists of eight virtual machines: A Microsoft Windows Server 2008 Enterprise Edition 64-bit virtual machine runs the following workload: Mail server: Microsoft Exchange 2007 A Microsoft Windows Server 2003 Enterprise Edition 32-bit virtual machine runs the following workload: Standby system: Powered on. VMmark harness STAF framework and STAX execution engine LoadGen Microsoft Outlook 2007 (standalone or included in Microsoft Office 2007) Microsoft Exchange 2007 management tools Cygwin A Java JDK Rain workload toolkit VMware. Inc. but running no application software Six SLES 11 64-bit Linux virtual machines run the following workloads: Olio database Olio web DVD Store 2 database Three DVD Store 2 web systems Client Software Requirements Each VMmark tile requires a client machine.

1 or later”). When this notation is included. a change in the value of X represents a major revision. but major revisions can not. NOTE Throughout this document we provide URLs from which third-party software packages can be downloaded. or both Y and Z.VMware VMmark Benchmarking Guide Software Versions The VMmark benchmark is designed to work with specific versions of the operating systems. we recommend that all clients and all workload virtual machines be running the same version of STAF. Free Software You can download the following free software packages from the Web: Cygwin environment STAF/STAX software Olio DVD Store 2 Java SDK VMware VMmark Harness (available only as part of the free VMmark download) Evaluation Software You can download evaluation versions of the following software packages from the Web: VMware vSphere (which includes vCenter Server and ESX) tc Server SLES 11 Linux (64-bit) Microsoft Outlook 2007 (standalone or included in Microsoft Office 2007) Purchased Software You must purchase licenses for the following software packages if you do not already own them: 40 VMware. Windows Server 2008). NOTE To avoid communication problems.Y (or X. in some cases it might be necessary to download the required software from alternate locations. some is available in no-cost evaluation versions. The following list summarizes these three categories. the edition (for example.4. and some requires paid licenses. and other software packages. Where it is relevant. or Z. While we believe these URLs to be accurate at the time of publication. Inc. The inclusion of these URLs is intended as a convenience to the user. while a change in the value of Y. . In the case of operating systems.Y. the service pack or release can be later than specified in this guide. workload software. minor revisions later than the one specified can be used with VMmark. for both workload and client systems. often with the notation “or later” (for example.Z). With a version number of the form X. but the base version (for example.1 is free. we can not guarantee their continued accuracy. Software License Summary Some of the software required to run VMmark 2. Enterprise Edition). and the bit architecture (32-bit or 64-bit) should not be changed. the addition of a service pack is considered a minor revision. represents a minor revision. specific versions are called out for each such software package. “STAF version 3. Similarly.

and any release. Thus in total each tile requires one Windows Server 2003 license. 64-bit. 32-bit Enterprise Edition may be used for the client system. The installation and configuration of other releases and service packs might vary slightly from these instructions. 32-bit or Microsoft Windows Server 2008 Enterprise Edition. NOTE Though Windows Server 2008 Enterprise Edition. 64-bit One or two copies per tile (one for the Mail Server and (optionally) one for that tile’s client system). however. CDs). 32-bit One or two copies per tile (one for the standby virtual machine and (optionally) one for that tile’s client system). Microsoft Exchange Server 2007 Enterprise Edition This is available as part of the Microsoft Developer’s Network (MSDN) Universal subscription. NOTE Any Service Pack 1 or later release of Windows Server 2003 Enterprise Edition. and any Service Pack 2 or later release of Windows Server 2003. 32-bit may be used for the standby virtual machine. VMware. are based on the use of Service Pack 2. Microsoft Windows Server 2008 Enterprise Edition. one Windows Server 2008 license. Inc. NOTE Because some of these packages may be available only in physical form (that is. and one additional license of either type. NOTE Each tile needs one client. may be used. The installation and configuration of other releases and service packs may vary slightly from these instructions. 41 .Chapter 2 VMmark Benchmark Requirements Microsoft Windows Server 2003 Enterprise Edition. 64-bit with or without a service pack. order them early in the planning process to allow time for shipping. and that client must be running either Microsoft Windows Server 2003 Enterprise Edition. the installation instructions in this guide are based on the use of Windows Server 2008 Enterprise Edition with Service Pack 2. The instructions in this guide.

Inc. .VMware VMmark Benchmarking Guide 42 VMware.

NOTE vCenter 4. VMware ESX. The hypervisor must either be a released. Install VMware ESX Install a hypervisor (i. It consists of the following sections: “Create the Virtualization Infrastructure” on page 43 “Create the VMmark Tiles” on page 47 Create the Virtualization Infrastructure The following subsections describe the steps needed to prepare the virtualization infrastructure for VMmark 2. generally available version. Make sure that hardware on which you are installing the hypervisor meets the requirements outlined in “Server Hardware Requirements” on page 35. Thus if any of your hosts will be running ESX 4.0 can’t manage ESX 4. 43 . you will need to install vCenter 4. VMware ESXi. NOTE vCenter Server 4.1 Benchmark Tests 3 This chapter describes the steps required in order to prepare the infrastructure for VMmark 2. Inc.. generally available version.1 hosts.1 tests.Preparing the Infrastructure for VMmark 2.1.1.1 is designed to run with vCenter 4. NOTE All ESX hosts should be able to reach the same shared storage in order to enable vMotion and Storage vMotion infrastructure operations. Make sure that all relevant updates and patches are installed. or must meet the pre-release requirements detailed in the VMmark Run and Reporting Rules.0 or later.e. or must meet the pre-release requirements detailed in the VMmark Run and Reporting Rules. The installed version of vCenter must either be a released. Install vSphere vCenter Install a version of VMware vSphere vCenter compatible with VMmark 2. Make sure that all relevant updates and patches are installed.1 requires a 64-bit Windows operating system.1 tests. including the datastore capacity and vMotion compatibility. VMware. or a combination) according to VMware instructions on all servers to be used in the test.1. VMmark 2.

then click Next.. leave Power Management at its default setting of Off. then click Next. Make sure that all hosts can vMotion to all other hosts within the cluster. click the box next to Turn on VMware DRS. At the Ready to Complete window. priority 3. 2 Create a cluster under the datacenter as follows: a b c Right-click on the new datacenter and select New Cluster. make sure that all the ESX hosts in your cluster can reach the same shared storage. At the VMware EVC window. under Fully automated. d e f g 3 4 5 Add hosts to your cluster by right clicking on the cluster name and selecting Add Host.vmware. The following sections describe how to accomplish this. Inc. and priority 4 recommendations. priority 2.. Configure Time Synchronization for ESX Hosts In order to maintain the timing of all systems and virtual machines under test we recommend that all hosts use NTP. choose the VMware EVC setting that best fits your expected hosts in the cluster. vCenter will apply recommendations that promise even a moderate improvement to the cluster’s load balance. Configure Time Synchronization on the ESX Hosts and the vCenter Server The time on the ESX hosts and on the vCenter Server need to be synchronized to a common NTP server. Navigate to and expand the following registry folder: HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\services\W32Time 44 VMware. . choose the Swapfile Policy for Virtual Machines that best fits your benchmarking environment. NOTE If there’s already a datacenter on your vSphere server. At the Power Management window.com/kb/1003736 http://www. follow these steps: 1 2 Open the Windows Registry editor (Start Menu > Run > Regedit).vmware. In order to enable vMotion and Storage vMotion infrastructure operations. the text below the slider should read Apply priority 1. At the Virtual Machine Swapfile Location window.com/kb/1003063 http://kb.com/support/pubs/ Configure Time Synchronization for the vCenter Server To configure your vCenter Server Windows system to synchronize with an external NTP server. closer to the Aggressive label. This can be done via the vSphere Client. At the VMware DRS window.. enter a name for the cluster (recording the name for later use). click Finish. then click Next.... move the Migration threshold: slider to the 4th option (from left to right).VMware VMmark Benchmarking Guide Configure vCenter 1 Using the vSphere Client. then click Next. Follow these links for additional detail: http://kb.vmware. When the slider is in the correct place. use that one instead. then click Next. create a new datacenter on your vSphere server (File > New > Datacenter). At the Cluster Features window.

Click OK. Type Data 900 3600 3600 Table 3-2. Enter the new data from Table 3-2. Repeat for each new entry in Table 3-2. Inc. select the Decimal radio button. Type Data NTP 5 1 Table 3-1. NOTE Use the same NTP server to synchronize your vCenter Server system and all your hosts. If you enter a DNS name (rather than an IP address) you must append . Click OK. modify each of the registry entries as follows: a b c d e f Path Navigate to the entry specified in the path column of Table 3-2. Registry Entries to Change TimeProviders\NtpClient\SpecialPollInterval Config\MaxPosPhaseCorrection Config\MaxNegPhaseCorrection 6 7 Close the registry editor. Enter the DNS name or IP address of your NTP server.) 5 Referring to Table 3-2. navigate to Parameters.1 Benchmark Tests 3 Referring to Table 3-1. as some configurations will also use it for their prime client. Registry Entries to Change Parameters\Type Config\AnnounceFlags TimeProviders\NtpServer\Enabled 4 Modify the NTP server name: a b c d REG_SZ REG_DWORD REG_DWORD Still within W32Time. Enter the new data from Table 3-1. as described in “Install Microsoft Windows Server on a Physical System” on page 63. Right-click the entry and select Modify. If the Type in Table 3-1 is REG_DWORD.0x1 to the end. Select Modify. Right-click the entry and select Modify. 45 . Repeat for each entry in Table 3-1. (Remember which NTP server you’re using. REG_DWORD REG_DWORD REG_DWORD Restart the time service by entering the following at a Command Prompt: net stop w32time && net start w32time VMware. Select the Decimal radio button. Right click on NtpServer.Chapter 3 Preparing the Infrastructure for VMmark 2. modify each of the registry entries as follows: a b c d e f Path Navigate to the entry specified in the path column of Table 3-1.

sdb /cfg c:\SignedOff. create a new OS customization specification that corresponds to your benchmarking environment. Edit the newly-created customization specification: a b 5 6 At Administrator Password screen. See “Prepare the Template for the Deploy Operation” on page 124. making enough copies for all clone and deploy operations your environment will need. edit these copies to change the VMnames and IP addresses (noting them for later use. select the previously created OS customization specification and Duplicate it. you should install the tools from the ESX 4. If your cluster contains four or more hosts and you will be running four or more tiles.0 U2 hosts in your cluster. . 46 VMware. if you have a mix of ESX 4. Time Zone. The number of operations is half of the smaller of either the number of hosts or the number of tiles.VMware VMmark Benchmarking Guide Prepare the vSphere vCenter Server for the Deploy Infrastructure Operations One of the operations in a VMmark 2 test is to deploy a server and upgrade its VMware Tools installation. follow these steps: 1 Create a standby system virtual machine from an existing virtual machine with outdated VMware tools. In order to allow this. Password. Install the sysprep files needed for the Standby virtual machine on the system hosting the vSphere vCenter Server. select Automatically log on as the Administrator. Inc. Once done. available on the VMware website. This specification must allow a newly deployed virtual machine to be able to be customized and then pinged by the prime client. NOTE Only ESX servers in this cluster will be used for the VMmark 2. VMware Tools must be installed but must be older than the oldest host in your cluster. To prepare your environment.0 U1 and ESX 4. Servers can be moved into and out of the cluster as needed for testing or they can be placed into maintenance mode to remove them testing. 7 Move the ESX servers you will be testing into this cluster. Instructions to do this can be found in vSphere Basic System Administration.1 test. Using the vSphere vCenter Server's Customization Specifications Manager (View > Management > Customization Specification Manager). then set Number of times to logon automatically: 100 times. VMmark will attempt additional simultaneous Clone and deploy operations. Windows License. add the following command: secedit /configure /db c:\SignedOff. when you edit the VMMARK2.0 initial release. Take special care in filling out the Computer Name. At the Run Once menu. For example. not conflicting with any other virtual machine names or IP addresses.CONFIG file in “Configure the VMmark Harness” on page 75).ini 2 3 4 Save the customization specification. and Networking options. rounded down to an integer.

then make backups of this working configuration before cloning the workload virtual machines to create the additional tiles.Chapter 3 Preparing the Infrastructure for VMmark 2. which run Windows. 47 .1 Benchmark Tests Create the VMmark Tiles Each VMmark tile consists of eight workload virtual machines: Mail server virtual machine (running Exchange) Standby virtual machine (an idle machine) Olio database virtual machine (running the Olio database application) Olio web virtual machine (running the Olio web driver) DVD Store 2 database virtual machine (running the DS2 back end database component) DVD Store 2 web A virtual machine (running the DS2 driver) DVD Store 2 web B virtual machine (running the DS2 driver) DVD Store 2 web C virtual machine (running the DS2 driver) The following sections describe the creation of these virtual machines. must be built from scratch. More information about this methodology can be found in “Performing a Short Run” on page 158. VMware. Other interfaces and other hypervisors may be different. Tile0) and make sure it is working smoothly. NOTE It can be useful to create one complete tile (that is. running SLES 11. NOTE These sections describe procedures using the VMware vCenter Client connected to an ESX host. available for the Olio workload (both database and web tiers) and the DVD Store workload (both database and Web tiers). The initial mail server and standby virtual machines. You may use these templates to avoid having to build the virtual machines from scratch. Inc. There are template virtual machines.

Tile2 Virtual machines should be named StandbyN. DS2WebAN. and virtual machine powered on review before run. 48 VMware. DS2DBN. with N replaced by the appropriate tile number. virtual machine resources review (vCPU and memory) before run. Inc. DS2WebBN. OlioDBN. starting from zero. several areas of functionality during the benchmark run will be hampered. Tile1. DS2WebCN. MailserverN. . for Tile0: Standby0 Mailserver0 OlioDB0 OlioWeb0 DS2DB0 DS2WebA0 DS2WebB0 DS2WebC0 And for Tile 1: Standby1 Mailserver1 OlioDB1 OlioWeb1 DS2DB1 DS2WebA1 DS2WebB1 DS2WebC1 If these naming rules are not adhered to. we highly recommended that you adhere to the following naming conventions when creating the tiles and virtual machines: Tiles should be numbered. Example: Tile0. For Example.VMware VMmark Benchmarking Guide NOTE For full harness functionality. These are: automatic tile to host placement before run. OlioWebN.

changing these settings is time consuming. create the database and backup drives. and make as many clones of the mail server virtual machine template as you will need (one for each tile you expect to run). Follow the instructions in “Configure STAF to Start Automatically” on page 123.1 Benchmark Tests Create the Mail Server Virtual Machines This section describes the creation of the mail server virtual machines.Chapter 3 Preparing the Infrastructure for VMmark 2. The initial mail server virtual machine must be build from scratch. 49 . See Figure 3-1 for an overview of the process. and promote each of the Exchange virtual machines to be a domain controller. 3 4 5 6 7 8 Follow the instructions in “Make the Mail Server Virtual Machine a Domain Controller” on page 120. clone that virtual machine. It is most efficient to partially configure a virtual machine as a template. Inc. Follow the instructions in “Install Microsoft Exchange Server 2007” on page 121. VMware. install and configure STAF. and install the software on each of the Exchange virtual machines. because it acts as the domain controller for all the virtual machines in its tile. and configure each of the Exchange virtual machines. After the machine is fully configured. and configure each of the Exchange virtual machines. Follow the instructions in “Increase the Transport Database Cache Size” on page 122. Follow the instructions in “Clone the Mail Server Virtual Machines” on page 119. there is no template virtual machine available. install VMware Tools. To create the mail server virtual machines 1 Follow the instructions in “Create and Configure the Mail Server Virtual Machines” on page 105 to create a virtual machine for the mail server. the mail server requires custom settings for each tile. 2 NOTE Unlike the other virtual machines. Follow the instructions in “Update Exchange Server 2007” on page 122. and install Windows Server components and support tools. and complete the configuration within each clone. install Windows. Follow the instructions in “Configure Microsoft Exchange Server” on page 121. and update each of the Exchange virtual machines. and increase the cache size on each of the Exchange virtual machines.

Inc.. Overview of Virtual Machine Creation for Mail Server Workloads Create Mail Server VM Template “MailServerTemplate” Install MS Windows Install VMware Tools Clone for Each Tile mailserver0 Configure mailserver1 Configure mailserver2 Configure . ..VMware VMmark Benchmarking Guide Figure 3-1. Install MS Exchange Install MS Exchange Install MS Exchange 50 VMware.

See Figure 3-2 for an overview of the process. and create the standby virtual machine for tile 0. there is no template virtual machine available.Chapter 3 Preparing the Infrastructure for VMmark 2. and create a virtual machine for the standby system using the following specifications: Name: standby0 Virtual processors: 1 Virtual memory: 512MB Disk Size: 4GB 2 3 Follow the instructions in “Prepare the Standby Virtual Machines” on page 124.1 Benchmark Tests Create the Standby Virtual Machines This section describes the creation of the standby virtual machines. Inc. VMware. Follow the instructions in “Clone the Standby Virtual Machine” on page 124. To create the standby virtual machines 1 Follow the instructions in “Create and Configure the Standby Virtual Machines” on page 100. and make as many clones of the standby virtual machine as you will need (one for each additional tile you expect to run). 51 . The initial standby virtual machine must be build from scratch.

VMware VMmark Benchmarking Guide Figure 3-2.. Overview of Virtual Machine Creation for Standby Workloads Create First Standby VM (“standby0”) Install MS Windows Install VMware Tools Configure Clone for Additional Tiles standby1 standby2 standby3 . Inc. .. 52 VMware.

. and follow the instructions to add the virtual machine to the vCenter inventory.com/kb/1017910). see VMware Knowledge Base article #1017910 (http://kb. 4 5 6 VMware. Navigate to the directory where you placed the virtual machine files. Within the vSphere Client Inventory pane. and make as many clones of the Olio database virtual machine as you will need (one for each additional tile you expect to run).tgz file by entering the following from an ESX/ESXi command line: cd /vmfs/volumes/<datastore> tar xvzf <template. as described in “Clone the Olio Database Virtual Machine” on page 128.vmware.tgz file to a datastore accessible from the ESX/ESXi hosts in your cluster. Alternatively. NOTE To enable remote tech support mode in ESXi. as described in “Create and Configure the SLES Virtual Machines” on page 112 and “Prepare the Olio Database Virtual Machines” on page 125.tgz file. 53 . you can also configure the virtual machine from scratch. as described in Appendix A. Right click on the . Inc. 3 Uncompress the template virtual machine . select the Summary tab.. allowing SCP connections. and select Browse Datastore. See Figure 3-3 for an overview of the process.tgz> (where <datastore> is the datastore and directory where you placed the virtual disk template file and <template. You would then skip the rest of this section. you may build this virtual machine from scratch.vmx file. Clone the pre-built virtual machine. NOTE This can be done using WinSCP or Cygwin from Windows. select the desired ESX/ESXi host. in the Resources pane right-click the datastore where you placed the virtual machine files.Chapter 3 Preparing the Infrastructure for VMmark 2. To create the Olio database virtual machines 1 Using a Windows or Linux system. 2 Copy the template virtual machine . “Create and Configure the SLES Virtual Machines” on page 112. or SCP or an NFS mount from Linux.. select Add to Inventory.tgz> is the name of the virtual disk template file). NOTE If you don’t wish to use this pre-built virtual disk file. download from VMware the pre-built Olio database template virtual machine .1 Benchmark Tests Create the Olio Database Virtual Machines This section describes the creation of the Olio database virtual machines using the pre-built template virtual machine available from VMware.

.VMware VMmark Benchmarking Guide Figure 3-3. Inc.. . Overview of Virtual Machine Creation for Olio Database Download Pre-Built Olio Database VM Clone Pre-Built VM as “OlioDB0” Clone for Additional Tiles OlioDB1 OlioDB2 OlioDB3 . 54 VMware.

allowing SCP connections.tgz> (where <datastore> is the datastore and directory where you placed the virtual disk template file and <template.. see VMware Knowledge Base article #1017910 (http://kb. select the Summary tab. you may build this virtual machine from scratch. Within the vSphere Client Inventory pane. 3 Uncompress the template virtual machine . as described in Appendix A.tgz file. Inc.com/kb/1017910).Chapter 3 Preparing the Infrastructure for VMmark 2.. as described in “Create and Configure the SLES Virtual Machines” on page 112 and “Prepare the Olio Web Virtual Machines” on page 129. You would then skip the rest of this section. 2 Copy the template virtual machine . Navigate to the directory where you placed the virtual machine files. 4 5 6 VMware. in the Resources pane right-click the datastore where you placed the virtual machine files.tgz> is the name of the virtual disk template file). or SCP or an NFS mount from Linux.vmware. 1 Using a Windows or Linux system.1 Benchmark Tests Create the Olio Web Virtual Machines This section describes the creation of the Olio web virtual machines using the pre-built template VM available from VMware. download from VMware the pre-built Olio web template virtual machine . See Figure 3-4 for an overview of the process. select Add to Inventory. and select Browse Datastore.. and follow the instructions to add the virtual machine to the vCenter inventory. NOTE If you don’t wish to use this pre-built virtual disk file. NOTE To enable remote tech support mode in ESXi. Right click on the . select the desired ESX/ESXi host. “Create and Configure the SLES Virtual Machines” on page 112. as described in “Clone the Olio Web Virtual Machine” on page 134. Clone the pre-built virtual machine.vmx file. 55 . Alternatively.tgz file by entering the following from an ESX/ESXi command line: cd /vmfs/volumes/<datastore> tar xvzf <template.tgz file to a datastore accessible from the ESX/ESXi hosts in your cluster. you can also configure the virtual machine from scratch. and make as many clones of the Olio web virtual machine as you will need (one for each additional tile you expect to run). NOTE This can be done using WinSCP or Cygwin from Windows.

tc Server. .VMware VMmark Benchmarking Guide Figure 3-4.. Overview of Virtual Machine Creation for Olio Web Download Pre-Built Olio Web VM Install Java.. Inc. 56 VMware. Clone Pre-Built VM as “OlioWeb0” Clone for Additional Tiles OlioWeb1 OlioWeb2 OlioWeb3 . etc.

vmx file. or SCP or an NFS mount from Linux. download from VMware the pre-built DVD Store 2 database template virtual machine . you can also configure the virtual machine from scratch.vmware. 57 .. allowing SCP connections. you may build this virtual machine from scratch. Clone the pre-built virtual machine. You would then skip the rest of this section. select the Summary tab. 2 Copy the template virtual machine .tgz> is the name of the virtual disk template file). Steps 1-3 of that procedure have already been completed in the template virtual machine.com/kb/1017910). Navigate to the directory where you placed the virtual machine files. 4 5 6 7 VMware. and make as many clones of the DVD Store 2 database virtual machine as you will need (one for each additional tile you expect to run). Right click on the .. NOTE This can be done using WinSCP or Cygwin from Windows. and follow the instructions to add the virtual machine to the vCenter inventory.tgz file by entering the following from an ESX/ESXi command line: cd /vmfs/volumes/<datastore> tar xvzf <template. Prepare the DVD Store 2 database. See Figure 3-5 for an overview of the process. To create the DVD Store 2 database virtual machines 1 Using a Windows or Linux system. and select Browse Datastore. NOTE If you don’t wish to use this pre-built virtual disk file. NOTE To enable remote tech support mode in ESXi. as described in Appendix A. Within the vSphere Client Inventory pane. select the desired ESX/ESXi host. Alternatively. 3 Uncompress the template virtual machine .. Inc. “Create and Configure the SLES Virtual Machines” on page 112. select Add to Inventory.tgz> (where <datastore> is the datastore and directory where you placed the virtual disk template file and <template.tgz file.1 Benchmark Tests Create the DVD Store 2 Database Virtual Machines This section describes the creation of the DVD Store 2 database virtual machines using the pre-built template VM available from VMware. as described in “Clone the DVD Store 2 Database Virtual Machine” on page 139.tgz file to a datastore accessible from the ESX/ESXi hosts in your cluster. as described in “Prepare the DVD Store 2 Database” on page 138. in the Resources pane right-click the datastore where you placed the virtual machine files. see VMware Knowledge Base article #1017910 (http://kb.Chapter 3 Preparing the Infrastructure for VMmark 2. as described in “Create and Configure the SLES Virtual Machines” on page 112 and “Prepare the DVD Store 2 Database Virtual Machines” on page 135.

. 58 VMware. Inc.VMware VMmark Benchmarking Guide Figure 3-5.. Overview of Virtual Machine Creation for DVD Store 2 Database Download Pre-Built DVD Store 2 Database VM Create Temporary 20GB Disk Prepare Database Clone Pre-Built VM as “DS2DB0” Clone for Additional Tiles DS2DB1 DS2DB2 DS2DB3 . .

Chapter 3 Preparing the Infrastructure for VMmark 2.. Follow the instructions in “Copy and Clone the DVD Store 2 Web Virtual Machine” on page 141 to clone the pre-built virtual machine (naming the clone DS2WebA0) and configure its network and hostname settings. 59 . then to make two more copies (naming them DS2WebB0 and DS2WebC0) and configure their network and hostname settings. 4 5 6 VMware. and select Browse Datastore. “Create and Configure the SLES Virtual Machines” on page 112. Within the vSphere Client Inventory pane. Navigate to the directory where you placed the virtual machine files. NOTE If you don’t wish to use this pre-built virtual disk file. then make as many clones of the DVD Store 2 web virtual machines as you will need (three for each additional tile you expect to run). See Figure 3-5 for an overview of the process. Inc. see VMware Knowledge Base article #1017910 (http://kb.1 Benchmark Tests Create the DVD Store 2 Web Virtual Machines This section describes the creation of the DVD Store 2 web virtual machines using the pre-built template VM available from VMware. NOTE To enable remote tech support mode in ESXi. and follow the instructions to add the virtual machine to the vCenter inventory. Right click on the . you may build this virtual machine from scratch. select the desired ESX/ESXi host.tgz file to a datastore accessible from the ESX/ESXi hosts in your cluster. Alternatively.tgz> (where <datastore> is the datastore and directory where you placed the virtual disk template file and <template. 3 Uncompress the template virtual machine . 2 Copy the template virtual machine . and configure their network and hostname settings. as described in Appendix A. To create the DVD Store 2 web virtual machines 1 Using a Windows or Linux system.vmx file.vmware. download from VMware the pre-built DVD Store 2 web template virtual machine .tgz> is the name of the virtual disk template file).. You would then skip the rest of this section.tgz file by entering the following from an ESX/ESXi command line: cd /vmfs/volumes/<datastore> tar xvzf <template.. you can also configure the virtual machine from scratch.tgz file. in the Resources pane right-click the datastore where you placed the virtual machine files. select the Summary tab. NOTE This can be done using WinSCP or Cygwin from Windows. as described in “Create and Configure the SLES Virtual Machines” on page 112 and “Prepare the DVD Store 2 Web Virtual Machines” on page 140.com/kb/1017910). or SCP or an NFS mount from Linux. allowing SCP connections. select Add to Inventory.

.. Inc. . 60 VMware. “DS2WebB0”. & “DS2WebC0” Clone for Additional Tiles (three copies for each tile) DS2WebA1 DS2WebB1 DS2WebC1 DS2WebA2 DS2WebB2 DS2WebC2 DS2WebA3 DS2WebB3 DS2WebC3 . Overview of Virtual Machine Creation for DVD Store 2 Web Download Pre-Built DVD Store 2 Web VM Clone Pre-Built VM three times as “DS2WebA0”.VMware VMmark Benchmarking Guide Figure 3-6.

“Install and Configure the Workload Client Software” on page 84. 61 . Inc. NOTE The prime client must be a physical machine. “Configure Microsoft Windows on the Client Systems” on page 66. the client software for workload virtual machines. Proceed to the appropriate section below. “Install Microsoft Windows Server on the Client Systems” on page 63. Once the physical machine is ready. This includes the operating system. subject to the limitations described in “Client Hardware Requirements” on page 36. Prepare a Client Physical Machine If you will be creating a client system on a physical machine. The chapter consists of the following sections: “Prepare the Client Machine” on page 61. “Create Additional Client Systems” on page 83. one of which is needed for each tile in the VMmark Benchmark test. make sure the system meets the requirements detailed in “Hardware Requirements for Physical Clients” on page 36. and. proceed to install Microsoft Windows Server.Configuring the Client Systems 4 This chapter describes the configuration required for the client machines.1. Prepare the Client Machine As of VMmark 2. “Install the General Software” on page 69. on the prime client system. as described in “Install Microsoft Windows Server on the Client Systems” on page 63. You can either clone the template you created for the mailserver workload virtual machine or create new virtual machine from scratch. VMware. the VMmark Harness that controls the workloads. “Install and Configure the VMmark Harness” on page 75. client systems can be either physical machines or virtual machines. Prepare a Client Virtual Machine This section describes the creation of a client virtual machine.

13 At the Ready to Complete window. then click Next. When you are asked to Specify a Name and Location for this Virtual Machine. then click Next. 9 10 11 When asked Which SCSI controller type would you like to use?. select Create a new virtual disk. When asked to Specify the virtual disk size and provisioning policy.. Enterprise Edition (32-bit). Remove the second virtual disk (used in the mailserver for the database and backup drives). select 4. choosing it at this point will save a few steps later. as appropriate. then click Next. then click Next. Inc. you might not have network access from the virtual machine until you install VMware Tools. however. select the Custom radio button. When you are asked to Specify the guest operating system.. then click Next. then click Next. then click Next.. follow these steps: Using the New Virtual Machine wizard in the VMware vCenter Client (Inventory > File > New > Virtual Machine). naming the clone client-template..VMware VMmark Benchmarking Guide To clone the mailserver template workload virtual machine: 1 Clone the mailserver0 template you created in “Create and Configure the Mail Server Virtual Machines” on page 105. When you are asked the Memory Configuration. select a location (either Store with the virtual machine or Specify a datastore:). make sure Connect at Power On is checked. select Virtual Machine Version: 7. NOTE If you will be using the high-performance VMXNET3 adapter. which includes the custom VMXNET3 driver. When you are asked for a Virtual Machine Version. When you are asked to specify the Number of virtual processors. 62 VMware. When asked to Select the type of disk to use. configure a new virtual machine with the following settings: 1 2 3 4 5 When you are asked to Select the configuration for the virtual machine. then click Next. The prime client must be a physical machine. enter 32GB. If you do so.. To create a client virtual machine from scratch. When you are asked to Select a Datastore. Skip ahead to “Install a Java JRE” on page 72 and follow the instructions from that point forward. leave the options unchanged: Virtual Device Node: SCSI (0:0) Mode: Independent: leave unselected Then click Next. When you are asked to Create Network Connections. select the Microsoft Windows radio button and in the Version: window choose Microsoft Windows Server 2008. proceed to install Microsoft Windows Server. choose the Adapter type. choose the network to use. as described in “Install Microsoft Windows Server on the Client Systems” on page 63. leave the Disk Provisioning options unchecked. 2 3 4 Change the virtual machine memory size to 4GB. enter client-template. select 4GB. choose either the LSI Logic Parallel or LSI Logic SAS. set the number of NICs to 1. Enterprise Edition (64-bit) or Microsoft Windows Server 2003. select your desired datastore. click Finish to create the virtual machine. then click Next. NOTE The client virtual machines must not be run on a host that is part of the cluster under test. 6 7 8 12 Once the virtual machine is ready. then click Next. then click Next.. . In the Advanced Options window.

both high-priority and optional (but don’t turn on automatic updating).your. The installation and configuration of other releases and service packs might vary slightly from these instructions. Click the Connect/disconnect the CD/DVD. you will need to configure the prime client to use the same NTP time source as the vCenter server and ESX hosts. You will see the virtual machine try to boot.Chapter 4 Configuring the Client Systems Install Microsoft Windows Server on the Client Systems This section describes the installation of Microsoft Windows Server on the client systems.com is your company’s domain name. Inc. button in the menu bar (it looks like a CD with a wrench in front of it). but fail. For Windows Server 2008 clients you can use other Windows Server 2008 releases or service packs. select it. Proceed to the appropriate section below: “Install Microsoft Windows Server on a Physical System” on page 63.com. and your. However.. and click Open. if your setup separates the prime client and client0 functions onto two servers. under Commands. where N is the tile number that this client machine will be controlling.company. From the Summary tab in the vCenter Client. NOTE The Windows Server 2003 instructions in this Chapter are based on the use of Windows Server 2003 Enterprise Edition with Service Pack 2. with at least Service Pack 2) or Microsoft Windows Server 2008 Enterprise Edition (64-bit) on the virtual machine. proceed to “Configure Microsoft Windows on the Client Systems” on page 66. select CD/DVD Drive 1. For Windows Server 2003 clients you can start with other Windows Server 2003 releases or service packs. The Windows Server 2008 instructions in this Chapter are based on the use of Windows Server 2008 Enterprise Edition with Service Pack 2. the second would be client1. but you must use 64-bit Enterprise Edition. with at least Service Pack 2) or Microsoft Windows Server 2008 Enterprise Edition (64-bit) on each client system. Select the correct virtual machine (created in “Prepare a Client Virtual Machine” on page 61). perform any configuration steps necessary for network access in your environment. The first client would be client0. 63 . Select the Console tab in the vCenter Client. Do this with any third-party “CD ripping” software tool. as described in “Configure Time Synchronization for the vCenter Server” on page 44. and so on.... (either on local disk or on a datastore). Once the installation is complete. Browse to the ISO image of the first operating system installation disc.company. 7 VMware. but you must use 32-bit Enterprise Edition and you must upgrade each client system to at least Service Pack 2 before running the benchmark. The installation and configuration of other releases and service packs vary slightly from these instructions.com. then select Connect to ISO image.company. NOTE The client systems should be named clientN. 1 2 3 4 5 6 Create an ISO image of the operating system installation disc(s). Install Microsoft Windows Server on a Physical System Install Microsoft Windows Server 2003 Enterprise Edition (32-bit.your. select Power On. Copy the ISO image file(s) to a file system accessible from the system running the VMware vCenter Client.company.your. The simplest way to install an operating system in a virtual machine is to use an ISO image (or images) of the installation disc (or discs). “Install Microsoft Windows Server on a Virtual System” on page 63. Install Microsoft Windows Server on a Virtual System Install Microsoft Windows Server 2003 Enterprise Edition (32-bit.com. and install all available updates. NOTE Physical clients will typically obtain time synchronization from their mailserver.

Inc. Make any configuration changes required. saving it to a file system accessible from the system running the VMware vCenter Client.. and causes it to reboot).. Note that if you change network drivers after an operating system is installed. click Yes to allow the system to be restarted. Click the Connect/disconnect the CD/DVD. an Initial Configuration Tasks wizard will come up. Adjust the screen resolution if desired (Start Menu > Control Panel > Personalization > Display Settings).VMware VMmark Benchmarking Guide 8 9 Still under the Console tab in the vCenter Client. for example. To use this driver. 10 11 12 13 Follow the Microsoft Windows installation prompts until the installation is complete.vmware. From a web browser on the vCenter Server system. navigate to http://packages. Inc. and download its . . then click OK. NOTE If you have problems getting the system to boot from the ISO image. click within the center of the console window (you may see no change. (either on local disk. choose Typical. and click Next. This brings up a boot menu. you can press <Esc> as the virtual machine is booting. After the Windows Desktop appears. then click Close. this time inside the virtual machine console (it may take a few minutes). click Install. or your cursor may disappear). When the Setup Type window appears.com/tools/esx. you might need to reconfigure any networking settings. In the vCenter Client. select CD/DVD Drive 1.. provide a new Administrator password. For VMware ESXi: 1 2 Power-on the virtual machine. click Next. When a Welcome to the installation wizard for VMware Tools window appears. then select Connect to ISO image. When the installation is complete and the system reboots. Restart the virtual machine by pressing <Ctrl><Alt><Insert> (this gets passed to the virtual machine as <Ctrl><Alt><Delete>. 3 4 5 64 VMware. button in the menu bar (it looks like a CD with a wrench in front of it).exe Published by VMware. select the ESX version and host operating system you're running. right-click on the virtual machine and select Guest > Install/Upgrade VMware Tools. it might be necessary to manually select it instead of the automatically-installed driver. accepting the defaults. For VMware ESX (as opposed to ESXi. or on a datastore). click Finish.iso file. The virtual machine will boot from the ISO image. At the VMware Tools window. and click Open. When the Ready to Install the Program window appears. which is addressed in the next section): 1 2 3 4 5 6 7 8 Power-on the virtual machine. proxy server or IP address.. select it. When the Installation Wizard Completed window appears.iso file you just downloaded. click Run setup. If an AutoPlay window appears in the guest operating system. Install the VMware Tools Package in Microsoft Windows Follow these steps to install the VMware Tools package in the Microsoft Windows virtual machine: NOTE Among the drivers included in the VMware Tools package is a high-performance VMXNET3 network driver. click Next. then follow the subsequent Windows prompts. Browse to the VMware Tools . When a Welcome to the installation wizard for VMware Tools window appears. from which you can select CD-ROM Drive.

Under Important Updates select Never check for updates (not recommended). double-click Automatic Updates. click Change Settings. VMware. click Install. install them. Install any new Windows Update software. and repeat until no more updates appear. Enable Time Synchronization in VMware Tools 1 2 3 4 After the system has restarted. click Yes to allow the system to be restarted. by following these steps: 1 2 3 4 5 6 7 Run Windows Update (Start Menu > All Programs > Windows Update). If there are more available. At the Automatic Updates window. then install all available updates. but don’t turn on automatic updating. At the Control Panel. 65 . make sure the radio button for Turn off Automatic Updates is selected. install them. For Windows Server 2008: Install all available windows updates. right-click the VMware icon in the system tray on the task bar and choose Open VMware Tools. click Custom. both high-priority and optional. When the updates are complete. If there are more available. restart the system by clicking Restart now. Click OK to close the dialog box. Click the Check for updates button. then click OK. After the system restarts. by following these steps: 1 2 3 4 5 Run Windows Update (Start Menu > Windows Update). Check the box next to Time synchronization between the virtual machine and the host operating system. At the Microsoft Windows Update page. Install Windows Updates For Windows Server 2003: Install all available windows updates. choose Typical. Turn off automatic updates by following these steps: 1 2 3 4 Open the Control Panel (Start Menu > Settings > Control Panel). check again for updates. both high-priority and optional. Install any new Windows Update software. After the system restarts. click Finish. check again for updates. When the Installation Wizard Completed window appears. restart the system. and repeat until no more updates appear. At the VMware Tools window. restart the system by clicking Restart now. and click Next. then install all available updates. Inc. then click OK. When the Ready to Install the Program window appears. When the updates are complete. both high-priority and optional. restart the system. Select the Options tab. In the Windows Update window.Chapter 4 Configuring the Client Systems 6 7 8 9 When the Setup Type window appears. Close the Control Panel.

VMware. For Windows Server 2003: 1 2 3 4 5 6 7 8 9 10 Open the Start menu. At the Web Server (IIS) window. click Install. Inc. you’ll need to configure it. Click Next and complete the installation. Click the Details button. click Next. click Roles. causing the component to be highlighted but not resulting in a checkmark in the box. Click the Details button. as described in this section. In the Components list click on Application Server. When the Add features required for Web Server (IIS)? window appears. click Next. At the Select Server Roles window. Close the Server Manager window. then OK again to return to the Windows Component Wizard window. In the left pane. At the Installation Results window. Back at the Select Server Roles window. 10 11 12 13 66 . then click Close. wait for the installation to complete. click Next. Click OK to return to Application Server window. click Add Roles. add a checkmark next to Web Server (IIS). At the Select Role Services window add checkmarks to the following role services: Basic Authentication Windows Authentication Digest Authentication Dynamic Content Compression IIS 6 Metabase Compatibility IIS 6 Management Console Still in the Select Role Services window. click the Add Required Features button. In the Subcomponents of Internet Information Services (IIS) list click the Common Files check box. In the right pane of the Server Manager window. At the Before You Begin window. In the left pane of the Server Manager window. resulting in a checkmark in the box.VMware VMmark Benchmarking Guide Configure Microsoft Windows on the Client Systems Once Microsoft Windows is installed in the client system according to the instructions in “Install Microsoft Windows Server on the Client Systems” on page 63. In the Subcomponents of Application Server list click on Internet Information Services (IIS). At this point you might be prompted for an installation disc. then select Settings > Control Panel > Add or Remove Programs. Install Windows Server Components Follow the instructions in the appropriate section below (for either Windows Server 2003 or Windows Server 2008) to install various Windows Server components. click Next. For Windows Server 2008: 1 2 3 4 5 6 7 8 9 Open the Start menu and select Server Manager. At the Confirm Installation Selections window. select Add/Remove Windows Components. causing the component to be highlighted but not resulting in a checkmark in the box.

disable the Data Execution Prevention (DEP) feature in the Microsoft Windows boot. click the Edit button.exe) on the client systems. however. VMware.aspx?FamilyId=f002462b-c8f2-417a-92a3-287f5f81407e&di splaylang=en Install the update (WindowsServer2003-KB968930-x86-ENG.com/support/developer/PowerCLI/ Install the package on the client system. 2 Install vSphere PowerCLI 1 2 Download the latest version of VMware vSphere PowerCLI from: http://www. Inc. Reboot the client system. a b Accept all defaults.ini file will open in Notepad. to have them on the other client systems as well. NOTE This section is not required for Windows Server 2008 clients.microsoft.Chapter 4 Configuring the Client Systems Disable Data Execution Prevention (DEP) on the Client In order to avoid LoadGen crashes on the Windows Server 2003 client systems.microsoft.com/downloads/details. In the System startup section.vmware. Install or Update Windows PowerShell and vSphere PowerCLI For Windows Server 2003 The prime client needs PowerShell version 2 and vSphere PowerCLI. wait for the VIX installation to finish before continuing. The boot. More information about this feature may be found at: http://msdn. In the Startup and Recovery section. Install Windows PowerShell Version 2 1 Download the Windows Management Framework Core package update from: http://www. Click OK to close the Startup and Recovery window.ini file (File > Save) and close Notepad.aspx To disable DEP 1 Open the file C:\boot. including VIX installation. After vSphere PowerCLI finishes installing. It doesn’t hurt.com/en-us/library/ff557134. Click the Advanced tab. click the Settings button. Change the value of the /noexecute option to alwaysoff: multi(0)disk(0)rdisk(0)partition(1)\WINDOWS="Windows Server 2003.ini for editing a b c d 2 Open the System Properties utility (Start Menu > Control Panel > System). 67 . Click OK to close the System Properties utility.ini file. Enterprise" /noexecute=alwaysoff /fastdetect 3 4 5 6 Save the boot.

a b Accept all defaults. click Features. In the Confirm Installation Selections window. then click Next. add a checkmark next to Windows PowerShell. Inc.com/support/developer/PowerCLI/ Install the package on the client system. including VIX installation. restart the system. Run Windows Update (Start Menu > All Programs > Windows Update). In the Select Features window. At the Installation Results window click Close. click Add Features. When the updates are complete. . In the right pane of the Server Manager window. Close the Server Manager window. click Install. Install vSphere PowerCLI 1 2 Download the latest version of VMware vSphere PowerCLI from: http://www. Click the Check for updates button. After vSphere PowerCLI finishes installing. 68 VMware. wait for the VIX installation to finish before continuing.vmware. Install all available updates (including optional updates). In the left pane of the Server Manager window.VMware VMmark Benchmarking Guide For Windows Server 2008 Install Windows PowerShell 1 2 3 4 5 6 7 8 9 10 11 Open the Start menu and select Server Manager.

button. Back at the Add a Program window. Install the STAF Package Follow these steps to install the STAF package in the client system: 1 2 Go to: http://staf. and leaving all options at their defaults. Install and Configure the STAF Package Install and configure the STAF package in the client system.sourceforge. we recommend that all clients and all workload virtual machines be running the same version of STAF. navigate to C:\staf\bin\STAFProc. Follow these steps to configure STAF to start when the system boots: For Windows Server 2003: 1 2 VMware.exe to Pass Through Windows Server 2008 includes a firewall. In the Windows Firewall window. 2003. depending on the current version of the package. Configure the Windows Server 2008 Firewall to Allow STAFProc.net/getcurrent.exe (The exact name of the file might be different. Follow these steps to configure the Windows firewall to allow STAF to pass through: 1 2 3 4 5 6 7 8 Open the Start menu then select Control Panel. double-click Windows Firewall. Vista. When the Scheduled Task Wizard appears. this will be: Windows 2000. Windows 7 (32-bit) and the filename will be similar to: STAF344-setup-win32. then click the Open button.4.) 3 Run the executable setup file. In the Control Panel window. Windows 7 (AMD64.php Download the executable (*. click OK. 69 . For 32-bit operating systems.Chapter 4 Configuring the Client Systems Install the General Software Each client system requires a number of support packages in order to interoperate with the VMmark Harness and with the workloads. this will be: Windows Server 2003/2008/2008R2. Back at the Windows Firewall window click OK. click Allow a program through Windows Firewall. Configure STAF to Start Automatically By default STAF starts when a user first logs in.) For 64-bit operating systems. click Next. The sections below describe the installation of these packages. In the Windows Firewall Settings window click the Add Program. XP. NOTE To avoid communication problems. the exact name of the file might be different.1 or later STAF package with a bundled JVM. Inc. aka x64) and the filename will be similar to: STAF344-setup-winamd64. In the Browse window. following the prompts to install the software. and choose Control Panel > Scheduled Tasks > Add Scheduled Task. as described in the following sections. WinSrv2008.exe (Again..exe.exe) version 3. Vista. In the Add a Program window.. depending on the current version of the package. click Browse. Open the Start menu.

then click Finish. select the Settings tab. NOTE For the prime client. In the Start a Program window. Restart windows. select the Run whether user is logged on or not radio button. Inc. click Next. select the When I log on radio button instead of the When my computer starts radio button. button. enter the administrator password. uncheck it. then click Open. then click Next. select the startSTAFProc Windows Batch File (not the startSTAFProc Icon). enter the Administrator username and click OK. then click OK. select Start a program. Click Finish. At the Task Scheduler window. 7 8 9 10 11 12 13 14 15 16 17 18 In the Action window.4. Remove <computername> if it appears as a prefix.bat. select When the computer starts. Restart windows. Close the Task Scheduler window. NOTE For the prime client. Check the Open Advanced properties for this task when I click Finish box. select the When I log on radio button instead of the When the computer starts radio button. and click Next. You might have to browse to C:\STAF\startSTAFProc. double-click Administrative Tools. select it. Click to OK to close the properties window. then click Next. enter STAF. Back at the STAF Properties (Local Computer) window. select the Settings tab and remove the check mark next to Stop the task if it runs longer than:. then click Next. (The exact entry will vary depending on which version of STAF you have installed. then click OK. click Create Basic Task. In the Task Trigger window. enter password. . click Browse. double-click Task Scheduler.. At the STAF Properties (Local Computer) window.VMware VMmark Benchmarking Guide 3 Scroll to Start STAF 3. under the General tab. in the right-most pane (Actions).4. At the Summary window. add a check mark next to Open the Properties dialog for this task when I click Finish. In the Control Panel window. Back at the Start a Program window. In the Create Basic Task Wizard window. go to C:\STAF\. 70 VMware. In the Task Scheduler window. For Windows Server 2008: 1 2 3 4 5 6 Open the Start menu then select Control Panel. 4 5 6 7 8 9 10 11 Enter (or confirm) the Administrator user name. If the box labeled Stop the task if it runs for [72] hours is checked. In the Administrative Tools window.. When the Start STAF properties window opens. and click Next. Click the Change User or Group. At the Select User or Group window. in the Name: filed. and click Next.) Select the When my computer starts radio button. Close the Administrative Tools window.

Inc. (To see this file. you have to change Files of type to All Documents (*. Follow these steps to install and configure the STAX execution engine in the client system: 1 2 3 Download version 3. Install the STAF EVENT Service Follow these steps to install and configure the STAF EVENT service in the client system: 1 2 Download version 3.txt.sourceforge.cfg from Client 0 for another client.4 or later of the EVENT package from: http://staf.1 or later of the STAX package for Windows from: http://staf.cfg. placing the event directory it contains into the C:\STAF\services directory.php Create a services directory under the STAF directory. It will save as STAF.cfg.cfg.1.) NOTE If you have customized a STAF. to trust all machines in the 192. In the Folder Options window. under the View tab. Uncompress the zip file and place the stax directory it contains in C:\STAF\services. Install the STAX Execution Engine NOTE STAX is only required on the prime client. comment out the service stax and service event entries (be sure to get all the lines.*.jar OPTION \ J2=-Xverify:none parms "numthreads 100 logtcelapsedtime enabled logtcstartstop \ enabled" service event library JSTAF execute C:\STAF\services\stax\STAFEvent. starting with that one can save some of the steps below. you use the STAF.net/getservices. however. 3 Rename the file C:\STAF\bin\STAF. then click OK.cfg file for another client. add the line: trust machine 192. uncheck the box next to Hide extensions for known file types.net/getstax. open C:\STAF\bin\STAF. Close the Control Panel window.168. For example: trust machine client0 level 5 Alternatively.*) within WordPad.php Uncompress the zip file.sourceforge. 71 .cfg File 1 Using WordPad (Start Menu > All Programs > Accessories > WordPad). despite showing as STAF. double-click Folder Options. You should end up with: VMware.* level 5 If this system is a prime client add the following entries: service stax library JSTAF execute C:\STAF\services\stax\STAX. Its presence on the other clients. Configure Windows to show file extensions even for known file types: a b c d 6 Open the Start menu then select Control Panel. however.txt as C:\STAF\bin\STAF.cfg. If.4. including those that are continued with a backslash) 2 In the trust level block add the networking mask for the systems to be trusted and set them to trust level 5.cfg.168 network.jar 4 5 Save the edited file as C:\STAF\bin\STAF. does not cause problems. In the Control Panel window.cfg and close WordPad.Chapter 4 Configuring the Client Systems Create a Customized STAF.

NOTE If you used the mailserver template as a starting point for a client virtual machine you might need to revisit your network settings. In the Control Panel window. Part of the preparation of that template is to configure Internet Explorer to not use a proxy server. In the System Properties window. You can use any vendor’s JRE. look for JAVA_HOME. select the Advanced tab. Details of this JRE must be included in the disclosure file for a result to be compliant. select the Advanced System Setting.jar 3 Restart the client system. click the Environment Variables button. Set the JAVA_HOME environment variable (which you might have to create) to correspond to your java installation path (which might vary. open System. click the New button. Under System variables.VMware VMmark Benchmarking Guide C:\STAF\services\event\event. . Inc. not a beta). For example: JAVA_HOME = "c:\Java\jre6\" For Windows Server 2003: a b c d Open the Start menu. If the variable is already defined. depending on which java version you installed). If the variable is already defined. look for JAVA_HOME. as long it’s a released version (i. In the Control Panel window. click the Edit button and set it to correspond to your Java installation path. Make the following adjustments when installing the JRE: 1 Install the package (for example. Under System variables.. jre-windows-6u23-x64) on the client system. then click the Environment Variables button.pdf C:\STAF\services\event\History C:\STAF\services\event\License. add the variable and set it to correspond to your Java installation path. and is a “default” build type. select Settings. For Windows Server 2008: a b c d e Open the Start menu then select Control Panel. then select Control Panel. In the System Properties window. click the Edit button and set it to correspond to your Java installation path.e. add the variable and set it to correspond to your Java installation path. click the New button. Install a Java JRE Install a Java JRE.htm C:\STAF\services\event\STAFEvent. open System. which should be changed from the default (often C:\Program Files\Java) to C:\Java. is publicly available. If the variable is not yet defined. If the variable is not yet defined. In the System window. 2 72 VMware. accepting all defaults except the installation directory.

The status of all the packages will change from Default to Install. The script will install the service. At the Create Icons window. saving it to the Desktop. click Next. Run the Cygwin setup utility. h i j 3 4 5 6 If you see a Resolving Dependencies window. At the Choose A Download Source window. accept the additional packages required and click Next. accept the additional packages required and click Next. Click Next. At the Installation Complete window.com/setup. setup. connection type. select Install from Local Directory and click Next. The status of all the packages will change from Default to Install. At the Choose A Download Source window. answer yes and press <Enter>. click once on the word Default. Select the directory where you made the Cygwin install files available (probably a local directory if you are still on client 0 or a shared network directory if you are on another client). Make the Cygwin download directory available to all the other clients over the network. click once on the word Default. Set the CYGWIN=server and Path environment variables as follows: VMware. Accept the defaults until the Select Packages window appears.exe. g Run the Cygwin setup utility. and click Next. setup. then display Basic Cygserver configuration finished. At the Cygwin Net Release Setup Program window.exe. At the top of the list in the Select Packages window. click Finish. click Finish. Close the Cygwin shell. leave the All Users radio button selected. Have fun!. Follow the remaining prompts to choose a local package directory. NOTE This download may take a long time. 7 8 9 10 11 Follow these steps to configure the Cygwin environment: 1 2 3 4 5 Open a Cygwin shell (Start Menu > All Programs > Cygwin > Cygwin Bash Shell). 73 .Chapter 4 Configuring the Client Systems Install the Cygwin Environment Follow these steps to download and install the Cygwin environment: 1 2 Download the Cygwin setup utility from: http://www. Click Next. Inc. At the Cygwin Net Release Setup Program window.cygwin. click Next. At the top of the list.exe. and download site.exe If this is your first client system save time by first downloading the files without installing: a b c d e f Download the Cygwin setup utility. that you saved to the Desktop earlier. If you see a Resolving Dependencies window. next to the word All. Run the following command: cygserver-config When asked Do you want to install cygserver as a service?. setup. select Download Without Installing and click Next. next to the word All.

For Windows Server 2008: a b c d e f g h i 6 7 Open the Start menu then select Control Panel. Reboot the client system. Inc. in the Variable value field enter server. Below the System variables window. Click the Environment Variables button. in the Variable value field enter server. In the System variables window. In the Variable name field enter CYGWIN. . Click the Environment Variables button. At the end of the Variable value. then click OK. then click Edit. To verify that Cygwin started automatically. In the System window. double-click System. click New. 74 VMware. Below the System variables window.C:\cygwin\bin Click OK three times to exit. then click Edit.C:\cygwin\bin Click OK three times to exit. open a Windows command prompt and type: net start If Cygwin is running you will see CYGWIN cygserver within the alphabetical output of this command. then click OK. append: . At the end of the Variable value. In the Variable name field enter CYGWIN. In the System variables window. select the Path variable. click Advanced system settings. append: . select the Advanced tab. select the Path variable. In the Control Panel window. click New. In the System window.VMware VMmark Benchmarking Guide For Windows Server 2003: a b c d e f g h Open the System Properties window (Start Menu > Control Panel > System).

vclient2. # Test Vmmark Config File # Copyright © 2006 . located in C:\VMmark2 directory.Chapter 4 Configuring the Client Systems Install and Configure the VMmark Harness This section describes the installation of the VMmark Harness and the software it needs in order to run. A sample of the file is included below. client2. the VMmark Harness configuration is complete. 2 For any client other than client 0. NOTE This file is best edited with a program such as WordPad that correctly handles Unix/Linux style text files. vclient1.) and the directory names on those clients (vclient0. Deploy/DeployVMs="DeployVM" The VMname (or VMnames) in the OScustomization (or OScustomizations) created above. repeat the name as necessary. NOTE Be careful about the difference between the client names (client0. etc. Configure the VMmark Harness The VMMARK2. To perform multiple operations on the same LUN. All rights reserved.txt files included in the VMmark kit. Install the VMmark Harness Package To install the VMmark Harness Package 1 If your VMmark Harness package came on a CD. copy the contents (the VMmark2. is used to configure the VMmark benchmark. If your VMmark Harness package came as a zip file. Once you have edited this file to reflect your test setup. # ------------------------------------------------------------------# Test Configuration Settings # ------------------------------------------------------------------- VMware. etc. Inc. vclient0. that does not. you will also need to set the following variables in the VMMARK2. which should also be in the prime client’s hosts file. change the name of the vclient0 directory to match the tile that this client will be controlling. If your test benchmark runs will include multiple simultaneous clone and deploy operations (as calculated in “Prepare the vSphere vCenter Server for the Deploy Infrastructure Operations” on page 46). This file identifies the client systems and the server virtual machines that have been configured to host specific workloads. For an overview of the VMmark Harness. rather than Notepad. and doc directories) from the distribution CD to the root directory of the C:\ drive. vclient0. on client 2 it becomes vclient2. client1. uncompress the file and copy the contents (the VMmark2. On client 1 this directory becomes vclient1. and so on. The file specifies the number of tiles to run in the test as well as the workloads to run within each tile (with the default being the official VMware VMmark 2. In addition to the instructions included in this document.CONFIG file.).CONFIG file: Deploy/Templates="standby_upgrade" This should be the VC name of the template you create in “Prepare the Template for the Deploy Operation” on page 124.2011 VMware. Deploy/OScustomizations="VMmark2_Standby_Custom" This is the name (or names) of the OS customization specification (or specifications) you created in “Prepare the vSphere vCenter Server for the Deploy Infrastructure Operations” on page 46. you should also refer to any Readme.1 workload set). Inc. see “VMmark Harness” on page 26. and doc directories) to the root directory of the C:\ drive. Deploy/DeployLUNs="Shared_Migration_DS" The name of the LUNs on which this operation will be conducted. 75 .

Optional Settings .Optional Settings .com" # .vmware.VMware VMmark Benchmarking Guide # Number of Tiles to Run TILES=1 # ------------------------------------------------------------------# Infrastructure Configuration Settings # ------------------------------------------------------------------VCServerHOSTNAME="vcserver1" VCServerUSER="Administrator" VCServerPASSWORD="" VCServerCLUSTER="cluster0" Deploy/Templates="StandbyTemplate1" Deploy/OScustomizations="StandbyCust StandbyCust2" Deploy/DeployLUNs="CX3-80-Lun24 CX3-80-Lun23" Deploy/DeployVMs="DeployVM1 DeployVM2" # .defaults shown # .Optional Settings .Note : Vmotion and SVmotion infrastructure operations can not operate on the same workload(s) # .Optional Settings .com" # # .Warning : changing values may make resulting runs non-compliant OlioWeb/SKIPRESTORE="0" OlioWeb/DELAYTIME="5" OlioWeb/RAMPUP="300" OlioWeb/RAMPDOWN="300" OlioWeb/SCALE="400" OlioWeb/FINALIZE="10" OlioWeb/OLIORAIN="1" OlioWeb/FinalizeGlassFish="0" OlioDB/SKIPRESTORE="0" OlioDB/SCALE="400" # .defaults shown .defaults shown # .Warning : changing values may make resulting runs non-compliant # SVmotion/Workloads="Standby" # SVmotion/SleepBetween="300" # SVmotion/BurstQueueSize="auto" # SVmotion/DELAYTIME="160" # .Warning : changing values may make resulting runs non-compliant # Deploy/DELAYTIME="170" # Deploy/UpgradeTools="1" # Deploy/BurstQueueSize="auto" # Deploy/DeployDelayBetween="300" # # # # # # . .Optional Settings .defaults shown . # ------------------------------------------------------------------# Workload Configuration Settings # ------------------------------------------------------------------MailServer/MailPassword="" MailServer/MailDomains="maildomain0 maildomain1" MailServer/MailQualifier="eng.Warning : changing values may make resulting runs non-compliant # MailServer/SKIPRESTORE="0" # MailServer/DELAYTIME="12" # # # # # # # # # # # # # .at the same time.Warning : changing values may make resulting runs non-compliant Vmotion/Workloads="OlioDB" Vmotion/VMotionDelayBetween="180" Vmotion/BurstQueueSize="auto" Vmotion/DELAYTIME="150" SVmotion/TargetLUNs="CX3-80-Lun21 CX3-80-Lun21" # .Optional Settings .Note : MailQualifier must be 3 parts : For example "eng. Inc.defaults shown # .vmware.defaults shown 76 VMware.

Chapter 4 Configuring the Client Systems

# # # # # # # # # # # # # # #

- Warning : changing values may make resulting runs non-compliant DS2WebA/SKIPRESTORE="0" DS2WebA/DELAYTIME="8" DS2WebB/SKIPRESTORE="0" DS2WebB/DELAYTIME="10" DS2WebB/IterationTimeSlice="240" DS2WebB/DelayTimeSlice="60" DS2WebC/SKIPRESTORE="0" DS2WebC/DELAYTIME="15" DS2WebC/IterationTimeSlice="180" DS2WebC/DelayTimeSlice="120" DS2DB/SKIPRESTORE="0"

# - Optional Settings - defaults shown # - Warning : changing values may make resulting runs non-compliant # Standby/DELAYTIME="2" # ------------------------------------------------------------------# Testbed and Environment Configuration Settings # ------------------------------------------------------------------# Set up the list of client systems - must have # at least as many clients as tiles. CLIENTS="client0 client1" # Workload specific list of Server VM Hostnames MailServer/SERVERS="Mailserver0 Mailserver1" Standby/SERVERS="Standby0 Standby1" OlioWeb/SERVERS="OlioWeb0 OlioWeb1" OlioDB/SERVERS="OlioDB0 OlioDB1" DS2WebA/SERVERS="DS2WebA0 DS2WebA1" DS2WebB/SERVERS="DS2WebB0 DS2WebB1" DS2WebC/SERVERS="DS2WebC0 DS2WebC1" DS2DB/SERVERS="DS2DB0 DS2DB1" # - Note: For best results follow the above naming convention # # # # # # # # # # # Reporter Settings REPORTER=0 REPORTERDIR="/cygdrive/c/vmmark2/tools/" ScriptName="vSphere-get-config.sh" Error handling This will determine how the harness deals with errors during the phases before running. By setting ERRORIMMEDIATE to 1, the harness will exit upon finding the first error (as opposed to continuing through all the remaining work for that phase). ERRORIMMEDIATE=0

################################################################ # Standard Defaults # # All parameters below this line have the standard default # values listed. Normally these values do not require # changing. For the path values, we recommend that you # configure the testbed using the standard path names as # this helps facilitate debugging. There are several numeric # values that have occasionally been shown to be useful for # benchmarkers, but care should be taken when modifying these # values. Uncommenting these parameters will be denoted as # "Overriding Required Default". Changing key parameters # such as RUNTIME will cause the test run to be non-compliant. # ################################################################ # Set the RUNTIME for the test. The Default

VMware, Inc.

77

VMware VMmark Benchmarking Guide

# for a Fully Compliant test is 10800 secs # (3 hours). Changing this value can make # your test non-compliant ###RUNTIME=10800 # TILEDELAY=seconds # # Delays the start of the tile N by TILEDELAY * N (secs) and also # increments the runtime of the workloads by TILEDELAY * (#TILES - N - 1) # to compensate for the delay. No delay if set to 0. ###TILEDELAY=60 # FLAG to control display/logging of Info/Debug messages # when debugSTAXUtilLogAndMsg is called # if == 0: No messages are displayed/logged # if != 0: Messages are displayed and logged ###DEBUGFLAG=0 # This is a list of the workloads to be invoked # this is to allow a nonstandard list of workloads # to be run with this harness as long as the template # workload functions are in the vmmark/xml directory. # For a fully compliant test all 6 workloads must be # used (default) ###WORKLOADLIST="Standby MailServer OlioWeb OlioDB DS2WebA DS2WebB DS2WebC DS2DB" # This is a list of the infrastructure operations to be invoked # this is to allow a nonstandard list of infrastructure operations # to be run with this harness as long as the template # workload functions are in the vmmark/xml directory. # For a fully compliant test all 3 infrastructure operations must be # used (default) ###INFRASTRUCTURELIST="Deploy Vmotion SVmotion" # Flag to disable the Cluster VM Mapping routines ###DoClusterMapping=1 #!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! # Note: Please observe the special formatting used with # some of the non-numeric character strings in various # parameter settings. Quotes, double backslashes, %u, # and use of path names of the form "C:\Progra~1\... # are required where used in the sample VMMARK2.CONFIG # files to avoid character striping by the shells or # to avoid the use of path names with spaces which are # not supported in this file. #!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! # This directory is the location of the # Harness code ###IMPORTDIR=c:\vmmark2\xml # This is the location of any config files # referenced by the harness code. ###CONFIGDIR=c:\vmmark2 # This is a tmp directory for scratch files # the harness creates ###TMPDIR=c:\vmmark2\tmp # # # # # # # # This is the path on the VMmark clients that contains the individual workload directories. The directory on each client must be numbered by that client's tile number (i.e., vclient0, vclient1, etc.). The VMmark Harness software automatically replaces "%u" in the path below with the appropriate tile number. Note: The extra backslash is to escape the backslash-v that was being treated as a control char when passed

78

VMware, Inc.

Chapter 4 Configuring the Client Systems

# to windows batch files. ###CLIENTROOTDIR=C:\\vclient%u # Parallelize Workload Setup # # Set to 0 to disable ###PARALLELSETUP=1 # FLAG to control cleaning up results files after they've been # copied into the vmmark/results/Results_<datestamp> directory # if set to 0, Cleanup of files will be skipped. ###CLEANUPFLAG=1 # # Post Process Results # Disabled by default except for full runs where: # RUNTIME=10800 and WORKLOADS="<list of all 6>" # Note: %u will be #Tiles in run # The output is sent to: vmmark/results/Results_<timestamp>/Score_#_tile.out # The working directory is vmmark/results/Results_<timestamp> # To post process partial runs, set flag to 1 and modify the post processing # command as needed. # ###POSTPROCESSFLAG=0 ###POSTPROCESSCMD="C:\\cygwin\\bin\\perl -f C:\\vmmark2\\tilescore.pl -t %u" #02112011

Edit the cygserver.conf File
Edit the /etc/cygserver.conf file, uncommenting all values, including shmem and sem. This can be accomplished automatically as follows: 1 2 Open a Cygwin shell (Start Menu > All Programs > Cygwin > Cygwin Bash Shell). Within the Cygwin shell, run the following script: c:/vclient0/scripts/set_cygserver.sh (for clients other than client 0, substitute the proper vclientN directory). Close the Cygwin shell.

3

Edit Registry Settings in the Client System
The Windows Registry settings described in this section avoid problems with port utilization and improve efficiency during VMmark benchmark runs. This can be done automatically or manually, as described in the following two sections.

Automatically Apply the Registry Settings
1 2 Navigate to C:\vclientN\scripts directory. (Where N is the tile number.) Double click the vmmark_client.reg file. NOTE This file is installed during the VMmark harness installation. 3 4 When asked Are you sure you want to add the information in C:\vclient\scripts\vmmark_client.reg to the registry? click Yes. Repeat step 2 and step 3 for the ProxySettingsPerUser.reg file.

VMware, Inc.

79

Select Modify. Select the Decimal radio button. Enter the new data (from Table 4-1). Right-click the new entry. Select Modify. Right-click the new entry. 1 2 3 Open the Windows Registry editor (Start Menu > Run > Regedit).VMware VMmark Benchmarking Guide Manually Apply the Registry Settings If you applied the settings using the automatic method above you should skip this section. Select Modify. Click OK. Select the Decimal radio button. Enter the new data (from Table 4-2). Enter the new data (from Table 4-3). Registry Entry to Modify Action Modify Name ReservedPorts Type Multi String Value (REG_MULTI_SZ) Data 1025-5000 4 In the parameters folder. Name MaxFreeTWTcbs MaxUserPort TcpTimedWaitDelay TcpWindowSize Type DWORD Value (REG_DWORD) DWORD Value (REG_DWORD) DWORD Value (REG_DWORD) DWORD Value (REG_DWORD) Data 100000 65534 60 65535 Table 4-2. add the registry entries listed in Table 4-2: a b a b c d e f Create the new entry (Edit Menu > New > DWORD Value). Type the name of the new entry (from Table 4-3). Repeat for each new entry. Table 4-1. 6 80 VMware. Navigate to the following registry folder: HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Tcpip\Parameters Modify the registry entry listed in Table 4-1: a b c d Right-click the entry. Click OK. . Inc. Registry Entries to Add Action Add Add Add Add 5 Navigate to the following registry folder: HKEY_LOCAL_MACHINE\SOFTWARE\Policies\Microsoft\windows\CurrentVersion\Internet Settings Add the registry entry listed in Table 4-3: a b a b c d Create the new entry (Edit Menu > New > DWORD Value). Type the name of the new entry (from Table 4-2).

eng.19 DeployVM OlioDB0 OlioWeb0 mailserver0 mailserver0.5 192. you would download the 32-bit version (E2K7SP2EN32. The following is an example hosts file for the clients in a two-tile setup.Chapter 4 Configuring the Client Systems e Action Modify Click OK.maildomain0.eng.9 #Tile 1 192.7. Update the hosts File The client systems should be able to resolve all the workload virtual machine names in your cluster.15 192.168.8 192.7.6 192.7. These are the names by which the vCenter Server knows the workload virtual machines and is able to perform operations on them.168.7.exe) from: http://www.7. For example.168. You'll notice that the fully-qualified name of the mailserver is provided for each tile.vmware.168.168.18 192.eng.7.168.com maildomain1 maildomain1.com DS2DB1 DS2WebA1 DS2WebB1 DS2WebC1 standby1 Obtain Exchange Server 2007 and LoadGen Obtain Exchange Server 2007 as follows: For Windows Server 2003: 1 Download Exchange Server 2007.vmware.7. Name ProxySettingsPerUser Type DWORD Value (REG_DWORD) Data 0 Table 4-3.7.maildomain1.13 192.7.168.7. 81 .16 192.17 192.199 #Tile 0 192.12 192. Registry Entry to Modify 7 Close the Registry Editor.3 192.168.168.168.7.14 192.com maildomain0 maildomain0.168. but in this case must be the 32-bit version.4 192. This must be the same service pack version (if any) that you used for the Exchange mail server in the workload virtual machines (“Install Microsoft Exchange Server 2007” on page 121).168. if you used Exchange Server 2007 Service Pack 2 in the mail server workload virtual machines.168.7.microsoft.168.aspx?FamilyID=4c4bd2a3-5e50-42b0-8bbb-2cc9afe3216a 2 Save the Exchange Server 2007 install file to your client system for use in “Install Exchange Server 2007 Tools” on page 86.7 192.168. Inc. VMware.7.vmware.2 192.168.vmware.eng. Example hosts file: 192.com/downloads/details.7.7.7.168.com DS2DB0 DS2WebA0 DS2WebB0 DS2WebC0 standby0 OlioDB1 OlioWeb1 mailserver1 mailserver1.7.

.exe) from: http://www. click the LAN settings button. make sure none of the boxes contain a checkmark. Close the Internet Options window by clicking OK. At the Local Area Network (LAN) Settings window.microsoft. Close the Control Panel. Download LoadGen as follows: 1 Download the LoadGen tool (version 08. you must make sure to use the same service pack version (if any) for the Exchange Management Tools in the clients and for the Exchange mail server in the workload virtual machines. you would download the 64-bit version (E2K7SP2EN64. Configure Windows to Not Use a Proxy Server Configure Windows to not use a proxy server by following these steps: 1 2 Log in as the domain administrator. double-click Internet Options.com/downloads/details. 3 4 5 6 7 8 82 VMware.aspx?FamilyID=0fdb6f14-1e42-4165-bb17-96c83916c3ec 2 Save the LoadGen install file to your client system for use in “Install and Configure LoadGen on the Client” on page 87.02. Open the Control Panel: Windows Server 2003: Open the Start menu then select Settings > Control Panel.aspx?FamilyId=DDEC1642-F6E3-4D66-A82F-8D3062C6FA98 64-bit version http://www.microsoft. In the Control Panel window. Close the Local Area Network (LAN) Settings window by clicking OK.aspx?FamilyID=4c4bd2a3-5e50-42b0-8bbb-2cc9afe3216a 2 Save the Exchange Server 2007 install file to your client system for use in “Install Exchange Server 2007 Tools” on page 86.microsoft. If you used Exchange Server 2007 Service Pack 2 in the mail server workload virtual machines. Inc.VMware VMmark Benchmarking Guide For Windows Server 2008: 1 Obtain access to the 64-bit Exchange Server 2007 installation file you used for the Exchange installation in the mailserver workload virtual machine (“Install Microsoft Exchange Server 2007” on page 121).com/downloads/details. NOTE If you download this file from scratch.com/downloads/en/details. under the Connections tab. In the Internet Properties window.0045 or later) from: 32-bit version: http://www. Windows Server 2008: Open the Start menu then select Control Panel.

Configuring Additional Clients Manually To configure each client manually. and their C:\STAF\bin\STAF.Chapter 4 Configuring the Client Systems Create Additional Client Systems If you will be running multiple VMmark tiles. you should do so before installing and configuring the mail server client. you must customize each additional system as follows: 1 2 Rename the C:\vclient0 directory to C:\vclientN. or (if using virtual clients) clone the virtual machine.cfg and hosts files appropriately. where N is the tile number that this client machine will be controlling. where N is the tile number the client will be controlling. You can configure each additional client manually (repeating the above directions for each system). 83 .cfg and hosts files should be edited appropriately. Cloning a Virtual Machine If you have a virtual client and will be making additional client systems. you need additional client systems (one client per tile). If you will be copying the disk image or cloning the virtual machine. These new clients should be named clientN. copy the disk images using a commercial third-party disk-imaging tool along with the Windows System Preparation tool (Sysprep). you would repeat the instructions in this chapter for each desired client system. you can use vSphere to clone the client-template virtual machine.cfg file to reflect this client system’s short name. and editing the C:\STAF\bin\STAF. Copying the Disk Image If you copy the disk image from the first client to create additional client systems. Inc. changing the system name and the vclientN directory to reflect which tile the client will be controlling. VMware. Edit the C:\STAF\bin\STAF.

Enter the IP address of this tile’s mail server. No separate installation is necessary. This client software was installed as part of the VMware Harness installation. In the Advanced TCP/IP Settings window. Select the newly-added IP address and use the arrows at the right to move it to the top of the list. click Add. then change its preferred domain name server to its tile’s mail server virtual machine. under Network. In the Local Area Connection Status window. In the Internet Protocol (TCP/IP) Properties window. Install the DVD Store 2 Client Software The DVD Store 2 client software is installed as part of the VMmark Harness installation. 84 VMware. LoadGen.txt files included in the VMmark kit. For Windows Server 2008 1 2 3 4 5 On the client system. as follows: For Windows Server 2003 1 2 3 4 5 6 7 8 9 On the client system. then click Add. Install and Configure the Mail Server Client The client portion of the mail server consists of the Microsoft Exchange Load Generator. you should also refer to the various Readme. find the Local Area Connection entry and click View Status. In the Local Area Connection Status window. No separate installation is necessary. Install the Standby Client Software The standby workload is monitored by the IdleVMTest client. Set the Client’s Preferred Domain Name Server Power-on the client machine. Below DNS server addresses.VMware VMmark Benchmarking Guide Install and Configure the Workload Client Software This section describes the installation of the client software. In the Internet Protocol Version 4 (TCP/IPv4) Properties window. then click the Properties button. Select Internet Protocol Version 4 (TCP/IPv4). then click the Properties button. then select Control Panel > Network Connections > Local Area Connection. In the Network and Sharing Center window. No separate installation is necessary. . The installation is described in the sections below. in order of use:. Click OK twice. click the Properties button. click the Properties button. open the Start menu. select the DNS tab. Install the Olio Client Software The Olio client software is installed as part of the VMmark Harness installation. Inc. then select Control Panel > Network and Sharing Center. open the Start menu. click the Advanced button. Select Internet Protocol (TCP/IP). In addition to the instructions included in this document. described in “Install and Configure the VMmark Harness” on page 75. then click Close. click the Advanced button.

In the Control Panel double-click System. When the window appears welcoming you to the new domain. Under Member of select the Domain radio button. Select the Advanced System Settings. Click OK.com is your company’s domain name. open the Start menu. it may be necessary to temporarily disable the network cards that will not be using the tile’s mail server as a domain name server. When the window appears saying You must restart this computer. then click Add. select the DNS tab. Click OK. Click the Change button. and select Control Panel. 8 9 VMware. Enter a user name and password (the domain controller’s administrator account and password will work).com.com is your company’s domain name.company.com. Below DNS server addresses. then click Close twice. and your. Under Member of select the Domain radio button.your. 85 . These additional cards can then be re-enabled after the client system part of the mail server’s domain and the preferred DNS is set.. Select the Computer Name tab. open the Start menu. Enter the IP address of this tile’s mail server. Close the Network and Sharing Center window. Click the Change button. This tile’s mail server virtual machine must already be powered-on and connected to the network during the installation. This should be in the format maildomainN. click Add. where N is the tile number that this virtual machine will be part of. This should be in the format maildomainN. NOTE If the client system has more than one network card. Select the newly-added IP address and use the arrows at the right to move it to the top of the list. Enter a user name and password (the domain controller’s administrator account and password will work). and your. Inc.Chapter 4 Configuring the Client Systems 6 7 8 9 10 11 In the Advanced TCP/IP Settings window.company. click OK. Enter the fully-qualified domain name that you used when you created the mail server domain.. and select Control Panel > System.your. Enter the fully-qualified domain name that you used when you created the mail server domain. where N is the tile number that this virtual machine will be part of. For Windows Server 2003 1 2 3 4 5 On the client system. Make the Client System a Domain Member The client system must be a member of the domain controlled by its tile’s mail server virtual machine. Select the Computer Name tab.company.. 6 7 8 9 10 For Windows Server 2008 1 2 3 4 5 6 7 On the client system. Click OK twice. Click OK. click OK. in order of use:.company.

VMware VMmark Benchmarking Guide 10 11 Click OK. click Install. At the Server Role Selection window. click OK. At the Readiness Checks window.e. 8 9 For Windows Server 2008: 1 2 3 4 5 6 7 Log in as the domain administrator. E2K7SP2EN32. place a checkmark in the box next to Management Tools and click Next. Choose Install Microsoft Exchange Server 2007 SP2. you might need to install Windows Installer 4. When the window appears welcoming you to the new domain.) Accept the defaults until you get to the Installation Type menu..exe). 8 9 86 VMware. Install Exchange Server 2007 Tools The mail server client uses Exchange Server 2007 Tools. go ahead and install the new installer. The following two sections describe the installation for either Windows Server 2003 or Windows Server 2008. Run the Exchange Server 2007 install file you obtained in “Obtain Exchange Server 2007 and LoadGen” on page 81 (i. but choose the relevant install option. place a checkmark in the box next to Management Tools and click Next. If you see a warning about Host (A) record. Double-click to file setup.5 (WindowsServer2003-KB942288-v4-x86.com. For Windows Server 2003: 1 2 Log in as the domain administrator. after the checks are completed. you can safely ignore it.e. after the checks are completed. Double-click to file setup. click Restart Computer.exe if you’re using Service Pack 2). At the Server Role Selection window. click OK. E2K7SP2EN64. (Other Service packs will be slightly different.exe if you’re using Service Pack 2). click Install. Check for updates via Microsoft update.exe. (Other Service packs will be slightly different. then click Next. Run the Exchange Server 2007 install file you obtained in “Obtain Exchange Server 2007 and LoadGen” on page 81 (i. NOTE Depending on operating system version used for clients. where you should choose Custom Exchange Server Installation.) Accept the defaults until you get to the Installation Type menu. At the Readiness Checks window. Check for updates via Microsoft update. you can safely ignore it. At the Extraction Complete message. Choose Install Microsoft Exchange Server 2007 SP2. If you see a warning about Host (A) record.. Inc. If you get a warning about this. . but choose the relevant install option. where you should choose Custom Exchange Server Installation. 3 4 5 6 7 At the Extraction Complete message.

company.YOUR_3_PART_DOMAIN_NAME</string> </ClientAccessServers> Within the ClientAccessServers block.msi file you downloaded in “Obtain Exchange Server 2007 and LoadGen” on page 81. YOUR_DOMAIN_NAME_PART_2.DC=YOUR_DOMAIN_NAME_PART_2. Insert your mailserver password in place of YOUR_MAILSERVER_ADMINISTRATOR_PASSWORD. replace YOUR_DOMAIN_NAME_PART_1.DC=YOUR_DOMAIN_NAME_PART_1. your.company. Inc. if your fully qualified domain name is your. Save and close the vmmark2initializationtemplate. e. NOTE Before installing LoadGen. 6 7 8 9 10 11 12 VMware. enter: DC=your. Insert your mailserver administrator username in place of YOUR_MAILSERVER_ADMINISTRATOR_USERNAME. it is important that all the steps described in “Install Microsoft Windows Server on the Client Systems” on page 63 be completed. 87 .1 kit. Edit the LoadGen Initialization Template 1 2 Use Notepad to open the file vclientN/mailserver/vmmark2initializationtemplate.D C=YOUR_DOMAIN_NAME_PART_3</LdapBaseDn> 3 4 In both locations. which must contain three parts. Insert your mailserver password in place of YOUR_MAILSERVER_MASTER_PASSWORD.xml from the VMmark 2. 1 2 Install LoadGen by double-clicking the loadgen.Chapter 4 Configuring the Client Systems Install and Configure LoadGen on the Client Follow the instructions in the sections below to install and configure LoadGen on the client.DC=com 5 Find the section that begins with the TargetForest line. (This will be the same as the YOUR_MAILSERVER_ADMINISTRATOR_PASSWORD from Step 8. Follow the prompts to install LoadGen. replace YOUR_3_PART_DOMAIN_NAME with your fully-qualified domain name.DC=maildomainN. replace the N in maildomainN with the tile number you’re configuring.CONFIG file this three-part domain name is referred to as the MailQualifier.com.com.) The following line appears in two different places in the XML file: <LdapBaseDn>OU=Contacts. which will look like this: <TargetForest>maildomainN</TargetForest> <DirectoryUsername>YOUR_MAILSERVER_ADMINISTRATOR_USERNAME<DirectoryUsername> <DirectoryPassword>YOUR_MAILSERVER_ADMINISTRATOR_PASSWORD</DirectoryPassword> <DirectoryDomain>maildomainN</DirectoryDomain> <MasterPassword>YOUR_MAILSERVER_MASTER_PASSWORD</MasterPassword> <MasterDomain>maildomainN</MasterDomain> Replace the N in <TargetForest>maildomainN</TargetForest> with the tile number you’re configuring. For example.maildomainN. and YOUR_DOMAIN_NAME_PART_3 to match your domain name. (Note that in the VMMARK2.DC=company. accepting the EULA and the default options. Replace the N in <DirectoryDomain>maildomainN</DirectoryDomain> with the tile number you’re configuring. Find the ClientAccessServers block.xml file. replace the Ns in mailserverN and maildomainN with the tile number you’re configuring. which will look like this: <ClientAccessServers> <string>mailserverN.g.OU=LoadGen Objects.) Replace the N in <MasterDomain>maildomainN</MasterDomain> with the tile number you’re configuring.

edb Close the command prompt window. then click Continue. On the Specify test user groups page. c 4 Copy the database files from E:\vmmark to F:\ (that is. Click Continue with recipient management. Open the backup drive (Start Menu > Computer. leave Mailbox Database set to 0. follow the steps below.VMware VMmark Benchmarking Guide Configure LoadGen 1 2 3 4 5 6 7 8 9 10 Start LoadGen (Start Menu > All Programs > Microsoft Exchange > Exchange Load Generator). scroll to Microsoft Exchange Information Store.xml. then double-click on the Database drive (this should be drive E:\). defragment the Exchange database: a b Open a command prompt window (Start > Command Prompt). click Continue. then double-click on the Backup drive (this should be drive F:\). Enter the following commands: eseutil /d e:\vmmark\lpriv1.edb eseutil /d e:\vmmark\lpriv2. To do so. In the Services window. Double click on the vmmark directory. and copy them to the clipboard (<Ctrl>-C). In the Administrative Tools window. make a backup of the database in its pre-benchmarking state. double-click Administrative Tools. click Continue. set lpriv1 to 500 and lpriv2 to 500.) After a message appears saying that the Exchange service was stopped successfully. Backup the Microsoft Exchange Server 2007 Database After LoadGen is fully configured. On Advanced recipient settings page. Inc. On the Configuration Summary page. double-click Services. click Start the initialization phase (recommended before running the test) and wait for mailbox initialization to complete. Right-click Microsoft Exchange Information Store and select Stop. Paste the files from the clipboard to the backup drive (<Ctrl>-V). under the vmmark subheading. Stop the Exchange Services: a b c d e 3 Open the Start menu then select Control Panel. . 88 VMware. 1 2 Log on to the mail server virtual machine as user Administrator. Select Use the following saved configuration file: and browse to C:\vclient0\mailserver\vmmark2initializationtemplate. In the Control Panel window. On the User Settings page. Click Continue. from the vmmark directory of E: to the root directory of F:) as follows: a b c d e Open the database drive (Start Menu > Computer. (This operation may take a few minutes. click Continue and wait for recipient creation to complete. Click Start a new test. On the Remote configurations page. Select all files in the vmmark directory (<Ctrl>-A).

In the Control Panel window. double-click Administrative Tools. restart Exchange Services: a b c d e Open the Start menu then select Control Panel. (This operation may take a few minutes.) VMware. After the files are copied. double-click Services. scroll to Microsoft Exchange Information Store. In the Services window. In the Administrative Tools window. Inc. 89 . Right-click Microsoft Exchange Information Store and select Start.Chapter 4 Configuring the Client Systems f 5 Close the backup drive.

. Inc.VMware VMmark Benchmarking Guide 90 VMware.

each tile's workload virtual machines should be placed on a single host. rotating through the hosts in the cluster in a round-robin fashion until all tiles are placed. Running the VMmark Harness Typically. 91 . select the local machine radio button (if not already selected). The VMmark Harness is initiated from a single designated prime client in the testbed where the STAF & STAX software packages have been installed. you can begin running the VMmark Benchmark.jar When the STAX monitor window opens. the VMmark Harness is used to control all aspects of a benchmarking run. two-host configuration. If non-standard names are used. This section describes its use. After the VMmark Harness has been configured. the VMmark harness will attempt to place those workload virtual machines it recognizes and will leave the remaining workload virtual machines on their original hosts. the VMmark harness will automatically use vMotion to move the workload virtual machines to the correct host at the beginning of every run. Start the STAX Monitor on the prime client: java -jar C:\STAF\services\stax\STAXMon. Under XML Job File. The Job Info tab is displayed. It consists of the following sections: “Tile Placement” on page 91 “Running the VMmark Harness” on page 91 “Running Multiple-Tile Benchmarks” on page 93 “VMmark Results Files” on page 94 “Creating and Submitting a VMmark Full Disclosure Report” on page 95 “Running VMmark without STAXMonitor” on page 98 Tile Placement For a compliant run. To start a test run 1 2 3 4 Make sure that the system clocks on all the clients and the system clock on the server are synchronized to within 10 seconds. VMware. click the Submit New Job button. Inc. all of tile 0's and tile 2's workload virtual machines would be on host 0 and all of tile 1's workload virtual machines would be on host 1.Running the VMmark Benchmark 5 This chapter describes the process of running the VMmark benchmark. If the naming conventions specified in this guide are followed. For example in a three-tile.

in the Job Name box. STAX will locate the latest VMMARK2. . the results file will be located in a directory called: C:\vmmark\results\Results_<timestamp>_30-minutes-3-tile Click the Function tab. enter: C:\VMmark2\xml\vmmark2_main. enter an optional suffix to be appended to the name of the results directory. Select the default radio button. In the Arguments box enter: { 'CONFIGFILE' : r'C:\vmmark2\VMMARK2.xml Under Job Options. Under Arguments. if you enter 30-minutes-3-tile.VMware VMmark Benchmarking Guide 5 6 In the Filename box. Inc. click the Clear button. 7 8 9 10 11 The STAX Job Monitor window opens and STAX starts the VMmark Harness. The current status of the running workloads is shown in this window. 92 VMware. NOTE After the above information has been entered.CONFIG' } Click the Submit New Job button. For example. you can use the Resubmit Previous Job button.CONFIG file and the XML Harness code each time. The names entered are remembered across restarts of the Monitor.

Configuring the VMmark Harness for Multiple-Tile Benchmarks The VMmark Harness is configured using the VMMARK2.1 Benchmark Tests. Its presence on the other clients. you must create the appropriate number of tiles. The individual hostnames are set using the SERVERS variables (these should be set to the systems’ short names). Inc. Starting Multiple-Tile Benchmarks After the VMmark Harness is configured correctly.Chapter 5 Running the VMmark Benchmark Running Multiple-Tile Benchmarks To run a multiple-tile benchmark. however. Creating additional tiles is largely a repeat of the creation of the first tile.CONFIG file. The time and date on all clients must be synchronized to within a few seconds in order to generate valid VMmark test results. NOTE STAX is only required on the prime client. and then a multiple-tile benchmark may be started. the VMmark Harness needs to be configured to run them. VMware.” After the additional tiles are created and are in the inventory of the server system. “Preparing the Infrastructure for VMmark 2. located in the C:\vmmark directory on the prime client: The number of tiles to be run is set with the TILES variable. Make sure that each client has a vclientN directory (where N is that client’s tile number). The client system names are set using the CLIENTS variable (these should be set to the systems’ short names). as described in “Running the VMmark Harness” on page 91. These steps are detailed in the sections below. starting multiple-tile benchmarks is no different than starting single-tile benchmarks. 93 . and is described in Chapter 3. does not cause problems.

94 VMware.out file contains additional details of the test. TILE_N_Ratios: The scores normalized against the VMmark reference platform. Inc.wrf (Workload Results File) suffix in the Results_<datestamp> directory. start time. and p2).VMware VMmark Benchmarking Guide VMmark Results Files After a VMmark benchmark test run has completed. the average throughput scores for each workload are recorded in the Score_N_Tile_Test. then processes the results to score the test. and end time as well as: TILE_N_Scores: The actual workload scores for each VM during each of the three test phases (p0. The benchmark captures the 60-second throughput measurements for each workload and stores them in files with the .out file is the median of the sums of each phase’s geometric mean per tile. At the end of a compliant test run. such as duration. the VMmark harness automatically collects the results data from the client system (or systems) and places those results in the results directory on the prime client. . The Score_N_Tile_test. The composite VMmark score at the bottom of the Score_N_Tile_test.out file (where N is the number of tiles in the test) along with the normalized scores and the composite VMmark metric. p1.

HTML file submit the full disclosure report for review The following sections detail these steps.ssh/id_rsa.ssh directory exists. Otherwise run the following command: ssh-keygen -t rsa (accept the default file name and leave the passphrase empty). Configure the Prime Client to Log Into Virtualization Hosts Without a Password In order for the VMmark harness to automatically run the reporting script you must generate SSH keys on the prime client and on each virtualization host. Open the SSH configuration file for editing: vi /etc/ssh/sshd_config Search for PermitRootLogin under the Authentication section.d/sshd restart If the ~/root/. Otherwise run the following command: mkdir ~/root/.ssh/authorized_keys file on the virtualization host. which is documented in the next section): 1 2 3 Log into the VMware ESX server console. skip to step b. open a Cygwin window. Otherwise run the following command: mkdir /home/Administrator/.CONFIG file and run a compliant test create a name-mapping file generate an HTML-formatted table of results and ratios edit the disclosure. Inc. The resultant section will look like this: # Authentication: #LoginGraceTime 120 PermitRootLogin yes #StrictModes yes Save the /etc/ssh/sshd_config file.pub file on the prime client to the ~/root/. If /home/Administrator/. generate SSH keys on the prime client as follows: a On the prime client. 95 .com/community/vmtn/general/performance/vmmark To do this manually in VMware ESX (as opposed to ESXi. Change PermitRootLogin from no to yes.pub exists. Otherwise run the following command: ssh-keygen -t rsa (accept the default file name and leave the passphrase empty). skip to step 7.ssh/id_rsa.ssh If ~/root/. NOTE For a sample script to configure this automatically in ESX (but not ESXi). visit the Documents tab in the VMmark section of the VMware Communities at: http://communities.ssh exists.Chapter 5 Running the VMmark Benchmark Creating and Submitting a VMmark Full Disclosure Report Preparing VMmark results for publication according to the run and reporting rules involves the following tasks: configure the prime client to log in to the virtualization hosts without a password enable reporting in the VMMARK2.ssh/id_rsa. VMware.pub exists. If not already done. This task typically needs to be performed only once.ssh If ~/root/. 4 5 6 7 8 b 9 Copy the contents of the /home/Administrator/. skip to step a. skip to step 9.vmware. Restart SSH services: /etc/init.

sh Follow the script’s instructions for enabling passwordless SSH to the ESXi system. you need to run a full test with reporting enabled. If /home/Administrator/./VMmark2-CreateSSH.vmx 2 3 96 VMware. Create a Name-Mapping File Results to be submitted to VMmark for review must include a file showing the mapping of workloads to . Inc. skip to step 7.sh script from C:\VMmark2\tools to the /root directory of the ESXi system. access the ESXi command line.vmware. open a Cygwin window (Start Menu > All Programs > Cygwin > Cygwin Bash Shell) and change to the appropriate results directory: cd /cygdrive/c/vmmark2/results/Results_datestamp (where datestamp refers to the results to be formatted). entering in the right column the path and name of each . Copy the template VM-name-map..vmx file names. open a Cygwin window.txt file. 5 6 b 7 8 Copy the contents of the /home/Administrator/. To do so: 1 2 Edit the VMMARK2.CONFIG file and set the following two variables: REPORTER=1 Rerun a compliant VMmark test.CONFIG File When you are satisfied with your benchmark run and are ready to submit the results. skip to step b.sh script by following these steps: 1 2 3 4 Enable ESXi remote tech support mode. Repeat for each ESXi host in the cluster.pub exists.ssh If ~/root/. A template is provided in the reportingtools directory for this purpose.VMware VMmark Benchmarking Guide To do this manually in VMware ESXi: Run the VMmark2-CreateSSH. Otherwise run the following command: mkdir /home/Administrator/.ssh/authorized_keys file on the virtualization host./tools/VM-name-map.txt .txt file from the tools directory to the results directory: cp .ssh/id_rsa.com/kb/1017910).sh sh .vmx File Name -----------------------------------------Mailserver0 /vmfs/volumes/494d7f49-4a6b5a5e-5048-001b245bd287/mailserver0/mailserver0.ssh/id_rsa. Instruction to do this can be found in VMware Knowledge Base article #1017910 (http://kb. Copy the VMmark2-CreateSSH. From the ESXi command line.pub file on the prime client to the ~/root/./. The resulting file will look something like this example from a one-tile system: Workload Name .. Edit the VM-name-map. Enable Reporting in the VMMARK2. generate SSH keys on the prime client as follows: a On the prime client.vmx file that corresponds to the workload in the left column. . make the script executable then run it: chmod +x VMmark2-CreateSSH.ssh exists. 1 On the prime client. Using an SSH client. Otherwise run the following command: ssh-keygen -t rsa (accept the default file name and leave the passphrase empty). The harness automatically gathers information about the workload virtual machines and the ESX virtualization host and places that information in the results directory. If not already done.

the first step in preparing for publication is to generate an HTML-formatted table of results and ratios. 3 Edit the disclosure. VMware.. Inc. Copy the template disclosure. 1 2 On the prime client. a b Search for instances of ###.Chapter 5 Running the VMmark Benchmark Standby0 OlioDB0 OlioWeb0 DS2DB0 DS2WebA0 DS2WebB0 DS2WebC0 /vmfs/volumes/494d7f49-4a6b5a5e-5048-001b245bd287/standby0/standby0.vmx /vmfs/volumes/494d7f49-4a6b5a5e-5048-001b245bd287/ds2weba0/ds2weba0. In the section titled Performance./. the next step is to create a full disclosure report.html file. 2 3 c Submit the Full Disclosure Report for Review Once all the necessary files are in the appropriate results directory on the prime client. you are ready to submit the full disclosure report for review./.html . Change to the appropriate results directory: cd /cygdrive/c/vmmark2/results/Results_datestamp (where datestamp refers to the results to be formatted).sh as described in “Generate an HTML-Formatted Table of Results and Ratios” on page 97.vmx /vmfs/volumes/494d7f49-4a6b5a5e-5048-001b245bd287/ds2webc0/ds2webc0. 1 On the prime client.. open a Cygwin window (Start Menu > All Programs > Cygwin > Cygwin Bash Shell) and change to the appropriate results directory: cd /cygdrive/c/vmmark2/results/Results_datestamp (where datestamp refers to the results to be formatted). 97 ..sh n filename (where n is the number of tiles included in the results to be formatted and filename is the resulting HTML filename). and replace ### with the details of your system configuration./tools/tilescore2html.vmx /vmfs/volumes/494d7f49-4a6b5a5e-5048-001b245bd287/ds2db0/db2db0. insert the contents of the HTML file you generated with tilescore2html./tools/disclosure.html file. open a Cygwin window (Start Menu > All Programs > Cygwin > Cygwin Bash Shell). This table will later be inserted into the full disclosure report.html file from the tools directory to the results directory: cp .HTML File After generating the HTML-formatted table of results and ratios.. Save the disclosure. Issue the command: .vmx /vmfs/volumes/494d7f49-4a6b5a5e-5048-001b245bd287/ds2webb0/ds2webb0.vmx /vmfs/volumes/494d7f49-4a6b5a5e-5048-001b245bd287/olioweb0/olioweb0. Generate an HTML-Formatted Table of Results and Ratios After successfully completing a benchmark run with reporting enabled.vmx /vmfs/volumes/494d7f49-4a6b5a5e-5048-001b245bd287/oliodb0/oliodb0. This involves the following steps: Compress the results folder Generate an MD5 sum on the submission file FTP the file to the submission site Receive an emailed auto-acknowledgment For specific submission instructions send email to benchmark@vmware.txt file.com.vmx 4 Save the edited VM-name-map. Edit the disclosure.

Once you have the VMmark testbed configured and working.CONFIG_T2' }" WAIT RETURNRESULT 2 3 Run the script from the prime client.xml" args "{ 'CONFIGFILE' : r'C:\vmmark\VMMARK2.net/. Create a multirun. the results of the tests will be in the last two results/Result_<datestamp> directories on the prime client. Inc.bat files or Cygwin shell scripts can be invoked from the command-line interface.bat or multirun. To run a one-tile test followed by a two-tile test 1 Create a VMMARK2. then starts the next test. The command window where this is invoked should display text similar to the following as each test completes: Response -------Job ID: 15 Result: None Response -------Job ID: 16 Result: None 4 In this example.xml" args "{ 'CONFIGFILE' : r'C:\vmmark\VMMARK2. refer to their user's guides available through http://staf. The script starts the first test. For more information on running STAF/STAX from the command line.VMware VMmark Benchmarking Guide Running VMmark without STAXMonitor Using the command-line interface provided by STAF/STAX it is possible to run VMmark without using the STAXMonitor GUI. either Windows .CONFIG_T1' }" WAIT RETURNRESULT staf local stax execute file "c:\vmmark\xml\vmmark_main. waits for it to complete. 98 VMware. indicating that STAF successfully ran the command.CONFIG_T1 and a VMMARK2.log files will match the Job ID list.CONFIG_T2 that specify TILES=1 and TILES=2 respectively (leaving the remainder of these configuration files containing whatever is appropriate for the specific testbed). The “Result: None” line is the expected output in this case. and the STAX_Job_<ID>*.sh script file that contains the lines: staf local stax execute file "c:\vmmark\xml\vmmark_main. This allows you to script the running of multiple tests serially without the need to use the STAXMonitor GUI.sourceforge. .

Install the Microsoft Windows or Linux operating system in the virtual machine (partitioning the virtual disk appropriately for the workload for which the virtual machine will be used).Creating the Workload Virtual Machines A This appendix describes the steps to create the virtual machines that are used as the workloads for the VMmark Benchmark testing and install the Microsoft Windows or Linux operating systems on those virtual machines. the VMware Tools package). Configure the guest operating system. first for the virtual machine running Microsoft Windows Server 2003. NOTE Many of the steps required to configure the Linux workload virtual machines can be avoided by downloading pre-built Linux virtual machines from VMware. “Create the Olio Web Virtual Machines” on page 55. Install and configure the STAF package in the virtual machine. VMware. as described in: “Create the Olio Database Virtual Machines” on page 53. Inc. To create the eight workload virtual machines 1 2 3 4 5 Configure the underlying virtual machines (customized for the workload for which the virtual machine will be used). “Create the DVD Store 2 Database Virtual Machines” on page 57. and lastly for the six virtual machines running Linux. Install any customized drivers recommended by the hypervisor vendor for use in virtual machines running the specific operating systems required for VMmark (for example. then for the virtual machine running Microsoft Windows Server 2008. 99 . and “Create the DVD Store 2 Web Virtual Machines” on page 59. These steps are described in more detail in the following sections.

set the number of NICs to 1.. then click Next. then click Next. When you are asked to Specify the guest operating system. click Finish to create the virtual machine. then click Next. select Virtual Machine Version: 7.. configure a new virtual machine with the following settings: 1 2 3 4 5 When you are asked to Select the configuration for the virtual machine. Inc. which includes the custom VMXNET3 driver. When you are asked to Create Network Connections. then click Next. When you are asked to specify the Number of virtual processors. select the Custom radio button.. When you are asked for a Virtual Machine Version. enter standby0. If you do so.. then click Next. This section details the creation of those virtual machines. 13 At the Ready to Complete window. select 512MB. select a location (either Store with the virtual machine or Specify a datastore:). When you are asked to Select a Datastore. leave the options unchanged: Virtual Device Node: SCSI (0:0) Mode: Independent: leave unselected Then click Next. then click Next. choosing it at this point will save a few steps later. then click Next.. When you are asked to Specify a Name and Location for this Virtual Machine. 6 7 8 12 Once the virtual machine is ready. choose either the LSI Logic Parallel or LSI Logic SAS. leave the Disk Provisioning options unchecked. enter 4GB. you might not have network access from the virtual machine until you install VMware Tools. then click Next. select your desired datastore. .. select 1. choose the network to use. In the Advanced Options window. however. select the Microsoft Windows radio button and in the Version: window choose Microsoft Windows Server 2003. NOTE If you will be using the high-performance VMXNET3 adapter. make sure Connect at Power On is checked. When you are asked the Memory Configuration. Enterprise Edition (32-bit). Create the Standby Virtual Machine Using the New Virtual Machine wizard in the VMware vCenter Client (Inventory > File > New > Virtual Machine). choose the Adapter type. then click Next. then click Next. proceed to install Microsoft Windows Server. as described in “Install Microsoft Windows Server 2003 Enterprise Edition” on page 101. When asked to Specify the virtual disk size and provisioning policy.VMware VMmark Benchmarking Guide Create and Configure the Standby Virtual Machines The standby virtual machines used in each VMmark benchmark tile run Microsoft Windows Server 2003 Enterprise Edition (32-bit). 9 10 11 When asked Which SCSI controller type would you like to use?. select Create a new virtual disk. 100 VMware. then click Next. When asked to Select the type of disk to use.

Restart the virtual machine by pressing <Ctrl><Alt><Insert> (this gets passed to the virtual machine as <Ctrl><Alt><Delete>. At the Networking Components window. and default gateway values appropriate for your network. then click Next. button in the menu bar (it looks like a CD with a wrench in front of it). then click Properties. Browse to the ISO image of the first operating system installation disc. select the Use the following IP address radio button. Format the Windows partition using the NTFS file system.Appendix A Creating the Workload Virtual Machines Install Microsoft Windows Server 2003 Enterprise Edition Install Microsoft Windows Server 2003 Enterprise Edition in the virtual machine. (either on local disk. VMware. it must be a 32-bit version. 10 11 12 13 Follow the Microsoft Windows installation prompts until you are given the option to create a partition. You can start with other releases or service packs. and causes it to reboot). then click Next. From the Summary tab in the vCenter Client. You will see the virtual machine try to boot. To install Microsoft Windows Server 2003 Enterprise Edition SP2 1 2 3 4 5 6 Create an ISO image of the operating system installation disc(s). select it.. and click Open. NOTE The installation instructions in this section are based on the use of Windows Server 2003 Enterprise Edition with Service Pack 2. and fill in DNS server addresses appropriate for your network. and you must upgrade each standby virtual machine to at least Service Pack 1 before running the benchmark. At the Workgroup or Computer Domain window. from which you can select CD-ROM Drive. Select the correct virtual machine (created in “Create the Standby Virtual Machine” on page 100). enter values appropriate for your network. Back at the Networking Components window. Copy the ISO image file(s) to a file system accessible from the system running the VMware vCenter Client. Use all available space for the partition. you can press <Esc> as the virtual machine is booting. but you must use Enterprise Edition. Click OK. a b c d e f g 14 Choose the Custom Settings radio button.. or on a datastore). Inc. Continue to follow the Microsoft Windows installation prompts until you reach the Network Settings window. select Internet Protocol (TCP/IP). then select Connect to ISO image. 7 8 9 Follow the remaining prompts to install Microsoft Windows. At the Internet Protocol (TCP/IP) Properties window. Still at the Internet Protocol (TCP/IP) Properties window. click within the center of the console window (you may see no change. or your cursor may disappear). Still under the Console tab in the vCenter Client. under Commands. select the Use the following DNS server addresses radio button. click Next. 101 . The simplest way to install an operating system in a virtual machine is to use an ISO image (or images) of the installation disc (or discs). NOTE If you have problems getting the system to boot from the ISO image. and fill in IP address. select Power On. but fail.. subnet mask. Select the Console tab in the vCenter Client. select CD/DVD Drive 1. This brings up a boot menu. Click the Connect/disconnect the CD/DVD. Do this with any third-party “CD ripping” software tool.. The virtual machine will boot from the ISO image. The installation and configuration of other releases and service packs varies slightly from these instructions.

iso file you just downloaded. in the Windows Setup window. 3 4 5 6 7 8 9 102 VMware.. After the reboot. saving it to a file system accessible from the system running the VMware vCenter Client. and click Next. When the Setup Type window appears. click OK and follow the prompts. it might be necessary to manually select it instead of the automatically-installed driver. and click Next. In the vCenter Client.. proxy server or IP address. then click OK. click Finish. Inc. which is addressed in the next section): 1 2 3 4 5 6 7 8 Power-on the virtual machine. When the Ready to Install the Program window appears. then select Connect to ISO image. and click Open. click Finish. When the Ready to Install the Program window appears. Note that if you change network drivers after an operating system is installed. navigate to http://packages. the system reboots. For VMware ESXi: 1 2 Power-on the virtual machine. If Windows Setup asks for an additional disc you can supply it as follows: a b c d Click the Virtual CDROM(ide0:0) button in the menu bar and select the option that begins with the word Disconnect. click Next. When a Welcome to the installation wizard for VMware Tools window appears. this time inside the virtual machine console (it may take a few minutes).iso file. this time selecting Connect to ISO image.vmware.. click Run setup. and click Open. Install the VMware Tools Package in Microsoft Windows Follow these steps to install the VMware Tools package in the Microsoft Windows virtual machine: NOTE Among the drivers included in the VMware Tools package is a high-performance VMXNET3 network driver. Again click the Virtual CDROM(ide0:0) button in the menu bar. When the Setup Type window appears. or on a datastore). for example.VMware VMmark Benchmarking Guide 15 16 When the installation is complete. select it. When the Installation Wizard Completed window appears. choose Typical. select CD/DVD Drive 1.com/tools/esx. . click Yes to allow the system to be restarted.exe Published by VMware. and download its . Browse to the ISO image of the second CD. When the Installation Wizard Completed window appears. you might need to reconfigure any networking settings. log in as Administrator. At the VMware Tools window. At the VMware Tools window. click Install. click Install.. select it. Click the Connect/disconnect the CD/DVD. Inc.. choose Typical. From a web browser on the vCenter Server system. button in the menu bar (it looks like a CD with a wrench in front of it). (either on local disk. select the ESX version and host operating system you're running. right-click on the virtual machine and select Guest > Install/Upgrade VMware Tools. To use this driver. For VMware ESX (as opposed to ESXi. Back within the virtual machine.. When a Welcome to the installation wizard for VMware Tools window appears. If an AutoPlay window appears in the guest operating system. Browse to the VMware Tools . click Yes to allow the system to be restarted. click Next.

Appendix A Creating the Workload Virtual Machines Follow these steps to enable time synchronization in VMware Tools 1 2 3 4 Right-click the blue VMware icon in the system tray on the task bar and choose Open VMware Tools. Install Windows Updates Install all available windows updates. Install and Configure the STAF Package Install and configure the STAF package in the Microsoft Windows virtual machine. and repeat until no more updates appear. click Custom.net/getcurrent. following the prompts to install the software. Install any new Windows Update software. 103 . Vista (AMD64) depending on whether this virtual machine is running 32-bit or 64-bit Windows. restart the system by clicking Restart now. we recommend that all clients and all workload virtual machines be running the same version of STAF. and using the following inputs: a b c Place the software in the default location of C:\STAF.4. check again for updates. then click OK. Install the STAF Package To install the STAF package in the virtual machine 1 2 Go to http://staf. as described in the following sections. When the updates are complete. At the Automatic Updates window. If there are more available. choose Typical. For installation type. both high-priority and optional.exe) version 3.php. restart the system. NOTE To avoid communication problems.) Run the executable setup file. Leave all other options at their defaults. depending on the current version of the package. double-click Automatic Updates.1 or later STAF package for either: Win95/98/Me/NT/2000/XP/2003/Vista/WinSrv2008 (32-bit) or: Windows Server 2003/2008. then install all available updates. After the system restarts. by following these steps: 1 2 3 4 5 Run Windows Update (Start Menu > Windows Update). At the Control Panel. Click OK to close the dialog box. both high-priority and optional. 3 VMware. At the Microsoft Windows Update page. make sure the radio button for Turn off Automatic Updates is selected. install them. (The exact name of the file may vary. Inc. Check the box next to Time synchronization between the virtual machine and the host operating system. Close the Control Panel. Turn off automatic updates by following these steps: 1 2 3 4 Open the Control Panel (Start Menu > Settings > Control Panel).sourceforge. Select the Options tab. Download the executable (*.

select it. including those that are continued with a backslash). you use the STAF.*) within Notepad. however.7. start with that one. Update the HOSTS File The standby workload virtual machine should be able to resolve the name used for its tile’s client system in the STAF.txt extension).7. (The exact entry will vary depending on which version of STAF you have installed.1 with the client’s IP address. and click Next. add the line: trust machine 192.4. an IP address range was used instead of a specific machine name. select the Settings tab.168. When the Scheduled Task Wizard appears. Scroll to Start STAF 3. If. Restart windows. This might require an entry such as the following in the C:\Windows\System32\drivers\etc\HOSTS file: 192. When the Start STAF properties window opens. and click Next.) NOTE If you have customized a STAF.1 client0 (replacing 192. Inc. comment out the service stax and service event entries (be sure to get all the lines. open C:\STAF\bin\STAF. 2 In the trust level block add the networking mask for the systems to be trusted and set them to trust level 5. to trust all machines in the 192.*.cfg File 1 Using Notepad (Start Menu > All Programs > Accessories > Notepad).* level 5 Save the edited file as C:\STAF\bin\STAF.cfg from Client 0. click Next. in the STAF. and click Next. then select Control Panel > Scheduled Tasks > Add Scheduled Task.168 network.168. NOTE This is not necessary if. saving some of the steps below.cfg file. . uncheck it. you have to change Files of type to All Documents (*. (To see this file. Click to OK to close the properties window.1. 104 VMware. Enter (or confirm) the Administrator user name and password. Check the Open Advanced properties for this task when I click Finish box. 3 Configure STAF to Start Automatically By default STAF starts when a user first logs in. Follow these steps to configure STAF to start when the machine is booted: 1 2 3 4 5 6 7 8 9 10 11 Open the Start menu. and client0 with the client’s name). Click Finish. and close NotePad.168.cfg file for a client or for another virtual machine.cfg file’s trust level block. For example: trust machine client0 level 5 Alternatively. If the box labeled Stop the task if it runs for [72] hours is checked.VMware VMmark Benchmarking Guide Create a Customized STAF.) Select the When my computer starts radio button.cfg.cfg (change Save as type to All Files so Notepad doesn’t append a .

Inc. This section details the creation of those virtual machine. then click Next.. Create the Mail Server Virtual Machine Using the New Virtual Machine wizard in the VMware vCenter Client (Inventory > File > New > Virtual Machine). When you are asked to specify the Number of virtual processors. then click Next. leave the options unchanged: Virtual Device Node: SCSI (0:0) Mode: Independent: leave unselected Then click Next.. however. When you are asked the Memory Configuration.. choose the network to use. then click Next. choose the Adapter type. which includes the custom VMXNET3 driver. When you are asked to Create Network Connections. enter mailserver0. set the number of NICs to 1. select the Custom radio button. 9 10 11 When asked Which SCSI controller type would you like to use?.Appendix A Creating the Workload Virtual Machines Create and Configure the Mail Server Virtual Machines The mail server virtual machines used in each VMmark benchmark tile run Microsoft Windows Server 2008 Enterprise Edition (64-bit). select the Microsoft Windows radio button and in the Version: window choose Microsoft Windows Server 2008 (64-bit). When you are asked for a Virtual Machine Version. enter 32GB. 12 VMware.. then click Next. If you do so. then click Next. When you are asked to Select a Name and Location for this Virtual Machine. then click Next. select your desired datastore. make sure Connect at Power On is checked. select Virtual Machine Version: 7. then click Next.. choosing it at this point will save a few steps later. configure a new virtual machine with the following settings: 1 2 3 4 5 6 7 8 When you are asked to Select the configuration for the virtual machine. leave the Disk Provisioning options unchecked. then click Next. select 4.. When you are asked to Select a Datastore. choose either the LSI Logic Parallel or LSI Logic SAS. then click Next. select 8GB. 13 At the Ready to Complete window. select Create a new virtual disk. click Finish to create the virtual machine. When you are asked to Specify the guest operating system. 105 . then click Next. NOTE If you will be using the high-performance VMXNET3 adapter. When asked to Specify the virtual disk size and provisioning policy. you might not have network access from the virtual machine until you install VMware Tools. In the Advanced Options window. then click Next. select a location (either Store with the virtual machine or Specify a datastore:). When asked to Select the type of disk to use.

Browse to the ISO image of the first operating system installation disc.. Click the Virtual CDROM(ide0:0) button in the menu bar and select Connect to ISO image. You can use other releases or service packs. Do this with any third-party “CD ripping” software tool. .. 10 11 Follow the Microsoft Windows installation prompts until the installation is complete. 12 13 After the Windows Desktop appears. but fail. However Exchange 2007 is not supported on Windows Server 2008 R2 until Exchange 2007 Service Pack 3. VMmark123). but you must use Enterprise Edition and must use a 64-bit version. from which you can select CD-ROM Drive. The installation and configuration of other releases and service packs might vary slightly from these instructions. Still under the Console tab in the vCenter Client. under Commands. accepting the defaults. The password must meet Active Directory requirements for a strong password. For information about editing this file. The virtual machine will boot from the ISO image. Inc. Adjust the screen resolution if desired (Start Menu > Control Panel > Personalization > Display Settings). To install Microsoft Windows Server 2008 Enterprise Edition SP2 1 2 3 4 5 6 7 8 9 Create an ISO image of the operating system installation disc(s). select it. click within the center of the console window (you may see no change. Select the correct virtual machine (created in “Create the Standby Virtual Machine” on page 100). You will see the virtual machine try to boot. and causes it to reboot). provide a new Administrator password. 106 VMware. Then follow the subsequent Windows prompts. Make any configuration changes required. NOTE If you have problems getting the system to boot from the ISO image. an Initial Configuration Tasks wizard will come up. see “Configure the VMmark Harness” on page 75. for example. you can press <Esc> as the virtual machine is booting. Copy the ISO image file(s) to a file system accessible from the system running the VMware vCenter Client. Restart the virtual machine by pressing <Ctrl><Alt><Insert> (this gets passed to the virtual machine as <Ctrl><Alt><Delete>. or your cursor may disappear). When the installation is complete and the system reboots. and click Open. The simplest way to install an operating system in a virtual machine is to use an ISO image (or images) of the installation disc (or discs). select Power On. then click Close.config file at MailServer/MailPassword=" ". This brings up a boot menu.VMware VMmark Benchmarking Guide Install Microsoft Windows Server 2008 Enterprise Edition Install Microsoft Windows Server 2008 Enterprise Edition in the virtual machine. NOTE Microsoft Exchange 2007 is supported on Windows Server 2008 versions before R2. NOTE This password also needs to be entered in the VMmark2. NOTE The installation instructions in this guide are based on the use of Windows Server 2008 Enterprise Edition with Service Pack 2. From the Summary tab in the vCenter Client. Select the Console tab in the vCenter Client.

107 . When the Setup Type window appears. Select the Options tab. right-click the blue VMware icon in the system tray on the task bar and choose Open VMware Tools. for example. and click Open. When the Setup Type window appears. When a Welcome to the installation wizard for VMware Tools window appears. Browse to the VMware Tools . click Finish. VMware. When the Installation Wizard Completed window appears. click Yes to allow the system to be restarted. it might be necessary to manually select it instead of the automatically-installed driver. this time inside the virtual machine console (it may take a few minutes). click Run setup. click Finish. and download its . For VMware ESX (as opposed to ESXi. When the Installation Wizard Completed window appears.. To use this driver. and click Next. Note that if you change network drivers after an operating system is installed. select the ESX version and host operating system you're running.. which is addressed in the next section): 1 2 3 4 5 6 7 8 Power-on the virtual machine. When the Ready to Install the Program window appears.iso file you just downloaded. or on a datastore). Check the box next to Time synchronization between the virtual machine and the host operating system. saving it to a file system accessible from the system running the VMware vCenter Client. click Install. click Next. click Next.. right-click on the virtual machine and select Guest > Install/Upgrade VMware Tools. and click Next. Inc. When a Welcome to the installation wizard for VMware Tools window appears. At the VMware Tools window. select it. proxy server or IP address. click Install. Inc.vmware. In the vCenter Client. (either on local disk. then click OK. For VMware ESXi: 1 2 Power-on the virtual machine.iso file. then select Connect to ISO image. Click the Connect/disconnect the CD/DVD. navigate to http://packages. From a web browser on the vCenter Server system. When the Ready to Install the Program window appears.Appendix A Creating the Workload Virtual Machines Install the VMware Tools Package in Microsoft Windows Follow these steps to install the VMware Tools package in the Microsoft Windows virtual machine: NOTE Among the drivers included in the VMware Tools package is a high-performance VMXNET3 network driver. Click OK to close the dialog box.exe Published by VMware. button in the menu bar (it looks like a CD with a wrench in front of it). 3 4 5 6 7 8 9 Follow these steps to enable time synchronization in VMware Tools 1 2 3 4 After the system has restarted..com/tools/esx. choose Typical. you might need to reconfigure any networking settings. At the VMware Tools window. If an AutoPlay window appears in the guest operating system. click Yes to allow the system to be restarted. choose Typical. select CD/DVD Drive 1.

In the Add Hardware window. Right-click the word Disk 1 (it will have a small red arrow) and select Online. In the Advanced Options window.00 GB Unallocated) and select New Simple Volume. where it says 40. under the Hardware tab. button. In the Create a Disk window. Right click on the disk space area (toward the right. In the Virtual Machine Properties window. After the system restarts. Inc. install them. In the Windows Update window. Under the Getting Started tab. select the Create a new virtual disk radio button. leave the Disk Provisioning options unchecked. Back at the Virtual Machine Properties window. click Finish to accept settings. and repeat until no more updates appear. by following these steps: 1 2 3 4 5 6 7 Run Windows Update (Start Menu > All Programs > Windows Update). but don’t turn on automatic updating. within the middle pane. then click Next.. 9 10 At the Ready to Complete window. leave MBR selected.VMware VMmark Benchmarking Guide Install Windows Updates Install all available windows updates. When the updates are complete. In the Create a Disk window. Open the Server Manager window (Start Menu > Administrative Tools > Server Manager). then click Next. select the mail server virtual machine. check again for updates. Under Important Updates select Never check for updates (not recommended). Create a Second Virtual Disk 1 2 3 4 5 6 7 8 Within the vSphere Client Inventory pane. expand Storage (click the plus sign) and click Disk Management. Create the Database and Backup Drives The mail server virtual machine needs a second virtual disk on which are created two partitions. click the Add. select a location (either Store with the virtual machine or Specify a datastore:). then install all available updates. . leave the options unchanged: Virtual Device Node: SCSI (0:0) Mode: Independent: leave unselected Then click Next. In the Select a Disk window. then click Next. click OK to close the window. enter 40GB. Click the Check for updates button. restart the system. Install any new Windows Update software. At the Initialize Disk window. Again right-click the word Disk 1 (it will still have a small red arrow) and select Initialize Disk. select the Create a new virtual disk radio button. select Hard Disk. then click OK. If there are more available. restart the system by clicking Restart now. click Edit virtual machine settings. In the left pane. then click OK. Create and Format the Database Partition 1 1 2 3 4 5 6 Boot the mail server virtual machine into Windows. 108 VMware.. then click Next. both high-priority and optional. click Change Settings. this section describes the creation of this virtual disk and the creation and formatting of the partitions.

Switch to this window and click Cancel (the disk should already have been formatted as part of the previous step).. and se the Volume label to Backup..exe) version 3. click Finish. Switch to this window and click Cancel (the disk should already have been formatted as part of the previous step).php Download the executable (*. saying You need to format the disk. leave the Allocation unit size at Default. Install the STAF Package To install the STAF package in the virtual machine 1 2 Go to: http://staf. At the Format Partition window. click Next. set the File system to NTFS.1 or later STAF package for Windows Server 2003/2008. enter the maximum disk space of 8189MB. then click Next. 3 VMware. saying You need to format the disk. At the Welcome to the New Simple Volume Wizard window. A new window will pop up behind the Server Manager window. Inc. Create and Format the Backup Partition 1 2 3 4 5 6 7 Back at the Server Manager window. At the Completing the New Simple Volume Wizard window. aka x64).. leave the Allocation unit size at Default.net/getcurrent. At the Assign Drive Letter or Path window. At the Completing the New Simple Volume Wizard window.Appendix A Creating the Workload Virtual Machines 7 8 9 10 11 12 At the Welcome to the New Simple Volume Wizard window. At the Specify Volume Size window. enter a size of 32768MB.4.) Run the executable setup file.. and leaving all options at their defaults. assign drive letter E:. At the Format Partition window. then click Next. 109 . NOTE To avoid communication problems. Vista. then click Next. Install and Configure the STAF Package Install and configure the STAF package in the Microsoft Windows virtual machine. At the Assign Drive Letter or Path window. we recommend that all clients and all workload virtual machines be running the same version of STAF. and set the Volume label to Database. as described in the following sections. following the prompts to install the software.sourceforge. Windows 7 (AMD64. then click Next. then click Next.00 GB Unallocated) and select New Simple Volume.. assign drive letter F:. depending on the current version of the package. with a bundled JVM: STAF341-setup-winamd64. right click on the remaining disk space area (where it says 8. click Next. set the File system to NTFS. click Finish. A new window will pop up behind the Server Manager window. At the Specify Volume Size window. then click Next..exe (The exact name of the file might be different.

In the left pane of the Server Manager window. and close NotePad.) NOTE If you have customized a STAF. In the Add a Program window. 2 In the trust level block add the networking mask for the systems to be trusted and set them to trust level 5. Back at the Windows Firewall window click OK.7. double-click Windows Firewall.*. In the Windows Firewall Settings window click the Add Program. button.168. Inc. 110 VMware. .cfg from Client 0. then click the Open button. comment out the service stax and service event entries (be sure to get all the lines.* level 5 Save the edited file as C:\STAF\bin\STAF. add the line: trust machine 192.txt extension). (To see this file. navigate to C:\staf\bin\STAFProc. Update the hosts File The mailserver workload virtual machine should be able to resolve the name used for its tile’s client system in the STAF.168. Follow these steps to configure the Windows firewall to allow STAF to pass through: 1 2 3 4 5 6 7 8 Open the Start menu then select Control Panel. open C:\STAF\bin\STAF. click OK.. Install Windows Server Components and Windows Support Tools The last steps to take before cloning the mail server virtual machines are to install a number of optional server components.1 with the client’s IP address.. If. This might require an entry such as the following in the C:\Windows\System32\drivers\etc\hosts file: 192. In the Control Panel window. click Browse. you use the STAF.1 client0 (replacing 192.exe to Pass Through Windows Server 2008 includes a firewall.cfg (change Save as type to All Files so Notepad doesn’t append a .cfg file. NOTE This is not necessary if. and client0 with the client’s name).cfg file’s trust level block.cfg file customized for this virtual machine 1 Using Notepad (Start Menu > All Programs > Accessories > Notepad). to trust all machines in the 192. Back at the Add a Program window.7.VMware VMmark Benchmarking Guide Create a Customized STAF.cfg file for a client or for another virtual machine. click Features.168 network.cfg. saving some of the steps below. including those that are continued with a backslash). and to install Microsoft Windows Support Tools. In the Windows Firewall window. In the Browse window. an IP address range was used instead of a specific machine name. however.168. Install Windows PowerShell Install PowerShell as follows: 1 2 Open the Start menu and select Server Manager. 3 Configure the Windows Server 2008 Firewall to Allow STAFProc. start with that one. click Allow a program through Windows Firewall.cfg File To create a STAF. you have to change file type (in the lower right corner) to All Files. in the STAF. Alternatively.exe.

click Install. 10 11 12 13 Configure Internet Explorer to Not Use a Proxy Server 1 2 3 4 Start Internet Explorer.Appendix A Creating the Workload Virtual Machines 3 4 5 6 7 8 In the right pane of the Server Manager window. VMware.. Make sure the box next to Use a proxy server for your LAN is not checked. click Install. click Next. click Next.. click Next. Inc. then click on the LAN settings button. wait for the installation to complete. select Internet Options. At the Installation Results window. At the Tools menu. 111 . 1 2 3 4 5 6 7 8 9 Open the Start menu and select Server Manager. At the Select Role Services window. In the right pane of the Server Manager window. Dismiss the Windows automatic updating is not enabled. In the Confirmation window. At the Before You Begin window. add a checkmark next to Web Server (IIS). Close the Server Manager window. click the Add Required Features button. window. In the left pane of the Server Manager window. click Add Roles.. add checkmarks to the following role services: Basic Authentication Windows Authentication Digest Authentication Dynamic Content Compression IIS 6 Metabase Compatibility IIS 6 Management Console Still in the Select Role Services window. In the Select one or more features. add a checkmark next to Windows PowerShell. the Results window appears. Click Close. Close the Server Manager window. When the Add features required for Web Server (IIS)? window appears.. Install Windows Server Components Microsoft Windows Server 2008 requires the installation of a number of components before a system can become a domain controller. Select the Connections tab. At the Confirm Installation Selections window. After the installation is complete. then click Next. then click Close. click Roles. warning. At the Web Server (IIS) window. Back at the Select Server Roles window. click Next. click Add Features. At the Select Server Roles window.

10 When asked Which SCSI controller type would you like to use?. When you are asked to Specify the guest operating system. Other interfaces and other hypervisors may be different. then click Next. select your desired datastore. 11 12 When asked to Select the type of disk to use.. select 2GB. When you are asked to Select a Datastore. as we recommend. choose the Adapter type. as described in: “Create the Olio Database Virtual Machines” on page 53. then click Next.VMware VMmark Benchmarking Guide Create and Configure the SLES Virtual Machines Six of the eight virtual machines used in each VMmark benchmark tile run SLES 11 Linux (64-bit). you can skip this entire section.. When asked to Specify the virtual disk size and provisioning policy. Inc. choose the network to use. then click Next. select the Custom radio button. then click Next. then click Next. you instead download the pre-built virtual machine templates from VMware. then click Next. select Virtual Machine Version: 7. “Create the DVD Store 2 Database Virtual Machines” on page 57. enter SLES11-template. leave the Disk Provisioning options unchecked. leave the options unchanged: Virtual Device Node: SCSI (0:0) Mode: Independent: leave unselected Then click Next.. then click Next. NOTE If you will be using the high-performance VMXNET3 adapter. click Finish to create the virtual machine. This section details the creation and configuration of a single template for these six virtual machines. If you do so. NOTE The following sections describe procedures using the VMware vCenter Client connected to an ESX host.. enter the name of the cluster you created in “Configure vCenter” on page 44. then click Next. choose either the LSI Logic Parallel or LSI Logic SAS. When you are asked the Memory Configuration. When you are asked to Select a Name and Location for this Virtual Machine... NOTE This section is only necessary if you choose to configure one or more of the Linux workload virtual machines from scratch. If. make sure Connect at Power On is checked. 13 112 VMware. you might not have network access from the virtual machine until you install VMware Tools. however. select a location (either Store with the virtual machine or Specify a datastore:). select the Linux radio button and in the Version: window choose Suse Linux Enterprise Server 11 (64-bit). In the Advanced Options window. enter 10GB. When you are asked to Create Network Connections. If you are asked to On which host or cluster do you want to run this virtual machine. select 2. which includes the custom VMXNET3 driver. set the number of NICs to 1. When you are asked for a Virtual Machine Version. Create the Virtual Machine Using the New Virtual Machine wizard in the VMware vCenter Client (Inventory > File > New > Virtual Machine). and “Create the DVD Store 2 Web Virtual Machines” on page 59. select Create a new virtual disk. When you are asked to specify the Number of virtual processors. then click Next. then click Next. 14 At the Ready to Complete window. configure a new virtual machine with the following settings: 1 2 3 4 5 6 7 8 9 When you are asked to Select the configuration for the virtual machine. then click Next. then click Next. “Create the Olio Web Virtual Machines” on page 55. . choosing it at this point will save a few steps later.

then click Next. At the Installation Settings screen. Hardware Clock setting. At the Server Base Scenario screen.. To install SLES 11 1 2 3 4 5 6 Create ISO images of the operating system installation discs. from which you can select CD-ROM Drive. Do this with any third-party “CD ripping” software tool. From the Summary tab in the vCenter Client. Time Zone. Browse to the ISO image of the first operating system installation disc. click OK.. select a Language and Keyboard Layout. At this point. Select the Console tab in the vCenter Client. and causes it to reboot). At the Welcome screen. leave the New Installation radio button selected. then click Next. click within the center of the console window (you may see no change. Inc. NOTE If you will be using the template virtual machines supplied by VMware. unless you will be configuring a virtual machine from scratch. select it. you do not need to use this section. you should return to the instructions in Chapter 3.. At the Media Check screen. Click the Connect/disconnect the CD/DVD. then click Next. and click Open. leave the Include Add-On Products from Separate Media unselected. (either on local disk or on a datastore). NOTE If you have problems getting the system to boot from the ISO image. 113 . Select the correct virtual machine (created in “Create the Virtual Machine” on page 112). select Power On. At the Installation Mode screen. or your cursor may disappear). set your Region. At the Clock and Time Zone screen. and Time and Date. The virtual machine will boot from the ISO image.. button in the menu bar (it looks like a CD with a wrench in front of it). click the Software section heading. under Commands.. select the Physical Machine radio button. 10 11 12 13 14 15 16 At the SLES Boot Options prompt. Restart the virtual machine by pressing <Ctrl><Alt><Insert> (this gets passed to the virtual machine as <Ctrl><Alt><Delete>. “Preparing the Infrastructure for VMmark 2.”. and fail. select CD/DVD Drive 1. Still under the Console tab in the vCenter Client. then select Connect to ISO image. check the I Agree to the License Terms box to indicate your agreement.1 Benchmark Tests. then click Next.Appendix A Creating the Workload Virtual Machines 15 16 If you receive a warning Creation of the virtual machine (VM) does not include automatic installation of the guest operating system. then click Next. check your media if desired. you can press <Esc> as the virtual machine is booting. This brings up a boot menu. scroll down to Installation and press <ENTER> to begin the installation in graphical mode. Copy the ISO image files to a disk location accessible from the system running the VMware vCenter Client. You will see the virtual machine try to boot.. Install and Configure SUSE Linux Enterprise Server 11 Installation of the operating system requires the installation DVD for SUSE Linux Enterprise Server (SLES) 11 (64-bit version). 7 8 9 VMware.

com/kb/340). At the Network Configuration screen. At the CA Management screen. At the Installation Completed screen. 1 2 3 Power on the virtual machine and log in as root. . confirm the password. At the shell prompt.e. select Yes (use <Alt><y>).com). select Next (use <Alt><n>). click Install. 18 19 20 21 22 23 24 25 26 27 28 Back at the Network Configuration screen. Back at the Installation Settings screen. Install the VMware Tools Package in the Linux Virtual Machine To install the VMware Tools package in the SLES virtual machine. unselect Enable IPv6 (use <Tab> <Tab> <Space>). If a No Running Network warning appears. then select Next (use <Alt><n>). then select Next (use <Alt><n>). select Continue. your. The operating system will install and the system will reboot. At the Hardware Configuration screen. enter the following commands: 114 VMware. select Next (use <Alt><n>). set the root password to vmmark. accept the reboot is needed warning. follow these steps: NOTE These instructions are for Linux virtual machines running in ESX. At the User Authentication Method screen. make the following changes: Deselect Novell AppArmor Deselect all items under Graphical Environment Deselect all items under Primary Function then click OK. right-click on the virtual machine and select Guest > Install/Upgrade VMware Tools. Inc. At the Release Notes screen. For a pointer to the latest ESXi instructions. replace the default domain name with the appropriate one for your site (i. click Install. select Write Hostname to /etc/hosts (use <Tab> <Space>). Within the vSphere Client Inventory pane. and select Next (use <Alt><n>). select Change (use <Alt><c>) and select Firewall. replace the default hostname with SLES11-template. select Finish (use <Alt><f>). At the Confirm Installation screen.. leave the fields empty. At the Password is too simple screen. At the Password screen. Back at the Network Configuration screen. At the Password is all lower case screen. select Next (use <Alt><n>).VMware VMmark Benchmarking Guide 17 At the Software Selection and System Tasks screen. At the Hostname and Domain Name screen. leave the defaults. see VMware KB article 340 (http://kb. At the New Local User screen. leave the fields empty. deselect Change Hostname via DHCP (use <Tab> <Space>). then select OK (use <Alt><o>). but not in ESXi. select Change (use <Alt><c>) and select General Network Settings. then select Yes (use <Enter>). select Disable Firewall Automatic Starting (use <Tab> <Tab> <Space>). then select OK (use <Alt><o>). select Yes (use <Alt><y>). then select Next (use <Alt><n>). select Next (use <Alt><n>). At the Firewall Configuration: Start Up screen.company. choose not to test (use <Tab> <Tab> <Space>). then select Next (use <Alt><n>). At the Network Setup Method screen. 29 30 31 32 33 34 35 36 At the Test Internet Connection screen.vmware. At the Empty User Login screen.

change to the /tmp directory: cd /tmp Use wget to download the file. 5 6 7 When the install is complete. Set a static IP address.Appendix A Creating the Workload Virtual Machines For vSphere 4. If errors are reported.1: mount /dev/cdrom /media mkdir ~/vmware_tools cd ~/vmware_tools tar zxvf VMwareTools* cd vmware-tools-distrib . you can leave it as DHCP until after the virtual machine is cloned.pl 4 Accept the default answers to the questions. 115 . NOTE If desired.sourceforge. Back at the SLES virtual machine command line.gz STAF package. refer to VMware product documentation for troubleshooting. under the Options tab. right-click on the virtual machine and select Edit Settings. log in as root. 1 2 3 Within the vSphere Client Inventory pane. then click OK. For example: wget http://prdownloads. add a check mark next to Synchronize guest time with host. NOTE To avoid communication problems. 8 Verify that the VMware Tools package is fully installed by selecting the Summary tab for the virtual machine with which you are working and looking for the OK after VMware Tools: in the General box. under Advanced. VMware.1 or later.sourceforge. Install the STAF Package 1 2 3 From a web browser on another system. using the download URL you determined in Step 1. we recommend that all clients and all workload virtual machines be running the same version of STAF. select VMware Tools. reboot the system: shutdown -r now After the system boots. go to http://staf. In the right pane.tar./vmware-config-tools./vmware-install.gz (the exact filename might vary.pl For vSphere 4. Install and Configure the STAF Package Install and configure the STAF package in the Linux operating system virtual machine as detailed in the following two sections.4. Enable Time Synchronization in VMware Tools NOTE Methods of enabling time synchronization other than the one detailed below might not work. In the Virtual Machine Properties window.net/staf/STAF343-linux-amd64.0: mount /dev/cdrom /media cd /media rpm -ihv VMwareTools* . depending on the STAF release and bit version).net/getcurrent. version 3. Inc.php and determine the download URL for the Linux (AMD64) . NOTE The screen might flicker as the video driver is updated.tar.

VMware VMmark Benchmarking Guide

4

Execute the following command: tar xvzf STAF341-linux-amd64.tar.gz (again, the exact filename might vary, depending on the STAF release and bit version). Change to the newly-created staf directory. Execute the STAFInst script: ./STAFInst Press <ENTER> repeatedly to read the license, then press <ENTER> to accept it.

5 6 7

Create a Customized STAF.cfg File
1 Using the vi editor, open the STAF.cfg file: vi /usr/local/staf/bin/STAF.cfg NOTE If you’ve already customized a STAF.cfg file for a client or for another virtual machine, you can start with that one, saving some of the steps below. If you use a STAF.cfg file from a Windows system, however, comment out the line SET DEFAULTSTOPUSING WM_CLOSE, and if you use the STAF.cfg from Client 0, comment out the service stax and service event entries (be sure to get all the lines, including those that are continued with a backslash) 2 3 Use i to enter editing mode, then the cursor keys to move around within the file. In the trust level block, add the fully-qualified domain names of all workload virtual machines and all client systems, and set them to trust level 5. For example, to trust all machines in the 192.168 network, add the line: trust machine 192.168.*.* level 5 4 Save the file and close vi: <ESC> :wq

Set Open File Limits
1 Add the following to the /etc/security/limits.conf file: * soft nofile 65535 * hard nofile 65535 Add the following to the /usr/local/staf/STAFEnv.sh file (at the beginning of the file, just after the #STAF environment variables line): ulimit -n 65535

2

Disable Persistent Network Adapter Name Rules
1 2 Delete the file /etc/udev/rules.d/70-persistent-net.rules. Delete the file /lib/udev/rules.d/75-persistent-net-generator.rules.

Configure the Linux System to Automatically Start STAFProc
1 2 Open /etc/init.d/boot.local and add the following line to the end of the file: /usr/local/staf/startSTAFProc.sh Reboot the virtual machine.

Update the hosts File
The workload virtual machines should be able to resolve the name used for their tile’s client system in the STAF.cfg file’s trust level block. This might require an entry such as the following in the /etc/hosts file: 192.168.7.1 client0

116

VMware, Inc.

Appendix A Creating the Workload Virtual Machines

(replacing 192.168.7.1 with the client’s IP address, and client0 with the client’s name). NOTE This is not necessary if, in the STAF.cfg file, an IP address range was used instead of a specific machine name.

VMware, Inc.

117

VMware VMmark Benchmarking Guide

118

VMware, Inc.

If you don’t set the hostname and the configure static IP addresses here. VMware. you can use Guest Customization to configure each one with a hostname and static IP address. and performed the other customizations described in Appendix A. “Creating the Workload Virtual Machines. and then follow the instructions in the sections below. naming them mailserverN (where N is the tile number to which this workload belongs). Clone the Mail Server Virtual Machines Unlike the other virtual machines. the second would be mailserver1. Because some of these settings are not easily changed after Microsoft Exchange Server is installed. You should have created the six virtual machines. then complete the configuration and software installation. first create the underlying virtual machine. Prepare the Mail Server Virtual Machines To create the mail server virtual machines. you should also refer to the Readme. the mail server requires custom settings for each tile.Installing Applications in the Workload Virtual Machines B This appendix describes the steps needed to install applications in the six workload virtual machines that make up each tile. and so on. installed the operating systems. The first mail server virtual machine would be mailserver0. Inc. NOTE If you use vCenter to clone the mail server virtual machines.txt file included in the VMmark kit. In addition to the instructions included in this document. it is easiest to partially configure a machine to be used as a template. you’ll need to do so manually in the next section. clone it. Make as many clones of the mail server virtual machine template as you will need (one for each tile you expect to run).” on page 99. 119 . as described in “Create and Configure the Mail Server Virtual Machines” on page 105.

Dismiss the warning regarding domain controllers that are running Windows Server 2003 or later. 3 4 5 6 7 8 9 10 11 12 13 14 15 16 120 VMware..com. and click the Properties button. select it. Dismiss the warning regarding domain controllers that are running Windows Server 2003 or later. select Windows Server 2003. 1 If the mail server virtual machine is not yet configured with a static IP address.. where N is the tile number that this virtual machine will be part of. enter and confirm a password of your choice. Click OK to close the Internet Protocol (TCP/IP) Properties window.company. At the Summary window. If you get a warning window beginning A delegation for this DNS server cannot be created. At the Operating System Compatibility window click Next.e. Inc. then close the Network Connections window. select Settings > Network Connections.VMware VMmark Benchmarking Guide Make the Mail Server Virtual Machine a Domain Controller After the mail server virtual machines are cloned. and SYSVOL window. then click Restart Now. At the Choose a Deployment Configuration window. then click Next.company. scroll to Internet Protocol (TCP/IP). Log Files. At the Location for Database. assign one now. then click Next. Under the General tab. then click Next.. . then click Next.company. a b c d e From the Start menu. select Create a new domain in a new forest. At the Additional Domain Controller Options window. click Finish.your. At the Set Forest Functional Level. Enter a static IP address and other settings appropriate for your location. click Next. At the Directory Services Restore Mode Administrator Password window. your. follow these steps to promote each one to be a domain controller.com is your company’s domain name. 2 Start the Active Directory Installation Wizard by opening a Command Prompt window (Start > Command Prompt) and typing: dcpromo At the Active Directory Domain Services Installation Wizard click Next.. This domain name must be in three parts (i. leave the checkmark next to DNS server. Right-click the active network connection (typically Local Area Connection) and select Properties.. and your. enter the DNS name for the new domain.com). then click Next. When the system reports Active Directory Domain Services is now installed on this computer. This should be the fully-qualified domain name in the format maildomainN. then click Next. At the Set Domain Functional Level.. select Windows Server 2003. leave all folders in their default locations and click Next.. click Yes. At the Name the Forest Root Domain window. OK to close the Local Area Connection Properties window (which might have a different name).

In the vmmark Properties window. In the right pane. click Finish.. This will deselect all the cells (indicated by the cells turning white). select I accept. 2 3 4 5 6 7 8 9 10 11 12 Insert the DVD or run the downloaded file. In the vmmark Properties window. then click Finish. then click New. then click Apply. then click Next. At the Exchange Organization screen. In the top left of the spreadsheet double-click on the box with a dotted border. 121 .Appendix B Installing Applications in the Workload Virtual Machines Install Microsoft Exchange Server 2007 Install Microsoft Exchange Server 2007. click OK. At the License Agreement screen. then make sure that the Exchange Server tools installed in the client systems (described in “Install Exchange Server 2007 Tools” on page 86) match this service pack (or lack of service pack). leave the box next to Finalize Installation using the Exchange Management Console checked. enter E:\vmmark. At the Installation Type screen. is being installed at this time. then click Next. click Finish. leave the installation path at the default. In the Storage group name: field. check the box next to Enable circular logging. In the lower portion of the middle pane. In the lower portion of the middle pane. Click on Step 4: Install Microsoft Exchange. right click on vmmark and select New Mailbox Database. and in the System files path. select Properties > Customize. 2. At the Completion screen. Item 1.. In the left pane of the Exchange Management Console. If you see a Hub Transport Role Prerequisites warning. you can safely ignore it. At the Error Reporting screen. At the Client Settings screen. right click the database.) NOTE Note which Microsoft Exchange Server service pack. click the plus sign next to Server Configuration and select Mailbox. enter vmmark. click on each one in order and follow the prompts.. In the Mailbox database name: field. then click Install. in the Log files path field. At the Completion window. if any. enter E:\vmmark. leave it set to First Organization. (This is available as part of the Microsoft Developer’s Network (MSDN) Universal subscription. select No.. If.. then click New.. for some reason. Configure Microsoft Exchange Server To configure Exchange Server 2007 1 2 3 4 5 6 7 8 9 10 11 12 VMware. Inc. right click on vmmark and select Properties. At the Introduction screen. then click Next. After creating the mailbox database. select No. then click Next. To install the Microsoft Exchange Server 2007 package in each virtual machine 1 Obtain Microsoft Exchange Server 2007 Enterprise Edition. wait for the check to complete. At the Readiness Checks screen. enter lpriv1. click on New Storage Group. then click Next. click Next. click on Typical Exchange Server Installation. they’re not completed. and 3 should be greyed out (you’ve already performed these steps). At the Completion window.

. In that case. Check for Updates. At the Completion window.exe. c Update Exchange Server 2007 After installing and configuring Exchange Server. 1 2 3 4 5 6 7 8 9 Back at the Exchange Server 2007 setup window. the steps may be different than those shown below. Find the line that says: <add key="DatabaseMaxCacheSize" value="134217728" /> 122 VMware. Disable indexing on the Exchange databases: a b Open the Exchange Management shell (Start > All Programs > Microsoft Exchange Server 2007 > Exchange Management Shell). .VMware VMmark Benchmarking Guide 13 14 15 16 17 18 19 In the lower portion of the middle pane.config for editing. NOTE Note which Microsoft Exchange Server service pack. Close the Exchange Management Console. click Continue.. right click on vmmark and select New Mailbox Database.. Install the Active X control. Install Windows Update software (if requested). and update Exchange manually. At the Review the license agreement page. Increase the Transport Database Cache Size Increase the transport database cache size as follows: 1 2 3 Go to C:\Program Files\Microsoft\Exchange Server\Bin\ Open the file EdgeTransport. Inc. Click the Custom button. This will deselect all the cells (indicated by the cells turning white). enter lpriv2. In the top left of the spreadsheet double-click on the box with a dotted border. click on Step 5: Get Critical Updates for Microsoft Exchange. Install Microsoft Update software (if requested). if any. follow the prompts. is being installed at this time. At the Try Microsoft Update web page. then click New. click Finish. don’t install any additional roles. In the Mailbox database name: field. install any critical updates. Enter the following commands: Set-MailboxDatabase lpriv1 -IndexEnabled $false Set-MailboxDatabase lpriv2 -IndexEnabled $false Close the Exchange Management shell. Install all high priority updates. select Properties > Customize. then make sure that the Exchange Server tools installed in the client systems (described in “Install Exchange Server 2007 Tools” on page 86) match this service pack (or lack of service pack). NOTE Depending on your Exchange version and installation package type. right click the database. After creating the mailbox database. click Start Now.

Configure STAF to Start Automatically By default STAF starts when a user first logs in. Still at the STAF Properties window. At the STAF Properties window. At the Summary window. then click OK. select Start a program. Inc. then click Open. At the Task Scheduler window. Back at the Start a Program window. In the Action window. click Next. Follow these steps to configure STAF to start when the machine is booted: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Open the Start menu. In the Task Scheduler window. then click Next. Restart windows. double click Administrative Tools.Appendix B Installing Applications in the Workload Virtual Machines 4 5 Change it to: <add key="DatabaseMaxCacheSize" value="536870912" /> Save and close the file. enter STAF in the Name: field. add a check mark next to Open the Properties dialog for this task when I click Finish. In the Task Trigger window. double click Task Scheduler. enter the administrator password. then select Control Panel. In the Start a Program window. Close the Task Scheduler window and the Administrative Tools window. then click Next. go to C:\STAF\. select When the computer starts. VMware. select startSTAFProc (the selection identified as a batch file. go to the Settings tab and remove the check mark next to Stop the task if it runs longer than:. then click Next. then click OK. Within the Control Panel. click Browse. In the Administrative Tools window. In the Create a Basic Task window. under Actions (at the right). select the Run whether user is logged on or not radio button. click Create Basic Task. then click Finish. not the one identified as an Icon). under the General tab. 123 .

VMware VMmark Benchmarking Guide

Prepare the Standby Virtual Machines
The standby virtual machine is simply a virtual machine running Microsoft Windows Server 2003 Enterprise Edition with no workload applications installed or running. In order to control and monitor the virtual machine, however, the STAF software package must be installed. To create the standby virtual machine, create a Windows Server 2003 virtual machine, as described in “Create and Configure the Standby Virtual Machines” on page 100 (note that this includes the required STAF software package, mentioned earlier), then make the following customization: 1 In the C:\ directory of the template VM, create a new file named SignedOff.ini, containing the following text: [Unicode] Unicode=yes [Version] signature="$chicago$" Revision=1 [Registry Values] MACHINE\Software\Microsoft\Driver Signing\Policy=3,0 Save and close the file.

2

Clone the Standby Virtual Machine
After the configuration is complete, make as many clones of the standby virtual machine as you will need (one for each additional tile you expect to run), naming them standbyN (where N is the tile number to which this workload belongs), then edit their /etc/hosts file to include their tile’s client. The first standby virtual machine would be standby0, the second would be standby1, and so on.

Prepare the Template for the Deploy Operation
The deploy operation (one of the infrastructure operation workloads) starts with a virtual machine based on the standby virtual machine, but with an outdated version of VMware Tools. The VMmark Harness clones this template, boots it, performs an operating system customization on it, then upgrades the VMware Tools installation. This section describes creating the template for that operation. 1 2 3 Make a clone of the standby virtual machine you created in “Prepare the Standby Virtual Machines” on page 124, naming it DeployTemplate. Determine which version of ESX you will use as the source for the out-of-date VMware Tools. For example, if your test systems are all running ESX 4.1, you might use VMware Tools from ESX 4.0. On the vCenter Server system, navigate to http://packages.vmware.com/tools/esx, select the out-of-date ESX version you chose above, and download the Windows 32-bit .iso file for that version, saving it to a VMFS datastore. For example, to use VMware Tools from ESX 4.0, download: http://packages.vmware.com/tools/esx/4.0/windows/x86/VMware-tools-windows-4.0.0-164009.iso 4 5 6 7 Mount the VMware Tools Windows .iso file to the DeployTemplate virtual machine and perform a normal VMware Tools installation. Reboot the DeployTemplate virtual machine to complete the installation. Shut down the DeployTemplate virtual machine. Convert this virtual machine to a vSphere template. a b In vCenter, right-click the virtual machine from Inventory to see its menu. Select Template > Convert to Template.

124

VMware, Inc.

Appendix B Installing Applications in the Workload Virtual Machines

Prepare the Olio Database Virtual Machines
To prepare the Olio database virtual machine, first create a SLES 11 virtual machine template, as described in “Create and Configure the SLES Virtual Machines” on page 112, then follow the instructions in the following sections. NOTE This section is only necessary if you configure an Olio database workload virtual machine from scratch. If, as we recommend, you instead download the pre-built virtual machine template from VMware, as described in: “Create the Olio Database Virtual Machines” on page 53, you may skip this section entirely.

Customize the SLES 11 Virtual Machine Template
The Olio database virtual machine starts with the SLES 11 virtual machine template created in “Create and Configure the SLES Virtual Machines” on page 112. You then customize it, as described in the following two subsections.

Clone the SLES11 Template Virtual Machine
Clone the SLES11-template virtual machine, naming the new virtual machine OlioDB0.

Customize the Virtual Machine for Olio Database
1 2 3 4 5 6 7 8 Within the vSphere Client Inventory pane, select the Olio database virtual machine (OlioDB0). Make sure the virtual machine is powered down. Under the Getting Started tab, click Edit virtual machine settings. In the Virtual Machine Properties window, under the Hardware tab, select Memory. Set the Memory Configuration: to 2GB (it will probably already be set to this amount). In the Virtual Machine Properties window, under the Hardware tab, select CPUs. Set the Number of virtual processors: to 2 (it will probably already be set to this number). Click OK.

Create a Second Virtual Disk
1 2 3 4 5 6 7 8 Within the vSphere Client Inventory pane, select the Olio database virtual machine. Under the Getting Started tab, click Edit virtual machine settings. In the Virtual Machine Properties window, under the Hardware tab, click the Add... button. In the Add Hardware window, within the middle pane, select Hard Disk, then click Next. In the Select a Disk window, select the Create a new virtual disk radio button, then click Next. In the Create a Disk window, enter 4GB, leave the Disk Provisioning options unchecked, select a location (either Store with the virtual machine or Specify a datastore:), then click Next. In the Create a Disk window, select the Create a new virtual disk radio button, then click Next. In the Advanced Options window, leave the options unchanged: NOTE Optionally, the data disk can use the VMware PVSCSI device driver. For details, see “Using a PVSCSI Virtual Device Driver” on page 146. Virtual Device Node: SCSI (0:1) Mode: Independent: leave unselected Then click Next. 9 At the Ready to Complete window, click Finish to accept settings.

VMware, Inc.

125

VMware VMmark Benchmarking Guide

10

Back at the Virtual Machine Properties window, click OK to close the window.

Install the Software for the Olio Database Virtual Machines
Mount a data disk, then install MySQL and Olio, as described in the following sections.

Partition, Format, and Mount the Olio Database Disk
1 2 3 4 Boot the virtual machine and log in as root. Configure the network settings, as described in “Configuring Network Settings in SLES 11” on page 147. Edit the /etc/HOSTNAME file, changing the hostname to OlioDB0. Partition the newly-created disk using fdisk: a b c d e f 5 6 7 8 At a command prompt, enter: fdisk /dev/sdb When asked Command (m for help):, enter: n When asked Command action e extended p primary partition (1-4), enter: p When asked Partition number (1-4):, enter: 1 When asked the First cylinder and the Last cylinder, leave them at their defaults (to use the entire disk) by pressing <Enter> after each question. When again asked Command (m for help):, enter: w

Back at the command prompt, format the disk: mkfs -t ext3 /dev/sdb1 Create the /var/lib/mysql directory: mkdir /var/lib/mysql Mount the disk: mount /dev/sdb1 /var/lib/mysql Open the file /etc/fstab for editing and add the following line: /dev/sdb1 /var/lib/mysql ext3 defaults 1 2

Install MySQL
1 2 3 4 5 6 7 8 9 Connect the SLES 11 installation disk to the virtual machine. At the command prompt, type: yast Using the cursor keys, select Software in the left pane, move to the right pane, select Software Management, then press <Enter>. In the Search Phrase box, type mysql, then press <Enter>. Scroll down to mysql and select it for installation by pressing <Space>. Accept the package list by pressing <Alt><a>. Press <Enter> to accept the Automatic Changes. Press <Alt><q> to quit yast. Start MySQL: /etc/init.d/mysql start

126

VMware, Inc.

due to its size.4.war from the VMmark kit /vserver/oliodb directory to /usr/share/tomcat6/webapps/. 17 Start Tomcat: /etc/init. select Software Repositories. Scroll down to tomcat6 and select it for installation by pressing <Space>. then press <Enter>. NOTE It is important that Java-1_6_0 is selected. type: yast Using the cursor keys. Press <Alt><q> to quit yast. Press <Enter> to accept the Automatic Changes. then press <Enter>. At the Configured Software Repositories screen select Add (<Alt><a>). select Software Management. but a separate SDK disk. I Agree to the License Agreement (<Alt><y>). 127 . which doesn’t work with Tomcat. 12 13 14 15 16 In the Search Phrase box. VMware. create a directory and a symlink: mkdir -p /usr/java ln -s /usr/lib64/jvm/jre /usr/java/latest Copy Files 1 2 Copy the file my. might take a long time to download). Scroll to java-1_6_0-ibm and select it for installation by pressing <Space>. then Next (<Alt><x>). Back at the YaST2 Control Center. select Software in the left pane. Inc. type tomcat. At the Media Type screen select DVD (<Alt><d>). Otherwise yast autoselects Java 1. It can be downloaded from Novell at http://www. select Software in the left pane. Copy the file geocoder. At the License Agreement screen select Yes.novell. type java-1_6_0. then Next (<Alt><n>). move to the right pane. Back at the Configured Software Repositories screen select OK (<Alt><o>). 2 3 4 5 6 7 8 9 10 11 At the command prompt.html (this requires a Novell account and.cnf from the VMmark kit vserver/oliodb directory to /etc. then press <Enter>.com/developer/sle_sdk. NOTE This is not the installation disk. In the Search Phrase box. then press <Enter>. using the cursor keys. Accept the package list by pressing <Alt><a>.Appendix B Installing Applications in the Workload Virtual Machines 10 Configure MySQL to start automatically on future reboots: chkconfig mysql on Install Tomcat and Java 1 Connect the SLES 11 SDK disk 1 to the virtual machine. At the Insert the add-on product DVD pop-up select Continue (<Alt><o>).d/tomcat6 start 18 19 Configure Tomcat to start automatically on future reboots: chkconfig tomcat6 on Make sure the directory /usr/java/latest exists. move to the right pane. If it doesn’t.

* to 'olio'@'%' identified by 'olio' with grant option. create database bpwebapp. /root/schema.sql quit Make the /usr/local/olio directory: mkdir /usr/local/olio Copy the file dbloader.VMware VMmark Benchmarking Guide Configure the Olio Database 1 2 Copy the file schema.sql from the VMmark kit /vserver/oliodb directory to /root. configure their network settings. the second would be OlioDB1. Thus the first Olio database virtual machine would be OlioDB0.* to 'olio'@'localhost' identified by 'olio' with grant option. and so on. Inc. grant all privileges on *.zip Run the following commands: cd /usr/local/olio export JAVA_HOME=/usr/java/latest /usr/local/olio/dbloader. grant all privileges on *. and edit their /etc/hosts file to include their tile’s client. \. as described in “Configuring Network Settings in SLES 11” on page 147. 128 VMware. use bpwebapp. changing the hostname to the appropriate value. .zip from the VMmark kit /vserver/oliodb directory to /usr/local/olio. naming them OlioDBN (where N is the tile number to which this workload belongs). edit their /etc/HOSTNAME files. make as many clones of the Olio database virtual machine as you will need (one for each additional tile you expect to run). Unzip the file dbloader. Run the following commands: mysql create user 'olio'@'%' identified by 'olio'.sh localhost 400 3 4 5 6 Clone the Olio Database Virtual Machine After the configuration is complete.zip: unzip dbloader. After cloning the virtual machines.

NOTE This section is only necessary if you configure an Olio web workload virtual machine from scratch. as we recommend. You then customize it. click Finish to accept settings. under the Hardware tab. then click Next. Inc. select a location (either Store with the virtual machine or Specify a datastore:). In the Virtual Machine Properties window. as described in “Create and Configure the SLES Virtual Machines” on page 112. Customize the Virtual Machine for Olio Web 1 2 3 4 5 6 7 Within the vSphere Client Inventory pane. If. button. In the Select a Disk window. Create a Second Virtual Disk 1 2 3 4 5 6 7 Within the vSphere Client Inventory pane. In the Virtual Machine Properties window. first create a SLES 11 virtual machine template. 8 9 At the Ready to Complete window. In the Advanced Options window. then click Next.. click Edit virtual machine settings. Customize the SLES 11 Virtual Machine Template The Olio web virtual machine starts with the SLES 11 virtual machine template created in “Create and Configure the SLES Virtual Machines” on page 112. Under the Getting Started tab. enter 70GB. In the Add Hardware window. Set the Number of virtual processors: to 4. Set the Memory Configuration: to 6GB. select Memory. In the Virtual Machine Properties window. select the Olio web virtual machine. under the Hardware tab.Appendix B Installing Applications in the Workload Virtual Machines Prepare the Olio Web Virtual Machines To prepare the Olio web virtual machine. select Hard Disk. Virtual Device Node: SCSI (0:1) Mode: Independent: leave unselected Then click Next. Back at the Virtual Machine Properties window. the data disk can use the VMware PVSCSI device driver. Click OK. click Edit virtual machine settings. as described in: “Create the Olio Web Virtual Machines” on page 55. you instead download the pre-built virtual machine template from VMware. click the Add. 129 . you may skip this section entirely. select the Olio web virtual machine (OlioWeb0). as described in the following two subsections. naming the new virtual machine OlioWeb0. Clone the SLES11 Template Virtual Machine Clone the SLES11-template virtual machine. within the middle pane. then click Next.. see “Using a PVSCSI Virtual Device Driver” on page 146. select CPUs. For details. Under the Getting Started tab. click OK to close the window. leave the Disk Provisioning options unchecked. VMware. leave the options unchanged: NOTE Optionally. In the Create a Disk window. then follow the instructions in the following sections. select the Create a new virtual disk radio button. under the Hardware tab.

. Partition the newly-created disk using fdisk: a b c d e f 4 5 6 7 At a command prompt. Configure the network settings. enter: fdisk /dev/sdb When asked Command (m for help):. format the disk: mkfs -t ext2 /dev/sdb1 Create the /OlioFileStore directory: mkdir /OlioFileStore Mount the disk: mount /dev/sdb1 /OlioFileStore Open the file /etc/fstab for editing and add the following line: /dev/sdb1 /OlioFileStore ext2 noatime 1 2 Tune TCP/IP 1 2 Open the file /etc/sysconfig/sysctl for editing and change IP_TCP_SYNCOOKIES to “no”: IP_TCP_SYNCOOKIES="no" Save and close the file. as described in “Configuring Network Settings in SLES 11” on page 147. enter: w Back at the command prompt. as described in the following sections. enter: p When asked Partition number (1-4):. When again asked Command (m for help):. and Mount the Olio Filestore Disk 1 2 3 Boot the virtual machine and log in as root. edit the configuration files. Edit the /etc/hosts file to include an entry for Olio-DB as an alias for the IP address of its OlioDBN machine. leave them at their defaults (to use the entire disk) by pressing <Enter> after each question. changing the hostname to OlioWeb0.VMware VMmark Benchmarking Guide Install the Software for the Olio Web Virtual Machines Mount a data disk. Partition. Format. Edit the /etc/HOSTNAME and /etc/hosts Files 1 2 Edit the /etc/HOSTNAME file. enter: 1 When asked the First cylinder and the Last cylinder. enter: n When asked Command action e extended p primary partition (1-4). Inc. 130 VMware. and install and configure software.

Run the following commands: cd /usr/local/olio tar xvzf fileloader. type: yast Using the cursor keys. Press <Alt><q> to quit yast.html (this requires a Novell account and. move to the right pane. At the License Agreement screen select Yes.6 or later).novell. Back at the YaST2 Control Center. then press <Enter>. you will need to make a symbolic link /usr/java/latest to $JAVA_HOME. At the Configured Software Repositories screen select Add (<Alt><a>).gz from the VMmark kit /vserver/olioweb directory to /usr/local/olio. It can be downloaded from Novell at http://www. Press <Enter> to accept the Automatic Changes. you might observe a number of insserv errors. NOTE If the RPM version of Sun Java is not used. Inc. then Next (<Alt><n>). due to its size. Configure memcached to start automatically on future reboots: chkconfig memcached on NOTE After running this command.gz Install a 64-bit Java JRE Install a 64bit Java JRE of your choice (as long as it is Java 1. select Software in the left pane. These can be safely ignored. might take a long time to download). select Software Management. Scroll down to memcached and select it for installation by pressing <Space>. I Agree to the License Agreement (<Alt><y>).tar. Copy the Fileloader 1 2 3 Make the /usr/local/olio directory: mkdir /usr/local/olio Copy the file fileloader. select Software in the left pane. then press <Enter>. but a separate SDK disk. then Next (<Alt><x>). In the Search Phrase box. using the cursor keys. VMware.com/developer/sle_sdk.Appendix B Installing Applications in the Workload Virtual Machines Install Memcached 1 Connect the SLES 11 SDK disk 1 to the virtual machine. NOTE This is not the installation disk. 131 . Accept the package list by pressing <Alt><a>. type memcached. Back at the Configured Software Repositories screen select OK (<Alt><o>). At the Media Type screen select DVD (<Alt><d>).tar. 2 3 4 5 6 7 8 9 10 11 12 13 14 15 At the command prompt. then press <Enter>. select Software Repositories. At the Insert the add-on product DVD pop-up select Continue (<Alt><o>). move to the right pane.

5.sh -s olio-web Copy the webapp.jar /opt/springsourcetc-server-standard/olio-web/lib/ cp /tmp/org.5. Change to the following directory. Uncompress the zip file: cd /tmp unzip spring-framework-3.RELEASE.0.RELEASE.gz file: a b c 2 3 Go to: http://www. 132 VMware.php Select the latest EclipseLink 2.tomcat-3.0.0. Download the tar.VMware VMmark Benchmarking Guide Install tc Server Application Server 1 Download the Quick Start tc Runtime tar.zip (replacing the above filename with the one you just downloaded). cd /opt Unpack the tar file with the following command: tar zxvf /root/springsource-tc-server-standard-2. saving it to /tmp. Uncompress the zip file. Download latest GA release of Spring Framework (something like spring-framework-3.eclipse.0.tar.zip (replacing the above filename with the one you just downloaded).springframework.0.5.x (either Downloads or Patch Set Downloads) and download the Installer zip file. cd /opt/springsource-tc-server-standard Execute the following: /opt/springsource-tc-server-standard/tcruntime-instance.RELEASE.2. Copy the files as follows (replacing the version numbers in the filenames below with the actual version you just downloaded): cp /tmp/org.zip) to /tmp.0.springsource.war file from the VMmark kit: cp vserver/olioweb/tc-server/webapp.5.v20100323-r6872.instrument-3.RELEASE.instrument.zip file: a b 2 Go to: http://www.springsource.war /opt/springsource-tc-server-standard/olio-web/webapps/ 4 5 6 Install Spring Framework 1 Download the Spring Framework .gz (replacing the above filename with the one you just downloaded).jar /opt/springsourcetc-server-standard/olio-web/lib/ 3 Install EclipseLink 1 Download the EclipseLink installer . . cd /tmp unzip eclipselink-2.RELEASE. Inc.com/products/tc-server-evaluation Fill out the appropriate information and click the Download Now! button.zip file: a b c 2 Go to: http://www.gz version of the Quick Start tc Runtime file and save it in /root.com/download/community Fill out the appropriate information and click the Access Download! button.0. Change to the /opt directory.4.org/eclipselink/downloads/previous_releases.springframework.

jar /opt/springsource-tc-server-standard/olio-web/lib/ Install MySQL Connector/J 1 Download the MySQL Connector/J . copy the contents of the file: vserver/olioweb/tc-server/add_to_server.0.persistence_2.zip (replacing the above filename with the one you just downloaded).xml to: /opt/springsource-tc-server-standard/olio-web/conf/context. Copy the files as follows (replacing the version numbers in the filename below with the actual version you just downloaded): cp /tmp/mysql-connector-java-5.zip file: a b c 2 Go to: http://dev.jar /opt/springsource-tc-server-standard/olio-web/lib/ 3 Install JSTL 1 Download the following files.0.net/maven/glassfish/org/glassfish/web/jstl-impl/1.com/downloads/connector/j/5.xml Still in the server. Inc.xml file: With an editor of your choice.2.2.0.xml file: a With an editor of your choice.0.2. 133 .2/jstl-impl-1.java.Appendix B Installing Applications in the Workload Virtual Machines 3 Copy the files as follows (replacing the version numbers in the filenames below with the actual version you just downloaded): cp /tmp/eclipselink/jlib/eclipselink.2/jstl-api-1. saving it to /tmp.2.0.jar Copy the files as follows (replacing the version numbers in the filename below with the actual version you just downloaded): cp /tmp/jstl-api-1. saving them to /tmp: http://download.jar /opt/springsource-tc-server-standard/olio-web/lib/ cp /tmp/jstl-impl-1.v20100323-r6872.xml to: /opt/springsource-tc-server-standard/olio-web/conf/server.xml file: Change tomcatThreadPool to maxThreads="600" Set maxKeepAliveRequests="-1" b VMware.jar http://download.0. Uncompress the zip file.8.2. Download the zip archive version.8-bin.v201002051058.mysql.java.jar /opt/springsource-tc-server-standard/olio-web/lib/ cp /tmp/eclipselink/jlib/jpa/javax.html Select the latest version and Platform Independent.net/maven/glassfish/javax/servlet/jsp/jstl/jstl-api/1.jar /opt/springsource-tc-server-standard/olio-web/lib/ 2 Configure tc Server 1 Edit the context.0. cd /tmp unzip mysql-connector-java-5.xml 2 Edit the server.8/mysql-connector-java-5.jar /opt/springsource-tc-server-standard/olio-web/lib/ cp /tmp/eclipselink/jlib/jpa/eclipselink-jpa-modelgen_2. copy the contents of the file: vserver/olioweb/tc-server/add_to_context.

sh file: a b With an editor of your choice.d/tcserver chkconfig tcserver on NOTE After running these commands.rc. and edit their /etc/hosts file to include an entry for Olio-DB as an alias for the IP address of their OlioDBN machine and to include their tile’s client.MemCachedFactory -DgeocoderURL=http://olio-db:8080//geocoder/geocode" JAVA_HOME=/usr/java/latest JRE_HOME=/usr/java/latest 4 Edit the boot. 134 VMware. These can be safely ignored.VMware VMmark Benchmarking Guide 3 Edit the setenv.d/tcserver chmod +x /etc/init.image. Clone the Olio Web Virtual Machine After the configuration is complete. you might observe a number of insserv errors. edit their /etc/HOSTNAME files.rc. configure their network settings.rc. Inc. the second would be OlioWeb1.webapp.template file: a b With an editor of your choice.apache. open the file: /opt/springsource-tc-server-standard/olio-web/bin/setenv. changing the hostname to the appropriate value. Thus the first Olio web virtual machine would be OlioWeb0. .olio. as described in “Configuring Network Settings in SLES 11” on page 147. After cloning the virtual machines.template Set the following: TOMCAT_USER=root TC_SERVER_HOME="/opt/springsource-tc-server-standard" INSTANCE_NAME=olio-web JAVA_HOME=/usr/java/latest 5 Run the following commands: cp /opt/springsource-tc-server-standard/boot.template /etc/init. naming them OlioWebN (where N is the tile number to which this workload belongs).cache.directory=/OlioFileStore/ -DmemcachedInstances=localhost:11211 -DcacheFactoryClass=org. open the file: /opt/springsource-tc-server-standard/boot. make as many clones of the Olio web virtual machine as you will need (one for each additional tile you expect to run). and so on.sh Set the following: GENERAL_JVM_OPTS="-Xms2g -Xmx2g -Xss192k -server -XX:+UseParallelGC" APPLICATION_OPTS="-Dwebapp.

Create a Second Virtual Disk 1 2 3 4 5 6 7 Within the vSphere Client Inventory pane. click Finish to accept settings. within the middle pane. select CPUs. leave the Disk Provisioning options unchecked. select the Create a new virtual disk radio button. In the Virtual Machine Properties window. Under the Getting Started tab. In the Virtual Machine Properties window. For details. button. In the Add Hardware window. as described in “Create and Configure the SLES Virtual Machines” on page 112. you instead download the pre-built virtual machine template from VMware. then click Next. Under the Getting Started tab. the data disk can use the VMware PVSCSI device driver. In the Advanced Options window. In the Select a Disk window. then click Next. click OK to close the window. click the Add. click Edit virtual machine settings. Clone the SLES11 Template Virtual Machine Clone the SLES11-template virtual machine. VMware. then click Next. select the DVD Store 2 database virtual machine. leave the options unchanged: NOTE Optionally. as we recommend. select the DVD Store 2 database virtual machine (DS2DB0). 8 9 At the Ready to Complete window. under the Hardware tab.. Customize the Virtual Machine for DVD Store 2 Database 1 2 3 4 5 6 7 Within the vSphere Client Inventory pane. under the Hardware tab. select a location (either Store with the virtual machine or Specify a datastore:). select Memory. you may skip ahead to “Prepare the DVD Store 2 Database” on page 138. 135 . In the Virtual Machine Properties window.Appendix B Installing Applications in the Workload Virtual Machines Prepare the DVD Store 2 Database Virtual Machines To prepare the DVD Store 2 database virtual machine. If. enter 35GB. Set the Memory Configuration: to 4GB. as described in the following two subsections. Inc. see “Using a PVSCSI Virtual Device Driver” on page 146. as described in: “Create the DVD Store 2 Database Virtual Machines” on page 57. under the Hardware tab. Customize the SLES 11 Virtual Machine Template The DVD Store 2 database virtual machine starts with the SLES 11 virtual machine template created in “Create and Configure the SLES Virtual Machines” on page 112. You then customize it. naming the new virtual machine DS2db0. then follow the instructions in the following sections. select Hard Disk. In the Create a Disk window.. Click OK. first create a SLES 11 virtual machine template. Virtual Device Node: SCSI (0:1) Mode: Independent: leave unselected Then click Next. Set the Number of virtual processors: to 4. click Edit virtual machine settings. Back at the Virtual Machine Properties window. NOTE The majority of this section is only necessary if you configure a DVD Store 2 database workload virtual machine from scratch.

. leave the options unchanged: Virtual Device Node: SCSI (0:2) NOTE The virtual device node may be different than shown. changing the hostname to DS2DB0. and Mount the DVD Store 2 Database Disk 1 Partition the newly-created 35GB disk using fdisk: a b c d At a command prompt. as described in “Configuring Network Settings in SLES 11” on page 147. enter: fdisk /dev/sdb When asked Command (m for help):. Configure the Network and Set the Hostname 1 1 2 Boot the virtual machine and log in as root. In the Select a Disk window. within the middle pane. select the Create a new virtual disk radio button. you can use an NFS datastore instead. these other virtual machines can be powered back on. Partition. . click the Add. In the Advanced Options window. Edit the /etc/HOSTNAME file. click Finish to accept settings. in which case you can skip creation of the 20GB partition. enter 20GB. then click Next. enter: n When asked Command action e extended p primary partition (1-4). Install the Software for the DVD Store 2 Database Virtual Machines The following sections describe configuring the DVD Store 2 database system and installing software for the workload. click Edit virtual machine settings. select Hard Disk. button. In the Add Hardware window. Configure the network settings. 8 9 At the Ready to Complete window. select a location (either Store with the virtual machine or Specify a datastore:). then click Next. Inc. but can be left at its default Mode: Independent: leave unselected Then click Next. this additional 20GB might be more than you have available. powering down all the other virtual machines in the tile (thus automatically deleting their vswap files) will free enough space for this purpose. Format. then click Next. Once you complete the DVD Store 2 setup and delete the 20GB disk. In this case. select the DVD Store 2 database virtual machine.. In the Create a Disk window. enter: p When asked Partition number (1-4):. leave the Disk Provisioning options unchecked. Under the Getting Started tab. Back at the Virtual Machine Properties window. click OK to close the window. enter: 1 136 VMware. 1 2 3 4 5 6 7 Within the vSphere Client Inventory pane. under the Hardware tab. In the Virtual Machine Properties window.VMware VMmark Benchmarking Guide Create a Third (Temporary) Virtual Disk NOTE This 20GB disk is only used during the DVD Store 2 setup and can be removed afterwards. NOTE If you have allocated the bare minimum amount of disk space needed for a tile. If desired.

At the command prompt. then press <Enter>. Press <Alt><q> to quit yast. type: yast Using the cursor keys.Appendix B Installing Applications in the Workload Virtual Machines e f 2 3 4 5 When asked the First cylinder and the Last cylinder. you will need to again mount the drive manually.) Install MySQL 1 2 3 4 5 6 7 8 VMware. Accept the package list by pressing <Alt><a>. leave them at their defaults (to use the entire disk) by pressing <Enter> after each question. Press <Enter> to accept the Automatic Changes. When again asked Command (m for help):. select Software Management. enter: 1 When asked the First cylinder and the Last cylinder. Format. Inc. Connect the SLES 11 installation disk to the virtual machine. If you reboot before completing the DVD Store 2 database preparation. type mysql. format the 20GB disk: mkfs -t ext3 /dev/sdc1 Mount the 20GB disk: mount /dev/sdc1 /mnt (There is no need to add this disk to the fstab file because we will use it only once. enter: w Back at the command prompt. When again asked Command (m for help):. enter: n When asked Command action e extended p primary partition (1-4). Scroll down to mysql and select it for installation by pressing <Space>. select Software in the left pane. move to the right pane. then press <Enter>. In the Search Phrase box. though. enter: p When asked Partition number (1-4):. and Mount the DVD Store 2 Temporary Disk 1 Partition the newly-created 20GB disk using fdisk: a b c d e f 2 3 At a command prompt. enter: w Back at the command prompt. enter: fdisk /dev/sdc When asked Command (m for help):. 137 . format the 35GB disk: mkfs -t ext3 /dev/sdb1 Create the /var/lib/mysql directory: mkdir /var/lib/mysql Mount the 35GB disk: mount /dev/sdb1 /var/lib/mysql Open the file /etc/fstab for editing and add the following line: /dev/sdb1 /var/lib/mysql ext3 defaults 1 2 Partition. leave them at their defaults (to use the entire disk) by pressing <Enter> after each question.

move the entire DS2 directory to /root/ds2: mv /mnt/ds2 /root Unmount the temporary partition used for the DS2 data files: cd / umount /mnt If you used the template virtual machine.csv Only if creating the DVD 2 Store virtual machine from scratch (but not if using a template downloaded from VMware).cnf file from the VMmark kit vserver/ds2db directory to /etc. during which time it might receive high utilization warnings from vSphere. but repeating it will do no harm. but repeating it will do no harm.) Copy the DVD Store 2 database zip file (ds21. set password for 'web'@'%' = password('web').VMware VMmark Benchmarking Guide 9 10 11 Start MySQL: /etc/init. Inc. (This step will already have been completed if you are using pre-built virtual machine template downloaded from VMware.* to 'web'@'localhost' with grant option. grant all privileges on *.zip) from the VMmark kit vserver/ds2db directory to the /mnt directory (the temporary 20GB drive)./data_files rm -f cust/*.) cd /mnt/ds2 cd mysqlds2 sh mysqlds2_create_all.) Unpack the file in /mnt (the temporary 20GB drive): unzip ds21. grant all privileges on *. but repeating it will do no harm.csv rm -f orders/*. (This step will already have been completed if you are using pre-built virtual machine template downloaded from VMware..pl Create the database by running the following commands: (Note that the third command (the shell script) can take a long time to complete.d/mysql start Configure MySQL to start automatically on future reboots: chkconfig --level 3 mysql on Create the web user on mysql by running the following commands: mysql create user 'web'@'localhost' IDENTIFIED BY 'web'.* to 'web'@'%' with grant option.) Run the following commands: cd /mnt/ds2 perl Install_DVDStore_vmmark.zip (This step will already have been completed if you are using pre-built virtual machine template downloaded from VMware. remove from /etc/fstab the entry for the temporary disk (it’s marked “Remove after DB setup”).vmdk file.sh cd . Remove the 20GB temporary disk from the virtual machine and delete the corresponding . 2 3 4 5 6 7 8 9 138 VMware. . quit Prepare the DVD Store 2 Database 1 Copy the my.

edit their /etc/HOSTNAME files. naming them DS2DBN (where N is the tile number to which this workload belongs). as described in “Configuring Network Settings in SLES 11” on page 147. The first DVD Store 2 database virtual machine would be DS2DB0. make as many clones of the DVD Store 2 database virtual machine as you will need (one for each additional tile you expect to run). and edit their /etc/hosts file to include their tile’s client. changing the hostname to the appropriate value. and so on. configure their network settings. 139 . Inc.Appendix B Installing Applications in the Workload Virtual Machines Clone the DVD Store 2 Database Virtual Machine After the configuration is complete. the second would be DS2DB1. After cloning the virtual machines. VMware.

Edit the /etc/hosts file to include an entry for DS2-DB as an alias for the IP address of its DS2DBN machine. as described in: “Create the DVD Store 2 Web Virtual Machines” on page 59. as we recommend. move to the right pane. 140 VMware. At the command prompt. first create a SLES 11 virtual machine template. NOTE This section is only necessary if you configure a DVD Store 2 web workload virtual machine from scratch. In the Virtual Machine Properties window. Configure the network settings. Set the Number of virtual processors: to 2 (it will probably already be set to this number). Under the Getting Started tab. select Software in the left pane. Set the Memory Configuration: to 2GB. as described in the following two subsections.VMware VMmark Benchmarking Guide Prepare the DVD Store 2 Web Virtual Machines To prepare the DVD Store 2 web virtual machine. Customize the Virtual Machine for DVD Store 2 Web 1 2 3 4 5 6 7 Within the vSphere Client Inventory pane. changing the hostname to DS2WebA0. Configure the Network 1 2 3 4 Boot the virtual machine and log in as root. . If. you may skip this section entirely. Clone the SLES11 Template Virtual Machine Clone the SLES11-template virtual machine. select CPUs. Install the Software for the DVD Store 2 Web Virtual Machines The following sections describe installing software for DVD Store 2 web systems. type: yast Using the cursor keys. Customize the SLES 11 Virtual Machine Template The DVD Store 2 web virtual machine starts with the SLES 11 virtual machine template created in “Create and Configure the SLES Virtual Machines” on page 112. Install Apache and PHP 1 2 3 4 5 6 Connect the SLES 11 installation disk to the virtual machine. then press <Enter>. then follow the instructions in the following sections. as described in “Create and Configure the SLES Virtual Machines” on page 112. Accept the package list by pressing <Alt><a>. In the Search Phrase box. select Software Management. then press <Enter>. Edit the /etc/HOSTNAME file. In the Virtual Machine Properties window. under the Hardware tab. Click OK. type apache. click Edit virtual machine settings. naming the new virtual machine DS2WebA0. Inc. select Memory. Scroll down to apache2-mod_php5 and select it for installation by pressing <Space>. as described in “Configuring Network Settings in SLES 11” on page 147. under the Hardware tab. select the DVD Store 2 web virtual machine (DS2WebA0). You then customize it. you instead download the pre-built virtual machine template from VMware.

The original (DS2WebA0) and these two clones (DS2WebB0 and DS2WebC0) are now your three DVD Store 2 web workload virtual machines for tile 0. and edit their /etc/hosts file to include an entry for DS2-DB as an alias for the IP address of their DS2DBN machine and to include their tile’s client VMware. and DS2WebCN (where N is the tile number to which this workload belongs).allow_persistent = On mysql. for the second tile would be DS2WebA1. Press <Enter> to accept the Automatic Changes. The DVD Store 2 web virtual machines for the first tile would be DS2WebA0. Edit. configure their network settings. type php5-mysql.default_host = DS2-DB mysql. Press <Alt><q> to quit yast. and DS2WebC0.ini file for editing and make the following changes: mysql. 141 .default_password = web mysqli. DS2WebB0. edit their /etc/HOSTNAME files. and DS2WebC1.default_user = web mysql.default_user = web mysqli. changing the hostname to the appropriate value.default_host = DS2-DB mysqli. Then make as many clones of these three DVD Store 2 web virtual machine as you will need (one set for each additional tile you expect to run).tar. make two clones of the DVD Store 2 web virtual machine and name them DS2WebB0 and DS2WebC0. Accept the package list by pressing <Alt><a>. In the Search Phrase box.default_pw = web 4 5 Configure Apache to start automatically on future reboots: chkconfig --level 3 apache2 on Move the DVD Store 2 files: cd /srv/www/htdocs mkdir ds2 cd ds2 mv /tmp/ds2/* . as described in “Configuring Network Settings in SLES 11” on page 147.tar. DS2WebBN. and Move the DVD Store 2 Files 1 2 3 Copy the DVD Store 2 web tarball (DS2Web. Press <Enter> again to return to the main yast screen. Copy and Clone the DVD Store 2 Web Virtual Machine After the configuration is complete. naming them DS2WebAN. Untar the file: tar xvzf DS2Web. Inc.Appendix B Installing Applications in the Workload Virtual Machines 7 8 9 10 11 12 13 Press <Enter> to accept the Automatic Changes. Untar. DS2WebB1. then press <Enter>.gz) from the VMmark kit vserver/ds2web directory to the /tmp directory. After cloning the virtual machines. and so on.gz Open the /etc/php5/apache2/php. Scroll down to php5-mysql and select it for installation by pressing <Space>.

. Inc.VMware VMmark Benchmarking Guide 142 VMware.

with one or more partial tiles) do not count as valid runs for the purposes of calculating a VMmark Benchmark score. 143 . To start a partial-tile run using the VMmark Harness. however. or may be started using the VMmark Harness. modify the VMMARK2. There may be times.CONFIG file. when it is desirable to perform partial-tile runs. Partial-tile runs may be started manually. NOTE Partial-tile runs are only for research or diagnostic purposes and must not be used to calculate VMmark Benchmark results. It consists of the following section: “Running a Subset of the Workloads (a Partial Tile)” on page 143. such as debugging. changing the WORKLOADLIST and INFRASTRUCTURELIST variables to include only those workloads you want to run. by starting only those workloads desired. VMware. or measuring the effects of various workloads on the overall performance.Optional Configurations and Settings C This appendix provides information about optional configurations for many of the programs and utilities used to perform the VMmark benchmarking tests. located in the C:\VMmark2 directory on the prime client. “Optional Windows System Settings” on page 144 Running a Subset of the Workloads (a Partial Tile) Any test runs conducted with a subset of the workload suite (that is. Inc.

then log back in again. Make these changes only if your company policies and network environment allow.microsoft. Inc. Instructions to do this can be found at: http://support. then closing the window. thus you can choose to implement all of them. NOTE In the case of a Windows domain controller. select Control Panel > Display. it must be done before it is promoted to domain controller. and in the window that appears select the Enabled radio button. NOTE Many of these settings significantly reduce the security level of the workload virtual machines. click the plus sign next to Local Policies. then click Security Options.com/kb/324737 Disable the <Ctrl> <Alt> <Del> Prompt To avoid the need to press <Ctrl> <Alt> <Del> each time the system requires a login password. scroll to Interactive logon: Do not require CTRL + ALT + DEL. For these changes to take effect. 144 VMware. Click OK to close the Interactive logon: Do not require CTRL + ALT + DEL window. You can later access the Manage Your Server window from the Control Panel by choosing Administrative Tools > Manage Your Server. It can be disabled by checking the Don’t display this page at logon box on the bottom left of the window. some of them must be made before the machine is promoted to be a domain controller.VMware VMmark Benchmarking Guide Optional Windows System Settings There are a number of settings that can be changed on the Windows workload virtual machines to make them easier and faster to use in the VMmark environment. you can set the Windows workload virtual machines to autologon. . These settings are optional. and do not have a significant effect on the benchmark results. there may be a somewhat long delay). Close the Local Security Settings window (again. select Control Panel > Administrative Tools > Local Security Policy. select the Screen Saver tab. 2 3 4 5 6 In the left pane of the Local Security Settings window (or the Default Domain Security Settings window). Within the right pane. log out of Windows. 1 From the Start menu. Set the System to Autologon If your environment allows it. When the Display Properties window appears. follow these steps: For Windows Server 2003: 1 2 From the Start menu. double click it (there may be a somewhat long delay). Disable the Manage Your Server Window The Manage Your Server window appears at every reboot until disabled. none of them. this is under Control Panel > Administrative Tools > Domain Security Policy. When these changes are to be applied to the mail server virtual machine. or any desired subset. follow these steps: NOTE If this setting is to be applied to the mail server virtual machine. Disable Password Protection on Resume Windows Server enables password protection on resume. To disable this feature. They are mutually independent.

In the right pane of the Server Manager window. If desired.microsoft. click Configure IE ESC. display logon screen does not contain a checkmark (or set Screen saver to None).microsoft. When the Windows Components Wizard window appears. When you see the message You have successfully completed the Windows Components Wizard.com/kb/555541 http://support. VMware. Windows Server 2003 keeps a log of the reasons the system was shut down. Instructions to disable this tracking can be found at the following two URLs: http://support. select the Off radio buttons for both Administrators and Users. under Security Information. For Windows Server 2008: 1 2 3 4 5 6 From the Start menu. Close the Personalization window. If desired. Click OK to close the Display Properties window. scroll to Internet Explorer Enhanced Security Configuration and uncheck it. This feature can be disabled as follows: For Windows Server 2003: 1 2 3 4 5 6 From the Start menu. make sure the box next to On resume. double-click Personalization. Click Next. In the Control Panel. select Control Panel.Appendix C Optional Configurations and Settings 3 4 Uncheck the On resume. In the Internet Explorer Enhanced Security Configuration window. open Internet Explorer and change the home page. Inc. password protect box. Close the Add or Remove Programs window. select Control Panel > Add or Remove Programs > Add/Remove Windows Components. then click OK. click Finish. Click OK to close the Screen Saver Settings window. Disable Internet Explorer Enhanced Security Windows Server enables Internet Explorer’s enhanced security level by default. In the Personalization window click Screen Saver.com/kb/293814 (you might need to refer to both URLs to disable event tracking). 145 . In the Screen Saver Settings window. Disable the Shutdown Event Tracker By default. For Windows Server 2008: 1 2 3 4 5 Open the Start menu and select Server Manager. Close the Server Manager window. open Internet Explorer and change the home page.

under the Hardware tab. Depending on your combination. or not supported at all. then click Next. When creating a disk for VMmark workloads. guest operating system version. and guest operating system service pack.vmware. To do so: 1 Near the end of the creation process. 2 3 4 5 6 146 VMware. select the VMware Paravirtual radio button. under SCSI Controller Type. NOTE PVSCSI support varies depending on ESX version.com/resources/compatibility). including consistency of workloads). instead of leaving the option at its default SCSI (0:1). This section describes how to enable the PVSCSI adapters.VMware VMmark Benchmarking Guide Using a PVSCSI Virtual Device Driver The high-performance PVSCSI virtual device driver can be used wherever it is supported (though the machines must still meet all requirements in the Run and Reporting Rules. click the Change Type button. when you are given the chance to select the virtual device node. Back at the Virtual Machine Properties window. At the Ready to Complete window. Inc. select New SCSI Controller (adding). then click the OK button. . Back at the Virtual Machine Properties window. click OK. PVSCSI might be fully supported. For details. supported only for non-boot disks. click Finish to accept settings. see the VMware Compatibility Guide (http://www. In the Changing the SCSI Controller Type window. In the right pane. in the Advanced Options window. change it to SCSI (1:0). you can choose to use a PVSCSI virtual device driver.

and hostname in their respective fields. The Not configured NIC is the actual virtual NIC. then type <Alt><n> to save. if present. Type <Alt><o> to exit. Use the <Tab> and cursor keys until the Not configured NIC is highlighted. incorrectly refers to the template's virtual NIC. then press <Space> to select it. The other one. From command line. 4 5 6 7 8 9 10 VMware. one will say Not configured while the other will say DHCP.Appendix C Optional Configurations and Settings Configuring Network Settings in SLES 11 1 2 3 Make sure that the file /etc/udev/rules. Use the <Tab> key to move to the IP Address field and enter this virtual machine’s static IP address. Under the field IP Address. 147 . subnet mask. Inc.rules has been deleted. type: yast2 lan At the YaST2 Network Settings screen you might see two NICS listed in the main pane. Type <Alt><t> to delete the DHCP NIC.d/70-persistent-net. Use the <Tab> key to highlight Statically assigned IP Address. Use the <Tab> and cursor keys until the DHCP NIC is highlighted. Type <Alt><i> to edit the Not configured NIC.

.VMware VMmark Benchmarking Guide 148 VMware. Inc.

disable all network interface cards and retry the installation. and won’t actually affect benchmark operation. Microsoft Exchange Load Generator -.B08E90EE_3FC7_4509_A7F3_DE16BC275F17. (The drive names are just for convenience. VMware. In the left pane. For example. open the Server Manager window (Start Menu > Administrative Tools > Server Manager). but you installed Exchange SP1 on the server. There is a problem with this Windows Installer package. expand Storage (click the plus sign) and click Disk Management. Error: Setup encountered a problem while validating the state of Active Directory: Setup could not retrieve the schema master domain controller information from Active Directory. Correcting Mail Server Drive Letters and Names The mail server won’t function properly if its drive letters are not correct.Troubleshooting D This appendix provides assistance in troubleshooting the VMmark Benchmarking tests. Action START_REMOTE_SERVICE. Contact your support personnel or package vendor.Error 1722. location: net. Error Validating State of Active Directory The following error message can be caused by the Exchange Management Tools (in the client systems) and Exchange server (in the workload virtual machines) not having matching service packs.) 1 2 Within the mail server virtual machine. Workload Troubleshooting This section contains guidance for troubleshooting problems with specific workloads. This section details how to change them.Error 1722 The following error message might be encountered during LoadGen installation: • Product: Microsoft Exchange Load Generator -. Inc. 149 . A program run as part of the setup did not finish as expected. Also see “Install Exchange Server 2007 Tools” on page 86 and “Install Microsoft Windows Server 2008 Enterprise Edition” on page 106. command: START LoadGenRemote To get around this issue.exe. Mailserver Troubleshooting This section contains guidance for troubleshooting mailserver operations. you will see this error message if you installed the SP2 version of the Exchange Management Tools on the client.

as follows: 1 2 3 4 Open the Start menu then select Control Panel. in the top window.192MB Backup F: 4 If the drive letters don’t match the ones listed in Table D-1. Make sure the box next to Automatically detect settings does not contain a checkmark. click the LAN settings button. a b 5 Optionally. double-click Internet Options. close the Server Management window.768MB OS-and-Apps C: Partition 2 32. and Yes. type the partition name from Table D-1. Mail Server Virtual Machine Disk Partitions Function Partition size Partition name Partition letter Partition 1 32. click the Change button. turn off automatic proxy settings detection in Windows.VMMARKE-081 3D010428-LGU000003:AutoDiscover:Error:System. resulting in a run with no mailserver results. change it to D: Right-click on the CD-ROM and choose Change Drive Letter and Paths. Under the General tab. rename the E: and F: drives to correspond with the names in Table D-1: a b c a Right-click on the E: partition and choose Properties.Net. then click OK. then click OK. Table D-1. Click OK. In the Internet Properties window. then click OK. choose D from the drop-down menu.VMware VMmark Benchmarking Guide 3 Compare the drive letters and partition names to Table D-1.VMMARKE-081 3D010428-LGU000018:AutoDiscover:Failed. Mailserver Virtual Machines Produce No Results Entering an incorrect password for the mailserver in the VMMARK2. In the Control Panel window. Change the Database and/or Backup drive letters to match Table D-1: Right-click on the partition and choose Change Drive Letter and Paths. In the VMMARK2. and Yes. 6 When done. LoadGen Log File Errors LoadGen log file errors similar to the following can be caused by Windows proxy settings: Outlook2007Online Error: 0 : 6/11/2010 9:44:11 AM -. and Yes.768MB Database E: Partition 3 8. Outlook2007Online Error: 0 : 6/11/2010 9:44:11 AM -. click the Change button. Inc. choose the appropriate letter from the drop-down menu. change it to Z: (as a temporary designation): Right-click on the partition and choose Change Drive Letter and Paths. click the Change button. under the Connections tab. If the CD-ROM is using any drive letter other than D:. .WebException: The operation has timed out To correct this. choose Z from the drop-down menu.CONFIG file the mailserver password is entered on a line that looks like this: MailServer/MailPassword="password" 150 VMware.CONFIG file can result in LoadGen silently failing. correct them as follows: a If one of the disk partitions is using drive letter D:. Repeat for the F: partition.

but you don't see the Exchange window. try defragmenting the transport queue database as follows: 1 2 Log into the mailserver workload virtual machine. in turn. check the order of the NICs as follows: a b c Open Control Panel. usually the first connection will see the window. Make sure that the NIC you are using is first in the list. It should return the IP address of the domain server. try running LoadGen again. If you are connected to your client over terminal services. To fix this problem. Power on the mail server virtual machine. If it returns the secondary DNS address. Check networking (a ping test should be sufficient). It requires about 10MB of free space.que net start "Microsoft Exchange Transport" NOTE The eseutil command might fail if there is insufficient disk space. run nslookup in a Command Prompt. LoadGen Crashes If Exchange Server Transport Service Stops Corruption of the Exchange Server transport queue database. VMware. LoadGen Can’t Connect to Active Directory If LoadGen says it can't connect to the Active Directory. can cause the Exchange Server Transport service to stop. The client system has multiple NICs. If it’s not. Inc. You are experiencing network problems. select Open.Appendix D Troubleshooting No Exchange Window Visible If your harness says it's running Exchange. right click Network Connections. This. The Active Directory service is not running. or a transport queue database file so large that it is filling the database disk. 151 . Make sure that the Active Directory service is running on the mailserver (restart the service if it isn’t running). investigate the following possible causes and some suggested solutions for each: The corresponding mail server virtual machine is powered off. can cause LoadGen to crash. Repeat the nslookup command. then the Adapters and Bindings tab. choose Advanced Settings. At a Command Prompt enter: net stop "Microsoft Exchange Transport" cd C:\Program Files\Microsoft\Exchange Server\TransportRoles\data\Queue eseutil /d mail. use the green arrows to move it. If so. Make sure the client's preferred DNS server is the IP address of the mail server for that tile. this might be due to the Exchange window is running in a different session. You are experiencing DNS problems. If it now returns the IP address of the domain server. In the Network Connections window select the Advanced menu.

click on the + next to the domain name for this server. From the start menu. 152 VMware. In the left pane right-click LoadGen Objects and select Delete. From the Start menu select Computer. Recreate the VMmark storage group and the lpriv1 and lpriv2 mailbox stores. or for some other reason needs to be recreated. When a message appears asking Are you sure you want to remove ‘VMmark’?. In the left pane click on the + next to Server Configuration and select Mailbox. Repeat step 9 through step 11 for lpriv2. click OK.VMware VMmark Benchmarking Guide Deleting the Microsoft Exchange Database If the Microsoft Exchange database becomes corrupt. you must first delete the existing database. When a message appears stating The storage group has been removed. You must remove the database files from your computer manually.. Close the Exchange System Manager window. select All Programs > Administrative Tools > Active Directory Users and Computers. Open the Database drive (typically E:\). and delete it by clicking Remove in the right action pane. To delete the Microsoft Exchange database 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 From the start menu. When a message appears asking Are you sure you want to remove ‘lpriv1’?. select All Programs > Microsoft Exchange Server 2007 > Exchange Management Console. In the right pane. In the left pane. select the VMmark storage group and delete it by clicking Remove in the right action pane. You must remove the log files from your computer manually. . When asked to Confirm Subtree Deletion click Yes. In the left pane. click Yes. as described in “Configure Microsoft Exchange Server” on page 121. select lpriv1. Close the Active Directory Users and Computers window. click Yes. When asked Are you sure you want to delete the Organizational Unit names 'LoadGen Object'? click Yes. When a message appears stating The store has been removed. Inc. Delete all files on the database drive. click OK.

merge the ProxySettingsPerUser.reg file into your client system’s registry. VMware.wrf output file contains the following message. (504) Gateway Timeout Error If the DVD Store 2 . as described in “Configure Windows to Not Use a Proxy Server” on page 82. you might have a problem with proxy settings: Error returned from web server: The remote server returned an error: (504) Gateway Timeout" To fix this. 153 . Inc. as described in “Automatically Apply the Registry Settings” on page 79 (or follow the directions in “Manually Apply the Registry Settings” on page 80) then change the client’s proxy settings.Appendix D Troubleshooting DVD Store 2 Troubleshooting This section includes guidance for troubleshooting DVD Store 2 operations.

this time for PowerShell. Out of Bounds Error by Harness During Time Sync If you observe “Out of bounds error by harness during time sync” in the STAX messages window. Still in the left pane of the Server Manager window. Before starting the benchmark. expand Diagnostics by clicking the + next to the word. then expand Application and Services Logs by clicking the + next to the words. then expand Event Viewer by clicking the + next to the words. In the left pane of the Event Viewer window. Inc. not Windows PowerShell). If you see such an entry. make sure the Overwrite events as needed radio button is selected. modify the PowerShell properties to overwrite events by following these steps: For Windows Server 2003: 1 2 3 4 5 6 7 8 Open the Start menu and select Settings > Control Panel. repeat step 4 and step 5. Back in the left pane of the Event Viewer window. Close the Server Manager window. make sure the date and time format used by all Windows-based systems (that is. For Windows Server 2008 1 2 Open the Start menu and select Server Manager. In the Windows PowerShell Properties window. all clients and the vCenter server) is the USA standard (that is. On the vCenter Server. then click OK. day/month/year). repeat step 3 and step 4. Back in the left pane of the Server Manager window. In the Administrative Tools window. 154 VMware. Close the Event Viewer window. look for a PowerShell entry (just PowerShell. right-click on Windows PowerShell and choose Properties. month/day/year) as opposed to the UK standard (that is. In the Log Properties . this time for PowerShell.VMware VMmark Benchmarking Guide Miscellaneous Troubleshooting This section includes guidance for troubleshooting miscellaneous issues. make sure the Overwrite events as needed (oldest events first) radio button is selected. then click OK.Windows PowerShell window. Close the Administrative Tools window. right-click on Windows PowerShell and choose Properties. . go to Server Manager > Services. look for a PowerShell entry (just PowerShell. not Windows PowerShell). In the Control Panel. double-click Event Viewer. verify that the time protocol on the vCenter Server is running and that the vCenter Server time is synchronized with the testing environment. Popup: “Space Allocated for Logging PowerShell Events is Nearly Full” If you see a popup dialog box advising that the space allocated for logging PowerShell events is nearly full. check the following: Make sure your vCenter Server is pingable from the prime client. 3 4 5 6 Infrastructure Operations Troubleshooting If you're having issues with the VMmark infrastructure operation routines. double-click Administrative Tools. and make sure VMware VirtualCenter Server is Started. It can sometimes take up five minutes for the service to respond to requests after restarting either the vCenter system or the service itself. In the left pane of the Server Manager window. If you see such an entry.

this suggests that the trust level settings in the STAF. this may be due to one of the following causes: A communication or configuration problem. then the proxy server should be disabled before VMmark testing starts. PowerCLI should be started (allowing caching).exe to Pass Through” on page 69). type: staf alias ping ping (where alias is the alias in the client’s hosts file (for example. DS2WebA0)).cfg file contains the following: trust machine 192. Review the hosts files on both systems for accuracy (See “Update the hosts File” on page 81). distinguishable by the length of the delay.exe (“Configure the Windows Server 2008 Firewall to Allow STAFProc. it should be enabled. To correct this.168. Start PowerCLI (Start > Programs > PowerCLI) in an environment that can reach the external web so caching can occur.cfg file are not being correctly processed. This can be caused by either of two different issues. The VMmark Harness Complains That Clients Are Out of Sync If the VMmark harness complains that clients are out of sync. 155 .1) or later. make sure each STAF. NOTE If access to the external web requires the use of a proxy server.Appendix D Troubleshooting STAF Complains About Trust Level If STAF complains that systems are at trust level 3. Force clients to sync to their domain controllers immediately by opening a Command Prompt window and typing: net time /domain /set /yes VMware vSphere PowerCLI Snap-In Loads Slowly On some prime clients. PowerCLI Snap-In Takes About 20 Seconds to Load If you observe delays of about 20 seconds for the PowerCLI snap-in to load. The proper response is PONG.*. STAF is Unable to Connect to a Particular Server If STAF is unable to connect to a particular server.1. Make sure all clients and all workload virtual machines are running the same version of STAF. If it does not. While it is acceptable for the PowerCLI snap-in to load slowly the first time PowerCLI is run. this is likely due to client clocks not being synchronized to within the allowable threshold. follow the instructions in the appropriate section below. Log in as the domain administrator. VMware vSphere PowerCLI snap-in might take a long time to load and display the prompt. Review the firewall status on both systems for the allowance of STAFProc. and that you are running PowerShell version 2 or later. Dissimilar versions of STAF are installed.* level 5 (substituting the first three octets of the network to which the machines are connected). From a command line on the client. VMware. Inc. on subsequent invocations it should load quickly.1 update 1 (aka 4. perform the following steps: 1 2 3 Make sure you are running PowerCLI version 4.

VMware VMmark Benchmarking Guide PowerCLI Snap-In Takes About Two Minutes to Load If you observe delays of about two minutes for the PowerCLI snap-in to load. when running Windows Server 2008 on a prime client. Error: “File C:\VMmark2\tools\VMmarkPScli. Inc.ps1 Properties window.ps1 cannot be loaded. double-click Internet Options. In this case. In the Internet Options window. . 156 VMware. scroll down to Security. Remove the checkmark from the box next to Check for server certificate revocation. perform the following steps: 1 2 3 4 Navigate to the VMmark2\tools directory. under the Advanced tab. Click OK.ps1 is not digitally signed. Remove the checkmark from the box next to Check for publisher's certificate revocation. Close the VMmarkPScli. perform the following steps: 1 2 3 4 5 6 7 Open the Start menu then select Settings > Control Panel. click the Unblock button.” In some cases. Close the Control Panel. In the Control Panel. The file C:\VMmark2\tools\VMmarkPScli.ps1 Properties window. Right-click the VMmarkPScli.ps1 cannot be loaded. in Settings. The script will not execute on the system. under the General tab. you might observe in your output files the following error: File C:\VMmark2\tools\VMmarkPScli.ps1 file and select Properties. At the VMmarkPScli.

add ports as follows: a b c Click Edit Increase the number of ports. the correct virtual switch). Click OK. select Networking. Inc. Increasing the number of ports should alleviate these issues. Follow these steps to determine the number of ports a virtual switch is configured with and increase that number if required: 1 2 3 4 5 6 Within the vSphere Client Inventory pane. select the ESX host. Setting Network to Connect at Power-on If a virtual machine is unable to connect to the network. Setting the Network Name If a virtual machine is unable to connect to the network. 157 . Under the Ports tab. make sure that its network adapter is configured to connect at power on. In the Hardware window. 7 Click Close. This setting can be found in Summary > Commands > Edit Settings > Hardware > Network Adapter 1. make sure that it is configured to use the correct network (that is. For further information. NOTE The changes will take effect the next time the ESX host system is rebooted. you might experience difficult-to-diagnose errors.Appendix D Troubleshooting Networking Issues This section addresses network issues sometimes encountered while running VMmark. the vSwitch Properties section lists the number of ports. that the virtual switch is configured to the correct physical NIC. If your test uses more than this number of ports. refer to the VMware Infrastructure 3 Documentation set. To the right of the virtual switch to be configured choose Properties. Select the Configuration tab. Setting the Number of Ports on a Virtual Switch in ESX Virtual network switches in VMware ESX start out with a fixed number of ports by default. VMware. and that the NIC is connected to the intended network. If the number of ports listed is fewer than your setup needs.

Tile0) and making sure it is working smoothly. This can be done by reducing the value of the RUNTIME variable from its default of 10800 seconds (3 hours) to something no less than 900 second (15 minute). One situation in which these short runs are particularly helpful is when setting up the first tile. . then making backups of this working configuration before cloning the workload virtual machines to create the additional tiles. We recommend creating one complete tile (for example. 158 VMware. Inc. it can be useful to perform a short VMmark test run to make sure everything is functioning correctly.VMware VMmark Benchmarking Guide Performing a Short Run When configuring a VMmark system.

In the example above you could use client0. 159 . you can substitute one of the known good clients for any workload except mailserver (because mailserver is dependent on the domain relationship).CONFIG file. If you suspect the problem may be with the client.Appendix D Troubleshooting Testing a Single Failing Client-Workload Pair When setting up a multi-tile VMmark test. The relevant portions of the VMMARK2. You can also run a similar test with a functional client and virtual machine workload pair. the third client).log that contains the same output as was shown in the lower portion of the STAX Monitor window. or client4 (just make sure the client you use has a C:\vclient0 directory). Inc. the OlioWeb in the third tile) and client2 (that is. narrowing the test down to the simplest case where the failure occurs can help expedite the debugging process when reporting the problem to VMware. Edit the VMMARK2. This section describes how to do so. The harness will run a one-tile test of just the Olio workload using the client and workload virtual machine that seemed to be causing the problem. To debug the problem. The VMmark Harness is flexible enough to allow you to perform that type of testing. you may find that you are having problems with a particular workload in one of the tiles. client3. OlioWeb and OlioDB comprise the Olio workload. it can be useful to run a test that uses only the specific client system and workload virtual machine pair that exhibits the problem. client1.CONFIG file look something like this: TILES=5 CLIENTS="client0 client1 client2 client3 client4" MailServer/SERVERS="Mailserver0 Mailserver1 Mailserver2 Mailserver3 Mailserver4" Standby/SERVERS="Standby0 Standby1 Standby2 Standby3 Standby4" OlioWeb/SERVERS="OlioWeb0 OlioWeb1 OlioWeb2 OlioWeb3 OlioWeb4" OlioDB/SERVERS="OlioDB0 OlioDB1 OlioDB2 OlioDB3 OlioDB4" DS2WebA/SERVERS="DS2WebA0 DS2WebA1 DS2WebA2 DS2WebA4" DS2WebB/SERVERS="DS2WebB0 DS2WebB1 DS2WebB2 DS2WebB3 DS2WebB4" DS2WebC/SERVERS="DS2WebC0 DS2WebC1 DS2WebC2 DS2WebC3 DS2WebC4" DS2DB/SERVERS="DS2DB0 DS2DB1 DS2DB2 DS2DB3 DS2DB4" ###RUNTIME=10800 ###DEBUGFLAG=0 ###WORKLOADLIST="Standby MailServer OlioWeb OlioDB DS2WebA DS2WebB DS2WebC DS2DB" ###INFRASTRUCTURELIST="Deploy Vmotion SVmotion" To run just the one workload test between client2 and the Olio workload you can do the following: 1 2 Save your current VMMARK2. VMware. If you still don't see how to fix the problem. changing the following settings to the values shown: TILES=1 CLIENTS="client2" OlioWeb/SERVERS="OlioWeb2" OlioDB/SERVERS="OlioDB2" RUNTIME=900 DEBUGFLAG=1 WORKLOADLIST="OlioWeb OlioDB" INFRASTRUCTURELIST="" 3 4 Log on to client2 and copy the C:\vclient2 directory to C:\vclient0. so both need to run to test the failing OlioWeb. In the Results_<datestamp> directory you'll find the files from just that one workload along with the STAX_Job_User. allowing a side by side comparison of the STAX_Job_User logs.CONFIG file. Start the test from your prime client. This example shows a five-tile test and assumes a failure involving OlioWeb2 (that is.

vmx files. Running the VMmark2ConfigChecker Script The VMmark2ConfigChecker script is supplied as part of the VMmark kit (in the C:\VMmark2\tools directory). 2 Run the script: perl /root/VMmark2ConfigChecker. follow these steps: 1 2 3 4 Copy the script to the /root directory of the ESX/ESXi system to be checked. See “Manually Running the vSphere-get-config.tgz files using tar xzvf. 1 From any shell that has access to a filesystem where workload virtual machine configuration files (i. The location of these output files can also be specified with the -s option.. .. but rather is a framework that can be built upon.) The script’s default behavior is to display a summary of its findings to the screen. expose the ..e. The script recursively searches for . the script must be run on results that were generated from a VMmark run made with the REPORTER variable set to 1 (i.vmx files). The script can be run in two modes: on a running ESX/ESXi host or on previously-collected reporter results. see VMware Knowledge Base article #1017910 (http://kb.. . Running the VMmark2ConfigChecker Script on Previously-Collected Results To run the VMmark2ConfigChecker script on previously-collected results.e.) 160 VMware.VMware VMmark Benchmarking Guide The VMmark2ConfigChecker Script The VMmark2ConfigChecker script (VMmark2ConfigChecker. navigate to a folder containing the .vmx files in the directory in which it is run as well as all subdirectories. Both methods are described below.com/kb/1017910) for instructions on how to access a command-line interface. Change to the /vmfs/volumes directory.pl -t n (where n is the number of tiles to check. Running the VMmark2ConfigChecker Script on an ESX/ESXi Host To run the VMmark2ConfigChecker script on a running ESX/ESXi host. It is not intended to be an exhaustive check.sh Script” on page 163 for details on the archive file.vmx files) are located. . The script simply highlights areas for evaluation for such issues. The output of the script does not indicate the presence or absence of errors or noncompliant items in the benchmark configuration.vmx file and reports its findings.pl -t n (where n is the number of tiles to check. REPORTER=1). Log in to the ESX/ESXi command line as root.e. It then performs a series of checks on each .pl) is a Perl script that can be used by VMmark submitters to review their ESX testbed configurations for potential issues.e. Inc. NOTE If you are running ESXi. Run the script: perl /root/VMmark2ConfigChecker.vmware.tgz files). follow these steps: NOTE In this mode. the script saves more detailed findings to a set of output files. NOTE If the folder contains configuration-gathering archive files (i. These output files by default are saved to vmmarkconfig-results in the current directory (or /root/vmmarkconfig-results if the current directory is not writable). but not workload virtual machine configuration files (i.vmx files by unpacking the individual . With the -v option. .

161 .com. With the -v option. The location of these output files can also be specified with the -s option.Appendix D Troubleshooting The script’s default behavior is to display a summary of its findings to the screen. Inc. change the SearchStrings and the SearchStringModifiers variables near the top of the script. We welcome your suggestions for and examples of custom search strings for future versions of the script. Please send these to vmmark-info@vmware. These output files by default are saved to vmmarkconfig-results in the current directory (or /root/vmmarkconfig-results if the current directory is not writable). VMware. the script saves more detailed findings to a set of output files. Customizing the VMmark2ConfigChecker Script To add more checks to the VMmark2ConfigChecker script.

Alternatively. Recovering Data From An Aborted Run This section describes how to abort a VMmark run and how it might be possible to recover partial results files. continue to the next step. Inc. Run the canceltest. 1 2 3 4 5 To abort a run.1)))/60 Default test time (in minutes) = (10800 + (600 * (#TILES . reboot all clients and all workload virtual machines.VMware VMmark Benchmarking Guide Recovering Data from Abnormal Runs Even when a VMmark run must be aborted before completion.1)))/60 If at least 20 minutes more than the calculated total test time has elapsed.sh script (included in the \VMmark2\tools directory of the VMmark kit). reboot all clients and all workload virtual machines. This may happen. The recovered files will be moved into the directory in which the script was run. Recovering Data if the Harness Hangs This section describes how to generate potentially usable data after some harness hangs.sh script again as described above until there are no running harness processes. the partial results files from the run might still be useful for debugging or monitoring purposes. Before beginning another run. Before beginning another run. 1 Verify that the total test time has elapsed: Total test time (in minutes) = (RUNTIME + (TILEDELAY * (#TILES . right click on the active VMmark 2.sh script (included in the \VMmark2\tools directory of the VMmark kit). . Follow the script’s directions for recovering results files if the harness is hanging. for example. The recovered files will be moved into the directory in which the script was run. run the canceltest. in the STAX 3 Job Monitor window. If this was a fully-compliant run.0 job and select Terminate Job. If the STAX Job Monitor Active Job Elements display still shows a process in a tile running. 2 3 4 5 6 7 162 VMware. In a Cygwin terminal window go to the results directory of the aborted run (C:\VMmark2\results\Results_<datestamp>). the VMmark harness will output the run result files to the results directory. if the STAF process in a workload virtual machine or client system dies during the run. Run the canceltest. In a Cygwin terminal window go to the results directory of the aborted run (C:\VMmark2\results\Results_<datestamp>). Follow the script’s directions for recovering results files after a manual STAX shutdown. under Active Jobs. it might be possible to generate usable data from a run that fails to complete normally due to the harness hanging. as described in “Creating and Submitting a VMmark Full Disclosure Report” on page 95.

163 .com/kb/1017910) for instructions on how to access a command-line interface. 1 2 Copy the file C:\VMmark2\tools\vSphere-get-config. 3 Before you submit results. You also need to change some parameters for ESXi to run the script successfully. This information is usually obtained automatically. as described in this section. we recommend that you unpack the .sh After a few minutes.sh script before proceeding. Carry out the steps in the comments at the beginning of the vSphere-get-config. NOTE If you are running ESXi. the results of the script will be written to the ESX/ESXi host in a file named hostname-date-time.tgz file and run the VMmark2ConfigChecker script to review your ESX testbed configurations for potential issues. you can run it manually.Appendix D Troubleshooting Manually Running the vSphere-get-config. if the VMmark harness informs you that the virtualization host reporting script failed to run. as described in “Edit the disclosure. Copy this . Inc. see VMware Knowledge Base article #1017910 (http://kb.HTML File” on page 97.sh Script VMmark results for publication must include detailed information about the ESX/ESXi instances in which the test was run. From the ESX/ESXi command line. VMware. However. run the script as root: .tgz file to the appropriate results directory on the prime client.vmware. see “Running the VMmark2ConfigChecker Script” on page 160./vSphere-get-config.sh to /root on the host.tgz under the alphanumerically last /vmfs/volumes directory. For further information.

Inc. .VMware VMmark Benchmarking Guide 164 VMware.

Sign up to vote on this title
UsefulNot useful