Professional Documents
Culture Documents
White paper
Table of contents
Executive Summary .............................................................................................................................. 3 Applicability and Definitions ................................................................................................................. 3 Target Audience .................................................................................................................................. 4 Introduction to Cluster Extension (CLX) .................................................................................................... 4 Server Virtualization............................................................................................................................. 8 Benefits of Virtualization ....................................................................................................................... 8 Introduction to Hyper-V......................................................................................................................... 9 HP supported Configuration/hardware for Windows Server 2008 ............................................................ 9 Server Support................................................................................................................................. 9 Storage Support............................................................................................................................... 9 Hyper-VImplementation Considerations ............................................................................................. 10 Disk Performance Optimization........................................................................................................ 10 Storage Options in Hyper-V ............................................................................................................ 10 Virtual Hard Disk (VHD) choices ................................................................................................... 10 Pass-through Disk........................................................................................................................ 11 Hyper-V Integration Services............................................................................................................ 11 Memory Usage Maximization.......................................................................................................... 11 Network Configurations.................................................................................................................. 12 CLX and Hyper-V Scenarios ................................................................................................................ 12 Scenario A: Disaster Recovery and High Availability for Virtual Machine.............................................. 13 Scenario B: Disaster Recovery and High Availability for Virtual Machine and applications hosted by Virtual Machine ............................................................................................................................. 15 Scenario C: Failover Cluster between Virtual Machines ...................................................................... 17 Cluster between Virtual Machines hosted on the same physical server .............................................. 17 Cluster between Virtual Machines hosted on separate physical server............................................... 17 Step-by-step guide to deploy CLX Solution............................................................................................. 20 Deploying Windows Server 2008 Hyper-V ....................................................................................... 20 Installing Hyper-V role .................................................................................................................... 21 Creating Geographically Dispersed MNS cluster ............................................................................... 21 Configuring Network for Virtual Machine ......................................................................................... 22 Provisioning Storage for Virtual Machine .......................................................................................... 23 Creating and Configuring Virtual Machine........................................................................................ 26 Installing Cluster Extension Software................................................................................................. 28 Configuring Cluster Extension Software ............................................................................................ 29 Making Virtual Machine Highly Available......................................................................................... 30
Creating a CLX resource ................................................................................................................. 31 Set the dependency........................................................................................................................ 32 Test Failover or Quick Migration ...................................................................................................... 32 Appendix A: Bill of Materials .............................................................................................................. 34 References ........................................................................................................................................ 35
Executive Summary
Server virtualization, also known as hardware virtualization, is a hot topic in the information technology (IT) world because of the potential for serious economic benefits. Server virtualization enables multiple operating systems to run on a single physical machine as Virtual Machines. With server virtualization, you can consolidate workloads across multiple underutilized server machines onto a smaller number of machines. Fewer physical machines can lead to reduced costs through lower hardware, energy, and management overhead, plus the creation of a more dynamic IT infrastructure. Windows Server 2008 Hyper-V, the next-generation Hyper-Visor-based server virtualization technology, is available as an integral feature of Windows Server 2008 and enables you to implement server virtualization with ease. One of the key use cases of Hyper-V is to achieve Business Continuity and disaster recovery through complete integration with Microsoft Failover Cluster. The natural extension of this ability is to complement this feature with the HP products like HP StorageWorks Cluster Extension and HP StorageWorks Continuous Access to achieve comprehensive and robust multi-site disaster recovery and high availability solution. This paper briefly touches upon the Hyper-V and Cluster Extension (CLX) key features, functionality, best practices and various use cases. It also objectively describes the various scenarios in which Hyper-V and CLX complement each other to achieve the highest level of disaster tolerance. This paper concludes with the step-by-step details for creating a CLX solution in Hyper-V environment from scratch. There are many references also provided for referring to relevant technical details.
Virtual Machine
Hyper-V server
Target Audience
This document is for anyone who plans to implement Cluster Extension on a multi-site or stretched cluster with array based HP continuous access solution in a Hyper-V environment. The document describes Hyper-V configuration on HP ProLiant servers, explains how to create a Virtual Machine, mentions step by step method of adding a Virtual Machine to a Failover Cluster and finally mentions the CLX supported scenario with an example. To learn more about Cluster Extension, please see the documentation available on the Cluster Extension Websites (http://www.hp.com/go/clxxp and http://www.hp.com/go/clxeva) using the Technical documentation link under Support.
To summarize the key features of CLX are as follows: Protection against transaction data lossBecause the application cluster is extended over two sites and the storage is replicated at the second site using replication methodology, data exists ubiquitously with virtually no difference (depending on the replication method) in the data storage from site A to site B. No Single Point of Failure (SPOF) solution to increase the availability of company and customer data. Fully automatic failover and failbackAutomated failover and failback reduces the complexity involved in a disaster recovery situation. It is protection against the risk of downtime, whether planned or unplanned. No server reboot during failoverDisks on the server on both the primary and secondary sites are recognized during the initial system boot in a XP CLX environment; therefore LUN presentation and LUN mapping changes are not necessary during failover or failbackfor a truly hand-free Disaster Tolerant solution. No single point of failureSupreme redundancy: identical configuration of established SAN infrastructure redundancies is implemented on site B. MSCS Majority Node Set integrationCLX Windows uses the Microsoft Majority Node Set (MNS) and Microsoft File Share Witness (FSW) quorum feature that is available in Windows from Microsoft Windows Server 2003. These quorum models provide protection against split-brain situations without the single point of failure of a traditional Quorum disk. Split-brain syndrome occurs when the servers at one site of the stretched cluster lose all connection with the servers at the other site and the servers at each site form independent clusters. The serious consequence of the split-brain is corruption of business data since data will no longer be consistent. EVA array family supportThe entire EVA array family is supported on either end of the Disaster Tolerant configuration. Whether repurposing legacy units or simply adding newer generation units to an existing CLX EVA configuration, both sites are covered. See Software Support section for configuration requirements. XP array supportXP24000/20000, XP12000/10000, XP1024/128, and XP512/48 arrays are supported on either end of the DT configuration. Whether re-purposing legacy units or adding next-generation units to an existing XP CLX configuration, both sites are covered. See Software Support section for configuration requirements.
One of the failover use cases of CLX is described pictorially as below. Before site failureApplications are hosted on primary site and the business critical data is always replicated to recovery site for disaster recovery.
Arbitrator Node
After Site FailureCLX Automates the application storage failover and change in replication direction in conjunction with Microsoft Clustering solution achieving Business Continuity and High Availability.
Arbitrator Node
Automated by CLX
App A Continuous Access App B Primary Site Recovery Site
Server Virtualization
In the computing realm, the term virtualization refers to presenting a single physical resource as many individual logical resources (such as platform virtualization), as well as making many physical resources appear to function as a singular logical unit (such as resource virtualization). A virtualized environment may include servers and storage units, network connectivity and appliances, virtualization software, management software, and user applications. Basically, a virtual server or VM, is an instance of some operating system platform running on any given configuration of server hardware, centrally managed by a Virtual Machine Manager, or hypervisor, and consolidated management tools.
Virtual Machine
Virtual Machine
Virtual Machine
Virtualization Manager
Benefits of Virtualization
Virtualized infrastructure can benefit companies and organizations of all sizes. Virtualization greatly simplifies a physical IT infrastructure to provide greater centralized management over your technology assets and better flexibility over the allocation of your computing resources. This enables your business to focus resources when and where they're needed most, without the limitations imposed by the traditional one computer per box model. Virtualization enables you to create VMs that share hardware resources and transparently function as individual entities on the network. Consolidating servers as VMs on a small number of physical computers can save money on hardware costs and make centralized server management easier. Server virtualization also makes backup and disaster recovery simpler and faster, providing for a high level of business continuity. In addition, virtual environments are ideal for testing new operating systems, service packs, applications and configurations before rolling them out on a production network.
Introduction to Hyper-V
Windows Server 2008 Hyper-V, the next-generation Hyper-Visor-based server virtualization technology, is available as an integral feature of Windows Server 2008 and enables you to implement server virtualization with ease. Hyper-V allows you to make the best use of your server hardware investments by consolidating multiple server roles as separate Virtual Machines (VMs) running on a single physical machine. With Hyper-V, you can also efficiently run multiple different operating systemsWindows, Linux, and othersin parallel, on a single server, and fully leverage the power of x64 computing. Hyper-V offers great advantage in certain scenarios like Server Consolidation, Business Continuity and Disaster Recovery through complete integration with Microsoft Failover Cluster, Testing and deployment through its inherent ease and scaling capability, and so on. For more details on Hyper-V technology refer to Microsoft page at http://www.microsoft.com/windowsserver2008/en/us/hyperv.aspx
Server Support
Refer to the HP white paper available at the following link to identify the supported HP server for Hyper-V. It also covers various other supported components like HBA, NIC and Storage controllers. Also covered are the various steps to enable the hardware assisted virtualization for Hyper-V http://h20000.www2.hp.com/bc/docs/support/SupportManual/c01516156/c01516156.pdf
Storage Support
Refer to link below for detailed list of HP storage products supported with Windows Hyper-V http://h71028.www7.hp.com/enterprise/cache/612466-0-0-0-121.html
Hyper-VImplementation Considerations
Disk Performance Optimization
Hyper-V offers two different kinds of disk controller, IDE and SCSI controllers. Both have their distinct advantages and disadvantages. IDE controllers are the preferred choice because they provide the highest level of compatibility for a large range of guest operating systems. However, SCSI controllers can enable a virtual SCSI bus to provide multiple transactions simultaneously. If the workload is disk intensive, consider using only virtual SCSI controllers if the guest OS supports that configuration. If this is not possible, add additional SCSI connected VHDs. It is optimal to select SCSI connected VHDs that are stored on separate physical spindles or arrays on the host server.
10
Pass-through Disk One of the storage configuration options in Hyper-V child partitions is the ability to use pass-through disks. While the former options all have referred to VHD files which are files on the file system of the parent partition, a pass-through disk routes a physical volume from the parent to the child partition. The volume must be configured offline on the parent partition for this operation. This simplifies the communication and by design, the pass-through disk overhead is lower than the overhead with VHDs. However, Microsoft has invested in optimizing the fixed-size VHD performance which has significantly reduced the performance differential. Therefore, the more relevant reason to choose one over the other should be based on the size of the data sets. If there is a need to store very large data sets, a pass-through disk is typically the more practical choice. In the Virtual Machine, the pass-through disk would be attached either through an IDE controller or a SCSI controller.
Note: When presenting a pass-through disk, the disk should remain offline on the host OS. This prevents host and guest OS from using the pass-through disks simultaneously. Pass-through disks doesnt support VHD-related features, like VHD Snapshots, dynamically expanding VHDs and differencing VHD.
The further considerations for choosing pass-through disk against VHD disks are available at this Microsoft TechNet blog. Detailed information about Hyper-V storage performance based on measurements derived from the Microsoft performance lab can be found in the following blog entry http://blogs.msdn.com/tvoellm/archive/2008/09/24/what-hyper-v-storage-is-best-for-you-show-methe-numbers.aspx
11
Network Configurations
Virtual network configurations are configured in the Virtual Network Manager in the Hyper-V GUI or in the System Center Virtual Machine Manager in the properties of a physical server. There are three types of virtual networks: External: An external network is mapped to a physical NIC to allow Virtual Machines access to one of the physical networks that the parent partition is connected. Essentially, there is one external network and virtual switch per physical NIC. Internal: An internal network provides connectivity between Virtual Machines, and between Virtual Machines and the parent partition. Private: A private network provides connectivity between Virtual Machines only. The solution network requirements for the specific scenarios should be understood before configuring the network of various types.
12
VM
C:\
E:\
E:\
Host partition 1
Host partition 2
Failover Cluster
Site A
XP1
XP2
Site B
13
VM
C:\
E:\
E:\
Host partition 1
Host partition 2
Failover Cluster
Site A
XP1
XP2
Site B
14
Scenario B: Disaster Recovery and High Availability for Virtual Machine and applications hosted by Virtual Machine
This is an extension of scenario A. This scenario considers that there is an application hosted by the VM. Also assume that this application also uses replicated SAN storage for disaster recovery. When the VM failover, the application will also failover along with it to other host OS. After failover, for VM and application to come online, the disk access should be made available. This again can be achieved through replicated disks and failover through CLX. The way this would work is to have a minimum of two physical disks with multi-site replication, one disk for hosting the VM and the other hosts the application. The following diagram is an illustration of scenario B. Two multi-site replicated disks are presented to two Hyper-V parent partitions that are clustered using Windows Failover Cluster. On the parent partition, VM is created on one of the replicated disk and the data for the application hosted by VM is stored on the other replicated disk. The VM is added to the Failover Cluster as a service group. When a failure is detected by the Failover Cluster (host failure for example). Failover Cluster moves the VM and with it the application to the other cluster node and CLX ensures that storage replication direction is changed hence achieving automatic failover and high availability.
Application
VM
CLX managed disk
E:\ C:\
Host partition 1
Host partition 2
Failover Cluster
Site A
XP1
XP2
Site B
15
Application
VM
E:\ C:\
E:\
F:\
E:\
F:\
Host partition 1
Host partition 2
Failover Cluster
Site A
XP1
XP2
Site B
For this scenario to function properly it is important to note that both the VM as well as application hosted by VM should use the disk (LUN) which belongs to the same replication group. In such a situation, a single CLX resource can manage the failover of both the disks as a single atomic unit. The hierarchy of the resources within the cluster should me maintained as mentioned in a section above. For example, in the configuration above both Lun 1and Lun 2 should be part of same replication group.
16
17
The following diagram is illustration of the sub scenario where cluster is created between the Virtual Machines belonging to different physical servers.
Application
VM 1 E:\ C:\
Failover Cluster
VM 2
E:\ C:\
C:\vm1.vhd
E:\
C:\vm1.vhd
E:\
Host partition 1
Host partition 2
Site A
XP1
XP2
Site B
18
VM 1
Application
E:\ C:\
Failover Cluster
E:\ C:\
C:\vm1.vhd
E:\
C:\vm1.vhd
E:\
Host partition 1
Host partition 2
Site A
XP1
XP2
Site B
19
CV Station
Sit
eA
Site A
CV Station
Site B
te Si
My First VM
CLX 20
Source
VM01 Replication using Continuous Access EVA
Destination
VM01
EVA A
EVA B
The configuration involves a two node FSW cluster with one node in each of the sites and third node with file share for arbitration in the third site. It is recommended to use the FSW cluster configuration for CLX. It is also recommended to ensure redundancy for each and every component at each site. The inter site links also should be in redundant configuration so as not to have any Single Point of Failure (SPOF). For details on SAN configuration refer to HP SAN Design Guide. Link to the SAN Design Guide is provided in the references section at the end of this document. Also make sure the supportability of each and every component like Server, Storage, HBA, Switch and Softwares by referring to SPOCK Website.
20
21
Follow the cluster installation wizard and provide inputs whenever prompted. When the wizard completes a Failover Cluster will be created and can be managed through Failover Cluster Management MMC Snap-in.
Note: In the case where the cluster nodes are a Windows 2008 server core machines, use MMC from a different Window 2008 machine
22
Now that all Hyper-V host servers can be managed from a single point, select the Hyper-V host server and right click to open Virtual Network Manager. Create virtual networks as appropriate for the setup. In this example, two virtual networks are created. Both the virtual network are of network type External.
23
After creating the vdisk, a Data replication (DR) group is created. The source vdisk of the data replication group will be the vdisk vm01. The destination array will be the EVA named as CLXEVA02. In this example the DR group is named as Hyper-V white paper DR. When the DR group is created, a vdisk of similar size and name is created on the remote EVA CLXEVA02. Present the vm01 of CLXEVA02 to the host CLX23. The Vm01 vdisk of 20 GB size should be visible on the cluster nodes. Bring the disk online and name the disk appropriately. In this example the vdisk vm01 is seen on CLX20 node as disk1. The disk was initialized and named as EVA Disk for VM. These changes get reflected automatically on the remote node CLX23 as well.
24
25
The New Virtual Machine wizard will prompt for user inputs. At the Configure Networking page, select the virtual network created in earlier step. In the Connect virtual Disk page, select a virtual hard disk already available or create a new disk. The disk should be create/located on the EVA vdisk. In this example a new VHD disk is created on the EVA disk provisioned. A Windows operating system image located locally is attached for installing the operating system on the Virtual Machine.
26
Note: Operating system for the Virtual Machine can installed before or after adding the Virtual Machine to the cluster.
27
28
Note: For more detailed description about CLX installation and configuration refer to the CLX installation and Administrative Guide respectively.
29
In the Select Virtual Machine page select the Virtual Machine created in the step above and click Next. In this example, the Virtual Machine My First VM should be selected. Once the wizard is over one can see the Virtual Machine resource as a part of new Service and Application group.
30
Note: If the Failover Cluster (with CLX resource) is managed from a remote node then the CLX resource parameter tab may appear different from the previous figure. For remote administration of Failover Cluster with CLX resource refer to the latest XP CLX and EVA CLX Administrative Guide.
31
At this step the CLX solution is almost ready. It is always advisable to perform some test failovers to ensure that solution is behaving as expected.
When the Virtual Machine movement completes, the Virtual Machine is no longer available or related to node CLX20 and is now hosted on CLX23.
32
33
HP StorageWorks Enterprise Virtual Array EVA4400 and related Software Part Number AF002A AF002A 001 AF062A AF062A B01 AG637A AG637A 0D1 AG638A AG638A 0D1 AJ711A AJ711A 0D1 252663-D72 252663-D72 0D2 AF054A AF054A 0D1 221692-B21 T5497A T5486A T3667A T5505AAE U5466S Description HP Universal Rack 10642 G2 Shock Rack Factory Express Base Racking HP 10K G2 600W Stabilizer Kit Include with complete system HP EVA4400 Dual Controller Array Factory integrated HP M6412 Fibre Channel Drive Enclosure Factory integrated HP 400 GB 10K FC EVA M6412 Enc HDD Factory integrated HP 24A High Voltage US/JP Modular PDU Factory horizontal mount of PDU HP 10642 G2 Side panel Kit Factory integrated StorageWorks LC/LC 2m Cable HP CV EVA4400 Unlimited LTU HP Continuous Access EVA4400 Unlimited LTU HP EVA Cluster Extension Windows LTU HP Smartstart EVA Storage E-Media Kit HP Care Pack
34
References
Step-by-Step Guide for Testing Hyper-V and Failover Clustering http://www.microsoft.com/downloads/thankyou.aspx?familyId=cd828712-8d1e-45d1-a2907edadf1e4e9c&displayLang=en Deploying Windows server 2008 on HP ProLiant servers http://h20000.www2.hp.com/bc/docs/support/SupportManual/c00710606/c00710606.pdf Microsoft Virtualization Resources http://www.microsoft.com/virtualization/default.mspx Microsoft Virtualization on HP Website http://h18004.www1.hp.com/products/servers/software/microsoft/virtualization/ Hyper-V on HP Active Answers http://h71019.www7.hp.com/ActiveAnswers/cache/604725-0-0-0-121.html XP Cluster Extension Manuals http://h20392.www2.hp.com/portal/swdepot/displayProductInfo.do?productNumber=CLXXP EVA Cluster Extension Manuals http://h20392.www2.hp.com/portal/swdepot/displayProductInfo.do?productNumber=CLXEVA Comprehensive Hyper-V update list http://technet.microsoft.com/en-us/library/dd430893.aspx HP StorageWorks SPOCK (External) http://www.hp.com/storage/spock SAN Design Guide http://h20000.www2.hp.com/bc/docs/support/SupportManual/c00403562/c00403562.pdf?j umpid=reg_R1002_USEN HP StorageWorks XP Continuous Access http://h18006.www1.hp.com/products/storage/software/continuousaccess/index.html?jumpid=r eg_R1002_USEN HP StorageWorks EVA Continuous Access http://h18006.www1.hp.com/products/storage/software/conaccesseva/?jumpid=reg_R1002_USEN HP StorageWorks Command View EVA http://h18006.www1.hp.com/products/storage/software/cmdvieweva/index.html?jumpid=reg_R 1002_USEN HP Multipathing solutions http://h18006.www1.hp.com/products/sanworks/multipathoptions/index.html Microsoft Multipathing solutions http://www.microsoft.com/downloads/details.aspx?FamilyID=cbd27a84-23a1-4e88-b1986233623582f3&displaylang=en