Virtualization in Grid Computing Centers S.

Freitag Virtualization Impact on Grid Computing Conclusion

Impact of Advanced Virtualization Technologies on Grid Computing Centers

International Symposium on Grid Computing 2009

Stefan Freitag
Robotics Research Institute Dortmund University of Technology

23. April 2009

Overview
Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

1 Virtualization

2 Impact on Grid Computing

3 Conclusion

Introduction
Virtualization in Grid Computing Centers S. Freitag

Virtualization
Virtualization Impact on Grid Computing Conclusion

Resource

Application

Platform

Full Network Storage Input/Output

Paravirtualized

OS Level

Figure: Types of Virtualization

Network
Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion
LAN 1

VPN (Virtual Private Network) disjunct network partitions gateway service for tunneling WAN for interconnect
GW GW
LAN 2

FW

WAN

FW

GW
LAN 3

FW

Network
Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

VLAN (Virtual Local Area Network) Layer 2 (data link layer) construct, IEEE 802.1Q standard Devices on dierent physical LAN segments Communication as if on same physical LAN segment (bcast domain) Conguration of VLAN through software Trac shaping/ QoS
...
S3 .VLAN2 .. S4

... S2 ... S1

VLAN1

LAN

Storage
Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

decreasing storage costs (GByte/$) increasing management complexity full SAN bandwidth for I/O requests separation of data and metadata into dierent places control unit: appliances or SAN switches
1 Control 2

1 1a Control 1b

Virtualization 3 2

Virtualization 5 4

Virtualization 3 2

Platform
Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

Full virtualized Environment

guest unaware of virtualization, run native OS reduced performance because of hardware emulation

Para virtualized Environment

management module (hypervisor or virtual machine monitor) operates with modied operating system guest OS has much closer control of the underlying hardware (security, inuence on other VMs)
VM Management

Application Guest OS Virtual Hardware

Application Guest OS Virtual Hardware VM Management Host OS Application Guest OS (modified)

Virtualization Layer X86 Hardware

Application Guest OS (modified)

Virtualization Layer Host OS X86 Hardware

Input/ Output (IOV)

Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

Typical conguration: 4 to 6 I/O cards per server

Ethernet Inniband Fiber Channel

add I/O virtualization capability to PCIe

disaggreation consolidation virtualization
Server NICs LAN /WAN SAN HBAs

PCIe

IOV Switch

Input/ Output (IOV)

Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

I/O consolidation 100% of server connected to Ethernet, only 20% to FC FiberChannel over Ethernet (FCoE), pre-standard converged Network Adapter (C-NIC/ CNA) benet for compute centers
fewer adapters power savings cable management

Server FCoE Switch

Ethernet Switch

LAN /WAN

CNIC

SAN

Present situation
Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

Platform and storage virtualization in use server consolidation

improved utilization of existing servers increased number of services per m2 reducing TCO (maintenance,...) in the long-run

high availability run legacy applications managing mass-storage backends migration of virtual machines is bound to restrictions
storage network reconguration

Platform Virtualization @ LRMS level

Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

Job = Virtual Machine

share same operations (start, stop, suspend, checkpointing)

Scenarios:
user submits self-prepared virtual machine on-demand creation of virtual machine by LRMS

VM description as part of job specication LRMS schedules jobs and/ or virtual machines Not so good: black-box execution performance loss (MPI) compared to non-virtualized solution

IOV @ LRMS level

Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

vNIC (virtual Network Interface Card) vHBA (virtual Host Bus Adapter)
FC WWN used to identify to segregate devices for access control Virtualized environments: adapters WWN represents all DomUs (Xen) DomU migrates to new server, but WWN does not zoning and LUN masking (access control) ineective vHBA gets own WWN which migrates with VM

Platform Virtualization @ Grid Level

Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

Benets provide uniform environment to Grid users rapid on-demand provisioning of Grid nodes non-interfering execution of multiple Grid middlewares decoupling of knowledge (grid operator/ grid user) job exchange, e.g. inter cluster/ Grid resources

Platform Virtualization @ Grid Level

Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

Drawback resources run dierent virtualization software

Xen, KVM, VMware, . . .

creation of user environment for each resource

Virtual Appliances
Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

encapsulate user environment in a virtual appliance virtual appliance = virtual machine + operating system + application level software + MD5 Job = virtual machine virtual appliance virtual appliance is already technology-dependent :-( better approach step 1: create operating system + application level software + MD5 step 2: make it technology-dependent

KIWI
Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

idea: prepare once, run anywhere distribution independent, currently only SuSE supported centralized image description based on XML output formats: xen, vmware, Amazon EC2 , iso, . . . adoption to Scientic Linux ongoing in Dortmund
ot chro loop via ss s via acce cces a Packed ready 2 serve Image

additional software packages Image description

Unpacked Image

Figure: from: KIWI Cookbook

Conclusion & Outlook

Virtualization in Grid Computing Centers S. Freitag Virtualization Impact on Grid Computing Conclusion

Conclusion platform and storage virtualization widely spread increased exibility with I/O virtualization/ FCoE Grids prot at LRMS and Grid layer from virtualization on-demand provisioning of virtual appliances Outlook Grid resource provides bare metal + virtualization layer provision of resources to more than one Grid infrastructure/ VO