OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

Ruben S. Montero
Distributed Systems Architecture Research Group Universidad Complutense de Madrid

1/38

Contents 1. What is OpenNebula? 2. System Overview 3. Dynamic Provisioning of Computational Clusters 4. Demo

2/34

What is OpenNebula?
OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

Transform a distributed infrastructure into a flexible virtual infrastructure Adapt it to the changing demands of the the service workload OpenNebula is a distributed virtualization layer: Extend the benefits of VMMs Decouple the service from the physical infrastructure

3/34

System Overview
OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

OpenNebula OpenNebula Neutral VM description Neutral VM description LRMS like interaction LRMS like interaction VM managment & control VM managment & control Consumption & match-making allocation policies Consumption & match-making allocation policies

Cluster Services Cluster Services Shared FS for VM images Shared FS for VM images SSH access for host interaction SSH access for host interaction
4/34

System Overview
OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

Scheduler Client API

CLI

One Client API One Client API Based on common interfaces Based on common interfaces Unix-like CLI Unix-like CLI Scheduling modules Scheduling modules

XML-RPC ONE core Access Drivers One Core One Core VM Life-cycle management & control VM Life-cycle management & control Persistent back-end Persistent back-end Access Drivers Access Drivers Interface different hypervisors Interface different hypervisors Pools Database Monitoring physical resources Monitoring physical resources
5/34

sqlite

Dynamic Provisioning of Computational Clusters

OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

SGE Frontend

User Requests SGE interface Virtualization overhead Virtualized SGE nodes

Open Nebula
VMM VMM VMM

Dedicated SGE nodes

Cluster Nodes
6/34

Dynamic Provisioning of Computational Clusters

OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

Cluster Consolidation Cluster Consolidation Multiple worker nodes in a single resource Multiple worker nodes in a single resource SGE Frontend Dynamic provision rules Dynamic provision rules VMM functionality (e.g. live migration) VMM functionality (e.g. live migration) Virtualized SGE nodes

Open Nebula
VMM VMM VMM

Dedicated SGE nodes

Cluster Nodes
7/34

Dynamic Provisioning of Computational Clusters

OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

Cluster Partitioning Cluster Partitioning Performance partitioning (dedicated workernodes) Performance partitioning (dedicated workernodes) SGE Frontend Isolate service workload Isolate service workload Dedicated HA partitions Dedicated HA partitions Virtualized SGE nodes

Open Nebula
VMM VMM VMM

Dedicated SGE nodes

Cluster Nodes
8/34

Dynamic Provisioning of Computational Clusters

OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

Heterogenous Workloads Heterogenous Workloads Custom worker-node configurations (queues) Custom worker-node configurations (queues) SGE Frontend Dynamic provision of cluster configurations Dynamic provision of cluster configurations Example: on-demand VO workernodes in Grids Example: on-demand VO workernodes in Grids Virtualized SGE nodes

Open Nebula
VMM VMM VMM

Dedicated SGE nodes

Cluster Nodes
9/34

Dynamic Provisioning of Computational Clusters

OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

Cluster Configuration
Pre-defined queues for each workernode type Basic standard cluster services (NIS,NSF...)

Workernode Configuration
Workernodes pre-registered to sgemaster IP & hostname assigned through DHCP (MAC) Copy images to create new nodes Basic cluster services installed

10/34

OpenNebula: Open Source Virtual Machine Manager for Cluster Computing

THANK YOU FOR YOUR ATTENTION!!! More info, downloads, mailing lists at www.opennebula.org
OpenNebula is partially funded by the RESERVOIR Resources and Services Virtualization without Barriers project EU grant agreement 215605

Acknowledgements
Javier Fontan Luis Gonzalez Ignacio M. Llorente
11/34

Tino Vazquez