VMware and Cinder

Alex Jauch, Product Line Manager (@ajauch)

Kartik Bommepally, MTS (Cinder Driver Team)

Confidential
© 2011 VMware Inc. All rights reserved
OpenStack on VMware

2 Confidential – Not for External Distribution

 VMware Vision: Software Defined Storage

Software-Defined Storage Vision

“Bronze” SLA “Gold” SLA
Availability = Availability = 99.99%
Availability = 99% Availability = 99%
Throughput =99.99%
100 R/s,10 W/s
DR RTO = 1
Throughput = 1000 R/s, 20 W/s Enable new storage tiers
Latency = 95% under 5 ms
Latency = 90% under 10 ms
Enable DAS & server flash for shared
Reduce Storage Cost and Complexity

DR= 60’,
DR RPO RTORTO= 1 hour
= 360’ DR RPO = 1’, RTO = 10’
Back up = weekly
Security = Max Laten
encryption
Back up = hourly
Capacity res = 100%
storage along with enterprise SAN/NAS
Web Server
App Server
Enable tight integration with storage
Database Server ecosystem
Tighter integrations with broad storage
ecosystem through APIs
Software Defined Storage
Deliver policy-based automated
storage management
“Gold” “Silver” Distributed Automatically enforce per-VM SLAs for all
Array(s) Array(s) Storage apps across different types of storage

SSD Hard SSD Hard

disks disks

3 Confidential – Not for External Distribution

Virtual SAN (VSAN)

What is Virtual SAN? Key Features

vCenter Server  Converged compute + storage solution

 Utilizes DAS and server attached disks
 Auto-tiering between SSD and HDD
 Intelligent policy driven data placement
vSphere across the cluster
Virtual SAN  vCenter-integrated, instant storage
provisioning
…………….
Customer Benefits
SSD Hard SSD SSD Hard
Hard
disks disks disks
 High performance storage at up to
Distributed Storage 50% lower cost
Aggregated Datastore  Radically Simple Storage – configure
and manage without complex workflows
Clusters internal server disks to  Designed for dynamic scalability
provide scalable shared storage with and high resiliency
cloud agility and efficiency.

4 Confidential – Not for External Distribution

Virtual Volumes

What are Virtual Volumes? Key Features

Current Paradigm  Existing SAN/NAS systems become

VM-aware
VMDKs
on vSphere  Native representation of VMDKs
LUNs on SAN/NAS
 New API for data operations at
VMDK granularity
LUNs replicated

Virtual Volumes
Customer Benefits

vSphere  Native representation of VMDKs

on storage
 Snapshots, replications and other
VMDKs on
storage
operations at VM granularity on
systems external storage
VMDK replicated
 Works with existing SAN/NAS
Broad partner ecosystem storage systems
 VM level storage SLA enforcement

5 Confidential – Not for External Distribution

Storage Policy Based Management (SPBM)

What is Policy-based Management? Key Features

• Simple policies to specify app SLA

SLA Definitions SLA Definitions
requirements
Availability =
Availability = 99.99%
Availability = • Automation of storage provisioning and
Availability = 99%
99.99%
DR RTO = 1 hour 99.99%
Back up = daily
DR RTO = 4 hour
Back up = weekly VM placement across clusters
DR RTO = 1 hour
Storage capacity = 1 TB
DR RTO = 1 hour
Storage capacity = 10 TB
Performance = High I/O
Security = High
Performance = High I/O • Works for any protocol : block, file
Security = High
Max Laten Max Laten and object
• SLA Compliance monitoring & automatic
remediation

Software Defined Storage Customer Benefits

• Drastically simplify storage provisioning

• Management of different storage tiers
as one
• Reduce storage cost by optimizing
Virtual SAN BLOB Storage consumption

Enterprise SAN/ NAS

6 Confidential – Not for External Distribution

The Basics: Storage Abstraction in vSphere

 The Datastore is the fundamental persistence abstraction.

 The VMDK is the Disk abstraction
 Storage Policy Based Management (SPBM) is the Control Plane
 VMware is Moving Away from LUN based policy and towards
VMDK based policy
• For Local Storage, this is done via VSAN
• For Shared Storage, this is done via VVOL
 VMware is Moving Away from Raw Device Map (RDM) Disks
 Thus, a VMDK Driver for Cinder

7 Confidential – Not for External Distribution

Cinder VMDK Driver Work Flow

 As with Nova, vSphere Admin Sets Up Capacity Pools

• For Storage this Means Datastores in Havana
• For Icehouse, this will include SPBM
 Cloud Admin Creates Cinder Volume Types
• Volume Type is our MetaData Injection Vehicle
 Consumer Creates New Cinder Volume
• This Allows us to create meta data
 Consumer Attaches Cinder Volume
• We Lazy Create the VMDK Based on VM Target
• VMDK Is Mounted By vSphere Against Target

8 Confidential – Not for External Distribution

Volume types and extra specs

 Driver allows additional configuration for volume creation via extra

specs in the volume type
 VMDK type
• Use extra spec key ‘vmware:vmdk_type’
• Legal Values: ‘thin’, ‘thick’ and ‘eagerZeroedThick’
• Default type is ‘thin’
 Clone type
• Use extra spec key ‘vmware:clone_type’
• Legal Values: ‘full’ and ‘linked’
• Default type is ‘full’

9 Confidential – Not for External Distribution

What the Heck is a “Shadow” VM?

 In vSphere There is No “First Class Disk” Object. Yet.

 When You Create a VMDK It Must be the Child of a VM
 However, Cinder Assumes a First Class Disk
 Therefore, A “Shadow” VM is inserted
 <<<KARTIK, INSERT SCREEN SHOT HERE OF SHADOW VM>>>

10 Confidential – Not for External Distribution

 DEMO
VMware VMDK Driver for Cinder

11 Confidential – Not for External Distribution

Current API Support

 Create volume
• Supported VMDK types – thin, thick, eagerZeroedThick
• From scratch
• From glance image
• From an available source volume – full clone and linked clone
• From a snapshot – full clone and linked clone
 Attach volume to an instance
 Detach volume from an instance
 Snapshot an available volume
 Delete snapshot of an available volume
 Upload an available volume as glance image
 Delete volume

12 Confidential – Not for External Distribution

Committed Roadmap

 Support for Storage Policy Based Management (SPBM)

 Fix for SnapShot/Clone Issues with Attached Volumes
 Move Core Storage Code into Oslo
 Implement Remaining API Items
 Incorporate Additional Icehouse APIs
 Nova Support for SPBM

13 Confidential – Not for External Distribution

Thoughts Beyond Icehouse

 Common Meta Data Model Between Cinder and Nova

 Support For Application Consistent Snapshots
 DR/HA Considerations in Cinder
• How Do we Abstract Availability Zones?
 Storage QOS
• How Do We Represent Performance Contracts?
 Inter DC Data Mobility Services
 Alerting/Policy Violation Support, Ceilometer?
 Others?

14 Confidential – Not for External Distribution

 Learn More!

http://vmware.com/go/openstack
Day Time Room Title Speaker
Demo
Tuesday 2:50 Sky City Marriott - User Panel: How did you bring OpenStack Panel VMware vSphere on
PM Grand Ballroom C Cloud to your company OpenStack
by Scott Lowe
Tuesday 3:40 Expo Breakout Room 1 Bridging the Gap: Explaining OpenStack to Scott Lowe
PM VMware Administrators
Location: Sponsor Demo
Wednesday 11:15 Expo Breakout Room 1 OpenStack + VMware: Customer Success Dan Wendlandt Theatre
AM Stories & What’s Next Date: Wed @ 2 PM

Wednesday 5:30 Expo Breakout Room 1 Network Virtualization with OpenStack Somik Behera
PM Neutron & VMware NSX Dimitri Desmidt

Thursday 9:50 Sky City Marriott - Differentiated Services == Differentiated Gary Kotton General Session
AM Meeting Room 4 Scheduling
Navigating the
Thursday 2:40 Sky City Marriott - Open vSwitch Deep Dive: The Virtual Eric Lopez Transition to
PM Grand Ballroom C Switch for OpenStack Justin Pettit
Network
Thursday 3:30
PM
Sky City Marriott -
Meeting Room 4
Bridging the Gap: Cinder and vSphere Alex Jauch
Kartik Bommepally
Virtualization
With Martin Casado

Thursday 5:20 Sky City Marriott - How to Write a Neutron Plugin, If You Salvatore Location: Asia World –
PM Grand Ballroom C Really Need To Armando Summit Hall 2
Date: Tues @ 12:05 PM
Friday 11:00 Sky City Marriott - Hands-on with OpenStack + vSphere Gary Kotton
AM Grand Ballroom A&B

Friday 1:30 Sky City Marriott - OpenStack Networking Hands-on Lab Eric Lopez
15 PM Grand Ballroom A&B Confidential – Not for External Distribution Aaron Rosen
 Thank You!

16 Confidential – Not for External Distribution