Professional Documents
Culture Documents
gr| 20120828
GRNET
vkoukis@grnet.gr| 20120828
Outline
okeanos ? Rationale
VHPC 12
vkoukis@grnet.gr| 20120828
What is okeanos?
Oceans capture, store and deliver energy, oxygen and life around the planet.
VHPC 12
vkoukis@grnet.gr| 20120828
Simplicity
GRNET
vkoukis@grnet.gr| 20120828
GRNET
vkoukis@grnet.gr| 20120828
vkoukis@grnet.gr| 20120828
Flexibility
GRNET
vkoukis@grnet.gr| 20120828
GRNET
vkoukis@grnet.gr| 20120828
5x 8x
2x 1x
GRNET
vkoukis@grnet.gr| 20120828
okeanos service
Goal: Production-quality IaaS Now in Alpha: from July 2011, ~1200 VMs / ~800 users Target group: GRNETs customers
direct: IT depts of connected institutions indirect: university students, researchers in academia
vkoukis@grnet.gr| 20120828
okeanos service
Volumes: Archipelago
Accounting/Billing: Aquarium
VHPC 12 11
vkoukis@grnet.gr| 20120828
Rationale
GRNET
12
vkoukis@grnet.gr| 20120828
VHPC 12
13
vkoukis@grnet.gr| 20120828
Commercial IaaS
Amazon EC2 not an end-user service
VHPC 12
14
vkoukis@grnet.gr| 20120828
Hypervisor lock-in Is a turn-key solution suitable for a public cloud? Building public clouds is an ongoing process
Manageable by GRNETs operation Integrated into the rest of the infrastructure Scaling to thousands of users
vkoukis@grnet.gr| 20120828
Eucalyptus, OpenNebula, OpenStack Need a mature opensource core to build around Maturity, production-readiness?
proven in production environments, predictable
Extensibility?
Flexibility? Upgradeability, maintainability?
VHPC 12 16
vkoukis@grnet.gr| 20120828
Design
GRNET
17
vkoukis@grnet.gr| 20120828
vkoukis@grnet.gr| 20120828
VHPC 12
19
vkoukis@grnet.gr| 20120828
GRNET
20
vkoukis@grnet.gr| 20120828
Jigsaw puzzle
Synnefo
custom cloud management software to power okeanos
vkoukis@grnet.gr| 20120828
Why Ganeti?
vkoukis@grnet.gr| 20120828
Why Ganeti?
VHPC 12
23
vkoukis@grnet.gr| 20120828
Platform
GRNET
24
vkoukis@grnet.gr| 20120828
Software Stack
REST API
Multiple users, multiple resources
Multiple VMs on cluster Single VM
VHPC 12
25
vkoukis@grnet.gr| 20120828
Platform Design
user@home Web Client CLI Client Web Client 2 admin@home
GRNET Proprietary
GRNET datacenter
Virtual Hardware
VHPC 12
Debian
26
vkoukis@grnet.gr| 20120828
Features
GRNET
27
vkoukis@grnet.gr| 20120828
My_Windows_desktop
Start Reboot
Console
Shutdown
Greek Research and Technology Network VHPC 12
Destroy
28
vkoukis@grnet.gr| 20120828
Virtual Machines
powered by KVM
Linux and Windows guests, on Debian hosts
Google Ganeti for VM cluster management accessible by the end-user over the Web or
VHPC 12
29
vkoukis@grnet.gr| 20120828
Start, Shutdown, Reboot, Destroy Out-of-Band console over VNC for troubleshooting
VHPC 12
30
vkoukis@grnet.gr| 20120828
Full-featured UI in JS/jQuery
UI is just another API client All UI operations happen over the API
VHPC 12
31
vkoukis@grnet.gr| 20120828
Internet
VHPC 12
32
vkoukis@grnet.gr| 20120828
vkoukis@grnet.gr| 20120828
Unity
GRNET
34
vkoukis@grnet.gr| 20120828
Images
Spawn
my own Ubuntu
Freeze
Greek Research and Technology Network VHPC 12 35
vkoukis@grnet.gr| 20120828
Untrusted images
Host cannot touch user-provided data Resize fs, change hostname, change passwords, inject files
Split design
snf-image-host
snf-image-helper
VHPC 12
36
vkoukis@grnet.gr| 20120828
Synchronization, deduplication
An integral part of okeanos
User files, Image registry for VM Images
vkoukis@grnet.gr| 20120828
Images
Spawn
my own Ubuntu
Freeze
Greek Research and Technology Network VHPC 12 38
vkoukis@grnet.gr| 20120828
Images Storage
Clone
Snapshot
Greek Research and Technology Network VHPC 12 39
vkoukis@grnet.gr| 20120828
VHPC 12
40
vkoukis@grnet.gr| 20120828
IaaS Storage
VHPC 12
41
vkoukis@grnet.gr| 20120828
First-phase deployment
System-provided and custom user Images
VHPC 12
43
vkoukis@grnet.gr| 20120828
VHPC 12
44
vkoukis@grnet.gr| 20120828
Integration
GRNET
45
vkoukis@grnet.gr| 20120828
VHPC 12
46
vkoukis@grnet.gr| 20120828
VHPC 12
47
vkoukis@grnet.gr| 20120828
VHPC 12
48
vkoukis@grnet.gr| 20120828
VHPC 12
49
vkoukis@grnet.gr| 20120828
Support services
Identity: Astakos
Provides the user base for okeanos Once authenticated, the user retrieves a
VHPC 12
50
vkoukis@grnet.gr| 20120828
Automation
GRNET
51
vkoukis@grnet.gr| 20120828
./kamaki
$ ./kamaki Usage: kamaki <group> <command> [options] --api=API API can be either openstack or synnefo --url=URL API URL --token=TOKEN use token TOKEN Commands: flavor info flavor list image create image delete
vkoukis@grnet.gr| 20120828
./kamaki
$ ipython In [1]: from kamaki.client import Client In [2]: c = Client('http://localhost:8000/api/v1.1', "1234527db2") In [3]: c.list_flavors() In [4]: i = c.list_images() In [5]: i[5] {u'created': u'2011-06-09T00:00:00+00:00', u'id': 7, u'metadata': {u'values': {u'OS': u'windows', u'size': u'11000'}}, u'name': u'Windows', u'progress': 100, u'status': u'ACTIVE', u'updated': u'2011-09-12T14:47:12+00:00'} In [6]: c.create_server('mywin1', 3, 5)
Greek Research and Technology Network VHPC 12 53
vkoukis@grnet.gr| 20120828
Sights
GRNET
54
vkoukis@grnet.gr| 20120828
Live Demo
Prepare and upload Image from local template VM Spawn compute cluster to run MPI app Make local modifications and repeat
VHPC 12
55
vkoukis@grnet.gr| 20120828
Upcoming
GRNET
56
vkoukis@grnet.gr| 20120828
Now: Alpha2
Common user base, custom user images on Pithos+
medium-term
Volumes: clonable / snapshottable / attachable disks Network and storage hotplugging
vkoukis@grnet.gr| 20120828
Opensource
snf-image
https://code.grnet.gr/projects/snf-image
kamaki
https://code.grnet.gr/projects/kamaki
vncauthproxy
https://code.grnet.gr/projects/snf-vncauthproxy
https://okeanos.grnet.gr
vkoukis@grnet.gr| 20120828
Thank You!
Questions?
VHPC 12
60