You are on page 1of 25

Deploying a StratusLab cloud

+C$ Summer Schoo, -udapest. /ungary! 1* 0u,y (111
StratusLab is co-funded by the European Community’s Seventh Framework Programme Capacities! "rant #greement $%SF&-'$-()1**( 1

Presentation Outline

Project overview and Goals StratusLab Cloud Distribution Reference Cloud Service Prerequisites Installation Configuration

!d"inistration Conclusions

(

StratusLab Project

Goal

Create comprehensive. open-source. $aaS c,oud distribution Focus on supporting grid services

CNRS (FR)

UCM (ES)

Infor"ation
● ● ●

1 0une (111321 4ay (11( ( years! ) partners from * countries -udget 5 262 47 (62 47 EC!

GRNET (GR)

SIXSQ (CH)

Contacts
● ● ●

Site web5 http588stratus,ab6eu8 9witter5 :StratusLab Support5 support:stratus,ab6eu

TID (ES)

TCD (IE)

2

Pri"ary #se Cases

Grid sites on top of cloud infrastructures
● ●

-ridge c,oud and grid techno,ogies <nderstand techno,ogy gaps and imp,ications from combining these two approaches in the same environment +emonstrate production ,eve, grid services on top of c,oud techno,ogies

Cloud$li%e approac&es for grid service provision
● ●

+ynamic management 8 E,asticity of computing resources =&-based authentication and authori>ation for accessing c,oud resources

;

Grid and Cloud Integrations

users "rid 'esource Center
"rid Services C,oud #P$ and Service 4anager #P$

StratusLab +istribution Private8Pub,ic C,oud

Pub,ic C,ouds
*

'arget #ser Co""unities( !pplication Do"ains
Syste" !d"inistrators

)ill use t&e StratusLab distribution to deploy t&eir own cloud infrastructure
*anual installation $nsta,,ation through the ?uattor system

Grid Site ad"inistrators
● ●

@i,, use a StratusLab-based c,oud infrastructure to dep,oy their "rid sites @i,, re-use eAisting app,iances with grid midd,eware or bui,d their own images

+nd #sers
● ●

Focus on Scientific app,ications same as with "rid app,ications! -ioinformatics community participates in the proBect C%'S8$-CP!6 Ear,y adopters of StratusLab techno,ogy @i,, run their app,ications either as "rid Bobs or by accessing computing resources direct,y from the c,oud #P$s6
)

So far, so good-

Series of public(preview releases of StratusLab distribution
● ● ●

Latest re,ease5 v161 0u,y (111! 'P4s avai,ab,e from the StratusLab repo5 http588yum6stratus,ab6eu &pen%ebu,a (6( core virtua, machine manager

Public reference cloud service
● ● ●

&perated by "'%E9 Provides access to eAterna, users6 'eDuests send to support:stratus,ab6eu -ased on the ,atest at time StratusLab re,ease

!ppliance repository
● ● ●

&perated by 9C+ &ffers base &S and app,iance images pre-cooked with app-,eve, software!6 $s evo,ving towards a E4arketp,aceF of =4 #pp,iances registry of =4 metadata G actua, images stored in the c,oud!
C

!rc&itecture of StratusLab v./0
#pp,iance 4anagement users
/99P S! 'ES9 $nterface StratusLab 4arketp,ace

$aaS C,oud
9C,oud Service 4anager C,audia! I4L-'PC J &CC$ =irtua, 4achine 4anager &pen%ebu,a! L=4 Ien =4ware M

#pp,iance Storage @eb. "rid. C,oud!

'ES98C+4$ Storage 4anager iSCS$ K! M

Physica, Computing 'esources

Physica, Storage 'esources
H

Reference deploy"ent

one/ )omman$s as onea$min a))t+

Cloud Admin.

F ron te nd
OpenNebula(XMLRPCon 2634) Ganglia StratusLab web monitor N S Ser!er (images" #Ms" onea$min)

h ps ://cloud-g rnet.s tra tus lab.eu

Passwor$(less SS% a))ess *or onea$min a))t+

Nod e1
%&per!isor ('#M) Ganglia (gmon$) N SClient (images" #Ms" onea$min)

Nod e2
P&t,on CL- to %..P en$point %..P image trans*er ()url) %&per!isor ('#M) Ganglia (gmon$) N SClient (images" #Ms" onea$min)

User (Grid admin or app user)

Ap p lian c e sR e p os itory
h p://appliances .s tratus lab.eu
0pa),e12eb$a!

. . .

Nod eN
%&per!isor ('#M) Ganglia (gmon$) N SClient (images" #Ms" onea$min)

N

In action1 2G$03$StratusLab

'&e first 456 fully virtuali7ed production grid site running on a cloud infrastructure

1 CE. H dua,-core @%s. 1 SE 29- of storage!. 1 gLite-#PEL monitoring node. 1 <$ Certified in "reek %"$. officia,,y part of the nationa, grid infrastructure "stat detai,s5 http588gstat-prod6cern6ch8gstat8site8/"-1C-StratusLab8

11

9enefits
Grid admins

Grid end-users

Reduced ti"e to production *ini"i7e c&ances of downti"es due to &ardware proble"s +asier to quic%ly scale on &ig& load de"ands 2ardware ad"inistration delegated to cloud provider Cost$efficient access to co"puting resources

+8perience a "ore reliable Grid service

#dditiona, work is needed in order to eAp,oit the fu,, potentia, of the c,oud

11

Prerequisites

Hardware

#.(34e3tentions

Software

e$ora454 Passwor$less4ss,4between4%24no$es4as4root 04running46%CP4ser!er (Optional)47ri$ge4)on*iguration

1(

Installation Overview

Installation Methods

Manual4installation
– –

%ot as manua, as you think 5-! Set up the repository and insta,, StratusLab using manua, commands and preferences from the designated frontend node6

8uattor4installation
– – –

Faster. more comprehensive insta,,ation procedure Everything in one p,ace but "reater risk of prob,ems during insta,,ation

For this demonstration

Manual4-nstallation4will4be4use$"4to4gi!e4s&sa$mins4a4better4 i$ea4o*4t,e4prere9uisites4an$4pro)e$ures

12

Installation Overview 4:6

Packages

.,e4o**i)ial4repo4at4,ttp:11&um+stratuslab+eu1releases1*e$ora5414 One4pa);age4install:4&um4install4stratuslab()li(s&sa$min Optional:4stratuslab(web(monitor"4stratuslab(mar;etpla)e

DHCP configuration HW Node installation and configuration Frontend and node install Operational est practices

1;

D2CP configuration

A note on ONE net or!ing

( network types FiAed or 'anged

FiAed5 $Ps assigned on a per 4#C basis from unmanaged +/CP server G predictab,e $P assignmen 'anged5 $Ps are not assigned in a predictab,e fashion i6e6 it’s up to an unmanaged +/CP server!

"#C$ con%iguration

Provide each 4#C with an $P in a predictab,e manner &%E wi,, be notified during insta,,ation from StratusLab too,s

1*

*anual 2) node configuration

Net or!

4ake sure that a,, nodes have the correct bridges to the correct =L#%s if you are using seperate =L#%s! Stratus-insta,, can dea, with it during insta,,ation caveat5 this is a uti,ity that shou,d not be used G a restart wi,, inva,idate the configuration!

Node storage con%iguration

&%E has two modes of operation
– –

SS/ with ,oca, storage Shared storage e6g6 nfs!

<sing either of those reDuires no configuration stratus-insta,,! Oou can use your favorite shared8distributed FS e6g6 "PFS. g,usterfs. ceph! with ,itt,e effort. provided you can mount it on 8var8,ib8one8

&etup pass ordless ssh %or root
1)

Installation

'epositor(
PStratusLab-'e,easesQ nameRStratusLab-'e,eases baseur,Rhttp588yum6stratus,ab6eu8re,eases8fedora1; gpgcheckR1 Enab,edR1

)nstall pac!ages

yum insta,, stratus,ab-c,i-sysadmin 9hat’s itS

1C

Installation 4:6

$re-install con%ig

stratus-config Gk stratus-config TkeyU Tva,ueU /uge number of options G few reDuired EAamp,e

*rontend and node install

stratus-insta,, stratus-insta,, Gn ThostnameU =erbosity is good -v. -vv!

1H

)&at &appens5

User creation (oneadmin) ONE con%iguration (*E+ hosts+ ,nets) &er,ices con%ig (mainl( lib,irt/-emu) (Optionall() Net or! con%iguration (Optionall() N*& con%iguration

.uite a lot actuall(/

1N

'esting t&e installation

Use current tools/ Cloud la(er admin (oneadmin) 0aunching )nstances 1roubleshooting

Get help %rom the communit(/ (support2stratuslab.eu)

(1

Installing goodies

3eb 4onitor

yum insta,, stratus,ab-web-monitor 8etc8init6d8httpd start

Claudia

stratus-insta,, Gc,audia EAperimenta, sti,,S

(1

!d"inistration

Add/manage users

&ne-proAy or. the front-end! <ser credentia,s passwords or grid certs! Simp,y add8remove ,ines from a sing,e fi,e

.uotas

oneauth Duota set M

5ac!ups 1ailoring (i.e. #ac!ing :-) )

O&<' user community shou,d drive the reDuirements6 9rade-offs e6g6 storage capacity vs disk $8&! EAtreme,y configurab,e dep,oyment G bash scripting know,edge
((

Conclusions

&tratus0ab or!ing on cloud / grid integration/interoperabilit( scenarios &tratus0ab 6.7 release 'e%erence cloud ser,ice publicl( a,ailable $roduction grid site running on re%erence cloud 3or!ing on elastic grid site %unctionalit( E8ploring grid-li!e access to cloud resources

(2

;or "ore infor"ation-

&tratus0ab

i!i: http://

.stratuslab.eu

&upport mailing list: support2stratuslab.eu (also %or re-uesting access to the re%erence cloud ser,ice) Appliance 'epositor(: http://appliances.stratuslab.eu Git (source code): http://code.stratuslab.eu/public/git/ $ac!age repositor(: http://(um.stratuslab.eu OpenNebula tool!it: http://opennebula.org/ .uattor tool!it: http://-uattor.source%orge.net/

(;

Copyright V (111. 4embers of the StratusLab co,,aboration5 Centre %ationa, de ,a 'echerche ScientifiDue. <niversidad Comp,utense de 4adrid. "reek 'esearch and 9echno,ogy %etwork S6#6. SiASD SWr,. 9e,efXnica $nvestigaciXn y +esarro,,o S#. and 9he Provost Fe,,ows and Scho,ars of the Co,,ege of the /o,y and <ndivided 9rinity of ?ueen E,i>abeth %ear +ub,in6 9his work is ,icensed under the Creative Commons #ttribution 261 <nported License http588creativecommons6org8,icenses8by82618

(*