XtremWeb-HEP 8.0.

0
Interconnecting jobs over DG

Virtualization over DG

Oleg Lodygensky
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 Objectives

1.Deploy Virtual Machines in XtremWeb-HEP desktop grid to:

✓ protect volunteer resources
✓ generalize «pilot job» to interconnect grids
✓ deploy complex applications
2.Internode communications to:
✓deploy client/server jobs over DG
✓propose an interactive DG

➡ This does not make DG a cloud

O. Lodygensky 2
http://www.xtremweb-hep.org
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 State of the Art
Desktop Grids using VM
Submit/
retrieve

Download/
update

Distributed User
• monitor the platform
• upload applications jobs, datas..
• download job results
Distributed ressource (volunteer PC)
• download jobs, applications, data
• compute jobs
• upload results
• run end user jobs in a VM
• use a preinstalled VM

• run jobs in CernVM

O. Lodygensky • use a preinstalled CernVM
http://www.xtremweb-hep.org 5
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 VM over XWHEP
Centralized and securized services store applications and data
• scheduler
• repository Distributed
• etc. ressource may
declare the
StratusLab
virtualbox
proposes application.
distributions
with the IaaS
paradigms.

Distributed ressource (volunteer PC)

Distributed User • download the virtual disk
• submit a virtualbox job with a • create and run a new VM inside
virtual disk its local VirtualBox

O. Lodygensky 4
http://www.xtremweb-hep.org
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 VM : Contextualization
It is not simple to create a virtual disk (VD) containing a virtualized OS.
➡ we need a repository of «template» VD to ease the user life
➡ any user can still create and use its own VD
➡ any VD can be contextualized

XWHEP
worker
• contextualization VD
• if exists, mounted on /context
• if exists, /context/context.sh
executed at the end of boot
process
• bootable VD
• typically a live CD (350Mb)
• created on the fly by the worker
(=> not downloaded)
/dev/hda • mounted on /scratch
• typically 8Gb
• this is a variable size file
=> upload size then depends on result
size (max: 8Gb - hopefully less)
/dev/hdd /dev/hdb

O. Lodygensky 5
http://www.xtremweb-hep.org
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 VM : Use Case

• HEP applications are linked to ROOT (http://root.cern.ch)

• DG resources don’t have ROOT
➡ submitted jobs will not run

✓ Deploy a VM with ROOT and XWHEP worker

✓ Submit such VM on the fly
➡ the native worker shares VirtualBox
➡ the native worker launches the VM
➡the virtualized worker shares ROOT
➡the virtualized worker run HEP jobs

O. Lodygensky 6
http://www.xtremweb-hep.org
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 BitDew and XWHEP

The BitDew P2P network

places the virtual disk to
the expected XWHEP
workers.

O. Lodygensky 7
http://www.xtremweb-hep.org
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 Internode Communications
Interconnect jobs and applications over DG
Submit/
Centralized and securized services monitor

Download job/
upload results

SmartSockets Hub

(1) Register (1) Register (1) Register

(2) Retrieve (2) Retrieve (2) Retrieve

XWHEP XWHEP XWHEP

XWHEP

client smartsockets XWHEP worker

smartsockets worker
XWHEP
smartsockets
proxy (3) connect proxy proxy

launches launches

A communicating (3) A communicating

application A communicating job job
untouched code
untouched code untouched code reconfigured only Volunteer PC
reconfigured only reconfigured only Volunteer PC
User PC
(3)

O. Lodygensky
Laboratoire de l’Accélérateur Linéaire
Bypassing FireWalls and NAT
http://www.xtremweb-hep.org 8

mercredi 31 août 2011

 Internode Communications
Example 1 : connect client to a job running on volunteer resource.

E.G. : deploying jackrabbit over DG (http://jackrabbit.apache.org)

Centralized and securized services

Submit/
monitor

Download job/
SmartSockets Hub upload results

(1) Register
(1) Register (2) Retrieve
(2) Retrieve
XWHEP XWHEP
client smartsockets XWHEP XWHEP
smartsockets worker
proxy (3) connect proxy
launches

User PC Volunteer PC

O. Lodygensky 9
http://www.xtremweb-hep.org
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 Internode Communications
Example 2 : connect a job running on volunteer resource to a service

E.G. : deploy wget and connect to a web server running on client

Centralized and securized services

Submit/
monitor

Download job/
SmartSockets Hub upload results

(1) Register
(1) Register (2) Retrieve
(2) Retrieve
XWHEP XWHEP
client smartsockets XWHEP XWHEP
smartsockets worker
proxy (3) connect proxy
launches

User PC Volunteer PC

O. Lodygensky 10
http://www.xtremweb-hep.org
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 Internode Communications
Example 3 : interconnect jobs running on volunteer resources

E.G. : interconnect wget and jackrabbit running on volunteer resources

Centralized and securized services

Submit/
monitor

Download job/
SmartSockets Hub upload results

(1) Register (1) Register

(2) Retrieve (2) Retrieve
XWHEP XWHEP XWHEP XWHEP
client worker XWHEP
smartsockets smartsockets worker
proxy (3) connect proxy
launches
User PC launches

Volunteer PC
Volunteer PC
O. Lodygensky 11
http://www.xtremweb-hep.org
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011

 Internode Communications
Example 4 : connect client to a job running on volunteer resource.

E.G. : ssh to a running VM

Centralized and securized services

Submit/
monitor

Download job/
SmartSockets Hub upload results

(1) Register
(1) Register (2) Retrieve
(2) Retrieve
XWHEP XWHEP
client smartsockets XWHEP XWHEP
smartsockets worker
proxy (3) connect proxy
launches

ssh
User PC Volunteer PC

O. Lodygensky 12
http://www.xtremweb-hep.org
Laboratoire de l’Accélérateur Linéaire

mercredi 31 août 2011