Cloud Computing

Part II
Logical View
 Cloud Manager
• The Cloud Manager is the public access point to
the cloud where subscribers sign up for
accounts, manage the resources they rent from
the cloud, and access data stored in the cloud.

• The Cloud Manager includes mechanisms for

authenticating subscribers, and for generating
or validating access credentials (e.g.,
cryptographic keys) that subscribers then
employ when communicating with their virtual
machines.
 Cloud Manager
• The Cloud Manager also performs top-level resource
allocation; when a subscriber issues a command to rent a
number of resources, the Cloud Manager must determine if
the cloud has enough free resources to satisfy the request,
and if so, which Cluster Manager (or Managers) have some or
all the resources.

• If the request can be satisfied, the Cloud Manager must

commit to the allocation of the resources at the participating
Cluster Managers, and must coordinate the setup of virtual
networking so that the subscriber can uniformly access all
resources.

• The Cloud Manager will also enforce any cloud-global policies

governing resource requests.
 Cloud Manager
• In addition to coordination with Cluster Managers, Cloud
Manager connected to the cloud’s Data Object Storage (DOS)
repository.

• In actual implementations, the DOS could be distributed or put

on different networks; however, the DOS services need to be
available both to running virtual machines in the cloud and to
systems from outside the cloud, and must be coordinated
sufficiently with the Cloud Manager to keep track of valid
subscriber identities both to allow their administrative actions in
the DOS and for billing.

• These constraints imply a structure with close ties between the

DOS and the Cloud Manager, and with wide-area network
access from the DOS to both running virtual machines and
external systems.
 Cluster Manager
• Each Cluster Manager is responsible for the operation of a
collection of computers that are connected via high speed
local area networks.
• A computer cluster may contain hundreds or thousands of
computers.
• A Cluster Manager receives resource allocation commands
and queries from the Cloud Manager, and calculates
whether part or all of a command can be satisfied using the
resources of the computers in the cluster.
• A Cluster Manager queries the Computer Managers for
the computers in the cluster to determine resource
availability, and returns messages to the Cloud Manager on
whether part, or all, of a request can be satisfied in a
cluster.
 Cluster Manager
• If subsequently directed by the Cloud Manager, a Cluster
Manager then instructs the Computer Managers to
perform resource allocation, and reconfigures the virtual
network infrastructure to give the subscriber uniform
access.
• In addition to being connected to individual computers via
LAN links each Cluster Manager also connected to
Persistent Local Storage (PLS).
• As discussed above, virtual machines need persistent disk-
like storage to preserve their work while virtual machines
are de-allocated and later reallocated.
• The most natural location for this storage is where very
high speed connections to virtual machines are available,
but where the storage is not permanently bound to any
specific computer system.
 Computer Manager
• At the lowest layer in the hierarchy, the Computer Manager
cooperates with the hypervisor that runs on each computer
system in a cluster.

• In response to queries from its Cluster Manger, a Computer

Manager returns status information including how many virtual
machines are running and how many can still be started.

• In response to commands issued from its Cluster Manager, a

Computer Manager uses the command interface of its
hypervisor to start, stop, suspend, and reconfigure virtual
machines, and to set the local virtual network configuration.

• With some hypervisor technologies, network packets exchanged

between different virtual machines running on the same
hypervisor can be implemented in very high performance in-
memory messages, thus boosting performance.
Cloud Reference Model
Virtualization in Cloud
 Virtualization
• In a cloud a consumer is accessing pooled
resources using a technique called
virtualization.
• Virtualization assigns a logical name for a
physical resource.
• Then provides a pointer to that physical
resource when a request is made.
• Virtualization is dynamic in that the mapping
can be assigned based on rapidly changing
conditions.
 Virtualization
• Virtualization is a major design technique for
all cloud architectures.
• In cloud computing it refers primarily to
platform virtualization, or the abstraction of
physical IT resources from the people and
applications using them.
• Virtualization allows servers, storage devices,
and other hardware to be treated as a pool of
resources rather than discrete systems, so
that these resources can be allocated on
demand.
 Virtualization

• In cloud computing, we’re interested in

techniques such as para-virtualization, which
allows a single server to be treated as multiple
virtual servers, and clustering, which allows
multiple servers to be treated as a single
server.
Virtualization Benefits
 Virtualization Benefits
• Higher utilization rates
– Prior to Virtualization, server and storage
utilization rates in enterprise datacenters typically
averaged less than 50% (in fact, 10% to 15%
utilization rates were common).
– Through virtualization, workloads can be
encapsulated and transferred to idle or underused
systems — which means
– existing systems can be consolidated, so purchases
of additional server capacity can be delayed or
avoided.
 Virtualization Benefits

• Resource consolidation

– Virtualization allows for consolidation of multiple IT

resources.
– Along with server and storage consolidation,
virtualization provides an opportunity to consolidate
the systems architecture, application infrastructure,
data and databases, interfaces, networks, desktops,
and even business processes, resulting in cost
savings and greater efficiency.
 Virtualization Benefits
• Lower power usage/costs

– The electricity required to run enterprise-class

data-centers is no longer available in unlimited
supplies, and the cost is on an upward spiral.
– The amount of budget spent on server hardware,
an equal amount of budget is spent on power
(including the cost of running and cooling servers).
– Using virtualization to consolidate makes it possible
to cut total power consumption and save significant
money.
 Virtualization Benefits
• Space savings
– Server sprawl remains a serious problem in most
enterprise datacenters, but datacenter expansion is
not always an option, with building costs averaging
several thousand dollars per square foot.

– Virtualization can alleviate the strain by

consolidating many virtual systems onto fewer
physical systems.
 Virtualization Benefits
• Disaster recovery/business continuity
– Virtualization can increase overall service-level
availability rates and provide new options for
disaster recovery solutions.
• Reduced operations costs
– The average enterprise spends almost 8 times the
amount spent on new infrastructure, in
maintenance.
– Virtualization can change the server-to-admin ratio,
reduce the total administrative workload, and cut
total operations costs.
 Virtualization at Different Levels
• Operating System Virtualization
– The use of OS-level virtualization or partitioning in
cloud architectures can help solve some of the core
security, privacy, and regulatory issues that could
otherwise hinder the adoption of cloud computing.
– OS virtualization makes it possible to maintain a one-
application-per-server deployment model while
simultaneously sharing hardware resources.
– Example , Solaris Containers isolate software
applications and services using software-defined
boundaries and allow many private execution
environments to be created within a single instance of
the Solaris OS.
 Virtualization
• Another technology used to provide abstraction
creates virtual systems out of physical systems.
• Given a computer system with a certain set of
resources virtualization can set aside portion of
those resources to create a virtual machine.
• A system virtual machine has its own address space
in memory, its own processor resource allocation,
and its own device I/O using its own virtual device
drivers.
• These features enable VMM’s to manage application
provisioning , provide for machine instance cloning
and replication
• Virtualization suffers overhead.
 Virtualization at Different Levels
• Platform Virtualization
– Platform virtualization allows arbitrary operating systems
and resulting application environments to run on a given
system.

– There are two basic models for this system virtualization:

full virtualization, or a complete simulation of underlying
hardware, and paravirtualization, which offers a “mostly
similar” model of the underlying hardware.

– Generally, the more abstract the OS is made from the

underlying hardware, the less hardware specific features
can be accessed. Increased OS abstraction can also increase
the potential for performance reduction and limitations.
 Virtualization
• A low-level program that provides system
resource access to virtual machines, is
referred to as Hypervisor or Virtual Machine
Monitor.
• A hypervisor running on bare metal is a Type I
VM or native VM.
• Examples
– VMWARE ESX and ESXi
– ORACLE VM
– LynxSecure
– VirtualLogix VLX
 Virtualization
• Type I VMs have no host operating systems
because they are installed on a bare system.
• Some Hypervisors are installed over an
operating system and referred to as Type II or
hosted VM.
• Type II virtual machines are installed on a host
operating system.
• Examples
– VMWARE workstation and Server
– Microsoft Hyper V
– XEN
– KVM
 Virtualization at Different Levels
• Network Virtualization
– Load-balancing techniques have been a hot topic in cloud
computing because, as the physical and virtual systems
within the cloud scale up, so does the complexity of
managing the workload that’s performed to deliver the
service.
– Load balancers group multiple servers and services behind
virtual IP addresses.
– A significant challenge in cloud computing networking is not
just the provisioning of individual virtual network interfaces
to a given virtual environment, but also the increasing need
of cloud infrastructures to offer a more complicated virtual
private datacenter, which provisions a set of different
system roles and the logical interconnections between those
roles.
 Virtualization
• A client can request access to a cloud service from
any location.
• A cloud has multiple application instances and
directs requests to an instance based on conditions.
• Computers can be partitioned into a set of virtual
machines with each machine being assigned a
workload.
• Systems can be virtualized by using load balancing
techniques.
• Data is stored across storage devices and often
replicated for redundancy.
 Virtualization
• The technology used to distribute service requests to
resources is referred to as load balancing .
• Load balancing can be implemented in hardware and
software.
• Load balancing is an optimization technique.
• It can be used to increase utilization and throughput,
lower latency, reduce response time, and avoid
system overload.
• It also provides fault tolerance when coupled with a
failover mechanism.
 Virtualization
• In the simplest load balancing mechanism the
load balancer listens to a network port for
service request.
• When a request arrives the load balancer uses
a scheduling algorithm to assign where the
request is sent.
• Some of the scheduling algorithms are
– Round Robin
– Weighted round robin
– Least connections
 Virtualization
• A session ticket is created by the load balancer
to identify clients uniquely.
• The more sophisticated load balancers are
workload managers.
• They determine the current utilization of the
resources in their pool, the response time, the
work queue length, connection latency and
other factors.
• An Application Delivery Controller is a
combination of load balancer and application
server.
 Virtualization
• It is placed between a firewall and a server
farm providing web services.

• ADC provides data compression, content

caching, server health monitoring, security
and advanced routing.

• Google’s cloud is a good example of the use of

load balancing.
 VMware Vsphere
• VMware Vsphere is a management
infrastructure framework that virtualizes
system, storage, and networking hardware to
create cloud computing infrastructure.
• Vsphere provides following services.
• VMware vCompute - A service that aggregates server into
anassignable pool.
• VMware vStorage – A service that aggregates storage
resources into an assignable pool.
• VMware vNetwork – A service that creates and manages
virtual network interface.
• vCenter Server – A provisioning, management, and monitoring
console for Vmware cloud infrastructure.
 Add-on Products
• Virtual Machine File System (VMFS)
– A high performance cluster file system for an
ESX/ESXi cluster.

• VMotion
– A service that allows for migration of a virtual
machine from one physical server to another
physical server while the virtual server runs
continuously and ongoing transactions remain
unaffected.
• Storage VMotion
 Add-on Products

• Storage VMotion
– A product that can migrate files from one datastore
to another datastore while the virtual machine that
uses the datastore continues to run.

• Virtual SMP
– A feature that allows a virtual machine to run on
two or more physical processors at the same time.
 Add-on Products

• Distributed Resource Scheduler

– A system that provides virtual machines and load
balancing while processing resources dynamically
across the different physical systems that are in use.
– The Distributed Power Management module can
manage the power consumption of the systems.
• vNetwork Distributed Switch
– A capability to maintain a network runtime state for
virtual machines as they are migrated from one
physical server to another.
Q&A
THANK YOU