CLOUD COMPUTING

Cloud Virtualization and Clustering - I Courtesy:

Dr Gnanasekaran
Thangavel
 UNIT 4:CLOUD VIRTUALIZATION & CLUSTERS
Cloud deployment models: public, private, hybrid, community
– Categories of cloud computing:
– Everything as a service: Infrastructure, platform, software
– Pros and Cons of cloud computing
– Beowulf Cluster
– Installation of Rocks Cluster

10/17/2022 2
This unit mainly deals with following cloud computing concepts

1. Three deployment models

2. Four service models
3. Five major characteristics
4. Five virtualization levels
5. Six design objectives
6. Seven layers
7. Eight other common characteristics

10/17/2022 3
 Definition of Cloud Computing
• It is the practice of using a network of remote servers hosted on the
Internet to store, manage, and process data, rather than a local
server or a personal computer.
• Cloud computing is a model for enabling ubiquitous, convenient, on-
demand network access to a shared pool of configurable computing
resources (e.g., networks, servers, storage, applications, and
services) that can be rapidly provisioned and released with minimal
management effort or service provider interaction.
• This cloud model is composed of five essential characteristics, three
service models, and four deployment models.

10/17/2022 4
 Cloud Ecosystem and Enabling Technologies

10/17/2022 5
 Cost Model

10/17/2022 6
 Cloud Design Objectives
1. Shifting computing from desktops to data centers

2. Service provisioning and cloud economics

3. Scalability in performance

4. Data privacy protection

5. High quality of services

6. New standards and interfaces

10/17/2022 7
The following image shows that cloud computing is composed of five essential
, three , and four as shown in the
following figure:

10/17/2022 8
 Deployment Models
• Public cloud. The cloud infrastructure is provisioned for open use by the general public. It may be
owned, managed, and operated by a business, academic, or government organization, or some
combination of them. It exists on the premises of the cloud provider.
• Private cloud. The cloud infrastructure is provisioned for exclusive use by a single organization
comprising multiple consumers (e.g., business units). It may be owned, managed, and operated by
the organization, a third party, or some combination of them, and it may exist on or off premises.
• Community cloud. The cloud infrastructure is provisioned for exclusive use by a specific community
of consumers from organizations that have shared concerns (e.g., mission, security requirements,
policy, and compliance considerations). It may be owned, managed, and operated by one or more of
the organizations in the community, a third party, or some combination of them, and it may exist on
or off premises.
• Hybrid cloud. The cloud infrastructure is a composition of two or more distinct cloud infrastructures
(private, community, or public) that remain unique entities, but are bound together by standardized
or proprietary technology that enables data and application portability (e.g., cloud bursting for load
balancing between clouds).

10/17/2022 9
10/17/2022 10
 Cloud deployment models
• The concept of cloud computing has evolved from cluster, grid and utility
computing.
• Cluster and grid computing leverage the use of many computers in parallel to
solve problems of any size.
• Utility and Software as a Service (SaaS) provide computing resource as a service
with notation of pay per use.
• Cloud computing is a high throughput computing (HTC) paradigm whereby the
infrastructure provides the service through a large data centre or server farms.
• The cloud computing model enables users to share the resources from anywhere
at any time through their connected devices.
• All computations in cloud applications are distributed to servers in a data centre,
cloud platforms are systems distributed through virtualization.

10/17/2022 11
 Cloud deployment models

The major cloud deployment

models:
1. Public Cloud
2. Private Cloud
3. Hybrid Cloud
4. Community Cloud
portability

10/17/2022 12
The platform and ecosystem views of cloud computing represent a
new paradigm, and promote a new way of computing.

10/17/2022 13
 Service Models
• Software as a Service (SaaS). The capability provided to the consumer is to use the provider’s applications
running on a cloud infrastructure. The applications are accessible from various client devices through either a thin
client interface, such as a web browser (e.g., web-based email), or a program interface. The consumer does not
manage or control the underlying cloud infrastructure including network, servers, operating systems, storage, or
even individual application capabilities, with the possible exception of limited user-specific application configuration
settings.
• Platform as a Service (PaaS). The capability provided to the consumer is to deploy onto the cloud infrastructure
consumer-created or acquired applications created using programming languages, libraries, services, and tools
supported by the provider. The consumer does not manage or control the underlying cloud infrastructure including
network, servers, operating systems, or storage, but has control over the deployed applications and possibly
configuration settings for the application-hosting environment.
• Infrastructure as a Service (IaaS). The capability provided to the consumer is to provision processing, storage,
networks, and other fundamental computing resources where the consumer is able to deploy and run arbitrary
software, which can include operating systems and applications. The consumer does not manage or control the
underlying cloud infrastructure but has control over operating systems, storage, and deployed applications; and
possibly limited control of select networking components (e.g., host firewalls).

10/17/2022 14
Cloud service models offer customers varying levels of control over assets and services,
which presents performance visibility challenges.

10/17/2022 15
 Essential Characteristics:
• On-demand self-service. A consumer can unilaterally provision computing capabilities, such as server time and
network storage, as needed automatically without requiring human interaction with each service provider.
• Broad network access. Capabilities are available over the network and accessed through standard mechanisms that
promote use by heterogeneous thin or thick client platforms (e.g., mobile phones, tablets, laptops, and workstations).
• Resource pooling. The provider’s computing resources are pooled to serve multiple consumers using a multi-tenant
model, with different physical and virtual resources dynamically assigned and reassigned according to consumer
demand. There is a sense of location independence in that the customer generally has no control or knowledge over the
exact location of the provided resources but may be able to specify location at a higher level of abstraction (e.g., country,
state, or data center). Examples of resources include storage, processing, memory, and network bandwidth.
• Rapid elasticity. Capabilities can be elastically provisioned and released, in some cases automatically, to scale rapidly
up or down with varying demand. To the consumer, the capabilities available for provisioning often appear to be
unlimited and can be requested in any quantity at any time.
• Measured service. Cloud systems automatically control and optimize resource usage by leveraging metering capability
at some level of abstraction appropriate to the type of service (e.g., storage, processing, bandwidth, and active user
accounts). Resource usage can be monitored, controlled, and reported, providing transparency for both the provider and
consumer of the utilized service.

10/17/2022 16
 Advantages of Cloud Computing
• Cost Savings : Perhaps, the most significant cloud computing benefit is in terms of IT cost savings. Businesses, no matter what
their type or size, exist to earn money while keeping capital and operational expenses to a minimum. With cloud computing,
substantial capital costs can be saved with zero in-house server storage and application requirements. The lack of on-premises
infrastructure also removes their associated operational costs in the form of power, air conditioning and administration costs. You
pay for what is used and disengage whenever you like - there is no invested IT capital to worry about. It’s a common
misconception that only large businesses can afford to use the cloud, when in fact, cloud services are extremely affordable for
smaller businesses.
• Reliability: With a managed service platform, cloud computing is much more reliable and consistent than in-house IT
infrastructure. Most providers offer a Service Level Agreement (SLA) which guarantees 24/7/365 and 99.99% availability. Your
organization can benefit from a massive pool of redundant IT resources, as well as quick failover mechanism - if a server fails,
hosted applications and services can easily be transited to any of the available servers.
• Manageability :Cloud computing provides enhanced and simplified IT management and maintenance capabilities through central
administration of resources, vendor managed infrastructure and SLA backed agreements. IT infrastructure updates and
maintenance are eliminated, as all resources are maintained by the service provider. You enjoy a simple web-based user interface
for accessing software, applications and services – without the need for installation - and an SLA ensures the timely and
guaranteed delivery, management and maintenance of your IT services.
• Strategic Edge: Ever-increasing computing resources give you a competitive edge over competitors, as the time you require for IT
procurement is virtually nil. Your company can deploy mission critical applications that deliver significant business benefits, without
any upfront costs and minimal provisioning time. Cloud computing allows you to forget about technology and focus on your key
business activities and objectives. It can also help you to reduce the time needed to market newer applications and services.

10/17/2022 17
• Lower computer costs:
– You do not need a high-powered and high-priced computer to run cloud computing's web-based applications.
– Since applications run in the cloud, not on the desktop PC, your desktop PC does not need the processing power or hard disk
space demanded by traditional desktop software.
– When you are using web-based applications, your PC can be less expensive, with a smaller hard disk, less memory, more
efficient processor...
– In fact, your PC in this scenario does not even need a CD or DVD drive, as no software programs have to be loaded and no
document files need to be saved.
• Improved performance:
– With few large programs hogging your computer's memory, you will see better performance from your PC.
– Computers in a cloud computing system boot and run faster because they have fewer programs and processes loaded into
memory…
• Reduced software costs:
– Instead of purchasing expensive software applications, you can get most of what you need for free-ish!
• most cloud computing applications today, such as the Google Docs suite.
– better than paying for similar commercial software
• which alone may be justification for switching to cloud applications.
• Instant software updates:
– Another advantage to cloud computing is that you are no longer faced with choosing between obsolete software and high upgrade
costs.
– When the application is web-based, updates happen automatically
• available the next time you log into the cloud.
– When you access a web-based application, you get the latest version
• without needing to pay for or download an upgrade.
• Improved document format compatibility:
– You do not have to worry about the documents you create on your machine being compatible with other users' applications or
OSes
– There are potentially no format incompatibilities when everyone is sharing documents and applications in the cloud.

10/17/2022 18
• Unlimited storage capacity:
– Cloud computing offers virtually limitless storage.
– Your computer's current 1 Tbyte hard drive is small compared to the hundreds of Pbytes available in the cloud.
• Increased data reliability:
– Unlike desktop computing, in which if a hard disk crashes and destroy all your valuable data, a computer crashing in the cloud
should not affect the storage of your data.
• if your personal computer crashes, all your data is still out there in the cloud, still accessible
– In a world where few individual desktop PC users backup their data on a regular basis, cloud computing is a data-safe
computing platform!
• Universal document access:
– That is not a problem with cloud computing, because you do not take your documents with you.
– Instead, they stay in the cloud, and you can access them whenever you have a computer and an Internet
connection
– Documents are instantly available from wherever you are
• Latest version availability:
– When you edit a document at home, that edited version is what you see when you access the document at
work.
– The cloud always hosts the latest version of your documents
• as long as you are connected, you are not in danger of having an outdated version
• Easier group collaboration:
– Sharing documents leads directly to better collaboration.
– Many users do this as it is an important advantages of cloud computing
• multiple users can collaborate easily on documents and projects
• Device independence.
– You are no longer tethered to a single computer or network.
– Changes to computers, applications and documents follow you through the cloud.
– Move to a portable device, and your applications and documents are still available.
10/17/2022 19
 Disadvantages of Cloud Computing
• Downtime: As cloud service providers take care of a number of clients each day, they can become overwhelmed and may even
come up against technical outages. This can lead to your business processes being temporarily suspended. Additionally, if
your internet connection is offline, you will not be able to access any of your applications, server or data from the cloud.
• Security: Although cloud service providers implement the best security standards and industry certifications, storing data and
important files on external service providers always opens up risks. Using cloud-powered technologies means you need to
provide your service provider with access to important business data. Meanwhile, being a public service opens up cloud
service providers to security challenges on a routine basis. The ease in procuring and accessing cloud services can also give
nefarious users the ability to scan, identify and exploit loopholes and vulnerabilities within a system. For instance, in a multi-
tenant cloud architecture where multiple users are hosted on the same server, a hacker might try to break into the data of other
users hosted and stored on the same server. However, such exploits and loopholes are not likely to surface, and the likelihood
of a compromise is not great.
• Vendor Lock-In: Although cloud service providers promise that the cloud will be flexible to use and integrate, switching cloud
services is something that hasn’t yet completely evolved. Organizations may find it difficult to migrate their services from one
vendor to another. Hosting and integrating current cloud applications on another platform may throw up interoperability and
support issues. For instance, applications developed on Microsoft Development Framework (.Net) might not work properly on
the Linux platform.
• Limited Control: Since the cloud infrastructure is entirely owned, managed and monitored by the service provider, it transfers
minimal control over to the customer. The customer can only control and manage the applications, data and services operated
on top of that, not the backend infrastructure itself. Key administrative tasks such as server shell access, updating and
firmware management may not be passed to the customer or end user.

10/17/2022 20
• Requires a constant Internet connection:
– Cloud computing is impossible if you cannot connect to the Internet.
– Since you use the Internet to connect to both your applications and documents, if you do not have an
Internet connection you cannot access anything, even your own documents.
– A dead Internet connection means no work and in areas where Internet connections are few or
inherently unreliable, this could be a deal-breaker.
• Can be slow:
– Even with a fast connection, web-based applications can sometimes be slower than
accessing a similar software program on your desktop PC.
– Everything about the program, from the interface to the current document, has to be sent
back and forth from your computer to the computers in the cloud.
– If the cloud servers happen to be backed up at that moment, or if the Internet is having a
slow day, you would not get the instantaneous access you might expect from desktop
applications.
• Does not work well with low-speed connections:
– Similarly, a low-speed Internet connection, such as that found with dial-up services, makes
cloud computing painful at best and often impossible.
– Web-based applications require a lot of bandwidth to download, as do large documents.
• Features might be limited:
– This situation is bound to change, but today many web-based applications simply are not as
full-featured as their desktop-based applications.
• For example, you can do a lot more with Microsoft PowerPoint than with Google Presentation's
web-based offering

10/17/2022 21
• Stored data might not be secure:
– With cloud computing, all your data is stored on the cloud.
• The questions is How secure is the cloud?
– Can unauthorized users gain access to your confidential data?
• Stored data can be lost:
– Theoretically, data stored in the cloud is safe, replicated across multiple machines.
– But on the off chance that your data goes missing, you have no physical or local backup.
• Put simply, relying on the cloud puts you at risk if the cloud lets you down.
• HPC Systems:
– Not clear about when you can run compute-intensive HPC applications that use
MPI/OpenMP!
– Scheduling is important with this type of application
• as you want all the VM to be co-located to minimize communication latency!
• General Concerns:
– Each cloud systems uses different protocols and different APIs
• may not be possible to run applications between cloud based systems
– Amazon has created its own DB system (not SQL 92), and workflow system
• so your applications will have to be adapted to execute on these platforms.

10/17/2022 22
 Implementation Levels of Virtualization
Virtualization technology benefits the computer and IT industries by enabling users to share expensive hardware resources
by multiplexing VMs on the same set of hardware hosts.
• Virtual workspaces:
– An abstraction of an execution environment that can be made dynamically available to authorized
clients by using well-defined protocols,
– Resource quota (e.g. CPU, memory share), App App App

– Software configuration (e.g. O/S, provided services).

• Implement on Virtual Machines (VMs): OS OS OS
– Abstraction of a physical host machine,
– Hypervisor intercepts and emulates instructions Hypervisor
from VMs, and allows management of VMs,
– VMWare, Xen, etc. Hardware
• Provide infrastructure API:
– Plug-ins to hardware/support structures Virtualized Stack

10/17/2022 23
 Virtual Machines
• VM technology allows multiple virtual machines to run on
a single physical machine.
App App App App App
Xen
Guest OS Guest OS Guest OS
(Linux) (NetBSD) (Windows)
VMWare
VM VM VM
UML
Virtual Machine Monitor (VMM) / Hypervisor

Denali
Hardware
etc.

Performance: Para-virtualization (e.g. Xen) is very close to raw physical performance!

10/17/2022 24
 Virtualization in General
Advantages of virtual machines:
– Run operating systems where the physical hardware is unavailable,
– Easier to create new machines, backup machines, etc.,
– Software testing using “clean” installs of operating systems and software,
– Emulate more machines than are physically available,
– Timeshare lightly loaded systems on one host,
– Debug problems (suspend and resume the problem machine),
– Easy migration of virtual machines (shutdown needed or not).
– Run legacy systems!

10/17/2022 25
 What is the purpose and benefits?
• Cloud computing enables companies and applications, which are system
infrastructure dependent, to be infrastructure-less.
• By using the Cloud infrastructure on “pay as used and on demand”, all of us can
save in capital and operational investment!
• Clients can:
– Put their data on the platform instead of on their own desktop PCs and/or on their own
servers.
– They can put their applications on the cloud and use the servers within the cloud to do
processing and data manipulations etc.
– In computing, virtualization means to create a virtual version of a device or
resource, such as a server, storage device, network or even an operating
system where the framework divides the resource into one or more execution
environments.

10/17/2022 26
 Difference between Traditional and Virtual machines
• A traditional computer runs with a host operating system specially tailored for its hardware
architecture
• After virtualization, different user applications managed by their own operating systems (guest
OS) can run on the same hardware, independent of the host OS.
• The Virtualization layer is the middleware between the underlying hardware and virtual machines
represented in the system, also known as virtual machine monitor (VMM) or hypervisor.

With sufficient storage, any

computer platform can be
installed in another host
computer, even if they use
processors with different
instruction sets and run with
distinct operating systems
on the same hardware.

10/17/2022 27
 PC Clusters, Grids and Clouds ...

Cloud Computing: A Detailed Relationship to Grid and Cluster Computing

Ikechukwu Nwobodo

10/17/2022 28
Top500.org https://www.top500.org/resources/top-systems/
Beowulf Cluster of PCs
• A Beowulf cluster is a computer cluster of what are normally
identical, commodity-grade computers networked into a small local
area network with libraries and programs installed which allow
processing to be shared among them.
• The result is a high-performance parallel computing cluster from
inexpensive personal computer hardware.
• The name Beowulf originally referred to a
specific computer built in 1994 by
Thomas Sterling and Donald Becker at NASA.

10/17/2022
29
 Beowulf Cluster
The Borg, a 52-node Beowulf cluster
used by the McGill University pulsar
group to search for pulsations from
binary pulsars.
• Beowulf clusters normally run a Unix-
like operating system, such as BSD,
Linux, or Solaris, normally built from free
and open source software.
• Commonly used parallel processing
libraries include Message Passing
Interface (MPI) and Parallel Virtual
Machine (PVM).
• Both of these permit the programmers
to divide a task among a group of
networked computers, and collect the
results after processing is complete.

10/17/2022 30