Manjrasoft

Manjrasoft

Cloud Computing:
The Driver for Next Wave of Innovations
1
 Market-Oriented Cloud Computing
and Big Data Applications

Dr. Rajkumar Buyya Manjrasoft

Cloud Computing and Distributed Systems (CLOUDS) Lab
Innovative Solutions for Cloud Computing
Department of Computing and Information Systems
The University of Melbourne, Australia Dr Rajkumar Buyya

www.cloudbus.org
Chief Executive Officer

Manjrasoft Pty Ltd

Office No. 7.22, Doug McDonell Building

www.buyya.com Melbourne University - Parkville Campus

Melbourne, VIC 3010, Australia
P: +61-3-8344 1344 | M : +61-431799078

www.manjrasoft.com E: raj@manjrasoft.com | W: http://www.manjrasoft.com

Major Sponsors/Supporters

Manjrasoft
 The Next Revolution in IT
Manjrasoft
The Big Switch in IT
 Classical Computing  Cloud Computing
 Buy & Own  Subscribe
 Hardware, System  Use
Software, Applications
Every 18 months?

often to meet peak needs.

 Install, Configure, Test,
Verify
 Manage
 ..
 Finally, use it  $ - pay for what you
 $$$$....$(High CapEx) use, based on QoS

3
 Outline
Manjrasoft

 “Computer Utilities”
 Vision and Promising IT Paradigms/Platforms
 Cloud Computing and Related Paradigms
 Trends, Definition, Cloud Benefits and Challenges
 Market-Oriented Cloud Architecture
 SLA-oriented Resource Allocation
 Global Cloud Exchange
 Aneka: A Cloud Application Platform
 Summary and Thoughts for Future

4
 “Computer Utilities” Vision:
Manjrasoft
Implications of the Internet
 1969 – Leonard Kleinrock, ARPANET project
 “As of now, computer networks are still in their
infancy, but as they grow up and become
sophisticated, we will probably see the spread
of “Computer Utilities”, which, like present
electric and telephone utilities, will service
individual homes and offices across the
country”.
 During the last 44 years, several advances
have taken place in both “computing” and
“communications” areas that are turning the
vision of “Computer Utilities” in to a reality.
5
 Computing Paradigms and
Attributes: Realizing the ‘Computer
Utilities’ Vision

} ?
Manjrasoft

 …
 Web
 Data Centres
 Service Computing
 Grid Computing +
 P2P Computing
 Market-Oriented
Computing
-Ubiquitous
 .. -Reliable
- Trillion $ business
 Cloud Computing -Scalable
-Autonomic

-Dynamic

Paradigms discovery
- Composable
-QoS
-SLA
-…

6
Attributes/Capabilities
 Outline
Manjrasoft

 “Computer Utilities”
 Vision and Promising IT Paradigms/Platforms
 Cloud Computing and Related Paradigms
 Trends, Definition, Cloud Benefits and Challenges
 Market-Oriented Cloud Architecture
 SLA-oriented Resource Allocation
 Global Cloud Exchange
 Aneka: A Cloud Application Platform
 Summary and Thoughts for Future

7
 Very popular: too many are
Manjrasoft
“In Search” of Cloud Computing

Legend:
Grid computing
Cloud computing

8
 Interest over time
{grid, cloud, big data} computing
Manjrasoft

Legend:
Grid Computing
Cloud Computing
Big Data

9
 Open Data Center Alliance (ODCA)
for Cloud Computing
Manjrasoft

10
 Defining Clouds: There are many
views for what is cloud computing?
Manjrasoft

 Over 20 definitions:
 http://cloudcomputing.sys-con.com/read/612375_p.htm
 Renting “remote storage”  backup
 Renting “remote server”  hosting Web server
 Renting “remote more servers”  to manage large workload
 Buyya’s Scientific definition of Cloud Computing 
 “Cloud is a market-oriented distributed computing system consisting of a
collection of inter-connected and virtualised computers that are
dynamically provisioned and presented as one or more unified
computing resources based on service-level agreements (SLAs)
established through negotiation between the service provider and
consumers.”
 SLA = {negotiated and agreed QoS parameters + rewards +
penalties for violation of agreement....}

12
 Subscription-Oriented Cloud Services:
X{compute, apps, data, ..}
Manjrasoft as a Service (..aaS)

Public Clouds

Applications

Development and
Runtime Platform

Compute

Hy
Cloud
Storage
Manager br
id
Cl
ou
Private
d
Clients
Cloud

Other Govt.
Cloud Services Cloud Services

13
 Cloud Services
Manjrasoft

 Infrastructure as a Service
(IaaS)
Software as a Service (SaaS)
 CPU, Storage: Amazon.com,
Google Compute, ….
 Platform as a Service (PaaS)
Platform as a Service (PaaS)
 Google App Engine, Microsoft
Azure, Manjrasoft Aneka..
 Software as a Service (SaaS)
Infrastructure as a Service (IaaS)
 SalesForce.Com

....

14 Manjrasoft
 Cloud Deployment Models
Manjrasoft

Public/Internet Private/Enterprise Hybrid/Inter

Clouds Clouds Clouds

3rd party, Mixed usage of

Cloud model run
multi-tenant Cloud private and public
within a company’s
infrastructure Clouds: Leasing public
own Data Center /
& services: cloud services
infrastructure for
when private cloud
internal and/or
* available on capacity is
partners use.
subscription basis insufficient

15
 Cloud Applications
Manjrasoft

•Scientific/Tech Applications
•Business Applications

•Consumer/Social Applications

Science and Technical Applications

Business Applications

16 Consumer/Social Applications
 Cloud Biz Potential:
a trillion $ business/year by 2020?
Manjrasoft

2000

600?

30% 1000? 50%

120?
15%

2016 2020? 2020?

Buyya’s Guestimate!
17
 Cloud Computing Challenges:
Dealing with too many issues
Manjrasoft
ng
Prici

za t ion Scalability
uali Res
Virt o urc
e Met
er in g
QoS Reliability
v el
Le nts Billing
e e
r vic em
Se gre Ene
r
A gy E
f fi c i e
nc y
Provision
ing Utility & Risk
on Deman
d Management
a l & ry
y g to
ur i t Le ula
S ec g
Re
Uhm, I am not quite
Privacy Programming Env.
clear…Yet another
& Application Dev.
st complex IT paradigm?
Tru

Software Eng.
Complexity
18
 Outline
Manjrasoft

 “Computer Utilities”
 Vision and Promising IT Paradigms/Platforms
 Cloud Computing and Related Paradigms
 Trends, Definition, Cloud Benefits and Challenges
 Market-Oriented Cloud Architecture
 SLA-oriented Resource Allocation
 Global Cloud Exchange
 Aneka: A Cloud Application Platform
 Summary and Thoughts for Future

19
 Market-Oriented Cloud Architecture:
QoS negotiation and SLA-based Resource Allocation
Manjrasoft
Users/
Brokers

Service Request Examiner and

Admission Control
- Customer-driven Service Management
- Computational Risk Management
SLA - Autonomic Resource Management
Resource
Allocator Pricing Accounting

VM Service Request
Monitor Dispatcher Monitor

Virtual
Machines
(VMs)

Physical
Machines

20
 Cloud to expand (lease more
resources) with increase in demand
Manjrasoft
Users/
Brokers

Service Request Examiner and

Admission Control
- Customer-driven Service Management
- Computational Risk Management
SLA - Autonomic Resource Management
Resource
Allocator Pricing Accounting

VM Service Request
Monitor Dispatcher Monitor

Virtual
Machines
(VMs)

Multi-Clouds
Physical
Machines

21
 Cloud to shrink (unlease resources)
with decrease in demand
Manjrasoft
Users/
Brokers

Service Request Examiner and

Admission Control
- Customer-driven Service Management
- Computational Risk Management
SLA - Autonomic Resource Management
Resource
Allocator Pricing Accounting

VM Service Request
Monitor Dispatcher Monitor

Virtual
Machines
(VMs)

Physical
Machines

22
 Outline
Manjrasoft

 “Computer Utilities”
 Vision and Promising IT Paradigms/Platforms
 Cloud Computing and Related Paradigms
 Trends, Definition, Cloud Benefits and Challenges
 Market-Oriented Cloud Architecture
 SLA-oriented Resource Allocation
Software as a Service (SaaS)

 Global Cloud Exchange

 Aneka: A Cloud Application Platform Platform as a Service (PaaS)

 Summary and Thoughts for Future Infrastructure as a Service (IaaS)

26
 Aneka: Cloud Application Platform (CAP)
for Resource-Intensive/Elastic Apps
Manjrasoft

 World-first platform Multiple Applications

supporting multiple Cloud
programming models (Task, Thread Task ... MapReduce
Thread, MapReduce)
 SDK (Software 1. SDK
Development Kit) containing
APIs for multiple programming
models and tools
Aneka
 Runtime Environment for
managing application
execution on Clouds
 Suitable for 2. Runtime
 Development of Enterprise
Cloud Applications
Multi-core Cluster Grid Cloud
 Cloud enabling legacy
applications
2100 2100 2100 2100

 Portability for Customer Apps: 2100 2100 2100 2100

 Enterprise ↔ Public Clouds

 .NET/Win ↔ Mono/Linux
28 Multiple Infrastructures
 Aneka: The Cloud Application Platform
(CAP) for Resource-Intensive Apps
Manjrasoft (Available as Manjrasoft Product)
Application Management Kit
 World-first platform Management Administration

supporting multiple Cloud

Studio Portal
Software Development Kit

programming models (Task, APIs

Design
Explorer
SLA-Negotiation
Web Services
Management
Web Services

Thread, MapReduce) Conta ine r

 SDK (Software Programming Models

Development Kit) containing Task

Model
Thread
Model
Map Reduce
Model
Other
Models

Persistence
APIs for multiple programming

Security
models and tools Patent
Foundation Services
Membership Reservation Storage License Accounting
 Runtime Environment for (USA) Services Services Services Services Services

managing application Fabric Services

execution on Clouds Dynamic Resource Provisioning Services

Hardware Profile Services

 Suitable for
 Development of Enterprise Infrastructure

Cloud Applications .NET @ Windows Mono @ Linux

 Cloud enabling legacy Physical Machines/Virtual Machines

applications Amazon
 Portability for Customer Apps: Private Cloud Microsoft
IBM
Google

 Enterprise ↔ Public Clouds

 .NET/Win ↔ Mono/Linux
29 LAN network Data Center
 Aneka as a Cloud Application
Manjrasoft
Platform

Applications
& Services Application Development

Bag of Tasks Dist. Threads MapReduce …

Cloud Middleware

SLA & QoS User

Platform Application
Management
Management Dynamic
Aneka Provisioning

Scheduling & Monitoring Billing

Execution

Infrastructure
Clusters Public Clouds
Datacenters Desktop PCs

30
 Aneka - Dynamic Management of
Application Tasks and Cloud Resources
Manjrasoft

 Application

Aneka
Workker/Executor
Aneka Application

Aneka
Manager

Manager / Executor
Aneka Threads

31
 Aneka Support for InterCloud /
Federation of Resource Pools
Manjrasoft

 XenServer Pool
 Aneka + Xen Server Executors
private Cloud
 VMWare Pool Executor Executor

Scheduler
 Aneka + VMWare private privatenetwork
enterprise

Cloud internet
publicly available resources
Private
Amazon EC2 Pool
(physical and virtual)
 Cloud
Scheduler
 Aneka + public EC2
 Windows Azure
 Aneka + public Azure Client Libraries
VPN
(virtual resources)
Executors/Schedulers

 Federation Public Cloud

 Span across Clouds

33
Customer/Deployment Case Studies
 Data Growth Rate (IDC)
Manjrasoft
(doubling every 2 years)

39
 (GoFront: A unit of China
Southern Railway Group)
Manjrasoft
Application: Locomotive design CAD rendering
Aneka Maya Renderer
GoFront Private Aneka
Cloud

Use private
Aneka Cloud
LAN network
(Running Maya Batch Mode on
demand)

Case 2: Aneka
Enterprise Cloud Manjrasoft
Time
(in hrs)

Case 1: Single Server

Raw Locomotive Design Files
(Using AutoDesk Maya) Using Maya
Graphical Mode Single Aneka
Directly
Server Cloud
4 cores Aneka utilizes idle desktops
server (30) to decrease task time
40
from days to hours
 Indian Space Research
Organization (ISRO) - ADRIN
Manjrasoft

Distribution
Manjrasoft

Aneka Cloud

Receiving station
processing
Private Cloud Public Cloud
Citrix Xen Archiving Amazon AWS
41
 Health Care: SaaS Cloud for
Manjrasoft
ECG Sensor Data Analysis
Millions of users

User Requests
A User Wireless ECG Sensor
Embedded Bluetooth
Enabled
Data Processor &
Communication Module

ECG Sensor Module

ECG Data

SaaS
User Requests
1 Analysis
Software
2
Bluetooth connectivity

Dynamic Scalable Runtime

PaaS
User QoS based Scaling of
4 Compute Resources

3
IaaS

Wireless/ Mobile 3G Network

5
6
42
 IEEE Scalable Computing Challenge
Manjrasoft
at CCGrid 2010 Conference

43
47
manjrasoft.com
Manjrasoft
`
 Outline
Manjrasoft

 “Computer Utilities”
 Vision and Promising IT Paradigms/Platforms
 Cloud Computing and Related Paradigms
 Trends, Definition, Cloud Benefits and Challenges
 Market-Oriented Cloud Architecture
 SLA-oriented Resource Allocation
 Global Cloud Exchange
 Aneka: A Cloud Application Platform
 Summary and Thoughts for Future

48
 Summary
Manjrasoft

 Several Computing Paradigms have promised to

deliver “Computing Utilities” vision:
 Cloud Computing is the most recent kid in the block
promising to turn vision into reality
 Many exciting business and consumer applications
 Aneka is a rapidly emerging as a platform for:
 Building Clouds and their Apps rapidly – reducing the
cost/time of application Software Engineering.
 Already used in engineering, life science, gaming, and
business intelligence applications.
 Market-oriented Clouds starting to become real.
 Amazon Cloud Marketplace, Virtual Appliance,…

49
 Dozens of Open Research Issues
Manjrasoft

 (Application) Software Licensing

 Seamless integration of private and Cloud resources
 Security, Privacy and Trust
 Cloud “Lock-In” worries and Interoperability
 Application Scalability Across Multiple Clouds
 Clouds Federation and Cooperative Sharing
 Global Cloud Exchange and Market Maker
 Dynamic Pricing
 Dynamic Negotiation and SLA Management
 Energy Efficient Resource Allocation and User QoS
 Power-Cost and CO2 emission issues
 Use renewable energy: follow Sun and wind?
 Regulatory and Legal Issues

50
 A Reference Book and IEEE
Manjrasoft
Journal

cc
/t
Morgan Kauffman, USA McGraw Hill, India rg
r.o
te
pu
o m
.c
w
w
51
w
 Thanks for your attention!
Manjrasoft

 Are there any

 Questions?
 Comments/Suggestions
Manjrasoft

We welcome you to contact:

Study/Research with Us | To setup a Cloud Lab
http:/www.cloudbus.org | www.Manjrasoft.com
rbuyya@unimelb.edu.au | {raj, ravi)@manjrasoft.com
52
Manjrasoft

Manjrasoft

Platform for
Market-Oriented Cloud Computing
53
 Emerging Technologies
Manjrasoft
Priority Matrix 2013

54