Cloud Computing

BITS Pilani AWS-Storage and Database Services

Hyderabad Campus
 Cloud Computing Offerings

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 2
 Amazon Web Services
Amazon Web Services Cloud
• Provides highly reliable and scalable infrastructure for
deploying web-scale solutions
• With minimal support and administration costs
• More flexibility than own infrastructure, either on premise
or at a data centre facility

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 3
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 4
 Amazon Web Services

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 5
 Infrastructure Services
• Elastic IP addresses - allocate a static IP address and
assigned to an instance.
• CloudWatch: Enable monitoring Amazon EC2 instance - -
visibility into resource utilization, operational performance,
and overall demand patterns (including metrics such as
CPU utilization, disk reads and writes, and network traffic).
• Auto-scaling - to automatically scale capacity on certain
conditions based on metric that Amazon CloudWatch
collects.
• Elastic LB – distribute incoming traffic by creating an
elastic load balancer
• Amazon Elastic Block Storage (EBS) - volumes provide
network-attached persistent storage to Amazon EC2
instances.
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 6
 Infrastructure Services
• Amazon S3 is highly durable and distributed data store.
With a simple web services interface, store and retrieve
large amounts of data as objects in buckets (containers) at
any time, using standard HTTP
• Amazon SimpleDB - Provides the core functionality of a
database, real-time lookup and simple querying of
structured data
• Amazon Relational Database Service - provides an easy
way to setup, operate and scale a relational database in
the cloud.
• Amazon Elastic MapReduce - provides a hosted Hadoop
framework
• AWS Identity and Access Management (IAM) – enables
multiple User creation with unique security credentials and
manage the permissions for each of these Users

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 7
 Amazon Elastic Compute
Cloud (Amazon EC2)

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 8
 Features of Amazon EC2

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 9
 Amazon EC2

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 10
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 11
 Amazon Machine Image
(AMI)

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 12
 Types of AMI

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 13
 Amazon EC2 Choices

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 14
 Amazon EC2 Instance Types

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 15
 Elastic IP Address

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 16
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 17
 Auto Scaling

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 18
 Elastic Load Balancing

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 19
 Amazon VPC

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 20
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 21
 Amazon Route 53

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 22
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 23
 Security Groups

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-network-security.html

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 25
 Inbound
Source Protocol Port Range Comments
0.0.0.0/0 TCP 80 Allow inbound HTTP access from all
IPv4 addresses

::/0 TCP 80 Allow inbound HTTP access from all IPv6

addresses

0.0.0.0/0 TCP 443 Allow inbound HTTPS access from all

IPv4 addresses

::/0 TCP 443 Allow inbound HTTPS access from all IPv6
addresses

Your network's public IPv4 address TCP 22 Allow inbound SSH access to Linux
range instances from IPv4 IP addresses in
your network (over the Internet
gateway)

Your network's public IPv4 address TCP 3389 Allow inbound RDP access to Windows
range instances from IPv4 IP addresses in
your network (over the Internet
gateway)

Outbound
Destination Protocol Port Range Comments
The ID of the security group for your TCP 1433 Allow outbound Microsoft SQL Server
Microsoft SQL Server database servers access to instances in the specified
security group

The ID of the security group for your TCP 3306 Allow outbound MySQL access to
MySQL database servers instances in the specified security group

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 26
 Region versus Availability
Zones

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 27
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 28
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 29
 Regions

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 30
 Amazon S3

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 31
 Organization of Data in S3

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 32
 Amazon S3

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 33
 Amazon S3 pricing
S3 Standard Storage

First 50 TB / Month $0.023 per GB

Next 450 TB / Month $0.022 per GB

Over 500 TB / Month $0.021 per GB

S3 Standard-Infrequent Access (S3 Standard-IA) Storage

All storage / Month $0.0125 per GB

S3 One Zone-Infrequent Access (S3 One Zone-IA) Storage

All storage / Month $0.01 per GB

S3 Glacier Storage

All storage / Month $0.004 per GB

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 34
 Billions of Objects Stored

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 35
 S3 Namespace

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 36
 S3 Namespace

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 37
 S3 API

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 38
 Storage Resources

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 39
 Elastic Block Storage

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 40
 Elastic Block Storage

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 41
 Elastic Block Storage

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 42
 Elastic Block Storage
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSSnapshots.html
SS ZG527 AWS Storage and DB Services
In the diagram, Volume 1 is shown at
three points in time. A snapshot is taken
of each of these three volume states.
•In State 1, the volume has 10 GiB of
data. Because Snap A is the first
snapshot taken of the volume, the entire
10 GiB of data must be copied.
•In State 2, the volume still contains 10
GiB of data, but 4 GiB have changed.
Snap B needs to copy and store only the
4 GiB that changed after Snap A was
taken. The other 6 GiB of unchanged
data, which are already copied and
stored in Snap A, are referenced by
Snap B rather than (again) copied. This
is indicated by the dashed arrow.
•In State 3, 2 GiB of data have been
added to the volume, for a total of 12
GiB. Snap C needs to copy the 2 GiB
that were added after Snap B was taken.
As shown by the dashed arrows, Snap C
also references 4 GiB of data stored in
Snap B, and 6 GiB of data stored in
Snap A.
•The total storage required for the three
snapshots is 16 GiB.
Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 43
 Instance Storage vs EBS
Storage

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 44
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 45
SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 46
 Amazon Glacier

https://aws.amazon.com/glacier/

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 47
 Amazon Dynamo DB

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 50
 Amazon Dynamo DB

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 51
 Amazon Dynamo DB

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 52
 Amazon Cloud Front

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 53
 How CloudFront delivers
Content?

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 54
 How CloudFront delivers
Content?

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 55
 How CloudFront delivers
Content?

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 56
 Bibliography
• Jayaswal K., Kallakurchi J., Houde D. J., and Shah D.
Cloud Computing Black Book. DreamTech Press; 2014.
• Dan C. Marinescu, Cloud Computing Theory and
Practice. Elsevier; 2013.
• Internet Resources.
• Recorded Lectures.

SS ZG527 AWS Storage and DB Services Dr. S. Panda, CSIS, BITS Pilani, Hyderabad Campus 57