Professional Documents
Culture Documents
Service Drill-Downs
Leo Zhadanovsky | Senior Solutions Architect
UTILITY COMPUTING
}
Compute
Scaling
ON DEMAND Security
CDN Backup
DNS Database
UNIFORM
Storage Load Balancing
PAY AS YOU GO Workflow Monitoring
AVAILABLE Networking
Messaging
ELASTIC CAPACITY
Traditional IT
Capacity
Time
Your IT needs
On and Off Fast Growth
WASTE
CUSTOMER DISSATISFACTION
On and Off Fast Growth
WITH AWS
Demand
Elastic capacity
Time
An example that is close to home…
November traffic to Amazon.com
November
November traffic to Amazon.com
Provisioned capacity
November
November traffic to Amazon.com
76%
Provisioned capacity
November
24%
November 10th 2010
Turned off last physical web server of
Amazon.com
November traffic to Amazon.com
November
Each day AWS adds the equivalent server
capacity to power Amazon when it was a
global, $7B enterprise
Gartner Magic Quadrant for Cloud Infrastructure as a Service
Gartner “Magic Quadrant for Cloud Infrastructure as a Service,” Lydia Leong, Douglas Toombs, Bob Gill, Gregor Petri, Tiny Haynes, August 19, 2013. This Magic Quadrant graphic was published by Gartner, Inc. as part of a larger research note and should be evaluated in the
context of the entire report.. The Gartner report is available upon request from Steven Armstrong (asteven@amazon.com). Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only
those vendors with the highest ratings. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including
any warranties of merchantability or fitness for a particular purpose.
SECURITY IS A SHARED
RESPONSIBLITY
Customer Data
Customer
• Customers implement their
Platform, Applications, Identity & Access Management own set of controls
• Multiple customers with
FISMA Low and Moderate
Operating System, Network & Firewall Configuration ATOs
Client-side Data Encryption & Data Server-side Encryption Network Traffic Protection
Integrity Authentication (File System and/or Data) (Encryption/Integrity/Identity)
Foundation Services
• SAS-70 Type II
Amazon
Security Infrastructure
Security Infrastructure
Certifications and accreditations for AWS CloudTrail - AWS API call logging for
workloads that matter governance & compliance
Your Applications
Management & Administration
Identity & Access Deployment & Automation
AWS IAM Web Interface Monitoring AWS Elastic Beanstalk
Identity Federation Management Console Amazon CloudWatch
AWS CloudFormation
Consolidated Billing
Foundation Services
Storage Database Networking
Compute Amazon RDS Amazon VPC
Amazon S3
Amazon EC2 Amazon SimpleDB Elastic Load Balancing
Amazon EBS
Auto Scale Amazon ElastiCache Amazon Route 53
Amazon StorageGateway
Amazon DynamoDB AWS Direct Connect
Availability Zones
AWS Global Infrastructure Edge Locations
Regions
AWS Platform
Your Applications
Management & Administration
Identity & Access Deployment & Automation
AWS IAM Web Interface Monitoring AWS Elastic Beanstalk
Identity Federation Management Console Amazon CloudWatch
AWS CloudFormation
Consolidated Billing
Foundation Services
Storage Database Networking
Compute Amazon RDS Amazon VPC
Amazon S3
Amazon EC2 Amazon SimpleDB Elastic Load Balancing
Amazon EBS
Auto Scale Amazon ElastiCache Amazon Route 53
Amazon StorageGateway
Amazon DynamoDB AWS Direct Connect
Availability Zones
AWS Global Infrastructure Edge Locations
Regions
AWS Global Infrastructure
X
9 10 AWS Regions
X 51 AWS Edge Locations
42
AWS Regions & Availability Zones
Availability Availability
Zone A Zone B Availability Availability
Zone A Zone B
Availability Availability Availability Availability
Zone A Zone B Zone A Zone B
Availability Availability
Zone C Zone D Availability
Zone C
US West (OR) GovCloud (OR) EU (Ireland) South America (Sao Paulo) Asia Pacific (Sydney)
Availability Availability
Zone C Zone C
Your Applications
Management & Administration
Identity & Access Deployment & Automation
AWS IAM Web Interface Monitoring AWS Elastic Beanstalk
Identity Federation Management Console Amazon CloudWatch
AWS CloudFormation
Consolidated Billing
Foundation Services
Storage Database Networking
Compute Amazon RDS Amazon VPC
Amazon S3
Amazon EC2 Amazon SimpleDB Elastic Load Balancing
Amazon EBS
Auto Scale Amazon ElastiCache Amazon Route 53
Amazon StorageGateway
Amazon DynamoDB AWS Direct Connect
Availability Zones
AWS Global Infrastructure Edge Locations
Regions
Compute
Auto Scaling
Compute
128 o ry
em
64 g hM
Hi
e
ut
32 o m /O
p
C I
te r i g h
Memory (GB)
16 u s
Cl & H
rd PU
8 a nd
a
h C
St Hi
g
4
2 o
i cr
M
1
1 2 4 8 16 32 64 128
EC2 Compute Units (HP)
Compute
Auto Scaling
• Client Defined Business Rules
• Scale your Amazon EC2 capacity automatically once you define the conditions (may be 1000’s of
servers)
• Can scale up just a little…doesn’t need to be massive number of servers (may be simply 2 servers)
• Well suited for applications that experience variability in usage
• Set minimum and maximum scaling policies
• Can be used for high availability
Compute
Auto Scaling
Auto Scaling
S3
Storage Gateway
EBS
G Glacier
Storage
1.3 Trillion
262 Billion
102 Billion
2.9 Billion 14 Billion 40 Billion
Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q4 2011 Nov 2012 Apr 2013
Storage
AWS Glacier
• Your choice of programming language (Java, PHP, Python, Ruby, .NET) and mobile platform
(Android, iOS)
• The Developer Centers contains sample code, documentation, tools, and additional resources to help
you build applications on Amazon Web Services.
• http://aws.amazon.com/java/
• http://aws.amazon.com/mobile/
• http://aws.amazon.com/php/
• http://aws.amazon.com/python/
• http://aws.amazon.com/ruby/
• http://aws.amazon.com/net/
• New! Universal CLI based on Python!
Application Platform Services
Your Applications
Management & Administration
Identity & Access Deployment & Automation
AWS IAM Web Interface Monitoring AWS Elastic Beanstalk
Identity Federation Management Console Amazon CloudWatch
AWS CloudFormation
Consolidated Billing
Foundation Services
Storage Database Networking
Compute Amazon RDS Amazon VPC
Amazon S3
Amazon EC2 Amazon SimpleDB Elastic Load Balancing
Amazon EBS
Auto Scale Amazon ElastiCache Amazon Route 53
Amazon StorageGateway
Amazon DynamoDB AWS Direct Connect
Availability Zones
AWS Global Infrastructure Edge Locations
Regions
Database
DynamoDB ElastiCache
Redshift
Database
DynamoDB
• Fully managed NoSQL database.
• Eliminates the administrative burden of data modeling, index maintenance, and performance tuning.
• Durability and high-availability - stores data on Solid State Drives (SSDs) and replicates it
synchronously across multiple AWS Availability Zones in an AWS Region.
• Scalability - With AWS Console, you can grow your DynamoDB table from 10 to 100,000 writes
per sec.
• See video: http://www.youtube.com/watch?v=oz-7wJJ9HZ0
Database
Amazon ElastiCache
• Fully-managed, distributed, in-memory cache
• Memcached or Redis compliant cache cluster on-demand
• Manages patching, cache node failure detection and recovery
• Simple APIs calls to grow and shrink the cache cluster
• Seamlessly caches in front of SimpleDB or RDS instances
• Integrated with CloudWatch and SNS for monitoring and alerts
Database
Amazon SimpleDB
• Core database functions of data indexing and querying of text data
• No schema, automatic indexing
• Eliminates the administrative burden of data modeling, index maintenance, and performance tuning
• Real-time lookup and simple querying of structured data
• Use cases:
• Metadata storage -- often used in conjunction with S3
• Structured, fine-grained data needing query
• Data needing flexible schema
Database
Amazon Redshift
• Fully managed scalable data warehousing service
• Scale from a single 2TB XL node to a hundred 16TB 8XL clustered nodes for a total 1.6PB of
compressed user data
• Standard PostgreSQL JDBC or ODBC drivers
• Massively parallel processing (MPP) architecture
• Certified by Jaspersoft and MicroStrategy, with additional business intelligence tools coming
soon
• Priced as low as $1000 per terabyte per year
• Continuously backed up to S3
Content Delivery
Amazon CloudFront
• Web service for content delivery
• Distribute content to end users with low latency, high data transfer speeds, and no commitments
• Delivers your content using a global network of 50+ edge locations
• Supports download, streaming, live streaming, and dynamic content
• Key features: RTMP Streaming, HTTPS Delivery, Private Content for HTTP &
Streaming, Programmatic Invalidation, Detailed Logs for HTTP & Streaming, Default
Root Object
• Use Cases: Video and Rich Media, Online Gaming, Interactive Agencies, Software Downloads, Static
Websites
• Static web content that must be delivered to global user base at Highest bandwidth /
Lowest latency / Lowest cost
Application Services
SNS
SWF
SQS
CloudSearch
SES
Application Services
Processing results
Amazon SQS
Processing
task/processing
trigger
Application Services
2
Task A
Task B 3
(Auto-scaling)
Task C
Application Services
Amazon CloudSearch
• Fully-managed search service
• Integrate fast and highly scalable search functionality into applications
• Scales automatically: with increases in searchable data or as query rate changes
• AWS manages hardware provisioning, data partitioning, and software patches
Document
Server
Search
Server
Results
Parallel Processing
Amazon Route 53
• Route end users to Internet applications
• Answers DNS queries with low latency by using a global network of DNS servers
• Latency based routing to closest AWS endpoint (e.g. EC2 instances, Elastic IPs or ELBs)
• Integration with other AWS services (e.g., ELB)
Networking
Internet
EC2
Customer 1
EC2 EC2 EC2
EC2
Customer 2
EC2
EC2
10.1.2.3
EC2 10.27.45.16
10.27.45.16
AZ A AZ B
Customer 3
Internet
Internet GW
SN 10.0.1.0/24 SN 10.0.2.0/24
VPC 10.0.0.0/16
AZ A AZ B
Your Applications
Management & Administration
Identity & Access Deployment & Automation
AWS IAM Web Interface Monitoring AWS Elastic Beanstalk
Identity Federation Management Console Amazon CloudWatch
AWS CloudFormation
Consolidated Billing
Foundation Services
Storage Database Networking
Compute Amazon RDS Amazon VPC
Amazon S3
Amazon EC2 Amazon SimpleDB Elastic Load Balancing
Amazon EBS
Auto Scale Amazon ElastiCache Amazon Route 53
Amazon StorageGateway
Amazon DynamoDB AWS Direct Connect
Availability Zones
AWS Global Infrastructure Edge Locations
Regions
Deployment and Management
AWS CloudFormation
• Create templates of stack of resources
• Deploy stack from template with runtime parameters
• Templates are simple JSON formatted text files
• CloudFormer supports generating templates from running environments
"Resources" : {
"Ec2Instance" : {
"Type" : "AWS::EC2::Instance",
"Properties" : {
"SecurityGroups" : [ { "Ref" : "InstanceSecurityGroup" } ],
"ImageId" : { "Fn::FindInMap" : [ "RegionMap", { "Ref" : "AWS::Region" }, "AMI" ]},
"Tags" : [{
"Key" : "MyTag",
"Value" : "TagValue"
}]
}
},
Deployment and Management
AWS OpsWorks
• Model the layers of your applications into stacks
• Use Chef recipes and cookbooks
• Prebuilt templates for PHP, Ruby, Java, Node.js
• Granular security control
Data Pipeline
Amazon CloudWatch
• Visibility into resource utilization, operational performance, and overall demand patterns
• Metrics such as CPU utilization, disk reads and writes, and network traffic
• Accessible via the AWS Management Console, web service APIs or Command Line Tools
• Add custom metrics of your own
• Alarms (which tie into auto-scaling, SNS, SQS, etc.)
• Billing Alerts to help manage charges on AWS bill
Your Applications
Your Applications
Management & Administration
Identity & Access Deployment & Automation
AWS IAM Web Interface Monitoring AWS Elastic Beanstalk
Identity Federation Management Console Amazon CloudWatch
AWS CloudFormation
Consolidated Billing
Foundation Services
Storage Database Networking
Compute Amazon RDS Amazon VPC
Amazon S3
Amazon EC2 Amazon SimpleDB Elastic Load Balancing
Amazon EBS
Auto Scale Amazon ElastiCache Amazon Route 53
Amazon StorageGateway
Amazon DynamoDB AWS Direct Connect
Availability Zones
AWS Global Infrastructure Edge Locations
Regions
Putting Foundation Services
Together
deployment model:
availability
1. Use multiple
availability zones
2. Use RDS with replicas
and standby
3. Use auto-scaling
groups
4. Use Elastic Load
Balancing
5. Use Route53 to host
DNS zones
Three Services: Better Together
s
etrication
MUtiliz
Lat
en
cy
CloudWatch
Auto Scaling
Elastic Load Balancer
Architect to use cloud strengths
Use at regional level Leverage SLA Scale databases without Dynamically scale resources &
Combined with autoscaling will Improve application reliability with admin overhead control costs
balance requests and resource Route 53’s SLA on requests served Choose instance size for databases Only provision the resources that
capacity across availability zones and scale up over time are required with scale up and cool
Weighted routing down policies that match demand
Within VPC Perform A/B analysis, and staged Add high availability from
Use to loadbalance between application roll-outs by moving a management console
application tiers within an portion of traffic to new Create master-slave configurations
availability zone infrastructure and read-replicas. AWS takes care of
the failover and recreation of a new
Instance migrations Control TTLs and updates slave in event of master DB loss
Easily move instances from dev Take absolute control of DNS
environments to test environments updates for more decisive system
by moving between ELBs updates
Lamborghini uses AWS for Dynamic Webapps
Average simulation
Javier Roldán time went from 23 hours
Director of Technical Innovation to 20 minutes
News International uses AWS for Cloud-First IT
Call Tool
Micro-targeting
“The AWS Cloud let us build
solutions for an Dashboard
environment that moves so
Donor Collection
rapidly that you can’t plan System
for it. It made a big Volunteer
Management
difference to the success of System
the campaign.”