Devopsandaws 150924013128 Lva1 App6891 PDF

DevOps and AWS
Shiva Narayanaswamy
Solution Architect
DEPLOYMENTS AT AMAZON.COM
~11.6s ~1,079 ~10,000 ~30,000

Mean time between Max number of Mean number of hosts Max number of hosts
deployments deployments in a simultaneously simultaneously
(weekday) single hour receiving a receiving a
deployment deployment
Business Value of Frequent Deployments
75% 90% ~0.001%

Reduction in Reduction in Software
outages triggered outage minutes deployments
by software triggered by cause an
deployments software outage
since 2006 deployments
DevOps Culture
Innovation & Stability
Business
Build it faster Keep it stable
Development Operations
Continuous Innovation
Customer Business
Feedback Idea
Customer
Release Implementation
Testing
Deploying More Frequently Lowers Risk
Rare Release Events: Frequent Release Events:
“Waterfall Methodology” “Agile Methodology”
Change
Change
Time Time
Larger Effort Smaller Effort

“Increased Risk” “Minimized Risk”
Knowledge is power
Lots of Learning
Requirements Development
Test and QA Release
Gathering and Check In
Cycle Time
Minimal Learning
Some Learning
Change is inevitable
• Change is the root cause of most outages
• This leaves two approaches:

- Make it a big deal
- Small iterative non events

“Do painful things more
frequently, so you can
make it less painful…”
- Adrian Cockcroft, Architect, Netflix
Agile-er
Dev QA Ops
Waterfall
Analyze Design Build Test Deploy
Dev / QA Ops

Agile
Sprint Sprint Sprint
Deploy
A D B T A D B T A D B T
Dev/QA/Ops Dev/QA/Ops Dev/QA/Ops

Agile-er
Sprint Sprint Sprint

A D B T D A D B T D A D B T D
DevOps is a Re-Org!
- Adrian Cockcroft, Architect, Netflix
RE
Code
DevOps
W
a
Developer l IT Operations
l
– A philosophy? Cultural change? Paradigm shift ?
– Alignment of development and IT operations with better communication and
collaboration ?
– Improvement in software deployment ?
– Breaking down the barriers between development and IT operations ?
– Akin to Agile software development applied to infrastructure and IT
operations
– Set of tools and processes
– It’s all of the above!
Business and IT agility
Business Case Requirements Use Case Features Plan Go to market
Business
• Iterative development
Agile • Scrum, sprints, stories
Business
Development • Velocity Agility
Design Code Refactor Unit Test Bug Fix Deliver
Developers
(application)
• Continuous Integration IT
• Continuous Deployment
DevOps • IT Automation Agility
• Application Management
Provision Configure Orchestrate Deploy Report Monitor
IT Operations
Building Teams
• Encourage a fail fast, learn quick mindset

• Foster innovation and accountability
• Promote open and honest sharing of lessons
learned
• Build trust across organizational boundaries
- Include all the stakeholders
• Expect that it will be a work-in-progress

Amazon Leadership Principles
1. Customer Obsession 8. Bias for Action
2. Ownership 9. Frugality
3. Invent and Simplify 10. Learn and Be Curious
4. Are Right, A Lot 11. Earn Trust of Others
5. Hire and Develop the Best 12. Dive Deep
6. Insist on the Highest 13. Have Backbone;; Disagree
Standards and Commit
7. Think Big 14. Deliver Results
DevOps Technology
The DevOps Stack
Continuous Deployment
Communication
Delivery Pipelines
Agile
Deployment Automation
Continuous Automated Configuration

Integration Testing Management
DevOps Practices
• Infrastructure as code

• Application and Infrastructure version management
• Continuous Integration
• Test Automation
• Continuous Deployment
• Monitoring and logging
Sample Application Cycle
CloudFormation
Templates for Env
Repo
Generate
Package
Config Builder
Install
Create AMIs
Code Push
Config
Test Env
Tests
Version Deploy
CI Server Staging Env
Commit to Control Server
Git/master
Get /
Pull Prod Env
Dev
Code Distributed Builds
Run Tests in parallel
Continuous Integration
CloudFormation
Templates for Env
Repo
Generate
Package
Config Builder
Install
Create AMIs
Code Push
Config
Test Env
Tests
Version Deploy
Commit to Control Server
Get /
Git/master Prod Env
Dev Pull
Code Distributed Builds
Send Build Report to Dev

Stop everything if build failed
Continuous Integration
• Every developer check-in initiates a build

- Builds are fully automated
- Tests validate every check-in
• Instant feedback for developers

- The build must remain fast
• Minimizes the impact of broken builds

- Bugs don’t accumulate
• Drives the culture of small, frequent releases

Continuous Delivery/Deployment
CloudFormation
Templates for Env
Repo
Generate
Package
Config Builder
Install
Create AMIs
Code Push
Config
Test Env
Tests
Version Deploy
Commit to Control Get / Server
Git/master Pull Prod Env
Dev Code
Distributed Builds
Send Build Report to Dev

Stop everything if build failed
Continuous Deployment vs Delivery
Continuous Delivery
• Automated, repeatable process to push changes

• Hardens, de-risks the deployment process
• Immediate feedback from users
• Supports A/B testing or “We test customer
reactions to features in production”
• Gives us a breadth of data points across our
applications
Automated Testing
• Robust, automated testing drives confidence in

the entire process
• Testing is not viewed as a “phase” of a project
- Testing starts on day one
• View failures as successes

• Don’t overlook testing the infrastructure
- Are you ready for the Simian Army?
• Testing is everyone’s responsibility

Continuous Integration / Deployment & Automation
Application Deploy application

only
tar, war, zip
Write Build/ Package yum, rpm
Unit Test Deploy
App Compile Applicatio Dev Env
App Code App
Code Code n
Dev
Test Env
Version Control Artifact Repository
DR Env
CloudFormation
Write Validate Automate

Build Deploy
Infra Template Deployme
Infras
Prod Env
Code AMIs s nt
IT Ops
Infrastructure Deploy infrastructure AMI
only
DevOps Stack on AWS
Code Build Test Deploy Provision Monitor
AWS Elastic Beanstalk
AWS Opsworks
CodeCommit CodePipeline
AWS Elastic Container Service
CodeDeploy CloudFormation CloudWatch
28
CodeCommit
Secure, scalable, and managed Git source control Git objects
in Amazon S3
Git index
in Amazon
SSH or HTTPS
DynamoDB
git push CodeCommit Encryption key
in AWS KMS
• Data redundancy across Availability Zones
• Data-at-rest encryption
• Integrated with AWS Identity and Access Management
• No repo size limit
Same Git experience
$ git clone https://git-codecommit.us-east-1.amazonaws.com/v1/repos/aws-cli
Cloning into 'aws-cli'...
Receiving objects: 100% (16032/16032), 5.55 MiB | 1.25 MiB/s, done.
Resolving deltas: 100% (9900/9900), done.
Checking connectivity... done.
$ nano README.rst
$ git commit -am 'updated README'
[master 4fa0318] updated README
1 file changed, 1 insertion(+)
$ git push
Counting objects: 3, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (3/3), done.
Writing objects: 100% (3/3), 297 bytes | 0 bytes/s, done.
Total 3 (delta 2), reused 0 (delta 0)
remote:
To https://git-codecommit.us-east-1.amazonaws.com/v1/repos/aws-cli
4dacd6d..4fa0318 master -> master
CodePipeline
Continuous delivery and release automation, just like Amazon
Source Build Beta Gamma Production

1) Build 1) Deploy 1) Deploy 1) Deploy region1
2) Unit test 2) UI test 2) Load test 2) Deploy region2
3) Deploy region3
• Customizable workflow engine

• Integrate with partner and custom systems
• Visual editor and status
CodePipeline : Mockup
CodeDeploy
Coordinate automated deployments, just like Amazon
Application Deployment groups

revisions
Dev
v1, v2, v3 CodeDeploy
Staging Production
• Scale from 1 instance to thousands

• Deploy without downtime
• Centralize deployment control and monitoring
Step 1: Package your application (with an AppSpec
file)
version: 0.0
os: linux
files:
- source: chef/
destination: /etc/chef/codedeploy
- source: target/hello.war
destination: /var/lib/tomcat6/webapps
hooks:
ApplicationStop:
- location: deploy_hooks/stop-tomcat.sh
BeforeInstall:
- location: deploy_hooks/install-chef.sh
AfterInstall:
- location: deploy_hooks/librarian-install.sh
ApplicationStart:
- location: deploy_hooks/chef-solo.sh
ValidateService:
- location: deploy_hooks/verify_service.sh
file)
version: 0.0
os: linux
files:
- source: chef/
hooks:
ApplicationStop:
BeforeInstall:
AfterInstall:
ApplicationStart:
ValidateService:
file)
version: 0.0
os: linux
files:
- source: chef/
hooks:
ApplicationStop:
BeforeInstall:
AfterInstall:
ApplicationStart:
ValidateService:
Step 2: Set up your target environments
Deployment group Deployment group
Agent Agent Agent Agent Agent Agent
Staging
Group instances by: Agent Agent Agent
• Auto Scaling group Production

• Amazon EC2 tag
• On-premises tag
Step 3: Deploy!
AWS CLI & SDKs aws deploy create-deployment \
AWS Console --application-name MyApp \
CI / CD Partners --deployment-group-name TargetGroup \
GitHub --s3-location bucket=MyBucket,key=MyApp.zip
Deployment config – Choose speed
One-at-a-time v2 v1 v1 v1 v1 v1 v1 v1
Half-at-a-time v2 v2 v2 v2 v1 v1 v1 v1
All-at-once v2 v2 v2 v2 v2 v2 v2 v2
Rolling update – Deploy without downtime
Load Balancer
v1 v1 v1
Load Balancer
v2 v1 v1
Load Balancer
v2 v2 v1
Load Balancer
v2 v2 v2
Load Balancer
v2 v2 v2
Health Tracking – Catch deployment problems
Load Balancer
v2 v2 v2
Health tracking – Catch deployment problems
Load Balancer
v3 Stop v2 v2
Load Balancer
Rollback
v2 v2 v2
Load Balancer
v2 v2 v2
DevOps Stack on AWS
Code Build Test Deploy Provision Monitor
AWS Elastic Beanstalk
AWS Opsworks
CodeCommit CodePipeline
CodeDeploy CloudFormation CloudWatch
49
Automate with AWS CLI
Automate with AWS SDK
AWS Cloudformation
§ Infrastructure as Code

§ Integrates with version control
§ JSON format
§ Templates
§ Stacks
AWS CloudFormation § Supports most AWS resource types
AWS Cloudformation
{
"Description" : "Create an EC2 instance running the Amazon Linux 32 bit AMI.”,
"Parameters" : {
"KeyPair" : {
"Description" : "The EC2 Key Pair to allow SSH access to the instance",
"Type" : "String"
}
},
"Resources" : {
"Ec2Instance" : {
"Type" : "AWS::EC2::Instance",
"Properties" : {
"KeyName" : { "Ref" : "KeyPair" },
"ImageId" : "ami-75g0061f”,
“InstanceType” : “m1.medium”
}
}
},
"Outputs" : {
"InstanceId" : {
"Description" : "The InstanceId of the newly created EC2 instance",
"Value" : { "Ref" : "Ec2Instance” }
}
}
}
AWS Cloudformation
Use the version
control system of
your choice to store
Build out multiple
and track changes to
environments, such
Dev this template
as for Development, Git
Test, and Production Test Subversion
using the template Mercurial
Prod
Template File
Defining Stack
The entire application can be

represented in an AWS
CloudFormation template.
Describing Infrastructure with Code
This entire infrastructure stack can be constructed, configured, and deployed with code:
Amazon S 3 Amazon
Amazon
Route 5 3
CloudFront
Dev MySQL DEV APP DEV WEB
ELB ELB Dev Admin
DB Instance Dev Stack Dev Stack
Instance
Tier 2 Tier 1 Amazon
DynamoDB
Dev Environment VPC Subnet
VPN
VPN Internet TUNNEL Developers
Endpoint Gateway
&
Pre-commit Operations
Hook Internal
CI Workers CI Server
Git NAT Instance Amazon S QS
Testing Environment Subnet VPN facing VPC Subnet
Infrastructure Code
The code that describes infrastructure should inherit

the same values applied to application code
– Not JUST revision control
– Make use of bug tracking/ticketing systems
– Peer reviews of changes before they happen
– Establish infrastructure code patterns/designs
– Test infrastructure changes like code changes
AWS Opsworks
• AWS OpsWorks makes it easy to deploy

& operate apps of all shapes and sizes
• Define configurations for your

entire environment in a format that
you can maintain and version
just like your application source code
• Uses the Chef framework so you can

bring your own recipes or leverage
100’s of community-built configurations
AWS Beanstalk
• Quickly deploy and manage applications

in the AWS cloud without worrying about
the application infrastructure
• Automatically handles all

the details of resource provisioning,
load balancing & auto-scaling
• Launch your Java, PHP, .NET, Node.js,

Python, Ruby and Docker applications
in a matter of minutes
Launching
containers is in
the order of
seconds – very
WWW containers Application-specific microservices fast to react
WWW WWW WWW WWW WWW WWW Logging Pay Process Process Process Process
server server server server server server Service Service Service Service Service Service
Scale out
at the
container
level
Cluster of underlying

EC2 instances
What are we deploying? How much control do we want?
AWS Tools 3rd-Party Tools
• CloudFormation • Chef
• Elastic Beanstalk • Puppet
• OpsWorks
Deployment Approaches
• Deploy in place

– Deploy all at once (Service outage)
– Rolling updates
• Blue-Green Deployment
– Discrete environment
• Multiple environments from branches
• Support A/B testing
• “Rolling DNS”
• Alternate Blue-Green (Red-Black?) deployment
• Alternate auto scaling group
• Avoid messing with DNS
Deploy in place – Rolling update
ELB
ALMA Service Icons

EC2
Simple Deploy System
CodeDeploy S3
Pipelines
Pipelines
ALMA Service Icons
Pipelines
Pipelines
ALMA Service Icons
Pipelines
Pipelines
ALMA Service Icons
Pipelines
Pipelines
ALMA Service Icons
Pipelines
Pipelines
ALMA Service Icons
Pipelines
Pipelines
Pipelines
Blue-Green Deployment
Amazon
Route 53
100%
ELB
EC2
Instances
MySQL RDS ElastiCache

DynamoDB Instance Cache Node
Amazon
Route 53 UAT
100%
EL EL
B B
EC2 EC2
Instances Instances
MySQL RDS ElastiCache

DynamoDB Instance Cache Node
Amazon
Route 53
90% 10%
EL EL
B B
EC2 EC2
Instances Instances
DynamoDB MySQL ElastiCach

RDS e Cache
Instance Node
Amazon
Route 53
50% 50%
ELB ELB
EC2 EC2
Instances Instances
MySQL ElastiCache
DynamoDB
RDS Cache
Instance Node
Amazon
Route 53
0% 100%
ELB ELB
EC2 EC2
Instances Instances
MySQL ElastiCache
DynamoDB
RDS Cache Node
Instance
Amazon
Route 53
0% 100%
EL ELB
B
EC2 EC2
Instances Instances
MySQL ElastiCache
DynamoDB
RDS Cache
Instance Node
Red-Black Deployment
ELB
Auto
Scaling
Group
V1
Amazon
Relational
Database
Service (RDS)
ELB
UAT
Auto Auto Scaling

Scaling Group
Group V2
V1
Amazon
Relational
Database
Service (RDS)
ALM | Red-Black Deployment
ELB
Auto Auto Scaling

Scaling Group
Group V2
V1
Amazon
Relational
Database
Service (RDS)
ELB
Auto Scaling
Group
V2
Amazon
Relational
Database
Service (RDS)
Monitoring & Metrics : The DevOps Pulse
• Track every resource possible

• Alert on services, availability, and response times
• Capture, learn, and improve
• Share access with everyone on the team
• Plan metrics and monitoring into the lifecycle
Where do I go from here?
• Collect Metrics. Graph anything that moves

• Log everything, Centralize logging, Log
Analytics
• Infrastructure as Code
• Automated configuration management
• One click environment creation
• CI-CD pipelines
• Automated testing

Devopsandaws 150924013128 Lva1 App6891 PDF

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Devopsandaws 150924013128 Lva1 App6891 PDF

Uploaded by

Copyright:

Available Formats

DevOps and AWS

~11.6s ~1,079 ~10,000 ~30,000

75% 90% ~0.001%

Build it faster Keep it stable

Larger Effort Smaller Effort

Lots of Learning

• Change is the root cause of most outages

• This leaves two approaches:

-­ Small iterative non events

Analyze Design Build Test Deploy

Dev / QA Ops

Dev/QA/Ops Dev/QA/Ops Dev/QA/Ops

Sprint Sprint Sprint

Business Case Requirements Use Case Features Plan Go to market

Provision Configure Orchestrate Deploy Report Monitor

• Encourage a fail fast, learn quick mindset

• Expect that it will be a work-­in-­progress

Continuous Automated Configuration

• Infrastructure as code

Send Build Report to Dev

• Every developer check-­in initiates a build

• Instant feedback for developers

• Minimizes the impact of broken builds

• Drives the culture of small, frequent releases

Send Build Report to Dev

• Automated, repeatable process to push changes

• Robust, automated testing drives confidence in

• View failures as successes

• Testing is everyone’s responsibility

Application Deploy application

Write Validate Automate

Code Build Test Deploy Provision Monitor

AWS Elastic Beanstalk

CodeDeploy CloudFormation CloudWatch

Source Build Beta Gamma Production

• Customizable workflow engine

Application Deployment groups

• Scale from 1 instance to thousands

Agent Agent Agent Agent Agent Agent

Group instances by: Agent Agent Agent

• Auto Scaling group Production

Code Build Test Deploy Provision Monitor

AWS Elastic Beanstalk

CodeDeploy CloudFormation CloudWatch

§ Infrastructure as Code

The entire application can be

The code that describes infrastructure should inherit

• AWS OpsWorks makes it easy to deploy

• Define configurations for your

• Uses the Chef framework so you can

• Quickly deploy and manage applications

• Automatically handles all

• Launch your Java, PHP, .NET, Node.js,

Cluster of underlying

• Deploy in place

ALMA Service Icons

Simple Deploy System

Simple Deploy System

ALMA Service Icons

Simple Deploy System

Simple Deploy System

Simple Deploy System

ALMA Service Icons

- Small iterative non events

• Expect that it will be a work-in-progress

• Every developer check-in initiates a build