You are on page 1of 34

Transforming Product Development

Thomas Blood
AWS Enterprise Strategist

© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
M o t i va to r s ?

Hitting roadblocks Best practices


trying to drive review
change

Development practices Reduce cost of failure


need a refresh and experimentation

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Modern product development toolkit

What we’ll cover:


Achieving organizational flow

How the cloud is changing product development

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
M e t h o d s a n d P r i n c i p l e s of
M o d e r n P ro d u c t D e v e l o p m e n t

Design Thinking Agile Teaming DevOps


Interface to customer The organizational glue Interface for getting
and feedback loop that keeps release cycle stuff built and released
moving continuously

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Design Thinking is just…

User
Centered USER
Design

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Practical Principles: Design Thinking

Bring the outside in 1. First gain empathy

Pinpoint the pain point 2. Then frame the problems

Radical ideas, real impact 3. Now you can ideate

Build to learn 4. Run simple, fast, frugal tests

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agile Teaming
Focus: respond quickly to feedback

SCRUM
Agile Principle Continuously groomed backlog
Learning over
No changes to work plan made during sprint
following a plan
Product increment: must be completed, integrated and tested

Each Agile framework has a way of bringing feedback into its workstream

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agile Teaming
Focus: respond quickly to feedback

KANBAN
Agile Principle Finish task and pull forward next work item
Learning over
Uses work-in-progress (WIP) limits and cycle-time to manage flow
following a plan of new development
Adapted from Toyota Production System

Each Agile framework has a way of bringing feedback into its workstream

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agile Teaming
Focus: respond quickly to feedback

XP – Extreme Programming
Agile Principle Emphasizes technical excellence as a way to remain agile
Learning over
Pair programming and code reviews are common methods
following a plan
Frequent checkpoints - Allows for constant feedback on customer
requirements

Each Agile framework has a way of bringing feedback into its workstream

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Practical Principles: Agile

Use release maps 1. Rip the Band-Aid off, but have mercy

Two pizza team model 2. Keeping it real…and small

Power of the demo 3. Show something every sprint

Find your agile center 4. Trap: Agile by the book

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DevOps
Focus: promote and enable fast feedback

DevOps Principles

Automate all things


All of these reduce cycle time and allow builders to focus
Eliminate handoffs
on product, quickly deploying and collecting feedback

Establish guardrails

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
P u t t i n g t h e P i e c e s To g e t h e r :
F i n d i n g O rg a n i z a t i o n a l F l o w

Design Thinking Agile Teaming DevOps

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
MVP
Minimum Viable Product: What is the smallest thing you can
test to prove the unproven parts of your idea

Start with value hypothesis and growth hypothesis


Run small experiments to see if there is both value and demand
Bias towards many small tests vs. larger, extended ones
Persevere or pivot early based on results

“One accurate measurement is worth more than a thousand expert opinions.”


-Admiral Grace Hopper
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Project, Product, or Business KPI?
Methods to manage your product/technology portfolio

PROJECT PRODUCT BUSINESS OBJECTIVE


Pre-defined requirements Continuous Development Maximize a strategic KPI
scope and schedule
Customer defines roadmap Types of KPIs: Minimize
Deliver what was planned waste, increase conversion
Measured by output &
Measured by output outcomes Measured by outcomes

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Project, Product, or Business KPI?

Project Team Product Team Objective Team

Scope Defined set of Ongoing creation / Business objective


requirements enhancement of product
Success Milestone adherence User satisfaction, KPI
marketing objectives
Timeframe Defined beginning and Ongoing Continuous evaluation
end of business case
Involvement Implement requirements Gather, implement Test, measure, repoeat
feedback
Tools Gantt Chart Roadmap Impact Map/Dashboards

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Typical Release Testing

Most Tests
Occur Late Concept Dev Deployment Production
Functional Monitor
In Process Acceptance Respond to
Performance Defects/Incidents
Security/
Compliance

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Continuous Testing

Concept Development
Hypothesis Functional
A/B Acceptance
MVP Performance
Always Security/Compliance

Be
Testing Production Deployment
Prod Testing Functional
Chaos Engineering Acceptance
User Testing Feedback Performance
Security/Compliance
Canary

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How Amazon Achieves Flow

Working Backwards Two Pizza Teams Microservices


From the customer Run what you build Speed and agility

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PR Write the Press Release: Think big and focus on the
customer need

Working backwards
from the customer Write the FAQ: customer and internal stakeholder

Define the user interaction and write the manual

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Most companies write the software, they
get it all working, and then they throw it
over the wall to the marketing department,
saying ‘here is what we built, go write the
press release.’ That process is the one
that’s actually backwards.”
Jeffrey P. Bezos
Founder and Chief Executive Officer
Amazon.com, Inc.
Amazon Achieves Speed and Agility with Two-Pizza Teams

Small, Own/run
decentralized what you
teams are nimble build

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monoliths: Slow and Rigid
Developers Monolithic Application Delivery Pipeline

Build Test Release

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
M i c ro s e r v i c e s : S p e e d a n d A g i l i t y
Developers Microservices Delivery Pipelines

Build Test Release

Build Test Release

Build Test Release

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
M i c ro s e r v i c e s P r i n c i p l e s

Single Purpose

API-based http://

Highly-
decoupled

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
I m pa c t of C l o u d o n
P ro d u c t D e v e l o p m e n t

Reducing Cost Rapid Adoption of Quickly Scaling


of Failure New Capabilities Winning Ideas

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Reducing Time-to-Market for New Ideas
Agero created the MileUp app and used crash prediction models to
speed up emergency response

Cloud enables quick testing of unproven concepts


Quick time to market: 8 weeks from conception to production
Continuous scale: seamlessly ramps up to peak traffic of 22K
Concurrent Requests
Reducing Cost of
Experimentation Event driven architecture maximizes resource efficiency

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Devote More Resources to Customer Value
Mapbox adds location services to any application with mapping,
navigation, and location search SDKs

Cloud reduces undifferentiated infrastructure focus


Productivity: Allowed developers to focus more on runtime
functionality and less on infrastructure management
Cleaner separation of logging, metrics and security infrastructure
Reducing Cost of from application code base
New Development Cost: Spot instances and containers cut EC2 cost in half

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud Native Architectures
Accelerates adoption and innovation of new capabilities

Rekognition use case: automated footage tagging


API access to advanced service capabilities
Built in three weeks
Index against 99,000 people
Rapid Adoption of
New Capabilities Saving 9,000 hours a year in labor

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Bad State Predictor Model
App Container
Failure Prediction • Indicates which containers
should be removed before
failure
Outcomes: • App and system logs used to
*Improved user experience train model
*95% reduction in on-call • Developed by cloud team
with no ML/DL experience

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
E n te r p r i s e s A re A c h i e v i n g M a s s i v e S c a l e
w i t h C l o u d N a t i v e A rc h i te c t u re s

processes 4,000 requests can handle spikes


per second of 80x normal traffic
reduced the time to
ingest and process data
for its analytics pipeline
by 97%
processes half a trillion triggers 1.2 billion
validations of stock Lambda requests
trades daily each month

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Develop New Ideas Without Limits
Concurrent vCPUs in U.S. East (Northern Virginia)
1.2M

200K

06:38 21:40

Natural Language Processing on 1.1 million concurrent vCPUs


using EC2 Spot instances

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
FPGA World Record Genome Analysis

Cloud enables the massive scaling of big ideas


Immediate access to programmable hardware-acceleration using
FPGAs at cloud scale
Utilized AWS Batch to provision and orchestrate compute jobs
across 1,000 Amazon EC2 F1 instances
Quickly Scaling
Winning Ideas Compute infrastructure cost to analyze genome reduced to
staggeringly low ~$3 per whole human genome

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Achieving Massive Scale Not Massive Cost
AWS Lambda serverless architecture enables the FICO Decision
Management Suite (DMS) to perform computations on machine
learning models quickly, cheaply, and efficiently

Serverless enables quick and agile product development


>95% decrease in overall deployment and operational costs
Scales up or down for variation in customer request volume
Migrating tasks to Lambda took only a few weeks
Quickly Scaling
Winning Ideas

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank You!

© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

You might also like