Lisa

Crispin
With material from Janet Gregory

Copyright 2020
 New!

With Janet Gregory

“Agile Testing for the Whole Team”
also available as a remote course
AgileTestingFellow.com

Quality Owner at OutSystems,

Observability team
TestAutomationU.com
lisa@agiletester.ca
 Use visual models to Use a whole-team
guide conversations approach to build an
about continuous effective test strategy
testing

@lisacrispin
 Dan Ashby, “Continuous Testing in DevOps”,
https://danashby.co.uk/2016/10/19/continuous-testing-in-devops/
@lisacrispin 4
 Programmer Ops
Specialist

Business Tester
Analyst
Designer
?????

@lisacrispin 5
@lisacrispin 6
 Deploy
Discover Brainstorm Test in production
Test ideas
Release
Plan
Code “Shift left” “Shift right”
Monitor
Formulate
Observe
Build
Learn
Integrate Analyze

@lisacrispin 7
@lisacrispin 8
• Small misunderstandings lead to big problems
• Product, BAs, programmers, testers, data experts, ops,
support – all need to be on the same page!

@lisacrispin 9
@lisacrispin 10
Guide
conversations
with visual
models

@lisacrispin 11
 functional

nonfunctional
Source: Discover To Deliver, Gottesdiener & Gorman, 2012
www.DiscoverToDeliver.com/visual-language.php

@lisacrispin 12
@lisacrispin 13
 Tests more
of the app

Slower tests the

team loves

Fast tests Testable

devs love Prod Code

Models are thinking tools! 14

@lisacrispin
 Katrina Clokie’s Band Pass
Filter model from A
Practical Guide to Testing in
DevOps

Mike Cohn’s Test

Automation Pyramid Seb Rose’s test automation
iceberg (above) and
triangle (left)

@lisacrispin 15
@lisacrispin 16
Faster feedback

More confidence
https://github.com/ahunsberger/TestSuiteDesign - Ashley Hunsberger

18
Unknown unknowns
• Customers behave in unexpected ways
• Infrastructure components may fail What do
we do?
• External systems can impact ours
•…

@lisacrispin 19
• Ask the questions you didn’t know you’d need to ask –
without shipping new code
• Complex systems fail in complex ways
• With enough information, we can respond quickly

Cindy Sridharan,
https://medium.com/@c
opyconstruct/testing-in-
production-the-safe-way-
18ca102d0ef1

@lisacrispin 20
• DevOps culture – “you build it, you run it”
• New generation automation tools
• New ways to collaborate

Photo by Matilda
Wormwood from Pexels

@lisacrispin 21
 Get everyone engaged
• Commit to a level of quality
o Identifying what’s valuable to
customers
o Bug prevention over bug detection
o Fast response to prod issues
• Diverse perspectives, skill sets, biases
• Competencies > roles

@lisacrispin
 Build a quality culture

• Trust and psychological safety

• Focus on quality, not speed
• Build quality in

@lisacrispin
• https://agiletester.ca, https://lisacrispin.com
• My 3-part series on modeling your automation strategy:
https://testguild.com/modeling-automation-1/
• Hendrickson, Elisabeth, Explore It! Reduce Risk and Increase
Confidence with Exploratory Testing, Pragmatic Programmer, 2013
• Agile Testing Condensed, A Brief Introduction, LeanPub and
Amazon
• Agile Testing and More Agile Testing, Amazon
• “The Whole Team Approach to Continuous Testing”, Lisi Hocke,
TestAutomationU.com (free!)
24
@lisacrispin
Questions? Comments?

@lisacrispin