Tech Talk on

Service Virtualization
Hicham Jellab

DevOps Facilitator, CA Technologies

March 27th, 2018

What we’ll Cover
1 TESTING STILL A BARRIER TO VELOCITY

2 SERVICE VIRTUALIZATION

3 HOW SERVICE VIRTUALIZATION WORKS

4 BENEFITS / USE CASES

5 SERVICE VIRTUALIZATION AT SCOTIABANK

6 Q &A

© 2017 CA. Confidential. All rights reserved.

 We believe that

TODAY, EVERY
BUSINESS IS IN THE
SOFTWARE BUSINESS
and

EXPERIENCE GREAT DIGITAL

IS EVERYTHING EXPERIENCE IS
KEY TO WINNING AND
KEEPING CUSTOMERS

© 2017 CA. Confidential. All rights reserved.

 And

VELOCITY AND QUALITY ARE

CRITICAL TO GREAT EXPERIENCE
Automate continuous testing to

IMPROVE APPLICATION QUALITY

ACCELERATE TIME TO MARKET
REDUCE COST AND RISK

© 2017 CA. Confidential. All rights reserved.

Testing… Balancing Velocity and Quality
DevOps Adoption High, But Users Hit “Testing Wall”

79% 54%
Said that increasing Of the adoptees
the frequency of still
software releases is a
experience
priority to meet
business objectives* 73% a software testing
bottleneck *
Have adopted DevOps Process*

* eWeek Article, Research Conducted by Vanson Bourne in October 2016, survey of Enterprise IT decision makers

© 2017 CA. Confidential. All rights reserved.

5 © 2017 CA. ALL RIGHTS RESERVED.
Testing is STILL a Bottleneck…
Even in DevOps Shops
Where are the main hold-ups in the software production process?
A 2017 survey found that the
majority of delays were occurring at
the Test/QA stage of the cycle.
63%
32% 22% 23% 30%
16% 21%
Of self-proclaimed DevOps
Plan code Pre-test Build Test/QA Release Deploy Review/Improve
practitioners, 63% experience
delays in the Testing/QA area* What tends to suffer the most in a DevOps environment?
Speed
Speed
16%
Nothing
29 per cent of DevOps practitioners 42%
told us that quality was being Quality

sacrificed 29%
Security

Security
13%
Quality
http://www.computing.co.uk/digital_assets/634fe325-aa28-41d5-8676-855b06567fe2/CTG-DevOps-Review-2017.pdf

© 2017 CA. Confidential. All rights reserved.

Most Customers Cannot Do
Continuous Testing Today,
But They Aspire To Get There….

© 2017 CA. Confidential. All rights reserved.

 Testing Reality Testing Goal
TOOLSET TEST “Ice Cream Cone” TOOLSET TEST PYRAMID

UI Tools 5%
UI
UI
API Tools 45%
UI Tools 94% API

UI

API 3%
Dev Tools 50%
API Tools API Unit
Unit
Dev Tools Unit 3%

*Actual Customer Example of Their Testing Strategy

© 2017 CA. Confidential. All rights reserved.

 What’s holding up Testing?
Constraints/Bottlenecks across the SDLC

Over of teams experience

80% delays in development and
QA due to unavailable
Incomplete
Developm dependencies
ent
of critical dependencies
System
Constraints
Data
Constraints
Cost
Constraints
Development
Constraints
56% are unavailable when dev
and test teams need them

of teams face prohibitive

79% restrictions, time limits or
access fees on needed
3rd party services
Source: voke Market Snapshot TM Report: Service Virtualization
– January 2015
http://bit.ly/SV-ROI

© 2017 CA. Confidential. All rights reserved.

Legacy Tools Cause Testing Bottleneck

COMPLEXITY RESTRICTIVE
SCARCITY
LICENSING

Small number of experts

+
scarcity of infrastructure
=
Queue, Agile, Quality, Speed

© 2017 CA. Confidential. All rights reserved.

TESTING SHIFT LEFT (AND RIGHT)
SHIFT LEFT SHIFT RIGHT

CODE BUILD DELIVERY PRODUCTION

CONTINUOUS TESTING

© 2017 CA. Confidential. All rights reserved.

TESTING SHIFT LEFT (AND RIGHT)
SHIFT LEFT SHIFT RIGHT

CODE BUILD DELIVERY PRODUCTION

CONTINUOUS TESTING

© 2017 CA. Confidential. All rights reserved.

TESTING SHIFT LEFT (AND RIGHT)
SHIFT LEFT SHIFT RIGHT

CODE BUILD DELIVERY PRODUCTION

CONTINUOUS TESTING

© 2017 CA. Confidential. All rights reserved.

Service Virtualization: Why It’s Needed
System Data Cost Development
Constraints Constraints Constraints Constraints

Bottlenecks
Everywhere

“I can’t do anything
until I have everything ESB
…
and I never have
everything!”

© 2017 CA. Confidential. All rights reserved.

How Service Virtualization Eliminates
Unconstrained Dev. Wait Time
Dev/Test Constraints Development
Test Automation
Frameworks

Service
Service Order Management
Virtualization
Virtualization
ESB
Now I have
everything I need
when I need it
System of
Mainframe ERP SaaS/API
Record

Availability Sync Capacity Cost

© 2017 CA. Confidential. All rights reserved.

New Innovation Paradigm Accelerate Increase
“Shift-left” the SDLC Delivery Quality

Without SV Uncertain delivery schedule – defects persist until UAT

Dev Dev Dev Dev Dev Dev
1 2 1 3 2 3 System Integration Performance UAT…

Typical composite app today

waits for whole assembly to begin
With Service Virtualization quality
WITH SV effort moved earlier in the lifecycle
Dev1
Dev2
Dev3 Reduction in SDLC
Faster Delivery
System Test
Integration
Performance Test

UAT
© 2017 CA. Confidential. All rights reserved.
 Service Virtualization
Having Everything you need, when you need them.
Integration Testing
Front End Back End
 Remove constraints with virtual services
 Avoid manual repetitive development of stubs/mocks
 Simulate web services, Middleware, 3rd Party, APIs, or Secure
Internet of Things Mainframe Environments

Performance Testing
Mobile  Provide component level performance testing Applications
 Test negative performance conditions
 Shift performance testing left

ERP/SAP
SaaS/Cloud
Faster Time to Market
 Always available resources to continue work
Orchestration
Partner  No waiting for backend or 3rd party resources needed
Layer
 Speed Software Development Lifecycle by up to 50% Mainframe
Ecosystems

Better Quality
External  Test sooner and more often 3rd Party/APIs
Developers  Increase test coverage and negative testing capabilities
 Find up to 90% more defects at least one cycle earlier

© 2017 CA. Confidential. All rights reserved.

Integration Testing
Create test environments that exactly replicate production infrastructure.
Components Set-Up Test Systems
• Remove constraints with virtual services and
Environment
• Test components out of order Services
• Capture behavior data and performance characteristics
Virtual
of composite applications
Services
• Avoid manual repetitive development of stubs or
mockups
Test
• Mobile, Web, Middleware, Mainframe, 3rd Party Services Data
and API’s
Distributed Teams

Increase availability Cut overall

of testing platforms Enable Agile Save $2.5 million development cycle by
Testing Sprints in infrastructure
up to 90% 66%
KPN Telecommunications Forrester TEI Study November 2015 Nordstrom

AutoTrader STABILITY
• Cut integration time from three days to three hours “CA Service Virtualization gives
us a more stable and available
• Avoided $300,000 in test hardware and software costs
environment for Testing”
• Decreased software defects by 25 percent hours
© 2017 CA. Confidential. All rights reserved.
Performance Testing
Innovate Faster while Delivering a High Quality Experience BillMeLater
Current Testing
Tools PayPal
 Use the same tests used for functional test
 Virtual services for performance
 Engineering Thousands of
transactions TNT Express
 Simulate backend load
 Outlier conditions
Test Data 3rd Party Service
 Mobile experience
Application “X”

Establish IT as an
Reduce delays Eliminate
with high-performance 1 x 500 throughput capacity constraints for
Enabler of growth masking and sub-setting, and increase in testing performance testing
automated data discovery

Nordstrom SPEED
• Reduced performance testing time from 3 months to “CA Service Virtualization helps us bring better
an average of 4 days applications to market faster and establish our IT
• Cut overall development cycle by 66% function as an enabler of business growth”
© 2017 CA. Confidential. All rights reserved.
Service Virtualization vs Stubs and Mocks

© 2017 CA. Confidential. All rights reserved.

 Service Virtualization: How Does it Work?
“Any sufficiently advanced technology is indistinguishable from magic.”
- Arthur C. Clarke
CAPTURE PROCESS MODEL

Record traffic between existing
systems
Create from engineering specs
Draw from sources such as log
files, sample data, packet
capture, and CA APIM Gateway
Evaluate data and protocols
Convert into live-like model
“Make it easy” for developers
Consistent interface across
supported protocols
Living, breathing, “live” model
Sophisticated, contextual
behavior
Automatic handling for dynamic
properties

© 2017 CA. Confidential. All rights reserved.

Who Benefits from Service Virtualization
INTEGRATION PERFORMANCE
DEVELOPERS
TESTER TESTER

• Support TDD • Eliminate Wait Time • Reduce

• Enable Parallel • Minimize Test Data Infrastructure Costs
Development Setup • Eliminate
• Eliminate • Eliminate Test Data Environment
Mocking/Stubbing Burn Sharing
• Build True Release • Negative Test • Improved
Candidate Coverage Scalability
• Reproduce Production • Provide Stable Test • Reduce Transaction
Defects Environment Costs
• Minimize System
Availability Wait Time
© 2017 CA. Confidential. All rights reserved.
7 Common Service Virtualization Use Cases
Training Environments
Create complete and comprehensive
virtual training environments Negative Scenarios
Use SV to enable Negative
Scenario Testing
“Business In a Box”
Use SV for Integration constraints
Performance Constraints
Stress test applications components
3rd Party APIs using virtual services

Use SV to remove access and cost

constraints.
Time Constraints
Use SV to “Shift-Left” your SDLC,
Mainframe Constraints customers have shown 25%-50% faster
Eliminate mainframe constraints for both
distributed and mainframe development

© 2017 CA. Confidential. All rights reserved.

 Increased
Reduced testing Achieved cost
cost of 85% availability 90% savings of
40%
testing by by

http://bit.ly/184km3C http://bit.ly/1Cf80AN
http://cainc.to/xVYOXr

Real Companies, Real Results

$800K 2 Months
Saved from deferred Saved from development
investments & testing time
http://bit.ly/SV-Telus http://slidesha.re/1CRkeh9

© 2017 CA. Confidential. All rights reserved.

Service Virtualization at
ScotiaBank
Service Virtualization Recap
WHY Service Virtualization
 Service Virtualization removes
constraints by simulating constrained or
unavailable systems. Development
and test teams are able to work in a
constraint-free environments and
experience significant gains in
efficiency
 Service Virtualization creates an
accurate rendering of dependent
systems allowing developments team
to find and resolve defects earlier in the
SDLC, saving time and money.
© 2017 CA. Confidential. All rights reserved.
METRICS
 25-50% reduction in application development schedule
 60-90% more defects detected at least one step earlier
in the software development lifecycle
 Customers have saved millions of dollars,
in development and test lab hardware, software,
maintenance, and 3rd party access fees
TAKEAWAY
 Service Virtualization Improves
– Environment Availability
– Load and Performance Testing
– Data and Test Scenario Management
– Delivery Schedules
© 2017 CA. Confidential. All rights reserved.
Thank You.