Testing Tools using

Visual Studio
Randy Pagels
Sr. Developer Technology Specialist
Microsoft Corporation
Application lifecycle management
Pla REQUIREMENTS Monitor + Learn
n
BACKLOG

Development Production
Collaboration

Develop + Test Release

Agenda
• Web Performance Testing
• Load Testing
• Unit Testing
• Manual Testing
• Exploratory Testing
• Coded UI Testing
• Lab Management
Microsoft Testing Tools
Test Manager
Manual Testing Tools
• Test Plan Management
• Test Case Management
• Shared Steps Management
• Exploratory Testing
• Test Configuration Management • Ordered Tests
• Test Fast Forwarding
• Test Data Collection
• Test Lab Management
Visual Studio
Automated Testing Tools
• Coded UI Tests
• Web Performance Tests
• Load Tests
• Generic Tests
• Developer Unit Tests
• Database Unit Tests
Developer Focused Unit Test Experience
Red-Green
Search
Bar

Most
New Test Runner important
• Tests run in background tests shown
• Run automatically on build first
• Support for multiple unit testing
frameworks:
 MS Test, xUnit, nUnit ,and Timings
more!
• Deep integration in the IDE
• Supports native C++ code Shows tests
• Multiple run options from any
 Faile, not-run, and all tests framework
• Easy code coverage access Run Details
Unit Testing with Code Coverage
• Determine what
proportion of your
project's code is actually
being tested. Guard
effectively against bugs
by exercising a large
proportion of your code.
Code coverage analysis
can be applied to both
managed (CLI) and
unmanaged (native) code.
Manual Testing
• Manual testing is the process of
manually testing software for
defects. Microsoft Test Manager
allows you to work with test plans,
author and organize manual test
cases, execute test cases, file bugs,
and post results back to Team
Foundation Server.
Exploratory Testing
• Exploratory testing is the
testing of an application
without a set of tests defined in
advance. During an exploratory
test session, you are not
restricted to a script or a set of
predetermined steps. Some
improvements have been made
to the exploratory testing in
Microsoft Test Manager.
Coded UI Testing
• Coded UI tests provide a way to
create fully automated tests to
validate the functionality and
behavior of your application’s user
interface. You can create coded UI
tests directly from existing action
recordings. Action recordings
contain the steps taken during
manual testing of an application.
Web Performance Testing
• Any new Web performance and
load testing efforts you create in
Visual Studio are now created in a
Web performance and load test
project type instead of a test
project. A Web performance test
consists of a series of HTTP
requests. Web performance tests
work at the protocol layer by
issuing HTTP requests.
Load Testing
• Load tests consist of a series of Web
performance tests or unit tests
which operate under multiple
simulated users over a period of
time. Load tests can also include
automated coded UI tests. Coded
UI tests should be included only
under specific circumstances. All the
scenarios that use coded UI tests in
load tests involve using the coded
UI tests as performance tests.
Load Testing in the cloud Cloud-based load
testing
 Use existing load tests
 No need to setup servers or
virtual machines
 Use Visual Studio Ultimate to
create "Web Performance and
Load Test" types
 Run and analyze your load test
 View Performance and
Throughput graphs
 View all your load test runs at
any time via explorer
 Download reports to view
performance counter data,
threshold violations, and error
information
 Get performance data from
Application Insights
Load Testing in the cloud
AI Integration
 View the performance
data from Application
Insights
 Application counters are
correlated with the user
load
 Understand what issues
may be causing any
performance problems
 Easily go to Application
Insights if you need to do
a more detailed analysis
Load Test Manager
View Load Test
Runs
 Use from Visual
Studio Ultimate.
 Lists all the test
run against the
service.
 Same look and
feel as web
access, but
hosted inside
Visual Studio.
Demo

Testing Tools using

Visual Studio
Work Item Charting
Reporting
 Enable a
spectrum
from very
simple
charting up to
very powerful
BI capabilities
Agile Tools Tagging
 REST APIs for tags
 Query on Tag
 Tags in Visual Studio
 Tag Permissions
 Exclude non-working days
 Cumulative Flow Start Dates
 Pinning of Work Item Charts
Test: Test Case Management & MSDN
Benefits Enhanced test
management
• Support for non-Windows operating
systems with enhanced web-based test
case management
• Create or manage Test Suites and Plans
using web interface

Flexible on-premises or
cloud dev and test
 MSDN subscriptions now including
dev/test support in the cloud.
Test Management
Test Export
 Export your test plan to HTML
 Choose the level of detail you want
Test Management Test Parameters
 Create sets of test data
 Reference by various test cases
 Easily bind to automated tests
User and Security Management
Permissions Reference
• default groups, permissions, and roles
• configure to control access to the resources
• restrict access in TFS with allow or deny
permissions
Permissions by Groups
Permissions by Individual
TFS Alerts Set alerts, get
notified when
changes occur
• Set alerts just for
yourself
• Set alerts for your team
Lab Management
• Testing a complex multi-tiered
application and creating different
configurations in a user-flow can
be challenging. Lab
Management provides teams a
powerful and flexible
development and test lab
environment to enable scalable
build-deploy-test workflow and
continuous integration through
environment templates.
 Testing Architecture

Team Foundation Server

Test Controller

Team Build
System Center Virtual Machine
Manager (SCVMM)

VM Template Library SCVMM Environment Standard Environment

VM Template 1 VM Template 2 Web Server Database Server

VM Host Web Server Database Server
VM VM

Test Agent Test Agent VMMAgent Test Agent Test Agent Test Agent Test Agent

M I C R O S O F T C O N F I D E N T I A L – I N T E R N A L O N LY
Build-Deploy-Test
(1) Get Source Code (2) Compile projects

Team Foundation Server Team Build

(8) Publish results to
Team Foundation Server

(3) Copy build to running

SCVMM Environment
environment
Test Controller
(7) Send test
results
(4) Run deployment scripts for
each machine
(6) Execute VM Host
Web Server Database Server
automated tests VM VM

VMMAgent Test Agent Test Agent (5) Create environment snapshot

M I C R O S O F T C O N F I D E N T I A L – I N T E R N A L O N LY
Related Content
http://msdn.microsoft.com/en-us/library/tfs/bb385901%28v=vs.110%29

http://msdn.microsoft.com/en-us/library/tfs/dd293547%28v=vs.110%29

http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/09/javascript-unit-tests-on-team-
foundation-service-with-chutzpah.aspx

http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/31/writing-a-visual-studio-2012-
unit-test-adapter.aspx

http://msdn.microsoft.com/en-us/library/tfs/ms182539%28v=vs.110%29.aspx

http://blogs.msdn.com/b/visualstudioalm/archive/2012/06/04/getting-started-with-load-
testing-in-visual-studio-2012.aspx
 Visit Team System Café Today!
The door is open 24/7 at the café! Stop by for a cup of joe and delicious tidbits on AppDev topics!

freshly brewed news blog’s downloads

blogroll evidence
documents
slides
training
links user lab
groups management
links

events most popular

in person items help & how too
webinars training
books
FAQs
azure & windows 8 FAQs
resource links TFS
ALM http://www.teamsystemcafe.net

M I C R O S O F T C O N F I D E N T I A L – I N T E R N A L O N LY
Resources
What's New for Application Lifecycle Management in Visual Studio 2012
http://bit.ly/baSMz5

What's new for Microsoft Test Manager 2012

http://bit.ly/wN2JrH

Quick Start Guide for Manual Testing using Microsoft Test Manager 2012
http://bit.ly/d4l9qN

Test Scribe for Visual Studio 2012

http://bit.ly/Nim0gH

What is new in Coded UI Tests 2012

http://bit.ly/zWIbVf

Platforms for Coded UI Tests and Action Recordings

http://bit.ly/b5m32u
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of
Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.