Presenter s:

Manoj Panda, TCS , Bhubaneswar

Sakti Prasad Nayak, TCS , Bhubaneswar

January 15th , 2011

Silicon Institute of Technology, Bhubaneswar
Contents

-2-
Why Software Testing as a career ?
Market Scope

World-wide Software Forecast: India may garner 70% of market in

Software testing - Gartner Report

Domestic Software Market Check : While the market for software

services is growing at an average of about 10-12 percent, testing is growing
at more than 50 percent a year – Nasscom Report

Ample Scope for Research : Software testing still remains an art, due to
limited understanding of the principles of software. We are still using the
same testing techniques invented 20-30 years ago, some of which are
crafted methods or heuristics rather than good engineering methods.
Typically, more than 50% percent of the development time is spent in testing.
- Carnegie Mellon University

Analytical approach – Programming skills for Software Testing:

Knowledge of programming languages is required for unit testing, scripting
skill essential for Automation testing – Contrary to software myths
-3-
Contents

-4-
Types of Software Testing
Broadly can be classified into two following types:
System –side Testing & Application-side Testing (Functional & Non-Functional)
System-side Testing
• Types of Testing
• Unit Testing
• Software – software
integration testing
• Software – hardware
integration testing
• Performance Testing
• User Acceptance testing
• Real-time Systems domains
• Avionics
• Railway Signaling
• Aerospace
• Medical Instruments
• Embedded Testing domains
• Telecom
• Mobile Operating systems
• VLSI
Types of Software Testing
Application-side Testing
(Functional Testing)
• Types of Testing
• System Integration Testing
• Regression Testing
• Automation Testing
• User Acceptance testing
• Applicable Domains:
• Insurance
• Retail
• Manufacturing
• Healthcare
• Banking
• Financial & Capital Markets
Application-side Testing
(Non-Functional Testing)
• Types of Testing
• Performance Testing
• Usability Testing
• Security Testing
• Browser Compatibility
Testing
• Multi-lingual Testing
• Compliance Testing
• Data warehouse testing
-5-
Contents

-6-
System-side Software Testing
Part 1 Part 2 Part 3
100% Code
Coverage

Structural
Coverage
Input Decision Boolean
Testing the
Range Coverage Coverage Design

Testing Testing MCDC

White box
Testing
Works on
Hardware
What test rigs
How Execute

The dynamic Through use of • Unit testing (In

coverage of the White box testing isolation)
code is to be methods on • Software –
achieved using instrumented code Software testing
instrumented through use of •Software-
code tools or scripts Hardware
integration testing

Aim of System-side Testing Procedures for System-side Testing Output of System-side testing

7
System-side Software Testing
Applicable Industries , domains & sub-systems
Safety Critical Systems : Avionics
Sub-systems:
Fuel Quantity Indication Systems
Engine Control Systems
Multi-display Pilot Systems
Flight entertainment systems
Landing Gear Systems
Example : Airbus A380 Super Jumbo

Applicable Industries , domains & sub-systems

Safety Critical Systems : Railway Signaling

Sub-systems:
Automatic Train Operation
Automatic Train Protection
Track-side equipment systems
On-board equipment systems
Platform Control Systems
Example : Delhi Metro (Bombardier Rolling Stock)

-8-
Contents

-9-
Application-side software Testing
Aspects of Application-side Testing

• Functional Testing:
Complete or optimized
• Creation and execution of test cases /scenarios based on functionality
coverage of application
detailed in Software Design or Software Requirements
functionalities
• Regression testing and Automation testing also covered

• Non-functional Testing: The application needs to

• Tests created based on non-functional aspects of applications like adhere to the defined
application usability, performance, accessibility , compatibility with several project requirements or
browsers, multi-lingual languages support or database migration industry standards
• Testing techniques:
• Risk Based Testing Formal methods lead to
• Equivalence Class Partitioning comprehensive testing
• Boundary Value Analysis

Applicable Industries , Domains and Applications

• Domain : Insurance Segregate the Types of
• Specific Applications: Life Insurance & Annuities (Functional Testing) testing according to
• Generic Applications: Corporate Applications (Data warehouse Testing)) requirements

• Domain : Banking
• Basic Applications: Core-Banking Solution (Security Testing) Segregate the Types of
• Advanced Applications: Mobile Banking & ATM Software (Performance testing according to
Testing) applications

- 10 -
Contents

- 11 -
Testing Tools
System-side Testing Tools Application-side Testing Tools

Industry Commercially
Certified approved
Tools Tools

Unit Testing Tools: Functional Testing Tools:

1. Liverpool Developers Research Associates
(LDRA) Tool
2. IPL Canata
3. IPL AdaTest
4. Rational Realtime (RTRT)
5. A-Unit Framework (Freeware)
Integration Testing Tools:
1. Aonix Tool
2. IPL AdaTest
3. Rational Real-time (RTRT)
4. Ada ASSURED (Stylistic Tool)
5. Mathworks Polyspace (Semantic Analysis Tool)
1. HP QC (Quality Center)
2. Company specific Proprietary Tools
Automation Testing Tools:
1. HP QTP (Quick Test Professional)
2. IBM RFT (Rational Functional Tester)
3. Company specific Proprietary Tools
4. Segue SilkTest
Performance Testing Tools:
1. HP LR (Load Runner)
2. IBM RPT (Rational Performance Tester)
3. Segue Silk Performer
4. Jmeter (Freeware Tools)
5. Company specific Proprietary Tools

- 12 -
Contents

- 13 -
A Comparison – Testing Types
System-side Testing
1. Applicable to high-end industries like
Semiconductors, Real-time embedded systems
2. More of White Box Testing.
Require lot of system knowledge.
More of software product testing.
3. More involvement of Hardware systems (Test Rigs)
during software testing
4. Extremely regulations driven testing (Avionics –
DO178B, Railway Signaling – CELELEC EN 51028)
5. Very limited and specific market, hence lesser
software professionals. Testing methods more or less
defined.
Application-side Testing
1. Applicable to industries like Banking, insurance
companies, Manufacturing units and retail units.
2. More of Black-box Testing.
Require more of application knowledge.
More of software services testing.
3. Less need of hardware systems (Test Rigs) during
software testing. Can carry out with lesser hardware
dependendency
4. Lesser of industry wide regulations.
Hence defined more at client levels.
5. Huge market to explore for opportunities.
Plethora of software professionals and faster
growth. Testing methods still evolving.
- 14 -
Contents

- 15 -
Questions ?
Technical Questions

Suggestions

- 16 -
Way Forward…

Jan 2012

Pursue your
software career in
Phase 3 Software Testing

Testing Courses:

1 Year
1. Testing
Carve out Fundamental
Phase 2 s
a niche for
2. Test
yourself in Automation
STLC (HP QTP, QC
Go through phase of & ITKO LISA
Phase 1 Tool)
Software SDLC 3. Performance
Engineering during Testing
Materials academic Courses (HP
Load
Jan 2011 projects Runner)
4. Embedded
Testing
- 17 -