Professional Documents
Culture Documents
Q1) The QAI is starting a project to put the CSTE certification online. They
will use an automated process for recording candidate information,
scheduling candidates for exams, keeping track of results and sending out
certificates. Write a brief test plan for this new project?
Ans1:
Test plan of the above will consist of:
a) Objective: To automate the CSTE certification online
b) Identifier: CSTE-AUT/1/India
c) References: Records of earlier CSTE Exams held Names of the people involved in
earlier exams held CBOK, exam material, application forms, certification
d) Test Items:
The forms of the site for application, re-scheduling, postponing exam etc.
On line tutorials.
Help support provided
CSTE main exam links
Connectivity.
Databases
e) Risks:
Recovery
Correctness
Security
Unauthorized access of the application
Databases Integrity
Redundancy, Configuration management,
portability, Maintainability
Ease of use, ease of operation.
f) Testing Strategy:
White box testing
Black box testing
Stress testing,
Performance testing
Configuration Management,
System testing, Security Testing,
(can add some more techniques for testing)
g) Acceptance Criteria:
Criteria for exit like the requirements specified by user are met fully, the site is fault
free, and the application for the main exam is working fine. The functionality is fully
satisfied.
j) Environmental Needs:
Tools required for testing. Connectivity provided. Recovery data provided.
k) Training Needs:
Training of the testers, training of the personnel
l) Approval:
Approval of the management, users.
m) Glossary:
All the vocabulary support, data dictionaries etc.
Q4) How would u prepare the Test plan for the Project?
Ans4:
Assumptions:-
The requirements are given clearly to u, stating that u have to prepare
Plan for CSTE certification Online by
1. Recording candidate information
2. Scheduling candidates for exams
3. Keeping track of results and
4. Sending out certificates
Test Plan covering the details
Q6) "The top management was feeling that when there are any changes in
the technology being used, development schedules etc, it is a waste of time
to update the Test Plan also from time to time. Instead, they are
emphasizing that you should put your time into testing than working on the
test plan. Your Project Manager asked for your opinion. You have argued
that Test Plan is very important and you need to update your test plan from
time to time. It is not at all a waste of time and testing activities would be
more effective when you have your plan clear. Explain with some metrics;
how you would support your argument to have the test plan in place all the
time."?
Ans6:
Testing is a process and needs planning; too. The test plan serves as a contract
between QA and the project team. It serves as the foundation for the QA team. If
you don't plan, plan to fail. QA will not be able to verify the test coverage of the new
technology if it is not addressed in the test plan. Further, the test plan will address
how the technology will be tested in regards to test factors and if the technology will
negatively impact other features.
Or
If we keep the Test Plan up-to-date, it will enable:
a) Keep a track of all deliverables as defined in test plan with any slippages in their
schedules. If any slippages are occurring, take preventive actions. Also enable to
estimate h/w and manpower resources/efforts, based on technological changes.
b) Test progress S curve (plan, attempted, actual test cases) shall give a fair
indication of the status of testing activity.
e) Estimate correct value of Code coverage (Percentage of lines of code executed per
total lines of code) and take necessary action to test components that cover less
code
f) Serve as a basis for testing a similar kind of application in future
Q7) Short form for 11 Quality Factors: - MICE UR FlIRT (not exam related)
Ans7:
M: Maintainability
I: Integrity
C: Correctness
E: Efficiency
U: Usability
R: Reliability
Fl: Flexibility
I: Interoperability
R: Reusability
T: Testability
Q8) What fields would you include in creating a new defect tracking
program (used by QA, developers, etc)? (25 points)
Ans8:
It should content following fields:-
Defect Id
Status:- New, Active, Fixed, Resolve, Duplicate, By Design, Closed, Reopen
Assigned to
Source of Defect (Test case or other source)
Stage of origination
Project
Subject
Summary
Description
R&D comments
Reproducible Yes/No
Severity: - Low, Medium, High, Very High, Urgent
Priority: - Low, Medium, High, Very High, Urgent
Detected By
Detected date
Detected in version
Closed in version
Screen print & Logs etc.
Q9) which 3 tools would you purchase for your company for use in testing
and justify why you would want them? (This question is in both essay parts,
only rephrased. I think 10 points each time)
Ans9:
# Test management tool - (Optional)
why because : Helps in :
- Saving time in the creation and duplication of test scripts
-Staffing decisions accurately
-Testing process and implementation
- Maintaining documentation and implementation to meet the
requirements
- Taking corrective steps before the system goes live
- Tracking specific information about individual test scripts
- Getting updates on daily testing activities
- Record test results and produce statistical reports on test results
# Unit test tool -
Why because:
unit test must be performed by the programmers and each class
implemented must have programmer-developed unit tests, for everything that "could
possibly break". These tests are to be written during coding of the class, preferably
right before implementing a given feature. Tests are run as frequently as possible
during development, and all unit tests in the entire system must be running at 100%
before any developer releases his code.
# functional/regression test tool -
If I adopt this tool then i can reduce risks and make the most of limited resources
by implementing automated functional and regression testing of critical applications,
whereby development and QA teams create reusable test assets that provide in-
depth defect analysis and expedite resolution of defects.
Why because:
Q10) what are the points to be emphasized in testing of a system which has
multiple workstations for inputting (as against a single workstation
system)?
Ans10:
a) Seduconcurrancy testing :- When one user or console is updating /adding
/deleting a record other user should not be allowed to process the same
record - Other user should be in wait state
b) Load test / stress test should be done
c) Recovery test should be done
d) Performance testing: - Response time/Transaction completion time
e) Data validation: - Check if data is saved in correct order, data retrieval is
correct
f) Access control
g) Database security
h) Concurrent user test
i) Update and Rollback
j) Response time and Server connectivity
Q11) Write Test plan considerations for ….new e-business solution
Ans11:
Understanding the ecommerce could have a huge financial impact on a company if
not conducted properly. Also the fact that the infrastructure is not in place for the
company also will require additional testing. The types of tests I would conduct
include the following:
Structural Test
a) Stress - for the project volumes of transactions and number of users. It is key to
know where the limits of the application exist.
b) Execution
c) Recovery - With financial transactions it is important to know a system can stop
mid transaction and when it comes back up is able to return to processing when it
comes back up.
d) Security - Internal and external security
Functional Test
a. Requirements
b. Error Handling
c. Intersystem
Risk:-
a) Security
b) Performance
c) Correctness
d) Compatibility
e) Reliability
f) Authentication
g) Privacy and Protection of Information
h) Fraud and Misrepresentation
i) Reliability of trading partners
j) Technology Risk
a) Internal Auditor
b) Risk consultant
c) Data Processor
d) Security Officer
e) Computer operations manager
c] Error Guessing
Error guessing is based on the theory that test cases can be developed based upon
the intuition and experience of test engineer.
Example:-
Where one of the inputs is date a test engineer may try February 29, 2004 or 9/9/99
Q15) Write standards for test plan, test script, test report. 15
marks
Ans15:
Test Plan (Make this in table format)
a) Preface
b) Executive Summary
c) Introduction of the Project
d) Organization of Document
e) Test Organization
f) Test Techniques
g) Test Tools
h) Acceptance Criteria
i) Glossary
Test Script
a) Date of Test Conducted
b) Type of Test Conducted
c) Serial Number
d) Statement to Execute
e) Expected Result
f) Actual Result
g) Remark
Test Report
a) Name of the Project
b) Name of the Module/Subsystem
c) Type of the Testing
d) In the Heading Present the total number of Defects
e) Graphical Analysis of Test Result visa Histogram or so….
Q16) Your customer doesn’t know how to prepare acceptance test plan.
Write contents of the acceptance test plan for his guidance. 15
marks
Ans16:
Acceptance criteria should include success criteria for:
a) Functional Requirements -which relate to the business rules that the system
must execute
b) Performance Requirements which relate to operational requirements such as
time or resource constraints
c) Interfacing quality Requirements-which relate to a connection to another
component of processing(human/machine-machine/module)
d) Overall Software Quality requirements –are those that specify limits for factors
or attributes such as reliability, testability, correctness and usability
- Project description
- Scope
- User roles and responsibilities
- Acceptance criteria
- Test cases to be executed
Acceptance Criterion
-----------------------------------------------------------------------------------------------
No Acceptance req Critical Result Remark
Yes No Accept Reject
-----------------------------------------------------------------------------------------------
1 Login time
- should not be Yes Yes Accept
more than 6 sec
2. Concurrent users (min 40 Users) Yes Reject Only 30 works
Q17) Explain any 5 Test Metrics (10 Marks)
Ans17:
Test Coverage = Number of units (KLOC/FP) tested / total size of the system
Test cost (in %) = Cost of testing / total cost *100
Cost to locate defect = Cost of testing / the number of defects located
Defects detected in testing (in %) = Defects detected in testing / total system
defects*100
Acceptance criteria tested = Acceptance criteria tested / total acceptance criteria
Q18) Write a Test transaction for a scenario where 6.2% of tax deduction
for the first $62,000 of income has to be done?
Ans18:
For test transaction need to be consider Lower boundary, On the boundary and Upper
boundary while creating scenario.
a) Check if 6.2% tax deduction is calculated for income less than $62,000.
b) Check if 6.2% tax deduction is calculated for income equal to $62,000
c) Check if 6.2% tax deduction is not calculated for income more than $62,000.
(Because in the question he mentioned clearly that it’s for the first $62,000)
Q19) you have delivery of product in next 2/3 days. Have people already
overworked. Your budget does not allow including new team member. You
are finding that each test cycle is finding new defects. As a PM how u will
ensure that schedule is met and product quality is high?
Ans19:
a) Arrange team meeting. Tell importance and urgency.
b) Listen to concerns and opinions of team members
c) Have quick awareness session on type of defects. Use pareto analysis to find
out critical defects
d) Concentrate on root cause of defects
e) State severity and priority
f) Assign / change task and schedule
g) Give Motivation to team members
h) Aware customer about current status
d) Overall software quality requirements are those that specify limits for
factors or attributes such as reliability, testability, correctness, and usability.
Best Bank
ATM
ATM Service ATM System
Technician Administrator
Q34) Name the causes from which most of the testing problems occur?
Ans34:
a) Failure to define Test Objectives.
b) Lack of support from Development Team.
c) Lack of Training.
d) Lack of use of effective techniques.
Q35) Define cost-effective perspective in testing?
Ans35:
Cost Effective way of Testing is a way to achieve maximum advantage out of testing
which means that Cost of Conduction Testing is less than the loss due to undetected
defects.
Q36) Draw the Testing Cost Curve and the Optimum Test (where it occurs).
Ans36:
120
Untected Defects
100
Loss Due to
80 Loss Due to
60 Untected
40 Defect
20 Testing Cost
0
1 2 3 4 5 6 7 8 9
Testing Cost
Q38) Prepare a check list for the developers on unit testing before the
application comes to testing department
Ans38:
General
a) All Programs are Compiled successfully
b) All Programs are commented properly.
c) All Programs do not have spelling mistakes and grammar errors in
comments.
d) All program names in Build are same as in Release Notes.
e) Online Help exists for each program unit.(for each page if applicable)
f) User Manual does contain all program names and associated text.
GUI Interface
a) Background and Foreground color combination suits the eyes
b) Program works in all screen resolution modes
c) Program does not contain orphan/broken web links
d) Application does not raise any critical error message ( It should be
returned to developer if continuously severe errors encountered)
Q39) Write any attributes which will impact the testing process
Ans39:
a) Maintainability
b) Reliability
c) Correctness
d) Flexibility
Testing System:
Development and execution of a test plan in accordance with
Departmental procedures and user requirements.
Measurement of Testing
Cost of undetected defects.
Testing Standards
One defects per 250 executable program statements.
Q46) Draw a pictorial diagram of a report you would create for developers
to determine project status?
a. Draw a pictorial diagram of a report you would create for developers to determine
project status
b. Draw a pictorial diagram of a report you would create for users and management
to show project status
Ans46:
a)
Individual project status report
Planning
Requirement
Development
Implementation
[Frame7]
b)
Q47) it is being observed that in a project cost of testing is very high. After
going in detail it was found that the testers are testing the software which
is not left with many defects. How will you make sure that this is correct?
three ways? What are the disadvantages of Over Testing?
Ans47:
a) Disadvantages of Over-Testing:
b) Wastage of precious Test Time
c) Wastage of scarce Test Resources, and Test Environment
d) Less ROI
e) Distraction (to over-test) could cause some important applications
components to get under-tested
Q48) you find that the senior testers are making more mistakes then junior
testers; you need to communicate this aspect to the senior tester. Also, you
don't want to loose this tester. How should one go about the constructive
criticism?
Ans48:
a) Do it privately
b) Have the facts
c) Be prepared to help the worker to improve his/her performance
d) Be specific on expectations
e) Follow the specific process in giving the criticsm
1) state the positive first
2) Indicate the deficiencies with product or services produced by
individual
3) Get agreement that there is a problem
4) Ask the subordinate for advice how to improve his/her performance
5) If the is unable to solve suggest the cource
6) Make a specific “contract” regarding what will happened after the
session
7) Avoid the threat
Q49) how will you ensure the effectiveness, efficiency and total coverage of
a model with lots of fields, data, and interdependent paths between them?
Ans49:
First consider risk associated when fields are added
a) Test Factors you have to consider and draw a matrix
b) Testing go for Reliability
c) Effectiveness and efficiency test coverage is calculated
d) Regression, Stress, Black box testing is performed
White box testing can be useful to do these:
A) Unit testing - covers a) statement coverage b) path coverage c) loop testing d)
code coverage e) condition coverage f) branch coverage
B) Integration testing - data navigation from one module to another module since
the model consists of different fields
Q50) Put the following testing types in order and give a brief description of
each System testing, acceptance testing, unit testing, integration testing,
and benefits realization testing. (10 points)
Ans50:
1) Unit testing: -
Testing Individual Programs, modules, or components to demonstrate that the work
package executes per specification, and validate the design and technical quality of
the application. The focus is on ensuring that he detailed logic within the component
is accurate and reliable according to pre-determined specifications. Testing stubs or
drivers may be used to simulate behavior of interfacing models.
2) Integration testing: -
This test begins after two or more programs or application components have been
successfully unit tested. The development team to validate the technical quality or
design of the application conducts it. It is the first level of testing which formally
integrates a set of programs that communicate among themselves via messages or
files (a client and its server(s), a string of batch programs, or a set of on-line
modules within a dialog or conversation.)
3) System testing: -
During this event, the entire system is tested to verify that all functional,
information, structural and quality requirements have been met. A Predetermined
combination of tests is designed that, when executed successfully, satisfy
management that the system meets specifications. System testing verifies the
functional quality of the system in addition to all external interfaces, manual
procedures, restart and recovery, and human-computer interfaces. It also verifies
that interfaces between the application and the open environment work correctly,
that JCL functions correctly, and that the application functions appropriately with the
Database Management System, Operations Environment, and any communications
system.
4) Acceptance testing
Main objective acceptance testing is ensure all the functionalities and requirement
are implemented correctly or not. In Acceptance testing real time test data is used,
usually acceptance testing is done by client or client’s representative. Here client will
check the all the functionalities.
Benefits:-
a) Automating testing reduces testing errors
b) Maintainable, extendible and reusable Test Automation solutions
c) Automation enables repeatable testing process
d) Free up testers to focus on higher risk exploratory testing
e) Reduce testing costs for regression, acceptance and other repetitive tests
f) Discover the benefits of using Automated Regression Tests in your rapid
release schedule
g) Be able to make Automated Testing decisions that yield positive return-on-
testing investment
h) Complete testing coverage is a more readily achievable goal with an
automated suite of test tools
Q52) List what you think are the 4 primary goals of testing. (5 or 10 points)
Ans52:
Primary
Determine if system meets specs
Determine if system meets
business / user needs
Secondary Raising issues / instilling confidence in system/ insight into s/w delivery
process /improve test process.
Q53) Write test plan considerations for testing of a system with highly
interdependent and complex data model in nature. (It has lot of variables,
fields, constraints, mathematical processing and so on) and the customer
has modified the scope of the project without any additional time allotted.
What approach should be taken to test the system?
Ans53:
a) Since the scope of the project has been modified by the customer without any
additional time allotted, test plan is to be designed in such a way that it covers all
the major fundamentals functionality, modules and the software stress will be given
on testing those modules.
b) Since the product has complex data in mature constraint violation test
maintainability and reliability tests should also be carried out.
1) Test based on table relations
2) Boundary value analysis / Equivalence partitioning
3) Performance of system (time taken to complex data)
4) Since complex database is used load/stress test, recovery test should be
performed
In Software field, these terms are primarily used to indicate the effort put in to
develop the Software and How much is customer satisfied with the product.
Effectiveness signifies how well the customer requirements have been met i.e. does
the final product provides the solution to the Customer problem effectively.
Example
James efficiently made the calls he had wanted to make. Robert didn't make the calls
he had planned to make, but effectively met his sales quota by profiting from a
chance encounter with a business acquaintance.
Key Point
When you're effective, you are able to accomplish the worthwhile goal you've
chosen. When you're efficient, you quickly carry out actions. You won't be effective,
however, unless those actions result in your achieving a meaningful goal.
Test Effectiveness = ((Defects removed in a phase) / (Defect injected + Defect
escaped)) * 100
Test Efficiency = (Test Defects / (Test Defects + Acceptance Defects)) * 100
Q59) You are testing software for aeroplane takeoff and landing. Design a
test strategy to test it. – 15 marks
Ans59:
The Aeroplane takeoffs and landing is a very critical program as human lives are
affected, correctness, reliability, continuity of process, recovery and security are the
factors to be addressed while creating test strategy. Exhaustive Test should be done
since it’s a life-threatening software product. The test case coverage should be 100%
with respect to total program. The program should be Defect free.
a) Set up test environment that simulates production environment. Test System
on live data.
b) Recovery Test for failure
c) Stress Test
d) Security Test
e) Performance Test
f) Ad-hoc Test
g) Fault seeding
Q61) In your organization, testers are delivering code for system testing
without performing unit testing. Give an example of test policy in this
matter.
Ans61: Test Policy is management’s definition of testing for a department.
Sample Test Policy
TEST POLICY
CSTE GROUP LTD
Testing Definition:
Determination that the code is unit tested before delivering it
for system testing.
Testing System:
Development and execution of a unit test plan in accordance with
Departmental procedures and user requirements.
Measurement of Testing
Costs of correcting defects found because of process error and
logical errors in code. or No of defects found in unit testing Vs
number of defects expected.
Defects found in Unit test.
Defects originated in Unit test but found in Subsequent phases.
Cost of Unit testing = Cost of Unit testing versus
Number of defects in Unit test.
Testing Standards
There should not be more than five percent of defects which have been
undetected in Unit test phase and caught in subsequent phases.
Q62) What if the application has functionality that was not mentioned in the
requirements?
Ans62:
Get all the stakeholders involved i.e. customers, users, etc Review the functionality
with them. If they are in consensus that it is a value added allow the functionality to
remain and update the help and release notes. If they are not in consensus log that
functionality as a defect and ask the developers to resolve it “First” that a defect
should be opened and THEN go through the other steps of contacting the
stakeholders through the PM, etc…. Should the functionality need to stay, a change
request is accomplished. If not, the defect is addressed by removing the
functionality. However, either way – the defect would be opened first, would it not, in
order to track the progress of addressing the issue.
Q64) it has been observed that testers in your organization are performing
tests on the deliverables even after significant defects have been found.
This has resulted in unnecessary testing of little value because re-testing
needs to be done after defects have been rectified. You as the test manager
are going to update the test plan with recommendations on when to stop
testing. List what recommendations you are going to make?
Ans64:
a) When cost of testing exceeds the value obtained from the defects uncovered,
stop testing.
b) All high priority bugs fixed and regressed.
c) Testing objectives are met.
d) Budget constraints.
e) Deadline
f) Complete coverage of all the requirements, functionalities.
g) If any medium or low priority errors are outstanding, it must be documented
and signed off.
When the test engineers have found the good number of critical bugs then the they
should not test the same build / software version till the bugs are fixed. So in the
time between the test report is submitted and the time testing team gets the fix of
those bugs the test manager should ask team members to focus on others things
such as
a) Making test cases (as the newer software version will get immune to the
earlier test cases)
b) Should focus on automation.
c) Making test strategy to break the software.
Q65) the developers in your company do not believe in testing their code or
doing unit testing. Explain the need of unit testing? To change this trend
your company has implemented a process. What steps will you as a Test
Manager take to ensure compliance of the process?
Ans65: Need of unit testing:
Q66) what steps are needed to develop and run software test?
Ans66:
1. Determine the current status of your capabilities. This involves understanding the
capabilities of your testing process as well as the capabilities of your individual
testers.
2. Establish improvement goals. Determine and define the type of testing
organization you would like to have in your organization, as well as skill sets needed
by your testers.
3. Develop a plan to achieve your testing goals. The plan should be a Well defined
series of tests that will take you from where you are to where you want to be..
Q67) Explain points in favor of testing by Developing Team tem selves &
testing Independent team?
Ans67:
Development Teams:
Advantages:
a) Minimize the cost of Testing.
b) Gain knowledge of other parts of project.
c) Trains developers in good test methods.
Disadvantages:
a) Improper use of development process may not be detected.
b) Individual may be BLINDED into accepting erroneous system specification &
coding.
c) They are optimistic in their ability to do defect free work & thus
underestimate the need for extensive testing.
d) Without a formal division between Development & Test, an individual may be
tempted to improved the system structure & documentation rather than
allocate the time an effort to test.
Independent Team
Advantages:
a) Unbiased assessment of quality of the application.
b) Bring an independent perspective to the test process.
c) Group comprised of professionals who have specialized in area of testing,
have extensive testing experience in multiple projects. Thus are better able to
construct and execute tests.
Disadvantages:
a) Additional cost required to establish and administer a testing function.
b) Development team may place too much reliance on the test team and thus
fail to perform adequate testing themselves, resulting in overburdening
testers.
c) Competition between testers and developers results in breakdown of
cooperation making it difficult for testers to function properly.
Q70) Explain what testing tool you will buy for Client Server testing & WHY?
Ans70: We’ll buy following testing tools for client server testing:
1) Load/Stress Testing Tools: Example Astra Site Test by Mercury Interactive,
Silk Performer by Seague Software to evaluate web based systems when
subjected to large volumes of data of transactions.
2) Performance Testing: Example Load Runner to see the performance of the
client server system.
3) UI testing: Example Win Runner by Mercury Interactive to perform UI
testing.
Q71) Explain what testing tool you will buy for WEB testing & WHY?
Ans71: We’ll buy following testing tools for web testing:
1) HTML Test Tools: Example Doctor HTML by Imagineware to perform a
verification of HTML if we don’t have an HTML checker with web
development packages.
2) Site Validation: Example SQA Site check by Rational Software to identify
inconsistencies and errors such as Moved pages, Orphaned pages, Broken
Links.
3) Load/Stress Testing Tools: Example Astra Site Test by Mercury Interactive,
Silk Performer by Seague Software to evaluate web based systems when
subjected to large volumes of data of transactions.
4) Test Case Generators: Example Astra Quick Test by Mercury Interactive to
create transactions for use in testing. This tool tells what to test, as well
as create test cases that can be used in other test tools.
Q72) Suppose you have written a project status report for expected defects
vs. Actual defects, using testing metrics. If you PM ask, you to explain how
to read this report, what recommendations would you give her/his?
Ans72:
If expected rate is higher than the actual rate that means the testing activity has
been not performed thoroughly. If actual rate is higher than the expected rate then a
very inexperienced team is developing the software. So accordingly take the
appropriate corrective measures.
Q78) what is test strategy? List the four components of a good test
strategy?
Ans78: A test strategy is a statement of the overall approach to testing, identifying
what levels of testing are to be applied and the method, techniques and tool to be
used.
a) Critical success factor
b) Risk analysis
c) Assumptions
d) Methodology to be followed
Q81) what are the three most common phase end review?
Ans81:
a) Requirement review
b) Design review
c) Code review
Q82) what are the three reasons why people don’t listen well?
Ans82:
a) the speaker may not be taking about a topic of interest to them
b) they are impatient and have a lot of other stimuli going through their minds
c) they are too busy rehashing what they will say next
Q83) You as the quality assurance manager at the APEX company; one of
your assurance analysts is engaged in a dispute with a developer over the
cause of a defect reported by the analyst. What can / should you do?
Ans83:
You should discuss the defect report with QA analyst to ensure that the information is
correct and root-cause analysis was conducted. If it is clearly a case of developer
error then have both people discuss and come to an effective resolution. Record the
defect & status.
Q84) briefly describe the difference between automated and manual testing
tools. Give two examples each?
Ans84:
Manual tools do not execute program code and do not require executing software,
automated tool do.
Manual – Review and Check sheet
Automated – Code coverage analyzer and File comparison