2016 5th International Conference on Computer Science and Network Technology (ICCSNT)

Design and Implementation of Bank Financial

Business Automation Testing Framework Based on
QTP

Xianjie Xie1, Zhijun Yang2, 3, Jiankun Yu1,*, Weifeng Zhang3

1
School of Information
Yunnan University of Finance and Economics
Kunming, 650221, China
2
The Academy for Educational Science Research
Educational Department of Yunnan Province
Kunming, 650223, China
3
School of Information
Yunnan University
Kunming, 650091, China

Abstract—The current software testing in the aspects of
industrial benefits gradually causes the attention of the domestic
financial bank. The innovation of software technology, the
increase of software scale and the shortened developing period
make the traditional manual testing meeting enormous
challenges, while the development of automated testing
technology has promoted the progress of the software testing
industry. Because of the particularity of financial and banking
services, the bank is under an obligation to ensure the quality and
reliability of software. Therefore it’s vital to test the software. In
specific practice, although the powerful third-party testing tools
can be used as a solution, it is hard to rely on certain tool to
implement automated testing, hence a framework of automated
test is required to be introduced for testing, which intends to
handle high efficiency and high-quality testing for software
automation. This paper proposes a kind of software automation
testing framework based on QTP, mainly targeting on the core of
the bank, credit, online banking to test the function of the three
major operations. The framework is a secondary development
based on QTP and mainly for regression testing of software,
which integrates techniques including object recognition, data-
driven, and keyword-driven technology, checkpoint technology,
to proceed business-level testing. The paper expatiated on four
issues, which were the test system design, the test standardization,
the testing framework design and the testing of the
implementation. The practical application shows that the
framework can improve the operational efficiency, reduce the
test cost, and guarantee the smooth progress of the software
automation testing.
Keywords—software testing; test automation framework; QTP
automated testing tool
I. INTRODUCTION
The continuous development of banking and financial
services put forward higher requirements to the bank software
of financial management, especially the quality and efficiency
* Corresponding author email address: yjk1102@163.com
of software, which is vital to the market competitiveness of
banks. Software testing is a reliable means to guarantee the
quality of bank software. Using software testing methods to
automate the testing of bank software, not only can improve the
quality of the software, find out the flaws in the software, but
also can reduce the cost of the late, thus effectively saving
manpower resources cost and improving work efficiency. The
traditional test solution is to use the third party automated
testing tools. According to today's banking business
requirements, a separate test tool can’t reach the desired
objectives, therefore it’s very necessary to set up a complete
and applicable framework for automated testing.
The paper [2] proposed a regression test automation
framework that turns on the development of automated test
scripts test development process. By defining tables, data, and
control spreadsheets which can be easily maintained, it offers a
full range of features interface to complete the test. In
regression testing, the test need only modify the spreadsheet
definitions. The paper [3] establishes a framework for web
application testing. The framework is built on an excel file
which contains keywords imported into the frame by using
keyword driven framework Selenium web-driver API. The
paper [4] proposed an automatic test execution and
optimization of hybrid drive architecture, HTLP (hybrid test
Language Processing) data-oriented keywords. The HTLP is
applied to open source software based on the application of
good vtiger CRM5.
This paper is divided into three parts: The first part is the
introduction of testing tools QTP, mainly explaining its
working process and key technology. The second part
discusses the automated testing framework of bank financial
services based on QTP, from two aspects including the build
and design of testing system. The third part explores the
implementation process of automated testing framework,
which consists of three parts: feasibility analysis,
implementation steps and results comparison.

978-1-5090-2129-1/16/$31.00 ©2016 IEEE 143 Changchun, China

 II. TESTING TOOLS QTP
QTP (Quick Test Professional) is an automated testing tool
developed by HP company, which is the most popular
automated testing tool on the market. It has a great reliability,
stability and scalability. Through Java, Web, ActiveX, .NET
and other plug-ins, QTP offers an automated test environment
for all major application software, to facilitate functional
testing and regression testing being performed on the software.
QTP supports the functions of record and playback, by which
engineers can record and capture the operating process of the
software, automatic generation of functional tests or regression
test cases. Finally professional test engineers can write
VBScript by Expert view to gain full control of the testing and
object properties.
A. QTP Automated Testing Processes
The processes of QTP automation testing include planning,
requirements analysis, test script development, debugging test
scripts, a performance test script, result analysis, maintenance
of seven stages.
1) Plan: Before the test, it’s required to determine whether
the software is conforming to the requirements of QTP, taking
various factors into consideration, such as the function of the
test software, operation steps, ease of use and cost, etc.
2) Requirements analysis: It’s mainly to analyze the
correctness, consistency and feasibility of the test software
requirement.
3) Test script development: Record script by running the
software with QTP, add checkpoints to the test script, then
check the object properties, verify whether the function of the
software is correct or wrong. Replace the fixed value of the
recording script with the parameters, with more complex tests
being performed, then generate test cases.
4) Debugging test scripts: The completion of test script
should be debugged, to ensure that the test case goes through
all the wrong ways.
5) Perform test script: Run the test script in this stage,
whose main function is to test the software. During this process,
the tester can also debug the script until it meets the former
design.
6) Result analysis: View the generated test results after
each test script execution, to determine the defects existing in
the software.
7) Maintenance: Update script to solve a variety of defects
found in the implementation of test scripts, a good test
framework and test set can ensure the minimum cost of
maintenance.
B. QTP Key Technologies
In the process of QTP automated testing, the key
technologies are mainly identifying objects with image
recognition technique, checking the state of the property with
checking point technique, as well as the automation object
model technology, synchronization point technology and plug-
in extension technology.
144
1) Object recognition technology: QTP is usually by
adding objects to the object library to identify objects at run
time. There are four types of object recognition patterns in
object identification: mandatory attribute recognition, auxiliary
attribute recognition, sequential attribute recognition and
intelligent recognition. In general, most of the tested objects
can be identified by force mandatory attribute recognition.
When mandatory attribute recognition is not able to recognize
the object, it’s necessary to define the object by the aid of
attribute recognition and sequential recognition. Intelligent
recognition is used in the case when the object property of the
object database is not consistent with the property of the object
being tested.
2) Checkpoint technology: Checkpoint technology is used
to check whether the value of the measured object in the
process of the script is consistent with the former design, to
check the run states in the test report. Checkpoints in the QTP
are divided into two kinds including the built-in checkpoint and
custom checkpoint. Built-in checkpoints can be added by
recording or manual approach. Custom checkpoint, with
greater flexibility, is used to judge whether checkpoints
attributes as expected by conditional statements.
3) Automation object model technology: Object interface
provided by QTP allows the access and control of other
programs. QTP, configuration and activation of test cases can
be activated by writing the script. The object model library of
QTP provides various kinds of object interfaces, by calling the
objects, methods and properties of the interface. QTP Test
script can be written with a variety of programming languages
and under development environments, such as VBScript,
Visual Basic, Visual C ++, visual studio.NET, JavaScript, etc.
4) Synchronization point technology: In the process of
automated testing, there may be a good example where the
current statement is not executed, and the latter statement is
executed. Add synchronization points to the script, if you
encounter synchronization point during the execution of the
script, the script will be suspended. Then the object waiting to
be measured acquires a preset value of attribute before starting
the next statement, if the measured object in the preset time
interval don’t get a preset value, it will report an error message.
5) Plug-in extension technology: QTP supports different
application types. For different application types, it loads
different plug-ins for test, with unique license for each plug-in.
The built-in plug-ins has three types including Web, ActiveX,
and Visual Basic, while peripheral plug-ins includes
Delphi, .Net, Java, etc.
III. INTRODUCTION OF BANK SOFTWARE AUTOMATION TESTING
FRAMEWORK BASED ON QTP
Along with the continuous development of software
automation testing technology and the unceasing expansion of
user needs, automated testing has become ever more noticeable.
QTP automated testing technology has become the mainstream
of software automation testing tools, because of its powerful
object library, supporting a variety of different programming
platforms and plug-ins and so on. But it's not enough to only
rely on the simple recording and playback functions to operate
the software automatically test. Limited testing data and the
enormous workload, will not meet customers’ needs.
Introducing automated testing framework for banking financial
business test can effectively improve test efficiency and reduce
maintenance costs.
A. Testing System Design
Compared with the manual test, the automated testing has
significant advantages, such as high test speed and high
efficiency. Of course, there are also risks in automated testing,
therefore it’s necessary to set up a test system before designing
the framework and conduct the evaluation and consideration of
appropriate conditions to prevent automated test lead halfway.
The test system mainly includes organizational structure,
technology and methods, support tools, asset management,
asset management, team building and so on.
1) Organizational structure: In the bank, it needs to have
specialized departments being responsible for testing related
issues. In the meantime, the roles or responsibilities are needed
to be defined, such as testing center, the quality and safety
commissioner, the test person in charge of the assigned by the
technical department.
2) Technology and methods: Various technical methods
may be used in the process of automated testing. From category
point of view, it mainly includes text analysis technology,
automated test technology, performance testing technology,
security testing, etc. From the test process point of view, it
includes the test plan method and its template, the test case
design method and its template, the test result analysis method
and the test report template and so on.
3) Support tools: Choose appropriate tools to support
business test management, test implementation and software
quality analysis, which can be got by self-researching or be
purchased. According to the classification point, the tools
related to testing generally are as follows: test design and
execution management tool, defect management tools,
automated testing tools, performance testing tools, safety
testing tools, unit testing tools, integration testing tools,
configuration management tools.
4) Asset management: Effectively manage all stages of
documentation, testing data, code, scripts, tools, etc.. The assets
of the document category include test requirements, test plans,
test case documentation, documentation of test data, defect
analysis reports, test reports of various types of templates and
the actual submission at least.
5) Team building: It means to cultivate and build the test
team according to the enterprise's own construction ideas on
test, thus being equipped with the ability to carry out the test
functions.
B. Design of Bank Business Automation Testing Framework
Based on QTP
Automated testing framework is a collection of all the
processes in the automated testing process. A good testing
framework is conducive to the test, as well as the cost of the
reduction, post maintenance convenience. Therefore we put
forward a kind of automation testing framework based on QTP,
145
mainly including two parts, i.e., test standardization and
framework test design.
1) Test standardization: Test standardization is to make
the QTP automated test standard in order to reduce
unnecessary trouble.
a) Standardization of testing tools: Which mainly
indicates the standardization of the use of testing tools, such as
management mode of object library, associated drive script
and batch processing, testing tool settings, storage analysis of
test results, data source management and maintenance, scene
error recovery and resource, environment definition, etc.
b) Standardization of configuration management:
Which is mainly being used to work together with code
management, deployment of test version and management of
testing assets.
2) Test Standardization: The design of the automated
testing framework involves three systems including the core
business of the bank, credit and online banking. The test
objective is to define the interface, interaction, data validity and
storage of the system under the premise of each function of
three different systems in normal. Test cases and data will
cover all kinds of normal and abnormal conditions, including
different card states verification, verification of discrete
contract IOU, cost information verification, to assure the
successful application of the framework. Then it puts forward a
kind of automation testing framework based on QTP, which
mainly includes five parts: test driver layer, data layer,
abstraction layer, test case layer and object layer, operate layer.
The overall design is as shown in Figure 1.
Fig. 1. Design of automated testing framework based on QTP
a) Test driver layer: As a core part of the framework,
module of driver starts QTP by loading the configuration file,
calls test data and cases, then extracts the library data of
corresponding function and loads the object library and
function library to complete the automated test. Driver module
contains TestSet and TestCase driver, in which data driven or
keyword driven mode can be used.
x When the test target flows constantly, only the data
changes, then a data-driven test is being used. The data
are input and output from a separate data file, and the
 script describes a specific process executed in the test 1) Benefit-cost analysis: For the meaning of introducing
script. Such a script is used as a drive, with test data and automated testing framework, we made the analysis from the
test scripts (steps) for separation. With a script for cost-benefit formula. Assuming that there are m tests,
different data for testing, it relies on the script variables development costs in the beginning is D i (i 1,2,..., m) ,
for data transfer. Such framework can be used to reduce
maintenance cost is E , manual testing each test run number is
the number of scripts, thus improving the script reuse
rate, and avoiding duplication of scripts. n , a single script the cost of implementation of the manual is
Oi (i 1,2,..., m) , the return numbers is a , then the benefit-cost
x Keyword-driven testing is based on data-driven, as well is as shown in Formula (1).
as the use of keywords corresponding to all the basic
m
operations, each with a corresponding function
implementation. In the case to build a good testing
¦D i E
(1)
Benefit  cos t i 1
framework, the main task is to design key data tables, m

without the need to pay attention to the development of ¦ (n u a u O )

i 1
i

basic functions. Keyword-driven test cases can not only

effectively achieve the separation of data, business, We can see that the lower benefit cost, the greater income
script, but also achieve a separation of interface element of automated testing.
names and the test object, which simplifies the 2) Tested software environment analysis: This test is
development of the script and speeds up the primarily targeted on the business of financial banks, which is
development. involved the core, credit and online banking three systems. The
b) Data layer: All the test data are stored in the access test objective is to determine the function of the three systems,
file, with script having direct access to get them, which can and verify the interface, interaction, data validity and storage in
facilitate the realization of the data sharing between the scripts. the system. Test cases and data will cover all types of normal
and abnormal conditions, including different card states
c) Abstraction layer: This layer is used to store the verification, contract verification, cost information verification,
function library and script library. It stores project’s general etc. to assure the successful operation of the system.
function method, and some common functions of the project
on this layer. For example, logging reception function can be B. Automated Testing Framework Implementation Steps
made into a public function, which will be used in almost all
transactions, as well as report processing, exception handling, Design automation test framework is not the ultimate goal,
log records function. but to complete the test more efficiently. So in order to make
the automation framework better execute, there must be a
d) Test case layer and object layer: This layer is used to complete implementation process as a guarantee. The main
store test cases and objects, create different test scripts steps of the implementation are test plans, requirements
according to different test cases. Automated testing is usually analysis, test design, test execution, test reports several aspects,
based on test points of test cases. The object library stores all as shown in TableΣ.
the tested program objects that can be identified by QTP. In
the process of development, all developers continue to update
the object library, forming a total project object library. TABLE I. BASED BANKING AND FINANCIAL MANAGEMENT SOFTWARE
QTP AUTOMATED TESTING FRAMEWORK IMPLEMENTATION STEPS
Different scripts developed by developers can execute on
machines that share the project object library. Main Park Work Description Main Effect
e) Operate layer: This layer is divided into two parts: Match with the development
plan as the basis for the
part of the staff collect test objects, write code and do project manager to manage
debugging, and another part of the staff manage the script, Incorporate automated
the project schedule. In
define test sets, run the test set, view the results, report defects, Test Plan assessment and planning
addition to the guidance of
into the overall plan
etc. the test work, but also can be
bound to the development of
the submitted plans
IV. IMPLEMENT AUTOMATED TESTING FRAMEWORK FOR Synchronous analysis
Find the lack of demand,
BANKING FINANCIAL SERVICES BASED ON QTP Demand automation feasibility
errors, inconsistencies and
analysis and related test points
other issues
A. Feasibility Analysis of Automated Testing Framework priority
1. Follow the requirements
Generally speaking, automated testing framework is built Case development and
Test design and test cases
Implementation
on the specific implementation of the system characteristics, 2. Detailed design test
with the lowest cost being exchanged for higher benefits as a Automated execution
To prepare for the test
start point. Bank financial business process operation is execution
1. Implement test cases, find
relatively stable. When the developer adjusts the code to Test Perform automation and defects and improve the
submit a version, he can trigger the operation of regression execution maintenance according quality of software products.
tests by calling the prepared test data and test cases, and then to the actual needs and 2. Promote development
complete regression testing process without manual importance according to the planning
intervention. phase

146
 Main Park Work Description Main Effect test, its test time is reduced, with work efficiency improved
Evaluate the quality of a effectively. At the same time, it can detect whether there is any
Automation Report flaw in the bank's three major businesses and generate test
certain version.
Test report Tip each time point or the reports based on it, to help developers find defects and protect
Automation ROI reports overall situation each time, the development of commercial banks.
project and system quality

C. Analysis of Results ACKNOWLEDGMENT

From July to September in 2015, financial software of
certain bank, Web module and so on were developed with QTP
test script by the test team, in which a total of 315 test cases
were completed, with 185 object libraries. For comparison, we
took 100 test cases from them for testing, conducted five tests,
regarded the average test time of 5 times as the test time. The
results of such tests are as shown in TableΤ.
TABLE II. COMPARATIVE RESULTS OF THE IMPLEMENTATION OF QTP
AUTOMATED TESTING FRAMEWORK
Test case Test takes
Test mode Pass rate
number time(minutes)
Based on the
implementation of
100 28
QTP automated
testing framework
Common
implementation of
100 33
automated testing
framework
Manual testing 100 140~160
It took 28 minutes to test 100 use cases by QTP-based
automation framework, which passed the 95 test cases, with 5
defects being found. It took 33 minutes to test conventional
automation framework, which passed the 81 test cases. For
manual testing, according to common experience, each test
case probably took 1-2 minutes, it took 140 to 160 minutes to
finish testing all the test cases. Through the 86 test cases, it can
be seen that QTP-based automation test framework compared
to routine testing framework and the manual test has a faster
test speed, with highest pass rate of test cases among them,
which greatly improves the work efficiency.
V. CONCLUSIONS
Domestic automation testing is gradually developing. As
the most important financial industry, banks have strict
requirements on their own business. And the emergence of
automated testing just satisfies their requirements. In order to
guarantee the smooth progress of the automation test, the
automation testing framework is put forward. A suitable
framework for automated testing can ensure the smooth
progress of the test work, avoid the risk of automated testing
and make the testing process quite clear and obvious. Therefore,
this paper puts forward a software automation testing
framework for bank financial management based on QTP, and
makes automated test in three aspects including the core
business, credit and online banking. Compared with the manual
This work was supported by the National Natural Science
Foundation of China under Grant Nos. 61461054.
REFERENCES
[1] Lalwani T, Kanoujia S N, Howarth T, et al. QuickTest Professional
Unplugged[M]. KnowlegeInbox, 2011.
[2] Liu Z, Chen Q, Jiang X. A Maintainability Spreadsheet-Driven
Regression Test Automation Framework[C]//Computational Science and
Engineering (CSE), 2013 IEEE 16th International Conference on. IEEE,
2013: 1181-1184.
[3] Aiya K V, Verma H. Keyword driven automated testing framework for
web application[C]//2014 9th International Conference on Industrial and
Information Systems (ICIIS). IEEE, 2014: 1-6.
[4] Mann M, Sangwan O P, Tomar P. Hybrid test language processing
based framework for test case optimization[J]. CSI Transactions on ICT,
92%
1-11.
[5] Chen NengJi,Software Testing Guide:Fundamentals,Tools and
Practice(Second Edition)[J]. 2008.
81% [6] Grechanik M, Xie Q, Fu C. Maintaining and evolving GUI-directed test
scripts[C]//2009 IEEE 31st International Conference on Software
Engineering. IEEE, 2009: 408-418.
86%
[7] Kaur M, Kumari R. Comparative study of automated testing tools:
Testcomplete and quicktest pro[J]. International Journal of Computer
Applications, 2011, 24(1): 1-7.
[8] Graham D, Fewster M. Experiences of test automation: case studies of
software test automation[M]. Addison-Wesley Professional, 2012.
[9] Zhou R Z, Wei Z K, Tang S G, et al. Study on application of .NET
reflection in automated testing[C]//12th International Conference on
Advanced Communication Technology (ICACT). 2010: 797-800.
[10] Patwa P. Hybrid test automation frameworks implementation using
QTP[J]. Technical Article.
[11] Jain A, Jain M, Dhankar S. A Comparison of RANOREX and QTP
Automated Testing Tools and their impact on Software Testing[J].
IJEMS, 2014, 1(1): 8-12.
[12] Bhargava A. Designing and Implementing Test Automation Frameworks
with QTP[M]. Packt Publishing Ltd, 2013.
[13] Kaur H, Gupta G. Comparative Study of Automated Testing Tools:
Selenium, Quick Test Professional and Testcomplete[J]. Harpreet kaur et
al Int. Journal of Engineering Research and Applications ISSN, 2013:
2248-9622.
[14] Wang F, Du W. A test automation framework based on
web[C]//Computer and Information Science (ICIS), 2012 IEEE/ACIS
11th International Conference on. IEEE, 2012: 683-687.
[15] Jain A, Jain M, Dhankar S. A Comparison of RANOREX and QTP
Automated Testing Tools and their impact on Software Testing[J].
IJEMS, 2014, 1(1): 8-12.
[16] Xie Q, Grechanik M, Fu C. Rest: A tool for reducing effort in script-
based testing[C]//Software Maintenance, 2008. ICSM 2008. IEEE
International Conference on. IEEE, 2008: 468-469.
[17] Nagowah L, Roopnah P. AsT-A simple automated system testing
tool[C]//Computer Science and Information Technology (ICCSIT), 2010
3rd IEEE International Conference on. IEEE, 2010, 9: 301-306.

147