Professional Documents
Culture Documents
Volume 17 Issue 1
T SEKGWELEO
Cape Peninsula University of Technology
Cts330ci@gmail.com
T IYAMU*
Cape Peninsula University of Technology
IYAMUT@cput.ac.za
* corresponding author
ORCID NR: https://orcid.org/0000-0002-4949-094X
ABSTRACT
Organisations rely on software in providing services to its clients and business partners. Due to this reliance, the
quality of software contributes to dictating the type of services that some organisations provide, which in return,
influence their relationship with clients and partners. For this reason many organisations focus on the quality of
software, which makes testing critical. The challenge is that various factors influence the software testing in an
organisation. The objective of this study was to examine the factors that influence the software testing and
evaluation in an organisation in the automotive industry. The qualitative methods and case study approach were
applied in the case. The data were analysed by following the interpretivist approach, which was guided by two
theories: actor network theory (ANT) and diffusion of innovation (DOI). Based on the findings from the analysis, a
framework was developed, which can guide an understanding of the factors that influence software testing and
evaluation in this specific organisation as well as a guide for other organisations.
Key phrases
ANT; case study; DOI; software testing and qualitative methods
1. INTRODUCTION
Organisations either develop or purchase software for business purposes (Iyamu,
Sekgweleo & Mkhomazi 2013:607). Such software requires testing prior to its
implementation to ensure that it functions as expected. Software testing is performed by
following software quality standards to identify defects and flaws in the software and ensures
they are removed (Sowunmi, Misra, Fernandez-Sanz, Crawford & Soto 2016:2). It is for this
reason that organisations require skilled personnel, software testers, who understand
various types of testing as well as the right tools that enable them to properly conduct
software testing and evaluation. Through the use of testing tools, software testers, generate,
manage and execute the testing of software in a specific environment maintained for a
particular type of test (Bhardwaj 2015). According to Abbas, Sultan and Bhatti (2017:40),
with the automation of software testing tools, software testers can reliably test the software
in less time and repeatedly reuse those tools to retest the software.
The software testing process is required early in the life cycle, prior to any system coding
and during each of the stages preceding implementation (Munassar & Govardhan 2010:96).
According to Skidmore (2006:51), methodologies such as V-Model provide a relationship
between development and testing in ensuring proper testing and quality assurance
throughout the entire project life cycle. Kasurinen (2012:18) suggests that a test process
encompasses test planning & control, test analysis & design, test implementation &
execution, evaluating exit criteria, reporting and test closure activities.
Software testing can be conducted manually and also through automation testing tools
(Mishra, Ostrovska & Hacaloglu 2017:931). Irrespective of the tools or approaches that are
employed in the testing of software, there are challenges (Gautam & Nagpal 2016:10291).
Bamotra and Randhawa (2017:123) argue that manual testing is time consuming, resource
intensive and allows some defects to remain uncovered. Automation tools, then, enable
automation testers to record and replay those test cases or user actions which could be
performed manually by a software tester (Singh & Tarika 2014:1510).
The objective of this study was to examine the factors that influence the testing and
evaluation of software in a South African organisation. This was done through the lenses of
ANT and Roger’s DOI, because of the theories’ focus. In ANT, human and non-human are
actors, and of equal capability (Callon 1986:197). The theory focuses on formulation of
socio-technical networks with aligned interests, including the relationship and interaction
between the actors within the networks (Effah 2012:5). DOI focuses on the innovation of
technologies that is communicated to the members of social system through certain
communication channels to masses over time (Chang 2010:1).
3. LITERATURE REVIEW
Software development is a process of developing a software system following a particular
system development methodology (Bassil 2012:745). The systems development life cycle
(SDLC) is a practical and systematic process adopted by software developers in developing
software, enabling the software development team to plan, develop and control the way in
which software is developed (Amlani 2012:9). According to Bukhari, Faisal and Hira
(2014:2), SDLC consists of various stages including the collection of requirements, design,
development, testing and implementation. SDLC methodologies can be either traditional or
agile.
It is essential to have clear business requirements before developing and testing the
software in order to deliver quality software. Problems relating to user requirements, when
determined later in the software development process, often negatively impact the software
cost (Sener & Karsak 2012:21). These problems might be realised as early as the planning
stage if the software testing is involved early in the software development life cycle. Software
inspection enables the software testing team to systematically detect defects in all stages of
software development (Qazi, Shahzadi & Humayun 2016:11). This practice assists in
exposing defects early so that they can be fixed in time. It is easier to detect and correct
defects sooner rather than later in the software development life cycle. There is various
software testing methods that can be employed to test the software.
There are two common types of testing methods, which are black box (functional) and white
box (structural) testing (Mishra et al. 2017:934). In black box testing, the software is tested
upon expected output; the tester does not need to know the internal workings condition of
the software (Dhiman & Sharma 2016:508). In white box testing the software tester tests
both the functionality as well as the internal workings of the software (Jamil, Arif, Abubakar &
Ahmad 2016:178). In the use of any of the methods, the tools and testers make a difference
in the testing and evaluation of software in many instances (Nidhra & Dondeti 2012:30).
4. RESEARCH METHODOLOGY
The qualitative methods and the case study approach were applied in this study. This is
primarily because the qualitative methods focus on assisting empirical answers with regards
to people's behaviour, opinions and cultures (Linsley, Kane & Barker 2019:93). The case
study method was employed because the approach is considered most suitable in an
environment where there are large numbers of variables in a small number of applied units
of analysis when the context is of great importance, as in this study (Henderson 2016:8).
Hollweck (2015:108) argues that a high-quality case study puts emphasis on rigour, validity
and reliability. A South African organisation was selected for the study. The organisation was
given a pseudo name, Mootledi Logistics, because the organisation wanted its identity
preserved. Based on research code of code, the organisation’s request had to be adhered
to.
The semi-structured interview technique was used to collect data. A total of 14 employees in
both business and IT units, at various levels were interviewed. The researcher ended the
interview process at the total of 14, because there was no new information that was
forthcoming. The selection of the technique was influenced by its characteristics, as asserted
by Alshenqeeti (2014:40) “a semi-structured interview has a more flexible version of the
structured interview as it allows depth to be achieved by providing the opportunity on the part
of the interviewer to probe and expand the interviewee's responses”. This allows for the
opportunity to record conversations, take notes, refine questions and clarify things that were
unclear during the interviews process, which enriched the data. In the process, the
interviewees were assured of anonymity, and their right to privacy was upheld. This formed
part of the ethical considerations for this research. In addition, some documents that relate to
the study in the areas of organisational structure, standards and policies were granted
access by respondents.
The interpretivist approach was employed in the analysis of the data. The approach was
guided by ANT (Callon 1986:226) and DOI (Rogers 1995:17). ANT was applied first,
followed by DOI, primarily because it was critical to first establish the formulation and
existence of networks so as to know how the technology can be diffused in the
environment. It was also necessary to first understand the tools, methods, and relationships
between the actors involved in software testing, prior to assessment of innovative and
diffusion.
The DOI focuses on innovation, and how they are diffused within an environment (Rogers
1995). The theory has been used for many years to examine the processes by which
innovations are diffused and communicated within environments (Chang 2010). According to
Overhage and Schlauderer (2012), DOI theory clarifies the why, and at what rate innovations
gets diffused to a social system over a period of time. The theory is not concerned with the
respective actors and their interactions, which ANT covers.
A total of 14 employees participated in the study. For the purpose of this study, and analysis
of the data, the participants and the organisation were assigned code-name: ML for the
organisation (Mootledi Logistics) and 01 to 14 for the participants, which can be read as
ML01 to ML14. The code name makes referencing easier during analysis. For example,
ML01, 5:1-3 refers to: the organisation ML, first participant, page number 5, and line
numbers 1 to 3.
5.1 Actors
At Mootledi Logistics, both human and non-human actors were involved in the testing and
evaluation of software. The human actors were from both the information technology (IT)
and business departments. The actors had a common interest, to achieve the objectives of
the organisation through software testing, evaluation and use. The actors from the IT
department included project managers, business analysts, software developers and software
application manager. From the business department perspective, the actors were business
end-users, including business managers, and employees from finance, sales, operations,
fleet services, human resources and risk management units. The non-human actors in the
testing of software within the organisation fell into two categories: technical and non-
technical (i.e. business managers, business analysts, and end users), with technical
including hardware, software and network. Some hardware for enabling and supporting
software testing and evaluation included personal computers, servers and scanners.
Operating systems and software testing tools such as Mentis and Selenium were involved in
the testing of software in the organisation. The network consists of a local area network
(LAN), wide area network (WAN) and Wi-Fi. The non-human actors involved in the testing
and evaluation of software in the organisation included documentation, process and
methodology. The process that was followed was defined by the organisation. The
methodology was agile method (i.e. Scrum). It is a transparency enabler, used to deliver a
framework that leads to sustainable and continuous improvement. One of the participants
explained: “We make use of N-Unit for integration testing; we use Selenium for automated
web testing. Part of the agile methodology was followed in the delivering of software in an
iterative and efficient manner” (ML01, 08:0283-0284).
5.2 Networks
In Mootledi Logistics, groups and units (networks) were involved in testing and evaluation of
software. These networks were divided into two main groups: the IT and business
departments. Within the main networks, there were sub networks. Some networks also
replicated themselves within other networks, which ANT refers to as heterogeneity. The
networks were consciously and unconsciously formed. From the IT department perspective,
the networks involved in the testing and evaluation of software were divided into two
categories: technical and non-technical factors. The networks that focused on technical
factors were the IT steering committee, a team of project stakeholders, a project
management office (PMO), and a software development team.
the focal actors (software development manager) for reaching a common goal, which was to
test and evaluate software in the organisation.
Those who were responsible for conducting software testing and evaluation within Mootledi
Logistics included software developers, business analysts and business users. It was vital
for them to properly and rigorously test the software before it could be deployed to
production for use. It is always better and less expensive to discover faults while the
software is still in the testing environment (because they could be fixed) rather than when it
is in the production environment. Faults discovered by business users in the production
environment can have dire consequences on the image of the organisation. One participant
stated that: “With proper software testing we minimise faults coming back and forth which
saves a lot of time and it enables us to deliver quality software” (ML09, 46:1665-1666).
Discussions regarding software testing and evaluation took place at the redline meetings
that occurred within the organisation. Redline meetings focuses on taking critical decision
such as adoption of solution. The meetings are attended only by managers of teams within
the organisation. The meeting is on regular basis, which also helps to improve the
relationship between managers and their subordinates including business and IT
departments. It was an ongoing process of improving how things were done within the
organisation, enabling all parties involved in the testing and evaluation of software to be on
the same page (to have the same understanding). It also assisted managers in providing
more information about the requests they have logged to avoid rolling out software that
remained within the business without being used. The IT operations manager further stated
that: “I think the link between business and IT department is being defined much better than
what it was before, and it would encourage the better output within the IT department”
(ML02, 19:0699-0701).
Lack of processes within the organisation made it impossible to deliver the requested
software. Previously the organisation had no proper quality assurance processes in place
and the employees did not conduct thorough testing of the software developed. Poor
analysis as well as no proper functional requirements specifications negatively affected the
testing and evaluation of software. The software development and support manager
highlighted that: “We had no process previously and it was a question of let’s test this
software a little bit” (ML01, 13:0454-0455).
The actors had diverse interests in the testing and evaluation of software within the
organisation. Their interests were influenced by various factors. From a management
perspective, they were expected to ensure that software was in place to enable business
users from various departments to perform their day-to-day duties, to serve customers and
to provide customers with self-service software. Those departments included finance, risk
and fleet department even to the point of Mootledi Logistics’ customers. “The end users can
be as broad as the public (customers), anyone who can go to our web site and reserve a
vehicle from the web site” (ML01, 03:0079-0080).
The interest of teams and individuals was triggered by lack of quality assurance processes
and standards especially for conducting software testing and evaluation within the
organisation. Other teams, such as software development and business analysis, had their
own standards which they followed when doing their tasks. When software had to be tested
and evaluated, there was no software testing standard that was followed. The software
developers, business analysts and business users shared the responsibility of testing and
evaluating software. The various team standards were followed to conduct software testing:
“The software developer’s standard may not be exactly the same as the tester standard or
the business analyst standard because they may not know what exactly the expectations
are” (ML07, 45:1395-1396).
Some employees were interested in the software testing and evaluation, because they were
bound by the performance contract signed with their line managers on behalf of the
organisation. These performance contracts were used to assess the performance of
individual employees and teams concerning effectiveness and productivity, assisting
managers to identify employee strengths and weakness. As a result, relevant training was
provided to develop those who lacked in skill. Performance contracts were also used to
determine whether actors were eligible for salary increases or bonuses. Actors were
expected to perform their duties as agreed with their managers: “It is part of our annual
employee performance” (ML01, 11:0381).
While several efforts were made by managers to stir interest for the proposed solution to the
problematisation of software testing and evaluation, the building of interest among the
employees could not be regarded a success. Not all actors who were interested participated
in the testing and evaluation of software. It is for this reason that the enrolment of employees
was not completely successful as some employees were not willing to take part in the testing
of software and evaluation.
Even though there was no dedicated software testing team within Mootledi Logistics, some
kind of software testing was conducted. Software developers conducted unit testing and
end-to-end testing, business analysts conducted functional testing and business users
conducted user acceptance testing (UAT). This was to ensure that when the software was
handed over to the business department for use, it functioned as expected. The
responsibility of the IT department was to enable the business department to execute its
day-to-day functions of serving customers: “Currently we don’t have software testing teams,
so testing is conducted by software developers, business analysts, business users and even
the production support personnel” (ML13, 63:2302-2303).
As stated earlier in the previous stage, interest from employees was either of a voluntary or
obligatory nature, or both. The roles and responsibilities allocated to them during the
development, testing and evaluation of software. These managers used their managerial
discretion to enrol the employees in the network responsible for testing and evaluating
software: “The managers from different teams got to decide who they wanted to place on the
project based on their skills” (ML10, 47:1719-1720).
The IT managers ensured that they enrol competent, skilled and dedicated employees who
would fulfil their roles in the testing and evaluation of software. Mootledi Logistics relied on
software for competitiveness and sustainability. Therefore, new software was developed,
and existing software upgraded when a need arose. It was important for managers to have
strong teams to fulfil these needs: “There is diverse software that requires testing within our
organisation, therefore, we conduct different types of testing in order to test and evaluate
them” (ML01, 01:0010-0011).
Without quality assurance processes in place, it was difficult for those who were testing and
evaluating software to deliver quality software. Previously, the organisation was following the
traditional methodologies, such as waterfall, to develop, test and evaluate software. They
used to encounter challenges such as changes in requirements, business users not knowing
exactly what they want, software taking too long to be completed and late inclusion of
business users in the software development life cycle. Re-examining user requirements and
re-developing the software cost the organisation both time and money. Now the organisation
has moved into agile software development such as scrum to improve on challenges which
they previously faced: “Traditional methodologies are not as flexible as agile because with
waterfall if a requirement is missed or has changed you have to wait until the software is
deployed to production and then log a change request” (ML10, 50:1832-1835).
It is through functional software that Mootledi Logistics is able to function and serve its
customers. The IT department’s responsibility is first and foremost to deliver quality
functional software. Mootledi Logistics seems not to be concerned much about performance
testing. Performance testing is another important aspect of software testing and evaluation
for determining how the software performs in terms of responsiveness and stability under a
particular workload. There were no tools within the organisation that enabled the software
developers to check the performance. Performance testing provides confidence that when
the software is deployed to production it would be able to respond well under strenuous load
on the network. The software developers were improvising the performance element within
the code they were writing when developing the software: “I take much time to actually make
sure that the efficiency in the processing is there so that the code I am writing will not slow
the software” (ML12, 58:2098-2100).
The CEO sponsored the entire initiative of developing, testing and evaluating the software.
This software was going to be used by business users to serve customers and perform their
day-to-day duties. The managers of various teams persuaded their subordinates to be part
of the network to deliver quality software. The scrum master mobilised teams by ensuring
that they delivered accordingly and also reported progress to the business owner: “The
scrum master and the team held sprint meetings to plan and communicate about the
activities that needs to be done” (ML13, 64:2330-2331).
Mobilisation occurred through various platforms, including redline meetings as well as scrum
meetings. Redline meetings used to be attended only by managers to discuss progress and
issues within the project. Business users were formerly excluded but now they are included
in those meetings because managers were unable to provide some crucial information
regarding projects. Due to agile adoption, now there are scrum meetings attended by the
members of the same team to discuss challenges and progress: “During the scrum meeting
everyone has to report about what they have done and what they are going to do” (ML14,
69:2518-2519).
It was always helpful to provide feedback to the product owner in order to know the progress
about the software requested. Such feedback was also critical for project sponsors because
no one wanted to waste the organisation’s time and money on something that was not
achievable or something that was failing. Therefore, feedback persuaded all the actors to do
their best to deliver the tested and evaluated software. At the end of the day, the requested
software had to be signed off and accepted by business owners and business users: “Then
there was UAT whereby the business user runs through the testing in order to accept the
software” (ML01, 06:0211-0212).
Therefore, product owners had to mobilise their teams to make use of the software that had
been thoroughly tested and evaluated. The business team became the focal actor because
the testing and evaluation of the software was initially instigated by them. The management
was encouraged by the task of mobilisation which was linked to their performance
appraisals. Mobilisation was successful, and employees were excited about the contribution
in the testing and evaluation of software.
The comprehension of the requested software was very important to the software
development team as it enabled the team to develop, test and evaluate the software. It was
important for everyone involved in the software development life cycle to have a clear and
It was the responsibility of the software development team to seek clarity on vague business
requirements in order to develop the correct software, as it is a challenge to develop and test
software with ambiguous business requirements. Some of the software developers and
software testers had to be innovative in clarifying vague business requirements in order to
do precisely what was expected from them. There were instances, for example, whereby
software developers were issued three pages of business requirement specifications which
were not clear. As a result, they had to liaise with business analysts as well as business
users to find the necessary clarity. One of the software developers stated that: “I would
rather sit with the business users to get clarity, liaise with the business analysts and then
start developing the software because jumping straight into software development without
understanding what was required leads to back and forth which wastes time” (ML14,
69:2502-2504).
This team was interested in the innovation (requested software) and it actively looked for
related information in order to develop, test and evaluate this software. Each individual had
to actively play his role so that the team could succeed in delivering quality software. The
business analysts liaised with business users in order to find out what they really wanted in
order to document the business requirements. The entire software development team
(scrum) was dependent on the business requirement specification to perform their duties.
Failure in working as a team would negatively impact the output as well as delay the delivery
timelines of the IT department. Consequently, the product owner as well product sponsors
would be dissatisfied with the IT department delivering the software later than the agreed
timelines. The business department only expected what they have requested on the agreed
timelines. They wanted software that would make their lives easier in terms of performing
their duties and servicing customers: “With proper software testing we minimise faults
coming back and forth which save a lot of time, money and it enables the IT department to
deliver quality software” (ML09, 46:1665-1666).
The UAT is preceded by system integration testing (SIT) which helps the software
development team to verify whether the subsystems constituting the software solution work
as expected and cooperate in a streamlined manner. A variety of software testing needed to
be conducted for delivering software that met business requirements. During software
development, software developers conducted unit testing which was termed developer
testing at Mootledi Logistics. Unit testing is a software development process in which the
smallest testable parts of the software, called units, are individually and independently tested
for proper operation. This type of testing increased the confidence of software developers
that when handing over the software to the business analysts and business users to test, it
was fully functional. This was unfortunately not always the case at Mootledi Logistics: “The
biggest challenge is that the software developers don’t test the software properly the first
time because they are expected to test it before deploying it to the testing environment but
when the software is handed over to the business analysts to test it just keeps on failing”
(ML07, 37:1354-1356).
The organisation had a definite need to improve how software was developed, tested and
evaluated. Previously, the organisation followed traditional methodologies such as waterfall
to develop software. Some participants stated that the waterfall methodology was too rigid,
which caused delay in the gathering and compilation of the requirements specification. This
is was because business users were involved too late in the software development process.
As a result, business requirements changed while the software was being developed. Also
software developers, software testers, business intelligence personnel and support
personnel had to wait for the requirements specification to be completed before performing
their duties. As a result, by the time the software development was completed, the
technology had already changed or advanced. The one software developer asserted that:
“The biggest issues in technology is that by the time you are done with the waterfall project
the business rule has changed so what you are delivering doesn’t apply anymore” (ML12,
59:2168-2170).
Due to the above waterfall weaknesses, the organisation decided to adopt scrum agile
methodology. Risks associated with scrum include losing a team member without
transferring knowledge, reprioritization of product backlog, which may result in termination of
one or more sprints. This sometimes result in loss of time or a particular technology not
working sufficiently which may force the team to consider alternative plan. Scrum is
designed for teams of three to nine software developers who divide their work into actions
that can be completed within sprints. The scrum team holds daily scrums (stand-up
meetings) to report on progress, issues and the way forward. With agile methodology,
business users were involved from the beginning of the project because they needed to
verify all the functionalities they had requested. This was to avoid late requirements
changes. The changing of software development methodologies as well as the use of
software testing tools was aimed at improving software development, software testing and its
evaluation. This was the step in the right direction in terms of delivering quality software.
The process was that after deployment, the software is tested to ensure it fulfils the business
users’ requirements. The responsibility of the production support team was to ensure that
the new software was always available for use and functional at all times. They also
maintained the existing and new software, assisted business users with technical production
matters, carried out necessary research and provide in-depth analysis for resolving
production issues. They were also expected to know and understand how all the software
they maintained functioned. One business analyst stated that: “At the end of the day the
production support needs to support the software” (ML07, 39:1418).
The manager who requested software for their department had to use the power bestowed
on him to encourage staff to actually use the new software. Staff needed to understand, that
the software was meant to simplify the day-to-day duties as well render services more
efficiently to Mootledi Logistics customers. At Mootledi Logistics, any problems arising within
the department needed to be attended to as soon as possible to ensure the efficient running
of the department. Unresolved problems within the department would certainly have a
negative impact on the organisation itself. Every department within the organisation has to
function effectively for the entire organisation to be competitive.
Some of this software, such as the organisations’ web site, enables customers to serve
themselves. Customers are able to make bookings and reserve cars through the website, at
their personal convenience, without having to be physically present at the Mootledi Logistics
premises. The organisation had to develop efficient software that would enable it to
maximise profits. Another participant asserted that: “The organisation must ensure that the
software it implements saves time and make the work environment friendlier” (ML06,
34:1247-1248).
Business user output indicated that the organisation made the right decision by
implementing this new software. The organisation was heading in the right direction by
introducing this new software which enhanced efficiency of services. The IT operations
manager confessed that the organisation is not there yet but: “I think we are heading in the
right direction hopefully we would get there” (ML02, 19:0682-0683).
of software; and 5) lack of standards and procedures. Figure 1 depicts these factors and
their relation to each other.
These factors are empirically revealed to influence testing and evaluation of software in
Mootledi Logistics. The factors can also be used by organisation similar settings or
challenges to guide testing and evaluation of software in their environments. These factors
are discussed below.
Network of Employees
Business Analyst
Business End-User
Framework
Standards, Procedures
Some of the implications arising from the lack of testing framework were as follows: (1) there
was no handover from one employee to another for smooth continuance of the process until
completion; (2) there were inconsistencies in how testing was conducted, which
detrimentally impacted the quality of some software in the organisation; (3) software testing
and evaluation sometimes took longer to complete because employees might have been
testing the same scenarios over and over without realising that these were tested before; (5)
defects in software were hardly traced or tracked; and finally, (5) some crucial scenarios
were missed as a result of poor structure, improper processes and many employees testing
the same software.
Also, the organisation did not have a dedicated software testing team to perform testing and
evaluation activities of software that were developed within the organisation. Software
testing is a specialised field and requires a dedicated team. Software testers have to be
trained and equipped with the necessary skills for testing various types of software, and at
any given time. The lack of management involvement and weak commitment did not entice
many of the employees to commit to the concept of testing either. This frequently impacted
the quality of software that was developed and managed in the organisation.
Rather than following the organisational structure, some employees identified themselves
through interaction during the testing and evaluation of software. As result, some employees
felt comfortable only working with certain other employees. After development, the software
is hand-over to the business analyst or business end-user with whom they felt comfortable
working with, for testing and evaluating.
That became the normative practice by some employees to determine who would test which
software. The implication of performing testing and evaluation of software in that fashion
compromised the quality of software. If the business analyst or business end user was a
friend to a software developer, they would be lenient in testing and evaluating the software,
thereby imploring favouritism. As a result, software was not always properly or thoroughly
tested. Those who were strict and thorough in testing and evaluating software were often
bypassed or avoided because they were capable of detecting defects, which some software
developers were uncomfortable with, in that it exposed their inability to produce quality work.
Poor quality software stirred dissatisfaction from the customers. Customer couldn’t receive
the products and services rendered to them, services included booking of vehicles online. As
a result, business end users as well as customers couldn’t perform their duties because of
dysfunctional software. While organisations believe in keeping their customers happy at all
times, with poor quality software, it is impossible to achieve that.
Standards and procedures also assist in selecting software testing tools and how to utilise
those tools. It is a wasteful expenditure to purchase software testing tools and not know how
to use them.
8. CONCLUSION
Software testing is the most essential part of systems development life cycle as it helps
determine whether the software is of quality or not. Quality software is reasonably bug or
defect free, delivered on time and within budget, meets requirements and expectations and
is maintainable. ISO 8402-1986 standard defines quality as "the totality of features and
characteristics of a product or service that bears its ability to satisfy stated or implied needs".
With quality software, organisations are able to function and provide necessary services to
its clients. Many organisations as well as Mootledi Logistics are faced with various
challenges including lack of testing framework, management not showing interest in the
testing and evaluation of software, lack of software testing standards and procedures which
results in delivering poor quality software. As a result, the organisation is not able to provide
necessary services to clients. For this reason, it was important to understand the factors
influencing the testing and evaluation of software in order to deliver quality software. There
was a need for a framework to guide the organisation in making informed decisions about
testing the software as well as eradicating challenges that are encountered during software
testing. Failure in recognising that, could likely result in organisations implementing poor
quality software at all times. This article will add value to software developers, software
testers, software managers and academics.
Poor quality of software has implications for management of the organisation. Some of the
implications are as follows: (1) business is interrupted unnecessarily, which negatively
affects the image of the organisation; (2) it is the responsibility of the management team to
ensure that employees are trained and equipped with software testing skills as well as
knowledge for using those tools; and (3) although software testing tools can be expensive
but they can as well save excessive time and money in the long run. The influencing factors
guide and enable employees to create test requirements, test cases, and execute test cases
appropriately in increasing quality.
REFERENCES
ABBAS R, SULTAN Z & BHATTI SN. 2017. Comparative analysis of automated load testing tools: Apache
JMeter, Microsoft Visual Studio (TFS), LoadRunner, Siege. Communication Technologies (ComTech) 39-44.
(DOI:10.1109/COMTECH.2017.8065747.)
ALSHENQEETI H. 2014. Interviewing as a data collection method: A critical review. English Linguistics
Research 3(1):39-45. (DOI:https://doi.org/10.5430/elr.v3n1p39.)
AMLANI RD. 2012. Advantages and Limitations of Different SDLC Models. International Journal of Computer
Applications & Information Technology 1(3):6-11. [Internet:http://www.ijcait.com/IJCAIT/13/1334.pdf; downloaded
on 26 May 2015.]
BAMOTRA A & RANDHAWA AK. 2017. Software Testing Techniques. International Journal of Innovative
Computer Science & Engineering 4(3):122-126. [Internet:https://www.citefactor.org/search/keywords/articles/
Software+Testing+Techniques; downloaded on 07 November 2017.]
BASSIL Y. 2012. A Simulation Model for the Waterfall Software Development Life Cycle. International Journal of
Engineering & Technology 2(5):742-749. [Internet:https://arxiv.org/pdf/1205.6904.pdf; downloaded on 26 May
2015.]
BHARDWAJ S. 2015. Performance Testing Tools: A Comparative Analysis. International Journal of Engineering
Technology Management and Applied Sciences 3(4):100-105. [Internet:https://pdfs.semanticscholar.org/aca4/
b3bf1f9213a65e5c4f23637df5de495d478d.pdf; downloaded on 20 February 2016.]
BUKHARI A, FAISAL S & HIRA K. 2014. A comparative study on usage of traditional and agile software
development methodologies in software industry of Asia. Athens. (International Conference on Software
Engineering Research and Practice (SERP); 1-8.)
CALLON M. 1986. Some Elements of a Sociology of Translation: Domestication of the Scallops and the
Fishermen of St Brieuc Bay. In Law J. Ed. Power, Action and Belief: A New Sociology of Knowledge. London:
Routledge. (pp 196-232.)
CHANG H. 2010. A New Perspective on Twitter Hashtag Use: Diffusion of Innovation Theory. Proceedings of the
American Society for Information Science and Technology 47(1):1-4. (DOI:10.1002/meet.14504701295.)
DHIMAN S & SHARMA P. 2016. Performance Testing: A Comparative Study and Analysis of Web Service
Testing Tools. International Journal of Computer Science and Mobile Computing 5(6):507-512.
[Internet:https://pdfs.semanticscholar.org/aca4/b3bf1f9213a65e5c4f23637df5de495d478d.pdf; downloaded on
07 November 2017.]
EFFAH J. 2012. Mobilizing Culture for E-Business in Developing Countries: An Actor Network Theory Account.
The Electronic Journal on Information Systems in Developing Countries 52(5):1-18.
(DOI:https://doi.org/10.1002/j.1681-4835.2012.tb00370.x.)
FAROOQ SK & QUADRI SMK. 2013. Empirical Evaluation of Software Testing Techniques - Need, Issues and
Mitigation. Software Engineering: An International Journal (SEIJ) 3(1):41-51. [Internet:http://seij.dtu.ac.in/vol-
3/issue-1/paper4.pdf; downloaded on 20 February 2016.]
GAUTAM S & NAGPAL B. 2016. Descriptive Study of Software Testing & Testing Tools. International Journal of
Innovative Research in Computer and Communication Engineering 4(6):10288-10295.
(DOI:10.15680/IJIRCCE.2016. 0406006.)
HENDERSON S. 2016. Research Methodology. International Journal of Sales, Retailing and Marketing 4(9):1-
97. [Internet:http://www.ijsrm.com/ijsrm/Current_&_Past_Issues_files/IJSRM4-9.pdf; downloaded on 07
November 2017.]
HOLLWECK T. 2015. In Robert K. Yin. (2014). Case Study Research Design and Methods . Thousand Oaks,
CA: Sage. 282 pages. Canadian Journal of Program Evaluation 30(1):108-110. (DOI:10.3138/cjpe.30.1.108.)
HOODA I & CHHILLAR RS. 2015. Software Test Process, Testing Types and Techniques. International Journal
of Computer Applications 111(13):10-14.
[Internet:http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.695.1299&rep=rep1&type=pdf; downloaded
on 20 February 2016.]
IYAMU T, SEKGWELEO T & MKHOMAZI SS. 2013. Actor Network Theory in Interpretative Research Approach.
IFIP International Federation for Information Processing 605-610. (DOI:https://doi.org/10.1007/978-3-642-38862-
0_41.)
JAMIL MA, ARIF M, ABUBAKAR NSA & AHMAD A. 2016. Software Testing Techniques: A Literature Review.
(6th International Conference on Information and Communication Technology for the Muslim World). (pp 177-
182). (DOI:https://doi.org/10.1109/ICT4M.2016.045.)
KASURINEN J. 2012. Software Organizations and Test Process Development. Advances in Computers 85:1-63.
(DOI:https://doi.org/10.1016/B978-0-12-396526-4.00001-1.)
LINSLEY P, KANE R & BARKER JH. 2019. Evidence-based practice for nurses and healthcare professionals.
Thousand Oaks, California: Sage Publications Inc. (pp 91-154.)
MISHRA D, OSTROVSKA S & HACALOGLU T. 2017. Exploring and expanding students’ success in software
testing. Information Technology & People 30(4):927-945. (DOI:https://www.researchgate.net/deref/http%
3A%2F%2Fdx.doi.org%2F10.1108%2FITP-06-2016-0129.)
MISHRA S & PRADHAN A. 2012. Software Testing Techniques Adopted in Corporate Sectors: A Precise Study.
International Journal of Emerging Technology and Advanced Engineering 2(9):290-295.
[Internet:http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.413.5837&rep=rep1&type=pdf; downloaded
on 20 February 2016.]
MUNASSAR NM & GOVARDHAN A. 2010. A Comparison between Five Models of Software Engineering. IJCSI
International Journal of Computer Science Issues 7(5) 94-101. [Internet:http://citeseerx.ist.psu.edu/viewdoc/
download?doi=10.1.1.402.8120&rep=rep1&type=pdf#page=115; downloaded on 20 February 2016.]
NIDHRA S & DONDETI J. 2012. Black box and white box techniques - A literature review. International Journal
of Embedded Systems and Applications 2(2):29-50. (DOI:https://www.researchgate.net/deref/http%3A%2F%
2Fdx.doi.org%2F10.5121%2Fijesa.2012.2204.)
OVERHAGE S & SCHLAUDERER S. 2012. Investigating the Long-Term Acceptance of Agile Methodologies: An
Empirical Study of Developer Perceptions in Scrum Projects. (45th Hawaii International Conference on System
Sciences). (5452-5461.) (DOI:https://doi.org/10.1109/HICSS.2012.387.)
QAZI AM, SHAHZADI S & HUMAYUN M. 2016. A Comparative Study of Software Inspection Techniques for
Quality Perspective. International Journal of Modern Education and Computer Science 8(10):9-16.
(DOI:10.5815/ijmecs.2016.10.02.)
ROGERS EM. 1995. Diffusion of innovations. 4th ed. New York: Free Press. (pp 15-23.)
SALEH MF. 2011. An Agile Software Development Framework. International Journal of Software Engineering
(IJSE) 2(5):97-106. [Internet:http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.740.6970
&rep=rep1&type=pdf; downloaded on 20 February 2016.]
SANG HA & TSAI DR. 2009. Analyzing Strategies of Integrating ICT into Teaching Activities Using Innovation
Diffusion Theory. (5th International Joint Conference on INC, IMS and IDC. (pp 1876 -1878.)
(DOI:https://doi.org/10.1109/NCM.2009.323.)
SEKGWELEO T. 2015. Understanding Traditional Systems Development Methodologies. International Journal of
Advances in Management and Economics 4(3):51-58. [Internet:https://www.managementjournal.info/index.php/
IJAME/article/view/370; downloaded on 20 February 2016.]
SENER Z & KARSAK EE. 2012. A decision model for setting target levels in software quality function
deployment to respond to rapidly changing customer needs. Concurrent Engineering Research and Applications
20(1):19-29. (DOI:https://doi.org/10.1177%2F1063293X11435344.)
SINGH I & TARIKA B. 2014. Comparative Analysis of Open Source Automated Software Testing Tools:
Selenium, Sikuli and Watir. International Journal of Information & Computation Technology 4(15):1507-1518.
(DOI:10.13140/2.1.1418.4324.)
SKIDMORE S. 2006. The V-model. Professional Scheme Paper 2:48-49. [Internet:https://pdfslide.net/documents
/automatisert-testing-av-dynamisk-html-idintnuno-automatisert-testing-av.html; downloaded on 26 May 2015.]
SOWUNMI OY, MISRA S, FERNANDEZ-SANZ L, CRAWFORD B & SOTO R. 2016. An empirical evaluation of
software quality assurance practices and challenges in a developing country: a comparison of Nigeria and
Turkey. SpringerPlus 5(1):1-13. (DOI:https://doi.org/10.1186/s40064-016-3575-5.)