Professional Documents
Culture Documents
net/publication/347747846
CITATIONS READS
2 944
5 authors, including:
Some of the authors of this publication are also working on these related projects:
Edition, Publication and Visualization of Geoservices Using Open-Source Tools View project
All content following this page was uploaded by Antonio Quiña-Mera on 28 June 2021.
José Antonio Quiña-Mera1,2 [0000-0003-2516-9016], Luis Germán Correa Real1, Ana Ga-
briela Jácome Orozco1, Pablo Andrés Landeta-López1[0000-0002-2914-8696], Cathy Pamela
Guevara-Vega 1,2 [0000-0002-2470-8287]
1
Universidad Técnica del Norte, Facultad de Ingeniería en Ciencias Aplicadas, Ecuador
2 Network Science Research Group e-CIER, Ecuador
Abstract. Many software projects worldwide fail due to the lack of two aspects
of quality in the development process or the resulting software product. The sci-
entific community and the industry have developed and made available methods
and best practices to control these two aspects to face this problem. However,
several countries' regulations must also be considered, which must modify or
complement these methods. This research seeks to define a software development
project management model based on the Government by Results (GBR) frame-
work complemented by methodologies and best practices to guarantee its quality
and provide a comprehensive development service. And software maintenance
for internal and external clients of public institutions in Ecuador. A type of action
research was applied to carry out the study, structured as follows: 1. Research
design, 2. Theoretical foundation, 3. Development of the management model, 4
Evaluation of the management model (case study carried out in the Public Insti-
tution Yachay EP), 5. Results. As a result, an artifact framework for the manage-
ment of software development projects was obtained. The case study (software
project) shows that for every dollar invested in the project, $1.64 is recovered
during one year after its execution. Besides, the management model evaluated
the project with an average level of satisfaction since it optimizes the develop-
ment area's critical resources. It also found that the perception of the service
should be improved.
1 Introduction
The current market is very competitive; it is not enough to produce and distribute
products and/or services; it is necessary to do it with quality to achieve customer ac-
ceptance. According to Moreno, quality does not have a concept; it is only recognized
[1]. However, quality in software is a complex concept that is not directly comparable
2
to a product [2]. For this reason, finding quality in software has become one of the main
strategic objectives for organizations, since their most important processes and often
their survival depends on the flawless operation of the software [3]. In the software
development process, it is essential to establish and implement a reference framework
or methodologies that allow quality to be measured throughout the software product
[4]. Currently, most software projects are governed by one or more methods. The use
of these will depend on the context in which the project is developed. The existing
methodologies in the market are of various types: traditional, agile, real-time, among
others, but always governed by processes and aimed at the control and assurance of the
quality of the software product [5]. In Ecuador, in addition to using the methodologies
above, state regulation applies to software projects carried out in state institutions that
must be framed in the Government by results (GBR) regulations [6].
This research aims to define a software development project management model that
ensures product quality and complies with the GBP regulations in public institutions in
Ecuador. The management model's design will be carried out by combining various
methodologies and acceptable development practices complemented by GBP regula-
tions. This model will be carried out in the context of a case study of the Public Insti-
tution (Yachay E.P.).
This work is structured as follows: Section I. Introduction, where the problem, jus-
tification, and objective of the investigation are defined. Section II. Materials and meth-
ods describe the research design and methodology, conceptual basis, and development
of the management model (research proposal). Section III. Case study: Implementation
of the developed management model. Section IV Results shows the results obtained
from the case study. Section IV. Discussion, with similar works. And finally, Section
V. Conclusions and recommendations.
This section defines the research methodology phases, the participants, and the specific
objectives of the project (see Table 1).
Investigation type. In this work, action research in the field was chosen to research an
active actor within the context of public institutions in Ecuador to find solutions to
software development problems. The study was carried out in the software development
area of the Yachay E.P. Ecuador.
Research method. The chosen method to evaluate the research and the proposed man-
agement model was the case study. As a case study, this method was implemented in a
software development project to automate the document storage and archiving process
of Yachay E.P.
Population and sample. The study population comprises a work team made up of
seven developers, two coordinators, and a director of the software development area.
Due to the investigated population does not exceed 100 elements, we used the entire
universe without drawing a representative sample.
This section conceptualizes the topics, standards, methodologies, and best practices
used in developing the software development management model for public institutions
in Ecuador.
Management model. It takes a set of administrative activities such as planning, coor-
dination, measurement, monitoring, control, and reporting that ensures systemic, quan-
tifiable, and disciplined project management [7]. Management models are work
schemes for entities administration concerning strategy, processes, people, and results
to achieve excellence. Organizations allow them to govern, order, direct, organize and
arrange a set of developed actions to administer or manage a project [8]. The manage-
ment model pillars must be aligned with the mission, vision, and values of the organi-
zation. The three pillars are: processes, technology, and people, which will achieve the
proposed objectives and ensure optimal results; these pillars can be reviewed at the
following weblink1 [9].
Software development project management. It determines the previous prediction of
the cost, time, money, resources, tasks, and quality of a software development project.
These activities distributed throughout the project, correcting changes over time as pre-
venting risks [10]. Furthermore, it aims to improve the project so that it is successful
[11].
Cockburn, his work "The Heart of Agility," encourages agility and emphasizes four
essential aspects: collaboration, delivery, reflection, and improvement [22].
Analysis. The management model responds to the study of the prioritization of in-
ternal and external needs in the context of public institutions, the regulations to be fol-
lowed by the control entities, and the guidelines and best practices of referential frame-
works. For the development of the management model, the GRP balanced scorecard,
PMI's best practices were considered. However, to complement the model, it is neces-
sary to use the IT Government COBIT 5 reference framework that allows establishing
the levels of governance and administration of the operation in software development
areas and maintenance of public institutions. Considering that software development is
a computer service, it was necessary to include ITIL best practices and agile philosophy
to design processes oriented to service and internal customer satisfaction. Finally, to
give transparency and follow-up to the procedures carried out in the model, it was com-
plemented with metrics based on the Balanced Scorecard. The design of the model was
carried out by the technology manager, the director, an architect, and three software
analysts from the Yachay E.P. The structure of the theoretical foundation for the devel-
opment of the management model was carried out as follows (see Fig. 1).
Policies
COBIT GBP PMI
Standards, processes
and procedures COBIT PMI ITIL AGILE
Balanced
Scorecard GBP Balanced Scorecard
Management Model Framework. The Framework has one policy guide, one policy
guide, one process, and three procedures. Besides, the documentation has 20 artifacts
needed to carry out the following phases of software development and maintenance:
start, planning, execution, monitoring, and closing of software projects. The templates
7
of the components of the management model Framework are available at the following
weblink6.
To establish the Balanced Scorecard, the model will measure and evaluate the
productivity and performance of software development processes to control, manage
and continuously improve the methods to achieve the strategic indicator and the mis-
sion of the area of institution development. For this, Balanced Scorecard - KMI of
Kaplan and Norton [23] was used, which will evaluate the management of the devel-
opment area with four perspectives: financial, the satisfaction of delivery, internal pro-
cesses, development, and learning of team members. The indicators used are as follows,
see Table 4.
Table 4. Balanced scorecard indicators recovered from (Kaplan & Norton, 1992).
Indicators
Financial indicators 1. Return of investment - ROI
Delivery satisfaction indicators
2. Delivery satisfaction
Internal process indicators 3. Number of incidents found in the testing
and certification stage
4. Number of incidents found in production
5. Hours earned per project
6. Productivity per member of the project
team
Indicators of development and 7. Project research percentage
learning 8. Project innovation percentage
Each indicator has a technical and methodological sheet that shows how it is calcu-
lated. The technical and methodological guides can be downloaded at the following
weblink7.
The evaluation of the management model was carried out with a case study about im-
plementing a software development project for the public institution Yachay E.P., con-
sidering the functional requirements [24]. The context of the case study is described
below. See Table 5.
We developed the project with the artifacts described in the Management Model
Framework (Table 3) and used several model frameworks tools. The activities carried
out, the tools used, and the documents generated throughout the project development
phases. The complete Software Development Project (case study) can be downloaded
at the following weblink8.
3 Results
The result of the management model for software projects proposes a Framework (see
Table 3) that is made up of one policy guide, one norm guide, one process, three pro-
cedures, and 20 artifacts for documentation in the phases: start, planning, execution,
monitoring and closing of software projects. The artifacts to use will depend on the
technology and type of project (software implementation or maintenance).
The case study result shows in the integral scorecard of the project, see Table 6.
Number of inci-
dents found
Hours gained from Effective productivity 0.94
the project Estimated productivity 0.94
1
Team productivity
Project investiga- Research hours 80
16.00%
tion Total project hours 500
Number of inci- Hours of innovation 120 24.00%
dents found Total project hours 500
The Balanced Scorecard results show that the financial perspective was beneficial
for the institution because the project's cost was higher than the estimated benefits and
allowed to invest that difference in tasks of operational value. The cost of the project
will be recovered in less than the first year of using the system. The model implemented
the previous Quality Assurance (QA) review in each phase, which allowed to reduce
incidents, reprocessing, and maximizing team members' knowledge. The number of
incidents in the production stage strengthened the customer's perception of who re-
ceived a stable system (retrieved from the Satisfaction survey). The project had a 6%
deviation in planning, which means that each requirement was underestimated in 1.5
hours, causing a non-significant late delivery of the software product; this was quickly
alerted in project implementation stages as part of risk management and timely com-
munication with the requesting area.
For the evaluation of team productivity, the average of the team members' produc-
tivity was considered, which showed a slight gap in their learning curve because of the
change in project management and operation. The first assessment of the adoption of
the method is the initial state of the equipment; following evaluations for the project
manager should consider the actions necessary to potentiate each member's skills and
reduce the learning gap. In the context of the project's implementation, it invested 16%
of the team's effort to conduct research and 24% in tasks that generated operational
innovation and knowledge management for the institution.
The satisfaction survey was carried out on nine requesting users of the project to
assess customer satisfaction, and 15 days was given to fill it out after submitting the
project. The survey generates quality metrics: 75,56% usability, 81,11% performance,
74,81% efficiency, and 77,78% effectiveness. The results are shown as a percentage
reached concerning the expected value. The average satisfaction of the software project
is 77.31%, equivalent to 3.51 on the Likert scale. This result, validated in the balanced
scorecard's technical and methodological guide, classifies the project with a medium
level of satisfaction. The result suggests the opportunity for improvement in the four-
quality metrics, depending on the needs of the project stakeholders.
4 Discussion
To organize business processes, several authors generate proposals that combine frame-
works and methodologies to optimize their current approaches to provide a better
10
service. Alfaraj and Qin [25] report a proposal to implement an integrated model be-
tween CoBIT and CMMI using plugins of the ITIL, CoBIT, and ISO / IEC 22007
frameworks generated a template for integrating frameworks of job. The authors clarify
that the model will provide benefits to the organizations that implement it; They can
reduce the complexity of the decision-making process, determination, identification,
validation, and description of the area where they use it. We agree with Hussain's model
in combining several frameworks in our case, CoBIT, ITIL, PMI, Agile Philosophy,
and GBP, to improve a public institution's software development process and meet the
government requirements of results requested by external government entities. This
proposal was complemented by evaluating the model by executing a case study. In the
execution and development of the case study, it was observed that the institution's im-
provement began since a process was formally established with the necessary instru-
ments for its operation and monitoring. Furthermore, we were complimented by the
measurement through an integrated scorecard of indicators that measure the financial
perspectives, the satisfaction of delivery, processes, and learning of a project's work
team.
When executing the case study, it was observed that the model promotes the estab-
lishment of more realistic objectives in the projects, reduced incidences of errors,
thereby optimizing resources and reducing software costs, and also increases the con-
fidence of the management of the software development area. On many occasions, the
projects that require changes are not always well-received by all users; this directly
influences the software product's quality. It was evident that developing and imple-
menting management models (proposal) showed a deficit of trained personnel, which
requires a training plan for several team members. It was also evident that senior man-
agement's support and commitment is an essential point to implement projects of this
type because it requires effort in terms of training, organization, and change in business
culture.
5 Conclusions
In this research, we were able to study and integrate several methodologies and frame-
works to propose a software development project management model that ensures the
quality of the software product and complies with the GBR (Government by results)
regulations that apply to public institutions in Ecuador.
The proposed model integrated governance and IT administration processes recom-
mended by COBIT 5; the IT balanced scorecard was aligned with the Government for
Results (RBM). The project management structure was established with PMBOK®
(PMI) practices to manage internal and external applicants' software development
needs. The agile philosophy applied in the model helped to organize the effort and re-
lationships of the work team. It was based on ITIL to establish management processes
for software maintenance. Finally, the documentation proposed by the model met the
parameters of internal and external audits of the public institution without falling into
excessive and unnecessary documentation; on the contrary, the submitted
11
documentation was a source of knowledge and experience that will serve for subsequent
software projects.
We evaluated the model through a case study applied in a public institution in Ecua-
dor. We found that the application of the model improved the management, monitoring,
and quality control of the software development process and the software product and
improved the direction of the institution's software maintenance.
The results of applying the model in the case study were shown through the compre-
hensive scorecard in four perspectives: financial, satisfaction in delivery, internal pro-
cesses, development, and learning of team members. The improvements obtained are
1) Traceability of the software development area's work, where there was a favorable
change in the process and product quality. 2) Organization and clarity of the project
team's functions allowed to establish a stable communication flow to achieve the pro-
ject's objective. 3) Diagnosis of the productivity of the development area members in-
dividually and as a team, which allowed the establishment of professional development
plans for each of them. 4) Develop software features focused on customer needs, which
were refined at each stage of development, which reduced the repetition of tasks and
issued early warnings of change to the original scope. 5) Timely identification of risks
and problems to take measures to minimize and mitigate the impact on the project. 6)
Accessible and public documentation of the project's execution that will serve as a ref-
erence for future projects, which can take advantage of the knowledge of the institu-
tion's software development area. Finally, it was possible to have a tool for project
evaluation and prioritization based on estimated financial indicators.
Despite the positive results of the model's application, it must be taken into account
that such models are subject to the variation of government regulations and regulations.
References