Professional Documents
Culture Documents
DOI: 10.1049/sfw2.12041
- -Revised: 5 June 2021
O R I G I N A L R E S E A R C H PA P E R
Accepted: 22 June 2021
- IET Software
1
Centro de Investigación en Matemáticas‐Unidad Abstract
Zacatecas, Zacatecas, México
Around the world, the importance of Very Small Entities (VSEs), organisations having up to
2
Computer Science Department, CUCEI of the 25 people, has been constantly increasing. Worldwide, VSEs represent over 92% of the
Universidad de Guadalajara, Guadalajara, México
3
software industry. Therefore, two main needs can be highlighted: a) providing VSEs with
Department of Software and IT Engineering, École
resources to produce high‐quality software, and b) training software engineering un-
de Technologie Supérieure, Montréal, Québec,
Canada dergraduates in proven practices to produce high‐quality software within the given schedule
4
Facultad de Ingeniería, Universidad de Medellin,
and budget. A logical way to meet these needs is transfering proven practices provided by
Medellin, Colombia software engineering standards. However, transferring the knowledge of software engi-
neering standards is not always an easy task. The ISO/IEC 29110 is a series of international
Correspondence standards and guides that provide codified knowledge related to the software development
Jezreel Mejía, Centro de Investigación en process. The series was specifically developed to be used by VSEs. This study presents an
Matemáticas‐Unidad Zacatecas, Parque Quantum,
Ciudad del Conocimiento Av. Lasec Andador
exploratory analysis, conducted in 12 Mexican VSEs, which implemented the software Basic
Galileo Galilei Manzana 3 Lote 7, 98160, 98068 profile of the ISO/IEC 29110, to identify the pace at which they can adopt this standard to
Zacatecas, México. their environment. Besides, the benefits and difficulties encountered are provided. The
Email: jmejia@cimat.mx
results can be relevant for other VSEs interested in implementing this standard. Even if the
exploratory analysis was performed in the VSEs of Mexico, this analysis can be of interest in
other countries. The results obtained can help other VSEs that are interested in the adoption
of this international standard to reduce the barriers to a successful implementation.
KEYWORDS
software development management, software engineering, software management, software process
improvement, software quality
-
This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is
properly cited.
© 2021 The Authors. IET Software published by John Wiley & Sons Ltd on behalf of The Institution of Engineering and Technology.
characteristics such as a lack of knowledge and practical Because of their specific features, it becomes important to
experience regarding the implementation of SPI models and analyse the needs to perform software process improvement
standards. VSEs also must work hard to survive, and they lack activities from the human perspective. To address this
enough employees dedicated to SPI activities [2–5, 7–9]. perspective, this research study began focussing on identi-
The motivation to perform this research increased due to fying the factors that motivate and affect the implementation
the importance of VSEs as the main producers in a supply of the ISO/IEC 29110 standard [10].
chain of software products since they frequently develop The main results of this first exploratory analysis are
software for medium and large companies or organisations [1, 3]. summarised in Table 1.
TABLE 1 Factors that motivate and affect the implementation of the ISO/IEC 29110
Why did you invest resources to get certified? Processes, VSEs mentioned that they will achieve the Implementation of a structured way of
implementation of processes, and therefore, they will developing software has a positive impact
be more effective in software development.
Customers, VSEs consider that they will obtain Recognition of customers has a positive impact
recognition with an international standard and attract
more customers.
SPI project/reference models, VSEs mentioned that they
will ensure the quality of software projects because
they are working under the ISO/IEC 29110 standard.
What difficulties did you have in the Processes, VSEs had never developed software using Lack of experience using international standards
implementation of the ISO/IEC 29110? documented processes. has a negative impact
Learning and growth/skills, VSEs suffer the lack of
collaboration of the teammates, as there is no
knowledge of processes and there is no structured
way of working.
Organisation/culture, VSEs mentioned the resistance to
change to work under a formal or systematic way to
develop software.
What difficulties did you have to obtain the ISO/ Learning and growth/skills, VSEs present a lack of The resistance to change of the organisational
IEC 29110 certification? experience in performing some activities related to culture has a negative impact
quality such as architecture, design, verification, test
definition, and execution.
SPI project/reference models, VSEs mentioned that it was
the first time they applied a standard. They had to get
comprehension and a practical understanding of it.
What benefits did you have as a result of the Processes, VSEs mentioned that they achieved a Implementation of a structured way of
certification to the ISO/IEC 29110? definition, documentation, and implementation of developing software has a negative impact
processes for developing their software projects.
Customers, VSEs mentioned an increase in awareness
of the need to work under a quality standard.
What benefits did you have in the implementation Financial, VSEs mentioned the government's support in Economical support has a positive impact
of the ISO/IEC 29110? sponsoring a percentage of the cost of the
implementation and certification.
Learning and growth/skills, VSEs mentioned the Technical support has a positive impact
support from a research centre in training, reviewing,
and providing recommendations that helped them to
have a better understanding of the standard and how
to implement it within their organisations based on
their particular way of work.
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
414
- MUÑOZ ET AL.
After studying the results, the authors of this study wanted roadmap of four profiles that could be selected by a VSE ac-
to know the implementation pace as well as the benefits cording to its specific needs; (2) it has two processes as the
identified by VSEs. Therefore, these two questions motivated foundation for project management and the software imple-
this study: (1) what is the pace at which VSEs can adopt mentation; (3) it works in VSEs using any development
practices of the ISO/IEC 29110 standard? (2) Are VSEs able approach, methodology or tool; and (4) it provides a step‐by‐
to perceive the benefits of the practices of the software engi- step guide based on a set of process elements such as the
neering standard implemented? objective, activities, task, roles and work products.
This study presents the second study of a series of It is worth mentioning that, currently, Mexico has 81 of the
exploratory studies focussed on 12 VSEs of the Zacatecas state 129 VSEs certified to the software Basic profile of the ISO/
of Mexico that have implemented the software Basic profile of IEC 29110 standard in Latin America, which means that 63%
the ISO/IEC 29110. It is important to mention that the of Latin American VSEs certified to this standard are Mexican
software Basic profile is presently the only profile in which a VSEs [13]. Over 37% of other Latin American VSEs that
VSE can be certified. Therefore, the analysis is focussed on obtained a certification to the Basic profile are from Columbia
how they have adopted the proven practices of the Basic and Peru.
profile of the ISO/IEC 29110 standard and how they
perceived the utility of the practices provided by the standard.
We are confident that this analysis will help to reduce the 2.2 | Related works
potential barriers towards having a successful implementation of
the ISO/IEC 29110 for VSEs interested in the implementation The models and standards for the software industry are elab-
of this standard, such as the lack of experience in using a stan- orated to contribute to the development of quality products
dard. To be able to use a standard, VSEs must understand the within the budget and schedule, by optimising the efforts and
engineering and management practices to be carried out. VSEs resources. Nevertheless, their implementation in software
also have to identify the practices in which their people will need development organisations presents a great challenge. This fact
training or additional effort to implement them. is evidenced by researchers identifying such challenges [1–10,
After the Introduction, the rest of the paper is organised as 14–16]. But, only a few of them performed an analysis of the
follows: Section 2 provides the background of this research factors that impact the implementation of this standard; this
including why the ISO/IEC 29110 is interesting for the section briefly describes some of them [3, 14–17].
Mexican software industry, the related works, and an overview Larrucea, O’Connor, Colomo‐Palacios, and Laporte in [3]
of the software Basic profile of the ISO/IEC 29110 standard. provided a study of hurdles that VSEs must face in the
Section 3 provides an exploratory analysis performed to iden- implementation of Software Process Improvements as well as
tify how the practices were adopted by 12 VSEs as well as their the opportunities that its implementation offers. Their study
perception of the benefits provided by the software engineering was conducted based on the software industry experience of
practices of this standard. Section 4 presents the discussion, and authors in multiple countries. The results showed a set of 10
finally, Section 5 provides the conclusion and future work. barriers and 8 opportunities classified into four categories:
financial, skills, culture, and reference models.
Davila and Pessoa in [14] performed a case study in a
2 | BACKGROUND company in Peru to identify both positive and negative factors
that drive the implementation of the software Basic profile of
2.1 | Why is the ISO/IEC 29110 interesting the ISO/IEC 29110. They implemented a questionnaire to
for the Mexican software industry? perform the analysis for three targeted projects within the
company. They identified the experience in IT and top man-
The National Survey on Productivity and Competitiveness of agement support as factors that positively influence the
Micro, Small, and Medium Enterprises (ENAPROCE by its implementation of the ISO/IEC 29110. They also identified
Spanish acronym) published in 2018 in Mexico noted that competitive pressure, perceived usefulness, perceived ease of
Mexico has around four million enterprises and 97% of them use, and user training as factors with a negative influence on
are VSEs [11]. This highlights the importance of the role that the implementation of the ISO/IEC 29110.
VSEs play in supplying the chain of software to cover the Wongsai, Siddoo, and Wetprasit in [15] performed a study
software market demand. in Thailand to identify the negative and positive factors that
Therefore, pushing the competitiveness by the use of in- impact the implementation of the software Basic profile of the
ternational models and standards has been prioritised in ISO/IEC 29110 in VSEs. They analysed 15 papers from a
Mexico with the implementation of the ISO/IEC 29110 sys- Systematic Literature Review they evaluated through ISO
tems and software engineering series. The ISO/IEC 29110 has standard's experts to analyse its potential. They identified six
been recognised as one quality standard for the Mexican factor categories: finance, customer, internal business pro-
software industry to support VSEs to face challenges such as cesses, learning, and growth, organisation, and SPI project
improving productivity and quality with minimum costs [12]. programme; each category has a set of negative and positive
This standard presents a set of characteristics that makes it factors. Finally, they pointed out the importance of the effec-
attractive to Mexican VSEs, as follows [12]: (1) it provides a tive management of the available resources, staff turnover, and
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 415
individual skills and experience as valuable factors for the VSEs developing small projects of less than 6‐person month; (2)
implementation of the ISO/IEC 29110. the Basic profile is addressed to VSEs developing one product
Sanchez‐Gordon, O’Connor, and Colomo‐Palacios in [16] by a single team; (3) the Intermediate profile is addressed to
presented an analysis, based on the grounded theory, to un- VSEs developing more than one project in parallel with more
derstand the issues that affect the adoption of the ISO/IEC than one work team, and (4) the Advanced profile is addressed
29110 including VSEs from Ireland and Ecuador. They per- to VSEs that want to sustain and grow as an independent
formed a qualitative analysis of data resulting in three cate- competitive system or a software development business.
gories and six subcategories as follows: (1) the level of interest According to [1, 8, 12, 18], the four software profiles have
and awareness with two subcategories: high awareness on the two fundamental processes in common: the Project Manage-
standard and standard benefit awareness; (2) the level of ment (PM) process and the Software Implementation (SI)
acceptance with two subcategories: low acceptance and less process:
priority; and (3) barriers towards the standard adoption with
two subcategories: the perceived need and the resource de- 1. Project management process. This process aims to establish
mand. Their results for the first category showed that VSEs and carry out the tasks related to project management in a
have a very low level of acceptance and low priority for quality systematic way to complete it with the expected quality,
models and standards. Regarding the second category, the time, and costs of the project's objectives. This process is
results showed that due to the high level of awareness of composed of four activities: project planning, project plan
quality standards as well as the knowledge of its advantage, execution, project assessment and control, and project
VSEs are interested in a standard adoption in a short time. closure.
Finally, for the third category, they discovered the need for 2. Software implementation process. This process aims to
more guidelines and assistance to encourage and/or attract the perform in a systematic way, the activities related to the
attention of VSEs towards the implementation of quality analysis, design, construction, integration, and tests, ac-
standards. cording to the requirements specified of a new or modified
Lucho, Melendez, and Dávila in [17] presented an analysis software product. This process is composed of six activities:
of the environmental factors affecting the adoption of the initiation, analysis, design, construction, integration and
ISO/IEC 29110 standard. The analysis is based on a multiple tests, and delivery.
case study including four organisations. From a total of 16
environmental factors, the authors identified 5 factors that It is important to highlight that, nowadays, the ISO/IEC
influenced all organisations: partners support, vertical linkage, 29110 has only one certifiable software profile, the Basic
and trust with partners are the factors related to the top profile. Therefore, the analysis presented in this study was
management support an SPI with a positive influence; and the focussed on this profile.
partners' defence and globalisation influenced all organisations,
even when these factors have not been identified as barriers or
success factors in previous studies. Finally, they argued that the 3 | RESEARCH APPROACH
partner support factor must be supervised carefully during the
implementation of the ISO/IEC 29110. This section presents the results of the second exploratory
analysis that was performed on a set of organisations in México
to identify, in a qualitative way, the pace at which they were able
2.3 | The ISO/IEC 29110 series to adopt and adapt the practices provided by the ISO/IEC
29110 as well as the perception of the benefits.
To help VSEs unlock the use of quality standards, the ISO/ In the following paragraphs, we describe the three steps
IEC 29110 has been developed as a set of standards and guides performed: (1) design of an online questionnaire to collect
designed to cover the VSEs' needs [6]. The ISO/IEC 29110 data, (2) data collection strategy, and (3) data analysis.
series provides standards and guides with a minimal subset of
international engineering standards called profiles for VSEs
[1, 3, 8]. 3.1 | Design of an online questionnaire to
This standard is targeted to VSEs that do not develop collect data
critical products and have little or no experience in the use and
improvement of processes from systems engineering or soft- This step was focussed on the development of a questionnaire
ware engineering lifecycle standards for example ISO/IEC/ as an instrument to collect data from VSEs. We decided to
IEEE 12207 [1, 8, 18]. Additionally, one characteristic that provide a set of questions that were easy to answer, not taking
makes this standard attractive for VSEs is that it can be used too long for the VSE to complete. The following constraints
with any development approach such as waterfall, incremental, were then established:
evolutionary, iterative, and agile approaches [1, 8, 18].
The ISO/IEC 29110 standard has four software profiles to � No more than 12 questions per process.
be selected by an organisation according to its specific needs � The questions should be developed focussing on each
[1, 8, 18]: (1) the Entry profile is addressed to start‐ups and practice of the ISO/IEC 29110 and should allow registering:
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
416
- MUÑOZ ET AL.
(a) the year in which the practice was implemented and (b) complete questionnaire is available at https://forms.gle/GF
how the utility of each practice is perceived. rsbah6XuKyAW2BA.
� One question per process focussed on the benefits A brief description of the questionnaire is as follows:
perceived by the VSEs with the implementation of the
standard. To obtain the data related to the benefits, a list of � The questionnaire has three sections: general data, project
benefits was developed using the expected benefits provided management process questions, and software implementa-
in part 5 as a reference, and the purpose and objectives of tion process questions.
each process (i.e. project management and software process � The general data aims to collect two types of data: the year
implementation) provided by the software Basic profile of the VSEs implemented the Basic profile of the ISO/IEC
the ISO/IEC 29110 [12]. 29110, and the type of VSE (e.g. a software development
centre of a university or a software development
A 23‐question questionnaire with only multiple‐option organisation).
answers was designed as shown in Figure 1. � The project management section aims to obtain information
As illustrated in Figure 1, the questionnaire was related to each activity provided by the standard, to obtain
conducted in Spanish because the sample of VSEs was more detailed information. The questionnaire focussed on
from Mexico. Figure 1a shows the section aimed at the set of tasks provided for each activity. This section
obtaining the general data; Figure 1b shows an example contains nine questions:
of the questions aimed at obtaining the information about ◦ Four questions, one per project management activity (i.e.
the pace of each practice implementation; Figure 1c project planning, project plan execution, project assess-
shows an example of the questions aimed at obtaining the ment and control, and project closure), asking to select
information about the perception of the practice's utility; the year in which each practice was adopted.
and Figure 1d shows an example of a general question ◦ Four questions, one per project management activity (i.e.
asking about the benefits observed by a VSE after con- project planning, project plan execution, project assess-
ducting an entire implementation of the standard. The ment and control, and project closure), asking to select an
figure also lists the purpose and objectives of the project option in four‐scale values (i.e. very useful, useful, little
management process and the software implementation useful, or not useful) on how each practice is perceived by
process provided by the ISO/IEC 29110 [12]. The the VSE.
FIGURE 1 The questionnaire developed to collect data from Very Small Entities
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 417
◦ One question in which, from a set of previously defined Table 2 provides a summary of the sample of VSEs
benefits, the VSE selects the benefit(s) that they have participating in this research, the information provided includes
obtained. the number of employees (size), the software development
� The software implementation section aims at obtaining in- approach, the number of years using the standard (years), the
formation regarding each activity provided by the standard. application domain (specifying if it is an industry), the type of
This section of the questionnaire focussed on the set of software whether it is from academic domain, a spin‐off or a
tasks provided for each activity. This section contains 13 software development centre (SDC) of a university.
questions:
◦ Six questions, one per software implementation activity
(i.e. initiation, analysis, design, construction, integration 3.3 | Data analysis approach
and tests, and delivery), asking to select the year in which
each practice was adopted. To perform this exploratory analysis, the authors performed
◦ Six questions, one per project management activity (i.e. the following steps:
initiation, analysis, design, construction, integration and
tests, and delivery), asking to select in four‐scale values 1. To consolidate the data provided in the sections regarding the
(i.e. very useful, useful, little useful, or not useful) on how year of adoption of the practices and the observed benefits.
each practice is perceived by the VSE. 2. Illustrate the data graphically to analyse each practice
◦ One question in which, from a set of previously defined implementation pace from both processes: the project
benefits, the VSE selects the benefit(s) that have been management and the software implementation.
obtained. 3. Establish a relationship between the practices' imple-
mentation pace findings with the observed benefits.
4. Synthesise the results by consolidating the information
3.2 | Data collection strategy obtained in step 3.
VSE9 5 Waterfall/Scrum 2 Industry department in an SME developing software for the mining industry
(PM.2.5) were identified by VSE1 as practices that took 3 and shows the results of the year of adoption of the two tasks of
4 years, respectively, to be completely adopted. this activity.
As shown in Figure 5, all VSEs were able to adopt the two
Project assessment and control activity practices provided by this activity within the first year. These
This task is related to the evaluation of the performance of the practices are related to the formalisation of the completion of
project against the commitments documented in the project the project concerning the delivery instructions documented in
plan [12]. Figure 4 shows the results of the year of adoption of the project plan (PM.4.1) and the updation of the project re-
the three tasks of this activity. pository (PM.4.2).
As shown in Figure 4, 10 VSEs were able to have a
complete implementation of the practice establish actions to
correct project deviations or problems (PM.3.1). 4.1.2 | Analysis of the adoption of the
However, the practices evaluate the progress concerning software implementation process
the project plan (PM.3.2) and the use of change requests to
document changes to requirements and/or the project plan This section provides the analysis related to the adoption of the
(PM.3.3) were highlighted by VSE1 as practices that took four practices provided by each of the four activities of this process:
years to be completely adopted.
Software implementation initiation activity
Project closure activity This activity is conducted to ensure that the work team is
This task is related to the formalisation of the closure of the committed to the project plan [12]. Figure 6 shows the results
project according to the contract requirements [12]. Figure 5 of the year of adoption of the two tasks of this activity.
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
420
- MUÑOZ ET AL.
As shown in Figure 6, all VSEs were able to have a Software architectural and detailed design activity
complete implementation of the two practices provided by this This activity is related to the transformation of the software
activity within the first year. These practices are related to requirements by producing a software architecture and a
presenting the project plan to the work team members and detailed design [12]. Figure 8 shows the results of the year of
engaging them with the project (SI.1.1) and setting up the adoption of the eight tasks of this activity.
implementation environment or updating it (SI.1.2). As shown in Figure 8, most of the VSEs were able to
have a complete implementation of the practices provided
Software requirements analysis activity in this activity within the first year. These practices are
This activity is related to the establishment of the validated related to assigning tasks to the project team according to
requirements for a project [12]. Figure 7 shows the results of the their role (SI.3.1), getting an understanding of the re-
year of adoption of the seven tasks of this activity. quirements' specification (SI.3.2), documenting the software
As shown in Figure 7, all VSEs were able to have a complete design or updating it (SI3.3), verifying the software design
implementation of the practices provided by this activity within (SI.3.4), and verifying the test cases and test procedures
the first year, These practices are related to assigning the tasks to (SI.3.6).
the project team according to their role (SI.2.1), documenting the However, the practices such as establishing the test cases
requirements specification (SI.2.2), verifying the requirements' and test procedures (SI.3.5) were highlighted by VSE1 as a
specification (SI.2.3), validating the requirements' specification practice that took two years to be completely adopted and the
(SI.2.4), documenting the preliminary version of the user practices managing the traceability records (SI.3.7), and
documentation (SI.2.5), verifying the preliminary version of the incorporating produced artefacts to the baseline (SI.3.8) were
user documentation (SI.2.6), and incorporating the artefacts highlighted by VSE1 and VSE12 as the practices that took two
produced to the baseline (SI.2.7). years to be completely adopted.
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 421
FIGURE 8 Adoption of software architectural and detailed design practices by Very Small Entities
FIGURE 10 Adoption of software integration and test practices by Very Small Entities
(SI.5.2) by VSE1, managing the traceability record (SI.5.6) by assigning tasks to the project team according to their role
VSE7, and VSE12; documenting the product operation guide (SI.6.1), incorporating the maintenance documentation to the
(SI.5.7) by VSE12; and verifying the product operation guide baseline (SI.6.5), and delivering the product according to the
(SI.5.8), documenting the user documentation (SI.5.9), and delivery instructions (SI.6.6).
verifying the user documentation (SI.5.10) by VSE7. However, some practices were highlighted by at least one
VSE as practices that took two years to be adopted such as
Product delivery activity getting an understanding of the software configuration (SI.6.2)
This activity provides integrated software to the customer [12]. by VSE1, documenting the maintenance documentation
It is important to mention that software configuration means (SI.6.3), and verifying the maintenance documentation (SI.6.4)
the software and related artefacts (e.g. user manual) that were by VSE7.
committed in the project plan to the customer.
Figure 11 shows the results of the year of adoption of the
six tasks of this activity. 4.2 | Benefits observed
As shown in Figure 11, all VSEs were able to have a
complete adoption of most of the practices provided in this One of the main issues regarding the implementation of a
activity within the first year. These practices are related to standard in a VSE is often the lack of publications related to the
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 423
benefits of using software engineering practices. This is why it is 4.2.2 | Benefits identified with the
important to analyse the perceived benefits of the VSEs for the implementation of the software implementation
sample with the adoption of the practices of the Basic profiles of process
the ISO/IEC 29110 for both processes: Project Management
and Software Implementation processes. A list of 9 benefits was defined. Table 4 shows the benefits
Next, we present an analysis of the benefits identified by selected by VSEs. As Table 4 shows, the benefits selected by
the VSEs. Then, VSEs were asked to choose all the benefits 11 VSEs at the top are (B9) improvement in the software
that were applicable to them. Then, the VSEs had to select the architecture and detailed design, followed by (B1) improve-
benefit(s) in the VSE as a result of the adoption of the ment in the requirements definition and (B3) improvement
standard. in the software tests selected by 10 VSEs. Other benefits such
About the benefits, a percentage of 60% is considered a as (B2) improvement in the traceability of requirements (e.g.
high percentage because it means that at least 8 of 12 VSEs from the approval of requirements to the integration tests),
selected it as an identified benefit. (B5) reduction of project errors, and (B8) improvement in
the control of artefacts produced throughout the project
development were selected by nine VSEs. and (B4) an
4.2.1 | Benefits observed for the project improvement in the identification and correction of errors
management process and (B7) an increase of the customer satisfaction by eight
VSEs.
A list of nine benefits was defined. Table 3 shows the benefits Finally, the benefit (B4) identification of product errors in
selected by VSEs. As the table shows, the benefits selected by the early stages of the project was selected by six VSEs.
11 VSEs at the top are the (B5) improvement in the project
progress monitoring, followed by major project visibility
mentioned by 10 VSEs. Other benefits such as the (B1) 5 | DISCUSSION
improvement in the early stages of the project on the agree-
ment of the project requirements and the expected products to Using the results of the exploratory analysis with a sample of
be delivered to the customer, (B8) improvement in the agree- 12 VSEs, the following findings are highlighted:
ments' documentation, and (B9) improvement in the for- Related to the adoption pace of the Basic profile of
malisation of the project closure were mentioned by nine the ISO/IEC 29110, 55% of the practices were completely
VSEs, and (B2) a disciplined managed process and (B7) adopted by all the VSEs within the first year; 35% were
improvement in the analysis of change requests were completely adopted within the second year by all the
mentioned by eight VSEs. VSEs; 3% of the practices were completely adopted within
Finally, two benefits were identified only by seven VSEs, the third year by all the VSEs and 8% of the practices
(B4) an improvement in the definition and monitoring of were completely adopted within the fourth year by all the
corrective actions, and (B6) improvement in the risk's iden- VSEs.
tification and monitoring from the beginning to closure of Table 5 illustrates the number of years it took by the 12
projects. VSEs to fully implement the project management process
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
424
- MUÑOZ ET AL.
B6 Improvement in the risk's identification and monitoring from the beginning to closure of projects 7 2, 4–6, 8, 10
B2 Improvement in the traceability of requirements (e.g. from the approval of requirements to the 9 1, 2, 4–6, 8–11
integration tests)
B6 Identification of product errors in the early stages of the project 6 2, 4–6, 8,10
B8 Improvement in the control of artefacts produced throughout the project development 9 2–6, 8–11
5.1 | Project management process concern of that VSE was on hardware, and when the VSE
understood the importance of these practices for the soft-
Related to the project management process's practices, we ware, the VSE started using them.
focus on those practices that took 2 or more years to be
completely implemented and were mentioned by 2–4 VSEs:
5.3 | Benefits observed
� VSEs do not invest much time in tasks related to the project
estimation or the project repository background because Regarding the identified benefits from the adoption of the
they do not understand its importance. project management practices, in our previous results related
� VSEs find it difficult to evaluate the project progress to motivators positively impacting the implementation of the
because most of them do not develop estimations as well as standard (see Table 1), they highlighted the implementation of
the registration of the project progress. a structured way of developing software and the new knowl-
� VSEs find it difficult to implement the management of edge obtained. This matches with the new results related to the
change requests because most of them believe that changes benefits expected to implement the standard (see Table 3)
should be accepted because of the high dependency of the because most of the VSEs mentioned the following: B5 by 11
customer. Most VSEs that have demonstrated this behav- VSEs; B3 by 10 VSEs; B1, B8, and B9 by 9 VSEs; and, B2 and
iour, are from an academic domain (VSE1, VSE3, VSE5, B7 by 8 VSEs. These are the results of adopting a structured
and VSE8). The projects were performed by undergraduates way to develop software and of obtaining new knowledge
that do not have too much hands‐on experience about the related to the practices they do not use to perform before.
management of change requests. About identified benefits from the adoption of the software
� VSE7 and VSE9 develop embedded software. They were implementation practices, in our previous results related to
most focussed on hardware and that is the reason why tasks motivators positively impacting the implementation of the
related to the estimation and project monitoring took more standard (see Table 1), they highlighted the implementation of a
than one year to be understood to get a complete structured way of developing software and the new knowledge
implementation. obtained. This matches with the new results related to benefits
� Related to VSE10, from the industry, used agile practices in expected to implement the standard (see Table 4) because most
the first year of the standard adoption. This VSE did not of the VSEs mentioned the following: B9 by 11 VSEs, B1 and
formalise the estimation of the project resources and effort. B3 by 10 VSEs; B2, B5, and B8 by 9 VSEs; and B4 and B7 by 8
The cost estimation was performed by the VSE owner. VSEs. These are the results of adopting a structured way to
� VSE11, from the industry, use some agile practices, and develop software and of obtaining new knowledge related to
have used the standard for 4 years. Because of this, the VSE the practices they do not use to perform before.
develop embedded software; the employees did not pay
much attention to estimating the resources for the software
until they understood its importance. 6 | CONCLUSIONS AND FUTURE
WORK
5.2 | Software implementation process This study presents an exploratory analysis on the pace at which
12 VSEs adopted the proven practices of the software basic
Related to the software implementation process's practices, we profile of the ISO/IEC 29110 standard and the benefits they
focussed on those practices that took 2 or more years to be have identified that are the main contributions of this study.
completely implemented and were mentioned by 2– 4 VSEs: According to the results and the discussion provided, the
first question established in the introduction, ‘What is the pace at
� VSEs have more experience and practice in activities related which VSEs can adopt practices from ISO/IEC 29110?’ can be
to software development. We did not identify practices that answered by highlighting the fact that the software Basic profile
take up more than 1 year, as mentioned by three or four of the ISO/IEC 29110 can be implemented at a pace supported
VSEs. We detected three practices highlighted by VSEs; two by VSEs within the first year. Most importantly, it allows them to
by VSE1 and VSE12 (managing the traceability records understand and analyse the benefits of adopting a structured
(SI.3.7), and incorporating the produced artefacts to the way to develop software and of obtaining new knowledge
baseline (SI.3.8)); and one by VSE7 and VSE12 (managing related to practices they do not use to perform before.
the traceability record (SI.5.6)); all of them are from an It is important to highlight that the VSEs that achieved a
academic domain, where the projects are performed by complete implementation of the practices of the software
undergraduate students. Those VSEs did not have much implementation process in less time was because they paid
knowledge about this topic. It is complicated for them to more attention to software development. However, VSEs have
understand both concepts having little practical knowledge. a lack of using a structured way to perform practices related to
� VSE7, which develops embedded software, is the only VSE the project management process, for example those related to
from an industry domain that did not perform the unit and estimations and the registration of the project progress data
integration tests and test cases definition because the main and its evaluation resulting in an inadequate analysis of the
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
426
- MUÑOZ ET AL.
17. Lucho, S., Melendez, K., Dávila, A.: Analysis of environmental factors in
the adoption of ISO/IEC 29110. Multiple case study. In: Mejia, J., et al. How to cite this article: Muñoz, M., et al.: Beyond
(eds.) Trends and Applications in Software Engineering. CIMPS 2017.
Advances in Intelligent Systems and Computing, vol. 688. Springer,
factors that motivate the adoption of the ISO/IEC
Cham (2018). https://doi.org/10.1007/978‐3‐319‐69341‐5_8 29110 in Mexico: an exploratory study of the
18. Muñoz, M., et al.: Transitioning international software engineering implementation pace of this standard and the benefits
standards to academia: Analyzing the results of the adoption of ISO/IEC observed. IET Soft. 15(6), 412–427 (2021). https://doi.
29110 in four Mexican universities. Comput. Stand. Interfaces. 66, org/10.1049/sfw2.12041
103340 (2019). https://doi.org/10.1016/j.csi.2019.03.008