You are on page 1of 16

Received: 9 March 2021

DOI: 10.1049/sfw2.12041
- -Revised: 5 June 2021

O R I G I N A L R E S E A R C H PA P E R
Accepted: 22 June 2021

- IET Software

Beyond factors that motivate the adoption of the ISO/IEC 29110


in Mexico: An exploratory study of the implementation pace of
this standard and the benefits observed

Mirna Muñoz1 | Jezreel Mejía1 | Adriana Peña2 | Claude Y. Laporte3 |


Gloria Piedad Gasca‐Hurtado4

1
Centro de Investigación en Matemáticas‐Unidad Abstract
Zacatecas, Zacatecas, México
Around the world, the importance of Very Small Entities (VSEs), organisations having up to
2
Computer Science Department, CUCEI of the 25 people, has been constantly increasing. Worldwide, VSEs represent over 92% of the
Universidad de Guadalajara, Guadalajara, México
3
software industry. Therefore, two main needs can be highlighted: a) providing VSEs with
Department of Software and IT Engineering, École
resources to produce high‐quality software, and b) training software engineering un-
de Technologie Supérieure, Montréal, Québec,
Canada dergraduates in proven practices to produce high‐quality software within the given schedule
4
Facultad de Ingeniería, Universidad de Medellin,
and budget. A logical way to meet these needs is transfering proven practices provided by
Medellin, Colombia software engineering standards. However, transferring the knowledge of software engi-
neering standards is not always an easy task. The ISO/IEC 29110 is a series of international
Correspondence standards and guides that provide codified knowledge related to the software development
Jezreel Mejía, Centro de Investigación en process. The series was specifically developed to be used by VSEs. This study presents an
Matemáticas‐Unidad Zacatecas, Parque Quantum,
Ciudad del Conocimiento Av. Lasec Andador
exploratory analysis, conducted in 12 Mexican VSEs, which implemented the software Basic
Galileo Galilei Manzana 3 Lote 7, 98160, 98068 profile of the ISO/IEC 29110, to identify the pace at which they can adopt this standard to
Zacatecas, México. their environment. Besides, the benefits and difficulties encountered are provided. The
Email: jmejia@cimat.mx
results can be relevant for other VSEs interested in implementing this standard. Even if the
exploratory analysis was performed in the VSEs of Mexico, this analysis can be of interest in
other countries. The results obtained can help other VSEs that are interested in the adoption
of this international standard to reduce the barriers to a successful implementation.

KEYWORDS
software development management, software engineering, software management, software process
improvement, software quality

1 | INTRODUCTION competitiveness of software organisations [1–5]. The imple-


mentation of SPI in software development organisations has
The importance to generate software products and services highlighted many challenges related to time, financial support,
capable of solving problems of different domains such employee effort, and particularly the capacity to understand the
as industrial, agricultural, aeronautics, information, and information contained in the international software engineer-
communication technologies, among others, by providing ing standards [6].
high‐performance solutions is increasing, giving software en- These facts become more critical for small organisations,
gineering researchers a great opportunity to contribute to such as those having up to 25 people categorised as Very Small
software development organisations. Entities (VSEs). A VSE can be defined as an organisation (e.g.
In this context, Software Process Improvement (SPI) ac- public or non‐profit organisation), a project, or a department
tivities have been recognised as a logical way to increase the having up to 25 people [1–5, 7–9]. VSEs usually present

-
This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is
properly cited.
© 2021 The Authors. IET Software published by John Wiley & Sons Ltd on behalf of The Institution of Engineering and Technology.

412 IET Soft. 2021;15:412–427. wileyonlinelibrary.com/journal/sfw2


17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 413

characteristics such as a lack of knowledge and practical Because of their specific features, it becomes important to
experience regarding the implementation of SPI models and analyse the needs to perform software process improvement
standards. VSEs also must work hard to survive, and they lack activities from the human perspective. To address this
enough employees dedicated to SPI activities [2–5, 7–9]. perspective, this research study began focussing on identi-
The motivation to perform this research increased due to fying the factors that motivate and affect the implementation
the importance of VSEs as the main producers in a supply of the ISO/IEC 29110 standard [10].
chain of software products since they frequently develop The main results of this first exploratory analysis are
software for medium and large companies or organisations [1, 3]. summarised in Table 1.

TABLE 1 Factors that motivate and affect the implementation of the ISO/IEC 29110

Questions Highlighted factors Motivators and their type of impact


Why implement the ISO/IEC 29110 in your Customer was the most highlighted factor. VSEs Recognition of customers has a positive impact
organisation? mentioned that with the implementation of the ISO/
IEC 29110, they will be able to get new customers or
new markets.
Learning and growth/skills were the other highlighted New knowledge has a positive impact
factors. VSEs mentioned that they will update their
processes, products, or services based on the acquired
knowledge.

Why did you invest resources to get certified? Processes, VSEs mentioned that they will achieve the Implementation of a structured way of
implementation of processes, and therefore, they will developing software has a positive impact
be more effective in software development.
Customers, VSEs consider that they will obtain Recognition of customers has a positive impact
recognition with an international standard and attract
more customers.
SPI project/reference models, VSEs mentioned that they
will ensure the quality of software projects because
they are working under the ISO/IEC 29110 standard.

What difficulties did you have in the Processes, VSEs had never developed software using Lack of experience using international standards
implementation of the ISO/IEC 29110? documented processes. has a negative impact
Learning and growth/skills, VSEs suffer the lack of
collaboration of the teammates, as there is no
knowledge of processes and there is no structured
way of working.
Organisation/culture, VSEs mentioned the resistance to
change to work under a formal or systematic way to
develop software.

What difficulties did you have to obtain the ISO/ Learning and growth/skills, VSEs present a lack of The resistance to change of the organisational
IEC 29110 certification? experience in performing some activities related to culture has a negative impact
quality such as architecture, design, verification, test
definition, and execution.
SPI project/reference models, VSEs mentioned that it was
the first time they applied a standard. They had to get
comprehension and a practical understanding of it.

What benefits did you have as a result of the Processes, VSEs mentioned that they achieved a Implementation of a structured way of
certification to the ISO/IEC 29110? definition, documentation, and implementation of developing software has a negative impact
processes for developing their software projects.
Customers, VSEs mentioned an increase in awareness
of the need to work under a quality standard.

What benefits did you have in the implementation Financial, VSEs mentioned the government's support in Economical support has a positive impact
of the ISO/IEC 29110? sponsoring a percentage of the cost of the
implementation and certification.
Learning and growth/skills, VSEs mentioned the Technical support has a positive impact
support from a research centre in training, reviewing,
and providing recommendations that helped them to
have a better understanding of the standard and how
to implement it within their organisations based on
their particular way of work.
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
414
- MUÑOZ ET AL.

After studying the results, the authors of this study wanted roadmap of four profiles that could be selected by a VSE ac-
to know the implementation pace as well as the benefits cording to its specific needs; (2) it has two processes as the
identified by VSEs. Therefore, these two questions motivated foundation for project management and the software imple-
this study: (1) what is the pace at which VSEs can adopt mentation; (3) it works in VSEs using any development
practices of the ISO/IEC 29110 standard? (2) Are VSEs able approach, methodology or tool; and (4) it provides a step‐by‐
to perceive the benefits of the practices of the software engi- step guide based on a set of process elements such as the
neering standard implemented? objective, activities, task, roles and work products.
This study presents the second study of a series of It is worth mentioning that, currently, Mexico has 81 of the
exploratory studies focussed on 12 VSEs of the Zacatecas state 129 VSEs certified to the software Basic profile of the ISO/
of Mexico that have implemented the software Basic profile of IEC 29110 standard in Latin America, which means that 63%
the ISO/IEC 29110. It is important to mention that the of Latin American VSEs certified to this standard are Mexican
software Basic profile is presently the only profile in which a VSEs [13]. Over 37% of other Latin American VSEs that
VSE can be certified. Therefore, the analysis is focussed on obtained a certification to the Basic profile are from Columbia
how they have adopted the proven practices of the Basic and Peru.
profile of the ISO/IEC 29110 standard and how they
perceived the utility of the practices provided by the standard.
We are confident that this analysis will help to reduce the 2.2 | Related works
potential barriers towards having a successful implementation of
the ISO/IEC 29110 for VSEs interested in the implementation The models and standards for the software industry are elab-
of this standard, such as the lack of experience in using a stan- orated to contribute to the development of quality products
dard. To be able to use a standard, VSEs must understand the within the budget and schedule, by optimising the efforts and
engineering and management practices to be carried out. VSEs resources. Nevertheless, their implementation in software
also have to identify the practices in which their people will need development organisations presents a great challenge. This fact
training or additional effort to implement them. is evidenced by researchers identifying such challenges [1–10,
After the Introduction, the rest of the paper is organised as 14–16]. But, only a few of them performed an analysis of the
follows: Section 2 provides the background of this research factors that impact the implementation of this standard; this
including why the ISO/IEC 29110 is interesting for the section briefly describes some of them [3, 14–17].
Mexican software industry, the related works, and an overview Larrucea, O’Connor, Colomo‐Palacios, and Laporte in [3]
of the software Basic profile of the ISO/IEC 29110 standard. provided a study of hurdles that VSEs must face in the
Section 3 provides an exploratory analysis performed to iden- implementation of Software Process Improvements as well as
tify how the practices were adopted by 12 VSEs as well as their the opportunities that its implementation offers. Their study
perception of the benefits provided by the software engineering was conducted based on the software industry experience of
practices of this standard. Section 4 presents the discussion, and authors in multiple countries. The results showed a set of 10
finally, Section 5 provides the conclusion and future work. barriers and 8 opportunities classified into four categories:
financial, skills, culture, and reference models.
Davila and Pessoa in [14] performed a case study in a
2 | BACKGROUND company in Peru to identify both positive and negative factors
that drive the implementation of the software Basic profile of
2.1 | Why is the ISO/IEC 29110 interesting the ISO/IEC 29110. They implemented a questionnaire to
for the Mexican software industry? perform the analysis for three targeted projects within the
company. They identified the experience in IT and top man-
The National Survey on Productivity and Competitiveness of agement support as factors that positively influence the
Micro, Small, and Medium Enterprises (ENAPROCE by its implementation of the ISO/IEC 29110. They also identified
Spanish acronym) published in 2018 in Mexico noted that competitive pressure, perceived usefulness, perceived ease of
Mexico has around four million enterprises and 97% of them use, and user training as factors with a negative influence on
are VSEs [11]. This highlights the importance of the role that the implementation of the ISO/IEC 29110.
VSEs play in supplying the chain of software to cover the Wongsai, Siddoo, and Wetprasit in [15] performed a study
software market demand. in Thailand to identify the negative and positive factors that
Therefore, pushing the competitiveness by the use of in- impact the implementation of the software Basic profile of the
ternational models and standards has been prioritised in ISO/IEC 29110 in VSEs. They analysed 15 papers from a
Mexico with the implementation of the ISO/IEC 29110 sys- Systematic Literature Review they evaluated through ISO
tems and software engineering series. The ISO/IEC 29110 has standard's experts to analyse its potential. They identified six
been recognised as one quality standard for the Mexican factor categories: finance, customer, internal business pro-
software industry to support VSEs to face challenges such as cesses, learning, and growth, organisation, and SPI project
improving productivity and quality with minimum costs [12]. programme; each category has a set of negative and positive
This standard presents a set of characteristics that makes it factors. Finally, they pointed out the importance of the effec-
attractive to Mexican VSEs, as follows [12]: (1) it provides a tive management of the available resources, staff turnover, and
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 415

individual skills and experience as valuable factors for the VSEs developing small projects of less than 6‐person month; (2)
implementation of the ISO/IEC 29110. the Basic profile is addressed to VSEs developing one product
Sanchez‐Gordon, O’Connor, and Colomo‐Palacios in [16] by a single team; (3) the Intermediate profile is addressed to
presented an analysis, based on the grounded theory, to un- VSEs developing more than one project in parallel with more
derstand the issues that affect the adoption of the ISO/IEC than one work team, and (4) the Advanced profile is addressed
29110 including VSEs from Ireland and Ecuador. They per- to VSEs that want to sustain and grow as an independent
formed a qualitative analysis of data resulting in three cate- competitive system or a software development business.
gories and six subcategories as follows: (1) the level of interest According to [1, 8, 12, 18], the four software profiles have
and awareness with two subcategories: high awareness on the two fundamental processes in common: the Project Manage-
standard and standard benefit awareness; (2) the level of ment (PM) process and the Software Implementation (SI)
acceptance with two subcategories: low acceptance and less process:
priority; and (3) barriers towards the standard adoption with
two subcategories: the perceived need and the resource de- 1. Project management process. This process aims to establish
mand. Their results for the first category showed that VSEs and carry out the tasks related to project management in a
have a very low level of acceptance and low priority for quality systematic way to complete it with the expected quality,
models and standards. Regarding the second category, the time, and costs of the project's objectives. This process is
results showed that due to the high level of awareness of composed of four activities: project planning, project plan
quality standards as well as the knowledge of its advantage, execution, project assessment and control, and project
VSEs are interested in a standard adoption in a short time. closure.
Finally, for the third category, they discovered the need for 2. Software implementation process. This process aims to
more guidelines and assistance to encourage and/or attract the perform in a systematic way, the activities related to the
attention of VSEs towards the implementation of quality analysis, design, construction, integration, and tests, ac-
standards. cording to the requirements specified of a new or modified
Lucho, Melendez, and Dávila in [17] presented an analysis software product. This process is composed of six activities:
of the environmental factors affecting the adoption of the initiation, analysis, design, construction, integration and
ISO/IEC 29110 standard. The analysis is based on a multiple tests, and delivery.
case study including four organisations. From a total of 16
environmental factors, the authors identified 5 factors that It is important to highlight that, nowadays, the ISO/IEC
influenced all organisations: partners support, vertical linkage, 29110 has only one certifiable software profile, the Basic
and trust with partners are the factors related to the top profile. Therefore, the analysis presented in this study was
management support an SPI with a positive influence; and the focussed on this profile.
partners' defence and globalisation influenced all organisations,
even when these factors have not been identified as barriers or
success factors in previous studies. Finally, they argued that the 3 | RESEARCH APPROACH
partner support factor must be supervised carefully during the
implementation of the ISO/IEC 29110. This section presents the results of the second exploratory
analysis that was performed on a set of organisations in México
to identify, in a qualitative way, the pace at which they were able
2.3 | The ISO/IEC 29110 series to adopt and adapt the practices provided by the ISO/IEC
29110 as well as the perception of the benefits.
To help VSEs unlock the use of quality standards, the ISO/ In the following paragraphs, we describe the three steps
IEC 29110 has been developed as a set of standards and guides performed: (1) design of an online questionnaire to collect
designed to cover the VSEs' needs [6]. The ISO/IEC 29110 data, (2) data collection strategy, and (3) data analysis.
series provides standards and guides with a minimal subset of
international engineering standards called profiles for VSEs
[1, 3, 8]. 3.1 | Design of an online questionnaire to
This standard is targeted to VSEs that do not develop collect data
critical products and have little or no experience in the use and
improvement of processes from systems engineering or soft- This step was focussed on the development of a questionnaire
ware engineering lifecycle standards for example ISO/IEC/ as an instrument to collect data from VSEs. We decided to
IEEE 12207 [1, 8, 18]. Additionally, one characteristic that provide a set of questions that were easy to answer, not taking
makes this standard attractive for VSEs is that it can be used too long for the VSE to complete. The following constraints
with any development approach such as waterfall, incremental, were then established:
evolutionary, iterative, and agile approaches [1, 8, 18].
The ISO/IEC 29110 standard has four software profiles to � No more than 12 questions per process.
be selected by an organisation according to its specific needs � The questions should be developed focussing on each
[1, 8, 18]: (1) the Entry profile is addressed to start‐ups and practice of the ISO/IEC 29110 and should allow registering:
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
416
- MUÑOZ ET AL.

(a) the year in which the practice was implemented and (b) complete questionnaire is available at https://forms.gle/GF
how the utility of each practice is perceived. rsbah6XuKyAW2BA.
� One question per process focussed on the benefits A brief description of the questionnaire is as follows:
perceived by the VSEs with the implementation of the
standard. To obtain the data related to the benefits, a list of � The questionnaire has three sections: general data, project
benefits was developed using the expected benefits provided management process questions, and software implementa-
in part 5 as a reference, and the purpose and objectives of tion process questions.
each process (i.e. project management and software process � The general data aims to collect two types of data: the year
implementation) provided by the software Basic profile of the VSEs implemented the Basic profile of the ISO/IEC
the ISO/IEC 29110 [12]. 29110, and the type of VSE (e.g. a software development
centre of a university or a software development
A 23‐question questionnaire with only multiple‐option organisation).
answers was designed as shown in Figure 1. � The project management section aims to obtain information
As illustrated in Figure 1, the questionnaire was related to each activity provided by the standard, to obtain
conducted in Spanish because the sample of VSEs was more detailed information. The questionnaire focussed on
from Mexico. Figure 1a shows the section aimed at the set of tasks provided for each activity. This section
obtaining the general data; Figure 1b shows an example contains nine questions:
of the questions aimed at obtaining the information about ◦ Four questions, one per project management activity (i.e.
the pace of each practice implementation; Figure 1c project planning, project plan execution, project assess-
shows an example of the questions aimed at obtaining the ment and control, and project closure), asking to select
information about the perception of the practice's utility; the year in which each practice was adopted.
and Figure 1d shows an example of a general question ◦ Four questions, one per project management activity (i.e.
asking about the benefits observed by a VSE after con- project planning, project plan execution, project assess-
ducting an entire implementation of the standard. The ment and control, and project closure), asking to select an
figure also lists the purpose and objectives of the project option in four‐scale values (i.e. very useful, useful, little
management process and the software implementation useful, or not useful) on how each practice is perceived by
process provided by the ISO/IEC 29110 [12]. The the VSE.

FIGURE 1 The questionnaire developed to collect data from Very Small Entities
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 417

◦ One question in which, from a set of previously defined Table 2 provides a summary of the sample of VSEs
benefits, the VSE selects the benefit(s) that they have participating in this research, the information provided includes
obtained. the number of employees (size), the software development
� The software implementation section aims at obtaining in- approach, the number of years using the standard (years), the
formation regarding each activity provided by the standard. application domain (specifying if it is an industry), the type of
This section of the questionnaire focussed on the set of software whether it is from academic domain, a spin‐off or a
tasks provided for each activity. This section contains 13 software development centre (SDC) of a university.
questions:
◦ Six questions, one per software implementation activity
(i.e. initiation, analysis, design, construction, integration 3.3 | Data analysis approach
and tests, and delivery), asking to select the year in which
each practice was adopted. To perform this exploratory analysis, the authors performed
◦ Six questions, one per project management activity (i.e. the following steps:
initiation, analysis, design, construction, integration and
tests, and delivery), asking to select in four‐scale values 1. To consolidate the data provided in the sections regarding the
(i.e. very useful, useful, little useful, or not useful) on how year of adoption of the practices and the observed benefits.
each practice is perceived by the VSE. 2. Illustrate the data graphically to analyse each practice
◦ One question in which, from a set of previously defined implementation pace from both processes: the project
benefits, the VSE selects the benefit(s) that have been management and the software implementation.
obtained. 3. Establish a relationship between the practices' imple-
mentation pace findings with the observed benefits.
4. Synthesise the results by consolidating the information
3.2 | Data collection strategy obtained in step 3.

The questionnaire was sent to a sample of VSEs of the


Zacatecas state that have implemented the ISO/IEC 29110 4 | RESULTS
and have obtained their certification. The sample was made of
15 VSEs that participated in the study about the factors that This section aims to analyse the data related to the
motivated and affected the implementation of the software implementation pace of the practices provided in the basic
Basic profile of the ISO/IEC 29110 standard [10]. We profile of ISO/IEC 29110, and the benefits collected, and
received the answers from 12 VSEs, which means 80% of the provides an interpretation of the data. Next, Section 4.1
targeted sample. provides the results regarding the implementation pace and
In addition, it is important to highlight that within the sam- Section 4.2 provides the results regarding the benefits
ple, VSEs have been using the standard between 1 and 4 years. observed.

TABLE 2 Data from the sample of VSEs participating in this research

ID Size Software development approach Years Application domain


VSE1 7 Iterative 4 Academic (spin‐off)

VSE2 5 Waterfall 1 Academic (SDC)

VSE3 4 Scrum 4 Academic (SDC)

VSE4 7 Waterfall 2 Academic (SDC)

VSE5 4 Waterfall 2 Academic (SDC)

VSE6 5 TSP 3 Academic (SDC)

VSE7 2 Waterfall 2 Industry‐embedded software

VSE8 5 Iterative and incremental 3 Academic (SDC)

VSE9 5 Waterfall/Scrum 2 Industry department in an SME developing software for the mining industry

VSE10 3 Agile practices 1 Industryhuman resources software

VSE11 2 Agile practices 4 Industry‐embedded software

VSE12 4 Hybrid CMMI‐Scrum 2 Industry‐livestock systems

Abbreviation: SDC, software development centre; VSE, Very Small Entities.


17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
418
- MUÑOZ ET AL.

4.1 | Implementation pace The practice identification and documentation of the


project resources (PM.1.5) were completely adopted in the
4.1.1 | Analysis of the adoption of the project second year by VSE7 and VSE11, and in the third year by
management process VSE1.
The practice estimation of the project effort and cost
This section provides the analysis related to the adoption of (PM.1.8) was mentioned by VSE3, VSE7, and VSE11 as a
the practices provided by each of the four activities of this practice that took two years to be completely adopted. How-
process: ever, the VSE1 took four years to implement this practice.
Finally, the practice identification and documentation of
Project planning activity: project risk (PM.1.9) were highlighted by VSE1 as a practice
This activity is related to the documentation of the planning that took four years to be completely adopted.
details that are necessary to manage the software project [12].
Figure 2 shows the results of the year of adoption of the 15 Project plan execution activity
tasks of this activity by the VSEs. This task is related to the adoption of the activities docu-
As shown in Figure 2, all VSEs were able to have a mented in the project plan [12]. Figure 3 shows the results of
complete adoption of most of the practices provided by this the year of adoption of the six tasks of this activity.
activity within the first year related to the following, that is, As shown in Figure 3, half of the VSEs (VSE2, VSE3,
review the statement of work (PM.1.1), define delivery in- VSE4, VSE6, VSE8, and VSE12) were able to have a complete
structions (PM.1.2), identify tasks to be performed to achieve adoption of all the practices in the first year.
the project goals (PM.1.3), establish the workgroup composi- The following are the practices mentioned by VSEs as
tion (PM.1.6), generate and integrate a project plan practices that took two years to be completely adopted: moni-
(PM1.11), include the product description, scope, objectives, toring the execution of the project plan and the recording of the
and deliverables (PM.1.12)in the project plan, verify the progress status (PM.2.1) by VSE1 and VSE9; the practice anal-
project plan (PM.1.13), and validate the project plan ysis and evaluation of change requests (PM.2.2) by VSE7,
(PM1.14). VSE10, and VSE11; the practices performance of a project re-
The following are the practices identified by at least one pository backup (PM.2.5), and performance of a project re-
VSE as practices that took two years to be completely adop- pository recovery (PM.2.6) by VSE5 and VSE7; the practices of
ted: the estimation of the duration of the tasks (PM.1.4) by conducting meeting reviews with the team (PM.2.3) and con-
VSE1; assignment of start and completion dates (PM.1.7) ducting meeting reviews with the customer (PM.2.4) by VSE9.
by VSE7; creation of a version control strategy (PM.1.10) by However, the practices analyse and evaluate the change
VSE7; and the establishment of a project repository (PM.1.15) request for the cost, schedule, and technical impact (PM.2.2)
by VSE7. and perform backup according to the version control strategy

FIGURE 2 Adoption of project management practices by VSEs


17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 419

FIGURE 3 Adoption of project plan execution practices by Very Small Entities

FIGURE 4 Adoption of project assessment and control practices by VSEs

(PM.2.5) were identified by VSE1 as practices that took 3 and shows the results of the year of adoption of the two tasks of
4 years, respectively, to be completely adopted. this activity.
As shown in Figure 5, all VSEs were able to adopt the two
Project assessment and control activity practices provided by this activity within the first year. These
This task is related to the evaluation of the performance of the practices are related to the formalisation of the completion of
project against the commitments documented in the project the project concerning the delivery instructions documented in
plan [12]. Figure 4 shows the results of the year of adoption of the project plan (PM.4.1) and the updation of the project re-
the three tasks of this activity. pository (PM.4.2).
As shown in Figure 4, 10 VSEs were able to have a
complete implementation of the practice establish actions to
correct project deviations or problems (PM.3.1). 4.1.2 | Analysis of the adoption of the
However, the practices evaluate the progress concerning software implementation process
the project plan (PM.3.2) and the use of change requests to
document changes to requirements and/or the project plan This section provides the analysis related to the adoption of the
(PM.3.3) were highlighted by VSE1 as practices that took four practices provided by each of the four activities of this process:
years to be completely adopted.
Software implementation initiation activity
Project closure activity This activity is conducted to ensure that the work team is
This task is related to the formalisation of the closure of the committed to the project plan [12]. Figure 6 shows the results
project according to the contract requirements [12]. Figure 5 of the year of adoption of the two tasks of this activity.
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
420
- MUÑOZ ET AL.

FIGURE 5 Adoption of project closure practices by Very Small Entities

FIGURE 6 Adoption of software implementation initiation practices by Very Small Entities

As shown in Figure 6, all VSEs were able to have a Software architectural and detailed design activity
complete implementation of the two practices provided by this This activity is related to the transformation of the software
activity within the first year. These practices are related to requirements by producing a software architecture and a
presenting the project plan to the work team members and detailed design [12]. Figure 8 shows the results of the year of
engaging them with the project (SI.1.1) and setting up the adoption of the eight tasks of this activity.
implementation environment or updating it (SI.1.2). As shown in Figure 8, most of the VSEs were able to
have a complete implementation of the practices provided
Software requirements analysis activity in this activity within the first year. These practices are
This activity is related to the establishment of the validated related to assigning tasks to the project team according to
requirements for a project [12]. Figure 7 shows the results of the their role (SI.3.1), getting an understanding of the re-
year of adoption of the seven tasks of this activity. quirements' specification (SI.3.2), documenting the software
As shown in Figure 7, all VSEs were able to have a complete design or updating it (SI3.3), verifying the software design
implementation of the practices provided by this activity within (SI.3.4), and verifying the test cases and test procedures
the first year, These practices are related to assigning the tasks to (SI.3.6).
the project team according to their role (SI.2.1), documenting the However, the practices such as establishing the test cases
requirements specification (SI.2.2), verifying the requirements' and test procedures (SI.3.5) were highlighted by VSE1 as a
specification (SI.2.3), validating the requirements' specification practice that took two years to be completely adopted and the
(SI.2.4), documenting the preliminary version of the user practices managing the traceability records (SI.3.7), and
documentation (SI.2.5), verifying the preliminary version of the incorporating produced artefacts to the baseline (SI.3.8) were
user documentation (SI.2.6), and incorporating the artefacts highlighted by VSE1 and VSE12 as the practices that took two
produced to the baseline (SI.2.7). years to be completely adopted.
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 421

FIGURE 7 Adoption of software requirements analysis practices by Very Small Entities

FIGURE 8 Adoption of software architectural and detailed design practices by Very Small Entities

Software construction activity Software integration and test activity


This activity is related to the development of the software code This activity ensures that the integration of the software com-
and the execution of unit tests [12]. Figure 9 shows the results ponents satisfies the software requirements [12]. Figure 10 shows
of the year of adoption of the seven tasks of this activity. the results of the year of adoption of the 11 tasks of this activity.
As shown in Figure 9, most of the VSEs were able to adopt As shown in Figure 10, the VSEs were able to adopt most
most of the practices provided in this activity within the first of the practices provided in this activity within the first year.
year. These practices are related to assigning tasks to the project These practices are related to assigning tasks to the project
team according to their role (SI.4.1), getting an understanding team according to their role (SI.5.1), integrating the software,
of the software design (SI.4.2), building the software compo- and providing test cases and test procedures for integration
nents or updating them (SI.4.3), designing the unit test or testing (SI5.3), performing test cases and test procedures for
updating it (SI.4.4), and correcting defects found as result to integration testing (SI.5.4), correcting defects found as result to
apply unit test (SI.4.5). apply integration tests (SI.5.5) and incorporating the artefacts
However, the practices such as managing the traceability produced to the baseline (SI.5.11).
records (SI.4.6) and incorporating the produced artefacts to the However, six practices were highlighted by at least one
baseline (SI.4.7) were highlighted by VSE12 as practices that VSE as practices that took two years to be adopted such as
took two years to be adopted. getting an understanding of the test cases and test procedures
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
422
- MUÑOZ ET AL.

FIGURE 9 Adoption of the software construction practices by Very Small Entities

FIGURE 10 Adoption of software integration and test practices by Very Small Entities

(SI.5.2) by VSE1, managing the traceability record (SI.5.6) by assigning tasks to the project team according to their role
VSE7, and VSE12; documenting the product operation guide (SI.6.1), incorporating the maintenance documentation to the
(SI.5.7) by VSE12; and verifying the product operation guide baseline (SI.6.5), and delivering the product according to the
(SI.5.8), documenting the user documentation (SI.5.9), and delivery instructions (SI.6.6).
verifying the user documentation (SI.5.10) by VSE7. However, some practices were highlighted by at least one
VSE as practices that took two years to be adopted such as
Product delivery activity getting an understanding of the software configuration (SI.6.2)
This activity provides integrated software to the customer [12]. by VSE1, documenting the maintenance documentation
It is important to mention that software configuration means (SI.6.3), and verifying the maintenance documentation (SI.6.4)
the software and related artefacts (e.g. user manual) that were by VSE7.
committed in the project plan to the customer.
Figure 11 shows the results of the year of adoption of the
six tasks of this activity. 4.2 | Benefits observed
As shown in Figure 11, all VSEs were able to have a
complete adoption of most of the practices provided in this One of the main issues regarding the implementation of a
activity within the first year. These practices are related to standard in a VSE is often the lack of publications related to the
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 423

FIGURE 11 Adoption of product delivery practices by Very Small Entities

benefits of using software engineering practices. This is why it is 4.2.2 | Benefits identified with the
important to analyse the perceived benefits of the VSEs for the implementation of the software implementation
sample with the adoption of the practices of the Basic profiles of process
the ISO/IEC 29110 for both processes: Project Management
and Software Implementation processes. A list of 9 benefits was defined. Table 4 shows the benefits
Next, we present an analysis of the benefits identified by selected by VSEs. As Table 4 shows, the benefits selected by
the VSEs. Then, VSEs were asked to choose all the benefits 11 VSEs at the top are (B9) improvement in the software
that were applicable to them. Then, the VSEs had to select the architecture and detailed design, followed by (B1) improve-
benefit(s) in the VSE as a result of the adoption of the ment in the requirements definition and (B3) improvement
standard. in the software tests selected by 10 VSEs. Other benefits such
About the benefits, a percentage of 60% is considered a as (B2) improvement in the traceability of requirements (e.g.
high percentage because it means that at least 8 of 12 VSEs from the approval of requirements to the integration tests),
selected it as an identified benefit. (B5) reduction of project errors, and (B8) improvement in
the control of artefacts produced throughout the project
development were selected by nine VSEs. and (B4) an
4.2.1 | Benefits observed for the project improvement in the identification and correction of errors
management process and (B7) an increase of the customer satisfaction by eight
VSEs.
A list of nine benefits was defined. Table 3 shows the benefits Finally, the benefit (B4) identification of product errors in
selected by VSEs. As the table shows, the benefits selected by the early stages of the project was selected by six VSEs.
11 VSEs at the top are the (B5) improvement in the project
progress monitoring, followed by major project visibility
mentioned by 10 VSEs. Other benefits such as the (B1) 5 | DISCUSSION
improvement in the early stages of the project on the agree-
ment of the project requirements and the expected products to Using the results of the exploratory analysis with a sample of
be delivered to the customer, (B8) improvement in the agree- 12 VSEs, the following findings are highlighted:
ments' documentation, and (B9) improvement in the for- Related to the adoption pace of the Basic profile of
malisation of the project closure were mentioned by nine the ISO/IEC 29110, 55% of the practices were completely
VSEs, and (B2) a disciplined managed process and (B7) adopted by all the VSEs within the first year; 35% were
improvement in the analysis of change requests were completely adopted within the second year by all the
mentioned by eight VSEs. VSEs; 3% of the practices were completely adopted within
Finally, two benefits were identified only by seven VSEs, the third year by all the VSEs and 8% of the practices
(B4) an improvement in the definition and monitoring of were completely adopted within the fourth year by all the
corrective actions, and (B6) improvement in the risk's iden- VSEs.
tification and monitoring from the beginning to closure of Table 5 illustrates the number of years it took by the 12
projects. VSEs to fully implement the project management process
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
424
- MUÑOZ ET AL.

TABLE 3 Benefits identified for the project management process by VSEs

Benefit ID Benefits identified Number of VSEs VSE ID


B1 Improvement in the early stages of the project on the agreement of the project requirements and 9 1, 2, 4–8, 10, 12
the expected products to be delivered to the customer

B2 A disciplined management process was used 8 1–6, 8, 10

B3 Improvement in project visibility 10 1–5, 7, 9–12

B4 Improvement in the definition and monitoring of corrective actions 7 2, 4–8, 10

B5 Improvement in the project progress monitoring 11 1–11

B6 Improvement in the risk's identification and monitoring from the beginning to closure of projects 7 2, 4–6, 8, 10

B7 Improvement in the analysis of change requests 8 1, 2, 4–6, 8–10

B8 Improvement in the agreements' documentation 9 1, 2, 4‐8, 10, 11

B9 Improvement in the formalisation of project closure 9 1, 2, 4–7, 9, 10, 12

Abbreviation: VSEs, Very Small Entities.

TABLE 4 Benefits identified for the software implementation process by VSEs

Benefit ID Benefits identified Number of VSEs VSE ID


B1 Improvement in the requirements definition 10 1–8, 10, 12

B2 Improvement in the traceability of requirements (e.g. from the approval of requirements to the 9 1, 2, 4–6, 8–11
integration tests)

B3 Improvement in software tests 10 1–8, 10, 12

B4 Improvement in the identification and correction of the errors 8 1, 2, 4–8, 10

B5 Reduction of project errors 9 1, 2, 4–10

B6 Identification of product errors in the early stages of the project 6 2, 4–6, 8,10

B7 Improvement the customer satisfaction 8 2, 4–10

B8 Improvement in the control of artefacts produced throughout the project development 9 2–6, 8–11

B9 Improvement in the software architecture and detailed design 11 1, 2, 4–12

Abbreviation: VSEs, Very Small Entities.

TABLE 5 VSEs achieving the adoption of the standard by year


(PM) and the software implementation process (SI). It is ID Year 1 PM/SI Year 2 PM/SI Year 3 PM/SI Year 4 PM/SI
important to highlight that the project management process
VSE1 16/36 3/5 2/0 5/0
contains a total of 26 practices, and the software imple-
mentation process contains a total of 41 practices. VSE2 26/41 0/0 0/0 0/0
As Table 5 shows, if we analysed the number of VSEs VSE3 25/41 1/0 0/0 0/0
achieving the adoption of the standard, within the first year
VSE4 26/41 0/0 0/0 0/0
VSE2, VSE4 and VSE6 have achieved a complete adoption
of the standard; VSE3 and VSE10 have achieved 99% of a VSE5 24/41 2/0 0/0 0/0
complete adoption of the standard; VSE8 has achieved 97% VSE6 26/41 0/0 0/0 0/0
of a complete adoption of the standard, and VSE9 and
VSE7 18/35 8/6 0/0 0/0
VSE12 have achieved 95% of a complete adoption of the
standard. Moreover, those VSEs who have more practices VSE8 24/41 2/0 0/0 0/0
that took more than one year such as VSE11, VSE7, and VSE9 23/41 3/0 0/0 0/0
VSE1 have achieved 91%, 88%, and 79% of a complete
VSE10 25/41 1/0 0/0 0/0
adoption of the standard. All of them have achieved more
than 70% of a complete adoption of the standard in the VSE11 23/41 3/0 0/0 0/0
first year. Therefore, we can conclude that this standard is VSE12 26/35 0/6 0/0 0/0
easy to be implemented by VSEs if we take into account the
Abbreviation: VSEs, Very Small Entities.
following issues.
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 425

5.1 | Project management process concern of that VSE was on hardware, and when the VSE
understood the importance of these practices for the soft-
Related to the project management process's practices, we ware, the VSE started using them.
focus on those practices that took 2 or more years to be
completely implemented and were mentioned by 2–4 VSEs:
5.3 | Benefits observed
� VSEs do not invest much time in tasks related to the project
estimation or the project repository background because Regarding the identified benefits from the adoption of the
they do not understand its importance. project management practices, in our previous results related
� VSEs find it difficult to evaluate the project progress to motivators positively impacting the implementation of the
because most of them do not develop estimations as well as standard (see Table 1), they highlighted the implementation of
the registration of the project progress. a structured way of developing software and the new knowl-
� VSEs find it difficult to implement the management of edge obtained. This matches with the new results related to the
change requests because most of them believe that changes benefits expected to implement the standard (see Table 3)
should be accepted because of the high dependency of the because most of the VSEs mentioned the following: B5 by 11
customer. Most VSEs that have demonstrated this behav- VSEs; B3 by 10 VSEs; B1, B8, and B9 by 9 VSEs; and, B2 and
iour, are from an academic domain (VSE1, VSE3, VSE5, B7 by 8 VSEs. These are the results of adopting a structured
and VSE8). The projects were performed by undergraduates way to develop software and of obtaining new knowledge
that do not have too much hands‐on experience about the related to the practices they do not use to perform before.
management of change requests. About identified benefits from the adoption of the software
� VSE7 and VSE9 develop embedded software. They were implementation practices, in our previous results related to
most focussed on hardware and that is the reason why tasks motivators positively impacting the implementation of the
related to the estimation and project monitoring took more standard (see Table 1), they highlighted the implementation of a
than one year to be understood to get a complete structured way of developing software and the new knowledge
implementation. obtained. This matches with the new results related to benefits
� Related to VSE10, from the industry, used agile practices in expected to implement the standard (see Table 4) because most
the first year of the standard adoption. This VSE did not of the VSEs mentioned the following: B9 by 11 VSEs, B1 and
formalise the estimation of the project resources and effort. B3 by 10 VSEs; B2, B5, and B8 by 9 VSEs; and B4 and B7 by 8
The cost estimation was performed by the VSE owner. VSEs. These are the results of adopting a structured way to
� VSE11, from the industry, use some agile practices, and develop software and of obtaining new knowledge related to
have used the standard for 4 years. Because of this, the VSE the practices they do not use to perform before.
develop embedded software; the employees did not pay
much attention to estimating the resources for the software
until they understood its importance. 6 | CONCLUSIONS AND FUTURE
WORK

5.2 | Software implementation process This study presents an exploratory analysis on the pace at which
12 VSEs adopted the proven practices of the software basic
Related to the software implementation process's practices, we profile of the ISO/IEC 29110 standard and the benefits they
focussed on those practices that took 2 or more years to be have identified that are the main contributions of this study.
completely implemented and were mentioned by 2– 4 VSEs: According to the results and the discussion provided, the
first question established in the introduction, ‘What is the pace at
� VSEs have more experience and practice in activities related which VSEs can adopt practices from ISO/IEC 29110?’ can be
to software development. We did not identify practices that answered by highlighting the fact that the software Basic profile
take up more than 1 year, as mentioned by three or four of the ISO/IEC 29110 can be implemented at a pace supported
VSEs. We detected three practices highlighted by VSEs; two by VSEs within the first year. Most importantly, it allows them to
by VSE1 and VSE12 (managing the traceability records understand and analyse the benefits of adopting a structured
(SI.3.7), and incorporating the produced artefacts to the way to develop software and of obtaining new knowledge
baseline (SI.3.8)); and one by VSE7 and VSE12 (managing related to practices they do not use to perform before.
the traceability record (SI.5.6)); all of them are from an It is important to highlight that the VSEs that achieved a
academic domain, where the projects are performed by complete implementation of the practices of the software
undergraduate students. Those VSEs did not have much implementation process in less time was because they paid
knowledge about this topic. It is complicated for them to more attention to software development. However, VSEs have
understand both concepts having little practical knowledge. a lack of using a structured way to perform practices related to
� VSE7, which develops embedded software, is the only VSE the project management process, for example those related to
from an industry domain that did not perform the unit and estimations and the registration of the project progress data
integration tests and test cases definition because the main and its evaluation resulting in an inadequate analysis of the
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
426
- MUÑOZ ET AL.

project progress because of the lack of data to do that. These RE F E R E NC E S


practices took more time to be implemented because most of 1. Laporte, C.Y., et al.: Applying software engineering standards in very small
the time a few VSEs did not realise their importance. entities: from startups to grownups. IEEE Softw. 35(1), 99–103 (2018).
Regarding the second question ‘Are VSEs able to perceive https://doi.org/10.1109/MS.2017.4541041
2. Laporte, C.Y., O’Connor, R.: Systems and software engineering standards
the benefits of the practices of the software engineering for very small entities: accomplishments and overview. Computer. 49(8),
standard implemented?’, it can be answered by highlighting the 84–87 (2016). https://doi.org/10.1109/MC.2016.242
fact that the implementation of processes provided by this 3. Larrucea, X., et al.: Software process improvement in very small orga-
standard, enables the VSEs the following: (a) to implement nizations. IEEE Softw. 33(2), 85–89 (2016). https://doi.org/10.1109/
practices that help them to improve the performance of their MS.2016.42
4. Sánchez‐Gordon, M.‐L., et al.: A standard‐based framework to integrate
development process by providing project management prac- software work in small settings. Comput. Stand. Interfaces. 54(3),
tices, which enable them to have more visibility and control of 162–175 (2017). https://doi.org/10.1016/j.csi.2016.11.009
their projects; and (b) the practices provided by the software 5. Muñoz, M., et al.: A comparative analysis of the implementation of the
implementation process reinforce the activities they performed software basic profile of ISO/IEC 29110 in thirteen teams that used
in the software development. predictive versus adaptive life cycles. In: Walker, A., O'Connor, R.,
Messnarz, R. (eds.) Systems, Software, and Services Process Improve-
However, the practices that took more than one year to ment. EuroSPI 2019. Communications in Computer and Information
implement are related to the opportunity of new knowledge Science, vol. 1060, pp. 179–191. Springer, Cham (2019). https://doi.org/
that should be provided to VSEs such as the management of 10.1007/978‐3‐030‐28005‐5_14
traceability, change requests, and test cases and procedures. 6. Sánchez‐Gordón, M.L., et al.: The route to software process improve-
ment in small‐ and medium‐sized enterprises. In: Kuhrmann, M., et al.
A limitation to the results provided in this study, as
(eds.) Managing Software Process Evolution. Springer, Cham (2016).
mentioned in Section 3, is that the exploratory analysis was https://doi‐org.svproxy01.cimat.mx/10.1007/978‐3‐319‐31545‐4_7
performed in a small sample of VSEs from the Mexico region 7. Walker, A., O'Connor, R., Messnarz, R. (eds.): Systems, software, and
and that the instrument used in this research was validated by services process improvement. In: 26th European Conference, EuroSPI
some of the authors of this study with high experience in the 2019, Edinburgh, UK, September 18–20 2019, Proceedings. CCIS, vol.
standard. Besides, it is important to highlight that the authors 1060. https://doi.org/10.1007/978‐3‐030‐28005‐5
8. Laporte, C.Y., O’Connor, R.V.: Software process improvement standards
decided to provide a list of predefined benefits based on the and guides for very small organizations. An overview of eight imple-
answers provided by the VSEs in the previous analysis (see mentations. CrossTalk. 23–27 (2017)
Table 1). 9. O’Connor, R., Laporte, C.Y.: The evolution of the ISO/IEC 29110 set of
However, we are confident that the analysis of our data will standards and guides. Int. J. Inf. Technol. Syst. Approach. 10(1) 1–21
provide pointers to the elements that should be taken into (2017). https://doi.org/10.4018/IJITSA.2017010101
10. Muñoz, M., et al.: What motivates VSEs to adopt an international
account for VSEs interested in the implementation of the standard such as ISO/IEC 29110? An exploratory analysis. In: Yilmaz,
ISO/IEC 29110 standard. M., et al. (eds.) Systems, Software, and Services Process Improvement.
As future work, with the data identified, the authors are EuroSPI 2020. Communications in Computer and Information Science,
working on providing resources to help VSEs in the training of vol. 1251. Springer, Cham (2020). https://doi.org/10.1007/978‐3‐030‐
56441‐4_55
the standard in an attractive way such as using gamification and
11. INEGI: Encuesta Nacional sobre Productividad y Competitividad de las
serious games. Besides, the authors are collecting data to Micro, Pequeñas y Medianas Empresas (ENAPROCE). (2018) https://
perform a quantitative analysis of the benefits obtained and the www.inegi.org.mx/contenidos/saladeprensa/boletines/2019/especiales/
factors motivating the implementation of the ISO/IEC 29110 ENAPROCE2018.pdf
by VSEs. Finally, some of the authors are waiting for the 12. ISO/IEC TR 29110‐5‐1‐2:2011: Software Engineering – Lifecycle Pro-
approval of the guide to implement the ISO/IEC 29110 in files for Very Small Entities (VSEs) – Part 5‐1‐2: Management and
Engineering Guide: Generic Profile Group: Basic Profile. (2011). http://
agile environments (developed by some of them), to imple- standards.iso.org/ittf/PubliclyAvailableStandards/index.html
ment it in VSEs using an agile approach for software 13. NYCE: Companies Certified to ISO/IEC 29110‐4‐1:2011 Standard (2021).
development. https://www.nyce.org.mx/wp‐content/uploads/2020/01/PADRON‐
DE‐EMPRESAS‐CERTIFICADAS‐EN‐LA‐NORMA‐ISO‐IEC‐29110‐
CONF L ICT O F I N T E R EST 4‐1‐16‐01‐2020.pdf
14. Dávila, A., Pessoa, M.: Factors driving the adoption of ISO/IEC 29110:
The authors declare no conflicts of interest. A case study of a small software enterprise. In: 2015 Latin American
Computing Conference (CLEI), Arequipa, pp. 1–8. (2015). https://doi.
DATA AVA I LA BI LI T Y S TAT E M E NT org/10.1109/CLEI.2015.7360042
Data available on request due to privacy/ethical restrictions. 15. Wongsai, N., Siddoo, V., Wetprasit, R.: Factors of influence in software
process improvement: An ISO/IEC 29110 for Very Small Entities. In:
2015 7th International Conference on Information Technology and
ORCI D Electrical Engineering (ICITEE), Chiang Mai, pp. 12–17 (2015). https://
Mirna Muñoz https://orcid.org/0000-0001-8537-2695 doi.org/10.1109/ICITEED.2015.7408904
Jezreel Mejía https://orcid.org/0000-0003-0292-9318 16. Sanchez‐Gordon, M.L., O’Connor, R.V., Colomo‐Palacios, R.: Evalu-
Adriana Peña https://orcid.org/0000-0001-6823-2367 ating VSEs viewpoint and sentiment towards the ISO/IEC 29110
Claude Y. Laporte https://orcid.org/0000-0002-3453- standard: A two country grounded theory study. In: Rout, T., O’Connor,
R., Dorling, A. (eds.) Software Process Improvement and Capability
740X Determination. SPICE 2015. Communications in Computer and Infor-
Gloria Piedad Gasca‐Hurtado https://orcid.org/0000- mation Science, vol. 526. Springer, Cham (2015). https://doi.org/10.
0003-0157-1959 1007/978‐3‐319‐19860‐6_10
17518814, 2021, 6, Downloaded from https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sfw2.12041 by SEA ORCHID (Thailand), Wiley Online Library on [21/05/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
MUÑOZ ET AL.
- 427

17. Lucho, S., Melendez, K., Dávila, A.: Analysis of environmental factors in
the adoption of ISO/IEC 29110. Multiple case study. In: Mejia, J., et al. How to cite this article: Muñoz, M., et al.: Beyond
(eds.) Trends and Applications in Software Engineering. CIMPS 2017.
Advances in Intelligent Systems and Computing, vol. 688. Springer,
factors that motivate the adoption of the ISO/IEC
Cham (2018). https://doi.org/10.1007/978‐3‐319‐69341‐5_8 29110 in Mexico: an exploratory study of the
18. Muñoz, M., et al.: Transitioning international software engineering implementation pace of this standard and the benefits
standards to academia: Analyzing the results of the adoption of ISO/IEC observed. IET Soft. 15(6), 412–427 (2021). https://doi.
29110 in four Mexican universities. Comput. Stand. Interfaces. 66, org/10.1049/sfw2.12041
103340 (2019). https://doi.org/10.1016/j.csi.2019.03.008

You might also like