You are on page 1of 14

Special Issue: Performance Measurement

International Journal of Engineering


Business Management
On the relationship between human factor Volume 15: 1–13
© The Author(s) 2023
and overall equipment effectiveness (OEE): Article reuse guidelines:
sagepub.com/journals-permissions
DOI: 10.1177/18479790231188548
An analysis through the adoption of analytic journals.sagepub.com/home/enb

hierarchy process and ISO 22400

Sebastiano Di Luozzo1 , Fiorenza Starnoni1 and Massimiliano Maria Schiraldi1

Abstract
In the industrial field, one of the most widespread KPIs is represented by the Overall Equipment Effectiveness (OEE), first
introduced by Seiichi Nakajima within the Total Productive Maintenance (TPM) theory and aimed at identifying the in-
efficiencies of industrial assets. While OEE has been objective of several studies, the relationship between the Overall
Equipment Effectiveness and the role of the human factor in achieving its high levels of values has not been extensively
investigated. In recent years few scientific studies have investigated the relationship, showing that there is a link between
OEE and human factors, even significant, but not clearly identified yet. In order to examine this relationship, our study
proposes a framework to clarify the links between human factors, OEE parameters, the industrial sector, and the degree of
automation. This framework is then validated through the application of the Analytic Hierarchy Process (AHP) meth-
odology. As a result, 13 aspects related to the human factor were identified. Finally, the study provides practical guidance
and implications for maximizing the outcomes of the investigation, with the goal of improving an organization’s overall
manufacturing performance. By understanding the impact of the human factor on OEE, organizations can make informed
decisions to optimize their operations and achieve higher levels of productivity.

Keywords
Overall equipment effectiveness, OEE, ISO22400, KPI, human factor

Date received: 28 April 2023; accepted: 28 June 2023

Introduction In this context, although Nakajima underlines the main


role of manpower in the achievement of a high rate of the
Overall Equipment Effectiveness (OEE), first introduced by KPI,1 by reviewing the existing literature it is possible to
Nakajima in 1988 within the TPM theory, is a key per- understand how the relationship between the performance
formance indicator extensively adopted in the indicator and human factor has not been deepened. In
manufacturing context.1 Its huge diffusion can be linked to conclusion, the ways in which people carry out operational
the easiness of reading and to the capability to sum up
several metrics generally monitored by companies.2,3
Considering the number of scientific articles published in 1
Department of Enterprise Engineering, University of Rome Tor Vergata,
the last years, the role of the OEE within industrial and Rome, Italy
scientific context appears clear and recognized: the scien-
Corresponding author:
tific publications regarding the Overall Equipment Effec- Sebastiano Di Luozzo, Department of Enterprise Engineering, University of
tiveness and the improvement of the indicators itself are Rome Tor Vergata, Via del Politecnico 1, Rome 00133, Italy.
increasing. Email: sebastiano.di.luozzo@uniroma2.it

Creative Commons Non Commercial CC BY-NC: This article is distributed under the terms of the Creative Commons
Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use,
reproduction and distribution of the work without further permission provided the original work is attributed as specified on the
SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).
2 International Journal of Engineering Business Management

activities exerts an influence on the KPI and can play a key relationship between human factors impacting OEE;
role in achieving high OEE values – and therefore to the Analysis of the human factors affecting OEE elements
achievement of corporate effectiveness improvement – have through the adoption of ISO 22400 standard taxonomy and
not been appropriately deepened in the literature.4,5 Con- Relationship between human factor, industrial sector and
sidering the points discussed, the aim of our study is rep- degree of automation reports in order the analysis con-
resented by the investigation of the existing relationship ducted for the identification of the elements of the KPI
between human factors and OEE and understand how the impacted by the human factors and the relationship be-
human activities can exert an influence on reaching high tween human factors, degree of automation and industrial
levels of OEE. To our knowledge, no other scientific sector. The validation of the results is shown in AHP
contribution has proposed a deep dive on the human ac- analysis, results and discussions, where Analytic Hier-
tivities able to influence the Overall Equipment archy Process (AHP) analysis has been performed and its
Effectiveness. results analyzed. Lastly Conclusions reports the conclu-
In the context of industrial manufacturing, the influence sions of the article.
of the human factor plays a significant role in the overall
efficiency and productivity of the production processes.
Manufacturing operations often involve complex machin- Background
ery, automated systems, and intricate workflows, but it is the
human element that ultimately governs and interacts with The Overall Equipment Effectiveness is as a Key Perfor-
these systems. As a result, understanding and addressing the mance Indicator (KPI) that integrates three distinct indi-
impact of human factors is crucial for optimizing opera- cators, namely Availability, Performance Efficiency, and
tional performance, ensuring quality output, and maxi- Quality.1 The definition of the indicator is elaborated as
mizing the overall equipment efficiency (OEE). In this follows:
context, human factors encompass a wide range of ele- OEE ¼ Availability Performance Efficiency Quality (1)
ments, including but not limited to the skills, capabilities,
knowledge, experience, training, and behavior of the in- Specifically, as reported by2:
dividuals involved in the manufacturing process. These
factors can have both positive and negative effects on the · Availability refers to the portion of scheduled time
various parameters that contribute to OEE. that is utilized after accounting for all the time losses
By linking human factors to each parameter of OEE, due to major machinery stoppages, eliminating losses
organizations can gain a comprehensive understanding of caused by failures, downtime, and setup losses;
how human-related aspects influence equipment efficiency · Performance Efficiency indicates the proportion of
and overall manufacturing performance. This understanding operating time that is utilized after accounting for all
enables them to implement targeted strategies and inter- the time losses caused by minor machinery stoppages
ventions to optimize human performance, address potential or reductions in speed, including idling and minor
weaknesses, and capitalize on strengths. It also underscores stoppages, reduced speed, and reduced yield;
the importance of investing in ongoing training and de- · Quality Rate indicates the percentage of net operating
velopment programs, fostering a positive safety culture, time that is utilized after accounting for time losses
improving communication and collaboration, and im- resulting from work activities for processing of non-
plementing ergonomic design principles to create a har- sellable units (such as production waste or rework of
monious interaction between humans and the defective units).
manufacturing systems. According to this reasoning, the
paper discusses the following research question: Table 1 presents the values defined by Nakajima1 for the
various indicators that can be targeted to evaluate good
RQ: Which are the main human factors influencing the manufacturing performance. Nakajima also established a
achievement of high levels of OEE? What is their relationship benchmark level for OEE, known as the “World-Class
with the indicator? Level” (85%).
However, the scientific literature does not always concur
The paper is hence arranged as follows, in order to answer with these values. Kotze3 contends that, unlike Nakajima,
to the aforedescribed research question. Background is an OEE of 50% or less is a more realistic benchmark due to
dedicated to the definition of the OEE, its background and variations in industrial realities. Conversely, Ericsson,4
the relationship with human factors; Method is dedicated to suggests that an OEE ranging from 30% to 80% can be
the introduction of the methodology used for the research an effective reference benchmark. These discrepancies may
work; Analysis of the OEE and human factor in the scientific arise from difficulties in evaluating and comparing OEE
literature is aimed at identifying and clarifying the across various production processes and industries.5
Luozzo et al. 3

Table 1. World-class level target values.

Availability (%) Performance efficiency (%) Quality (%) OEE (%)

90 95 99 85

Consequently, several authors have proposed alternative No influence of operators on wasted time
methods for calculating the OEE indicator, tailored to
specific industries or production processes, leading to Losses in which the duration of downtime is not influenced
ambiguity in implementing the indicator in manufacturing by the activities performed by the operators.
settings. To provide KPI definitions that are independent of In a similar approach, human errors affecting plant per-
a company’s production and operational context, the In- formance are classified into six categories by,12 including
ternational Organization for Standardization (ISO) intro- operating errors, assembly errors, design errors, inspection
duced the ISO22400 standard (“Key performance errors, installation errors, and maintenance errors. Further-
indicators (KPIs) for manufacturing operations manage- more, the importance of the relationship between workers’
ment”) for manufacturing operations management.6,7 The skills, competences, and attitudes and OEE is gaining
standard includes two definitions of Overall Equipment attention.13,14 The human element is now considered a source
Effectiveness referred to as “Model A” and “Model B,” of competitiveness,15 owing to the intangible characteristics of
which were discussed in detail by Schiraldi and Varisco in human nature, including organizational knowledge, skills,
2020,8 who analyzed their consistency with Nakajima’s attitudes, and knowledge.16 Chen et al.’s research17 on the
original definition.1 Thus, significant efforts have been attitudes of human resources in large manufacturing compa-
made to develop comprehensive definitions and frameworks nies identifies the main elements and factors that can be
for implementing OEE to enable continuous improvement leveraged to improve operational productivity. Some publi-
and streamline production processes and performances: cations recommend performance improvement through the
manufacturing organizations have the chance to improve implementation of approaches, such as TPM, where the central
their production processes and performance by evaluating role of the human factor is acknowledged but do not detail the
the factors that affect OEE, allowing them to re-engineer, human elements that affect performance.18 Other publications
standardize and streamline their operations.9 describe specific cases where manpower has significantly
While attention was originally focused on assessing influenced operational activities.19
equipment, machinery, and other tangible factors in Therefore, it is evident from the literature review that there
manufacturing processes, investigating the relationship is a link between business performance and human activities.
between human factors and Overall Equipment Effective- However, this relationship is not fully elucidated regarding
ness has become crucial to achieving a competitive ad- the human factor’s influence on OEE. As a result, this study
vantage.10 As stated by Nakajima,1 even highly automated aims to explore the relationship between OEE and the human
plants cannot eliminate the positive and negative impact of factor, providing a comprehensive framework and organi-
manpower on manufacturing outcomes. For example, zational guidance to improve manufacturing performance.
manual maintenance and retooling activities can affect
execution times, Performance Efficiency, or Quality Rate
Method
during visual inspection. The scientific literature proposes a
classification of operational losses due to human actions,11 A procedure was created to identify the human activities that
which includes: impact the Overall Equipment Effectiveness, as illustrated
in Figure 1.
The initial stage of this study involves conducting an
Certain influence of operators on wasted time extensive literature review to assess the current state of
knowledge on the link between human factors and OEE. This
Losses where the duration of downtime, starting from the process entails examining articles from key databases, such
occurrence of a fault until the machinery resumes op- as Scopus and Web of Science. Once the literature portfolio is
eration, is influenced by the actions performed by the defined, the identified human elements are categorized into
operators; macro-categories based on a hierarchical structure, which is
necessary for the next phase of the procedure.
Next, the second phase of the study involved collecting
Uncertain influence of operators on wasted time opinions from experts in Operations Excellence, with the
Losses that may have varying duration of downtime based aim of confirming or rejecting the identified relationships
on the activities carried out by the operators; and determining the relevance and hierarchy of importance
4 International Journal of Engineering Business Management

Figure 1. flow of the proposed procedure.

of the human elements in relation to OEE performance. This Analysis of the OEE and human factor in
was accomplished through a questionnaire administered to a the scientific literature
Think Tank in Operations Excellence,1 and the opinions
collected of 13 involved experts were analyzed using the The procedure begins with a review of the current state of
Analytic Hierarchy Process (AHP) methodology. Accord- research aimed at identifying the primary human factors that
ing to Saaty,20 the Analytic Hierarchy Process (AHP) is a impact OEE values. The analysis focuses on articles that
multi-criteria method used to obtain pairwise comparison consider OEE in specific production contexts, both from a
scales for continuous and discrete factors. Developed at the theoretical and practical standpoint. To accomplish this, the
Wharton School of Business, it provides decision support search for articles within major scientific databases incor-
in situations where problem structuring is difficult, ratio- porates the keyword “OEE,” along with other specific terms
nality is limited, and there are multiple decision-making associated with improvement activities such as Lean
criteria that may be in contrast with each other. It enables Manufacturing and Six Sigma. These terms include “Im-
both tangible and intangible factors, such as experiences and provement,” “SMED,” “TPM,” “Fishbone diagram,”
values of the decision-maker, to be included in the choice “WCM,” and “Performance measurement management”.
among solution alternatives. It can also overcome defi- The selected publications were then assessed to deter-
ciencies in the description of the problem/criteria and accept mine their usefulness in identifying human activities that
contributions from decision-makers (e.g., situations in- influence OEE. The reference dataset used in this study
volving different areas).21 solely comprises scientific articles that identify how human
Thus, the categorization of human factors influencing actions impact plant, machine, or line performance at the
OEE was used to determine the AHP questionnaire, which OEE level. The resulting dataset analyzed in this study
was compiled by experts. The questionnaire aimed to define comprises 34 scientific articles, which are listed in
a comparison of the importance of human macro-factors in Appendix A. The bibliographic portfolio analysis was then
influencing OEE values and to compare the sub-factors conducted to identify and categorize the hierarchical
within the same macro-category. The experts’ responses structure of human factors affecting OEE, as outlined in
were then used to validate the human factors and quanti- Table 1. The model is structured into three hierarchical
tatively identify the factors that can significantly affect the levels:
achievement of a high degree of OEE. Indeed, expert
opinions and subjective judgments were gathered through 1° hierarchical level
pairwise comparisons, where the relative importance of
each human factor within a specific OEE parameter is as- the first level identifies the macro-categories of human
sessed. Participants ranked the factors in terms of their factors that impact achieving high OEE values. These
impact, using a numerical scale, considering criteria such as macro-categories are grouped by impact area;
expertise, experience, and knowledge. The collected
judgments have then been used to calculate weightings for
2° hierarchical level
each factor using mathematical algorithms, such as the
Saaty’s eigenvector method. These weightings reflect the The second level identifies the specific human factors that
relative importance of the human factors within each OEE influence performance indicator values, categorized ac-
parameter. Once the weightings have been established, they cording to the reference category;
were applied to the respective OEE parameters to quantify
the influence of the human factor on each parameter. This
allows for a numerical evaluation and comparison of the
3° Hierarchical level
impact of different human factors on the overall efficiency The third hierarchical level involves identifying the factors
of the manufacturing process. that may impact the accurate execution of manual activities
Luozzo et al. 5

and contribute to achieving higher OEE levels. These APT PRI * PQ GQ


factors are classified as either “Personal Features,” which OEEA ¼ * *
PBT APT PQ
includes Personal Abilities, Experience, and Training, or
“Human Interaction with the Environment,” which com- On the other hand, ISO 22400 defines the Model B of the
prises Low Noise Intensity, Proper Illumination, Proper OEE as an indicator that “represents the availability of a
Temperature and Humidity Conditions, Low Exposure to work unit, the efficiency of a work unit and the rate of
Vibrations, Electromagnetic Fields, Artificial Optical Ra- finished products integrated in a single indicator”.6 In
diation, Infrasound and Ultrasound, and Hyperbaric formulas:
Atmospheres.
OEE ¼ Availability *Performance rate *Finished Goods Ratio

Availability ¼ OPT =LT


Analysis of the human factors affecting
Performance Ratio ¼ NOT =OPT
OEE elements through the adoption of ISO
22400 standard taxonomy Finished Goods Ratio ¼ GQ =CM
In order to identify a strong relationship between the human
factors and the Overall Equipment Effectiveness, the in- Where Table 2 describes the elements characterizing both
fluence that each human factor exerts on the KPI has been OEE models:
underlined through the analysis of the specific OEE ele- After the identification of all the parameters configuring
ments. For this reason, the starting point is represented by the OEE, the human factors have been linked to each pa-
the study of the Overall Equipment Effectiveness following rameter considering the influence that they exert. The ra-
the two definitions of the KPI, OEEA and OEEB , provided tionale behind this approach is to gain a comprehensive
by the ISO22400 standard. In this context, the study of KPIs understanding of how human-related aspects impact the
is linked from the introduction of the ISO22400 standard, efficiency of equipment, for both types of OEE. This un-
which attempts to provide unambiguous definitions of in- derstanding can help in optimizing processes and improving
dicators in such a way as to promote standardisation. The overall efficiency by addressing human factors appropri-
ISO 22400 standard is based directly on the IEC ately. Indeed, by linking human factors to each parameter,
62264 standard and is linked to several other standards organizations can make informed decisions and take ap-
referring to the various levels of the functional hierarchy. propriate actions to optimize their processes, reduce
This means that to take full advantage of ISO22400, a downtime, enhance performance, and improve the quality
company should really understand the activities within the of their output.
MOM domain and their description provided in IEC The results are showed in the following table:
62264.7 With the Same Aim of the Previous Investigation, an
Within the ISO22400 standard, two different defini- Additional Analysis has Been Conducted in Order to Define
tions are provided for Overall Equipment Effectiveness, the Possible States of the Machinery or the Asset Could be
for which the convention for the definition of “Model A” at the Time of the Occurrence of the Human Factor
and “Model B” will be adopted. In the first definition Influencing the Attainment of High OEE Indicator Values.
(Model A), OEE is defined as that indicator representing Indeed, Schiraldi and Varisco in 20208 Proposed in Their
“the KPIs of work unit availability, work unit efficiency Study a Classification of the State of Machinery in Relation
and quality rate integrated into a single indicator”.6 In to the Cause of the Specific State and the Factor of Overall
formulas: Equipment Effectiveness for Both Model a and Model B,
Whose Relationship With the Human Factors has Been
OEEA ¼ Availability * Ef f ectiveness * Quality ratio Reported in Table 3.

Availability ¼ APT = PBT


Relationship between human factor,
Ef f ectiveness ¼ PRI * PQ = APT industrial sector and degree of automation
An additional evaluation has been carried out to determine
Quality Ratio ¼ GQ = PQ
the combined relationship between human factors
6 International Journal of Engineering Business Management

impacting OEE, industrial sector and degree of automaton publications was used. As in the industrial sector, also in the
of the company. Indeed, in this way it is possible to identify case of the analysis in relation to the degree of automation, it
the most relevant elements to be considered for the specific was not possible for all publications to identify the specific
organization under assessment. production mode: in several scientific articles, in fact, the
In order to perform the analysis on the basis of the in- parameter in question was not specified. In the latter case,
dustrial sector of reference, the International Standard In- the objective was to identify if a specific human factor was
dustrial Classification of All Economic Activities (ISIC) impacting in either the context of an automatic production
was used. ISIC proposes an international reference classi- system, or a semi-automatic production system, or a manual
fication of production activities, the purpose of which is to one. However, it is possible to point out that OEE is
propose various categories of activities that can be used for considered to be more suitable for semi-automatic and
the collection and reporting of statistical research based on automatic processes11 and, on the contrary, not recom-
these activities. mended for performance measurement with regard to
Starting from the papers identified in the literature within manual and semi-automatic assembly processes.1 For these
which the impact of human activities on OEE was observed reasons, the analysis was conducted with the objective of
(Table A.1), the reference industrial sector was analysed for analysing only the degree of semi-automatic and automatic
each paper according to the ISIC classification. For the automation.
analysis of the relationship between human factors and OEE The results of the analysis are shown in Table 4, which
parameters according to the degree of automation typical of reports the relationship between the industrial sector, degree
the specific production plant, the same dataset of scientific of automation and human factor impacting their combi-
nation. Note that for simplicity the level 2 human factors are
reported exclusively with their label (e.g., “D” stands for
Table 2. Elements characterizing OEE models as per ISO 22400 “Proper execution of logistics activities”).
standard. Looking at the results shown in Table 4, it is possible to
OEE model Parameters Description highlight the presence of three critical factors for each industry
sector of reference and for each degree of automation:
OEEA APT Actual production time
PBT Planned busy time · Proper execution of production activities;
PRI Planned runtime per item
· Proper execution of maintenance interventions;
PQ Produced quantity
GQ Good quantity · Proper execution of setup interventions.
OEEB OPT Operating time
LT Loading time Those three factors refer to the category of “Organization
NOT Net operating time and planning of manual activities” and these results could
GQ Good quantity produced derive from the need, regardless of the company’s configu-
CM Consumed material ration by degree of automation and reference industrial sector,

Table 3. Machinery states and human factors relationship.

Level 1 Level 2 Machinery state

Organization and planning of manual activities Proper execution of production activities (A) OFF; SLOW
Proper execution of setup interventions (B) OFF
Proper execution of maintenance interventions (C) OFF; STOP
Proper execution of logistics activities (D) SLOW
Definition and execution of standards, quality, Proper execution of procedures (E) SLOW
and procedures Expertise for conducting operational activities (F) OFF; SLOW; STOP
Order and cleanliness in the management of equipment within SLOW; OFF; ON;
the workplace (G) STOPS
Design of production and logistics systems Proper design and sizing of machinery (H) OFF; SLOW; STOP
Proper design of the production department layout (I) STOP; SLOW
Proper ergonomics of the operators’ workstations (L) SLOW
Proper design of material handling systems (M) SLOW
Information management Accuracy of manual data management (N) SLOW
Correct communication and sharing of information within the OFF
team (O)
Luozzo et al. 7

Table 4. Relationship between the human factors, industrial sector and degree of automation.

Industrial sector Semi-automatic Automatic

Defense & Space A; B; C; D A; C; E


Pharmaceutical A; B; D; E A; C; D; E
Food production A; C; D; E; F; G; H; I A; C; E; G; H
Aviation & Aerospace A; B; C; D; G; A; C; E
Automotive B; C; D; E; G; H; M G; L
Chemicals A; B; C; D; E; G A; C; E; G; L
Machinery A; B; C; D; G A; C; E
Shipbuilding A; B; C; D; G A; C; E
Textiles B; C; D; E; G C; E; A
Printing A; B; C; D; G A; C; E
Electrical & electronic manufacturing A; C; D; E; G A; C; E; G; L
Plastics A; B; C; D; G A; C; E
Renewables & environment A; B; C; D; G A; C; E
Glass, ceramics & concrete A; B; C; D; E; G; H; N A; C; E; G; H
Packaging & containers A; B; C; D; E; G A; C; E; G
Industrial automation A; B; C; G A; C; E
Paper & forest products A; B; C; D; E; G; H A; C; E; G
Railroad manufacture A; B; C; D; G A; C; E

for the scheduling by companies of production activities, further analysis of the level 1-2 factor weights. The results
maintenance activities and setup interventions. for the level 1 factors are presented below:
On the other hand, when analysing the factors identified Table 5 reveals that the factors that have a significant
for companies characterised by a semi-automated degree of impact on achieving high OEE values are related to “def-
automation, it can be observed that there are two human inition and execution of standards, qualities, and proce-
factors that are repeated for each industrial sector. The dures” and “Design of production and logistics systems”.
parameters in question are the Expertise for conducting These results highlight the importance of developing ac-
operational activities and Proper execution of procedures, curate Standard Operating Procedures (SOP) and taking into
that is, the operator’s ability to identify anomalies, such as consideration system design to improve OEE values.
possible signs of machine failure or non-conforming Hence, organizations should focus on these factors to im-
products, and training, that is, the degree of instruction prove their overall performance. The results for the level
on the processes and methods for carrying out the activities 2 factors are presented below:
learned within the enterprise. It is worth noting that only one question was included
in the pairwise comparison for the level 2 factors be-
longing to the “information management” macro-
AHP analysis, results and discussions
category, which resulted in a cr of 0. Consequently,
To determine the importance of the different levels of hu- the weights for these factors are as follows: 0.78 for the
man factors, an AHP questionnaire based on the proposed accuracy of manual data management and 0.22 for the
hierarchical structure has been developed to determine the correct communication and sharing of information
levels 1-2 factors weights. The questionnaire was filled by within the team. Based on the results, the most important
the Operations Excellence Think Tank members and re- level 2 factors are related to the proper execution of
quired participants to perform pairwise comparisons be- production and setup activities, expertise in operational
tween level 1 and level 2 criteria, as well as hierarchical activities, and the ergonomic conditions of operators’
ranking of level 3 criteria. workstations. These weights indicate that while planning
Saaty’s AHP semantic scale22 was used for the pairwise and organizing production and setup activities are crit-
comparisons, while experts ranked the level 3 criteria based ical for achieving efficient operations, the ergonomics,
on their impact on the specific level 2 factor, with position working conditions, and expertise of operators are also
one representing the highest ranking. vital for obtaining high oee values. In fact, the level
The responses were then averaged to identify the most 2 factor concerning the expertise of operators is the most
relevant personal features and environmental conditions. significant factor overall. finally, Tables 6 and 7 present
Each respondent was assigned a Consistency Ratio (CR) for the results for the level 3 factors.
8 International Journal of Engineering Business Management

Table 5. Weights of the level 1 factors.

Level 1 factors CR<0.1 CR<0.2 CR<0.3 Overall

Organization and planning of manual activities 0.36 0.29 0.22 0.18


Definition and execution of standards, quality and procedures 0.22 0.38 0.34 0.38
Design of production and logistics systems 0.32 0.22 0.34 0.32
Information management 0.1 0.1 0.01 0.12

Table 6. Average ranking of the level 3 factor “personal features”(for Each of the Impacted Level 2 Factor).

Level 2 factors Personal abilities Experience Training

Proper execution of production activities (A) 2.58 1.65 1.77


Proper execution of setup interventions (B) 2.64 2.18 1.18
Proper execution of maintenance interventions (C) 2.45 1.82 1.73
Proper execution of logistics activities (D) 2.27 1.91 1.82
Proper execution of procedures (E) 2.18 2.36 1.45
Expertise for conducting operational activities (F) 2.00 3.00 1.00
Order and cleanliness in the management of equipment in the workplace (G) 2.00 2.36 1.64
Proper design and sizing of machinery (H) 1.91 1.64 2.45
Proper design of the production department layout (I) 2.00 1.82 2.18
Proper ergonomics of the operators’ workstations (L) 2.09 1.64 2.27
Proper design of material handling systems (M) 2.18 1.91 1.91
Accuracy in manual data management (N) 2.00 2.45 1.55
Correct communication and sharing of information within the team (O) 2.18 2.18 1.64

Table 7. Average ranking of the level 3 factor “Human Interaction With the Environment” (for each of the impacted level 2 factor).

Low Low exposure


noise Proper Proper temperature and humidity to
Level 2 factors intensity illumination conditions vibrations, etc.

Proper execution of production activities (A) 2.18 1.64 2.55 3.64


Proper execution of setup interventions (B) 2.09 1.36 2.64 3.91
Proper execution of maintenance interventions (C) 2.00 1.45 2.73 3.82
Proper execution of logistics activities (D) 2.27 1.36 2.55 3.82
Proper execution of procedures (E) 2.36 1.36 2.27 4.00
Expertise for conducting operational 2.27 1.45 2.27 4.00
activities (F)
Order and cleanliness in the management of equipment in 2.45 1.27 2.45 3.82
the workplace (G)
Luozzo et al. 9

Table 8. hierarchical structure of the human factors impacting the KPI.

Level 1 Level 2 Level 3

Organization and planning of manual Proper execution of production activities (A) Personal features
activities Human interaction with the
environment
Proper execution of setup interventions (B) Personal features
Human interaction with the
environment
Proper execution of maintenance interventions (C) Personal features
Human interaction with the
environment
Proper execution of logistics activities (D) Personal features
Human interaction with the
environment
Definition and execution of standards, Proper execution of procedures (E) Personal features
quality, and procedures Expertise for conducting operational activities (F) Personal features
Order and cleanliness in the management of equipment Personal features
within the workplace (G)
Design of production and logistics systems Proper design and sizing of machinery (H) Personal features
Human interaction with the
environment
Proper design of the production department layout (I) Personal features
Human interaction with the
environment
Proper ergonomics of the operators’ workstations (L) Personal features
Human interaction with the
environment
Proper design of material handling systems (M) Personal features
Human interaction with the
environment
Information management Accuracy of manual data management (N) Personal features
Correct communication and sharing of information Personal features
within the team (O)

Table 9. Analysis of human factors and OEE elements.

Level 1 Level 2 OEEA OEEB

Organization and planning of manual Proper execution of production activities (A) PRI; PBT Lt; OPT
activities Proper execution of setup interventions (B) PBT GQ; LT
Proper execution of maintenance interventions (C) APT OPT; LT
Proper execution of logistics activities (D) APT POT
Definition and execution of standards, Proper execution of procedures (E) PRI; APT NOT; LT
quality, and procedures Expertise for conducting operational activities (F) APT; PRI; NOT; LT; OPT;
GQ GQ
Order and cleanliness in the management of equipment APT NOT; OPT
within the workplace (G)
Design of production and logistics systems Proper design and sizing of machinery (H) PRI OPT
Proper design of the production department layout (I) APT; PBT OPT; LT
Proper ergonomics of the operators’ workstations (L) APT NOT
Proper design of material handling systems (M) PRI OPT
Information management Accuracy of manual data management (N) APT OPT
Correct communication and sharing of information within APT OPT
the team (O)
10 International Journal of Engineering Business Management

Table 10. Weights of the level 2 factors (for Level 1 Factor “Organization and Planning of Manual Activities”).

Level 2 factors CR<0.1 CR<0.2 CR<0.3 Overall

Proper execution of production activities (A) 0.43 0.47 0.39 0.33


Proper execution of setup interventions (B) 0.36 0.33 0.36 0.41
Proper execution of maintenance interventions (C) 0.08 0.09 0.15 0.15
Proper execution of logistics activities (D) 0.15 0.11 0.11 0.11

Table 11. Weights of the level 2 Factors (for Level 1 factor “definition and Execution of Standards, Qualit y, and Procedures”).

Level 2 factors CR<0.1 CR<0.2 CR<0.3 Overall

Proper execution of procedures (E) 0.25 / / 0.25


Expertise for conducting operational activities (F) 0.41 / / 0.41
Order and cleanliness in the management of equipment in the Workplace (G) 0.34 / / 0.34

Table 12. Weights of the level 2 factors (for Level 1 Factor “Design of Production and Logistics Systems”).

Level 2 factors CR<0.1 CR<0.2 CR<0.3 Overall

Proper design and sizing of machinery (H) 0.16 0.12 0.24 0.24
Proper design of the production department layout (I) 0.31 0.28 0.27 0.25
Proper ergonomics of the operators’ workstations (L) 0.3 0.4 0.33 0.35
Proper design of material handling systems (M) 0.23 0.2 0.17 0.16

It is possible to observe that for the greater part of the high consistency ratio in AHP matrices, leading to more
level 2 factors, “Training” and “Proper illumination” are robust and trustworthy findings in the assessment.
assessed as the most important elements for increasing the
Overall Equipment Effectiveness. Hence, this result allows
to state that personal characteristics and the soft side of
Conclusions
people are actually evaluated by decision-makers as rele- The objective of this study is to establish the correlation
vant towards the reaching of excellence in operations between Overall Equipment Effectiveness (OEE) and the
performances, supporting the considerations of the shift human factors that have the greatest influence on this key
from Operational Excellence to Human Excellence theory23 performance indicator. To achieve this scope, the study aims
and showing the required need for an individualized Human to identify the activities or elements related to manpower
Resource Management.14 that impact OEE performance and, if appropriately con-
Moreover, it must be noted that some of the obtained trolled and managed, could result in achieving high OEE
responses show a medium-high CR level, due to the limited values. The study relies on a comprehensive literature re-
number of gathered responses. Managing a high consis- view to identify four categories of human factors that di-
tency ratio in AHP matrices is an important aspect of en- rectly affect OEE values and two categories that indirectly
suring the reliability and validity of the analysis. Indeed, affect the indicator. In total, twenty human factors were
several strategies can be employed to mitigate this effect: identified and organized into a hierarchical structure to
better understand their impact on the OEE indicator. Those
1. Reviewing and revising judgments; human factors can be assessed and evaluated, for instance,
2. Increasing the number of participants; through the adoption of Key Activity Indicators (KAIs),
3. Conducting sensitivity analysis; which can be used also for the evaluation of activities re-
4. Expert consultation and consensus building; lated to the human sphere.
5. Training and calibration sessions. The Analytic Hierarchy Process (AHP) methodology
was adopted to validate the identified relationships. A
By employing these strategies, researchers and practi- questionnaire was developed and completed by experts
tioners can effectively manage and mitigate the impact of a from an Operations Excellence Think Tank. The analysis of
Luozzo et al. 11

the results helped determine the relative importance of the Funding


different human factors and provided guidelines for im- The author(s) received no financial support for the research, au-
proving OEE. The study concluded that the “definition and thorship, and/or publication of this article.
execution of standards, qualities, and procedures” and the
“Design of production and logistics systems” are the main
areas requiring attention, particularly regarding the exper- ORCID iD
tise and training of operators. Sebastiano Di Luozzo  https://orcid.org/0000-0002-2591-1738
However, the results of the analysis were characterised
by responses that were not always perfectly consistent Note
and by matrices of pairwise comparisons with Consis- 1. The Think Tank in Operations Excellence was founded in
tency Ratios above the threshold value of 0.1. For these 2019 in ‘Tor Vergata’ University of Rome to provide a
reasons, in the future, it might be advisable to carry out an platform for information sharing, exchange of ideas,
AHP analysis in the first instance, presenting answers that knowledge creation, and dissemination of Operations Ex-
are as consistent as possible. Alternatively, it might be cellence best practices in industries. Currently, it is com-
advisable to carry out an analysis for the validation of the posed of 13 experts at managerial or executive positions
results that takes into consideration a wider range of with 10 to 30+ years of proven qualification in Operations
respondents, thus being able to perform statistical ana- Excellence themes, on behalf of six multinational compa-
lyses of the results. nies operating in different sectors: consumer goods, food,
Additionally, the identified human factors have been beverage, pharmaceutical, textile manufacturing, robotics,
related to the OEE models described by the ISO and automation technologies.
22400 standard, which represents the international norm
categorizing KPIs in Manufacturing Operations Manage-
References
ment, and successively to the specific company’s industrial
sector and degree of automation. Indeed, within the study 1. Nakajima S. Introduction to TPM. Portland, Oregon: Pro-
human factors were also classified according to the in- ductivity Press, 1988.
dustrial sector of reference and the degree of automation 2. Cesarotti V, Introna V, Rotunno R, et al. Investigating the
typical of the production plant of reference. In this sense, it relationship between energy consumption and overall
could also be interesting to validate the results obtained equipment effectiveness for improving manufacturing
through a case study that takes these variables into systems’productivity: an application in the thermo-
consideration. forming process. Int J Prod Qual Manag 2016; 18(2/3):
Those results could represent the starting point for a 279.
deeper analysis regarding the factors that affect the 3. Kotze D. Consistency, accuracy lead to maximum OEE
achievement of high level of OEE. Moreover, they also benefits. TPM Newsletter 1993; 4(2).
represent a set of factors that the companies could start 4. Ericsson J. Disruption analysis – an important tool in lean
monitoring through specific indicators in concert with the production. Lund: Department of Production and Materials
Overall Equipment Effectiveness. Thanks also to the Engineering, Lund University, 1997.
framework proposed, companies could understand which 5. Jonsson P and Lesshammar M. Evaluation and im-
are the most suitable indicators to be monitored based on provement of manufacturing performance measurement
their characteristics, considering the combination of the systems- the role of OEE. Int Jrnl of Op & Prod Mna-
industrial sector and degree of automation.In conclusion, gemnt 1999; 19(1): 55–78.
the research area is not yet well explored, and this study 6. ISO22400:2, Automation system and integration- key per-
may serve as a starting point for further analysis of the formance indicators (KPIs) for manufacturing operations
relationship between OEE and human factors. Future management-Part 2: definitions and descriptions, Geneva,
studies should focus on identifying additional human Switzerland: international Organization for Standardization,
factors in production settings and expanding the study to 2014
include respondents from both industrial and aca- 7. Di Luozzo S, Varisco M and Schiraldi MM. The diffusion of
demic backgrounds to validate the results obtained international standards on managerial practices. Int J Eng Bus
Tables 8–12. Manag 2020; 12: 184797902092161.
8. Schiraldi MM and Varisco M. Overall equipment effective-
ness: consistency of ISO standard with literature. Comput Ind
Declaration of conflicting interests Eng 2020; 145: 106518.
The author(s) declared no potential conflicts of interest with 9. Mathur A, Dangayach GS, Mittal ML, et al. Performance
respect to the research, authorship, and/or publication of this measurement in automated manufacturing. Measuring
article. Business Excellence 2011; 15(1): 77–91.
12 International Journal of Engineering Business Management

10. Di Luozzo S, Pop GR and Schiraldi MM. The human per- 17. Chen L, Liaw S and Lee T. Using an HRM pattern approach to
formance impact on oee in the adoption of new production examine the productivity of manufacturing firms – an em-
technologies. Appl Sci 2021; 11(18): 8620. pirical study. Int J Manpow 2003; 24(3): 299–318.
11. Hedman R, Subramaniyan M and Almström P. Analysis of 18. Sun H, Yam R and Wai-Keung N. The implementation and
critical factors for automatic measurement of OEE. Procedia evaluation of total productive maintenance (TPM) – an action
CIRP 2016; 57: 128–133. case study in a Hong Kong manufacturing company. Int J Adv
12. Dhillon B and Liu Y. Human error in maintenance: a review. Manuf Technol 2003; 22(3): 224–228.
J Qual Mainten Eng 2006; 12(1): 21–36. 19. Pinto L, Nunes E and Sousa S. A framework to improve
13. John G and Andrew C. Knowledge management and pro- training and development of workers’ technical skills: effects
fessional experrience: the uneasy dynamics between tacit on operational performance during company relocation.
knowledge and performativity in organizations. J Kwoled Procedia Manuf 2020; 51: 1806–1813.
Manag 2017; 21(4): 872–884. 20. Saaty R. The analytic hierarchy process—what it is and how it
14. Aloini D, Fronzetti Colladon A, Gloor P, et al. Enhancing is used. Math Model 1987; 9(5): 161–176.
operations management through smart sensors: mea- 21. Battistoni E. Decisioni a razionalità limitata. In: La Bella A
suring and improving well-being, interaction and per- and Capece G (eds). Manuale di direzione d’impresa. Milan,
formance of logistics workers. TQM journal 2022; 34(2): Italy: FrancoAngeli, 2012, pp. 287–342.
303–329. 22. Battistoni E, Colladon AF, Scarabotti L, et al. Analytic hi-
15. Barney J and Wright P. On becoming a strategic partner: the erarchy process for new product development. Int J Eng Bus
role of human resources in gaining competitive advantage. Manag 2013; 5(42): 42.
Hum Resour Manage 1998; 37(1): 31–46. 23. Schiraldi MM, Marino M and Luozzo SD. Human excel-
16. Bollinger A and Smith R. Managing organizational lence maturity model: leveraging human resource man-
knowledge as a strategic asset. J Knowl Manag 2001; 5: agement to achieve operational excellence. Int J Bus Excel
8–18. 2021; 1: 1.

Appendix

Table A1. selected bibliographic portfolio.

ID Reference Title Journal Year

1 (Xiang & feng, 2021) Implementing total productive maintenance in a Journal of industrial engineering and 2021
manufacturing Small or medium-Sized enterprise management
2 (Di Luozzo, et al., The human performance impact on OEE in the adoption Applied Sciences 2021
2021) of New production technologies
3 (Heng, et al., 2019) Automatic estimate of OEE considering uncertainty 52nd CIRP conference on manufacturing 2019
systems
4 (Dal, et al., 2000) Overall equipment effectiveness as a measure of International journal of operations & 2000
operational improvement- a practical analysis production management
5 (Fakhri, et al., 2019) Overall equipment effectiveness (OEE) analysis to IOP conference Series: Earth and 2019
improve the effectiveness of vannamei (Litopenaeus environmental Science
vannamei) shrimp freezing machine performance at
PT. XY, Situbondo-east java
6 (Tsarouhas, 2018) Improving operation of the croissant production line International journal of productivity and 2018
through overall equipment effectiveness (OEE) performance management
7 (Huang, et al., 2010) Manufacturing productivity improvement using International journal of production response 2010
effectiveness metrics and simulation analysis
8 (Zuashkiani, et al., Mapping the dynamics of overall equipment effectiveness Journal of quality in maintenance engineering 2011
2011) to enhance asset management practices
9 (Zennaro, et al., Micro downtime - data collection, analysis and impact on International journal of quality & reliability 2018
2018) OEE in bottling lines the San benedetto case study management
10 (Tsarouhas, 2020) Overall equipment effectiveness (OEE) evaluation for an International journal of productivity and 2020
automated ice cream production line performance management

(continued)
Luozzo et al. 13

Table A1. (continued)

ID Reference Title Journal Year

11 (Soltanali, et al., Measuring the production performance indicators for Measurement 2021
2021) food processing industry
12 (Castro & oliveira Proposal for OEE (overall equipment effectiveness) Brazilian journal of operations & production 2012
de Arujo, 2012) indicator deployment in a beverage plant management
13 (Muchiri & pintelon, Performance measurement using overall equipment International journal of production research 2008
2008) effectiveness (OEE): Literature review and practical
application discussion
14 (Hansson & Lycke, Managing commitment: Increasing the odds for International journal of quality & reliability 2003
2003) successful implementation of TQM, TPM or RCM management
15 (Phogat & Gupta, Identification of problems in maintenance operations Journal of quality in maintenance engineering 2017
2017) and comparison with manufacturing operations: A
review
16 (Mansour, et al., Evaluation of operational performance of workover rigs International journal of productivity and 2013
2013) activities in oilfield performance management
17 (Gupta & Vardhan, Optimizing OEE, productivity and production cost for International journal of production research 2016
2016) improving sales volume in an automobile industry
through TPM: a Case study
18 (Kshantra, et al., Calculation and improving the overall equipment International journal of emerging trends in 2020
2020) effectiveness for textile industry machine engineering research
19 (Ohunakin & Total productive implementation in a beverage industry: Journal of engineering and applied Science 2012
Leramo, 2012) A case study
20 (Rasib, et al., 2021) Non-conformance time As the component of time loss Journal of physics: Conference Series 2021
measures in assembly processes
21 (Li & rong, 2009) The reliable design of one-piece flow production system Computers & operations research 2009
using fuzzy ant colony optimization
22 (Hedman, et al., Analysis of critical factors for automatic measurement of Procedia CIRP 2016
2016) OEE
23 (Martomo & Analysis of total productive maintenance (TPM) 3rd international conference on industrial 2018
Laksono, 2018) implementation using overall equipment effectiveness mechanical, electrical, and chemical
(OEE) and six big losses: A case study engineering, ICIMECE 2017
24 (Nayak, et al., 2013) Evaluation of OEE in a continuous process industry on an International journal of innovative research 2013
insulation line in a cable manufacturing unit in Science, engineering and technology
25 (Sousa, et al., 2018) Applying SMED methodology in cork stoppers Procedia manufacturing 2018
production
26 (Tsarouhas, 2007) Implementation of total productive maintenance in food Journal of quality in maintenance engineering 2007
industry: a Case study
27 (Trattner, et al., Why slow down? Factors affecting speed loss in process The international journal of Advanced 2020
2020) manufacturing manufacturing technology
28 (Hopp & Spearman, Factory physics: Foundations of manufacturing McGraw-Hill 2008
2008) management
29 (Strauch, 2002) Investigating human error: Incidents, Accidents, and CRC press 2002
complex systems
30 (Nakajima, 1988) Introduction to TPM Productivity press 1988
31 (Benjamin, et al., Scrap loss reduction using the 5-whys analysis International journal of quality & reliability 2010
2010) management
32 (Dhillon, 2014) Human error in maintenance: An investigative study for IOP conf. Series: Materials Science and 2014
the future engineering
33 (Dhillon & Liu, Evaluation of operational performance of workover rigs Journal of quality in maintenance engineering 2007
2007) activities in oil field
34 (Aboutaleb, 2015) Empirical study of the effect of stochastic variability on Published PhD thesis 2015
the performance of human-dependent flexible flow
lines
Copyright of International Journal of Engineering Business Management is the property of
Sage Publications Inc. and its content may not be copied or emailed to multiple sites or posted
to a listserv without the copyright holder's express written permission. However, users may
print, download, or email articles for individual use.

You might also like