You are on page 1of 14

Computers in Industry 115 (2020) 103112

Contents lists available at ScienceDirect

Computers in Industry
journal homepage: www.elsevier.com/locate/compind

Adopting augmented reality in the age of industrial digitalisation


Tariq Masood a,b,∗ , Johannes Egger a
a
Institute for Manufacturing, Department of Engineering, University of Cambridge, 17 Charles Babbage Road, Cambridge, CB3 0FS, UK
b
Engineering Design Centre, Department of Engineering, University of Cambridge, Trumpington Street, Cambridge, CB2 1PZ, UK

a r t i c l e i n f o a b s t r a c t

Article history: Industrial augmented reality (IAR) is one of the key pillars of the industrial digitalisation concepts, which
Received 5 February 2019 connects workers with the physical world through overlaying digital information. Augmented reality
Received in revised form 31 May 2019 (AR) market is increasing but still its adoption levels are low in industry. While companies strive to
Accepted 9 July 2019
learn and adopt AR, there are chances that they fail in such endeavours due to lack of understanding key
challenges and success factors in this space. This study identifies critical success factors and challenges
Keywords:
for IAR implementation projects based on field experiments. The broadly used technology, organisation,
Augmented reality
environment (TOE) framework was used as a theoretical basis for the study, while 22 experiments were
Manufacturing
Technology
conducted for validation. It is found that, while technological aspects are of importance, organisational
Organisation issues are more relevant for industry, which has not been reflected to the same extent in the literature.
Environment © 2019 Elsevier B.V. All rights reserved.
TOE
Challenges
Implementation
Critical success factors
Industry 4.0
Industrial experiments
Digital

1. Introduction resilient smart factories (Rashid et al. 2017) with intelligent manu-
facturing environments (Kagermann et al. 2013). The augmented
The industrial digitalisation drive is making use of a number of operator paradigm (Pereira and Romero 2017) relies on IAR to
emerging technologies. Industry 4.0 and other similar terms like achieve that goal. IAR is classified by the European Union as one
Industrial Internet, or Internet 2025 are broad concepts which are of the main technologies that will drive the smart factory devel-
built around the horizontal value network integration, the verti- opment (Davies 2015) by enabling the seamless human-machine
cal integration within a value creation system, and the end-to-end interactions through visualising interactive and contextual infor-
engineering integration across the product lifecycle (Kagermann mation (Longo et al. 2017). In order to facilitate collaboration and
et al. 2013) through digital technologies. interaction between humans and production systems based on dig-
Despite increased and intelligent automation being a vital part ital data, researchers focus on utilising AR in industrial applications.
of those ventures, humans still play an important role in manu- However, it is unclear how to implement this technology. Hence,
facturing operations (Pereira and Romero 2017; Kagermann et al. this research is aimed at determining success factors and challenges
2013). The Industry 4.0 and similar initiatives do not focus on ‘dark in implementing IAR systems.
factories’ without humans, but aim to enable people to work in A recent structured literature review (Egger and Masood 2018;
Egger and Masood In press) and an industrial survey provided
guidance on which aspects industry should focus on to ensure AR
implementation success (IS) with following conclusions (Masood
Abbreviations: AR, Augmented Reality; ES, External support; HHD, hand-held
device; HMD, Head-mounted device; H&S, Health and Safety; IAR, Industrial Aug-
and Egger 2019): (i) technology context (TC) and organisational fit
mented Reality; IS, Implementation success; OF, Organisational fit; SC, System (OF) are key success factors for the AR implementation, (ii) user bar-
configuration; TAM, Technology acceptance model; TC, Technology compatibility; rier (UB) and external support (ES) do not significantly influence the
TCT, Task Completion Time; THR, Technology hardware readiness; TOE, Technology, AR IS, (iii) while technological aspects are important, organisational
Organisation, Environment; UB, User barriers.
∗ Corresponding author at: University of Cambridge, Department of Engineering,
issues are more relevant for industry. This article extends the work
Institute for Manufacturing, 17 Charles Babbage Road, Cambridge, CB3 0FS, UK.
presented in Egger and Masood (2018; In press) and Masood and
E-mail address: tm487@cam.ac.uk (T. Masood).

https://doi.org/10.1016/j.compind.2019.07.002
0166-3615/© 2019 Elsevier B.V. All rights reserved.
2 T. Masood and J. Egger / Computers in Industry 115 (2020) 103112

Egger (2019) by conducting 22 experiments in industry the results extent to which the IAR system increased the efficiency through
of which are presented here. a decreased task completion time (TCT) and a decreased error rate
The rest of the article is structured as follows. The literature on depends on the task complexity (Syberfeldt et al. 2016; Henderson
IAR is reviewed, and challenges are identified as well as research and Feiner 2011), several studies confirm the superiority of IAR
questions are formulated in section 2. Then experiment method- supported assembly over conventional methods, like paper-based
ology is outlined in section 3. The results of the experiments are instructions in laboratory experiments (Uva et al. 2018; Bosch et al.
presented in section 4. After the discussion in section 5, section 6 2017).
concludes this article. However, the participants in the studies mentioned above were
recruited from an academic background. It was hypothesised in lit-
2. Industrial augmented reality erature that this selection can influence the results (Sanna et al.
2015). This was confirmed by a long-term study conducted at an
In this section, the background and challenges of IAR are automotive factory (Funk et al. 2017). While the projection-based
explained. Based on the findings, the research gap and the research IAR system was useful in the learning phase for untrained work-
questions are defined. ers, it slowed down expert workers. Expert workers also perceived
a higher cognitive workload using the IAR system as untrained
2.1. Background workers. Hence, the experience and the background of the users
themselves influence the effect of IAR solutions.
At the present time, many companies see AR as an important Shop-floor and organisational processes would need to be
tool to provide new services related to their products (Zubizarreta adapted in order to gain a significant advantage by supporting the
et al. 2019). By providing flexible real-time information and the task by IAR. Integration conflicts and possible disruptions have been
possibility of obtaining information hands-free IAR can offer a sub- mentioned in literature (Funk et al. 2017; Espíndola et al. 2013;
stantial efficiency benefit (Guo et al. 2014; Hou and Wang 2013) by Gavish et al. 2013; Porcelli et al. 2013). Porcelli et al. (2013), for
decreasing the error rate (Wang et al. 2016a; Wang et al. 2016b), example, point out, that when using IAR in maintenance, the train-
like picking or assembly errors and it provides easy ways to commu- ing and work organisation of technicians needs to change. Realising
nicate with experts in maintenance tasks (Mourtzis et al. 2017b). the potential of IAR can only happen if organisational processes are
IAR can be used for assembly operations, either in training changed.
(Werrlich et al. 2017; Hahn et al. 2015) or as a live guidance system
for operators (Blattgerste et al. 2017; Funk et al. 2017). In logis- 2.2.2. User acceptance and ergonomics
tics, ‘pick-by-vision’ is a prominent concept utilising IAR to indicate In a variety of studies, the usability and ergonomics of the IAR
picking locations and quantities (Hanson et al. 2017; Renner and system is a dependent variable (Kretschmer et al. 2018; Uva et al.
Pfeiffer 2017; Guo et al. 2014; Reif et al. 2009). Another area of 2018; Espíndola et al. 2013). Often, the weight of head-mounted
logistics where IAR can be used are general warehouse operations devices (HMDs) and the field of view of those devices is a point of
(Stoltz et al. 2017). Additional prominent fields of applications criticism (Holm et al. 2017; Schlagowski et al. 2017; Makris et al.
include quality assurance (Antonelli and Astanin 2015; Segovia 2016). However, ergonomics incorporates more aspects than wear-
et al. 2015) and maintenance (Martinetti et al. 2017; Masoni et al. ability. Murauer et al. (2018) showed that use over a work day of
2017; Mourtzis et al., 2017a; Palmarini et al. 2017; Zhu et al. 2012). IAR systems can cause visual fatigue and impact concentration per-
As soon as operators depend on or can profit from (real-time) infor- formance. In addition, the design of the user interface can lead to
mation, IAR can be used to intuitively display this information on distraction or disorientation (Funk et al. 2017; Hou et al. 2013).
site. No industry-wide standard has been established yet on how to
The basic components of an AR system are the visualisation tech- design user interfaces and user interaction for augmented real-
nology, a sensor system, a tracking system, a processing unit, and ity devices. Compared to touch devices, there is no common
the user interface (Wang et al. 2016a). The interaction between framework on how the user can give the system feedback intu-
those components, their function, and the technologies used are itively. Different systems on gesture recognition use different
shown in Fig. 1. hand-gestures (Saxen et al. 2017; Wang et al. 2016b; Rodriguez
When relating the industrial application to the visualisation et al. 2015).
technology, a significant difference can be observed. Static screens
or projectors are used for stationary applications, like assembly 2.2.3. Software capabilities
operations (Funk et al. 2017). Projection-based solutions utilise Most of the functionality of IAR systems is related to the
projectors to display information onto the workspace (Funk et al. software. One focus area of research is the tracking technology
2017; Funk et al. 2016). Static screens can be used to display, e.g. (Blanco-Novoa et al. 2018; Kretschmer et al. 2018; Tong et al. 2016).
interactive standard operating procedures (SOPs) (Holm et al. 2017) When placing digital content in the real world, reliable tracking of
for the current status of the assembly and animate the next assem- the physical world is essential to provide a coherent user experi-
bly step. They enable operators to move around and access and ence, but hard to achieve.
read information hands-free, speeding up operations (Syberfeldt As the technology matures, the integration of IAR solutions into
et al. 2016). Syberfeldt et al. (2017) provides evaluation criteria for the current IT infrastructure, like product lifecycle or quality man-
selection of smart glasses for shopfloors. agement tools is of importance (Mourtzis et al., 2017a; Flatt et al.
2015; Havard et al. 2015; Serván et al. 2012). As industrial systems
2.2. Challenges become digitally enabled, interfaces and content creation (author-
ing) need to follow certain standards (Flatt et al. 2015; Havard et al.
Despite the advantages and the broad applicability, literature 2015). While there is a vast number of standards available (Trappey
has identified a variety of different challenges, which are discussed et al. 2017), none of them is dominant yet.
in the following sections.
2.3. Results and analysis of a recent industrial survey
2.2.1. Shop-floor and organisational challenges
In general, IAR for assembly training and for assembly guidance Results and analysis of a recent industrial survey are discussed
shows promising results in laboratory environments. While the in this section (Masood and Egger 2019; Masood et al. 2018). This
T. Masood and J. Egger / Computers in Industry 115 (2020) 103112 3

Fig. 1. Components and their interaction of an AR system (based on Wang et al. 2016a; Azuma 1997).

study used the technology, organisation, environment (TOE) frame- 3. Method


work as a basis for analysis (DePietro et al. 1990). Further details
are reported by Masood and Egger (2019). This section determines a suitable research methodology, start-
The metrics to analyse importance and influence concerning ing with the research approach (see Fig. 3). 22 experiments were
IAR implementation of the success factors from the qualitative conducted to answer the research question.
part are the count and the normalised average rank. Those two This article makes use of the learnings from the systematic lit-
metrics are then used to plot the success factors on a chart, erature review of AR (Egger and Masood 2018; Egger and Masood
where the x-axis represents the absolute number of how often In press) and industrial survey of AR implementation (Masood and
a success factor was chosen and the Y-axis represents the aver- Egger 2019) to lay foundations for the AR experiments in industry
age normalised importance rank given by the respondents of the (presented in this article), which are further used to ground the
industrial survey (see Fig. 2) in the interval [1,2], where 1 is theoretical knowledge.
the most important rank. Each dot on the chart represents one
success factor. The items are classified into three distinct areas, 3.1. Experiments
namely high, medium, and low relevance based on their count and
rank. The experiment guides through an assembly task utilising an
HMD (Microsoft HoloLens). An assembly application was chosen
because it is prominent in the literature and in industry. However,
2.4. Research gap and research question it cannot be generalised for all IAR use cases.

IAR can have a significant impact on the efficiency and effec- 3.1.1. Research setting
tiveness of industrial operations. However, studies show that new The influence of user acceptance is controversial in the quanti-
issues arise which are not necessarily of technical nature when tative and qualitative survey results. To refine the understanding
moving from the laboratory setting towards industrial implemen- of user acceptance and how to achieve it, the study needed to be
tation. conducted with operators at factories. In addition, non-operator
The compound annual growth rate of the IAR market is projected industry professionals took part as well to provide their perspec-
to be around 74% between 2018 and 2025 while the aggregated tives.
market of IAR will reach $76 billion in 2025 (BIS Research, 2018). Several field studies used IAR for assembly tasks (Funk et al.
This growth is likely to be sustained or accelerated by the growing 2017; Syberfeldt et al. 2016; Hahn et al. 2015; Gavish et al. 2013).
maturity of IAR technology and broad variety of industrial applica- Gavish et al. (2013) used an hand-held device (HHD), which may
tions. An increasing number of companies will be faced with issues impede the information access, as the hands-free aspect of HMDs
arising from IAR implementation. Despite this increase in industrial is an important factor. Hence, an HMD was chosen for this exper-
diffusion of the technology, no extensive research of technology iment. Syberfeldt et al. (2016) did not conduct their study with
implementation has been conducted. Due to the lack of a global operators in the field.
industry-based perspective considering the broader context of IAR Hahn et al. (2015) used an HMD for assembling a printed circuit
implementation, the following research question is posed: board (PCB). Due to the nature of PCBs, the use of 3D holograms is
‘What are the challenges and success factors for adopting aug- not necessary. Similarly, Funk et al. (2017) utilised in-site projec-
mented reality in industry?’. tion to indicate parts necessary for an assembly step. Both of the
4 T. Masood and J. Egger / Computers in Industry 115 (2020) 103112

Fig. 2. Success factors based on count and rank given by the respondents of the industrial survey (Masood and Egger 2019).

Fig. 3. Overall Research approach.

studies don’t utilise 3D holograms to show the correct assembly. pants have sufficient knowledge about the experiment and its
This experiment, however, utilises the capabilities of the HoloLens goals.
to show the correct assembly procedure as 3D hologram.
As primary data from subjects is collected, ethical approval
3.1.2. Sample and sample size
was applied for and granted by the Ethics Review Commit-
As an assembly task was chosen, one group of participants
tee of the University of Cambridge Engineering Department.
are assembly operators and field technicians. In order to validate
A participant information sheet and a consent form were
the usability of IAR, the companies chosen have a low degree of
used in addition to verbal information to ensure partici-
automation.
T. Masood and J. Egger / Computers in Industry 115 (2020) 103112 5

Table 1
Company background and participant classification.

Operators Non-operators
Company/Institution Industry Revenue Employees
Assembly Field Application (Operations) Students
Workers technician engineers Managers

University of University N/A 11,100 0 0 0 0 7


Cambridge (2015-16)
Beckhoff Automation Automation equipment £724 million 3,900 (2017) 0 0 2 1 0
supplier (2017)
Herman Miller Furniture £2.28 billion 8,000 (2017) 5 0 0 1 0
manufacturer (2017)
Fluiconnecto Hydraulic equipment £121 million 3,150 (2014) 5 1 0 0 0
(Subsidiary of the manufacturer (2014) (Numbers of (Numbers of
Manuli Group) Manuli Group) Manuli Group)

Total 11 11

Beckhoff automation1 is a supplier for pc-based automation Table 2


Age and previous knowledge about IAR of the experiment participants.
equipment, used in industrial and building automation. To sup-
port their customers, Beckhoff is already looking into using IAR for Non-operators Operators
maintenance tasks. Age
Herman Miller2 produces high-end furniture mainly for offices. below 26 5 2
Office chairs, office tables, and boundary screens are the main prod- 26-40 4 3
ucts produced at the site the experiment was conducted at. These 41-55 2 5
above 55 0 1
products are characterised by a high degree of customisability. To Heard of AR before the experiment?
some extent, certain products are one-offs. The assembly process Yes 10 6
is completely manual. No 1 5
Fluiconnecto3 assembles hydraulic hoses and connectors Used AR before this experiment?
Yes 4 2
mainly for construction equipment manufacturers. Their assembly
No 7 9
is organised in manufacturing cells to react flexibly to customer
demands, as fluiconnecto has to deal with a low batch size and a
large number of variations.
3.1.4. Data collection
As results might differ between operators and non-operators
Data was collected through an initial questionnaire, measuring
(Sanna et al. 2015), a control group is used to identify differences
the TCT, measuring the workload with the raw NASA Task Load
between those groups. Assembly workers are recruited in the com-
Index (TLX) (Hart 2016), and a feedback session in the end. In the
panies. Members of the control group are recruited in companies
feedback session, the questions were asked semi-structured to gain
and the University of Cambridge. All of the control group members
insights into the operators’ perspective of IAR. Fig. 8 shows the data
have a university degree. No incentive to participate was offered.
gathering process. The TCT and the NASA TLX were aggregated into
Table 1 shows the sample description and size.
two main categories (operators and non-operators) and visualised
through a boxplot. The answers to the semi-structured questions
were synthesised per company according to the most relevant chal-
3.1.3. Materials lenges and success factors based on the literature review and the
The Microsoft HoloLens was used, which is a stand-alone device, survey.
capable of mapping the environment and placing holograms in a
fixed position. Unity (Version 2017.4.1f1) was used to develop the 3.1.5. Data analysis
3D environment. Certain parts of the Holotoolkit were used in the Data was analysed as follows.
application4 . Fig. 4 shows the software components of the applica-
tion and how they interact based on the C4 software visualisation 4. Results and analysis
framework (Brown 2018) including user gaze.
During the experiment, participants assembled a gearbox (see This section presents the results and analysis of the 22 experi-
Fig. 5) with three planetary stages in 12 steps (see Fig. 6). The assem- ments (15 in industry, 7 in University). The results and analysis will
bly is based on an open source project5 and was 3D printed on be discussed in detail in the discussion section (see Section 5).
a Makerbot Replicator Gen5 available at the University of Cam- Table 2 shows the age brackets of the experiment participants
bridge. Fig. 7 depicts a screenshot of how users see the application and the previous knowledge/experience with IAR. In general, more
and describe the ways of the application to show the necessary of the non-operators have heard or used IAR before the experiment.
information and different stages of the assembly process and the Fig. 9 shows the boxplot of the TCT. Operators take longer to
enhancement through IAR. finish the assembly task. Concerning the NASA TLX, however, oper-
ators perceive the workload as lower (see Fig. 10). Yet, the spread
among both groups is high and the boxplots overlap. Hence, it can-
not be conclusively stated that the perceived workload amongst
1
https://beckhoff.com/ operators is lower.
2
https://www.hermanmiller.co.uk/ When analysing the item scores of the NASA TLX between non-
3
https://www.fluiconnecto.com/ operators and operators (see Fig. 11), the frustration item shows the
4
The experiment code is available on Github. Necessary tools: Unity (free devel-
opers edition); Visual Studio 2018 (free developers edition): https://github.com/
biggest difference. In the discussion with the operators and non-
eggerjo/ARAssemblyGuidance operators after the assembly task, it became clear the frustration
5
Available from: https://www.thingiverse.com/thing:25063 of the non-operators stems mainly from the assembly itself. It was
6 T. Masood and J. Egger / Computers in Industry 115 (2020) 103112

Fig. 4. Framework of the software system (based on the C4 framework (Brown 2018)).

Fig. 5. Exploded view of the gearbox, which is assembled in the experiment.

frustrating for non-operators to put the parts together correctly Egger and Masood In press) and industrial survey (Masood and
because of the tight fit of the parts. Operators did not state this fact. Egger 2019). Then, implications for academia and industry are out-
Table 3 sums up the key-takeaways based on the three most lined as well as limitations of the study and possibilities for further
important challenges (highest percentage) of the technology and work.
organisation context for industry. In addition, the H&S aspect was
included, as it was specifically highlighted during the experiments. 5.1. Technology context
Table 4 sums up the key-takeaways according to four of the high
relevance success factors. Table 4 also provides relevant use cases. The technology hardware readiness (THR) is important accord-
ing to the quantitative part, however not as important as the SC
5. Discussion and the technology compatibility (TC). This is also supported by
the qualitative results, as hardware robustness and battery life are
In this section, the results of the experiments are discussed, lowly ranked success factors. There are three main reasons why
compared, and related to the literature (Egger and Masood 2018; THR is not as important as SC and TC.
T. Masood and J. Egger / Computers in Industry 115 (2020) 103112 7

Fig. 6. Gearbox assembly steps with pictures.

1) IAR hardware is commercially available, which indicates that a 3) Lastly, the second most important advantage is the efficiency
certain level of maturity has been reached. This is confirmed by improvement through IAR. The system needs to be correctly con-
the experimental feedback session (see Tables 3 and 4), where figured to perform. Hardware and pilot tests with the users can
the hardware is suitable for industrial use according to the test uncover initial problems, like low visibility of the virtual con-
subjects. tent, especially as the visualisation device and technology itself
2) The most significant advantage of IAR according to the survey has an influence on how well the IAR system performs (Renner
is the effective access to information (Masood and Egger 2019). and Pfeiffer 2017). Hence, the SC is a crucial success factor for
To make the information accessible on an IAR device and, thus, achieving an efficiency increase. This fact aligns with the highly
materialise the advantage of effective information access, the ranked success factor of visibility.
system has to be integrated into the existing IT infrastructure.
Hence, the IAR system has to be (made) compatible with the
The second measure of SC is the system configuration according
current IT system (part of TC). However, compatibility with cur-
to health and safety (H&S) standards. Not only can IAR be dis-
rent IT system is not an important success factor according to
tracting, it can also collide with regulations governing the existing
the survey. Hence, the lack of compatibility is a challenge to
(H&S) system (see Table 3). Especially when users wear prescrip-
overcome.
tion safety glasses, the use of 3D AR HMDs, like the HoloLens, is an
issue.
8 T. Masood and J. Egger / Computers in Industry 115 (2020) 103112

Fig. 7. Impressions/user view of the HoloLens application and holograms with a description of the four main areas.

Table 3
Challenges according to experiments feedback.

Beckhoff Automation Herman Miller Fluiconnecto

User interface Sufficient visibility of content Sufficient visibility of content Sufficient visibility of content
Sufficient field of view Sufficient field of view Sufficient field of view
Technology
Weight Too heavy for 8h Too heavy for 8h Too heavy for 8h
Tracking technology Needs improvement for field Sufficient Sufficient
Challenges service
H&S No concerns Not all HDMs fulfil safety Not all HDMs fulfil safety
glasses regulation Distraction glasses regulation
by AR was problematic on
shopfloor
User acceptance Customisable instructions More experienced operators AR is not well known - fear of
necessary are more sceptical change and unknown
Organisation
Organisational Lack of integration possibilities No concerns No concerns
structure into enterprise systems (ERP,
MRP, etc.)
Shop floor processes No concerns Shop floor needs to be adapted Shop floor needs to be adapted
(lightning conditions, anchor (space around operator to use
points, assembly steps, moving gestures) No need for adaption
parts) if only used for training
Cost Content authoring is costly Content authoring is costly Hardware prices are low
Hardware prices are low Hardware prices are low enough
enough enough
Environment – – –

A challenge that emerged is the ability to scale the solution 5.2. Organisation context
up easily. This challenge was confirmed in the feedback discus-
sion after the experiment (see Table 3). While the cost of hardware From experiments, it is evident that the user acceptance is an
is no issue, the ability to scale the software applications up effi- important challenge and a significant success factor respectively.
ciently is as system integration and content authoring are difficult The experiments show that introducing the technology to opera-
(see Tables 3 and 4). Currently, it takes programming experience to tors can decrease the user barriors (UB) challenge if the technology
develop for every new task (for example a change in the mainte- is easy to use and demonstrates capabilities useful for users. It
nance procedure), which scales with a large-scale implementation. was stated by several operators after the experiment that their
reservations towards AR were alleviated through the process of
introducing them to the technology and gathering their feedback
(see Tables 3 and 4).
T. Masood and J. Egger / Computers in Industry 115 (2020) 103112 9

Fig. 8. Impressions of the data collection.

Table 4
Success factors and use cases according to experiments feedback.

Beckhoff Automation Herman Miller Fluiconnecto

User acceptance Easy to achieve if operators benefit Sceptical operators can be Users need to be educated about
High relevance success from technology convinced by relevant proof of AR early on to achieve acceptance
factors concept for them
Visibility of Important, but already sufficient Important, but already sufficient Important, but already sufficient
information
Ergonomics Long-term pilot tests necessary Weight needs to be reduced Important, but already sufficient
with different user interfaces and for training purpose
hardware systems
Usability of user Intuitive and hands-free access to Multimodal information is suitable Gesture recognition needs to be
interface information is necessary to achieve for dyslexic or non-native speakers more reliable
usability (no need for text if done right)
Voice recognition is problematic in
factory environment AR is
engaging and ’fun’
Use Cases Field service Non-repetitive Training High variety/low volume Training Maintenance Operating
assembly tasks Tele-maintenance assembly guidance Quality machinery
Quality assurance assurance (component alignment)
Human-robot collaboration

While the NASA TLX results do not indicate a significant differ- were on average 110 s faster than operators. These results contrast a
ence in perceived workload between operators and non-operators long-term study where untrained workers report a lower NASA TLX
(see Fig. 10), the TCT differs significantly (see Fig. 9). Non-operators and have a similar TCT (Funk et al. 2017). This could be explained
10 T. Masood and J. Egger / Computers in Industry 115 (2020) 103112

not concerned with the organisation context, as the challenge cat-


egories are outlined in the literature. The survey data shows that
70% of the pilot and implementation project have started within
the last three years (Masood and Egger 2019). Thus, it is possible
that academic research has not sufficiently tackled the problem yet.

5.3. Environment context

The ES has no statistically significant influence on the IS. This


has been observed in other studies concerned with IS (Zhu et al.
2010) or Industry 4.0 adoption (Arnold et al. 2018) as well. Several
possible explanations for this issue exist.

Fig. 9. Boxplot of the TCT for operators and non-operators. • Companies may not use industry associations to develop and pro-
mote de-facto industry standards, as the industrial use is in its
infancy and such information might be seen as proprietary.
• ES might be crucial in the adoption decision-making process
itself, prior to the actual implementation stage. At this initial stage
of the adoption decision, companies might not be equipped with
an appropriate level of knowledge around IAR, as it is a new tech-
nology. Hence, the influence at the adoption stage concerning ES
to build up the necessary knowledge base could be significant.

5.4. Summary of success factors and challenges

To summarise the discussion section and to answer the research


question, the three main success factors and the four main chal-
lenges of IAR implementation are highlighted in this section (see
Fig. 10. Boxplot of the total raw NASA TLX score for operators and non-operators. Figs. 12 and 13). Due to the use of different methods, it is possible
to validate the results through data triangulation. In addition, the
experiments facilitated an in-depth understanding of each of the
by the knowledge and experience non-operators have of IAR com- challenges and success factors.
pared to operators (see Table 2) within this research. This highlights The quantitative part of the survey was used to prioritise the
the importance to educate and include operators early on in the challenges and success factors, which are validated through the
implementation project to gain the expected benefits. qualitative part of the survey. Despite the fact that UB was not sig-
In general, the qualitative results indicate that most of the chal- nificantly correlated to IS, user acceptance is on top of the success
lenges industry is concerned with stem from an organisational factors and the challenges, as the qualitative part indicates that
point of view in contrast to academic research, which tends to have user acceptance is a key challenge and success factor. In addition,
a technological focus. Yet, this is no indication that academia is the qualitative part was used to differentiate between challenges

Fig. 11. NASA TLX item scores.


T. Masood and J. Egger / Computers in Industry 115 (2020) 103112 11

Fig. 12. Main success factors for IAR implementation.

and success factors and to uncover challenges not mentioned in the the findings in theory and allowed this research to frame the results
studies reviewed in the systematic literature review. in an academically recognised way.
The feedback of the experiments enabled an in-depth under-
standing of the challenges and success factors (see Tables 3 and 4). 5.6. Implications for practice
Additionally, the quantitative results of the experiments (see
Figs. 9–11) showed if operator-specific issues exist and how they The study unveils the areas that are crucial to IAR project suc-
could be alleviated. cess. The resulting main challenges and success factors can be used
It has to be noted that focusing on the identified challenges as a starting point when developing an IAR system. This information
and success factors does not guarantee success when implement- acts as a guideline of crucial aspects to consider before and during
ing IAR. Some factors were unveiled in the qualitative part, but it the implementation phase. Hence, this article provides guidance on
is unclear how strong their influence is. In addition, other factors which aspects industry should focus on to ensure IS. As the number
related to different contexts might exist. Those can be relevant to of implementation projects of IAR is expected to increase over the
IAR implementation as well and might be industry or application next years, a rising number of companies will be subjected to the
specific. issues presented in this article.
Figs. 12 and 13 summarises the main success factors and chal- Academic and industrial research on AR is quite different, the
lenges respectively. former looks for new science, more robust algorithms and faster
response, while industry wants solutions to their problems, to
5.5. Implications for Academia increase productivity and shorten learning curve. It is important
to address how a balance can be achieved in getting the most out
This study used the TOE framework to determine the effects of of AR research and applications. This article is a step forward in
different factors in the IS. The quantitative part indicated factors achieving a balance by providing insights from academic literature
that influence the IS and shows the empirical applicability of the and linking those with industrial thinking while also providing evi-
TOE framework for IAR solution. dence through industrial experiments. Both academia and industry
This article has contributed to the academic body of knowledge could benefit by investing more on developing AR demonstrators
through three main aspects. First, the TOE framework has been for various industrial sectors and applications, which can poten-
used for a variety of Industry 4.0 related new technologies. Through tially increase the adoption levels of AR in industry.
the quantitative part and the qualitative categorisation according
to the TOE model, this study has expanded the body of knowl- 5.7. Limitation and further work
edge for TOE based research. Second, a quantitative, a qualitative,
and an experimental perspective were utilised towards IAR imple- IAR is a fairly new technology in industry without widespread
mentation. Based on those three pillars, the results from industry adoption. The capabilities of the technology are still important and
professionals allowed to uncover and analyse challenges and suc- will be important in future, especially in support of achieving Indus-
cess factors. Finally, the utilisation of the TOE framework grounds try 4.0 objectives, as it has not reached maturity yet. However, the
12 T. Masood and J. Egger / Computers in Industry 115 (2020) 103112

Fig. 13. Main challenges of IAR implementation.

technology tends to be not as important as organisational issues aim of this study was to answer the research question ‘What are
when implementing IAR. This shift from a technology focus to an the challenges and success factors for the implementation of industrial
organisational focus is not reflected in the IAR research. Due to the augmented reality?’ through 22 experiments conducted in industry
significant implications of the organisational fit (OF) and the com- and university.
patibility of the technology towards IS, future research can focus The contributions of this article to the academic and industrial
on how to adapt processes for IAR, how to align it with the current knowledge include:
systems, or how to ensure the operator’s health and safety when
using those systems. • Addition to TOE framework based research and Industry 4.0 rel-
The qualitative part of the study unveiled factors that have not evant technologies. Using TOE framework, IAR challenges were
been part of the quantitative study. The scalability of the IAR solu- identified under following classifications: Technology (user inter-
tion seems to be of interest for industry. Scalability can be part of a face, weight, tracking technology, H&S), and Organisation (user
‘relative advantage’ construct in the technology context for future acceptance, organisational structure, shop floor processes, cost).
TOE framework-based research. • Guidance for focus areas for achieving success in adopting AR in
Future studies can incorporate acceptance models (like the industry. High relevance IAR success factors were identified as
Technology Acceptance Model) into a TOE-based research project follows: user acceptance, visibility of information, ergonomics
to ground these factors in theory and determine their influence. As and usability of user interface. Use cases were also identified
IAR includes new hardware and can change work processes, the across these factors.
user side needs to be analysed in more detail. Due to advance- • Analysis of mental, physical and temporal demands, perfor-
ments in immersive and collaborative artificial-reality for design mance, effort and frustration amongst operators and non-
and operation of human-robot workspaces (Malik et al. In press), operators for AR adoption.
there may be a potential to research how IAR can be positioned • Perceived workload amongst operators is lower as compared to
with respect to that. non-operators for AR adoption.

6. Conclusion While this research has shown that the technological context is
the basis for a successful IAR implementation, the organisational
The IAR is one of the major pillars of the industrial digitalisa- side of the implementation is relevant for the industry as well. The
tion drives. It connects workers with the digital environment. The user acceptance and the organisational fit (OF) are crucial success
T. Masood and J. Egger / Computers in Industry 115 (2020) 103112 13

factors. As IAR might use new hardware and unfamiliar modes of Flatt, Holger, Koch, Nils, Rocker, Carsten, et al., 2015. A context-aware assistance
interfacing with the technology, including the user in the imple- system for maintenance applications in smart factories based on augmented
reality and indoor localization. In 2015 IEEE 20th Conference on Emerging Tech-
mentation process is critical. nologies & Factory Automation (ETFA): 8 - 11 Sept. 2015, City of Luxembourg,
User acceptance is not only a success factor, but a lack of it Luxembourg, 1-4. Piscataway, NJ. IEEE.
is a serious challenge to overcome. Despite the latent variable Funk, Markus, Bächler, Andreas, Bächler, Liane, et al., 2017. Working with Aug-
mented Reality? A Long-Term Analysis of In-Situ Instructions at the Assembly
UB not correlating significantly with the IS of IAR, the qualitative Workplace. In: In Proceedings of the 10th International Conference on Perva-
and experimental findings show the importance of users conclu- sive Technologies Related to Assistive Environments, New York, NY. ACM, pp.
sively. Educating users and showing use cases relevant to them can 222–229.
Funk, Markus, Kosch, Thomas, Schmidt, Albrecht, 2016. Interactive worker assis-
alleviate this challenge. Additionally, the lack of the fragmented
tance. In: In Proceedings of the 2016 ACM International Joint Conference on
ecosystem leads to upscaling issues, as no easy way of content Pervasive and Ubiquitous Computing. Edited by Paul Lukowicz et al., New York,
creation exists. It is the author’s opinion that this challenge will NY. ACM, pp. 934–939.
Gavish, Nirit, Gutiérrez, Teresa, Webel, Sabine, et al., 2013. Evaluating virtual reality
diminish over time, as a dominant and easy way to create content
and augmented reality training for industrial maintenance and assembly tasks.
will arise eventually. Interact. Learn. Environ. 23 (6), 778–798.
While IAR is not ready yet for industrial deployment in some Guo, Anhong, Starner, Thad, Raghu, Shashank, et al., 2014. A comparison of order
areas, it is already used in others. Companies are testing and picking assisted by head-up display (HUD), cart-mounted display (CMD), light,
and paper pick list. In: In Proceedings of the 2014 ACM International Symposium
implementing IAR solutions for different applications. While tech- on Wearable Computers. Edited by Lucy Dunne, Tom Martin and Michael Beigl,
nological challenges are not a central concern for industry, the New York, NY. ACM, pp. 71–78.
software ecosystem and the organisational integration are. How- Hahn, J.ürgen, Ludwig, Bernd, Wolff, Christian, 2015. Augmented reality-based train-
ing of the PCB assembly process. In: In Proceedings of the 14th International
ever, the potential benefits of IAR shown through a broad variety Conference on Mobile and Ubiquitous Multimedia. Edited by Clemens Holzmann
of experiments incentivise to overcome those challenges. and René Mayrhofer, New York, NY. ACM, pp. 395–399.
Hanson, Robin, Falkenström, William, Miettinen, Mikael, 2017. Augmented reality
as a means of conveying picking information in kit preparation for mixed-model
Declaration of Competing Interest assembly. Comput. Ind. Eng. 113, 570–575.
Hart, Sandra G., 2016. Nasa-task load index (NASA-TLX); 20 years later. Hum. Factors
Ergon. Soc. Annu. Meet. Proc. 50 (9), 904–908.
There is no conflict of interest to declare. Havard, V., Baudry, D., Louis, A., et al., 2015. Augmented reality maintenance demon-
strator and associated modelling. In: In 2015 IEEE Virtual Reality (VR): 23 - 27
March 2015, Arles, France; [Including Papers from the] Workshop on Perceptual
Acknowledgements and Cognitive Issues in AR (PERCAR). Edited by Tobias Höllerer, Piscataway, NJ.
IEEE, pp. 329–330.
The authors are most grateful to the industry colleagues (from Henderson, Steven J., Feiner, Steven K., 2011. Augmented reality in the psychomotor
phase of a procedural task. In: In 10th IEEE International Symposium on Mixed
Beckhoff Automation, Herman Miller and fluiconnecto) and Uni- and Augmented Reality (ISMAR), 2011: 26 - 29 Oct. 2011, Basel, Switzerland,
versity of Cambridge students for their in-kind support (in terms Piscataway, NJ. IEEE, pp. 191–200.
of their time and providing access to the premises) for conducting Holm, Magnus, Danielsson, Oscar, Syberfeldt, Anna, et al., 2017. Adaptive instruc-
tions to novice shop-floor operators using Augmented Reality. J. Ind. Prod. Eng.
the 22 experiments in total. The authors are also thankful to the 34 (5), 362–374.
reviewers and colleagues for their constructive comments. Hou, Lei, Wang, Xiangyu, 2013. A study on the benefits of augmented reality in
retaining working memory in assembly tasks: a focus on differences in gender.
Autom. Constr. 32, 38–45.
References Hou, Lei, Wang, Xiangyu, Bernold, Leonhard, et al., 2013. Using animated aug-
mented reality to cognitively guide assembly. J. Comput. Civ. Eng. 27 (5), 439–
Antonelli, Dario, Astanin, Sergey, 2015. Enhancing the quality of manual spot weld- 451.
ing through augmented reality assisted guidance. Procedia CIRP 33, 556–561. Kagermann, Hanning, Wahlster, Wolfgang, Helbig, Johannes, 2013. “Umset-
Arnold, Christian, Veile, Johannes, Voigt, Kai-Ingo, 2018. What drives industry 4.0 zungsempfehlungen für das Zukuntsprojekt Industrie 4.0: Abschlussbericht
adoption? An examination of technological, organizational, and environmental des Arbeitskreises Industrie 4.0. BMBF. https://www.bmbf.de/files/
determinants. In: In IAMOT Conference, Birmingham, pp. 1–19. Umsetzungsempfehlungen Industrie4 0.pdf.
Azuma, Ronald T., 1997. A survey of augmented reality. Presence Teleoperators Kretschmer, V., Plewan, T., Rinkenauer, G., et al., 2018. Smart palletisation: cognitive
Virtual Environ. 6 (4), 355–385. ergonomics in augmented reality based palletising. 1st International Conference
BIS Research, 2018. Global augmented reality and mixed reality market: analysis on Intelligent Human Systems Integration: Integrating People and Intelligent
forecast. 2018–2025. Systems Vol. 722, 355–360.
Blanco-Novoa, Oscar, Fernandez-Carames, Tiago M., Fraga-Lamas, Paula, et al., 2018. Longo, Francesco, Nicoletti, Letizia, Padovano, Antonio, 2017. Smart operators in
A practical evaluation of commercial industrial augmented reality systems in an industry 4.0: a human-centered approach to enhance operators’ capabilities
industry 4.0 shipyard. IEEE Access 6, 8201. and competencies within the new smart factory context. Comput. Ind. Eng. 113,
Blattgerste, Jonas, Strenge, Benjamin, Renner, Patrick, et al., 2017. Comparing con- 144–159.
ventional and augmented reality instructions for manual assembly tasks. In: Makris, Sotiris, Karagiannis, Panagiotis, Koukas, Spyridon, et al., 2016. Augmented
In Proceedings of the 10th International Conference on Pervasive Technologies reality system for operator support in human–robot collaborative assembly.
Related to Assistive Environments, New York, NY. ACM, pp. 75–82. CIRP Ann. Manuf. Technol. 65 (1), 61–64.
Bosch, Tim, Könemann, Reinier, de Cock, Hans, et al., 2017. The effects of projected Malik Ali Ahmad, Masood Tariq and Bilberg Arne, Virtual reality in manufactur-
versus display instructions on productivity, quality and workload in a simulated ing: immersive and collaborative artificial-reality in design of human-robot
assembly task. In: In Proceedings of the 10th International Conference on Per- workspace, Int. J. Comput. Int. Manuf., In press, Accepted for publication on 4
vasive Technologies Related to Assistive Environments, New York, NY. ACM, pp. November 2019, https://doi.org/10.1080/0951192X.2019.1690685.
412–415. Martinetti, Alberto, Rajabalinejad, Mohammad, Dongen, Leovan, 2017. Shap-
Brown, Simon, Updated August 1, Accessed 5 August 2018. 2018. The C4 Model for ing the future maintenance operations: reflections on the adoptions of
Software Architecture. http://c4model.com/. augmented reality through problems and opportunities. Procedia CIRP 59,
Davies, Ron, 2015. Industry 4.0: Digitalization for Productivity and Growth. Euro- 14–17.
pean Parliamentary Research Service. Masoni, Riccardo, Ferrise, Francesco, Bordegoni, Monica, et al., 2017. Supporting
DePietro, Rocoo, Wiarda, Edith, Fleischer, Mitchell, 1990. The context for change: Remote Maintenance in Industry 4.0 through Augmented Reality. Procedia
organization, technology and environment. The processes of technological inno- Manuf. 11, 1296–1302.
vation. In: Tornatzky, Louis G., Fleischer, Mitchell (Eds.), Issues in Organization Masood, Tariq, Egger, Johannes, 2019. Augmented reality in support of Industry 4.0
and Management Series. Lexington Mass. Lexington Books, pp. 151–175. – implementation challenges and success factors. Rob. Comput. Integr. Manuf.
Egger, Johannes, Masood, Tariq, 2018. Augmented Reality in Support of Intelligent 58, 181–195.
Manufacturing -A Systematic Literature Review. University of Cambridge, Cam- Masood, Tariq, Egger, Johannes, Kern, Maximilian, 2018. Future-proofing the
bridge, UK, 28/06/. through-life engineering service systems. Procedia Manuf. 16, 179–186.
Egger Johannes and Masood Tariq, Augmented reality in support of intelligent man- Mourtzis, D., Zogopoulos, V., Vlachou, E., 2017a. Augmented reality application to
ufacturing – A systematic literature review, Comput. Ind. Eng. In press, Accepted support remote maintenance as a service in the robotics industry. Procedia CIRP
for publication on 18 November 2019. 63, 46–51.
Espíndola, Danúbia Bueno, Fumagalli, Luca, Garetti, Marco, et al., 2013. A model- Mourtzis, Dimitris, Vlachou, Aikaterini, Zogopoulos, Vasilios, 2017b. Cloud-based
based approach for data integration to improve maintenance management by augmented reality remote maintenance through shop-floor monitoring: a
mixed reality. Comput. Ind. 64 (4), 376–391. product-service system approach. J. Manuf. Sci. Eng. 139 (6), 1–11.
14 T. Masood and J. Egger / Computers in Industry 115 (2020) 103112

Murauer, Nela, Pflanz, Nerina, Hassel, Ceciliavon, 2018. Comparison of Scan- Segovia, Daniel, Mendoza, Miguel, Mendoza, Eloy, et al., 2015. Augmented reality as
Mechanisms in Augmented Reality-Supported Order Picking Processes. CEUR a tool for production and quality monitoring. Procedia Comput. Sci. 75, 291–300.
Workshop Proc. 2082, 69–76. Serván, J., Mas, F., Menéndez, J.L., et al., 2012. Assembly work instruction deployment
Palmarini, Riccardo, Erkoyuncu, John Ahmet, Roy, Rajkumar, 2017. An innovative using augmented reality. Key Eng. Mater. 502, 25–30.
process to select augmented reality (AR) technology for maintenance. Procedia Stoltz, M.-H., Giannikas, V., McFarlane, D., et al., 2017. Augmented reality in
Cirp 59, 23–28. warehouse operations: opportunities and barriers. IFAC-Papers OnLine 50 (1),
Pereira, A.C., Romero, F., 2017. A review of the meanings and the implications of the 12979–12984.
Industry 4.0 concept. Procedia Manuf. 13, 1206–1214. Syberfeldt, Anna, Danielsson, Oscar, Gustavsson, Patrik, 2017. Augmented reality
Porcelli, Isabella, Rapaccini, Mario, Espíndola, Danúbia B., et al., 2013. Technical and smart glasses in the smart factory: product evaluation guidelines and review of
Organizational Issues about the Introduction of Augmented Reality in Mainte- available products. IEEE Access 5, 9118–9130.
nance and Technical Assistance Services. IFAC Proc. 46 (7), 257–262. Syberfeldt, Anna, Holm, Magnus, Danielsson, Oscar, et al., 2016. Support systems on
Rashid, Asif, Masood, Tariq, Erkoyuncu, John A., et al., 2017. Enterprise systems’ the industrial shop-floors of the future – operators’ perspective on augmented
life cycle in pursuit of resilient smart factory for emerging aircraft industry: a reality. Procedia CIRP 44, 108–113.
synthesis of Critical Success Factors’(CSFs), theory, knowledge gaps, and impli- Tong, Yanfeng, Wang, Yongtian, Chen, Jing, et al., 2016. A small scene assistant main-
cations. Enterp. Inf. Syst. 39, 1–41. tenance system based on optical see-through augmented reality. In the 15th
Reif, Rupert, Guenther, Willibald A., Schwerdtfeger, Bjoern, et al., 2009. Pick-by- ACM SIGGRAPH Conference. Edited by Yiyu Cai and Daniel Thalmann, 155–158.
vision comes of Age: evaluation of an augmented reality supported picking Trappey, Amy J.C., Trappey, Charles V., Govindarajan, Usharani Hareesh, et al., 2017.
system in real storage environment. In: In Proceedings of the 6th International A review of essential standards and patent landscapes for the Internet of Things:
Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction. a key enabler for Industry 4.0. Adv. Eng. Inform. 33, 208–229.
Edited by Alexandre Hardy et al., New York, NY. ACM, pp. 23–32. Uva, Antonio E., Gattullo, Michele, Manghisi, Vito M., et al., 2018. Evaluating the
Renner, Patrick, Pfeiffer, Thies, 2017. Augmented reality assistance in the Central effectiveness of spatial augmented reality in smart manufacturing: A solution
Field-of-View outperforms peripheral displays for order picking: results from a for manual working stations. Int. J. Adv. Manuf. Technol. 94 (1-4), 509–521.
virtual reality simulation study. In 2017 IEEE International Symposium on Mixed Wang, X., Ong, S.K., Nee, A.Y.C., 2016a. A comprehensive survey of augmented reality
and Augmented Reality (ISMAR-Adjunct), 176–181. assembly research. Adv. Manuf. 4 (1), 1–22.
Rodriguez, Leonardo, Quint, Fabian, Gorecky, Dominic, et al., 2015. Developing Wang, X., Ong, S.K., Nee, A.Y.C., 2016b. Multi-modal augmented-reality assembly
a Mixed Reality Assistance System Based on Projection Mapping Technology guidance based on bare-hand interface. Adv. Eng. Inform. 30 (3), 406–421.
for Manual Operations at Assembly Workstations. Procedia Comput. Sci. 75, Werrlich, Stefan, Nitsche, Kai, Notni, Gunther, 2017. Demand analysis for an
327–333. augmented reality based assembly training. In: In Proceedings of the 10th
Sanna, A., Manuri, F., Lamberti, F., et al., 2015. Using handheld devices to sup port International Conference on Pervasive Technologies Related to Assistive Envi-
augmented reality-based maintenance and assembly tasks. In IEEE International ronments, New York, NY. ACM, pp. 416–422.
Conference on Consumer Electronics (ICCE), 2015: 9 - 12 Jan. 2015, Las Vegas, Zhu, J., Ong, S.K., Nee, A.Y.C., 2012. An authorable context-aware augmented reality
NV, USA, 178-179. Piscataway, NJ. IEEE. system to assist the maintenance technicians. Int. J. Adv. Manuf. Technol. 45,
Saxen, Frerk, Köpsel, Anne, Adler, Simon, et al., 2017. Investigation of an aug- 1699–1714.
mented reality-based machine operator assistance-system. In: Biundo, Susanne, Zhu, Yan, Li, Yan, Wang, Weiquan, et al., 2010. What leads to post-implementation
Wendemuth, Andreas (Eds.), Companion Technology: A Paradigm Shift in success of ERP? An empirical study of the Chinese retail industry. Int. J. Inf.
Human-Technology Interaction. Springer, Cham, Switzerland, pp. 471–483, Cog- Manage. 30 (3), 265–276.
nitive technologies. Zubizarreta, Jon, Aguinaga, Iker, Amundarain, Aiert, 2019. A framework for aug-
Schlagowski, R., Merkel, L., Meitinger, C., 2017. Design of an assistant system for mented reality guidance in industry. Int. J. Adv. Manuf. Technol. 102 (9–12),
industrial maintenance tasks and implementation of a prototype using aug- 4095–4108.
mented reality. In 2017 IEEE International Conference on Industrial Engineering
& Engineering Management: IEEE IEEM2017 10-13 Dec, Singapore, 294-298.
Piscataway, NJ. IEEE.

You might also like