You are on page 1of 15

Computers in Industry 118 (2020) 103221

Contents lists available at ScienceDirect

Computers in Industry
journal homepage: www.elsevier.com/locate/compind

Unveiling the technological trends of augmented reality:


A patent analysis
Alessandro Evangelista a,∗ , Lorenzo Ardito a,b , Antonio Boccaccio a , Michele Fiorentino a ,
Antonio Messeni Petruzzelli a , Antonio E. Uva a
a
Department of Mechanics Mathematics and Management, Polytechnic University of Bari, Via Edoardo Orabona, 4, 70126, Bari, Italy
b
Mount Royal University, Institute for Innovation and Entrepreneurship, 4825 Mt Royal Cir SW, Calgary, AB T3E 6K6, Calgary, Canada

a r t i c l e i n f o a b s t r a c t

Article history: This paper investigates the Augmented Reality (AR) technology with a novel approach based on patent
Received 29 November 2019 research. We searched the USPTO for AR-related granted patents in the period 1993–2018, we selected
Received in revised form 24 February 2020 and manually browse a total of 2,373, we classified them in five key technological classes i.e., display
Accepted 28 February 2020
device, tracking, user interaction, application, and system, and we finally analyzed the results. The main
Available online 17 March 2020
contribution of this paper is the investigation of the technological trends, with outcomes that can be
useful for researchers and developers for technical steering, but also for policymakers, managers and
Keywords:
entrepreneurs for technology scouting and forecasting. Our study found that AR technological develop-
Augmented reality
Patent analysis
ment has especially increased in the last decade. In particular, we evidenced a remarkable steady of 82 %
Technological trend annual growth rate of the number of granted patents after 2012. From geographical distribution, we found
Technological innovation that North America is the leader (68 %); Asia (18 %) and Europe (13 %) are lagging behind despite dedicated
Technology scouting Industry 4.0 policies actuated by the governments. Another nontrivial result is the incoherency between
Technology forecasting the owners of a high quantity of patents and those highly impacting. In fact, only Microsoft Corporation
Geographical distribution and Amazon Technologies are at the same time in the top 10 of the most patent-intensive organizations
Industry 4.0 and the top 10 of highly impacting organizations. Moreover, the majority of the patents are owned by
Display device
companies, albeit some of the highly impacting ones come from universities or research centers. These
Tracking
findings provide theoretical, managerial, and policy implications for future research activities in the AR
User interaction
Application domain.
AR systems © 2020 Elsevier B.V. All rights reserved.
Interactive technologies
Human-machine interaction
Visual overlay
Holograms
Immersive technologies
Presence
Review

Contents

1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
2. Theoretical background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
2.1. Conceptualizing AR classification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
2.2. Patents as a mean to trace technological trends . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
3. Methods and data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
3.1. Patent analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
4. Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

∗ Corresponding author.
E-mail addresses: alessandro.evangelista@poliba.it (A. Evangelista), lorenzo.ardito@poliba.it (L. Ardito), antonio.boccaccio@poliba.it (A. Boccaccio),
michele.fiorentino@poliba.it (M. Fiorentino), antonio.messenipetruzzelli@poliba.it (A. Messeni Petruzzelli), antonio.uva@poliba.it (A.E. Uva).

https://doi.org/10.1016/j.compind.2020.103221
0166-3615/© 2020 Elsevier B.V. All rights reserved.
2 A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221

4.1. Temporal trends . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5


4.2. Geographical trends . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
4.3. Classes distribution analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
4.4. Organization distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
5. Discussion, conclusion and future research directions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Acknowledgements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Appendix A . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

1. Introduction rate of the AR technological development and most involved orga-


nizations is available.
Augmented Reality (AR) integrates digital information in the So far, insights on the technological evolution of AR are mainly
form of virtual objects (e.g., text, video, 3D model, audio, haptic and gathered in survey papers. Among them, some are focused on spe-
so on) with a real environment. AR also allows immediate access cific technical aspects and related shortcomings (He et al., 2019; Ko
to information that is not naturally present in a real environment et al., 2013; Adhani and Awang, 2012; Azuma, 2001; Mallem, 2010;
and permits to blend computer interface with the environment. Papagiannakis et al., 2008), while others are focused on research
The logic behind AR is to include computing experience in the evolution and future trends (Zhou et al., 2008; Kim et al., 2018;
real world, thus making possible paradigm shifts from a traditional Mekni and Lemieux, 2014), thus limiting the comprehensiveness
desktop interface towards a world-centered interface. Therefore, of the analysis of the AR domain and the provisions of managerial
AR aims to make the world our user interface (Schmalstieg and and policy implications. Moreover, despite the important attempt
Reitmayr, 2007). to fully trace the AR domain, some of the most noteworthy papers
In recent years, the technical progress of the entire ICT area has reduced the search scope to articles published in past conferences
further fueled the research and development (R&D) of AR systems (Zhou et al., 2008; Kim et al., 2018) or provided an overview of
and devices. The performance improvement of mobile devices, in the solutions already in use (Mekni and Lemieux, 2014). Hence,
combination with the commercialization of stand-alone hardware these studies leave out some data useful to uncover all the tech-
devices specific for AR (Chen et al., 2015), has contributed to making nologies developed, including those that are yet to be adopted.
the AR accessible and exploitable in many fields, thus generating On the other hand, to overcome these issues, recent works ana-
new business opportunities. lyze patent dynamics in AR (Choi et al., 2018; Jeong and Yoon,
Nowadays, the main demand for AR solutions comes from pro- 2017), hence proposing a novel approach to study technological
fessionals and enterprises. For example, according to the European trends based upon patented technologies, being these more repre-
Union, AR is one of the nine Key Enabling Technologies that will sentatives of solutions developed in a given domain (Ardito et al.,
support the Industry 4.0 program (Paelke, 2014). Indeed, AR is 2018). In the present research, we rely upon these studies, offering
expected to open a wide range of new opportunities in the man- however a more reliable and comprehensive investigation. Indeed,
ufacturing sector. However, in the near future, also consumer we manually processed each patent instead of using a computer-
demand is likely to grow. Accordingly, while the global AR mar- based classification approach. We believe that given the multi-topic
ket was valued at USD 11.14 billion in 2018, it is expected to nature of the AR patents, it becomes necessary to dig into each
reach USD 60.55 billion by 2023, with an annual growth rate of patent in order to understand the type of patented technology.
40.29 % during this 5-year forecast (Marketsandmarkets, 2019). Moreover, we update and complement prior analysis by includ-
The key success factor for the growth of AR in the consumer mar- ing aspects not previously addressed, such as geographical trends
ket is related to the increased use of smartphones, tablets, and and assessment of highly impacting organizations, which may pro-
other devices for the implementation of AR (Arth and Schmalstieg, vide additional valuable information to comprehend where the AR
2011). In particular, Head-Mounted Displays (HMDs) are the most domain is and where it may go. In line with this reasoning, this study
promising solutions deemed to boost the growth of the AR mar- aims to understand the technological trends of AR, their temporal
ket (Kiyokawa, 2012). In fact, major companies such as Microsoft trends, the main technological areas, the geographic location of the
Corporation, Magic Leap Inc., and DAQRI LLC have developed their technological developments, and key organizations involved in the
own HMDs (Microsoft HoloLens, 2019; Magic Leap, 2019; Daqri AR domain, with an emphasis on those developing highly impact-
Smart Glasses, 2019; Epson Moverio, 2019), proving to believe in ing AR solutions. To do so, we studied and analyzed a sample of
their market potential. Given the dimension and potential rapid 2,373 granted patents filed at the USPTO in the period 1993–2018.
expansion of the AR market, the R&D efforts in improving existing The paper proceeds as follows. Section 2 presents the theoretical
AR solutions and developing new ones are rising, especially con- background. Section 3 describes the methodology. Section 4 shows
sidering that AR technologies are far from fulfilling their ultimate the results of the patent analysis. Section 5 proposes the discussion,
potential. limitations, and future research directions.
AR is almost fifty years old in industrial research and scien-
tific literature. Still, the development of AR technologies is growing
at a very fast pace and is scattered among different businesses,
academia, and sciences. Therefore, the study of the AR domain is not
an easy task. Moreover, AR integrates different systems/solutions, 2. Theoretical background
needs specific applications for each industry, and is developed by
different organizations worldwide, further hindering the possibil- With the advancements in computing performance of the 80’s
ity to keep pace with the evolution of AR. Eventually, it is difficult to and 90’s, the AR begins to become an independent research field.
unveil how the technological trends of AR have evolved over time, The logic behind AR is to fill the gap between the virtual and real-
with negative consequences for planning the directions for subse- world, both spatially and cognitively. Following this idea, digital
quent R&D activities. Notably, planning R&D becomes less risky and information must be perceived by the user as an integral part of
more straightforward if information about, for instance, the growth the real world.
A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221 3

2.1. Conceptualizing AR classification in the enterprise is taking off also pushed by the Industry 4.0
emerging paradigm, where it is exploited for training personnel,
In his 1997 survey paper, Azuma (1997) proposed the definition maintenance of machines, design, engineering simulations and
of AR, which is still the most accepted by the scientific community safety (Fernández del Amo et al., 2018; Tatić and Tešić, 2017; Wang
nowadays. Based on this definition, AR must have the following et al., 2014; Fiorentino et al., 2014). In healthcare and medical
three characteristics: (i) combines real and virtual, (ii) Interactive fields, AR can be exploited, for instance, in case of surgery, for visu-
in real-time and (iii) registered in 3D. alizing medical data (conventional x-ray, computed tomography,
To combine virtual and real stimuli, Azuma’s definition of AR and so on) directly superimposed on the patient (Sielhorst et al.,
requires specific output devices, i.e. display device. Moreover, the 2008), thus allowing the surgeon to conduct a minimally inva-
definition also requires spatial registration and interactivity, this sive surgery (Botden and Jakimowicz, 2009). Moreover, AR lends
means that virtual elements must be real-time precisely aligned itself well for training doctors and medical students (Barsom et al.,
with the real environment; the tracking system takes care of this 2016). Nevertheless, the AR market will be driven by consumer
aspect, dynamically determining the spatial properties of the vir- applications such as gaming, sports, and entertainment (Pucihar
tual entities in a real environment. Finally, the Interactivity aspect and Coulton, 2014). Among them, the greatest commercially suc-
also implies that an AR system needs a user interaction module cessful AR game experience is Pokémon GO, with over 100 million
capable of operating in conjunction with the tracking system. downloads (Paavilainen et al., 2017), which uses AR for attracting
Based on the analysis of Azuma’s definition, three main techno- potential consumers into malls and shops by leveraging gamifica-
logical classes can be identified: tion dynamics.
The display class includes visual displays and nonvisual dis- As regards the aforementioned classes, they can be also recog-
plays. The essential requirement discriminating AR displays from nized in classifications made by previous studies. The survey by
ordinary computer displays consists in the necessity to merge real- Zhou et al. (2008), in pointing out the technology areas needed
ity and virtuality. This can be achieved both by using an optical to deliver an AR application, identifies five primary topics: Dis-
see-through or a video see-through display (Rolland et al., 1995). play Techniques, Interaction Techniques, Tracking Techniques,
Another visual display solution consists of projecting a virtual Calibration and Registration, and AR Applications. According to
object onto the physical object; this display technology is known Schmalstieg and Hollerer (2016), tracking, calibration, and reg-
as the Spatial AR (Uva et al., 2016). Out of the visual domain, nonvi- istration techniques overlap in practical use, hence reducing the
sual displays are used for involving the remaining 4 human senses actual number of areas to four. These four areas are recalled by our
in AR experiences. Indeed, audio (Lindeman et al., 2007), haptic classification, where the class named tacking includes tracking, cal-
(Bau and Poupyrev, 2012), olfactory and gustatory (Narumi et al., ibration, and registration techniques as suggested by Schmalstieg
2011) displays complete the class of AR displays. and Hollerer.
The tracking class includes systems that perform the virtual Finally, the system class includes integrated AR solutions (Van
object registration in a real environment; besides, in order to pro- Krevelen, 2010) that are innovative because exploit existing AR
vide a compelling AR experience, virtual elements must be precisely technologies in a novel way but are not specifically designed to
aligned with the real environment in real-time. Therefore, AR track- be adopted in various industry domains. In other words, they
ing system is one of the main critical aspects of AR and is used to are more pervasive in nature. Basically, we added the remaining
dynamically determine the spatial properties (6DOF) of the virtual class—system—in order to classify patents that describe the imple-
entities in a real environment. Specifically, it combines hardware mentation of display, tracking, and user interaction technologies in
technology with a variety of sensors such as mechanical, electro- a single system (Van Krevelen, 2010), and that, as such, cannot be
magnetic, ultrasonic, optical tracking and software algorithms for included in any of the other classes.
tracking the real environment (Rabbi and Ullah, 2013; Afif et al., The final classification, including the five classes, is reported in
2013; Wagner et al., 2008; You and Neumann, 2001). Moreover, Fig. 1.
calibration and registration techniques are part of this class.
The user interaction (U.I) class includes a specific branch of
HCI research, uses alternative means to traditional 2D user inter- 2.2. Patents as a mean to trace technological trends
faces such as a mouse, keyboard, and touch screen input. The AR
uses instead non-desktop User Interfaces such as 3D input, speech, A patent is recognized as an intellectual property (IP) right that
gestures, gaze and so on (Liarokapis, 2007; Piumsomboon et al., allows an organization to solely use and exploit its invention. In
2013; Poupyrev et al., 2002; Buchmann et al., 2004). In particular, turn, patenting prevents others from commercially using the inven-
interaction methods as information browsers, 3D user interface, tion, establishes the inventing organization as a preeminent player
tangible user Interface, natural user interface and multimodal inter- in the market (Cockburn and MacGarvie, 2009; Teece, 2008), and
face (Billinghurst et al., 2014) are part of this class. makes business partners, investors, and shareholders perceive the
Furthermore, two additional classes can be considered to inventing organization as technologically advanced and worth of
account for those solutions —the integrated AR systems (Livingston financing (e.g., Mann and Sager, 2007).
et al., 2002; Höllerer et al., 1999)— that include the three main These very well-known aspects of patenting mainly relate to the
(stand-alone) technological classes. Indeed, an AR system may be managerial practices and have largely been studied by the IP litera-
specific for an application field or pervasive in nature, i.e., with no ture (Fisher and Oberholzer-Gee, 2013; Henkel et al., 2013). Instead,
application in any specific field. In detail, the two classes can be rooted in the characteristic of patented inventions to be novel, non-
defined as follows: obvious, and useful (e.g., Thai Patent Act 1979; 35 U.S.C. 100–105),
The application class includes existing solutions and technolo- the technology management literature has looked at patents with a
gies that innovate in a specific domain of application. Nowadays, different perspective. That is, regardless of their actual effectiveness
the increased interest of major technology companies with rising as an IP tool, since patents reflect inventions that must possess the
investments in AR technology is one of the major factors driving aforementioned characteristics, they have been deemed to assess
this market. Basically, the AR is exploitable in industrial (Palmarini R&D efforts. Specifically, a wealth of research has sought to validate
et al., 2018), military (Livingston et al., 2011), healthcare (Zhu et al., patents as a proxy for tracing developed technologies and, nowa-
2014), entertainment (Thomas et al., 2002), retail (Dacko, 2017), days, patents represent the most common proxy for R&D outputs
and e-commerce applications (Yim et al., 2017). For instance, AR (Abraham and Moitra, 2001; Acs et al., 2002; Archibugi and Pianta,
4 A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221

Fig. 1. Classification of AR.

1996; OECD, 2009; Pavitt, 1985; Roper and Hewitt-Dundas, 2015; Table 1
Exclusion criteria.
Trajtenberg, 1990).
Specifically, given the variety of information of patent docu- Exclusion criteria Examples of excluded patents
ments – e.g., filing and granting dates, name(s) and residence of The patent title and abstract Frank et al., 2018; Shubham et al.,
inventor(s), name(s) of assignee(s) and location of headquarter(s), describe a technology not related 2016; Seung-hwan et al. (2016)
technological classifications, and citations – multiple aspects of to AR and, in the claims, the term
technological trends (e.g., temporal trends, geographical distribu- “augmented reality” is present
but used in a generic way and
tion, and patent quality) can be assessed. In line with this reasoning,
not well addressed.
a number of studies have agreed with the suitability of patents for The patent title, abstract and Rovira and Luis (2004); Kenneth
analyzing technological trends in a comprehensive manner (e.g., claims describe a technology and John, 2019; Nadler and Ingo
Albino et al., 2014; Huang et al., 2011; Leydesdorff et al., 2015; Li using the term “augmented (2016)
reality” but was virtual reality.
et al., 2007), including the fields related to computers in indus-
try. For instance, studies on the convergence of ICT technological
standards (Han and Sohn, 2016) and cross-country comparisons
for studying the antecedents of ICT solutions (Lee et al., 2016) have addressed the effectiveness evaluation of keyword search strategy
relied on patent information. Moreover, patents have been used for patent identification, revealing that “the most effective method
to provide a comprehensive picture of the technology lifecycle of of identifying patents in a specific domain through keyword search
telematics (Chang and Fan, 2016), derive policy and managerial is using the patent information in the title, abstract and claims”,
implications for future R&D activities in the IoT domain by map- as this is where an invention’s essential content is described” (see
ping related patenting activity trends (Ardito et al., 2018; Han and also Moehrle and Caferoglu, 2019). The USPTO was chosen as patent
Sohn, 2016), and inform about technologies enabling supply chain source of patent data because it “represents the largest body where
management-marketing integration in light of the Industry 4.0 rev- patents are filed from all over the world” (Tong and Frame, 1994).
olution (Lee et al., 2016). Moreover, it “is supposed to have one of the lowest home biases as
more than 50 % of the patents that are issued in the U.S. goes toward
non-U.S. entities” (Huang et al., 2015; Kim et al., 2020). This lets us
3. Methods and data consider the USPTO without the necessity to scrutinize all other
patent offices, still allowing us to provide a more comprehensive
To analyze the technological trends of AR, we collected granted picture of the AR technological development. The search process
patents related to the AR domain. That is, we excluded patent appli- ended on April 30, 2019. Initially, the search process yielded a sam-
cations whose review process is still ongoing since the respective ple of 2,587 patents. To avoid false-positive results, each patent
invention cannot be still considered an actual patent even though was read by three AR experts, together with the authors, and based
information about the potential future patent is available. To collect on the exclusion criteria reported in Table 1, noise patents were
patents, firstly, the search string “augmented reality” was defined. eliminated from the starting sample. The final sample is composed
Then, we queried the USPTO for granted patents that contain this of 2,373 granted patents filed between 1993 and 2018. According
search string in the title, abstract, or claims - the resulting query to the classification explained in Section 2, selected patents were
string, hence, was: [TTL/“augmented reality” OR ABST/“augmented distinguished among our 5 classes.
reality” OR ACLM/“augmented reality”], where TTL refers to the
field title, ABST refers to the field abstract, and ACLM refers to 3.1. Patent analysis
the field claim(s). Indeed, if the search string appears in the title
or abstract, it is more likely that the patent actually pertains to This section explains more in detail the analysis that we will pro-
the domain described by the search string. Likewise, we also con- pose in the next section, and how patent information has been used
sidered the claims since a claim mentioning “augmented reality” to deliver our analysis. First, we will present temporal trends of R&D
would suggest that the patent protects a feature/application related efforts in general and for each specific AR class. Patent count per
to AR (Novelli, 2015; Tong and Frame, 1994). Other fields, such as year is used as the measure for the R&D outputs undertaken over
the description, have been excluded since they are more generic time. Second, the geographic origins of the developed patents will
and/or used for discussing macro-trends that do not specifically be presented. Each patent was assigned to a country based on the
pertain to the searched string, thus leading to non-relevant results. country where the first inventor resides. Indeed, the first inventor is
This approach is consistent with many previous studies adopt- considered as the main inventor, and the inventing activity usually
ing patent analysis for examining technological trends (e.g., Huang takes place where s/he resides (Albino et al., 2014). Third, analy-
et al., 2015; Kim et al., 2020; Kronemeyer et al., 2020), and its reli- sis at the organizational level was conducted. Accordingly, we will
ability was formally confirmed by Xie and Miyazaki (2013), who highlight the organizations more involved in the development of AR
A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221 5

Fig. 2. Temporal trends per filing and granting year show a sharp increment in AR patent activity from 2008 onwards.

patents. In this case, inventing organizations are assessed in terms ber of patents was minimum 35 % and maximum 227 %–82 % on
of both patent count and impact on subsequent patents. Following average - in the time period 2012–2018 (granting years). The lim-
previous studies, the impact of inventing organizations is measured ited number of patents granted in 2019 is due to the fact that our
by means of forwarding citations, i.e., the citations received by search process ended at the end of April 2019.
an organizations’ patents from patents developed afterward (e.g., These trends can be widely explained by the fast development of
Trajtenberg, 1990; Harhoff et al., 1999). mobile technology in the last decade. In fact, 2008 has originated
a wave of new AR-satisfying device, for instance, the first multi-
4. Results touch screen mobile phone also known as Apple iPhone or also the
Android-based G1, the HTC’s Touch HD, the Nokia N97 and so on.
In this section, we begin to look at the AR patent landscape and Furthermore, in 2007, the first AR tracking SDKs for mobile devices
perform an analysis of temporal trends, geographical trends, class were released by ARToolKit (Wagner and Schmalstieg, 2007). In
distribution, and inventing organizations. the following year, these tracking libraries were released for the
main mobile operative systems (OS) such as iOS in 2008 and two
4.1. Temporal trends years later, in 2010, it was made available an Android version. From
this point on, a large series of mobile devices have been presented,
Fig. 2 shows the patenting activity trend of the 2,373 collected and many of them are able to support AR applications. However, we
granted patents respect to both their filing year which better believe that from 2009 onwards the development of AR technology
reflects the actual year of development of inventions and grant- is mainly driven by high expectations and huge investments from
ing year which reflects the year when the property right is actually world-leading companies such as Microsoft, Sony, IBM, Google,
granted. In other words, the two trends depict the temporal distri- Qualcomm, and so on.
bution of the same sample patents. All in all, the patenting activity In Fig. 3, we show the temporal trend from 1992 onwards of the
of AR solutions began in 1993. Looking at the temporal distribu- scientific documents published in Scopus. In the previous graph, we
tion respect to the filing year, the patenting activity trend remained found a significant and growing interest in AR patents since 2008
quite constant until 2007, while it had a sharp growth in the number (considering the filing year), but in the scientific publications, the
of patents from 2008 onwards. This sharp increase in the num- interest towards AR has broken out since 1997. In fact, one of the
ber of patents is reflected with a 3–4 years lag, as revealed by most cited AR paper was published in 1997, that is “A Survey of
the patenting activity trend respect to the granting year. Accord- Augmented Reality” by Azuma (1997). This paper describes the AR
ingly, it manifests a sharp growth from 2011 onwards. This implies technology and the first application attempts in different fields;
that patents require 3–4 years to be granted. Thus, patents filed furthermore, it defines the AR system and their characteristics,
in the last years (i.e., 2016–2018) are likely to be not granted yet, summarizing them in 3 pillars (see Section 2).
meaning that they are not captured by our analysis. This explains Thus, we also believe that the growing patenting activity trend
the apparent declining trend starting from 2015 when looking at from 2008 onwards is mainly driven by strong scientific activity
the patenting activity trend respect to the filing year. That is, the made in the previous years in the AR field, and from which patent-
declining trend is more the result of a long review process than a ing activity has benefited successively. However, scientific research
reduction of R&D efforts in that it is uncommon that patents filed in the AR field has temporal growth, in terms of publications num-
more recently are granted in less than 1–3 years. This can be fur- ber, always positive. The graph also shows the trend of journal
ther proven by looking at the patenting activity trend with respect articles published from 1992 onwards. Noteworthy is the rapid
to the granting year. This trend is, in fact, steadily growing until growth in the number of publications since 2016. This acceleration
2018. Specifically, the annual percentage growth rate of the num- of the growing trend is probably due to the release of Microsoft
6 A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221

Fig. 3. The trends of scientific documents published in the Scopus database show a growing interest in AR from 1997 onwards.

be explained by a large number of milestones placed by the United


States (U.S.) during the previous 50 years in AR development. All the
know-how acquired in these five decades, also thanks to the eco-
nomic policies of the U.S. government in the industrial, academic,
and military research fields, was stored and used to carry out an
intense patenting activity. As a matter of fact, in 1968, one of the
first attempts to create an AR system was made in the University
of Utah by Sutherland (1968) and many years later, in 1992, Tom
Caudell and David Mizell used an HMD see-through for implement
an AR prototype system for U.S. airplane manufacturer: the Boeing
Company (Caudell and Mizell, 1992). In 1997, Feiner et al. (1997)
presented the Touring Machine that is the first mobile AR system
(MARS), made at Columbia University. Two years later in 1999, Kato
and Billinghurst presented ARToolKit (Kato and Billinghurst, 1999),
a pose tracking library with six degrees of freedom based on square
Fig. 4. Geographical distribution of granted patents shows that North America driv-
ing the AR innovation. fiducials marker and a template-based approach for recognition.
These are just a small set of milestones placed by the U.S., a more
exhaustive list can be found in (Arth et al., 2015).
HoloLens (March 2016), the holographic HMD running Windows Fig. 6 reveals the top six states in terms of granted patents in Asia,
Mixed Reality platform, which represents a new publishing oppor- like South Korea, Japan, Israel, Japan, China, and India. In particular,
tunity for researchers who want to exploit the HoloLens features for South Korea (43 %) and Japan (25 %) have developed more than
new AR applications or just to highlight strengths and weaknesses. half of all Asian patents. Furthermore, the contribution of Israel (13
%) to the Asian patenting activity is not negligible. Differently, the
4.2. Geographical trends contribution of China and India is scant (6 %). It is yet interesting
to note the 5 % contribution of Taiwan. In Fig. 7, we delved into the
We examined the global geographical distribution of granted geographical distribution of patents in Europe. The United Kingdom
patents across world continents in the AR field, in order to highlight (35 %) owns most of the European patents, followed by Germany
the geographical area that contributes the most to the technological (20 %), France (11 %), and Finland (9 %). Despite the push of Industry
development in the AR domain. From the pie chart in Fig. 4, we note 4.0 policies, European numbers remain low when compared with
that the main geographical area to which patents can be associated those of North America and Asia (Fig. 4).
in North America (68 %). A minor but not negligible role is played
by Asia (18 %) and Europe (13 %). Fig. 5 disentangles the contribu-
tion of each geographical area (North America, Asia, Europa, and 4.3. Classes distribution analysis
Others) to the overall patenting activity trend presented earlier in
Fig. 2. The distinct patenting activity trends are plotted with respect Fig. 8 shows the percentage dimensions of each one of the
to the filing year. The figure shows a sharp growth of the number patents’ classes. The numerousness of each class population can
of patents filed in 2008 onwards (as already shown in Fig. 2) in all be explained considering both technological and economic moti-
geographic areas, but especially in North America. This trend can vations.
A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221 7

Fig. 5. Geographical distribution of granted patents per filing year shows that, from 2008 onwards, the patent activity of North America is the most intense.

Fig. 8. Classification of patents per AR classes shows that system and application
are the most patented classes.
Fig. 6. Geographical distribution focused on Asia shows that South Korea driving
the AR innovation.
The most populated class is system (39.23 %). This finding can be
explained by the fact that this class is very broad (Todeschini, 2014;
Skarulis, 2015), but it could also be argued that in this field, where
many established technologies already exist, integrating existing
ones into new systems is generally less prone to unsuccess than
the development of new ones.
The amplitude of the application class (21.53 %) can be explained
because some application fields are drivers of AR (e.g. manufac-
turing, medical, entertainment and so on). Indeed, these are the
fields where AR has been proved to be particularly effective by the
academic and industrial literature (Henderson and Feiner, 2009;
Henderson and Feiner, 2011; Uva et al., 2018; Moro et al., 2017).
The third class is display device (14.59 %). Since the first develop-
ment of AR, visual displays were considered one of the most critical
aspects of this class (Wagner and Schmalstieg, 2007). Despite the
great development efforts, modern visual displays, especially HMD,
have still many limits in terms of field of view (FOV), ergonomics,
cybersickness and so on (Rebenitsch and Owen, 2016; Koulieris
Fig. 7. Geographical distribution focused on Europe shows that the United Kingdom et al., 2019; Miller et al., 2019). It is worth noting that not only
and Germany own most than 50 % of European AR innovation. visual displays are patented for AR (e.g., haptic and audio) (Choi,
2013; Flaks, 2014).
8 A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221

Fig. 9. Temporal trends of patents per AR class confirm 2008 as a turning point for AR patent activity, especially for System class.

The fourth class is tracking (13.78 %). Similarly to display tech- cation with an additional domain that emerged during the patent
nologies, tracking technologies are one of the open challenges of analysis, namely Banking. Fig. 7 delves into the specific domains
AR (Rabbi and Ullah, 2013). A precise alignment of virtual elements covered by the application class. The domains Entertainment and
in the real environment is a crucial aspect for a satisfactory user Games (103 patents), Navigation and Path Planning (95 patents),
experience (Kruijff et al., 2010). There are several patents of track- Manufacturing (77 patents), Medical (64 patents), and Market-
ing techniques in the field of AR divided into vision-based tracking, ing (54 patents) include almost 80 % of all patents in application
sensor-based tracking, and sensor fusion tracking (Mott et al., 2018; class. The remaining 20 % is divided among the other 8 domains.
Balanet et al., 2018). where Military, Geospatial, and Tourism and Cultural Heritage are
The user interaction class is the least populated (10.87 %). the domains with the lowest R&D efforts placed on, probably due
Indeed, designing AR interactions is not an easy task, especially to the scarcer commercial opportunities for AR solutions in these
when interaction must take account of the inclusion of the user’s application domains.
physical surroundings as part of the interface. Furthermore, U.I. Fig. 11 shows the temporal trend of R&D efforts in the different
design is strictly related to the application scenario. The U.I. class application domains of the AR. The application domain Entertain-
encompasses several patents involving both novel interface tech- ment and Games has been growing rapidly since 2008, with a slight
nologies and interaction metaphors allowing the user to interact decrease in 2014 and a recovery in the following years. It is worth
with the augmented scene (Balan et al., 2016; Asbun et al., 2018; noting that Navigation and Path Planning has a similar trend to
Swaminathan et al., 2018). Entertainment and Games but from 2010 onwards. The Manufac-
Fig. 9 further illustrates how the R&D efforts of the different turing application domain has a slow growth until 2015, but in the
AR classes are evolving over time. In particular, the class of sys- same year, it is the most patented application domain. Medical and
tem shows the highest growth rate, with a growth trend starting Marketing are characterized by moderate growth from 2010 with
one year before the others, from 2008 onwards. The application a fluctuating trend.
class is growing rapidly from 2009 onwards with a slight decline in
2014 and a recovery in the successive years. The trends of the other 4.4. Organization distribution
3 classes (Tracking, U.I, Display) are characterized by a moderate
growth starting from 2009 with a fluctuating trend. The display In Fig. 10 are shown the top 10 patenting organizations.
device class since 2013 has a fast growth in terms of patents filed. Microsoft Corporation (U.S.) (29 %) is the most active in the AR
As mentioned in Section 2.1, the AR application class includes domain, followed by Sony (JP) (10 %) and IBM (U.S) (10 %). Below
all patents that provide innovation in a specific domain. Therefore, 10 % there are Qualcomm (U.S.) (9 %), Samsung Electronics (S.K.) (8
a further sub-analysis was made at the level of application domains %), Magic Leap (U.S.) (7 %), Amazon Technologies (U.S) (7 %), Intel
to unveil which specific domains are covered by the sample patents Corporation (U.S) (7 %), Empire Technology Development (U.S.) (7
and to what extent. In so doing, the 13 classes identified by Mekni %) and Daqri (U.S) (6 %). It is worth noting that only companies are
and Lemieux (2014) were considered, namely Medical, Military, included in the top 10, which means their influence on AR, from a
Manufacturing, Visualization, Entertainment and Games, Robotics, quantitative perspective, is higher than universities, research cen-
Education, Marketing, Navigation and Path Planning, Tourism and ters, and government organizations. In particular, eight companies
Cultural Heritage, Geospatial, Urban Planning and Civil Engineer- out of 10 are headquartered in the U.S., further supporting the find-
ing. Still, Mekni and Lemieux acknowledged that their classification ings of Figs. 10 and 4. Fig. 11 complements Fig. 10 by revealing when
might not be exhaustive. Accordingly, we extended their classifi- those companies patented their inventions. It shows that the top 10
A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221 9

Fig. 10. Domains distribution within the application class. The Pareto chart shows that the five out 13 domains account for almost 80 % of the patents of the application class.

Fig. 11. Temporal trends of application domains distribution show that the first domain to grow appreciably is Entertainment and Games.
10 A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221

In this way, they may be in a better position to understand where


more basic research is (still) needed and where research on con-
crete applications can be proposed.
From a managerial and policy perspective, firstly, the growing
trend in patenting activity, especially from 2008, should be consid-
ered by managers as a signal (and confirmation) of the increasing
expectations about AR from the business point of view. This is
corroborated by the fact that most of the developed AR patents
are owned by private organizations, hence indicating the central
role of profit-oriented organizations as catalysts for R&D efforts in
the domain under investigation. Nonetheless, the growing trend
is quite recent since it started a decade ago. Thus, it is likely that
there is still room for those firms seeking to enter the AR mar-
ket, but they should not wait too much since the fast growth rate.
Second, managers and policymakers are advised of the geograph-
Fig. 12. The chart of top 10 patenting organizations distribution (extracted from
Table 1 in appendix) shows the Microsoft Corporation leadership in patent activities. ical origins of the technological knowledge underlying AR. From
this perspective, it is evidenced by the overwhelming primacy of
North America, especially of the U.S. (Canada contribution is neg-
patent-intensive organizations have not contributed to AR since the ligible). Instead, Europe lags behind the U.S. and, also, the Asian
beginning of the emergence of AR patents (1993) but started around context, which, driven by South Korea and Japan, is the second
the late 2000s. Notably, the oldest patent is by Intel Corporation, most patent-intensive geographical area. This implies that the U.S.
filed in 2002. This can be explained by the fact that R&D efforts in may be considered the key area from which sourcing technologi-
the AR domain likely started to become a less risky investment in cal knowledge and learning about AR. As evidenced by Fig. 11, the
those years due to improved awareness about AR by enterprises, most highly impacting organizations are headquartered in the U.S.
the (call for the) implementation of digitalization strategies, and In turn, it could be said that the U.S. market is fuller than Euro-
government support. pean and Asian ones, which may represent better contexts were
We also ranked the companies respect to the number of cita- running new businesses in the AR domain. Notwithstanding, firms
tions received by their patents. In other words, we identified the operating (or attempting to enter) in such contexts should not
top 10 highly impacting organizations (Fig. 12). Fig. 12 reveals disregard a closer look at the U.S. context, since it may be their
that U.S. (with Microsoft Corporation, University of North Carolina, reference framework. From a policy perspective, European poli-
Google, Criticom corporation, Geo Vector, Information Decision cymakers should account for the fact that despite AR has been
Technologies, Amazon Technologies and HRL laboratories) and Ger- indicated as one of the key enabling technologies, the European
man (with Siemens and Metaio) organizations hold the majority context is not even as productive as the Asian one. Maybe, incen-
of patents with the highest technological impact. This stresses the tive schemes and/or financial support to R&D activities towards AR
dominance of the U.S. area and highlights that the technologies should be reinforced. Also, collaboration efforts between European
developed in Asia and Europe are, probably, the result of more and U.S. organizations should be promoted in order to improve
incremental R&D efforts with no sensible impact on subsequent technological catch-up and learning activities.
R&D. It is also interesting to highlight that most patent-intensive Third, our findings show the differences existing between the
organizations are not necessarily those that have a considerable AR classes under analysis. System is the class with the most intense
impact on subsequent R&D activities. In fact, only Microsoft Cor- patenting activity, so it reflects that the majority of R&D efforts are
poration and Amazon Technologies are present both rankings. directed to the development of pervasive systems. The Application
Moreover, when considering the rank of patenting organizations class is the second most patented class, and this could mean that
respect to their impact, universities, research centers, and govern- AR has demonstrated enough (potential) success in some specific
ment organizations assume more relevant positions. For instance, application domains to make the AR worthy of being patented in
the University of North Carolina is even one of the top 10 highly these specific fields. Specifically, the domains that have manifested
impacting organizations. the highest R&D efforts are Entertainment and Games Navigation,
Path Planning, Manufacturing, Medical, and Marketing, covering
5. Discussion, conclusion and future research directions 80 % of the patents in the application domain. These hence repre-
sent the most exploited markets so far with regard to AR solutions.
This paper unveils the technological trends of the AR domain. In this context, managers should investigate whether and to what
Specifically, this work tries to explain the technological develop- extent there exist further opportunities in these markets as well
ment of AR by revealing temporal trends, geographical distribution, as whether and to what extent investments in less exploited - and
and most involved organizations in AR patenting. To do so, we col- hence lees competitive - markets are worthy to be explored or not,
lected 2,373 AR granted patents filed between 1993 and 2018 at especially considering that some of these markets are at the core of
the USPTO. In line with previous studies (Zhou et al., 2008; Azuma, the digital revolution agenda (e.g., Robotics, Tourism and Cultural
1997; Schmalstieg and Hollerer, 2016), we categorize these patents Heritage, Urban Planning and Civil Engineering). The three stand-
into five main technological classes, namely display, tracking, U.I., alone AR technological classes (Display, Tracking, U.I.), together,
application, and system. Despite the intrinsic complexity of the AR include less than half of the total patents. This result may have a
domain, we believe our work provides some valuable results from double meaning: (i) the development of a new technology in these
which AR scholars, managers, and policymakers could benefit. three classes is very risky, due to the fact that established technolo-
From a theoretical perspective to the best of our knowledge, gies with which it is difficult to compete already exist, hence driving
this study is one of the first attempts to depict a comprehensive the majority of R&D efforts towards the development integrated AR
overview of AR by exploiting patent-based measures. In detail, such solutions (system and application) rather than the improvement of
an overview may benefit AR scholars in identifying the extent and a specific (stand-alone) solution; (ii) the technologies are rather
pace at which actual technologies have been developed in the AR mature, but that they still need improvements. Finally, looking
domain, both in general and considering (five) different AR classes. at the most patent-intensive organizations, it emerges that pub-
A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221 11

Fig. 13. Patenting activity trends of the top 10 patent-intensive organizations (number of patents in the bubble).

lic research organizations and universities seem to play a marginal


role. Indeed, as highlighted, firms represent the organizations that
own many of the patents. However, this result (slightly) changes
when organizations are ranked according to their impact. In this
case, universities rise in position; for instance, the University of
North Carolina at Chapel Hill ranks third. Therefore, executives
must be aware that, probably, universities are actually driving the
path of the AR domain even though, in absolute terms, their con-
tribution may appear less evident. Some of the limits in current AR
solutions for the industry may suffer from this misalignment. That
is, firms, in order to avoid risky projects, do not explore for more
radical solutions, even though existing ones appear not so effec-
tive for the industrial practice. Conversely, universities are more
devoted to this exploratory approach. In turn, policymakers, in light
of this finding, may design actions aimed at fostering collabora-
Fig. 14. The chart of top 10 patenting organizations per received citations shows that
tions between firms and universities, which will likely benefit AR
only Microsoft Corporation is also the organization that owns the largest number of
from the cross-fertilization of their different perspectives and avoid valuable patents.
the technological lock-in often characterizing firms’ R&D efforts.
Furthermore, the highlighted difference between Figs. 10 and 11
may help distinguishing organizations respect to the relevance of our results show, less than half of the total patents belong to these
their R&D efforts. For example, it emerged that Microsoft Corpo- classes. In light of these considerations and in our opinion, research
ration stands out both for the number of patents granted and for and innovation efforts should be more focused on the aforemen-
their impact in the AR field. This helps managers in recognizing tioned classes in order to overcome these still open challenges in
which organizations may be more harmful, from a competitive per- AR. The limitations in the use of AR are not only technical but also
spective, or beneficial, from a collaborative perspective. Likewise, human, in fact, there are factors such as social acceptance, pri-
policymakers may more easily identify organizations that are hav- vacy and usability problems that slow down the diffusion of AR
ing the highest impact in the AR domain and could accordingly in everyday life (Figs. 13 and 14).
further stimulate their research productivity. Of course, we acknowledge that these conjectures may be sub-
Fourth, although AR technology is increasing in expectations ject to the data source. The conjectures can surely well-describe
due to technological progress in hardware and software, it still the US market, which is also the biggest and most representative
suffers from technical and non-technical limitations that currently one with regard to AR. Nonetheless, despite we still underline the
limit its use in everyday life. From a technical point of view, the USPTO is the patent database where organizations worldwide tend
limitations are mainly due to several challenges, such as alignment, to patent their invention (see discussion in Section 3), a small coun-
interaction, and visualization (Rabbi and Ullah, 2013). Despite the try bias may persist. This may relax the validity of our implications,
important role that the three main AR technologies (visualization, however calling for future studies to confirm (or contradict) our
tracking, and interaction) play in addressing these challenges, as findings, for instance by examining PCT or triadic patent applica-
tions (Lee et al., 2015).
12 A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221

In conclusion, we believe that this study has taken the literature Appendix A.
one step further in the on-going debate on the dynamics of AR tech-
nological solutions and hope that it may encourage further studies Table A1
in AR trends analysis. We also expect that, in the future, it might be
interesting to revisit this work to investigate the new trends and
fast-changing landscape of the AR domain. References

Abraham, B.P., Moitra, S.D., 2001. Innovation assessment through patent analysis.
Technovation 21, 245–252, http://dx.doi.org/10.1016/S0166-4972(00)00040-7.
Declaration of Competing Interest Acs, Z.J., Anselin, L., Varga, A., 2002. Patents and innovation counts as measures of
regional production of new knowledge. Res. Policy 31, 1069–1085, http://dx.doi.
The authors declare that they have no known competing finan- org/10.1016/S0048-7333(01)00184-6.
Adhani, N.I., Awang, R.D.R., 2012. A survey of mobile augmented reality applications.
cial interests or personal relationships that could have appeared to 1st Int. Conf. Futur. Trends Comput. Commun. Technol., 89–96.
influence the work reported in this paper. Afif, F.N., Basori, A.H., Saari, N., 2013. Vision based tracking technology for aug-
mented reality: a survey. Int. J. Interact. Digit. Media. 1, 46–49.
Albino, V., Ardito, L., Dangelico, R.M., Messeni Petruzzelli, A., 2014. Understanding
the development trends of low-carbon energy technologies: a patent analysis.
Acknowledgements Appl. Energy 135, 836–854, http://dx.doi.org/10.1016/j.apenergy.2014.08.012.
Archibugi, D., Pianta, M., 1996. Innovation Surveys and Patents as Technology Indi-
cators: the State of the Art. OECD, Innov. Patents Technol. Strateg., pp. 17–56
This work was supported by the Italian Ministry of Education, (Accessed October 25, 2019) https://ora.uniurb.it/handle/11576/1889690.
University and Research under the Programmes “Department of Ardito, L., D’Adda, D., Messeni Petruzzelli, A., 2018. Mapping innovation dynamics in
Excellence”, Legge 232/2016 (Grant No. CUP – D94I18000260001), the Internet of Things domain: evidence from patent analysis. Technol. Forecast.
Soc. Change 136, 317–330, http://dx.doi.org/10.1016/j.techfore.2017.04.022.
and the Piano Operativo Nazionale (PON) “Ricerca e Innovazione” Arth, C., Schmalstieg, D., 2011. Challenges of Large-scale Augmented Reality on
2014-202 AIM – Attrazione e Mobilità Internazionale. Smartphones. Graz Univ. Technol. Graz., pp. 1–4.

Table A1
Most relevant patenting organizations (owners of the 60 % of all patents).

Assignee (60 % all patents) # patents # citations Mean citations Display device Tracking U.I. HM Device System Application Technological
diversification

Microsoft Corporation 203 970 4.8 36 27 43 23 60 14 0,8


Sony 73 195 2.7 3 15 12 3 33 7 0,7
International Business Machines 71 71 1 5 9 3 2 46 6 0,54
QUALCOMM Incorporated 64 155 2.4 1 16 19 2 23 3 0,71
Samsung Electronics Co. Ltd. 59 84 1.4 11 6 3 0 32 7 0,63
Magic Leap. Inc. 51 118 2.3 16 7 4 6 18 0 0,72
Amazon Technologies 49 226 4.6 13 7 9 0 16 4 0,75
Intel Corporation 49 71 1.4 2 5 4 0 34 4 0,48
Empire Technology Develoment LLC 48 58 1.2 3 11 5 1 25 3 0,64
DAQRI. LLC 45 22 0.5 2 7 5 7 22 2 0,68
Siemens AG 41 606 14.8 1 11 10 1 7 11 0,75
DISNEY ENTERPRISES. INC. 37 65 1.8 4 2 6 1 15 9 0,71
Google Inc 35 397 11.3 7 3 10 3 9 3 0,77
LG Electronics Inc. 35 129 3.7 3 2 2 11 13 4 0,72
NOKIA CORPORATION 31 52 1.7 1 1 9 0 18 2 0,55
Nant Holdings IP. LLC 21 145 6.9 1 6 1 0 9 4 0,66
A9.COM. INC. 21 29 1.4 0 6 5 0 6 4 0,71
Apple. Inc. 20 96 4.8 3 6 0 0 10 1 0,6
Bally Gaming. Inc. 20 37 1.85 0 1 0 0 3 16 0,32
AT&T 18 15 0.8 0 0 0 0 15 3 0,26
Meta Company 16 3 0.2 3 0 8 1 4 0 0,61
Bank of America Corporation 16 85 5.3 0 1 0 0 9 6 0,51
Electronics and Telecommunications 16 27 1.7 0 2 1 0 5 8 0,59
Research Institute
Information Decision Technologies LLC 16 255 15.9 0 2 1 0 2 11 0,46
The Boeing Company 15 23 1.5 0 1 0 1 2 11 0,41
SEIKO EPSON CORPORATION 14 0 0 1 2 0 11 0 0 0,33
THINKWARE CORPORATION 14 0 0 0 0 0 0 6 8 0,45
Atheer 13 2 0.2 0 2 6 1 4 0 0,61
Honda Motor Co. Ltd. 13 25 1.9 2 0 0 0 0 11 0,24
Blackberry Limited 12 7 0.6 0 2 2 1 7 0 0,55
IMMERSION CORPORATION 11 8 0.7 7 0 1 0 3 0 0,47
Elwha LLC 11 8 0.7 0 0 2 0 9 0 0,27
Capital One Services. LLC 11 3 0.3 0 5 0 0 4 2 0,57
eBay Inc. 11 25 2.3 0 0 0 0 7 4 0,42
Osterhout Group. Inc. 11 29 2.6 6 1 0 3 1 0 0,56
Hyundai Motor Company 11 5 0.5 2 0 1 0 1 7 0,5
XEROX Corporation 11 215 19.5 0 3 0 0 8 0 0,36
Bentley Systems. Incorporated 11 13 1.2 0 3 0 0 6 2 0,54
Metaio GmbH 11 360 32.7 0 9 0 0 2 0 0,27
Rawles LLC 11 75 6.8 3 3 2 0 3 0 0,68
Wells Fargo Bank. N.A. 10 3 0.3 0 0 0 0 4 6 0,43
HAND HELD PRODUCTS. INC. 10 170 17.0 0 1 0 0 2 7 0,41
FUJITSU LIMITED 10 2 0.2 4 3 0 0 2 1 0,63
ABL IP Holding LLC 10 9 0.9 0 6 1 0 1 2 0,52
HERE Global B.V. 10 17 1.7 0 1 2 0 6 1 0,52
A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221 13

Arth, C., Grasset, R., Gruber, L., Langlotz, T., Mulloni, A., Wagner, D., 2015. The History Henkel, J., Baldwin, C.Y., Shih, W., 2013. IP modularity: profiting from innovation by
of Mobile Augmented Reality: Developments in Mobile AR Over the Last 50 aligning product architecture with intellectual property. Calif. Manage. Rev. 55,
Years. 65–82, http://dx.doi.org/10.1525/cmr.2013.55.4.65.
Asbun et al., Gaze-driven augmented reality, US20160259977A1, 2018. Höllerer, T., Feiner, S., Terauchi, T., Rashid, G., Hallaway, D., 1999. Exploring
Azuma, R.T., 2001. Augmented Reality: Approaches and Technical Challenges. Fun- MARS: developing indoor and outdoor user interfaces to a mobile augmented
dam. Wearable Comput. Augment. Real., CRC Press, pp. 43–80. reality system. Comput. Graph. 23, 779–785, http://dx.doi.org/10.1016/S0097-
Azuma, R.T., 1997. A Survey of Augmented Reality, http://www. 8493(99)00103-X.
cs.unc.edu/∼azumaW: (Accessed October 9, 2019). Huang, C., Notten, A., Rasters, N., 2011. Nanoscience and technology publications
Balan et al., Two-hand interaction with natural user interface, US20150040040A1, and patents: a review of social science studies and search strategies. J. Technol.
2016. Transf. 36, 145–172, http://dx.doi.org/10.1007/s10961-009-9149-8.
Balanet al., Passive optical and inertial tracking in slim form-factor, Huang, M.H., Yang, H.W., Chen, D.Z., 2015. Industry–academia collaboration in
US20170357333A1, 2018. fuel cells: a perspective from paper and patent analysis. Scientometrics 105,
Barsom, E.Z., Graafland, M., Schijven, M.P., 2016. Systematic review on the effec- 1301–1318, http://dx.doi.org/10.1007/s11192-015-1748-6.
tiveness of augmented reality applications in medical training. Surg. Endosc. 30, Jeong, B., Yoon, J., 2017. Competitive intelligence analysis of augmented real-
4174–4183, http://dx.doi.org/10.1007/s00464-016-4800-6. ity technology using patent information. Sustain 9, http://dx.doi.org/10.3390/
Bau, O., Poupyrev, I., 2012. REVEL: tactile feedback technology for augmented su9040497.
reality. ACM Trans. Graph. 31, 89, http://dx.doi.org/10.1145/2185520.2185585, Kato, H., Billinghurst, M., 1999. Marker tracking and HMD calibration for a video-
1–89:11. based augmented reality conferencing system. Proc. - 2nd IEEE ACM Int. Work.
Billinghurst, M., Clark, A., Lee, G., 2014. A survey of augmented reality. Found. Trends Augment. Reality, IWAR 1999, Institute of Electrical and Electronics Engineers
Human-Computer Interact. 8, 73–272, http://dx.doi.org/10.1561/1100000049. Inc., 85–94, http://dx.doi.org/10.1109/IWAR.1999.803809.
Botden, S.M.B.I., Jakimowicz, J.J., 2009. What is going on in augmented reality simu- H.B. Kenneth, C. St. John, Method and system for calibrating a virtual reality system,
lation in laparoscopic surgery? Surg. Endosc. 23, 1693–1700, http://dx.doi.org/ US 20160343167 A1, 2019.
10.1007/s00464-008-0144-1. Kim, K., Billinghurst, M., Bruder, G., Duh, H.B.L., Welch, G.F., 2018. Revisiting trends in
Buchmann, V., Violich, S., Billinghurst, M., Cockburn, A., 2004. FingARtips: gesture augmented reality research: a review of the 2nd Decade of ISMAR (2008-2017).
based direct manipulation in augmented reality. In: Proc. 2nd Int. Conf. Comput. IEEE Trans. Vis. Comput. Graph. 24, 2947–2962, http://dx.doi.org/10.1109/TVCG.
Graph. Interact. Tech. Australas, South East Asia, pp. 212–221. 2018.2868591.
Caudell, T.P., Mizell, D.W., 1992. Augmented reality: an application of heads-up dis- Kim, S., Park, I., Yoon, B., 2020. Sao2vec: development of an algorithm for embedding
play technology to manual manufacturing processes. Proc. Twenty-Fifth Hawaii the subject-action-object (SAO) structure using Doc2Vec. PLoS One 15, http://
Int. Conf. Syst. Sci., 659–669. dx.doi.org/10.1371/journal.pone.0227930.
Chang, S.H., Fan, C.Y., 2016. Identification of the technology life cycle of telematics a Kiyokawa, K., 2012. Trends and vision of head mounted display in augmented reality.
patent-based analytical perspective. Technol. Forecast. Soc. Change 105, 1–10, Proc. - 2012 Int. Symp. Ubiquitous Virtual Reality, ISUVR 2012, 14–17, http://dx.
http://dx.doi.org/10.1016/j.techfore.2016.01.023. doi.org/10.1109/ISUVR.2012.11.
Chen, H., Lee, A.S., Swift, M., Tang, J.C., 2015. 3D collaboration method over Ko, S.M., Chang, W.S., Ji, Y.G., 2013. Usability principles for augmented reality
HoloLens$$texttrademark and Skype$$texttrademark end points. Proc. 3rd applications in a smartphone environment. Int. J. Human–Comp. Interact. 29,
Int. Work. Immersive Media Exp., 27–30, http://dx.doi.org/10.1145/2814347. 501–515, http://dx.doi.org/10.1080/10447318.2012.722466.
2814350. Koulieris, G.A., Akşit, K., Stengel, M., Mantiuk, R.K., Mania, K., Richardt, C., 2019.
S. Choi, Apparatus and method for providing haptic augmented reality, Near-eye display and tracking technologies for virtual and augmented reality.
US20100141409A1, 2013. Comput. Graph. Forum 38, 493–519, http://dx.doi.org/10.1111/cgf.13654.
Choi, H., Oh, S., Choi, S., Yoon, J., 2018. Innovation topic analysis of technology: the Kronemeyer, L.L., Eilers, K., Wustmans, M., Moehrle, M.G., 2020. Monitoring com-
case of augmented reality patents. IEEE Access 6, 16119–16137, http://dx.doi. petitors innovation activities: analyzing the competitive patent landscape based
org/10.1109/ACCESS.2018.2807622. on semantic anchor points. IEEE Trans. Eng. Manag., http://dx.doi.org/10.1109/
Cockburn, I.M., MacGarvie, M.J., 2009. Patents, thickets and the financing of early- TEM.2019.2958518.
stage firms: evidence from the software industry. J. Econ. Manag. Strateg., Kruijff, E., Swan, J.E., Feiner, S., 2010. Perceptual issues in augmented reality revisited.
729–773, http://dx.doi.org/10.1111/j.1530-9134.2009.00228.x. 9th IEEE Int. Symp. Mix. Augment. Real. 2010 Sci. Technol. ISMAR 2010 - Proc.,
Dacko, S.G., 2017. Enabling smart retail settings via mobile augmented reality shop- 3–12, http://dx.doi.org/10.1109/ISMAR.2010.5643530.
ping apps. Technol. Forecast. Soc. Change 124, 243–256. Lee, Nam, Y., Lee, S., Son, H., 2016. Determinants of ICT innovations: a cross-country
Daqri Smart Glasses, 2019 (n.d.). https://daqri.com/products/smart-glasses/ empirical study. Technol. Forecast. Soc. Change 110, 71–77, http://dx.doi.org/
(accessed October 14, 2019). 10.1016/j.techfore.2015.11.010.
Epson Moverio, 2019 (n.d.). https://www.epson.co.uk/products/see-through- Lee, W.S., Han, E.J., Sohn, S.Y., 2015. Predicting the pattern of technology convergence
mobile-viewer (accessed October 14, 2019). using big-data technology on large-scale triadic patents. Technol. Forecast. Soc.
Feiner, S., MacIntyre, B., Höllerer, T., et al., 1997. A touring machine: Change 100, 317–329, http://dx.doi.org/10.1016/j.techfore.2015.07.022.
Prototyping 3D mobile augmented reality systems for exploring the Leydesdorff, L., Alkemade, F., Heimeriks, G., Hoekstra, R., 2015. Patents as instru-
urban environment. Personal Technol. 1, 208–217, http://dx.doi.org/10.1007/ ments for exploring innovation dynamics: geographic and technological
BF01682023. perspectives on “photovoltaic cells”. Scientometrics 102, 629–651, http://dx.
Fernández del Amo, I., Erkoyuncu, J.A., Roy, R., Palmarini, R., Onoufriou, D., 2018. A doi.org/10.1007/s11192-014-1447-8.
systematic review of Augmented Reality content-related techniques for knowl- Li, X., Chen, H., Huang, Z., Roco, M.C., 2007. Patent citation network in nanotech-
edge transfer in maintenance applications. Comput. Ind. 103, 47–71, http://dx. nology (1976-2004). J. Nanopart. Res. 9, 337–352, http://dx.doi.org/10.1007/
doi.org/10.1016/j.compind.2018.08.007. s11051-006-9194-2.
Fiorentino, M., Uva, A.E., Gattullo, M., Debernardis, S., Monno, G., 2014. Augmented Liarokapis, F., 2007. An augmented reality interface for visualizing and interacting
reality on large screen for interactive maintenance instructions. Comput. Ind. with virtual content. Virtual Real. 11, 23–43, http://dx.doi.org/10.1007/s10055-
65, 270–278, http://dx.doi.org/10.1016/j.compind.2013.11.004. 006-0055-1.
Fisher, W.W., Oberholzer-Gee, F., 2013. Strategic management of intellectual prop- Lindeman, R.W., Noma, H., De Barros, P.G., 2007. Hear-through and mic-through
erty: an integrated approach. Calif. Manage. Rev. 55, 157–183, http://dx.doi.org/ augmented reality: using bone conduction to display spatialized audio. 2007
10.1525/cmr.2013.55.4.157. 6th IEEE ACM Int. Symp. Mix. Augment. Reality, ISMAR, 1–4, http://dx.doi.org/
J. Flaks, System and method for high-precision 3-dimensional audio for augmented 10.1109/ISMAR.2007.4538843.
reality, US20120093320A1, 2014. Livingston, M., Rosenblum, L., Julier, S., Brown, D., Baillot, Y., Swan, J., Gabbard, J., Hix,
M. Frank, W. Robert, P. Makowenskyj, K. Walter, A. Thelemann, G. Dawson, Capsule D., 2002. An augmented reality system for military operations in urban terrain.
body attachment, US 20150108050 A1, 2018. Engineering 2002, 1–8 (Accessed October 28, 2019) https://apps.dtic.mil/docs/
Han, E.J., Sohn, S.Y., 2016. Technological convergence in standards for information citations/ADA499032.
and communication technologies. Technol. Forecast. Soc. Change 106, 1–10, Livingston, M.A., Rosenblum, L.J., Brown, D.G., Schmidt, G.S., Julier, S.J., Baillot, Y.,
http://dx.doi.org/10.1016/j.techfore.2016.02.003. Swan, J.E., Ai, Z., Maassel, P., 2011. Military Applications of Augmented Reality.
Harhoff, D., Narin, F., Scherer, F.M., Vopel, K., 1999. Citation frequency and the value Handb. Augment. Real., Springer, New York, pp. 671–706, http://dx.doi.org/10.
of patented inventions. Rev. Econ. Stat. 81, 511–515, http://dx.doi.org/10.1162/ 1007/978-1-4614-0064-6 31.
003465399558265. Magic Leap, 2019 (n.d.). https://www.magicleap.com (accessed October 14, 2019).
He, Z., Sui, X., Jin, G., Cao, L., 2019. Progress in virtual reality and augmented real- Mallem, M., 2010. Augmented reality: issues, trends and challenges. 2010 2nd Int.
ity based on holographic display. Appl. Opt. 58, A74–A81, http://dx.doi.org/10. Conf. Image Process. Theory, Tools Appl., 8, http://dx.doi.org/10.1109/IPTA.2010.
1364/AO.58.000A74. 5586829.
Henderson, S.J., Feiner, S., 2009. Evaluating the benefits of augmented reality for task Mann, R.J., Sager, T.W., 2007. Patents, venture capital, and software start-ups. Res.
localization in maintenance of an armored personnel carrier turret. Sci. Technol. Policy 36, 193–208, http://dx.doi.org/10.1016/j.respol.2006.10.002.
Proc. - IEEE 2009 Int. Symp. Mix. Augment. Reality, ISMAR 2009, 135–144, http:// Anon, (n.d.). https://www.marketsandmarkets.com/ResearchInsight/augmented-
dx.doi.org/10.1109/ISMAR.2009.5336486. reality-virtual-reality-market.asp (Accessed October 14, 2019) 2019. Market-
Henderson, S., Feiner, S., 2011. Exploring the benefits of augmented reality doc- sandmarkets, Market Leader - Augmented Reality and Virtual Reality Market.
umentation for maintenance and repair. IEEE Trans. Vis. Comput. Graph. 17, Mekni, M., Lemieux, A., 2014. Augmented reality: applications, challenges and future
1355–1368, http://dx.doi.org/10.1109/TVCG.2010.245. trends. Appl. Comput. Sci., 205–214.
Microsoft HoloLens, 2019 (n.d.). https://www.microsoft.com/en-us/hololens
(accessed October 14, 2019).
14 A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221

Miller, J., Hoover, M., Winer, E., 2019. Overcoming limitations of the HoloLens Intellect. Prop. Underst. Multinatl. Enterp. Mod. World, 67–88, http://dx.doi.org/
for use in product assembly. IS&T Int. Symp. Electron. Imaging Sci. Tech- 10.1142/9789812833181 0005.
nol., 1–9 https://www.ingentaconnect.com/contentone/ist/ei/2019/00002019/ Thomas, B., Close, B., Donoghue, J., Squires, J., De Bondi, P., Piekarski, W., 2002. First
00000002/art00006. Person indoor/outdoor Augmented Reality Application: ARQuake. Pers. Ubiq-
Moehrle, M.G., Caferoglu, H., 2019. Technological speciation as a source for emerging uitous Comput., Springer-Verlag London Ltd, pp. 75–86, http://dx.doi.org/10.
technologies. Using semantic patent analysis for the case of camera technol- 1007/s007790200007.
ogy. Technol. Forecast. Soc. Change 146, 776–784, http://dx.doi.org/10.1016/j. E. Todeschini, Augmented-reality signature capture, US9251411B2, 2014.
techfore.2018.07.049. Tong, X., Frame, J.D., 1994. Measuring national technological performance with
Moro, C., Štromberga, Z., Raikos, A., Stirling, A., 2017. The effectiveness of virtual and patent claims data. Res. Policy 23, 133–141, http://dx.doi.org/10.1016/0048-
augmented reality in health sciences and medical anatomy. Anat. Sci. Educ. 10, 7333(94)90050-7.
549–559, http://dx.doi.org/10.1002/ase.1696. Trajtenberg, M., 1990. A penny for your quotes: patent citations and the value of
Mott et al., Adaptive fiducials for image match recognition and tracking, 14/475,333, innovations. Rand J. Econ. 21, 172, http://dx.doi.org/10.2307/2555502.
2018. Uva, A.E., Fiorentino, M., Gattullo, M., Colaprico, M., de Ruvo, M.F., Marino, F., Trotta,
Nadler; Ingo, Virtual reality communication systems and methods thereofo Title, US G.F., Manghisi, V.M., Boccaccio, A., Bevilacqua, V., 2016. Others, design of a pro-
20170026635 A1, 2016. jective AR workbench for manual working stations. Int. Conf. Augment. Reality,
Narumi, T., Nishizaka, S., Kajinami, T., Tanikawa, T., Hirose, M., 2011. Augmented Virtual Real. Comput. Graph., 358–367.
reality flavors: gustatory display based on edible marker and cross-modal inter- Uva, A.E., Gattullo, M., Manghisi, V.M., Spagnulo, D., Cascella, G.L., Fiorentino, M.,
action. Conf. Hum. Factors Comput. Syst. - Proc., 93–102, http://dx.doi.org/10. 2018. Evaluating the effectiveness of spatial augmented reality in smart man-
1145/1978942.1978957. ufacturing: a solution for manual working stations. Int. J. Adv. Manuf. Technol.
Novelli, E., 2015. An examination of the antecedents and implications of patent 94, 509–521, http://dx.doi.org/10.1007/s00170-017-0846-4.
scope. Res. Policy 44, 493–507, http://dx.doi.org/10.1016/j.respol.2014.09.005. Van Krevelen, D.W.F., 2010. Augmented reality: technologies, applications, and limi-
OECD, 2009. Patent Statistics Manual. OECD Publ (Accessed October 25, 2019) tations. Int. J. Virtual Real. 9, 1–20, http://dx.doi.org/10.13140/RG.2.1.1874.7929.
https://www.oecd-ilibrary.org/science-and-technology/oecd-patent-statistics- Wagner, D., Schmalstieg, D., 2007. ARToolKitPlus for pose track-
manual 9789264056442-en. ing on Mobile devices. Proc. 12th Comput. Vis. Winter Work,
Paavilainen, J., Korhonen, H., Alha, K., Stenros, J., Koskinen, E., Mäyrä, F., 2017. The http://data.icg.tugraz.at/∼dieter/publications/Schmalstieg 114.pdf.
Pokémon go experience: a location-based augmented reality mobile game goes Wagner, D., Langlotz, T., Schmalstieg, D., 2008. Robust and unobtrusive marker track-
mainstream. Conf. Hum. Factors Comput. Syst. - Proc., 2493–2498, http://dx.doi. ing on mobile phones. Proc. - 7th IEEE Int. Symp. Mix. Augment. Real. 2008,
org/10.1145/3025453.3025871. ISMAR 2008, 121–124, http://dx.doi.org/10.1109/ISMAR.2008.4637337.
Paelke, V., 2014. Augmented reality in the smart factory: supporting workers in an Wang, X., Love, P.E.D., Kim, M.J., Wang, W., 2014. Mutual awareness in collaborative
industry 4.0. Environment. 19th IEEE Int. Conf. Emerg. Technol. Fact. Autom. design: an Augmented Reality integrated telepresence system. Comput. Ind. 65,
ETFA 2014, 1–4, http://dx.doi.org/10.1109/ETFA.2014.7005252. 314–324, http://dx.doi.org/10.1016/j.compind.2013.11.012.
Palmarini, R., Erkoyuncu, J.A., Roy, R., Torabmostaedi, H., 2018. A systematic review Xie, Z., Miyazaki, K., 2013. Evaluating the effectiveness of keyword search strategy
of augmented reality applications in maintenance. Robot. Comput. Manuf. 49, for patent identification. World Pat. Inf. 35, 20–30, http://dx.doi.org/10.1016/j.
215–228, http://dx.doi.org/10.1016/j.rcim.2017.06.002. wpi.2012.10.005.
Papagiannakis, G., Singh, G., Magnenat-Thalmann, N., 2008. A survey of mobile and Yim, M.Y.-C., Chu, S.-C., Sauer, P.L., 2017. Is augmented reality technology an effec-
wireless technologies for augmented reality systems. Comput. Animat. Virtual tive tool for e-commerce? An interactivity and vividness perspective. J. Interact.
Worlds 19, 3–22, http://dx.doi.org/10.1002/cav.221. Mark. 39, 89–103.
Pavitt, K., 1985. Patent statistics as indicators of innovative activities: possibilities You, S., Neumann, U., 2001. Fusion of vision and gyro tracking for robust augmented
and problems. Scientometrics 7, 77–99, http://dx.doi.org/10.1007/BF02020142. reality registration. Proc. IEEE Virtual Real. 2001, 71–78.
Piumsomboon, T., Clark, A., Billinghurst, M., Cockburn, A., 2013. User-defined ges- Zhou, F., Dun, H.B.L., Billinghurst, M., 2008. Trends in augmented reality tracking,
tures for augmented reality. IFIP Conf. Human-Computer Interact., 282–299. interaction and display: a review of ten years of ISMAR. Proc. - 7th IEEE Int.
Poupyrev, I., Tan, D.S., Billinghurst, M., Kato, H., Regenbrecht, H., Tetsutani, N., Symp. Mix. Augment. Real. 2008, ISMAR 2008, 193–202, http://dx.doi.org/10.
2002. Developing a generic augmented-reality interface. Computer (Long. Beach. 1109/ISMAR.2008.4637362.
Calif.) 35, 44–50, http://dx.doi.org/10.1109/2.989929. Zhu, E., Hadadgar, A., Masiello, I., Zary, N., 2014. Augmented reality in healthcare
Pucihar, K.Č., Coulton, P., 2014. Exploring the evolution of mobile augmented reality education: an integrative review. PeerJ 2, e469.
for future entertainment systems. Comput. Entertain. 11, 1, http://dx.doi.org/
10.1145/2582179.2633427, 1–1:16.
Rabbi, I., Ullah, S., 2013. A survey on augmented reality challenges and tracking. Acta Alessandro Evangelista received the B.S.,and M.S. degrees
Graph. Znan. Časopis Za Tisk. i Graf. Komun. 24, 29–46. in Management Engineering from the Polytechnic Uni-
Rebenitsch, L., Owen, C., 2016. Review on cybersickness in applications and versity of Bari, Italy, in 2014, and 2017, respectively.
visual displays. Virtual Real. 20, 101–125, http://dx.doi.org/10.1007/s10055- He is currently working toward the PhD degree at the
016-0285-9. Department of Mechanics, Mathematics, and Manage-
Rolland, J.P., Holloway, R.L., Fuchs, H., 1995. Comparison of optical and video see- ment, Polytechnic Institute of Bari. His research interests
through, head-mounted displays. In: Das, H. (Ed.), Telemanipulator Telepresence include virtual and augmented reality for industrial appli-
Technol. SPIE, pp. 293–307, http://dx.doi.org/10.1117/12.197322. cation, natural user interfaces, CAD modeling, reverse
Roper, S., Hewitt-Dundas, N., 2015. Knowledge stocks, knowledge flows and inno- engineering, and industrial automation.
vation: evidence from matched patents and innovation panel data. Res. Policy
44, 1327–1340, http://dx.doi.org/10.1016/j.respol.2015.03.003.
Rovira, Luis, A., 6,795,972 2004. Subscriber Television System User Interface with a
Virtual Reality Media Space.
Schmalstieg, D., Hollerer, T., 2016. Augmented Reality: Principles and Practice. Lorenzo Ardito is an Assistant Professor of Technology
Addison-Wesley Professional. and Innovation Management at the Polytechnic University
Schmalstieg, D., Reitmayr, G., 2007. The world as a user interface: augmented real- of Bari, also qualified to the position of Associate Pro-
ity for ubiquitous computing. In: Locat. Based Serv. TeleCartography. Springer, fessor. He is an external Research Fellow at the Mount
Berlin Heidelberg, pp. 369–391, http://dx.doi.org/10.1007/978-3-540-36728-4 Royal University and has been visiting PhD candidate
28. at the WHU-Otto Beisheim School of Management. His
L. Seung-hwan, M. Pill-kyoung, Y. Soo-yeoun, L. Sang-joon, L. Jeong-yeon, L. Jun-Ho, J. main research interests concern innovation management,
Seong-hoon, C. Bong-hyun, Method of providing information-of-users’ interest sustainable development, and digital transformation. His
when video call is made, and electronic apparatus thereof, US 20140125757 A1, studies on this topic are made in collaboration with
2016. scholars worldwide and have been published in lead-
A. Shubham, R. Abhishek, S. Kartik, B. Vijan, H.R. C, D.G. Mercedes, D.P. Giuseppe, ing international journals - e.g., Journal of Business
L.R. Kevin, Checkout and/or ordering systems and methods, US 20140279191 Research, Technological Forecasting and Social Change,
A1, 2016. R&D Management, Journal of Engineering and Technol-
Sielhorst, T., Feuerstein, M., Navab, N., 2008. Advanced medical displays: a literature ogy Management, European Management Journal, European Management Review.
review of augmented reality. J. Disp. Technol. 4, 451–467. He is member of the Editorial Board of Journal of Knowledge Management, Sustain-
M. Skarulis, Systems and methods for an augmented reality platform, ability, and Cogent Business & Management. Finally, he has received some awards
US20130016123A1, 2015. for his research activities (e.g., a Best Paper Award, Outstanding Contribution in
Sutherland, I.E., 1968. A head-mounted three dimensional display. Proc. December Reviewing, and a research grant from the Ermenegildo Zegna Founder’s Scholarship
9-11, 1968, Fall Jt. Comput. Conf. Part I, 757–764. program).
Swaminathan et al., Enabling augmented reality using eye gaze tracking,
US20140168056A1, 2018.
Tatić, D., Tešić, B., 2017. The application of augmented reality technologies for the
improvement of occupational safety in an industrial environment. Comput. Ind.
85, 1–10, http://dx.doi.org/10.1016/j.compind.2016.11.004.
Teece, D.J., 2008. Profiting from technological innovation: implications for inte-
gration, collaboration, licensing and public policy. Transf. Licens. Know-How
A. Evangelista, L. Ardito, A. Boccaccio et al. / Computers in Industry 118 (2020) 103221 15

Antonio Boccaccioreceived his BS and MS degrees in Antonio Messeni Petruzzelli is Associate Professor of
Mechanical Engineering from the Polytechnic University Innovation Management at Polytechnic University of Bari.
of Bari Italy, in 2002 and his PhD degree in Bioengineering He is the author of more than 95 international pub-
from Polytechnic Institute of Milan, Italy, in 2006. In 2005 lications and four international books on the topic of
he was Visiting Research Scholar at the Centre for Bioengi- innovation management. His studies on this issue have
neering, Trinity College Dublin. Since December 2016 he been published in leading journals, as Research Policy,
is Assistant Professor, Senior at the Polytechnic University Entrepreneurship Theory & Practice, Academy of Man-
of Bari. He authored more than 100 publications (46 peer- agement Perspectives, Journal of Management and Long
reviewed ISI journal papers, 2 national journal papers, 10 Range Planning. He belongs to the editorial team of Journal
book chapters, 1 invited lecture, 53 conference papers) of Knowledge Management and Technological Forecasting
and 1 European patent. He is a member of the Editorial and Social Change. Finally, his studies have recently been
Board of three internationally reputed journals. In 2012, awarded the Nokia Siemens Network Award in Technol-
he has been awarded with the Fylde Electronics Prize for ogy Management for Innovation into the Future.
the best paper published in 2010 in the Strain journal by the British Society for
Strain Measurement. Dr. Boccaccio’s research interests are optical techniques for
reverse engineering, human-computer interaction, morphological optimization of Antonio Emmanuele Uva received his BS and MS degrees
biomaterials, modeling and simulation of biomedical devices and mechanobiologi- in Mechanical Engineering from the Polytechnic Univer-
cal processes. sity of Bari, Italy, in 1995 and his Ph.D. degree from the
University of Naples in 2000. He was visiting researcher
for over a year at the University of California at Davis.
Michele Fiorentino received his BS and MS degrees in He was with the Department of Mechanics, Mathemat-
Mechanical Engineering from the Polytechnic University ics and Management at the Polytechnic University of Bari
of Bari, Italy, in 1999 and his Ph.D. in 2003 in ädvanced since 2006 as Associate Professor. Since 2003, he is a mem-
production systems¨. He was with the Department of ber of Centre of Excellence for Computational Mechanics
Mechanics, Mathematics and Management at the Poly- of Polytechnic Institute of Bari. He published more than
technic Institute of Bari since 2015 as Associate Professor. 50 papers in international journals, book chapters, and
From 2017 he is qualified to Full Professor. From 2018 international conferences. He participated in national and
he is the coordinator of the Master’s degree in industrial international projects and currently, he serves as invited
design and board member of the Digilab, the Contami- expert for the European Commission as regards interactive technologies. His main
nation Lab of the Polytechnic of Bari, and committee of research interests are CAD, human-computer interaction, virtual and augmented
ISMAR, IEEE. The main areas of research are CAD, CAX, reality, and bioengineering. He is a member of IEEE, ACM, ADM (Italian Mechanical
ergonomic tools Virtual, Augmented Reality, reality recon- Drawing Association).
struction and bioengineering. He was a visiting researcher
in several institutes around the world. He is currently the author of more than 34
papers on international journals, has coordinated and has participated to interna-
tional research projects. He currently teaches V̈irtual Design and Simulationät the
Faculty of Industrial Design and S̈imulation and Virtual Prototypingïn the Master’s
Degree in Engineering at the Polytechnic University of Bari. He also has about 15
years of experience as a professional trainer for companies, technical schools, and
Ph.D.

You might also like