Raj vaghani 224737 1

The Role of Augmented Reality in Smart

Factory and Digitalized Production
M_ITTM_S22 SS-2023

Abstract
An innovative form of human-machine interaction (HMI) called augmented reality (AR)
applies digitally created information over a real-world setting. Industry 4.0 can be
conceivable by augmented reality (AR), a technology that has rapidly gained popularity and
increased in capability. AR has been used to improve a variety of floor-level operations,
including assembly, maintenance, product design, and other manufacturing phases. To
ensure the needs and safety of end users, numerous manufacturing processes need high
quality and almost zero error rates. AR can also provide operators with immersive interfaces
to increase productivity, accuracy, and autonomy in the quality sectors. The aim of this
paper is to conduct a literature review to draw a conclusion about the growing interest in
augmented reality (AR) as a key technology in industry 4.0.

Key words: Human-machine Interaction (HMI), Augmented Reality (AR), Industry 4.0

1. Introduction
Smart manufacturing also known as industry 4.0, is the new trend of automation and data
transparency in manufacturing technique. Technology equipped with computer software
programs are successfully used in this so-called smart manufacturing. It is difficult to
imagine product manufacturing without computer aided (CA) systems. With modern tools
integration the efficiency of production depends on real time communication between
individual and this modern tools. And this communication gap is filling by augmented reality
(AR) in present time. Augmented reality (AR) is a novel human-computer interaction tool
that overlays computer-generated information on the real scene. The information display
and image overlay are context-sensitive depending on the observed objects [1]. Moreover,
Augmented Reality (AR) is an Industry 4.0 tool currently attracting significant industrial
interest. It generates the addition of virtual information to the real ‘sensed’ environment
with the use of appropriate devices [2], supporting the user in performing his daily tasks
such as assembling parts to create a product [3]. Furthermore, this technical paper gives
detailed explanations of Augmented reality [AR] in the context of smart manufacturing.
Raj vaghani 224737 2

2. Augmented reality
AR can be defined as a technological system in which virtual objects are added to the real
world in real-time during the user’s experience [1]. An AR system has three following
principles; it combines real and virtual objects in a real environment; can run interactively
and in real-time; and register real and virtual objects with each other. AR experience can be
classified into two categories ‘marker-based AR’ and ‘marker-less AR.’ Marker in terms of
reference for dimension. Furthermore, AR needs a surface to projectile the experience and a
computer or mobile phone for processing graphics, images. In present, two-display AR
systems exist, a video see-through (VST) and an optical see-though (OST) AR systems [5].The
first method reveals virtual objects to the user by using a camera to capture real objects or
scenes and overlaying virtual objects on top of them while projecting them onto a video or
monitor, whereas the second method merges the virtual object on a transparent surface,
such as glasses, allowing the user to see the added elements. The primary distinction
between the two systems is latency: an OST system could take longer than a VST system to
show virtual objects, resulting in a delay between the user's performance and the system's
detection of it. In the end, objective of AR is to develop a system in which the user is unable
to distinguish between the real world and its virtual augmentation. The ultimate system
would make it seem to the user as though he is viewing a single real scene. The two ends of
this continuum are the real world and a completely virtual environment, with Mixed Reality
occupying the in-between space.

3. AR in manufacturing
There are several ways to categorize the contribution that AR can make to manufacturing
process, such as whether the user is provided with hardware devices rather than software
tools or the type of production environment, they are used in.

Recently, a publication suggested of an AR device category [8]. The following is an analysis of

that publication description:

• (HMD) a display device with a small optic display in front of each eye (or one eye) is
known as a head mounted display.
• A handheld device is an interactive gadget that has a display and a camera and can
be operated with just one hand; regular smartphones are excellent examples of this
type of device.
• Without the need for workers to carry devices, visual information can be displayed
on actual objects using projectors, such as laser or LCD/LED models.
• User tracking: Sensors and motion detection can be used to track a user's
movements, however due to the cumbersome gear these devices require the user to
wear, they are not frequently widely used in industrial applications. Additionally,
Raj vaghani 224737 3

connection with RFID would make it possible to facilitate more dynamic

communication between these AR systems.
• Force and haptic feedback: these two are types of wearable technology that give the
user feedback without requiring him to take his attention away from the work at
hand.

3.1. Use of AR in various production process

3.1.1 Prototyping: AR can be used for speed up the process of prototyping by allowing users
to view virtual model of prototype in real time and in present environment. Users can test
specific characteristics, such colour or user interfaces, on virtual items using augmented
reality. [9] suggested a system for the virtual generation of 3D models and an effortless way
to edit them. Designers can alter virtual prototypes using gestures with this AR system
because it contains a data gloves gesture interaction module that manages gesture inputs
and turns them into autonomous activities.

3.1.2 Assembly cycle and design: It takes optimization decisions to successfully implement
the work cycles and to make a certain item on an assembly line when they have been
defined. The effects of such decisions can be tested by designers using AR techniques in a
real-world setting. AR has been deeply studied to help users with assembly by offering
virtual instruction. Virtual instructions appeared in the user's field of view while wearing an
AR headset, and corresponding virtual CAD (Computer Aided Design) models were shown
around actual objects. The AR-based assembly process incorporated a variety of interaction
metaphors, such as a virtual interactive tool or bare hand for assembly assistance [11]. Each
of the construction modules was equipped with RFID technology, enabling real-time
tracking and monitoring for assembly guidance [10].

3.1.3 Production control and design: Simulation for CNC (Computer Numerical Control)
could be enhanced by AR applications. An important use of AR in this industry is the
opportunity to merge outcomes from CNC simulation tools with the expertise of human
operators in real time. By using AR techniques, the person driving the robot (for instance,
with joysticks) can examine additional information that will help him perform his duty more
effectively. To preview the robot's motions in accordance with the program that is being
built in a real environment, AR is also employed when programming the robot's movements.
An AR tool for the NC path validation and manipulation was proposed by [12], this tool
synchronizes the computer simulation with the actual real process, such as five-axis milling,
and gives the operator information and data that he can use to spot critical situations and
reset the estimated NC code.

3.1.4 Augmented Reality in Maintenace: Maintenance is a key area in manufacturing and

AR can be especially useful by providing Real-time performance data of any equipment to
Raj vaghani 224737 4

the end users, additionally it can provide information on human resource (HR) which include
availability, specialization area, training and much more. And, with step-by-step
maintenance instructions AR system can quickly identify maintenance needs. AR produce
timely access to potential failure data for the equipment which enables much farsighted and
anticipated maintenance system. AR gives benefits of effective training process which helps
user by providing more interactive environment.

Conclusion
In conclusion, the implementation of augmented reality (AR) in manufacturing technologies
can be improved to the required level. To achieve the best efficiency, productivity, and user
comfort, this field needs more study and testing. The user experience and hardware
dependence of conventional ways of presenting AR objects, such as LCD monitors or head-
mounted displays, are limited.

This study's major goal is to give readers an in-depth knowledge of AR systems and how
they might be used for assembly, maintenance, and production control tasks in the
manufacturing industry. Even though production control and management tasks are crucial
for satisfying client requirements. Therefore, resource utilization can be optimized by using
AR technology to cut down on human error and processing time.

Finally, there is a lot of potential for improving manufacturing processes, especially in the
design sector, with the ongoing development of AR technology combined with careful
assessment and analysis of numerous elements; utilizing the advantages of AR, such as less
errors, faster process times, and productive quality control, manufacturers may maximize
resource usage, boost productivity, and increase customer satisfaction.

References
[1]: (2001) Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., and B. MacIntyre.
“Recent advances in augmented reality,” IEEE vol. 21, no. 6, pp. 34-47

[2]: (2011) Carmigniani, J., Furht, B., Anisetti, M., Ceravolo, P., Damiani “Augmented reality
technologies, systems, and applications. Multimedia tools and applications,” 51(1), 341-377
Raj vaghani 224737 5

[3]: (2011) Furht, B. (Ed.). “Handbook of augmented reality.” Springer Science & Business
Media
[4]: (1992) Rosenberg, Louis B. "The Use of Virtual Fixtures as Perceptual Overlays to
Enhance Operator Performance in Remote Environments"
[5]: (2005) Botella C. M., Juan M. C., Baños R. M., Alcañiz M., Guillén V., Rey B. “Mixing
realities an application of augmented reality for the treatment of cockroach phobia” [Google
Scholar]

[6]: (2018) Pietro Cipresso, Irene Alice Chicchi Giglioli, Mariano Alcañiz Raya,and Giuseppe
Riva “The Past, Present, and Future of Virtual and Augmented Reality Research: A Network
and Cluster Analysis of the Literature”
[7]: (2013) Jozef Novak-Marcincin, Jozef Barna, Miroslav Janak, Ludmila Novakova-
Marcincinova “Augmented reality aided manufacturing” Procedia Computer Science Pages
23-31
[8]: (2012) Andrew Y C Nee, Andrew Y C Nee, George Chryssolouris “Augmented reality
applications in design and manufacturing”

[9]: (2011) Ng, L.X., Oon, S.W., Ong, S.K., Nee, A.Y.C. “A Gesture-based Augmented Reality
Design Evaluation System.” International Journal of Interactive Design and Manufacturing,
5(2),85–94

[10]: (2011) Zhang, S. Ong, A. Nee, “RFID-assisted assembly guidance system in an

augmented reality environment.” International Journal of Production Research 49 (13)
3919–3938.

[11]: (2016) X. Wang, S. Ong, A. Y.-C. Nee, “Multi-modal augmented-reality assembly

guidance based on bare-hand interface.” Advanced Engineering Informatics 30 (3) 406–421.

[12]: (2008) Weinert, K., Zabel, A., Ungemach, E., Odendahl, S. “Improved NC Path
Validation and Manipulation with Augmented Reality Methods.” Production Engineering,
2(4), 371–376.