You are on page 1of 11

Sensors International 3 (2022) 100132

Contents lists available at ScienceDirect

Sensors International
journal homepage: www.keaipublishing.com/en/journals/sensors-international

Exploring impact and features of machine vision for progressive industry


4.0 culture
Mohd Javaid a, *, Abid Haleem a, Ravi Pratap Singh b, Shanay Rab a, Rajiv Suman c
a
Department of Mechanical Engineering, Jamia Millia Islamia, New Delhi, India
b
Department of Industrial and Production Engineering, Dr B R Ambedkar National Institute of Technology, Jalandhar, Punjab, India
c
Department of Industrial & Production Engineering, G.B. Pant University of Agriculture & Technology, Pantnagar, Uttarakhand, India

A R T I C L E I N F O A B S T R A C T

Keywords: Machine Vision (MV), like other digital technologies, is a critical component of Industry 4.0. The high volume of
Machine vision data accessible by visual equipment can well quickly detect & flag faulty goods while recognising their defects,
Industry 4.0 thereby allowing rapid and efficient intervention in industry 4.0. The versions of MV are essential for efficient
Computer vision
production on a scale with applications in quality assurance, enforcement, and inventory management. The
Imaging
Inspection
removal of human error simultaneously minimises the probability of a mistake. This paper briefly discusses MV
and how it helps Industry 4.0. Various collaborative features and smart technologies of MV for Industry 4.0 are
diagrammatically presented. Further, the authors have identified and discussed twenty significant applications of
MV for Industry 4.0. In Industry 4.0 and associated digital industry transition, every step in the process, including
manufacturing, inventory control of the supply chain, and more, involves a different and innovative approach.
One of the aims is to develop MV capable of seeing, communicating, and working with more accuracy better than
human beings. Enabling robots to perceive and help people in dynamic systems provides the way for many op-
portunities. In the smart plant of the future, MV plays a significant role, in which automated production lines will
adapt themselves to optimise productivity, performance, and profitability.

1. Introduction to 'see' the world through the extraction, processing, and analysis of vi-
sual knowledge [1–3].
Today, Industry 4.0 is one of the most debated subjects in the MV system facilitates automated inspection and review of systems by
manufacturing world. Industry 4.0 refers to several new technologies that image processing, including automatic inspection, monitoring of pro-
can revolutionise manufacturing. These advanced technologies are ro- cesses, and robotic guidance. MV is a computational capacity applied in
botics, artificial intelligence, machine vision, big data, cloud computing, new ways for current technology to resolve real problems. MV is a field of
and machinery education. This fourth industrial revolution has an systems engineering that can be seen as different from computational
enormous capacity for enhancing sustainability, reducing pollution, vision. It is the system body, and computer vision is the system intellect,
improving the efficiency of the products, increasing production stability, like computer frameworks for what is inside, likes device chips powering
reducing running costs, and providing the plant with various other the computer. MV has now automated the log rotation operation, readily
benefits. Industry 4.0 creates a 'smart plant,' which uses data from the applicable for the industry [4,5]. The scanned information with the help
different sensors to improve processes. Machine vision (MV) belongs to a of this technology is analysed to maximise the performance, which is
dynamic smart production strategy, allowing computers and machinery historically based exclusively on human evaluation. The application of

* Corresponding author.
E-mail addresses: mjavaid@jmi.ac.in (M. Javaid), ahaleem@jmi.ac.in (A. Haleem), singhrp@nitj.ac.in (R.P. Singh), shanayrab753@gmail.com (S. Rab), raje.
suman@gmail.com (R. Suman).

Production and hosting by Elsevier

https://doi.org/10.1016/j.sintl.2021.100132
Received 29 August 2021; Received in revised form 30 October 2021; Accepted 30 October 2021
Available online 6 November 2021
2666-3511/© 2021 The Authors. Publishing services by Elsevier B.V. on behalf of KeAi Communications Co. Ltd. This is an open access article under the CC BY license
(http://creativecommons.org/licenses/by/4.0/).
M. Javaid et al. Sensors International 3 (2022) 100132

high-speed vision technologies automatically detects off-size plates, material inspection, object recognition, pattern recognition, electronic
maintaining consistent production and eliminating additional material component analysis, signature recognition, optical character recognition,
waste. The machine vision allows a company to reap the durable benefits and money recognition. It aims to find new ways to combine existing
of increased manufacturing accuracy [6–8]. technology and apply them to real-world problems [19,20]. The term is
MVs techniques are interdisciplinary as it uses cameras, sensors and most typically associated with these skills in industrial automation,
computing power to interpret pictures and enable machines to complete although it is also used in other contexts such as security and vehicle
industrial tasks, such as production and verification of quality. For In- navigation. The MV process begins with a detailed analysis of the needs
dustry 4.0, MV is an essential component that supports industrial auto- and project, developing a solution. The procedure starts with imaging
mation technologies in several respects, such as performance and then automatic picture analysis and information extraction [21,22].
improvement through stock improvement and defective component Fig. 1 shows the steps of the MV process system.
detection and product quality improvement. This is helpful for imaging Any case of any visual system's sensitivity and resolution are two
automated inspection and analysis for such applications as automated critical criteria. The ability of a machine to see in dim light or detect weak
inspection, process control, and robot guidance. This technology is impulses at infrared wavelengths is referred to as sensitivity. A machine's
beneficial to reduce labour costs [9,10]. In addition to decreased labour resolution refers to its capacity to discriminate between objects. In gen-
costs, errors or deviations from expectations are made less space, which eral, the smaller the field of vision becomes as the resolution increases.
improves overall product consistency and reduces waste. The actual uses The terms sensitivity and resolution are interchangeable. Raising sensi-
are almost unlimited in production, which can maximise operations, ef- tivity lowers resolution, while increasing resolution raises sensitivity,
ficiency, and revenues. assuming all other factors remain constant [23,24].
A computer viewing system includes applications for viewing the data Although different forms of computer vision have been used for many
and seeing what the cameras are ‘searching for’ to analyse, maintain and decades, recent machine learning and image processing developments
program the hardware. Different software is available to balance the MVs have enabled new production cases. AI-supported computer vision sys-
framework. Machine learning will teach technology to identify various tems can operate in increasingly diverse contexts, no longer restricted to
borders used to sort the objects in the process line. The device will spot, organised and routine activities. This works continuously with operators
fit and count patterns on the process line employing pattern recognition. to improve efficiency, decrease mistakes and improve data. When
Different patterns or more complicated patterns may be taught to the dynamically embedded in the intelligent plant, computer vision systems
computer through a simulator through profound experience. It helps enhance visual and human output online. The continuous insight of real-
them to understand an object more correctly, put an item more accu- time into processes is one of the claims of computer vision. In the context
rately and perform complicated activities such as inspections more of data from computers and other, non-visual operator data obtained by a
quickly [11–13]. computer vision system becomes more important. MV sends signals to
MVs are used for automated machine control in the manufacturing respond to the behaviour of an operator and affects them in real-time. It is
industries. It requires computer vision for processing and understanding a crucial part of the modern factory in its present condition [25–27].
images. Computer vision operates on the algorithms which recognise the MV defines many techniques for obtaining visual data from hardware
visual flaw and comprise the whole system to eliminate defects. The and processing and analysing information in its most broad terms.
image can be easily captured by optical sensors, digital cameras, and Modern computer vision solutions are versatile, unlike existing systems.
ultraviolet cameras. The hardware captures the picture and makes it These modern technologies have enhanced their ability to perform in half
visible. The hardware can analyse digital data via image processing al- and unstructured scenarios rather than handling structured information
gorithms. The computer is directed to take the appropriate action based in managed settings. In Industry 4.0, MV technologies can work with and
on knowledge obtained in the previous process [14,15]. This paper respond to operators and allow for new ways of contact between digital
provides an overview of MV in the context of Industry 4.0. and human beings [28,29].
MV use of evolving technology such as AI and deep learning, along
2. Research objectives with advanced data analytics, is bringing about a short revolution. MV
systems become quickly to meet and often even exceed market specifi-
Industry 4.0 technologies aim to improve manufacturing processes cations. The systems are matching ever-increasing rates of demand
through computer technology which helps to improve automation and quicker and more affordable at the same time. MV play options are much
productivity. MV technology also allows factories to function quicker and more intuitive and simpler to use [30,31]. It gains information to cope
better in the manufacturing process and increase the demand for vision with manufacturing cycles and other process variations across new
systems for machines. It allows for a higher automation rate and enhanced technologies. In the assembly line, the advantages of sophisticated MV
vision systems, which enable the robots to occupy a more significant part are enormous. Modern computer vision can accelerate processes of pro-
of the industrial job. Predictive maintenance systems may be triggered by duction and inspection to frame rates. Robots may depend on explicit
visual evidence. These systems rely more on sensors like heat and vibra- imagery to distinguish the sharpest differences in picking and sorting
tion detectors. Software for image processing is running on hardware that components [32,33].
determines image processing speed [16–18]. The required rate depends
on the application case and minimising hardware costs at the correct 4. How machine vision helps industry 4.0?
speed. The primary research objectives of this article are as under:
RO1: - To brief about Machine Vision and its working steps; Industrial revolutions have shaped the society we live in and the way
RO2: - to discuss how Machine Vision helps Industry 4.0; we make items throughout history. Water and steam-powered machines
RO3: - to discuss collaborative features and smart technologies for were introduced during the 1st industrial revolution, allowing for the
practising Machine Vision in Industry 4.0; widespread production of commodities. The 2nd revolution was distin-
RO4: - to identify and discuss significant applications of Machine guished by the use of electricity to power production lines and increase
Vision in Industry 4.0 culture; operating hours. The 3rd industrial revolution saw the development of
electronics, computers, and Programmable Logic Controllers (PLCs),
3. What is machine vision? which led to the automation of production lines and processes. Cyber-
physical systems enhance factory automation with better data and ma-
Machine vision is a term used in industry to describe the technology chine learning in the 4th industrial revolution, known as Industry 4.0
and methodologies utilised to deliver imaging-based autonomous in- [34–36]. Fig. 2 shows some of the major components of Industry 4.0 in
spection and analysis for applications. MV is used in the industry for developing a Smart factory.

2
M. Javaid et al. Sensors International 3 (2022) 100132

Fig. 1. Working steps of machine vision system.

Fig. 2. Industry 4.0 Smart factory components.

MV technology is critical in collecting the physical world and trans- MV also complements IoT automation technology. Robotics inspec-
ferring it into networked, digital data, as Industry 4.0 predicts a higher tion stations can operate faster than employees and automatically, as
dependence on machine learning. This data may be evaluated and pro- faults and exceptions are easily identified. Management structures con-
cessed in real-time to raise operational efficiency, maintain quality structed with MV show greater mobility and travel capability for robots
standards, and reduce waste, allowing firms to improve productivity, and cobots and assist them at working with human staff more quickly and
maintain quality standards, and reduce waste in a continuous develop- efficiently. MV allows robotics in warehouses and other settings with a
ment cycle. In fact, after investing in smart factory projects, organisations high probability of error to increase response time and limit defects
report increases of up to 12% in areas like manufacturing production, which lead to a company loss [42,43].
factory utilisation, and labour productivity [37,38]. A significant time for technical progress is the explosion of the In-
Machines are connected in Industry 4.0 to establish an ecosystem dustrial Internet of Things (IIoT). The IIoT offers companies an extraor-
known as the Internet of Things (IoT). The integration of MV with dinary view from top to bottom of their activities. Cloud-based sensors
automation systems improves the quality and amount of data collected, and hubs for resource planning provide two-way data mobility from local
allowing the smart factory to become a reality. This extra information is and remote assets to business partners. MV increases the power and us-
used in applications to ensure quality, reduce waste, and improve safety ability of sensors around the IoT [44,45]. The sensors have a degree of
while increasing production speed. MV is a developing market expected analysis and abstraction that can be used in decision-making or further
to grow in the long run and has a promising future because of its ease of automation rather than supplying brute data. MV can help minimise
use, and new non-industrial uses are emerging. Industries that have broad-scale IoT accumulation needs for bandwidth. Usually, machine
already adopted MV are reaping the benefits of increased profit margins, view testing is performed at the data source, compared with collecting
while non-adopter competitors are lagging [39–41]. photographs and data and sending them to analytical Servers [46,47].

3
M. Javaid et al. Sensors International 3 (2022) 100132

5. Collaborative Features of Machine Vision for industry 4.0 manufacturing that eliminates pollution and reduces global demand. The
digital copy generated by the smart scanner is used by an automated
Literature reports classical features of MV and investigations for its device to perform simulations to establish the maximum use of the
application in the environment of Industry 4.0. Fig. 3 explores those content. MV can extract the cumulative data over time for process
appreciable and fundamental features of the MV concept graphically. The monitoring [62–64].
features like barcoding reading, detection of defects, traceability, soring MV contributes significantly to the manufacturing sector by providing
process, optical verification, vision robotics, etc., further made the ap- automatic inspection capacity under quality control procedures. A good
plications of MV in Industry 4.0 more decent and adequate. As mentioned practice is a visual inspection on a production line or packing line [65,
earlier, the overall impact of the features is to improve the practice of the 66]. Smart cameras perform inspection tasks and deliver a pass/fail result
MV culture in the Industry 4.0 scenario [48–50]. to the control system, to computer-based systems of multiple cameras. In
Industrial revolutions have transformed the world where manufac- combination with the predictive process management techniques, vision
turers can produce products throughout human history [51,52]. The best inspections should also be used to track important metrics and analyse
methods for computer vision work with operators to make them more patterns in these measures [67–69].
efficient and reliable. Computer vision systems should be integrated into Technology has a significant influence in any step of the production
the activities of a manufacturer to identify any move in a process that chain, from machine vision in warehouses to advanced robotics in
guides an operator through complicated job orders [53–55]. As corpo- research and development laboratories. The developments in
rations aim to improve efficiency and quality management, more com- manufacturing have contributed to reducing manufacturing errors,
panies are searching to reduce unplanned downtime. Increasing improvement in product efficiency, increased versatility, reduced time
dependency on machine learning means that machine vision technology and costs, and increased productivity [70,71]. It is essential to optimise
plays an integral role in collecting and converting the real world into the process with extensive data analysis based on input from several
networked digital data [56–58]. These data can be analysed and stored in different kinds of process monitoring sensors in the smart factory of the
real-time for productivity enhancement, quality levels maintained and future. These include primary and intelligent vision sensors, as well as
waste reduction, enabling companies to increase operating performance more advanced vision subsystems or systems. MV has become the most
in a period of constant improvement. Industries open up possibilities for a common and benefited industry during the last decade, particularly in
higher profit margin as their non-adopted counterparts lag. It can help the manufacturing sector [72–74].
quality control in-line by providing supervision at the process level as the MV allows computers to distinguish objects, interpret real-life scenes
operator functions. Some programs can also track and identify operators' and events. Deep learning is often aided by other methods that improve
actions over time, enabling engineers to gain more visibility [59–61]. its usefulness in some contexts. In other words, cameras can see and
This technology enhances 3D scanner capabilities, which uses lasers inform people about fire observed or quality problems diagnosed in
to trace the object's surface and digitalise it in a dot cloud representing its manufacturing lines, count items on conveyor belts, examine medical
3D copy. This data stream is often forwarded downstream to a device for photographs, observe structures and inspect building environments [75,
analysis. Companies that are implementing robotic control MV can see 76]. In automated production, image processing systems built around
their productivity, reliability, and output rise exponentially. It certainly industrial cameras are now an essential component. Industrial vision
facilitates the development of demand for their customers and new cameras are used in all sectors and are an integral component of ensuring
sources of income for themselves. When companies grow more dynamic, reliability and high-quality performance in the entire manufacturing
resource control is interlinked more directly with the viability of an process, from testing of raw materials and control of production to final
organisation. The use of MV in many sectors enables more accurate inspections and quality assurance. Image capture and analysis is crucial

Fig. 3. Collaborative Features of Machine Vision for implementing Industry 4.0.

4
M. Javaid et al. Sensors International 3 (2022) 100132

factor in collecting the required information for Industry 4.0. Along with inspection, object identification, pattern recognition, and electronic ex-
increasing networking capacities, machine vision imaging systems open amination of components, along with signature recognition, operating
up various new technologies and develop Industry 4.0 [77–89]. characteristics, and currency. The view of the machine is generally
MV is an automation device where a camera is used to record any connected to the visibility of a screen. The term computer vision is
action on a mounting line. The camera is designed in this situation to applied to the technologies used to digitise an image, manipulate the data
determine the object's height, form, and colour. When implemented and perform various operations on a computer. A framework for viewing
strategically in the smart factory, MV systems are most effective as it a machine uses a robot sensor to display an object via a screen [91–93].
improves human and digital performance. The task of barcode scanners is The industrial view of machines means low cost, reasonable accuracy,
crucial in production. Barcode scanners have replaced the old paper and high robustness, high mechanical reliability, and consistency in tem-
pencil sorting approach. Since introducing barcode scanners, manufac- perature. Vision machine systems depend on digital sensors shielded by
turers have had various advantages, from smooth operations to reduced specialist optics in industrial cameras for computer hardware and soft-
time and costs to minimal errors to lowered stress levels [81–83]. ware to store, interpret, and calculate different decision-making char-
acteristics. It uses cameras, typically in commercial or manufacturing
6. Smart technologies for practising Machine Vision in Industry environments, to inspect and interpret objects automatically. The data
4.0 environment collected will then be used to monitor a method or production process.
The camera may be coded to verify whether or not the object's location,
Fig. 4 exemplifies the numerous intelligent and advanced technolo- colour, size, or form is present [94,95].
gies and theories proposed under MV for its proper realisation in Industry MV is becoming increasingly common in industrial automation en-
4.0 environment. It denotes several tact and traits, namely as; digital vironments and more widely employed in other industries, such as
electronics, lighting science, theory of sensors, system engineering, in- defence, autonomous vehicular, food processing, packaging, logistics,
dustrial and mechanical engineering, concepts of optics, throughout the and robotics and drones. Computer vision can be combined with tech-
control of the quality, etc. to overall enhance the practicality of machine nology, such as deep learning and machine education, to understand data
vision through its implementation and realisation in the culture of in- better and optimise business performance [12,18]. MV has gathered
dustry 4.0 [84–86]. different meanings for what it is and how it does. Note that vision by
In the industrial sector, new-age innovations have always been at the computer is not related to image processing, which is a method in which
foremost. Thus, manufacturers innovate and revolutionise many activ- the result is an image [96–98]. Thus, to understand the information
ities leveraging new technological innovations in production. Similarly, captured in the machine view, the identification, location, and guidance
in manufacturing, machine vision technologies address big problems of the subjects captured by the machine view system are interpreted as a
facing businesses, helping them achieve benefits like greater yields, type of data. The technology can be used with a sensor that colours the
better quality of performance, and lower financial costs [87,88]. The images and when objects are inspected and sorted [99,100].
rendering of images in 3D has continuously expanded by computer vision In order to retrieve the necessary information and decide what to do
technologies. Various modules have expanded in recent years, and these with the image, machine vision applications and programs would then
components are increasingly sophisticated and tailored for specialised use different processing methods. This usually involves sending the pic-
applications, including robot guidance, high-speed imagery, and surface ture to the next phase, routing it to a separate process, or deleting the
profiling [89,90]. object from the output or delivery chain. The approach is programmed to
In contrast to traditional vision techniques used before, where a user adapt depending on the role and use of these technologies in the system
manually intervened in the definition and test of individual models and and on the type of equipment the vision system will require. Specific
functions, machine vision is more sophisticated and efficient. Machine devices only need a few components, while others need many parts of the
vision is used in a range of manufacturing procedures, such as content same component in the production line or device [101,102].

Fig. 4. Illustration of machine vision technologies for industry 4.0.

5
M. Javaid et al. Sensors International 3 (2022) 100132

Table 1
Machine vision applications in industry 4.0
S Applications Description
No

1 Inspection Instead of human inspectors, several factories use MV because it is ideally suited to repeated inspection activities. It is quicker, more
objective, and continually functioning. MV systems can inspect thousands of parts per minute and more accurately and precisely provide
inspection results than humans. Manufacturers can save money and raise profits by cutting errors, increasing returns, enabling compliance
with regulations, and monitoring MV parts. MV may use Colour sensing pixels for machine vision, and sometimes pixel arrays are even more
prominent. In order to determine the dimensions, locations of the border, motion and relative position of components, software tools are
applied to the captured images. Many different ways to add lighting to the picture are available. When creating a computer viewing system,
the direction the light comes from, its magnitude, and wavelength relative to the target colour are all essential factors.
2 Increase data collection Combining MV with automation systems increases data collection efficiency and quantity and makes the intelligent plant possible. These
efficiency additional data are used in applications for quality assurance, waste minimisation, and protection at the more incredible output speed. For
the company's image and financial performance, the production of a reliable product satisfies the specifications of its customers. The
incorporation of MV to distinguish differences in production in real-time is improved in the era of Industry 4.0.
3 Quality improvement The 3D scanner watches products constantly during development and avoids wasting whole batches as a practice instead of waiting for
manual batches to be tested or examined. Many companies now incorporate 3D quality improvement computer vision. 3D scanners provide
precise product dimensions at each point in plants that produce products with complex dimensions, such as paver blocks, wood and tube
pipework. The operator will get instant notifications and shut down the manufacturing line, as can unacceptably differences in product
measurements.
4 Share of useful information MV continues to enhance the sharing of accurate and helpful information with the material processing devices, production lines, and
inspection stations. A manufacturing environment ensures that equipment and humans perform well with fewer bottlenecks, overruns, and
more disturbances. Human beings and machines work together on the production of an automobile component in order to obtain raw
materials, evaluate their content, transfer them to a processing plant and pass them through the production point. It enhances productivity in
any department, such as installation, and ensures consistent higher output standards.
5 Quality testing MV is gaining interest in automating quality testing. It helps employers simplify and boost outcomes from the quality assurance process in
certain modern production conditions, even without losing human employment. This digital test stations address high-priority work whilst
workers learn more demanding skills from their cognitive point of view. In industrial manufacturing, this is attributed to changes in the
vision of the computer and the desire to avoid inefficiency, inaccuracy, and waste as much as possible from industrial manufacturing.
6 Intelligent production The role of MV in industrial automation and intelligent production is revolutionised by deep learning. Integrating deep learning has made it
possible to adapt machine vision applications to production variations autonomously. The value proposition for the view of the computer has
been significantly increased by improved operating efficiency, speeding the inspection process, and increasing reliability. MV integrates
machine learning in several instruments with unparalleled ability to observe and view consumer and industrial hardware surroundings. The
technology, along with robotics and high-speed networking, in an industrial context leads to Industry 4.0. This delivers new methods of
conducting low-waste manufacturing operations with high performance.
7 Simplify certain processes MV is a superior technology that helps manufacturers simplify specific processes where many products need to be tested on a production line.
Most producers rely on an exceptional quality for their output, and thus, it is essential to have a mechanism that automatically identifies any
variations. The most general use of MV systems is applied for tooling and details placement on the production lines. The machine determines
exactly where an entity or instrument has been located and sends these coordinates to the robot. It is typically used for application selection
and placement. Identifying abnormalities is used to study new photographs and equate them to existing data sets to identify defects in
production facilities, production lines, etc., and avoid harmful conditions.
8 Die-cutting The manufacturing industry can implement MV systems to do rotary die cutting as accurately as laser cutting to cut any pattern. The device
would direct the die-cutting mechanism to perform cutting into the computer vision system correctly. Some production processes take place
in critical temperatures, so material deterioration is normal. Constant equipment inspection is carried out manually by the manufacturers.
However, computer programs will track the equipment continuously using different metrics. If the deviation from the metrics indicates
corrosion, the respective managers will warn the computer vision systems to conduct maintenance proactively.
9 Quality assurance The quality assurance of machinery with vision ensures the precision and quality of produce, reducing operating losses from waste materials,
are met every time. A manufacturing line has traditionally involved human involvement and assessment of crucial stages. The beginning of
Industry 4.0 provides an integrated approach that allows computers to decide on the data collected from the 3D scanner with the assistance of
machine vision. The effect is an intelligent and cleaner farm, which reduces the consumption of labour and increases production.
10 Control employee movement Industries employees operate in challenging circumstances, which mean that the risk of injuries is even greater. The production facilities
must comply with safety requirements implemented by regulatory bodies. Firms that do not comply with these standards must face sanctions
even though manufacturers have mounted cameras to control employees' movement inside the plant to maintain safe conditions. The manual
procedures may be mistaken, and this may have severe effects. A computer view controlled by AI can be a suitable solution. MV technology
watches the production site continuously from the entrance, in the site, and the exit.
11 Supervision The MV system will alert supervisors and personnel to the occurrence and injury intensity of an ongoing accident to stop development in that
particular field and proactively guarantee the welfare of workers. It is necessary to count the number of fabricated parts before being
packaged in a container in some manufacturing firms. Another use case for machine vision inspects the damages to the box itself when the
products are correctly packaged. Items can go safely only once in a while to consumers. Before exiting the factory, computer vision devices
will proactively diversion any faulty packaging. Barcode authentication is another significant factor in which most goods are subject to
barcodes. The packaging department reviews the accuracy and reading of written barcodes.
12 Barcode checking Cross-checking bar codes for thousands of items require much manual time and are inefficient and error-prone. MV devices can quickly check
barcodes and identify defective barcodes. This system can help to count stocks, retain warehouse inventory status and automate and warn
management. The MV systems can prevent errors in inventory counting. This solution can help inventory managers identify warehouse items
by using computer vision technology based on barcode data.
13 Minimise production faults MV applications allow businesses to increase the quality of their goods, minimise production faults, reduce production costs and meet
customer demands with products of the highest quality at a reasonable rate. The fundamentals of MV software and interpreting the industrial
barcode will help to ease inspections, maximise read speeds, and make the production line's results more accurate and repeatable. In the
advancement of industrial robotics, MV has played a vital role, and the two are rapidly combined. MV enables a robot to see in a way what it
is doing. This technology helps a robot adapt to challenges in its world by realising which tasks it has to complete.
14 Identify defects The manufacturer can identify defects and fractures in a physical object through MV systems. In addition, these devices can accurately verify
exact and reliable measurements of materials and components. MV devices take commodity and goods pictures. These images are then sent to
a computing computer. The staff concerned receives information on any errors. In order to satisfy the consumer, producers are capable of
implementing electronic inventory testing machines and accurate quality management.
15 Tracking and reporting This technology is also suitable for tracking and reporting. The high dynamic range of the vision sensor permits service in challenging
lighting conditions while providing far less data than a conventional framework-based solution and reduces the computational burden of
scene analysis. MV automatically analyses and inspects manufacturing lines using imagery, which is used to track processes, check,
(continued on next page)

6
M. Javaid et al. Sensors International 3 (2022) 100132

Table 1 (continued )
S Applications Description
No

estimation, robot guidance and other functions. It requires a complete approach from image acquisition to a management data system
interaction.
16 Monitor devices The MV system automatically acquires an image to provide desired information and monitor devices or systems according to industry
requirements. It is an automated method by which quality management information is retrieval from digital pictures. Most factories are best
suited to repeated check activities with automatic MV instead of human inspectors. It is quicker, more objective, and continually functioning.
MV extends to all systems where computers are operationally driven by a mixture of hardware and software when executing the tasks
dependent on image capturing and processing.
17 Visually recognise pictures MV provides robots with the ability to visually recognise pictures and capture and take decisions the same way humans do. These
progressions have made it possible for a machine vision to automatically identify specific patterns in various images and execute the action
needed. Machine vision is one of AI's primary industries that seek to have computers that have a human-like vision capability to capture,
recognise, and decision-making images as in the real world. These progressions have made it possible for a machine vision to automatically
identify specific patterns in various images and execute the action needed.
18 Robotics and production lines MV is commonly accepted for use in robotics and production lines. The use of this technology reduces the role of humans in different
procedures. Implementing MV in collaboration with other technologies like conveyors may insert them into a dangerous environment or in
clean rooms that could contaminate humans. The vision systems will increase production efficiency due to human errors and maintain the
quality control of all goods along the chain. Machine visioning device uses algorithms to classify programmed features that also trigger a
series of actions depending on the results.
19 Monitoring and controlling MV devices have many other uses in addition to content inspection. These devices are also used to monitor and control visual stock, such as
visual stock reading and counting barcodes and testing components at different points in industrial production. A robot viewing device consists of various
important elements, including a camera capturing an image, which supplies and communicates the result to the processing mechanism. It is
vital how these fundamental components combine to make every machine vision device reliable and deliver results.
20 View complex design In the automotive sector, as the industry is gradually changing from product standardisation to product specialisation, machine vision is
likely to increase. A typical computer viewing system is complex to design as several industrial sectors cover, and criteria are different
depending on consumer requirements. The demand for machine vision is divided into a general vision based on implementation. Robots can
accommodate a growing range of product variations as part styles can be modified by simply modifying the control and program without
stopping the development process.

Vision by the computer is a skill and not an enterprise like other skills 7. Machine vision applications for industry 4.0
like learning by machine, deep learning, and neural networks. It is a
capability that can be embedded with other systems and processes to MV is helpful for image-based automatic inspection. Its applications
enhance market performance and support the industry. As companies have become essential in Industry 4.0 and continue to evolve in various
gradually strive to simplify business operations through the adoption of sectors. The Vision of machines is presently used in many fields,
automation capabilities such as computer vision and robotics, the ap- including automobile, pharmacy, military, food and drink, electronics,
plications of MV are rising and are never going to slow down. Automation etc. MV uses include fault detection, an inspection of product and
and robotics exhibit real strength and capacity because companies cannot packaging, recognition and monitoring of parts, and measurement
satisfy decreased labour demands of industry and consumers [103,104]. [114–116]. These technologies improve efficiency, greater productivity,
In the manufacturing sector, MV has become critical. The need for MV a decreased footprint, and low manufacturing costs. During the predic-
technology is crucial for increased quality control requirements. MV tion era, the automotive sector holds the biggest MV markets. The MV
builds on technologies and expertise in automatic camera inspection and technology in the automotive industry offers increased precision in
testing for applications such as measurement, text interpreting, process crucial operations, including the placement of pieces for assembly, such
control, and robot guidelines. The vision system can consist of several as doors and panels. Due to the lack of skilled workers and the reduction
sensors, often installed over an assembly line, inspecting products, in automotive manufacturing costs, automotive industries are more
recording data, reading labels, direct products and more [105–107]. focused on automating their manufacturing processes. Therefore, the
Due to the growing quality demands of manufacturers and con- automobile industry will hold the most significant demand in the future
sumers, machine vision has become a core technology in production and for MV [117–120]. Table 1 discusses the significant applications of ma-
quality control. To visually inspect objects, translate products, and con- chine vision for Industry 4.0.
trol robots in real-time, MV uses industrial imaging with cameras MV will be everywhere shortly, bringing to the Internet of things in
installed over manufacturing lines and cells. The technology of MV has a Industry 4.0. The vision of the computer is a series of innovations that
significant effect on the manufacturing sector and industry. With the enable machines to become more aware of their environment. It makes it
latest wave of digitalisation entering the market, this technology is easier to recognise and make decisions dependent on knowledge of im-
supposed to offer businesses even greater hope. In the context of indus- ages [121–125]. Industrial equipment uses highly faithful cameras to
trial production operations, the emphasis of MV is mainly on computer capture digital environmental and workpiece pictures that utilise com-
vision or by inspection or other sensitive control inputs [108,109]. puter vision. The pictures can be taken on a robot inspection station and
The ability to do an imaging examination on equipment is usually an an autonomous led vehicle. MV uses incredibly advanced model recog-
MV. It allows industrial machinery to perform activities such as pro- nition algorithms to evaluate its location. Part of the barcode is shaded;
duction and quality control. This technology is a core factor of Industry reading can cause an error when unavailable or vice versa. The required
4.0 and supports industrial automation systems by performance lighting is crucial for correct MV when manual inspections are carried out
improvement, inventory improvement, and product identification, and [126–129].
finally, quality improvement [110,111]. This technology supports many MV provides primary importance to producers for better protection to
new developments, such as artificial intelligence, robots, and clever staff and safeguards the environment. Production organisations improve
brass. As a transformation technology, MV in the supply chain provides and offer the best available support in terms of safety programs. Not only
reliable, automatic logistic control of the outputs. Zero shipping errors can MV help manufacturers simplify the production operation, but also
and maximises workflow productivity by automated data acquisition increase employee safety. These devices can collect photos from the plant
reduce operating costs and improve profitability. While the exposure of with real-time image processing. This results in helpful knowledge about
the supply chain is constant, the MV methods will be used by producers when employees are in life-threatening and dangerous conditions. MV
and shipping firms for the next few years [112,113]. devices would inform the concerned about the hazardous site situation to

7
M. Javaid et al. Sensors International 3 (2022) 100132

take the precautions required in due course. The vision systems for ma- and Industry 4.0. In the coming years, this will further guarantee future
chinery will thus help manufacturing industries predict environmental economic prosperity and peace. Computer vision integrates machine
threats or risks in due course, avoiding potential malfunctions learning in several instruments that have unparalleled ability to observe
[130–132]. and view their surroundings for consumer and industrial hardware.
These developments, along with robotics and high-speed networking, are
8. Discussion added to a modern technological revolution in the context of industry
4.0. This also delivers brand new methods of conducting low-waste
The MV technology takes multiple images from different angles to manufacturing operations with high performance. The vision of the
provide a 3D rendering as components pass around the production plant. machine affects output, perforation, and mining. It includes freight and
These identify any defective threading or slight deviation from the supply chain management, quality management, materials handling,
specification when paired with and fed into AI algorithms. This tech- protection, and a range of other processes.
nology is highly credible in manufacturing sectors such as automobiles,
electrical circuits, oil, gas, energy, etc. It offers operators and engineers a 10. Conclusion
tool for improved data collection, empowering operators and bug-
resistant assemblies. As part of Industry 4.0, the manufacturing in- MV is the approach of industrial automation and related technology.
dustry has adopted different automation technologies. The automotive It can be implemented for automated visual inspection, which can
sector uses numerous emerging technologies such as artificial intelli- overcome several business problems. The technology of machine vision
gence, machine learning, the internet of objects, computer vision, ro- replaced human quality checks steadily. It offers different precision and
botics, etc., to modify the production of goods as part of industrial durability in the identification of objects. MV is beneficial for Industry
automation. 4.0 to improve accuracy, productivity, and overall efficiency to increase
In the product and component assembly in the production area, MV the traceability of their goods. Here industrial equipment uses highly
systems play a significant role. Much of the automotive industry has faithful cameras to capture digital environmental pictures or a workpiece
implemented MV for fully integrated product assembly and management to utilise a computer vision system. Thus, MV, particularly in the
processes as part of the transformation of Industry 4.0. The computer's manufacturing sector, has gained immense prominence. Manufacturing
vision system precisely controls the mounting process based on designs. companies can take advantage of greater versatility, reduced product
These systems track robotic arms and staff in the assembly line and direct errors, and improved overall technological efficiency. When manufac-
them continuously. The computer-driven vision program compiles in- turers deal with the production of large-scale products, many primary
formation from cameras and uses machine learning techniques, analyses machines and heavy equipment are used. In order to prevent equipment
data sources and identifies faults, and provides the proportion of de- downtime, certain pieces of equipment are tracked constantly. MV is
viations based on predefined quality specifications. This data can be used beneficial for freight, supply chain, quality assurance, inventory pro-
to trace reverses in manufacturing line processes. In a manufacturing cessing, safety, and a range of other vertical procedures, and soon, it will
line, a machine vision inspection device is used to carry out human tasks. be everywhere in production.
In this case, a complete 3D model of modules and connector pins are
constructed using a high-resolution image framework. Declaration of competing interest
For some time now, robots have become part of the production in-
dustry. AI and computer vision technologies are used to control robots. None.
Robots can take pictures of all machinery quickly. The pictures and any
additional equipment information are then sent to the cloud to analyse References
and sort. The data will allow producers to obtain valuable information on
whether or not this particular device will malfunction. To improve [1] D.P. Penumuru, S. Muthuswamy, P. Karumbu, Identification and classification of
customer loyalty, suppliers must provide their customers with the best materials using machine vision and machine learning in the context of industry
4.0, J. Intell. Manuf. 31 (5) (2020) 1229–1241.
quality goods. It is possible for an MV to automatically identify specific
[2] R.L. Silva, O. Canciglieri Junior, M. Rudek, A road map for planning-deploying
patterns in various images and execute the action needed. machine vision artifacts in the context of industry 4.0, J. Ind. Prod. Eng. (2021)
Modern MV technologies are essential to automation and quality 1–14.
assurance in the automobile industry. That is why longevity and ease of [3] A. Varshney, N. Garg, K.S. Nagla, et al., Challenges in sensors technology for
industry 4.0 for futuristic metrological applications, MAPAN 36 (2021) 215–226,
service are of particular significance. Systems also have to be easily in- https://doi.org/10.1007/s12647-021-00453-1.
tegrated into battery production because of short rise times. Combined [4] K.N. Joshi, B.T. Patil, H.B. Vaishnav, Principal components based multivariate
with machine learning, MV technology and robotics deliver various new statistical process monitoring of machining process using machine vision
approach, in: New Paradigm of Industry 4.0, Springer, Cham, 2020, pp. 145–160.
opportunities for realising state-of-the-art ideas like the smart factory. [5] R. Kumar, O. Patil, K. Nath, K.S. Sangwan, R. Kumar, A machine vision-based
MV applies basically to picture-based technologies used in automotive cyber-physical production system for energy efficiency and enhanced teaching-
and manufacturing applications, including recognition, inspection, sort- learning using a learning factory, Procedia CIRP 98 (2021) 424–429.
[6] J. Chen, J. Zhou, Revisiting industry 4.0 with a case study, in: 2018 IEEE
ing, and measurement. It is also used for robotics guidance. The scope for International Conference on Internet of Things (iThings) and IEEE Green
inspection in computer vision grows exponentially because of advances Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social
in deep learning techniques. Machine vision can now perform hard or Computing (CPSCom) and IEEE Smart Data (SmartData), IEEE, 2018, July,
pp. 1928–1932.
impossible tasks to execute a few years ago based on state-of-the-art [7] J.A. Saucedo-Martínez, M. Perez-Lara, J.A. Marmolejo-Saucedo, T.E. Salais-Fierro,
guidelines. P. Vasant, Industry 4.0 framework for management and operations: a review,
J. Ambient Intell. Humanized Comput. 9 (3) (2018) 789–801.
[8] C. Yates, Industry 4.0 and AI to shape vision market: newly elected EMVA
9. Future of machine vision president Chris Yates considers what the future might hold for machine vision,
Imag. Mach. Vision Europe 98 (98) (2020) 20–22.
MV in manufacturing will be a very multifaceted technical stack like [9] T.A. Strelkova, A.P. Lytyuga, A.S. Kalmykov, Statistical characteristics of optical
signals and images in machine vision systems, in: Examining Optoelectronics in
any technological approach. This segment will examine some of the most
Machine Vision and Applications in Industry 4.0, IGI Global, 2021, pp. 134–162.
commonly used powered software. It has a library of functions and al- 
[10] A. Moreno, G. Velez, A. Ardanza, I. Barandiaran, A.R. de Infante, R. Chopitea,
gorithms that will allow users to read images, pre-set the camera to Virtualisation process of a sheet metal punching machine within the Industry 4.0
normal, reduce optical distortions, and measure the motion of an object. vision, Int. J. Interact. Des. Manuf. 11 (2) (2017) 365–373.
[11] G. Genta, G. Maculotti, Uncertainty evaluation of small wear measurements on
Industries that give automation preferences are gaining strategic complex technological surfaces by machine vision-aided topographical methods,
advantage over peers with all the benefits realised from machine vision CIRP Ann. (2021).

8
M. Javaid et al. Sensors International 3 (2022) 100132

[12] V. Alonso, A. Dacal-Nieto, L. Barreto, A. Amaral, E. Rivero, Industry 4.0 [41] A.A. Malik, M.V. Andersen, A. Bilberg, Advances in machine vision for flexible
implications in machine vision metrology: an overview, Procedia Manuf. 41 feeding of assembly parts, Procedia Manuf. 38 (2019) 1228–1235.
(2019) 359–366. [42] D.K. Aswal, Quality infrastructure of India and its importance for inclusive
[13] B. Jeon, J.S. Yoon, J. Um, S.H. Suh, The architecture development of Industry 4.0 national growth, MAPAN 35 (2020) 139–150, https://doi.org/10.1007/s12647-
compliant smart machine tool system (SMTS), J. Intell. Manuf. 31 (8) (2020) 020-00376-3.
1837–1859. [43] P. Pierleoni, A. Belli, L. Palma, M. Palmucci, L. Sabbatini, A machine vision system
[14] A. Nelson, Machine vision trends for today's industrial age, Quality 59 (13) (2020) for manual assembly line monitoring, in: 2020 International Conference on
26VS–29VS. Intelligent Engineering and Management (ICIEM), IEEE, 2020, June, pp. 33–38.
[15] F. Müller, D. Jaeger, M. Hanewinkel, Digitisation in wood supply–A review on [44] E. Nica, Cyber-physical production networks and advanced digitalisation in
how Industry 4.0 will change the forest value chain, Comput. Electron. Agric. 162 Industry 4.0 manufacturing systems: sustainable supply chain management,
(2019) 206–218. organisational resilience, and data-driven innovation, J. Self Govern. Manag.
[16] M. Dopico, A. G omez, D. De la Fuente, N. García, R. Rosillo, J. Puche, A vision of Econ. 7 (3) (2019) 27–33.
industry 4.0 from an artificial intelligence point of view, in: Proceedings on the [45] R. Crossley, S. Ratchev, Aerospace assembly gap measurement using low-cost
International Conference on Artificial Intelligence (ICAI), The Steering Committee smart tools with machine vision, in: International Precision Assembly Seminar,
of The World Congress in Computer Science, Computer Engineering and Applied Springer, Cham, 2018, January, pp. 158–168.
Computing (WorldCom), 2016, p. 407. [46] M. Jones, L. Zarzycki, G. Murray, Does industry 4.0 pose a challenge for the sme
[17] T.H.J. Uhlemann, C. Lehmann, R. Steinhilper, The digital twin: realising the cyber- machine builder? A case study and reflection of readiness for a UK SME, in:
physical production system for industry 4.0, Procedia CIRP 61 (2017) 335–340. International Precision Assembly Seminar, Springer, Cham, 2018, January,
[18] V.C. Coffey, Machine vision: the eyes of industry 4.0, Opt Photon. News 29 (7) pp. 183–197.
(2018) 42–49. [47] A. Bartolini, L. Bossi, L. Capineri, P. Falorni, A. Bulletti, M. Dimitri, T. Byndych,
[19] R.L. Silva, M. Rudek, A.L. Szejka, O.C. Junior, Machine vision systems for Machine vision for obstacle avoidance, tripwire detection, and subsurface radar
industrial quality control inspections, in: IFIP International Conference on Product image correction on a robotic vehicle for the detection and discrimination of
Lifecycle Management, Springer, Cham, 2018, July, pp. 631–641. landmines, in: 2019 PhotonIcs & Electromagnetics Research Symposium-Spring
[20] L. Louw, M. Droomer, Development of a low cost machine vision-based quality (PIERS-Spring), IEEE, 2019, June, pp. 1602–1606.
control system for a learning factory, Procedia Manuf. 31 (2019) 264–269. [48] A. Raina, M.I.U. Haq, M. Javaid, S. Rab, A. Haleem, 4D Printing for Automotive
[21] C.S. Tang, L.P. Veelenturf, The strategic role of logistics in the industry 4.0 era, Industry Applications, Journal of The Institution of Engineers (India): Series D,
Transport. Res. E Logist. Transport. Rev. 129 (2019) 1–11. 2021, pp. 1–9.
[22] E. Zancul, H.O. Martins, F.P. Lopes, F.A. da Silva Neto, Machine vision [49] A. Krdzalic, L. Hodzic, Sustainable engineering challenges towards Industry 4.0: a
applications in a learning factory, Procedia Manuf. 45 (2020) 516–521. comprehensive review, Sustain. Eng. Innov. 1 (1) (2019) 1–23. ISSN 2712-0562.
[23] T. Strelkova, A.I. Strelkov, V.M. Kartashov, A.P. Lytyuga, A.S. Kalmykov, Methods [50] A. Walter Colombo, S. Karnouskos, C. Hanisch, Engineering human-focused
of reception and signal processing in machine vision systems, in: Examining industrial cyber-physical systems in industry 4.0 context, Philos. Trans. Roy. Soc.
Optoelectronics in Machine Vision and Applications in Industry 4.0, IGI Global, A 379 (2207) (2021) 20200366.
2021, pp. 71–102. [51] A.V. Gurjanov, V.I. Babenkov, A.V. Shukalov, I.O. Zharinov, O.O. Zharinov, Total
[24] D. Gorecky, M. Schmitt, M. Loskyll, D. Zühlke, Human-machine-interaction in the quality control of the cyber-physical production using machine vision
industry 4.0 era, in: 2014 12th IEEE International Conference on Industrial technologies, in: Journal of Physics: Conference Series, vol. 1889, IOP Publishing,
Informatics (INDIN), Ieee, 2014, July, pp. 289–294. 2021, April, p. 52014. No. 5.
[25] M. Ammar, A. Haleem, M. Javaid, S. Bahl, A.S. Verma, Implementing Industry 4.0 [52] V.D. Majstorovic, N. Durakbasa, Y. Takaya, S. Stojadinovic, June). Advanced
technologies in self-healing materials and digitally managing the quality of manufacturing metrology in context of industry 4.0 model, in: International
manufacturing, Mater. Today: Proc. (2021). Conference on Measurement and Quality Control-Cyber Physical Issue, Springer,
[26] L. Perez, I. Rodríguez, N. Rodríguez, R. Usamentiaga, D.F. García, Robot guidance Cham, 2019, pp. 1–11.
using machine vision techniques in industrial environments: a comparative [53] M. Williamson, Keeping up standards in machine vision, Quality 57 (13) (2018)
review, Sensors 16 (3) (2016) 335. 33–35.
[27] F. Chiarello, L. Trivelli, A. Bonaccorsi, G. Fantoni, Extracting and mapping [54] G. Erboz, How to Define Industry 4.0: Main Pillars of Industry 4.0. Managerial
industry 4.0 technologies using Wikipedia, Comput. Ind. 100 (2018) 244–257. Trends in the Development of Enterprises in Globalisation Era, 2017, pp. 761–767.
[28] S. Rab, S. Yadav, N. Garg, S. Rajput, D.K. Aswal, Evolution of measurement system [55] C. Cimini, G. Pezzotta, R. Pinto, S. Cavalieri, Industry 4.0 technologies impacts in
and SI units in India, MAPAN (2020) 1–16. the manufacturing and supply chain landscape: an overview, in: International
[29] A. Angelopoulos, E.T. Michailidis, N. Nomikos, P. Trakadas, A. Hatziefremidis, Workshop on Service Orientation in Holonic and Multi-Agent Manufacturing,
S. Voliotis, T. Zahariadis, Tackling faults in the industry 4.0 era—a survey of Springer, Cham, 2018, June, pp. 109–120.
machine-learning solutions and key aspects, Sensors 20 (1) (2020) 109. 
[56] J. David, P. Svec, V. Pasker, R. Garzinova, Usage of real-time machine vision in
[30] J.E.M. Vega, A.G. Chaidez, C.M. García, M.R. L opez, W.F. Fuentes, O. Sergiyenko, rolling mill, Sustainability 13 (7) (2021) 3851.
Recognition system by using machine vision tools and machine learning [57] K. Xia, Z. Weng, Workpieces sorting system based on industrial robot of machine
techniques for mobile robots, in: Examining Optoelectronics in Machine Vision vision, in: 2016 3rd International Conference on Systems and Informatics (ICSAI),
and Applications in Industry 4.0, IGI Global, 2021, pp. 258–287. IEEE, 2016, November, pp. 422–426.
[31] R. French, M. Benakis, H. Marin-Reyes, Intelligent sensing for robotic re- [58] A. Haleem, M. Javaid, Additive manufacturing applications in industry 4.0: a
manufacturing in aerospace—an industry 4.0 design based prototype, in: 2017 review, J. Ind. Integr. Manag. 4 (4) (2019) 1930001.
IEEE International Symposium on Robotics and Intelligent Sensors (IRIS), IEEE, [59] E. Oztemel, S. Gursev, Literature review of Industry 4.0 and related technologies,
2017, October, pp. 272–277. J. Intell. Manuf. 31 (1) (2020) 127–182.
[32] M. Crnjac, I. Veza, N. Banduka, From concept to the introduction of industry 4.0, [60] C. Wittenberg, Human-CPS Interaction-requirements and human-machine
Int. J. Ind. Eng. Manag. 8 (1) (2017) 21–30. interaction methods for the Industry 4.0, IFAC-PapersOnLine 49 (19) (2016)
[33] B. Tjahjono, C. Esplugues, E. Ares, G. Pelaez, What does industry 4.0 mean to 420–425.
supply chain? Procedia Manuf. 13 (2017) 1175–1182. [61] J. Lou, Crawling robot manipulator tracking based on Gaussian mixture model of
[34] M. Javaid, A. Haleem, R.P. Singh, S. Rab, R. Suman, S. Khan, Exploring machine vision, Neural Comput. Appl. (2021) 1–11.
relationships between Lean 4.0 and manufacturing industry, in: Industrial Robot: [62] M. Swami, D. Verma, V.P. Vishwakarma, Blockchain and industrial internet of
the International Journal of Robotics Research and Application, 2021. things: applications for industry 4.0, in: Proceedings of International Conference
[35] J.E. Miranda-Vega, J. Rivera-Castillo, M. Rivas-L opez, W. Flores-Fuentes, on Artificial Intelligence and Applications, Springer, Singapore, 2021,
O. Sergiyenko, J.C. Rodríguez-Qui~ nonez, D. Hernandez-Balbuena, Reducing the pp. 279–290.
optical noise of machine vision optical scanners for landslide monitoring, in: _
[63] B. Bayram, G. Ince, Advances in robotics in the era of industry 4.0, in: Industry 4.0:
Examining Optoelectronics in Machine Vision and Applications in Industry 4.0, Managing the Digital Transformation, Springer, Cham, 2018, pp. 187–200.
IGI Global, 2021, pp. 103–133. [64] M. Dale, The dawn of data: matthew Dale explores Industry 4.0 and machine
[36] J. Theunissen, H. Xu, R.Y. Zhong, X. Xu, Smart AGV system for manufacturing vision's role in the connected factories of the future, Imag. Mach. Vision Europe 95
shop floor in the context of industry 4.0, in: 2018 25th International Conference (95) (2019) 16–20.
on Mechatronics and Machine Vision in Practice (M2VIP), IEEE, 2018, November, [65] A. Massaro, N. Contuzzi, A. Galiano, Intelligent processes in automated production
pp. 1–6. involving Industry 4.0 technologies and artificial intelligence, in: Advanced
[37] P. Fraga-Lamas, T.M. Fernandez-Carames, O. Blanco-Novoa, M.A. Vilar- Robotics and Intelligent Automation in Manufacturing, IGI Global, 2020,
Montesinos, A review on industrial augmented reality systems for the industry 4.0 pp. 97–122.
shipyard, IEEE Access 6 (2018) 13358–13375. [66] A.C. Pereira, F. Romero, A review of the meanings and the implications of the
[38] J. Villalba-Diez, D. Schmidt, R. Gevers, J. Ordieres-Mere, M. Buchwitz, Industry 4.0 concept, Procedia Manuf. 13 (2017) 1206–1214.
W. Wellbrock, Deep learning for industrial computer vision quality control in the [67] P. Osterrieder, L. Budde, T. Friedli, The smart factory as a key construct of industry
printing industry 4.0, Sensors 19 (18) (2019) 3987. 4.0: a systematic literature review, Int. J. Prod. Econ. 221 (2020) 107476.
[39] M. Ghobakhloo, Industry 4.0, digitisation, and opportunities for sustainability, [68] M.K. Adeyeri, K. Mpofu, T.A. Olukorede, Integration of agent technology into
J. Clean. Prod. 252 (2020) 119869. manufacturing enterprise: a review and platform for industry 4.0, in: 2015
[40] B. Meindl, N.F. Ayala, J. Mendonça, A.G. Frank, The four smarts of Industry 4.0: International Conference on Industrial Engineering and Operations Management
evolution of ten years of research and future perspectives, Technol. Forecast. Soc. (IEOM), IEEE, 2015, March, pp. 1–10.
Change 168 (2021) 120784.

9
M. Javaid et al. Sensors International 3 (2022) 100132

[69] R.G. Lins, P.R.M. de Araujo, M. Corazzim, In-process machine vision monitoring of [99] L. Bassi, Industry 4.0: hope, hype or revolution?, in: 2017 IEEE 3rd International
tool wear for Cyber-Physical Production Systems, Robot. Comput. Integrated Forum on Research and Technologies for Society and Industry (RTSI) IEEE, 2017,
Manuf. 61 (2020) 101859. September, pp. 1–6.
[70] Y. Lin, D. Chen, S. Liang, Z. Xu, Y. Qiu, J. Zhang, X. Liu, Color classification of [100] H. Würschinger, M. Mühlbauer, M. Winter, M. Engelbrecht, N. Hanenkamp,
wooden boards based on machine vision and the clustering algorithm, Appl. Sci. Implementation and potentials of a machine vision system in a series production
10 (19) (2020) 6816. using deep learning and low-cost hardware, Procedia CIRP 90 (2020) 611–616.
[71] R.Y. Zhong, X. Xu, E. Klotz, S.T. Newman, Intelligent manufacturing in the context [101] G. Bansod, S. Khandekar, S. Khurana, Analysis of convolution neural network
of industry 4.0: a review, Engineering 3 (5) (2017) 616–630. architectures and their applications in industry 4.0, in: Metaheuristic Algorithms
[72] J.D. Contreras, J.I. Garcia, J.D. Pastrana, Developing of industry 4.0 applications, in Industry 4.0, CRC Press, 2021, pp. 139–162.
Int. J. Online Eng. 13 (10) (2017). [102] A.V. Carvalho, A. Chouchene, T.M. Lima, F. Charrua-Santos, Cognitive

[73] D. Oztürk, Technological transformation of manufacturing by smart factory vision: manufacturing in industry 4.0 toward cognitive load reduction: a conceptual
industry 4.0, Int. J. Dev. Res. 7 (11) (2017) 17371–17382. framework, Appl. Syst. Innov. 3 (4) (2020) 55.
[74] S.S. Kamran, A. Haleem, S. Bahl, M. Javaid, D. Nandan, A.S. Verma, Role of smart [103] M. Cejnek, C. Oswald, Machine vision object measurement in difficult industry
materials and digital twin (DT) for the adoption of electric vehicles in India, environment, in: 2019 Third World Conference on Smart Trends in Systems
Mater. Today: Proc. (2021). Security and Sustainability (WorldS4), IEEE, 2019, July, pp. 167–170.
[75] G. Culot, F. Fattori, M. Podrecca, M. Sartor, Addressing industry 4.0 cybersecurity [104] P. Drahos, E. Kucera, O. Haffner, I. Klimo, Trends in industrial communication and
challenges, IEEE Eng. Manag. Rev. 47 (3) (2019) 79–86. OPC UA, in: 2018 Cybernetics & Informatics (K&I), IEEE, 2018, January, pp. 1–5.
[76] L. Bibby, B. Dehe, Defining and assessing industry 4.0 maturity levels–case of the [105] I. Malý, D. Sedlacek, P. Leitao, Augmented reality experiments with industrial
defence sector, Prod. Plann. Control 29 (12) (2018) 1030–1043. robot in industry 4.0 environment, in: 2016 IEEE 14th International Conference on
[77] A. Massaro, N. Contuzzi, A. Galiano, Intelligent processes in automated production Industrial Informatics (INDIN), IEEE, 2016, July, pp. 176–181.
involving Industry 4.0 technologies and artificial intelligence, in: Advanced [106] K. Williams, The readiness and compatibility of a modern anode handling and
Robotics and Intelligent Automation in Manufacturing, IGI Global, 2020, cleaning system for industry 4.0 technologies, in: Light Metals 2021, Springer,
pp. 97–122. Cham, 2021, pp. 957–964.
[78] K. Santos, E. Loures, F. Piechnicki, O. Canciglieri, Opportunities assessment of [107] A. Haleem, M. Javaid, R.P. Singh, R. Suman, S. Rab, Blockchain technology
product development process in Industry 4.0, Procedia Manuf. 11 (2017) applications in healthcare: an overview, Int. J. Intell. Netw. (2021).
1358–1365. [108] I. Grangel-Gonzalez, P. Baptista, L. Halilaj, S. Lohmann, M.E. Vidal, C. Mader,
[79] C. Nuzzi, S. Pasinetti, M. Lancini, F. Docchio, G. Sansoni, Deep learning-based S. Auer, The industry 4.0 standards landscape from a semantic integration
machine vision: first steps towards a hand gesture recognition set up for perspective, in: 2017 22nd IEEE International Conference on Emerging
collaborative robots, in: 2018 Workshop on Metrology for Industry 4.0 and IoT, Technologies and Factory Automation (ETFA), IEEE, 2017, September, pp. 1–8.
IEEE, 2018, April, pp. 28–33. [109] R.M. Mitrovic, I. Atanasovska, N. Soldat, Z. Miskovic, New trends in machine
[80] M. Ramsgaard Thomsen, P. Nicholas, M. Tamke, S. Gatz, Y. Sinke, G. Rossi, design within industry 4.0 framework, in: Proceedings of 5th International
Towards machine learning for architectural fabrication in the age of industry 4.0, Conference on the Industry 4.0 Model for Advanced Manufacturing, Springer,
Int. J. Architect. Comput. 18 (4) (2020) 335–352. Cham, 2020, pp. 227–238.
[81] H.G. Lemu, On opportunities and limitations of additive manufacturing [110] S. Rab, S. Yadav, S.K. Jaiswal, A. Haleem, D.K. Aswal, Quality infrastructure of
technology for Industry 4.0 era, in: International Workshop of Advanced national metrology institutes: a comparative study. http://nopr.niscair.res.in/han
Manufacturing and Automation, Springer, Singapore, 2018, September, dle/123456789/56603, 2021.
pp. 106–113. [111] S. Yadav, D.K. Aswal, Redefined SI units and their implications, MAPAN 35 (2020)
[82] A. Schumacher, S. Erol, W. Sihn, A maturity model for assessing Industry 4.0 1–9, https://doi.org/10.1007/s12647-020-00369-2.
readiness and maturity of manufacturing enterprises, Procedia CIRP 52 (2016) [112] S.C. Jepsen, T.I. Mørk, J. Hviid, T. Worm, A pilot study of industry 4.0 asset
161–166. interoperability challenges in an industry 4.0 laboratory, in: 2020 IEEE
[83] Z. Rajnai, I. Kocsis, Assessing industry 4.0 readiness of enterprises, in: 2018 IEEE International Conference on Industrial Engineering and Engineering Management
16th World Symposium on Applied Machine Intelligence and Informatics (SAMI), (IEEM), IEEE, 2020, December, pp. 571–575.
IEEE, 2018, February, pp. 225–230. [113] F. Jaensch, A. Csiszar, C. Scheifele, A. Verl, Digital twins of manufacturing systems
[84] U. Kaewmorakot, S. Thaenkaew, K. Ruangsiri, Development of training package as a base for machine learning, in: 2018 25th International Conference on
on machine vision applying STEM approach for industrial education, in: 2019 Mechatronics and Machine Vision in Practice (M2VIP), IEEE, 2018, November,
International Conference on Power, Energy and Innovations (ICPEI), IEEE, 2019, pp. 1–6.
October, pp. 130–133. [114] P. Zheng, H. Wang, Z. Sang, R.Y. Zhong, Y. Liu, C. Liu, X. Xu, Smart manufacturing
[85] R. Urena, F. Rodrıguez, M. Berenguel, A machine vision system for seeds quality systems for Industry 4.0: conceptual framework, scenarios, and future
evaluation using fuzzy logic, Comput. Electron. Agric. 32 (1) (2001) 1–20. perspectives, Front. Mech. Eng. 13 (2) (2018) 137–150.
[86] M. Nardo, D. Forino, T. Murino, The evolution of man-machine interaction: the [115] F. Almada-Lobo, The industry 4.0 revolution and the future of manufacturing
role of human in Industry 4.0 paradigm, Prod. Manuf. Res. 8 (1) (2020) 20–34. execution systems (MES), J. Innov. Manag. 3 (4) (2015) 16–21.
[87] P. Papcun, E. Kaj ati, J. Koziorek, Human-machine interface in concept of industry [116] A. Benesova, J. Tupa, Requirements for education and qualification of people in
4.0, in: 2018 World Symposium on Digital Intelligence for Systems and Machines Industry 4.0, Procedia Manuf. 11 (2017) 2195–2202.
(DISA), IEEE, 2018, August, pp. 289–296. [117] G.B. Cotet, N.L. Carutasu, F. Chiscop, Industry 4.0 diagnosis from an millennial
[88] D. Kolberg, D. Zühlke, Lean automation enabled by industry 4.0 technologies, educational perspective, Educ. Sci. 10 (1) (2020) 21.
IFAC-PapersOnLine 48 (3) (2015) 1870–1875. [118] N. Habibifar, H. Salmanzadeh, H. Karrari, M. Bakhtiari, Design technology
[89] A. Breyer, Machine Vision in France: EMVA report unveils market peculiarities in roadmap for developing machine vision technologies in press and body shops of
Europe's second-largest industry nation, Optik Photonik 13 (2) (2018) 20–21. Iranian automotive industries, Commercial Surv. 18 (104) (2020) 45–62.
[90] E. G€okalp, U. Şener, P.E. Eren, Development of an assessment model for industry [119] C.J. Kuo, K.C. Ting, Y.C. Chen, D.L. Yang, H.M. Chen, Automatic machine status
4.0: industry 4.0-MM, in: International Conference on Software Process prediction in the era of Industry 4.0: case study of machines in a spring factory,
Improvement and Capability Determination, Springer, Cham, 2017, October, J. Syst. Architect. 81 (2017) 44–53.
pp. 128–142. [120] A. Badri, B. Boudreau-Trudel, A.S. Souissi, Occupational health and safety in the
[91] O. Poliarus, Y. Poliakov, Detection of landmarks by mobile autonomous robots industry 4.0 era: a cause for major concern? Saf. Sci. 109 (2018) 403–411.
based on estimating the color parameters of the surrounding area, in: Examining [121] T. Lindner, D. Wyrwał, A. Kubacki, Autonomous stand for 3D printing and
Optoelectronics in Machine Vision and Applications in Industry 4.0, IGI Global, machine vision system, in: Conference on Automation, Springer, Cham, 2018,
2021, pp. 224–257. March, pp. 62–71.
[92] J.A. Mu~ noz, R. Perez-Fernandez, Adopting industry 4.0 technologies in [122] H. Subakti, J.R. Jiang, Indoor augmented reality using deep learning for industry
shipbuilding through CAD systems, Int. J. Marit. Eng. 163 (A1) (2021) 41–49. 4.0 smart factories, in: 2018 IEEE 42nd Annual Computer Software and
[93] K. Zhou, T. Liu, L. Zhou, Industry 4.0: towards future industrial opportunities and Applications Conference (COMPSAC), vol. 2, IEEE, 2018, July, pp. 63–68.
challenges, in: 2015 12th International Conference on Fuzzy Systems and [123] L.D. Xu, E.L. Xu, L. Li, Industry 4.0: state of the art and future trends, Int. J. Prod.
Knowledge Discovery (FSKD), IEEE, 2015, August, pp. 2147–2152. Res. 56 (8) (2018) 2941–2962.
[94] A.A. Kryukova, N.A. Stefanova, I.A. Khasanshin, Smart" Region: Managing [124] M. Javaid, A. Haleem, R.P. Singh, R. Suman, Artificial intelligence applications for
Economic Development on the Basis of Machine Vision and Ubiquitous industry 4.0: a literature-based study, J. Ind. Integr. Manag. (2021) 1–29.
Computing. In-State and Corporate Management of Region's Development in the [125] N.H.M. Zaidin, M.N.M. Diah, P.H. Yee, S. Sorooshian, Quality management in
Conditions of the Digital Economy, Springer, Cham, 2021, pp. 127–131. industry 4.0 era, J. Manag. Sci. 8 (2) (2018) 82–91.
[95] A. Ardanza, A. Moreno, A.  Segura, M. de la Cruz, D. Aguinaga, Sustainable and [126] M.I.U. Haq, A. Raina, M.J. Ghazali, M. Javaid, A. Haleem, Potential of 3D printing
flexible industrial human-machine interfaces to support adaptable applications in technologies in developing applications of polymeric nanocomposites, in:
the Industry 4.0 paradigm, Int. J. Prod. Res. 57 (12) (2019) 4045–4059. Tribology of Polymer and Polymer Composites for Industry 4.0, Springer,
[96] M. Javaid, A. Haleem, R.P. Singh, S. Rab, R. Suman, Significance of sensors for Singapore, 2021, pp. 193–210.
industry 4.0: roles, capabilities, and applications, Sens. Int. (2021) 100110. [127] D. Mishra, R.B. Roy, S. Dutta, S.K. Pal, D. Chakravarty, A review on sensor-based
[97] M. Sishi, A. Telukdarie, Implementation of Industry 4.0 technologies in the mining monitoring and control of friction stir welding process and a roadmap to Industry
industry a case study, Int. J. Min. Miner. Eng. 11 (1) (2020) 1–22. 4.0, J. Manuf. Process. 36 (2018) 373–397.
[98] Y. Torun, M.R. Akbaş, M.A. Çelık, O. Kaynar, Development of a machine vision [128] Q. Chen, B. Heydari, M. Moghaddam, Leveraging task modularity in reinforcement
system for marble classification, in: 2019 27th Signal Processing and learning for adaptable industry 4.0 automation, J. Mech. Des. 143 (7) (2021),
Communications Applications Conference (SIU), IEEE, 2019, April, pp. 1–4. 071701.

10
M. Javaid et al. Sensors International 3 (2022) 100132

[129] M. Javaid, A. Haleem, R.P. Singh, S. Rab, R. Suman, Exploring the potential of [131] M. Javaid, A. Haleem, R.P. Singh, S. Rab, R. Suman, Upgrading the manufacturing
Nanosensors: a brief overview, Sens. Int. (2021) 100130. sector via applications of industrial internet of things (IIoT), Sens. Int. 2 (2021)
[130] M. Javaid, S. Babu, S. Rab, R. Vaishya, A. Haleem, Tribological review of medical 100129.
implants manufactured by additive manufacturing, in: Tribology and [132] E. Oztemel, S. Gursev, Literature review of Industry 4.0 and related technologies,
Sustainability, CRC Press, 2021, pp. 379–395. J. Intell. Manuf. 31 (1) (2020) 127–182.

11

You might also like