Introduction

Detect detection techniques

Deep learning-based visual inspection systems are good at detecting defects that are
complex in nature. They not only address complex surfaces and cosmetic flaws—but also
generalize and conceptualize the parts’ surfaces.

https://mobidev.biz/blog/ai-visual-inspection-deep-learning-computer-vision-defect-detection#nav1

5. DEPLOY & IMPROVE

When deploying a visual inspection model, it’s important to consider how software
and hardware system architectures correspond to a model capacity.
Software 
The structure of visual inspection-powered software bases itself on the combination
of web solutions for data transmission and a Python framework for neural network
processing. 
The key parameter here is data storage. There are three common ways to store
data: local server, a cloud streaming service, or serverless architecture.  
A visual inspection system involves the storage of video records. The choice of a
data storage solution often depends on a deep learning model functionality. For
example, if a visual inspection system uses a large dataset, the optimal selection
may be a cloud streaming service.
Hardware
Depending on the industry and automation processes, devices required to integrate
visual inspection system may include:
 Camera. The key camera option is real-time video streaming. Some examples
include IP and CCTV.
 Gateway. Both dedicated hardware appliances and software programs work well
for a visual inspection system.
 CPU / GPU. If real-time results are necessary, a GPU would be the better choice
than a CPU, as the former boasts a faster processing speed when it comes to
image-based deep learning models. It is possible to optimize a CPU for operating
the visual inspection model, but not for training. An example of an optimal GPU
might be the Jetson Nano . 
 Photometer (optional). Depending on the lighting conditions of the visual
inspection system environment, photometers may be required.
 Colorimeter (optional). When detecting color and luminance in light sources,
imaging colorimeters have consistently high spatial resolutions, allowing for
detailed visual inspections. 
Deep learning models are open to improvement after deployment. A deep learning
approach can increase the accuracy of the neural network through the iterative
gathering of new data and model re-training. The result is a “smarter” visual
inspection model that learns through increasing the amount of data during
operation.
Deep learning has been widely used in various fields. This paper uses the supervised deep
learning architecture for automatic optical inspection. The advantage of using deep learning
is that it can detect the defects that cannot be detected by traditional machine vision
algorithms. The dataset in this study is surface scratches on plastic housings. The shape of
scratches is mostly slender. They are too narrow that the features will disappear after CNN
reduces spatial resolution. For this issue, we further evaluate the input size of the defect. In
addition, we also propose a mask labeling map based on pixel annotation to do the block
cropping with sliding windows strategy. The results show that the influence of the feature's
pixel size into the convolution calculation will enable us to more accurately locate the defect,
and the pixel accuracy can reach 73.47% only with two images. The research results also
provide a new consideration for defect detection and its pixel size.

This paper provides a review of defect detection methodologies described in more than 220
scientific contributions. A significant amount of works is based on statistical observations and
uses statistical or filter-based methods. The Gabor filter is one of the most commonly used
methods. However, most of the studies present specific limitations, being heavily dependent on
the pattern, material and texture. Solving the segmentation and windowing problems of
overlapping objects is still a ponderous topic approached by several researchers. Images having
color features can multiply the complexity of these problems.
Neural networks are a powerful technique often employed in artificial image processing since
they can nearly solve every classification problem. However, the main drawback is the required
large amount of training samples. In artificial image processing, this issue can be easily solved
with labeled datasets, or applying stochastic solutions (i.e., mini-batches). However, in other
fields such as robotics, or other systems that learn from real-world operations, it is still a
challenging problem. Improving the training efficiency and convergence capability of neural
networks is an ongoing research area. It is also notable that large neural networks used for deep
learning require significant computational resources, which lead to an unavoidable
parallelization of the challenges [220].
Supervised learning methods are well-functioning and straightforward to use. Due to their
capabilities, supervised methods are the most preferred for classification in industry but in many
cases they are time consuming to train and require large datasets.
Unsupervised learning is used for density estimation, dimensionality reduction and clustering
problems. However, in many cases, unsupervised methods have shown lower efficiencies than
supervised learning methods. Natural supervision is an emerging topic in the field, due to its
similarities to biological learning behaviors. From another perspective, artificial neural networks
are inspired by biological neural networks, but do not necessarily replicate them. Back
propagation is the essence to train many artificial neural networks, although no such mechanism
exactly exists in biological networks [221]. This means that biological neural networks gave a
good inspiration to develop artificial neural networks that can be used as classifiers; however,
sufficiently modeling them for technological use is still an unsolved topic.
In artificial image processing, different textural databases are available for testing, although
several studies do not provide satisfactory results due to the lack of testing samples and frequent
inconsistency of such databases. Moreover, there is still a huge demand for developing general
defect detection methods able to deal with any kind of defect on every kind of material, and also
able to establish a general and reliable defect description system. Due to the lack of solutions,
there is a huge demand in industry to increase the defect identification efficiency with multi-
sensory systems applications. To this aim, deep learning is the emerging field that could solve
the generalization requirement and hyper-complexity of problems without drastically increasing
computational costs.

it is natural to try Fully Convolutional Networks such as U-Net [21] to label each pixel in a region to
indicate those that belong to abnormalities of interest. In this paper we show that when only small
numbers of training examples are available, such techniques perform poorly. However, we go on to
show that the features that are learnt in the different U-Net layers are useful for discriminating good
from bad, and that a Random Forest, trained to classify each pixel based on such features, achieves a
much better result than the usual final softmax layer in the U-Net.