PLT 425

VISION SYSTEM

CHAPTER 1:
INTRODUCTION TO MACHINE VISION

From Wikipedia: Machine vision (MV) is the technology and

methods used to provide imaging-based automatic
inspection and analysis for such applications as automatic
inspection, process control, and robot guidance in industry.
“The scope of MV is broad”.

1
 INTRODUCTION

 A machine vision system recovers useful information

about a scene from its 2-dimensional projections.

 The goal of machine vision is to create a model of the

real world from images.

2
FIELDS THAT DEAL WITH IMAGES
 Image
Images are two-dimensional projections of the three-dimensional
world.
 Image Processing
Enhancement or manipulation of the image – the result of which is
usually another image.
 Computer Vision
Analysis and understanding of image content.
 Video Processing
Similar with image processing, but processing of multiple
images/frames. Combined with computer vision, end result is
normally extracted information.

3
3 PRINCIPAL USES FOR IMAGE PROCESSING

 Improvement of pictorial information for human

interpretation
Do you have example in mind?

 Compression of image data for storage and transmission

 Processing of image data for autonomous machine

perception to enable object representation, detection,
classification and tracking
Which is why we learn this course.

4
FUNDAMENTAL STEPS & COMPONENTS OF
MACHINE VISION SYSTEMS
• The first stage of any vision system is the image
acquisition stage.
Image acquisition • The action of retrieving an image from some source,
usually a hardware-based source for processing.
• To create a digital image, it requires 2 process:
Image sampling and quantization.
• Improves image for human and computer
consumption, highlight / extract relevant feature
• Remove noises, deblurred etc
Image processing • Color Conversion
• Segmentation and representations
• Extract features such a edge, regions, surfaces
etc.
• Measurement analysis - measure features on the
object

• Image classification refers to the labelling of

Classification images into one of a number of predefined
categories
5
 Example: Face Recognition Workflow

6
 Example: Face Recognition Workflow

7
  Machine vision system is a sensor used in the robots for viewing and
recognizing an object with the help of a computer.
 It is mostly used in the industrial robots for inspection purposes.

8
Source: http://www.roboticsbible.com/machine-vision-system.html
APPLICATIONS OF MACHINE VISION SYSTEMS

 Law enforcement
 Medical imaging
 Remote sensing
 Satellite image processing
 Industrial inspection
 Robot control
 And so other many applications

9
 LAW ENFORCEMENT
How to extract features that can be used to differentiate among
different images?

10
 LAW ENFORCEMENT
 Example: Face Recognition System

11
 LAW ENFORCEMENT
 Example: Automated license plate recognition

12
 MEDICAL IMAGING
 Comprises different imaging
modalities and processes of
image human body for diagnostic
and treatment purposes.
 Allowing doctors to find disease
earlier and improve patient
outcomes.
 How to process/ analyze the
image to help diagnosis or
treatment?
 Types of image modalities:
– Ultra Sound (US)
– Magnetic Resonance Imaging
(MRI)
– Computer Tomography (CT)
– X-Rays
13
14
 REMOTE SENSING

 The use of satellite- or aircraft-

based sensor technologies to
detect and classify objects on
Earth
 Example: Weather observation
and prediction
– Multispectral image of Hurricane
Andrew from satellites using sensors
in the visible and infrared bands

New York (from Landast-5 TM)

15
 REMOTE SENSING
 Example: Palm Mapping Using Drones

16
SATELLITE IMAGE PROCESSING

Infrared image of hurricane Irma

17
 INDUSTRIAL INSPECTION

Vision sensor detects torn

label

Monitor bottle overfill and

underfill

18
INDUSTRIAL INSPECTION

Inspecting date/code and

label quality

19
 ROBOT CONTROL

 Unmanned operations -
autonomous vehicle driving
 How to detect and track target?
 How to avoid obstacles?

Mars Rover: An example of an

unmanned land-based vehicle. Notice
the stereo cameras mounted on top of
the Rover.

20
OTHERS

21
ADVANTAGES OF MACHINE VISION SYSTEMS

 Cutting out defective goods

 Making better use of raw materials

 Cutting the cost of quality control

 Enabling real-time process monitoring

 Improving employment conditions

22