Artificial Neural

Network

1
Modelling

Water = H2O

2
Emotion = ?

3
Biological Perspective of Neural
Networks

4
• A neuron has a branching input structure (dendrites), a cell
body, and a branching output structure (axon).

• When a neuron is activated, it fires an electrochemical

signal along the axon. The signal crosses the synapses to
other neurons, which may in turn fire.

• A neuron fires only if the total signal received at the cell

body from the dendrites exceeds a certain level (firing
threshold).

5
 Neural Networks Concept
• A neural network is an interconnected assembly of simple
processing elements (units/ nodes).
• The processing ability of the network is stored in the inter-
unit connection strengths (weights) obtained by the learning
process from a set of training patterns.

6
 Neural Networks Applications
• Manufacturing
• process and machine diagnosis, welding quality analysis,
visual quality inspection system
• Defense
• Target tracking, facial recognition, feature extraction and
noise suppression, signal/ image identification
• Banking
• Check and document reading, credit application evaluation
• Transportation
• Truck brake diagnosis systems, vehicle scheduling, routing
systems
7
Components of Simple Neuron

8
9
 McCulloch–Pitts Model
1. The activation of a McCulloch–Pitts neuron is binary. At
any time step, the neuron either fires or does not fire.
2. Connected by directed weighted paths.
3. The connection path is excitatory if the weight on the path
is positive; otherwise it is inhibitory. All excitatory
connections into a particular neuron have the same
weights.
4. Each neuron has a fixed threshold such that if the net
input to the neuron is greater than the threshold, the
neuron fires.
5. Takes one time step for a signal to pass over one
connection link.
10
A neuron with 2 inputs is shown below. The transfer
function for the neuron is hardlimit, where

Given p1 = 2.5; p2 = 3; w1 = 0.5; w2 = -0.7; b = 0.3

11
Neural Network with Single-Layer
of Neurons

R = number of elements in input vector

12
Neural Network Learning Methods
Gradient Descent
• Iterative learning algorithm for computational unit with
differentiable activation functions. Gradient descent method
converge linear to the solution. Gradient descent can
determine a local minimum for a multivariable function.

13
Backpropagation
• Iterative learning algorithm for computational unit with
differentiable activation functions. It propagates the error
between the desired output and actual output of neural
network for the purpose of adjusting the weight. It consists
of two phases:
• Forward path -> the input vectors are presented to network
• backward path -> the error gradient is used to update the
weights.

14