You are on page 1of 20

Artificial Neural Networks - 10

Dr. Aditya Abhyankar

SOM

LVQ

Last time

• ART!!

Today

LVQ (Learning Vector Quantization)

• Supervised classifier • Discriminating surfaces are Bayes surfaces • Weight vector for output = codebook vector • Each output is a known class

LVQ (Learning Vector Quantization)

LVQ (Learning Vector Quantization)

LVQ (Learning Vector Quantization)

LVQ (Learning Vector Quantization)

LVQ (Learning Vector Quantization)

LVQ (Learning Vector Quantization)

LVQ (Learning Vector Quantization)

Adaptive Resonance Theory (ART)

• User gets to define degree of (relative) similarity for a given class • Input patterns can be in any order • Single pattern can be learnt multiple times • Dilemma 1: Unstable Nets – single pattern associates with multiple classes

• Dilemma 2: Plasticity – Ability of Net to respond to an unseen pattern

Adaptive Resonance Theory (ART)

• ART Nets are designed to be STABLE and PLASTIC

• Vigilance parameter: User defined parameter to control degree of similarity between patterns of same class

• Learning governed by differential Eqs

• Once acceptable cluster unit selected for learning, signals are maintained for extended time -- resonance

Adaptive Resonance Theory (ART)

• ART1: Designed to cluster binary input vectors

• ART2: Designed to cluster non-binary input vectors

• Learning could be FAST or SLOW depending upon the relative speed of weight updation

Architecture

Competitive Layer

Reset
Reset
Architecture Competitive Layer Reset
Architecture Competitive Layer Reset

Supplementary Units

Supplementary Units 2/3 rule !!!

2/3 rule !!!

F2 Stages:

F2 Stages:

Learning Stages

Learning Stages
Learning Stages

Algorithm : ART1

Algorithm : ART1

Algorithm

Algorithm

Algorithm

Algorithm

Algorithm

Algorithm

Example

Use ART1 Net to cluster (1 1 0 0), (0 0 0 1), (1 0 0 0), (0 0 1 1) in atmost three clusters

Example • Use ART1 Net to cluster (1 1 0 0), (0 0 0 1), (1