EC-5224 NEURAL NETWORKS

Syllabus:

1. Classification of Artificial Neural Networks and Learning Methods:

Mathematical Model of Neural Networks, Artificial Neural Network Learning Methods
and Learning Strategies, Selecting appropriate Neural Network Topology, Activation
Functions, Typical classes of network architectures

2. Mathematical Foundations and Learning mechanisms:

Re-visiting vector and matrix algebra, State-space concepts, Concepts of optimization,
Error-correction learning, Memory-based learning, Hebbian learning, Competitive learning.

3. Classic models of Artificial Neural Networks:

Single and Multilayer-perceptron, Feed-forward Networks, Self-organizing Map
(Kohonen network), Hopfield Network, Radial Basis Function (RBF) Network, Learning
Algorithms, training and convergence,

4. Radial Basis Function Networks and Support Vector machines:

Pattern separability and interpolation, Regularization Theory, Regularization and RBF
networks, RBF network design and training, Approximation properties of RBF, Linear
separability and optimal hyperplane, Determination of optimal hyperplane, Optimal
hyperplane for nonseparable patterns, Design of an SVM, Examples of SVM

5. Data visualization with Competitive Learning and Self organizing ANN:

General clustering procedures, Learning Vector Quantization (LVQ), Competitive
learning algorithms and architectures, Self organizing feature maps, Properties of feature maps.

6. Fuzzy Neural Networks and Neural Network Tree based learning:

Neuro-fuzzy systems, Background of fuzzy sets and logic, Design of fuzzy stems, Design
of fuzzy ANNs

7. Artificial Neural Networks Applications:

Using neural networks for classification and pattern recognition, Prediction variables and
indicators, Optimization problems

Reference Books:
1. Simon Haykin, "Neural Networks: A comprehensive foundation", Second Edition,
Pearson Education Asia.
2. Kacel M.Jurada, Introduction to Artificial Neural Systems, Jaico Publications