Example: Learning XOR

Hidden Units

Output units

Backpropagation Algorithms

L1 and L2 regularization

Dropout

Early stopping

Noise Robustness

Parameter Typing and Parameter Sharing

Bagging Boosting

Challenges in Neural Network Optimization

Convolutional Neural Network – Motivation, Components of CNN , variants of Convolution operation

Sequence Modeling – Recurrent and Recursive Neural Network, Computational Graphs 10.2 to 10.11

Performance Metrics

Selecting Hyperparameters

Application – Computer Vision