esr, aren 2e6mmS Ex 186 Fa 766853 DEPARTMENT OF COMPUTER SCIENCE ‘dare fear, ‘UNIVERSITY OF DELHT, DELHI 110007 (INDIA) ‘ech Rreafagurera, FR - 110 007 (aD MCS. 210 Deep Learning (New Elective Course Outcomes ‘On completion ofthis course, the student will be abe to COI: describe the Feedforward and deep networks (COR:design single and multi-layer feed-forward deep networks and tune various hyper parameters (COS: analyse performance of deep networks. Introduction: Historical context and motivation for deep learning; basic supervised lasstication task, optimizing logistic clasiier using gradient descent, stochastic gradient escent, momentum, and adaptive sub-gradiet method. Neural Networks: Feedforward neural networks, deep networks regubizing @ deep network, model exploration, and hyperparamete ning Convolution Neural Networks: Introduction to convolution neural networks: stacking, striding and pooling, applications like image, and tet classification, Sequence Modeling: Recurrent Nets: Unfolding computational graphs, ecurrent neural networks (RNNs), bidirectional RNNs,encoder-decoder sequence to sequence achitetures, deep recurent networks ‘Autoencoders: Undercomplete auftoencoders, regularized autoencoders, sparse autoencoders, denoising autoencoders, representational power, layer, s autoencoder, stochastic encoders and decoder Structuring Machine Learning Projects: Onhogonalization, evaluation metrics, waindevitest distributions, size of the dev and test sets, cleaning up inecretly labeled data, bias and variance with mismatched data distributions, transfer learning, multi-task Teaming. References 1. 1an Goodfellow, Deep Learning, MIT Press, 2016, 2, Je Heaton, Deep Learning and Neural Networks, Heaton Research Inz, 2015. 3. Mindy L Hall, Deep Learning, VDM Verlag, 2011 4. Li Deng, Dong Yu, Deep Learning: Methods and Applications Now Publishers Ine, 2008. NY ag oars, ert end er 1