Update date: 23/10/2019

89-511-01
Number of hours: 4 hours/week (2 for lectures and 2 for recitation)
Lecturer: Prof. Joseph Keshet

1. Name: Introduction to machine learning

‫מבוא ללמידת מכונה‬

2. Goal: The course gives a basic introduction to machine learning
and deep learning. The course presents the basic theory,
methods and techniques in machine learning, with emphasis on
practical implementation.

3. Class Meetings: Frontal lectures using transparencies. The

transparencies used during the course all appear in the course
web page.

4. Syllabus:
Meeting Subject
1 Introduction
2 ERM principle and Perceptron
3 The optimal Bayes classifier and Maximum likelihood
estimator
4 PAC learnability and VC dim
5 Beyond ERM: regularization, and stability
6 Support Vector Machine (SVM)
7 Kernels
8 Deep networks I: feed-forward and back-propagation
9 Deep networks II: convolutional neural networks (CNNs)
10 Deep networks III: recurrent neural networks (RNNs)
4. Preliminary course requirements: General probability 89262

5. Tasks and final grade: homework assignments (30%), final exam

(70%)

6. Bibliography:
- Mohri, Foundations in Machine Learning, 2012

- Shai Shalev-Shwartz and Shai Ben-David, "Understanding Machine

Learning: From Theory to Algorithms", Cambridge University Press, 2014
https://www.cs.huji.ac.il/~shais/UnderstandingMachineLearning/

- Ian Goodfellow and Yoshua Bengio and Aaron Courville, "Deep

Learning", MIT Press, 2016.
https://github.com/janishar/mit-deep-learning-book-pdf