Machine Learning

SYLLABUS
Fall, 2023
Instructor: Jui-Hung Hung Class Hours: 1G4CD
Office: EC439 Class Location: EC115
Email: juihunghung@gmail.com Website: http://www.jhhlab.tw

Week Date Topics Details covered Notes

1 9/11 Introduction
1. Linear model regression
Regression Bishop Ch3
9/14 2. Least Square error
I 3. Regularized least squares

4. Newton’s method
Online 5. Hessian matrix
HW01

2 9/18 Q & A session

1. Random variable
2. Expectation and Variance
3. Joint and conditional probabilities
Probability Bishop Ch1, 2
4. Independence
5. Bayesian inference
6. Naïve Bayes classifier
7. Information theory
Online 8. KL divergence
9. Maximum entropy

3 Q & A session
1. Bernoulli and Binomial distribution
Distribution 2. Beta/ Dirichlet distribution
9/28 (Online, 3. Maximum likelihood estimate for Gaussian Bishop Ch2
4. Conjugate prior
Teachers' Day)
5. Online learning

6. Gaussian integral Bishop Ch2

Online 7. Gaussian distribution HW02

4 10/2 Q & A session

8. Bayesian inference for the Gaussian

9. Gaussian conjugation
10. Sequential estimation
11. Affine property of Gaussian
12. Marginal Gaussian
Online 13. Conditional Gaussian
14. Central limit theory

5 Holiday
1. Maximum a posteriori (MAP)
Regression 2. Bayesian Linear Regression Bishop Ch3
10/12
II 3. Sequential Bayesian learning HW03
4. Fully Bayesian: Predictive distribution

Linear 1. Decision theory

Online Models for 2. Bias-Variance Decomposition
Classification 3. Bias-Variance tradeoff

1
6 10/16 Q & A session

4. Confusion matrix
10/19 5. Logistic regression
Bishop Ch4

6. KNN
Online 7. Decision boundary

7 10/23 Q&A session

1. Incomplete data
2. Specialized EM algorithm Bishop Ch9
10/26 Clustering 3. General EM algorithm
4. Gaussian Mixture Model

Online 5. The theory behind EM algorithm HW04

Q & A session
8 10/30
Midterm
11/2 (To be
determined)