Machine Learning for Signal Processing

EHB 328E

Ibraheem Shayea
Electronics and Communication Engineering Department,
Faculty of Electrical and Electronics Engineering
İstanbul Teknik Üniversitesi - İTÜ
Course Information
Contact Details
❖ Name:
Ibraheem Shayea,

❖ Office
2409 Level 3
Department of Electronics & Communication Eng.
Electronics and Communication Engineering Department,
Faculty of Electrical and Electronics Engineering
İstanbulTeknik Üniversitesi – İTÜ

❖ Mobile Phone
HP. No: 0 538 447 36 26
WhatsApp: 0 538 447 36 26

❖ E-mail
ibr.shayea@gmail.com
shayea@itu.edu.tr

❖ Website:
https://eskiweb.ehb.itu.edu.tr/index.php?id=viewprofile&person=shayea&lang=tr
https://sites.google.com/view/ibraheem-shayea-/main-page

❖ Class Homepage:
All handouts, lecture notes, announcements, etc. will be shared through:
❑ NINOVA , and/or
❑ WhatsApp Group
Assessment
Grading:
• Midterm Exam: 30%

• Term Project Paper : 30%

• Final Exam : 40%

• Attendance: Student Must attend at least 70%

General Objective
❑ Introduce the student to the basic techniques of machine
learning geared towards signal processing applications

❑ Provide the students with examples to develop their

programming skills

❑ Gain a working knowledge of probability, linear algebra, signal

processing motivated by problems of current interest
Course Outline
Week No Syllabus No Syllabus Subject Date

Week 01 Syllabus 01 Fundamentals of Probability and Statistic 15.02.2024

Week 02 Syllabus 02 Distribution Functions 22.02.2024

Week 03 Syllabus 03 Fundamentals of Linear Algebra 29.02.2024

Week 04 Syllabus 04 Basics of Data Representation 07.03.2024

Week 05 Syllabus 05 Data-Driven Representations 14.03.2024

Week 06 Syllabus 06 Introduction to Machine Learning 21.03.2024

Course Outline
Week No Syllabus No Syllabus Subject Date

Week 07 Supervise Learning 28.03.2024

Introduction to Supervise Learning

Week 07 Regression 28.03.2024

Introduction to Regression
Linear Regression Prediction
Stochastic Gradient Descent
Week 08 Midterm Exam 04.04.2024
Week 09 Term Break 11.04.2024
Week 10 Support Vector Machines (SVM) 18.04.2024
Kernel Support Vector Machines (SVM)
LMS (Least Mean Square) Adaptive Filters
Boosting for Regression
Polynomial Regression
Softmax Regression
Course Outline
Week No Syllabus No Syllabus Subject Date

Week 11 Classification 25.04.2024

Introduction to Classification
K-Nearest Neighbours (KNN)
Decision Tree
Logistic Regression for Classification
Support Vector Machines (SVM)
Kernel Support Vector Machines (SVM)
Course Outline
Week No Syllabus No Syllabus Subject Date

Week 12 Unsupervised Learning 02.05.2024

Week 12 Clustering Method 02.05.2024

K-Mean
Hierarchical Clustering

Week Association Method

Apriori Algorithm
FP-Growth Algorithm
Kernel Principal Component Analysis (PCA)
Covariance

Week 13 Dimensionality Reduction 09.05.2024

Principal Component Analysis (PCA)
Kernel Principal Component Analysis (PCA)
Independent Component Analysis (ICA)
Non-negative Matrix Factorization
Low Rank Matrix Representations
Course Outline
Week No Syllabus No Syllabus Subject Date

Week 14 Syllabus Neural Networks and Deep Learning. 16.05.2024

Convolutional Networks and Applications to Signal and

Image Processing.

Week 14 Project Presentation 23.05.2024

Useful Links
Machine Learning for Signal Processing
o Machine Learning
https://techvidvan.com/tutorials/machine-learning-algorithms/

o Deep Learning Tutorial! (Stanford University)

http://ufldl.stanford.edu/tutorial/

o Online Video Courses

https://www.youtube.com/watch?v=jGwO_UgTS7I&list=PLoROMvodv4rMiGQp3WXShtMG
gzqpfVfbU

https://www.youtube.com/watch?v=i_ZHxMTywII

o etc.
Useful Links
Machine Learning for Signal Processing
o Machine Learning for Signal Processing
http://opilab.utb.edu.co/ml4sp/

o Machine learning in signal processing WS 20/21

https://machinelearning.tf.fau.de/course_mlisp.html

o EE269 - Signal Processing for Machine Learning

http://web.stanford.edu/class/ee269/slides.html

o Signal Analysis, Models, and Machine Learning

https://isi.ee.ethz.ch/teaching/courses/sml.html

o EE 425X: Machine Learning: A Signal Processing Perspective

https://www.ece.iastate.edu/~namrata/MachLearn_SigProc/

o Machine Learning in Signal Processing

https://www.lms.tf.fau.eu/study-and-teaching/lectures/lv_id/21755918&sem=2020w/
o etc.
Useful Links
Machine Learning for Wireless
Machine Learning CS229: Syllabus and Course Schedule (Video Available)
http://cs229.stanford.edu/syllabus.html

CSE176 Introduction to Machine Learning — Lecture notes

https://faculty.ucmerced.edu/mcarreira-perpinan/teaching/CSE176/lecturenotes.pdf

STAT 479: Machine Learning Lecture Notes

https://sebastianraschka.com/pdf/lecture-notes/stat479fs18/01_ml-overview_notes.pdf

Machine Learning (ITC05F)

https://www.u-aizu.ac.jp/~qf-zhao/TEACHING/ML/ML.html

Machine Learning Lecture Notes

https://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-867-machine-learning-fall-
2006/lecture-notes/

6.867 Machine Learning (Fall 2004)

http://www.ai.mit.edu/courses/6.867-f04/lectures.html

Introduction to Machine Learning, third edition

https://www.cmpe.boun.edu.tr/~ethem/i2ml3e/
Useful Links
Machine Learning for Wireless
ML course at Coursera:
https://www.coursera.org/learn/machine-learning/

Toolbox scikit-learn:
http://scikit-learn.org/stable/user_guide.html

Caret Package:
http://topepo.github.io/caret/index.html

Python and R codes:

http://www.analyticsvidhya.com/blog/2015/09/fullcheatsheet-machine-learning-algorithms/

Introductory Primer to Machine Learning:

http://www.toptal.com/machinelearning/machine-learning-theory-an-introductory-primer
Text Book
The End

Thank You