Professional Documents
Culture Documents
An Overview of Machine Learning
An Overview of Machine Learning
Machine Learning
Speaker: Yi-Fan Chang
Adviser: Prof. J. J. Ding
Date: 2011/10/21
Outline & Content
What is machine learning?
Learning system model
Training and testing
Performance
Algorithms
Machine learning structure
What are we seeking?
Learning techniques
Applications
Conclusion
What is machine learning?
A branch of artificial intelligence, concerned wit
h the design and development of algorithms that al
low computers to evolve behaviors based on empiric
al data.
Testing
Input Learni
Sampl ng
es Metho
d
Syste
m
Trainin
g
Training and testing
Data Practical
acquisition usage
Universal
set
(unobserv
ed)
Training Testing
set set
(observe (unobserv
Training and testing
Training is the process of making the system able
to learn.
Supervised Unsupervised
learning learning
10 Semi-supervised
Machine learning structure
Supervised learning
Machine learning structure
Unsupervised learning
What are we seeking?
Supervised: Low E-out or maximize probabilistic te
rms
E-in: for training
set
E-out: for
testing set
erro
r
ree
Aggregation
Bagging (bootstrap + aggregation), Adaboost, Random f
orest
Learning techniques
• Linear
classifier
, where w is an d-dim vector (learned)
Techniques:
Perceptron
Logistic regression
Support vector machine (SVM)
Ada-line
Multi-layer perceptron (MLP)
Learning techniques
Using perceptron learning
algorithm(PLA)
Traini Testin
ngrate:
Error g rate:
Error
0.10 0.156
Learning techniques
Using logistic regression
Traini Testin
ngrate:
Error g rate:
Error
0.11 0.145
Learning techniques
• Non-linear case
Spectral clustering
Density Estimation
Gaussian mixture model (GMM)
Graphical models
Dimensionality reduction
Principal component analysis (PCA)
Factor analysis
Applications
Face detection
Object detection and recognition
Image segmentation
Multimedia event detection
Economical and commercial usage
Conclusion
We have a simple overview of some t
echniques and algorithms in machine lea
rning. Furthermore, there are more and
more techniques apply machine learning
as a solution. In the future, machine l
earning will play an important role in
our daily life.
Reference
[1] W. L. Chao, J. J. Ding, “Integrate
d Machine Learning Algorithms for Human
Age Estimation”, NTU, 2011.