MACHINE LEARNING

Presenter: Junaid Khan

Department of Computer Science
University of Peshawar Pakistan
Junaid_upesh@yahoo.com
 MACHINE LEARNING

 “… the design and development of algorithms and

techniques that allow computers to ‘learn’ ”
 “… these programs develop concepts, infer new
concepts from existing concepts and revise incorrect
concepts”
 Getting computers to Programme themselves

2 12/08/21 MACHINE LEARNING

 CONTD….

 Machine learning is a scientific discipline that is

concerned with the design and development of
algorithms that allow computers to change behavior
based on data, such as from sensor data or databases
.
 A major focus of machine learning research is to
automatically learn to recognize complex patterns and
make intelligent decisions based on data. Hence,
machine learning is closely related to fields such as
statistics, probability theory

3 12/08/21 MACHINE LEARNING

 EXAMPLE

 A machine learning algorithm for face recognition in

images would try to define what a face is (round
skin-like-colored disk, with dark area where you
expect the eyes etc). A machine learning algorithm
would not have such coded definition, but will "learn-
by-examples": you'll show several images of faces
and not-faces and a good algorithm will eventually
learn and be able to predict whether or not an
unseen image is a face.

4 12/08/21 MACHINE LEARNING

 MAGIC???

No, more like gardening

Seeds = Algorithms
Nutrients = Data
Gardener = You
Plants = Programs

5 12/08/21 MACHINE LEARNING

 TYPES OF LEARNING\ALGORITHMS

 Supervised
 Unsupervised
 Semi-supervised
 Reinforcement
 Transduction
 Learning to learn

6 12/08/21 MACHINE LEARNING

 1:SUPERVISED LEARNING

 Generates a function that maps inputs to desired

outputs.
 the model defines the effect one set of observations,
called inputs, has on another set of observations,
called outputs
 other words, the inputs are assumed to be at the
beginning and outputs at the end of the causal chain.

7 12/08/21 MACHINE LEARNING

 2:UN SUPERVISED LEARNING

 the observations are assumed to be caused by latent

variables, that is, the observations are assumed to
be at the end of the causal chain
 Only have inputs
 Want to find regularities in the input
 Density Estimation: finding patterns in the input
space
– Clustering: find groupings in the input

8 12/08/21 MACHINE LEARNING

 FIG 1:

9 12/08/21 MACHINE LEARNING

 LATENT VARIABLES;

 . The latent variables in

the higher levels of
abstraction are the
causes for both sets of
observations and
mediate the
dependence between
inputs and outputs.

10 12/08/21 MACHINE LEARNING

 EXAMPLE:

 Decision trees do classification

– Classifies instances into one
of a discrete set of possible
categories

– Learned function
represented by tree

– Each node in tree is test on

some attribute of an instance

– Branches represent values of

attributes
– Follow the tree from root to
leaves to find the output
value.
11 12/08/21 MACHINE LEARNING
 3:SEMI SUPERVISED LEARNING

o
Combines both labeled and unlabeled examples to
generate an appropriate function or classifier.

Deduce function from training data

Training data is a pair of input object and desired
output

12 12/08/21 MACHINE LEARNING

 4:REINFORCEMENT LEARNING
 Learns how to act given an
observation of the world.
 Policy: generating correct
actions to reach the goal
 Learn from past good policies
 Example: robot navigating
unknown environment in
search of a goal
– Some data may be
missing
– May be multiple agents in
the system

13 12/08/21 MACHINE LEARNING

 5:TRANSDUCTION

 Tries to predict new outputs

based on training inputs,
training outputs, and test inputs.
 Example: Navigation of
autonomous car
– Training Data: actions of
human drivers in various
situations
– Input: data from sensors
(like GPS or video)
– Output: angle to turn
steering wheel

14 12/08/21 MACHINE LEARNING

 DIFFERNENCE:

TRADITIONAL PROGRAMMING

DATA
OUTPUT
PROGRAM

MACHINE LEARNING

DATA
PROGRAM
OUTPUT

15 12/08/21 MACHINE LEARNING

 HUMAN INTERFACE

 Some machine learning systems attempt to eliminate

the need for human intuition in data analysis
 Human intuition cannot, however, be entirely
eliminated, since the system's designer must specify
how the data is to be represented

16 12/08/21 MACHINE LEARNING

 APPLICATIONS

 MACHINE
PERCEPTION
 NLP
 ROBOTICS
 CHEMINFORMATICS
 CREDIT CARD FRAUD
 SEARCH ENGINES
 HANDWRITTING
RECOGNITION

17 12/08/21 MACHINE LEARNING

 Why Learning Programs?

 Differences in learning styles

 Saves human time
 Helps make advances in research

18 12/08/21 MACHINE LEARNING

 Why Not Learning Programs?

 Difficult to program
 May require advance knowledge
 Supervision required in some cases
 Not suited for all tasks
 Human interaction cannot be eliminated

19 12/08/21 MACHINE LEARNING

 REFFRENCES :

 http://en.wikipedia.org/wiki/Machine_learning
 http://www.lisa.org/globalizationinsider/2004/09/teaching
_comput.html
 http://teach-computers.org/
 http://hunch.net/?p=290
 http://www.machinelearning.net/

20 12/08/21 MACHINE LEARNING

 MESSAGE:

“ A life dedicated chiefly towards the

fulfillment of personal desires sooner or
later always leads to bitter disappointment”
ALBERT
EINSTIEN

21 12/08/21 MACHINE LEARNING