Is my classifier confused?

Is my classifier confused? I’m confident

it is yellow
Uh oh!
I’m confident
it is purple

Warning! Just because a prediction

is made with more confidence does
not mean it must be correct!
How far is a point from a set?
Distance of a point from a set
𝑆
𝐰
Distance of the origin from the
hyperplane where
Orthogonal Decomposition
𝐱 𝐪 𝐱 𝐪 𝐱
𝐪
𝐩
𝐩 𝐩
𝐱 If is not unit length, we
need to normalize it first
𝐪 and set

𝐩 𝐮
How far is a hyperplane from the origin?
with 𝐰
means
Since this means 𝐩 𝐯
Pythagoras’ Theorem

i.e. – contradiction!! 
Closest point must be parallel to ! 𝐪
Using and gives Closest point
i.e.
Closest distance
How far is a hyperplane from a point ?
Change of variables 𝐰

Point becomes the new origin! 𝐩

Equation of the (same) hyperplane
𝐯
in new variables: set

𝐳 𝐪
Using old formula, distance is
Exercise 𝐜
𝑟
 Find the distance of from the ball
 First, try to do this when is the origin
 Decompose along and perpendicular to 𝐳
 Find out why this trick does not work for
ellipses, e.g., when and the ellipse is 3
where
 The closest point does not lie along the line joining 2
the origin and centre of ellipse any more  this is the
closest
c
not the
c
closest
1

0
0 1 2 3
4
Have fun!
Join us next time.