Mathine

earning
A Case study
Approach
 Supervisa) ANT
Kegre ssion

APp Predichng haule pmce.

Lineo seleCd
which b ne is to be
Fegressidd deccdedw}th RSS
R)wetwate
f(a) WtWiE
Slepe
INtercep
(W Wa) are
Re ress ion

Suare fee
esoual edneuohich giveS mîn
Sumot RSS Snold 6e selees-
S uateg
RSS a
C

WotWiaD} (y3-vNo tWiAs)+

-au hGuSes
redu eHn
House RSS ww) 2( -LWotw)
Wo Tnercept
44

Wo WatWIXAEo
AR By puin waue at x tesyfee
we h getpeickd hnte
Pie
 LANII
Data

Highe Suadaic Eauaion verH4%n4

Orde
Regressidps averminimied SS
13thordegPo\y nomí ul4i

tCx) We thtW1
Thercep f ee
X Square feet)7
2aune Poices ot house
Cannofbe se
Hence as mode complexitY increase g-
i e gveyittoq ocuY en uwbich (£a ds b Overtttn9 ive
PToblem
problem andnat gu table model
Hou to choose mode eomplexityZ-

Remov some o houses ronm

data FemporaEy
a)Fit model on remaùning data

predict heldout house

SPit dasa into
Training data
Test data-

we 3pit dada to rain and model. test ind

thar S raî ning data and predicfar fest
odata and found he per formante at mode
 ANT
De
Pre

raining error Tess ermor

fest dato
Trainimt
d a t a

find value Predd tHonS

of w usingwN
S9ft Saft

TraininqerroY CW))= Test erYOY (W)

$ain tw (sq.Mn, (test- fa(s9ftres
(srain -

fu(sq. Hrai) +(Sts fa sqfta)

for au data for au RsT
datu

yanaion of Test/Trainim frors with mode Complei

As we încreaSe model
complexi ty we A} Hhe
tsa ni ng9 dara moxe
Presely as
seen in
test erroY ( )
OverfiHhing forPoynonmia m
hence traun{nq eror
decreases

Trauning eror)+But with ncrease in

complexiy test eroY
decre ase to optH ma ad
Model complerity then inueases due 6e
Ovet fHina
 ANT
Pagi

4dding other We caD add morefRaruye5to mode

eatutes (=Wo+WiG)+w6}
intercept sgtr # Bost

Bamvebms-

69ft
Here we added o eause mode
ot Bathrooms shich
to neve twofeaures and whichis givenb
hyper
plane
we als Can add nmany more feattres omode
ke foY house pmce
Sqft
a) # Batroom
3) # Bed roomS

Yeo t built
 A

Ofhev eg: Where egressíon useo

stock predicthon
Depends on- Recent history
a)NewsS event
R e l a e com modi he

Jweet populanmty
Dependson follouwers
) # followels ot folloe
3)feaUre o¥ text fweeR
potucuty ot hashinz

3 TemP cperHcwlam spae in smat house

Depends o hemosteu seH}nas
open asedwinoaus
)Vents
4) Tenp outs ole
)Time day
 ANT
Pago

Regression m Blo ck Diagramn

bouseidarhibues
4tBathrooms Regresson
Feature Predicted
Traininq ML y heuse Prce
Daa Extracio) model
weegbts
(A) on featunes

gaue
Mt atgeithray
Eror Rss =

guolitL
meicf
 Super vised) LANT
D
Classification

pucan n spamfileDns , Suggsting he Cargones ot atide,

Uideo ec Image classificaion,disease ciassificaio
Reading Ou mind

nea To classify revie as sentene is posiHve o2n9ah

Csifie Count at posi Hve..uleTdi0eaaiue words
if t posilive z # negahve eviayis Postive
List ot PosiH ucttneghve
OTd werds
9ood,iect e fad, oor$ er

Simpe Tresheld chssifr

ve ve wY ds
fcow
+ V > - ve then revidu p0s}ive

Simple threshold have problems ke

Hou to get ist
tVe or TVe
a
woTds nave i . deare et e n a n t
Leg goode grer
9 Smgle woneds men' enouyh we hee
ddress iE fY mone 4eature
Leg.good
nat geod
Hence
Hence we wil) use tran}ng daa wi H a s n esh
ita ollou and eNamine he s e n e n e e fleOo
goed = 10 dwos qod, tase a g
seTve ods ble
Yeat S
Cuesome2-7 SCoxe) 247-a
tembe--2
2 AS Store >o

Kevie S poS{nve
 LANT
|Decision If only two words hove non zero uweignt
oundoay words uweigh SCore LO # Aweso me .
fOawesMC-ASaefu
Auesome Seoreo Dic
Aweful-15
Sushi twas auesome
Food uas esome
8ut Ses v'ice uas
aweu SC
awesome
Decision eoundany separete PoSHve negahe
PTedicHOnS.
e t w o weights STe non ze®
TIne C20)
a) when three nonzeio weiçhs
pane (30)
uhen many non 2eho eiant
Hyperplone
for geneza
Comple tak shapes

Training classifie
paro wan
TYalnino
Se team
Datat Cdssfie au ful-

Eva
froY *predfukey
total senkn Accua Riaht Fr
foae

Attturuo Emm
 LANI
Pag

loc diagram TeAt to review

wOYdcouunt predithed
Tunm featueE A MT senHmet
data exnatHon Mode
weight
ferect
sen ment
abe MLGlg
uali'h
Comeare amd y
Hnd acetran

We evaluate the mode by Anding error and

accurOCu
What is aood acuurauy
Wnen we ave Bino>y dassifiahon random)y seleu
gives O:5 acCuroty
For k classes acturacy is ccuraCy
So as with random gues Simg ge Such aCUTO
we

uwe teast, least, east beat he aturay geHKrg

by Random, guessing
e9. Tt we have 3 casses we have
0:333 o r random
accuraoy
guessnq
we must be havino a leat
ACuratby>
o333
 LANT
Dese
Pape

1S 90: accuracy is goo4

AnSwer îS t depends
AS d a f ShowS from sto 2a16 9Ó emajts ge
wete Spam.
hence if our modet predick eveky eml
Spom,he also we achieve 9o7 OCT

So we need to dig into this-

ook
Took foY gsejine apprOach ie Tahdom gus
majonty ctass e in emait cese.
uhat is the impact ot mistakes eryos
f impartant enough emaj sent dSpom
if disease geh undeeckol,

TMpes oE miskakes
Predicted lakel-
t Diferent mistakes
True False bave ditferent, impa-
PosiHue negahve
False TYue
TTrue PositHve Acura

Positive hegaiv True negaHve

3) False Posittve enof
4 False regohve mi
For email fillennq
--

False negaive Spam email in inbo Anno

False Posiive 1mpoYtant emails lec > Hovm
Havm
 LAN
Dai
Page

for disease derecHon

False negaHve Disease.unreajed Hormfu
false posiHve wastefl treakment less horm

lence 0e need to look for the cost ot uwrong preoik

Confusian mahyiX
Heal thy Cold flue_ 6OFIZt2
Healthy ACCUraCy o6
O.80
celd

flue
(1
Here we need to look for the wrong Predicion maklng
wnaf imPactand.whaur is consquenues which wi 11
Cost most Ond prepqre Mode accord tngly
 Dete

Even if we provideintHnike
cata en.
Bias andther iSalwdy
Cannot be o

Some errov wnich is Called Bias

Bias
Bias i
Amount af Traing elata bfagya
Mcdg

In our made of senHmenF classifi Sigle w

are ok but when it Comeg to CombinaHr
of two wOrds model makes maStalee
eg. Sushi uwas notgoe4

Hencewe need MaxeLamplexModel as

word weight
+15 -Biagram medel
Not 90od-2 tess errors
more acura
ess B(as
BY Not CompleN
alurate
SH have some
Bia3
 unsupenvised)
Clusteingand Reriepal
LANI
Daac

To And Similar avhdesSike douuments

PP
emevo we And distane beueen Queraydotumen and
nearest alothel dorcumers
ekahbo a Nearest neighbouas 1etuned
Search

lgosthms NN algomihm-most neighauy neaYesB on 0D

)_KNN algomthm. aroup/set o nearesi ndgy bu
Nedrest NeignboY Search
we get one qrticle out ok CoYpous
aSpecfycdistance o ach qHde toith euety aide
and torm distance memcs.
3) orhdes aoving esse distances remevesd tos Gue
article
i
 EAN
Csiec

Word count document RepresentaHon.

3 2
the SOGce gmess

We COunt# instancec for each ward and torm vecth

tor
for each documents and iook for slmilamtyd
documents based on uord counts Vectoy DrOducs
Simitant for Doc L8 2&3
Doc o |o053colddoo similaiky Dacixo
Doc 2 Baol ol 2loldulollotoo 13
DOC Hololo5 3 olollelooo] 1SimilamH =Docl
DOL 3 30olo|6 |4|do/2]olo6 S 45
1
hence slmilar Doctiment foy S 3

Issues with uuord Count a

AS ther are common words ike the, ar'and
which Qre present in au documents

PAS
AS Short doumen} have ess cownt of wards
as Compare to large documen iS hence it
hampers the resuLES
 LANT
Prage

To handle
handle Short and Lona Documents.uwe use metmod
Normali2atiom

DOC I

nomali 2aHon Y1+52+3+1=6

Normalised
DOC &oo lsl£lso
we use this normalised fav document
yECtOY
retieval as regardless of dotument si2e
t treat document COuntS equiNalenty
L

To handle frequency of rare ords Common

wOYdS USe method. Called
TE-TDF-Term fequencyInverse Doc Frequent

The most Cammon uwords wich Comes in eve

clocument must be downgraded ike the and'
also etc Commun focatty
Rore 9obly
Rare woTds 9 wotds appear in feus doc
Common words 3 ords appeo in evey dec
Commonx
globcui
 ANT
Dete
Page

CalculaHng TE-TDF
TE -Term frequency

|O0 5
ne mesi

IDF Inverse doument frequenCy

manydocum e n
F

the
14
words i n

log DOC
togi#lor
hence
Tt# Dc having wSrd the
Wo13in
globallly Common wOTds Tein fed goeumIt fe
l0g ldYge

dausngTaded andRare words upqradel

by Te 1DP
Now TA-IDF = TF * TDF
mmti
TECDE
tfr tDf
Use foT DOCument reievat

2
 LANI
Pags

MulHclasS classficaion (SupeaJTses

WoYld\
new
Eneramen
SportS
arHcle to news
ckassifiy Politica Tech nolo9
into g a o g o n e TNews
Here we need to give lqbels to clusters unidh causes
tbecomes supervised leqxnirgs

K-meanS Algo
iniiaHze cluster centYes randomly whereuete we

UJant
)ASS)gn obse rvaHons fa 0earest Cluse cme

)Revise und update clu.stey Centres as mea

of o b s e v a i o n s in Clustee

Repeat Proce unHl ConveTgence (s tep &2)

ASsgn updla
 ANT
Doker.
Page-

Examples
Gro agle Secrch fox images
Croupin paience by. medical Condih'ons
3) roduc Search on ama 20
Sucuina web seanh result3

Clusenna Block diagram

doidTable ctusteing9 EStim
doc-textj TF-TDE cluse
featue abe
Traing mL
Data Exhathon model

Cwsttl centse3

means
ML algornthms
>Distance tu
Qualiky CugtecanTe
memds
 clASSMALte
Date
Page

Recommendey Su Stem.s_
Appliaon auHube ,NeFLü Am2on MUSÍA,friend sIgqesHans,
Drug taraet interatH ons e if ape medicte
is usekul in treatement at one disease IE (od
be usekul treaHng Same otheR dASea sAA.
Druq trget

BLldind Approach G -_ Based_an populany producS are

Recommpdsz Kanlced and sugq ested oalcording
Syser -larity)lbichbas linmi.ta.hions far globalpapis
personalLss
SugaesHons

Appraach ClassiticaHion_model
-To find uheadheR person uloLudd \ie ar nof
purchasi ng the radue.
Usey nfo-
gende
i) Age es
Professio classitie
v PUrehasing No
hi_tory
Produ c ihfo
Limitations keatures ike usey info, Praduck into
May not be available
 elassMat
Date
Page

AppY Aach2 CollaboratHive fAltenng-

- peaple byaught this also buy
CO-OCCYante fMarmia
2 3
Product

PYoduct tte NO Of pecp

HfchaSTT
C
matrix
2
Somee
PTOdu GS
t
3

PYOducrT
xoduct3
given matrix
IS Summ mC
ma tncS
Hence e peeple Buyina DrOdu
and oo people Buying proeluct
ssameCi:Cji
o recammed the produuc
)Ne go to p1Aduct row
a) Hind Out elemeni having most /1argest Cownts
3) Recommed_item bavinq bigh COunts
eg person buy Bably diapez
Baby L 7
diapez
Bab Baby aby aty
toy p e s food
most

is
Limitaiong TU
lc
itep
s e l y tobe
But this CauseS Retommendation
uwhichis based on papuloats and draun doun
effectS hence ue need to narmalisationaf papu
follaus
NarmalizaHon--
Purchased i and j
tPurchased f or j
 CTA

Dale
Page

Weighted average of purchased items

user bought items diaper, milk

t
weighted Score faor ( Baby uwipes) (Sbabywipe,diapey
Sbaywipe milk
milk
we aak tor purchaSe histary ie diapeR
we aok rar ra a this p10duIS
cofactor
3 I any item is to be éecamrnendeo fran
mahix We ook tar it tore9 6abY wipe
ind tPeaple purchase d baby wipe &baby diape.
weind
nd
And_# peaple_ purch.ased baby wipe& mite
LE aweragefar welghted gcOTe,

Linitaons
1t daesn' loak for attet teahures ike time at day,
User's ioformaion Producintormaton
Cald Start problem whep their ii no bista
AppYoach 5 -Discavering hidden StruckuYe by matrix
tacharn2aHon.
LE Some users bave watchedome mavies and
Kated those movie uie have moatix with user and
therr raHng for mavie but not eveny MOvie_Yakd
by eueN USer and his bnk Space coun 6eHled .
And 6asedon that maviegYeçammendEA

NoW white spaces. f11led up

by looking tor mavies
user ated and predl te d
the raing f unrate movse
Complete el matix dsec
moviesS tuathek for tecmmeHckhe
2
 ASSM
Date
Page-

Let user 1 Razed movie 4 as 5 ratng3

movie.5 L2
Achon Rcmonce COmedy dYamg
vector of feaur ond ther uweigh iS kmwn

usey 1
ACjon Romance (dmedy yeuma
Vectoy of_ feature_and theiy ueight_a that ke j
tOY moVie Raing of unknousn smovie

AcHon Romaun ce comedy oam

movie 4 1 3
user 2 3

Kaing hat user may 3tve secided bt-Predu

Raina fer mavie-| 34 5 xa +3A3 +4

Movie 4 usex [2 3 4J
32

Based on the this Whte spuced itted

PrediaioTS MuÝx erm-

Raing
_maves-
vecto

PayameieIS
user o t mo 4e
NectoY

When we aet product a yser yector and_mgvies G

We get au the voAues m e t i x
User Vector_z Lu - Action Ro a n t e (omedyH yam
element

PAOvie vector
elemenDt Rv AcHon Romance , Comey duma
 clASSMAte
Date
Page

RSS (LR) (Rating al

given -CLu R))+-. yated mavies
T
OCtua PYedicted
RaAng hnq

Cimitation
cold start prablem. New movie
NEW User
user Matri
factonzano

Prrodu c id redi
Training Faure R
Dara
LExbaian ML medel

RaHn9 ML rith)YorS
meri