Corditöns dan a valid kenn

oesign
ma ix

Featun
matix,

Gaam matix an kernal gnam maix, 2

.Kum

Cndi tons te valid kennal:

9 Gam matoix Gtmust be positue semj-deinite (pso) .

Scalens
M
 RANKA
DArE

PAGE

Degnaa tuo - alwoys oaken Hhan, O

honce proved.
NoTE
G9 G, PSD thun
GtG’PSD

ERT ’PS

Mences theaUm
Let k ) : R"xRR be
gien
Then dan k to. e a valid Kenngl it is
necceSany and sncient hat o
any n,zm the caesponding kenl, Gsm mat is Symotie
Positvwe' Semi deirúe (psD).
-REGULARIzATION_:
Bais and Vaniance trade-o:

h = et
hea= otx +
Undenyithing "Susssh-Spot"
hi_h bais
evengi
hish ng Valdn ce

Adhg a
penaty eam to poent
pnevent panamatens to
is called Jagulaizath be
becone veny
 tenghego nidge equgtins
tan Normal
he
decay cOeght
equvahoh: updaBe
hoC))0479 -(yn
vessIon (Smothe .Aeto
Co)= L
nom) (L2- | (9) R
where
RCe) TCO)
+ min
wgneSn. ide calec Also
[AIDG] L2-Reg
LA
 PAGE

we wen An a
highen dimen slon:

e pimal whun 2 optima)

Lasso sgneon.
Use L| naNm. 1s
Penalhy tknmg thskad L2-sm.
L.ce)
2

LI-nm.
ML -RANKA
DATE (7 /lo 2023

PAGE

kenal Ridgg Rogne bn

Jo) = min
2.

2 iz|

XERmXn

.and P>0

Lemma !

usher UGRnxm

t' absve imma

Dua onm closed tonm soluton.

J=1

podicked atpot sn tos m Kenol

 -RANKA
DArE

PAGE

Bayesian Agpnoach MAP eohnahon

MAP mavimum aposBeni
Maxium ieël od etngton:

r(y|ain; )

. In bayeoian leanning appoach we ting e to be a nandom vaniale

ushose voalue is unbknaun . In bayean appoach we wad speity
a piior distabuten PCe) that expese e oun piog helees believ¹o
about thu paramleAS.

PCOls) = P(se) r(9)

Bayesan rmodel has tuo componands:

gven ised

max

Padbabilisthc inten pactathion dor nidg geso lon

JCO) = min
2
2
 -RANKA
DATE

PAGE

2o2
univaniate dístibutton

(2)
2I) when I= cova ana matix

exp(-so
262
Sma = ang mqx

let Y = iM3
mlgL
(m log
22

Cost cunton

LASso
J(0) min|
2 i

Loplacian (oy b)
 ML -RANKA
DATE 18 (o /2023
PAGE

k-Means custeaing
" be0 Unsunvised leanring alganithm.

No labels
Heu we want to geup dato tntb 4Rs siilas duslens

" , ’ Centoids Caordom)

CGPA
Steps
1) Deide the nombtn s) cluslens K (Say 3).
2)
Tnitalize clusten centnoids: Hyz nmo an dimensi

Caandoml). we can ausuny any 3 tsaihing points only centoods,

3) Asiqn thu eol clustens: Caleuaie distanca o each point ¡m te inihe
120d Centnsjd.

min - Euclidion distance

4) Move tho centoids

",©, ’ enods Cne)
 RANKA
DATE
PAGE

not
(entaoid ts moved> Anish ew cerojd
Centueid mard caleulaie distane o all points m
and opgat nomsep 3.

Ebew muthed'
wCsS Ksth /rnenti

Elbow point

3 5 clostns

wcss within custo sum Squaud distanQ

w'CSS> wcsS+wCsS
 -RANK
DATE

PAGE

K=2

wcss wcss1

wcss wcss, > wcssa

wCSS denoase.
As numben clustens n cnaane,, s

chaplen 1-lo : Complebcd chaptes is skipped

Exam pre panahon

gost
closed fom
Pnincipal Com ponent Analssis
Unsupevised leannng alg
Dinentieralihy
L g)
woduction dgo
0Rk (K<n)

Bengg
» jaaen execuhon
PCA:

thu alganithms.
2)
Dmentionality voducton’ comprso 0en
3) Eaoie visualizatn ((06Dim ensions ’ 2D |3D).

No. b No shops
C)

"sres

’ vaniahens aleng is man

han .
is mela Imp.
eahue than x2 theneae
Ex!
 DATE

PAGE

No. doms washoms phica

’ di companable tody thenes both x and g

tmpantant
Selechon
No eahue Aeheon is not going to sk; we nasd to use eauna
hause)
Featue ertnachòn is done using poincipal componant qnayis
Compongnt
uwoshsom(miñcipat

washom

Room! (Raineeal component 2)

we carn selet Woorn

Jom nees set atunas.
NOTE: Vaniahin s mpotant pantm en used to selet imnpa tont eatues
 m L

cbjechüe chose that oxis ()

which ha the highet
Vanign a
objeckhue tunchon ’ ma

Saln the dataset-’

make tha moan =0 and asaize pa..

Nanianca =1

washoom (c

Room[R)

(1o|=)

wheu, 0 nnw s wb- spa a

 aCo-20)=o 2zU+ VyL)
lagnag1án: jonmulale cwen pnab., apt. above sole To "
St
mx
input )() matrixCOValiana
U
man
m
|)
nax
becomes! problemoptinizaton 2zap iann he .
PAGE
RANKA DATE
 -RANKA
DATE

PAGE

Eigen vechabs Covaianca matix,

And Yhe saluton tha opt. pacblem is

Eiqen vecta , to
maximnunn eigan valoe (àmax) covaniane matix ceesC).
porn aing
to k
Therejano t waduce dimenhon inputs select the eign vecns ( s
k
ejgen seets valwes
top

7Uky -- Un

eign value
 ML -RANKA.
OATE 31 o23
PAGE

MLE in thu prag enca sl Jatent van ialoe

Expec tahon - maximirzathon
algsnithn:(EM)
Unsupe vi sed leanning algo.
USed
4an densityehiraton
Univaniate Go: - (R

mulhvaiahe Go :

Suassian mixhu modal

Halack

- It is tha Ainean supeh posihion dienont gau 1an S

P(x;A, E) =j=t

PDF GIM. Hene y is mixing cot an pnis plebabilithy

j= P|z0=jywhine z0) an calad laten/ hiddan vaniabko
These ang Unobsenved vaniabes.

ieh j is the
(ioTE: ,> prob g wnieh data cluslen /gausian tha point j belenqs.to
 RANIKA
DATE

PAGE

yo {knsn)Unsupvisedyz) funtnaan tatentJ

SUpovised
z0 Mutinemial (øø2 k)

SBeps

Repegh unil convens

E-shep Fon each ij seh

Agosteoian pnobalbility /Reonsibily

 -RANKA
DATE

PAGE

Repeat until onvergano 1

Step-2) E-slep fan each iz set

P(20=j)=
poslenien enob.
/Responsibilihy
shep-3 M-step Update panamalens

thane is no
onuengsnaJ qoto slepa.