Pe _MACHINE LEARNING ak danived poem zal a domain Ar (Arh} cial Intelligences) © know Made O Reascning capaoi bthy fanning: pp 4 Coveney expertnes site expottize. machins learning &- iy vu prow dr pochniqut which subi ably includes Hu P A tu om O: partinlan task T shrough gnpsriane & does mods waking, | pudidion , Tonelhiation ) anally efor - ducisiom wang . Expuleaos- pata set (we hawt to tonuet Hum satlo Mrudiuud form) t Aecunad predalon Eres. 4, dt 3 + tuples | vecoreh 82,03, ( Atrmorctio)© cupetvstd haha —> 4% Ww uae ofp [labs | bound bruth a9 a © Vnsupervised dearing > Mw is no ofp [Label [bound truxn ® sem? Supervised Ararning @ Rein porcemast Asarening Wu sole of supetvi'son 2 to Vveufy or nol supervised aecibeget 4 NS Classi ctf on bn Cwe can prudict olata based on pant fabled olata Ex Quick of 0 parhoular shane ie _ mrantut r yaad dees Teduniqur | Yuethods .- We Sechnical method of wnsupouuie Larning is lusting FA: Amazon , glue pak — Semisupenvised 1 da a = ik of supervised and i unsupervised. 1 — Beinfonernunt e-ha 2 = xwvord, pratt Senhhis Agent Achion . 5 Envisooment 4) SUPERVISED / EARNING, °- maduu—> whith takes some Mrput 4 gives output. / wag vit ’ , ata ReeBataan ES (A Com be Angle Limensionsl ale 24 mulhichtmwnsronal) dobel 'y Cy ton) Cea or C hearin fe f 2 AeA) eg f zy | d fesetion EE ce | mes eee ale ghee 4- f(x) = we +L Ny +9 HD or | re 7 2 Wo FW) HE TWH, Hy + LOVAP so ici on SS panamein Cposihion 5 dufeug | Binoy vay iters) ~ Data (x, > 2 mnte tf ng). eite 4 My Rey Aged my Gand . . aia ort 4 No. ¥ Yi (araxen a) =2%%2 = ntl a 66 Nova. functina = 2 8 ae called pypotrehical fusctions.5) output assouatid uscth 4% example vis 4 a : Esttmalid Cpudictid ofp) 9 2% examplr is : = Case! on uypothesin Junction) ae D,@ornlt nro © & mou WOH oO s juprh unchon dy reprusettid ey hut) (w nuwans panomat) yt ae actuod hw(x) = 0+ 94 Yr B probit Cruype techie) F Wo tw By chanat le » . fay wn (de U0), Srv = € Cyt_pt oh - i Tetal Er EM 0) position gy Lint changes gum douand ervor= EC i gaye : q 4 wb ae cs eakmatid y mean dquan over ~L ow” fon it example “ eam." = a el Cy! hw (ai))> SS huo(ae) wi = i TUDA, + Lo %y + ----- > tUHXy Cn Actus ') ors (Xo= 1) lwo = Nia; Xo ; ne) x 4 \ lon, ) Garg Xo} (nei) x1 = ie Wo ¢ Wj) a) W=0.3 pe Ss oh 4a) 2) W=0.7 s 3) W=hs Res (xi)ewe +W1%y yy az 2.0 mais 7)oy ( Ci-1x0.35? (222K 0.3)7 4°08 280.57 + Cu- 4x0. J - aC Cid0.5)* BNC g)? +(s-6.9) +C4-1. D7] = aoe oii piywe Hasesd | se POR 3209, & : An0.9)* + (>-2x0.9)%-4(3- 3x0-9)” + cu-uxo.4)* )Be (nd)? | te + aly eae )) sgilat bp Ke a” fe qe S Wi = radiant Dasant Algo (a6 Alo Sept > worsoue vals of Leoarvng sta Kaond Arpping aifol se) fe, x a hyper parormilen Cros we prt just chong not caleulating), Step2 > 4Anibalise ws stp3 > [scat = Wold — xdt KH K dw Skpy> duck, Atrpping citi. ef aahafeld else go to stp 3. ‘ Wott) = Uo%e t U7R5 (w=1) hho( nH) > Wor t WiX) : LX yt (wore rujra! ) (x24)Wraw * Wold « « «gi dw Wyre, = ¢ ‘i o,. ¢ \at dale cee ange in % Ee (y 7 dy fos jen yaeagntinty zy : oi Awl = WOO 40) FWeHe HE « ~ Warten Sues wie (yadiiint Descent Algo +- 2 Reatune dcaling = (tox Aosimalize aU values from ofp 2) WH WLC wvanges from dtos] | max val > AW tealtuws ranges from o to 4. 3 wan = wald — K do Ute Tew? dus fine Wee 2 oe Gee gy tet on cod o. coluulab \w' for 4 =0.) OS, Kel,AeD Y eration > wWnw= 2~coA) (u) uonew = 1-6 — O-1K 2K1b o = 2-04 246 = 1.28 a=! = ie ) we 2- Wu) ) OF 2-20 toe ea eae Perce FOr ON vj) << « - rez]Pa eo \ hropping sate + € I's lice Purp ddeolly when $20 (x) < Ceame as fe an dy ae Way ee) he eee = < i uve 7 Use evitenia. ay 2) \33| 41 FO-QyTK + OxT x Ht is large, 4 aw ao fer minima ox ynaxima Adu =O AxTRe = 2NT% ( wucttiplay tov» fds wen (xt 1) W=VKYTOT W = KYT(KTy)T . perme Go Ondithin. Oe ING 3: Size > mers Latoya Wrecieery omer Qu wil as dvi hh bia (weassumed 8 ln ean cour] a abaads) D hye traiming data 3 Ln murenbir of -eoTures Noga ft Aadgh polymorteal T dug fotiineyto 5 © Wg FAdv lem ow ya “Se ola EADS) 130 on) ? q i a an ee a Ridge Rogul - (4 Asgular sanion) deta larization [ mle ye Regal. (41 ” ) soem” 5 Elastic method pA ceraleeely cep hw (We (We Wo TWA t+ Wet + tog nF + um uly) © wot Wik) TwW2Xt + We gt LOuts hws) = Wott , ; © = 24+3x } : ae = 2 -+0¥ We Basta, UA daguiaiiom we wd te reduce parece 4, Arot pus 4 onion tg udinigahin i ee 7 bE gle)” ot é e ai = NRY igohionRe ra) As danges (wit owt only fousra fp reduce parametn wo) ') 5) << stay do sete 28d dem’) A fd valu a wo for ain nurs 2 (by taking asi vaben) A: oli dhnimbiage omd selection qpecator) Regularization 2— Fo af Ey chsle))” Ab il] tcl See PER MOA be xno yusors fystix rduerion, Rédge amd Lasso sugular’s atten, ek evo ‘ : ‘)2 ae e_ huotai))* 4 AU Ci-0) 5 4 i) ; ia r_ © CLASSIFIATION fan we wse Uncan Siemon hoy oa Chssift coh Ans Yes 2NO as oe yo >y outpu U yo.6,awd1 ‘ yp rypotrusts sit) 4 ng Bult may ae = abro (29-20) ie whe a ert : = al 24: ¢220) eee opel eo ne mig = (29 be SN eo, = heol x) =LOTX ee , Tae 9 et Sao? oS ULib 0 9 hea id (ror ou : ud Wi heold) wer > 1 C45) gover be caoe det Ss Newub-ja 8 ae z eoowk- dk mont 0 awd islFears ° : GHaduint ces cnt funchon need te ania a Works ry pr optim) L,_t0 get convex at WD Conver, 40 use Be Cost (y hw) = beg Chwlsd) for yea base coal = lag (ih) °F Yeo oe “= NO ' neg" ea Cea i “9 fA he bod Brees ees” eel Le. i Esthet) t a (rota) 3 > wx ae «hwo. « de © coon sasdhol ¢ hwld. (t~ hol) - oe a dy wu Oo aid ee en fai) | HW). Chat) tb ay iol) = hasta) PHL SL yi Cenotad = (eye) hist hip 2 -1 2 [ vf - bot) ) om heolal) *Yoho)] te} E é w(t Bie Ely ~hela)) Ke de aw ;Borer Rule i °( Ala) = ea a0) e( e( RB = e (Bnd) (O , CC® P(Ane)=0( and) TB) P1). = 0(a/n) 200) (P(Ale) = cpa ETRE PCS V= P(Xa)- PCA. CS) ce oe PS) = PUL.) PCO) \ US . ‘ Outclars | = Argonay 4 Pee) a} ‘ — aie max valu BaAit2> 0 9" © vale a} Sega hot , posmal Rere% os K ung pnormal |, 3%) > This isnot oun dataset We 9 i neohwr nme oF Nob eee Fae p(Yed|.) e(No]) PI? yes) # oCyes) formal, sirongs)’ hot, normal sreona| yes)» PCYes)bal aE |S" fal | Pein ar ae —? day ; P (va! Sunny , eee At gal (sana): (228 C2 oo = B07 Boe G7 Wa 8 4c %, = igs P(wo| «sunny, hot, Normal, smong> = Palo). P( (ety). F {+ P Ca, p (sme) =s panei, Si 2 cee = Sa = Go49) toe. BS Ss aa ot | acral, shore) = Ayos), Peet yes). (i t( “Se, #(Smory hy)=e ¢ (Nol cou hiner) = MNO), P(Overeab hs) HC Hota) F/ ‘ No)* P(srong hig). “20 Nort j455 Ko 8) OK wo . Purdafleis gibiabion, LAPLACE SMOOTHING Uk by a mascd Ushich beod Abt condition ever unde nodes P(g) = men GC Cle) {te} ~ On P(t) a oe % * Smoothing Ruramdler| Nase Ne No: of examples F wth =¢c Pforwelic)= Ott = 4 ea) (ements) ee Kino. of fentn. “ts Jw any path ef yedrtar. unique path & [Rested Dat) up diveetsd aaph won propedy of Ddhue ws erocr ly eye now) nose Jy dagnte as | Bye oll rot of ™ Pe 3) AMI ctr node» rust have undagus exodly 1. * Nodes cnaving outdeqss (wo) aw Known as af node, lasvea, NS aa "external Sad £294 oo! ay deo J external Node au otm node aro calledr ‘DEUSION REE aD — WY yooted Ince oe eos sap tion ee ost Of 27 given @ach Node Meprerurts OM atinibybe a — Baa Have max { polls Yolus ef ethng See Xoct un awe oihiy otaset ”. 14 2 capa plited datasel based on Valu, | eae Doe Uison, appioash De eo sent te seach pan rods rors ack SPH odes eH Lief nods ks eet Tuy Jur a clatact yh aw wy examples au Woulatid oP vene stale. shar Ansys }2 At usta Dp, ; \ D hae Pca ; Barty ae ra Pex) Jag Ce) . ~PC) Sag) a Leama os C2) fg cs)Alvainut of a (fats) walen gives aman anformey) gor wi be Foci: a ivalmablin.s > datast should be pighty Mmpurt . (d= ~ € ee) dag pC) a Ss! - 2im% ss 3) 0-56 "op an Voc llene ein) > ete Sect Ye] | am ECO2) = O $ 2X =-0.55+0.96 TY 4G = BRO. NG2 5 = Ou) [sqeou) sod maar be O12". Ba ot" \m wit prudice vorong. 3(rape) see wstr 1O3 algo. CART “Algo. for Decision Tree Oso" 0 int ioclex Eegri0) = 1-£(8) 2 kK Fey -ley = 0.362 ee é BO INS 2 alr ucint obs So ie iadSEN Ourlook 2. ¢ rst ae 1 2 dre ena VeUie Og = 014 [| (0) = '-(2)2-[8)"- ove a Poe Pa Gal ds) =0 Galod=1- {gy (8)?-0¥8 y a ie Om Jum 25 o.ug 4x04 S xOUs= 0.343 ta te (Cm Od after aptit Reduction fr Impwuly = ©.ug- 0.343 (ouslook) = Ome Gra) = \- (wr-(2). Ogu HOR ILM (VR eee SGI Or 069s, 0.38 AN} we OUv-o.uy = 0.022 GBC) = 1- (8)-(4)% < 1-04-00 Gtlos)= \- a (24 é “(3)*- (4 = 0.1803 we nigh = ous 2y Reducion fr uN 20.06, o 0.24 + TOUS 0, Or re w o 1 c ~ eGo. sour} (0.43) = Ob - 0-365 = 0.095 =' ly vi IN Ex ouy Os F PREG LEAS Ap. 42-G) (3) = 0.ug-O-4by = 0.016 (Reduoron Sempuructy)ffia)_Declson free ¢- % a outlook s bl ovencast Rain [ Harn] [ond , Da af plorrralf a Fore weak No Yea yes _.2_ —“, aeMe K= Nearest, Alguuthm Nughbourr ( Instance Sas Learning), “Lasy algo” iin all previous Modal i Traini phase iciam Distance Ai ae, Testing phase Test Wma Ha > An ee é kan st TE ours? Gear Instance based) Hearing also celled ‘ fo: 4 Fe sod 2 wb aay Algorithn SLE] atandshg orc x and veeton (datapownts rage exit iM : > 99 = 2,00 Distonce ; TOs a Saaz etay® =4 3 4 Rad a gerd 2 go oefSupport Modan Machine (SVM) — classipion ond in (sum) 3 Used when Oatored sy Line: ee Te, spr margin SVM» Dates , mot a tate Ud = Wot Vis Cinceon) Arduas Non-lnins 4 AUX) 2 wo +2171 + Wa%a + - = = Wn abe: AGNES Wort Cot One ona ~~ Cnon= Gree 9 adult of ome dipens om \ decision Boundary” & Jryporplane es gis yi a, hus iss ape" Wo + Wins +H2%2 +> tonn =0) ee) cae gacision boundary lank . ox Wx tWo=O peuilien Bias at tal, ee YEE s — i a . “ae acy Non Uncarly Seprrable —b ault gum maw Hard enaugin sum 4, menhionad So}t manga hun soft margin VAD). Bd ee pas Wo position 3 © oventaron fees bb, 29 Ondestalon © poston 4 ad> ate oriatahon sore but pasion aig > Se : rand 4 wnataron aif a Zt 2m t4%2>0 q St 2% ty7270 posilion (4 we X at ntl, Mdudtid we) Bitte C4 22% sje m, not Adusid wo)Mis wd a goo eS roMeery |": Tur is ntortr To - and ; Jor to + sine margin error ter @, Ven ane many decision tourdiies possibly, Wwe should have a ee oundary for decison boun fe t) kcision Soundany ¢ Lith mangin af error) | tw bea best one . 7 both dany . as Ce * — © \ ‘ Thwe 3 au called svmwx + (we-0Z0 yl at! wrx + (wet!) ¢o Yoo -4 WK + Wo 24 wWTX +Wo $-4 y 4 Imp por bibs fev correct clamsifi oh‘on nm, and A. ane om plont, so WTA, + Wy = WTA2 +Wo : WT, + Wo=0 Te nk =< wT (x2 -%)=0 Lot Xo tWo=O oT (x2 -%)=O (%2 =m) wb AWwovy 1 wa vector: wt» Ld (O-x%) a the plane ts wT es Hane tle tan plansHP ao wir's we=20 —O Hea win! +s 20 —@) Dotance blo 9 paral! Ay puplans (Cr anda, ax ves) fd w 17 = x! edt a Cangl put valu of x sn © WOT (x! tet) +P =O at (al + dot) two tld -Wom? Wx eO)2%d twd + WE-wWOTO wn! +0 4 (wt d 4 wer 09s =O Ot Got)*g + wea! =0 (Wd = wh we d= Wo-wo* er ad c.wTt on™ L guns with the conshaint gcc + 22) 24” 5221 ee wtxrtwd so Siro ois wk +o =O oat A= wees = | aio Lagsanges Qual L (09, We, oan ae e x fy" (whe) | ae Aayrgyiag tam dust equation. Xt be maximus Ue +E ke —O det = a Ea Ww € aigiots - Ba ay ¢ = Hee oO or eeu 1o =o QWe al F«y >] —o mol = oS Bodin! OOO On4 : . Pe ere prea: Cae ee yet Ei put value of 19 fomea@) ee Leis 2 ie gixd dey & 43 0) 1 ee | 2 2d DLA) 29 ALA) =o pe upto m. Oa, 5 Oe, ye (eoTat + leo) = | . ytul(votot +w=yr ae +8 rut boon yesuport ay ged ae ay ay co i L@ = wry thy gar + 30142 * 5H, Xy + Zeya) + SX + Boys t SH mM + BAGKD T a 5x3 > Ua) = ay Ho 4% A[ser a5 #909 * Gains 1 Eeaea H1081%3 | ae dl) a g- [541 +342 4 54g]-? todwo “Yo | \> |= (Co -YoJ* (es = -1- [o-I=0 Do TWA) + Wore =O Rava aaeo [=o] tow t2 Handle Nofse In pata for svm objedive : ALT dha tbe min condirasnt ye (o% +099) 71-6 & > & | Alock Variable | PObecivme : ) ™ . 2 +e Fay a &! vwsanges nw z ning cose.mm Ke-L & S Ava; ' 2 do S + UK) = 2 gigentrd ~ Escy!ao VOSKi 60? Keanal Taick :- (pata is nen dinconly Aspanable). X=<%G) a> Funehion (x) > Higher domain | Dix). pty) = | x | | Sen > Kix | | Y¥o a Hoyt + 242 Ying Xo.xy [7] Yous ny X2xo JL Yo.¥e = (41 X03) o slo sene 9, hW)- 909) = (xyy2 =kQy) = KS YY? KOR! 20) x= D4, 1) = CY %): K(x,4)=(x.9)? ial =(xy + ho 42) dw= [x8 | is 2 a aM See er ay V+ XY t (my) op ---- (xy)?& yal chic tt kernal fection an Cbabsty oy o0F an qn data Ensemble ni (ampend fuem Gage Reciser ) ap f Wire pcan n eerie het NUL ane ‘n' me ynodela Pro balaLliky | enon =P Probability shod “® (eur oD Lous ww make enor Pe = Neg PF CI — Baal mou than on chan to make dhoisen FSS ef tombintng keannens ) Divowsrty —> Lear should ce dlivere 2 Peciacy Hove to make ey 1G c lon Gi) Naive Bayes Wi) gum () Deusion Tree () Knn >) Ose dligfennt Juyper ponents > we dake Bknos wud k valus gf o alyferant for AU. 3) Dybeunt optimigarion fechniques Calgorithna) D Citfewrt prambn 6) Ojpwit data actAtable_vis_Onstablr anne La re do a dmau nv © clalasd ; We jet dan at , At as dtoble ele wndtabls tut WU (900 exormpla wn clota set 800 Sea 200 — teak — dtnal, 200 [rawning 800 tut > wrstogy, a » bogutic | Seg susMion , kNn 2 Stably | ee als cuir element in Pick ak Lwuwr gu snout BS Gn oh ag dus a tll anager a Ensumoy, a ‘ eng 4 heen oer dtocing Boosting $00 dota sof Soy. 207: Chrosning) test)a Blo} 22 Sooeting (squentiat larnfug) ee Algo -1990) Achapire + Assum a Be dataset X i 0 vauable. . Randomly dividieh x ibe ~ anu dubset %) 1X5, ¥ + Jou mw Lanny 4) 2, Lg (roauls) + Use Xi to than Ly. Tatained Ly D Use data v5 as est data -6{ 41 ns © Collect all the examples whith ane Rae classipid aa [Han ly oy X. dataset. @ (se Xy as dt dala fox 41 £ (2. amplts 8 ¥3 om which ber 4 and > ars dlircgps (A Vd coluctid «20 read g nw clato det x3, cae Adlai Ap Bar L;. Andbl, and tp (2 OMe EAD this is OM sesponte- ne Mangas ma pavieulor Aut example Aut example tp ly and dM dypenut | nal veut.