eae awk 4 Supervised Learning Machine es Onsupervised leaxnin P lec Supervised —> Reaéession Sls SQ Classification a Cocctpect is known) = = —] = = = : ; Regeession hs Lineoe Keqeesston = 2. Pelunomtos Reggession i SVR = 4. Decision Téee = 5. Random Fosest = = = Sj a 3 a a é. avers TKN ClassiAcation:—> 1. Logistic Re : 2. sV™M 3. Decision Tee &. Random FPosest Ss Naive Bay es 6. Kn asession 1 bbeiia Gnespeciised \soxening: Coutpet ts urknown) Suen stinDBs can yKMeang') i my dose, Hierarchical, SilhoueHe messingye Saipeten ised ssatining : : Fa: i uulipdependent Featuxe dependent : Oegeec Eoxperierce alaxip) features BCG me fee ete Ts Sok Poy 2 Tok ( Olp = continuous —> pce o0 Peoblem Bd Z Independent Feat. 7 dependent No:of play No.of Study Fass! Foil Feat. hes | hes Olp = cartegosicos = classificakon paoblem Plight Psice Péedichion —> Seqeessie paoblem PE eso Fiee Podest? -> classification PPP PP ee eR KKK}. paoblem » Peedict Ate Quality Ident —> NEES ‘ Reobtem Rain Péediction — classification Reoblem + Buying dayo +! “classi ¢ eg oy fa patton classificakon oe : péoblens iNotes Independent featuces is basically inpat peaiteces : Pye g Mnect Ke ree Cone indepen dent ioe and one oo featuxe) eq aim: +o c&eate A model, aBten dakes inpat ; as Rett and peedict wetgnt dataset: helgbt. ale Eq: Aim: Basedon the no- of K 6 datapoint Cosigi Pane n arta poin Coats inal) Ou peedicted daka point "difference between cea) points and P&edicted polnis is called sesidaols OS Brod.© Based on the teaining dataset, it finds the be it Wine ty such a way that *he uD ©} between eal Points md” péeclicte J shoc be mintmam lest, ese need to undexstand ae ase cacating a Straight line 2 Vs. best €i+ line ee ae Best best -ft line ts hothin Slope but a equatkon of straight line 4 Y= mate me 4 Bot Bix allovce intexcept. eq”: of hola) = Go + 61x 2 line hola) = Go + Gre Se Slope Intexcept : [intoccept} when 2-0, thé line meeting the eynaads), that arHoulore poi ts sivas “known as intercept. _ with the unit movement to the x-aais what is +he movement in the toooea Bo and 91 best kit line win be 2 By shone Vi change ft la a } 4S 60,01: changing the values, | ee A win them AKS line bs * iners|dn et Fe N Lae alter, some erations, we will eta best kit line which is renee known as taining Of the model. + + \ we need to minimize Abts + Rest ¢ eécoes usin equakon called as VY cost function: \Cost Per Eamalion > foé eas ey colewtations Cderxivatives) Geet ‘e (reco 4 Ci > \2m/ fal eres ee —~——"pkedlicted actual, mean SQUaHe eo &- (one ofthe eost Lamction + we need to minimige cost functton +o ast the best fit Noe. dividing ey m 40 att she vege Gu ea)Ey ChotorS eee ‘ 2m eI ‘Saag the values ok 60 and 61. Letus consider, Go=0 Ne Cad = 1H lets assume ©t=! ho lad = ©(X) = 1 polar) = Oot Or ea Teda\ E Goto ) mw i) 5 [a+o +o] HOS Af (os. “A Cl-2)°4 (US- a AGtEadient descent cuxve suis point Objective: owe main aim is to come newe ace minima: ae cannot change 9 value manually: Ahexe shoatd be some mechanism +o elute @~vatue pole ane lobal minima: To overcome wis, we Use Convexcqence AN a Convexgence al reas ~- int 4H \ POA S poems aa of 4 See ue: FS step sé! as small steps it? a Sadia beech — Moweane Ore : 80H Can EDRepeat ant Sonvergence ing > lesening Sate oe SNE Of Ve slope: Beeeecight side of the Nine facin downwards 4 se = ome NC? Slope estab side of the tine focing apwoxds ~ > 6 4Vve’ slope ees tO 2S Oj = 6} -X Eve) = Oj +% eans We axe incxeasing 6}.=> —$—y — = - =] 3 = 3 z z a a ebeaxning, Rate It decides the Speed of the Cae Ik |e ts vexy smal h VA widl dake moée time a Fo Keach te minima. KE ts eet lovee { At oul yarn breve and thee, And won't each +o ce minima- &, shouldbe atcund o-co) fos Smaller, Se \ Sieh Dal—Genverge nee atgosi thro 2 3 C80561) = ) 1 “4 Cima =) ; -cost function pe INS actual o& Pas Wet point m= eee data point difference between cost funclion and loss fanction- 60st function: we Lind exog fosall the points SS and take oc OL ihe Loss function: we find ewroe fo& obsexved polots and if we find exrwroé fos aul the points then tt is loss fanction- Y ed loss funchHon:= Chaco” -¢ ! ‘ péedicled ~ "a Nalue. actual VAIUE ee aC 4-5 ty sist sin point we need to find aati los10 Achieve ateeas mininay dexivative w.64 40 Boje rt ae (5) y\~ 3(60,0;) = 2 Fu hota’ a4) 4 S. ree a Wola) = 00+ O10 x are 2.9 2, $ fonenilal’9 i (co0r6.0)'-y') x| t= F eS a C+a0-45 a a = ) : = 2fUeod-gh) = ceorern) -¢') — iz) m Sil Alentiveiver co ct. STEN 2, 3060.9) 23. ae ye 5 ie 2 a. 5 (004 orw)-y a Tel)ano ce BG k1- F Croend-y!)" fay BOT a 61 = ot 5 Chete)' - i) od m ial } } \ ) y ) ) Pi elt Ty ELS Types of cost function! @ mse: mean “squaxe aun nt = Meee MAE: Mean absolute exno® @ RMSE: Soot Mean square dependent catuxe Ecpenlence ~ Pag aera Chua cater (y-G)? Ctaxns)* Coy anit rd —7 hme compleaities pee x ___iuoxeaned: 7Be i xe we don’t do MPAG joa dependent peats g we dep Gy — Squorcd —> exioe > penotiaed Imorea Mean! Absolute Bus PEAS L no MAer= as. DP) Bac ‘ rm Pa | a i AA a @ Robust +0 outers. @ _ '4 will also be inthe. same unit: ___disadv: a Sonvexa erins tisually takes moee dime. opttimigation ts a comptenc Aas: fe) time sensuming. ive cannot be feetRot mean Square Ewroe CAmse) mses | i & CRON —~ ee ae ee Ai! Ags disadv: = I Creceiabie > ~ Not Gobust +o ” Unit Remain same. outers - Habe Less Punction The Hubes, toss Of hers the best of bot wodlds by balanelog the MSE and MAE togeted , C 2 > Cy- Ftv) ‘anh Ugly, cov) = S}y-Fed|- 45> — otherwise > It Says! fee !oss values less thandelta, use the = MSE, fog toss values qscwgines than‘ delta, / use +he mAe- ysis the MAE tes longer 10SS values mitigates the weight that we put on outliers so that we sHil a a well- &oundeol model. At the same tHme, We use the MSE & *he smaller Joss Values +0 maintain o Deda funckon incor the centre ethas +h Sth feet Ook Maagnitying she ‘oss aAtues A5 aco as eo One q kates Ahan. loss fos dhose data points dips below) , data EpaN OTS 1 os Eire thub Mabe. Joss any Riise ou jee! tnoat jou need a balance ac ivin oudiexs some Saar but noFtco “much. How can we etea\s ik a model ts good 68& eee quadkatic fer notion down-ewciqhts them ocus the et on the oo erro & ee pecfosmance mebacs + cd? measuxes Awe sspemancs ° BS tnesmodel: f tBest fitline ek t eR squaked = ss rs | + ie ¢ q ——~ ss \ a ee; SS awccaey Fa # SSres = Sumo Squaxe - “ 7a Residuals bie E Kn SStotal = Sum of Square average n AD low value R- squaxed Saw SCG 45) a ~\2 =U 2, C4) ~ oat valuc GF oage as Ge = t= 9 Ssmalivalue j Biqqes value J-s smal : Nalue " R- squaxed = 0:85 = 89%. accurate = oS = 184% accuxaie & If R squared Is (NE? Aen the model ts not peshing ts ee| R? = ~ve | 7 = to Here Cyy-G) > Cyy~J) — R? will be SAO Is | * | |R2et | > | Ber ae 1 ____s djusted R-squaxed ea: No digect cones avon cere | os [ \10-65 e [\sataxy forencter } ___ House Jocation' — bedxcoms 4 é ] Peice | - Befose, when a sige Of house was p&esent as an inde pendent feature to get the psice and has some R- pdgonce Naluc. But with addition of city location = ot inckease- ayrex that with addition % se pit bcdxoom , Gsncketc, Me Value aes inckease , bus there is wet th die eo! Comnela ce, the value gender and px ee MN: ‘Pace2 & featuxes added ad}. R?_ Independent yeater Se. Size of house 63% Pay 784, location _ BB P=2 ¢ SQ. 06 df bedrooms 264, P23 Sor. Gren ded asy. P24 i ¥ frie Do Aisect comaelaltors wie + peice Fe Neer Pa tncxease, but this shouldn't happen: Yo solve this pot lem we use Ac A ie : Adjusted R2 = 1~ C1-R2)Cr0-1) Ge cepe yan begphyaiaiies mi M2 No.of data poinss Pe Ne-of Independent featunes x Adjusted R?:is +hebes+-meteics to evaluate the model: | s a) ao wad 0, 0 a ie ae Lerma age arid Se er J RAIS, { woo del Veain- dadaseh - cee a |1o0e datapoints laa Testing | O30) moded bestiting C Bias and Vaxiance) gven|iHing and andentsing. r : C c 100 ; [Teaining dataset \ rr Ji he = A Feain| | Vatidote ] / See 200 Y = tyain the model bu pekpaxamelee BUDning +ne model. [iene | Gener alige Model Téain Sata — NE geod accuracy ens Test Data — 5 Vere i Gebd Accuracy Cast.) 2 rr SI 04x aim is to get ace dest and drain veeoey Téain data — very qeod Accuracy Soy. Liew we + est Bata —s5 Mery haces Accnnacr usy, D low Voueiance]Welting — oe TRain — > & ; » —> Very qood mecuNacy C40¥-) [lew Bias] Bue Sst 5 Bad BECOME Canes e High Vaxiance | Qndex}ittin TRAIN —> mode acewrac is low- Chih bias] Test —> modet accuracy ts leva / nian: pa a 4} ( ook hi ly Vaxion ef * WE Can solve this issue b pecfeémin hy pete ter tunni i ‘ ene unning os by ineReas "4 no-4