Da

Dce leasnluq Nehu1eSauuay

DATE

AL M DL
2000
19C6 gor Aj7en béra,.
Je hn Me lorthy Arthur Camuel

DL C L AL
MLL

Machine bleasn Ao. CrdipPired

Maune to miMuC
Fo human behaOr with exREMeule tueele
Fonehon
oHyman
bLrain.
ML
Exetuion
Tral nkn 1Taini
Tmin Te

Neulon

Da DL
Depunl au festoemande ML

Daka.
Suull Au a Dala beaF apHsLLo

a Awl- a 0a4-\ul- a Heu 4

T n Msdel DL
 ML teehniqvel thul
tasns feakue 4 4 a l k
Deepl ecs,nu nq r t ,tex|-
Diruty fam Dh e D afend)
Whele
whw-9

Hu4t AMt d Dat Hanle, Hu dic field

An 0ala Rabeics
Buplex tueblem self divi
CH e
FeatuMe txhaHon, Unkthuuts) Translah on.
Rece uwo) leblew
Coaipley pul aens
Psema Sofvea

sde)
R
T oain Mede!.
Feuhue
Manul
feed.in
L whle L il- Jlf euett qne
fursht w. reu o alul-

Sntu feahuie 6trechc clatfiaonodped-

fCbals tehratha+dlahi(eshcu, > culfu

 Notei y Sasvagy Jain

Deep Leasung DAT

Dee Leatunigs it bype a

a
Peep leasnln
Malune leaaniaq andastihitial ntelliq ente
+hat imí tetes the nay hu )49 1aln terkan
typ knewoled DLCmLAL
iir nporko elenenl- ef
Da Cuentt. uhich in duessfaHithics omd
prediciv6 Modelin4
Deep ltisnlg UHlizes both
Studued andUnChucpured pa fov ainy
ratoln.kxample a ! - Via ua ACicanla,
Visien or drvless Cahs, Money launden
laundema.
tate De beien, fue ReaguiTahon
Peep lsnlng is SpporHn
alqpriths thal- a e iospiriA
b the StAuve.
d fvncion h e Kuma brin, aod
hameel a i f t i a l }eural Nepwnk.
Deep 1eunins, ufH irs Supuited,
Seni Cupeaviteel ad un supuuuiséd leunun to
wan em Data Repredaahe9. The
n i u on
funhienalik op Deep leasning
the bloo peints

t e imifaks he fureienaliH a hua

brufn for ana ting the Da ta and forminq
he patfern ter rifemi it in Deitio
Maki
he u n d Dau lCan he foerlenyeced
 Dclo
Deep leanminq- Noes B- SawaT

Divnse and (empley io hahure.

theaqerhe Daha dl the MOVe tftiuenl

he truning- 4hu{ liruky tmpaslA. h e
he
Deiien maki

AdVankA Dep kasug

ahi te geheuhe nuo feusuzel tren
he limihel avaiJube raioinq Daka lal

lan strk en uncupeNise lning- tuniguas

helps in 9enerain aspionehle and Teliale
tas uflomed
reodud he Lime Turw for feature
n n neening, ane a4he task ul-Tquind.
MC
4ime in PretHlir Mavhune leussin
wh
w i lenpinuouy truiing, 'h aneikeekre
hul belcme ulepHive to thanqe auel is
ahme to work n divense PAablem

Ditavaoqd ay Deer leasuning$

Auh 4he ineesin Pupulaniyn, deep

lesun all husa handl ful a thvee-1
Kudheed' fo he addre ssel
 Sawo41a Jain.
Peep leecninNeles B

he, leplete haininMe(edt elias on the lontinueu

Fow 0ahe whih detvensad the Scope tor
l ve Mealin the rauniy fh» (eks

he st lonpuahcn el cuain igfitaahly

ln euJU win increuse the No. op
an 10
Dafajel.
k tans pasuuly ia faul|-Twi non. ale.
inkrmieliae Skeps to Pletjde he sgumen)
for a erhaln fuulp. foorder ho Tplve iffue
a
Coplee Honthy q4s e viled.
Nud tor Expentive el ountes, hiqh-sree
Aete Ci4 nia and Powevul u ' s fov
runia the peau fejt.

Wonkinq af Deep le
Peep lesminq alguihmd
,J
uHlz Supervifw i . nlupusviu leusnidq,agmthM
to train the uttuH thrsum the deliveveeiipdi.
in de lusinn,. e DeuronJ au
ClaCie into hree diffeve hiehasckit oq laqeY
term as Enpu- Hiilen,, Cmd 0 p d - laqers.

The firc- heuren laper ie. ingul- laqtT

ruuives the ln f - daa and Pe Cses iF Fo the

firs hidden lutr.

 Deerlcas Nok 0 Sanuagjau

dn
the hiden ayers per fovm +he lanapuuhoni
he reeivee daa. the biqul- thallergt
Under he4va hetvorks r u i o n i Fo deside
nlo. c hidlen lyer
+he
the No. ol heuvend and a

yev PAoduted h e
hnallythe Oupu
r e u r e 8us-

ulpu-laqe
Hidden Hdden
layer later Laer
This ithe basic Hes o-WoTking, No Lo lonned
4he
he Poio where the Methed lomfutaho
ExPlained
Eveylenbechon bluo the heurend
Can it a4 weii4. F denthes the Siqnifiante
e the inP-Yalus Io OYde to Sfandasie
the
+he 6u ao acivahon. tunc on is vled.

for rnin +he Nework twd

npor hao- uures e lensidere.The firg-if Fo
Crealee 1 e Dal- Jl-nd the Jetend i
lag lnpuhahcnal fooev
 Deep Leamne Nes A Sanwagya Jain.
PAGE N
DATE
The Deep fn deep lesining Siqni fied the Nuber
f hidden lagers the Medel it udinq to tain
the Daha l
he woking af Deep lkeunnq an be
Summe p io four final Pe1ats
AN aske_ COmhinaion ot bina
True falde queuts.
ExtraeHnq humemi Values fio 6leckt a
Dak
9 Ser Hinthe Daka a fer he releiveel
AmAwev.
A fin Peinls maukin| labeling the
Deca.
Tep Alqmitm fo Deep Leasnín
.KNN (K-
nanesi-hejqhbor) Method.
. Arh hiial Neura
Newk (aNnl)
3
ConNojuhional Neural Neuork can)
Reurenl Neur NetwoTk (RNN)
Deep Neur a Netwovk (DNN
). Deep Belief Netork DeN)
Bcuk Psepeqahie
8)
8). Stochas He 61adjeol-Nesten.
9) Lon Sherl- Tem Menory Nuork (Lsrms
on
to) Gnenesahve AdveTaia Network1 (GaNc)
11) Radlia Gadi foncie N4eCTk
(RSFN:)
a.Mulilyer Perleptrons(MLP)
 Jain.
De leasuiq N¢rA: B1 SrUag1

13S e l F asqawinq, mapi (sond

lu) R i DolM4n M ahine (RBM)
Auloehleders
Cer)vsmvs (o1) X X

A ML
. Mimicking the S. A
teehhjque b . A tehniqu
intelli qen te ov Nhich a ConapuleY
Crneen toM Machine les ni
behaviouYal paHn Dai wi thou-U inq iPire by 67
rhyMans on Ha Conuplex Su-e
OHer Iivinq H braan's bwh
Piffereo-ruly Ntoork
His APro ach lA heyron.
Mainly bad en
ts Cini4 mode
fo daaseF
AC is o ad fied thal- . mL is a Jubsl- 8,. i q ustel-
Inude ML and DL

A
ML
NN

Laseledvnlaheled Daha.
Supeuis SemiUnsuperwit
Sthuke undhetuse Dda.
Melulloch- Pitts Neulon- 1943
NeuT Natwok asui iie Neuu NuOTk
inic h e human hvafn hbeh a -
alymthm
huld Neose it lpsutad i fou nua
Cauuupo nea Cnfr 1weiyhl-,a bias o thrs hold

healtbmc fpomula woud lov

x f + bias e WX +wak2 tw¥3t

bia

remtTe 14 apl iEto a More tannble

xaple
exaple ke whethe _r olyeu Shoue
adey a Pizza forioner. i s will be
u presiched t l e m e 0 y-hal-

L CLMuM h heE aue hree MLin

fuled thal- wiu intuente. yeur detition

bOei4

Pi2za y u r NO: o)

3 14 u will S e Mon (qu:1 No

hen
4vi hes l ow(na10 Pu
1 , Sjoce ye e hol- Makig dinmey
Xa0 Linte.
ToPti
X3= 1 Sile We a Dul
y ttiay
&lices.
Mvin on we n0 hied Fo
chqn comt
wehH deesune. fnuporan.
eih liraer
k e a diu1e injuH
Cou buhón
othe Otpuy ore
tinik Can-CoMpadu
+oeher opuk.
W= Since ybu Value im
W 33 Le164 V«lue Shuyj i

SinC eu hue
he b4n k e-Money in
nau
hoau e
we all elume a thresheld
ule u c which weuld ransld
obias /alue
SinLe u eAuslitheel cull Ae elevaa
 FAGE No.

DATE

eluesfor Ou X4mahen we lan he

he) foto 4hifosmula
plua
Plug
M
wixi+ bial wXj +wx,_+ WaX3 tbias.

USi auivahon ton chi oy.

we Lan n o w Caldale the &uHut
(1e. OuL deu a'o oOrdev Pia2a):

Qupu-fo) wiX1 > hre hold

Zw, xj threshold

YEha-) x+ox3 + ix 2
2
SlaneY-bal- is 2 the autPd- ton
h e uivuhe unhon wi he I
ha we wll sder Pi2za.

x. he you bwene
biad epsden-
to go to desfi224
willime44
to bi, ane 4ilh
6us uu PakH

hyhele biosisalte kue

thret hold
Nyui.thrwhel4 1 alluhia
LL1ding. Blocks bf aflurad Nahu
N
LaqedA
NeuronS-||Peuetro
Lo a NeuraNetoork
A euTeal Netuoork i4 MAe
e-u.
CT Veuh Celly Stakud
ponen Co4lw
LaHer
Layer There OLe
hreeytesa
Neala Nelwovk. Loyerd
Hidden
Lopu

auyeY Lyav 2
L 3
SP- Laer timsis he op-
LunerTis LcLyeY uil
QLLep-the daa ou pass f to he zes I-
f +he Nehwcsk.
HidJenastY The
i4 Called the idden
sen+yfe a ayeY
LayeY ddenlapeYs
e ther e or Move. fn Numbey for a
heul Netuovk. Hid Jen Laytst ahe h e
heAAu ae aufuudy Ponsible. for
for

he éxCeleade Peformance ond nuplexi y

h e u l Netwrk Tk Ptorm MUHpl
funtions F H e Same Hme sueh as Dae
tseahen
rad fm ahon, aiufo mahic f e t s e
et
14
Guttu taen helast tqte leY
he ulfu- l a e y the 6utpuy- C a r h o d s
he JuF bT he utu- the Lo ble

A Raus Cnye qt pam o

for
he fof- luer and u TeLeivd
uwrtu- in e utu wY

M Nekide CMee Vehicle

NeusonS 1n a Neus Netoor k Laye

CoySic a Small indvidul Uoi Call
hewon A heulon ln aneusl Nefuork
ean be beHer unde chco d wih the hel a
bioleCw heuons An Asi i i l Neulen
1Simil Fo a biological heuton
L e i u s inpu- e m h e o4her heuen
Poduas n
Peuom ome PAtes ine, L
dultul-.

fotu F)
WL

Here X,, X ane Ihful-to 4he aUsh Hul.

heuonk x ) Tepien the role &i
olcne On he inful omd y prseo)a+he
f u at the heul on.

V e neson has a endentr to

ire
ire bu only in Cesfio COndiions.
Xanyle.

fofu -y Ouhu

we Sepreseol- +() h addihcn.

hen his heud on Mcu fire when Cum b
reeteytha Say lon. while 4heje ma* be
aCule whetehe aher heulon, MA tre
hen he Su i reulev han lo
Thue Cendi iond uhich diffey heulo to
heulen Ue Cale thres ha|d

X+Y > thres hol d ire

X+2<thmuhe
2 thres hol d hre
X X2-hreshold NO fire

X+X2+biat> o
X1 +X2 + bias O Ne i r e

.
Nquie hreghel d Cal bias
inan auifiau Neusa Ntwosk
ayhe heulonA io a hauethe
Sqme o ios .
taer
Nou Another ape- an u i fiu
nelenud weqn So f a r uL
fo0u ulahon w e hau aane
Peranle Fo a 4he inpu
 EXqmpleT Supt ole da 14 a
lolle
Pah and ®y heko delide
whether ou hauld o +o 4he PayoY
hol-baled n dome fotuLendi Hon
Suwh as

CI,0)X the weather ood

(1,o) X2 = Ls the Venye hea 2
,0)., *3 =
t Jour Cmyh Canu' Foo 2

y Sheul d go +hG tas}2

Now us
urhqn Betqnj-b e
4heAhe badis,
frnt
Pupcraue.

W
 DATE

NOif the Sy) a a these threc faukOT

asetFR i4arenter ha+hs held
tAun y eu Cn deide hyoto the paa

Acivienfoncion in neulal Nekork

An HeHVaioo function v
Porlan fealwe o 4 auifiia deide
neulal Neuprk, theg bahaU
aLHvakee
whetheY h e heulon Sho J be
Y 6- sHAGa Nual NehooTk
he auivaicn fvneheo d u d s h e oult
t h a y - node qven anu1a pu-or se
a fngu
The Pma Tolc e
auivhon fonchon is to hrans forM
the
The SumMed weiqht i tom t h e
node ialo a0 outpu- Vaue to be fed
tothe hex biddenlayey er aj 0upu.
AChvacn fonfon dwu he hen-line

CLLp e to leam annd

Ptom moe touuplep
7 Nixj+ b
NN3
Nulay Can hel- Lecum
Node u h Juyl-a ineas fuush
Ot achei o S1- NLfUM uu tef- it leay ater dar
 LtCov
Heue

Gnhi uttu lan ead fom m jn

fnfiof o fntinír:

Bu his Can be chalengeA in manp

Caumtantel AMyme we tirs) weo Fo.
ima-e the a T a aPeyon foy hic
heighi, weiqh-, ond chaleltve leo
nd h e +he i fy- peuson a e)4
or nol-, baled o if +he aui u qreater
hen6o
X iqh

Y eiqh)- 2

X choleo

bi

Now it we wethis ven newson +he

the 4 a 26 Eve Po ssible

e4 kn ouo thud he ran a
aLLcA +oue Culll Huusu) e
d hi hewon will a u y e fo

0euen Hhe t
Some @ue eu 26 i Poisle
e i c i t e n a to Clarify
hi
eCn
A n o l - 614.
he pen on haueheeh Mh
BuF fF wou4
Muh MOYe
alade
bete
beter had the at
0utpu- thi
Sente Siuh a fethe
+he a
eulen u i h rpryeol +
hu heen 1 h e u a Sa
t h i s Aaie
SO haw lan w e folve
o u t - a a heuson 1A hoj
udhey 4he

he
One Nhad is o di. 4he t
be o uwe a fonchon
htuhu we de
u h ay Max to, X)

Ncw leH fim nofe Hhe asi4jnd

CoudiHon.4 betore wi a
fundion
t o r P e Cihue X we Kee a Paihue y
wehad a heaahu y
foY h4uie x
for
epjen) he aLual
Hue x
prelunE the Mand fome
Vccluas C Y
/au.

3 2 3
-2
 oue ue e 2e i Porei5le
weC«n u s e h i elarifr
t e m a t o clarcifr
h e p u on A ne 614
But f woul 4 haueheen M
betes had+he a r lde M h MoYe
SeyteSieh a s f t h e t - this
Deulon u i h rprseolthe a
had been 1the an aSo
so ha w tan we folve t h i s Aale
udhey he o u t - a a heuson iA ho -
a aH a

Gn Need i o clit. 4he t n 4he

h y a i u Sde wew4 be o uwe a fonchon
Suh a MAy lo X)

Ncw lH FiTnofe he asigjn

CoAiHon beore wia any fonien
for Poihve X we hud a Pasi hve y
for heyutieX wehae a hesahue
X
X epdey)% h e auHd
YcLlus G Y p e e n - h e ManMfomed
ue

3 2 3
-2
 he tt Ycy
ycu o nl- to ge md the
hegaiue Ualues tuhe w lan to e
a
foncHon k e Max(ox). usi
i s foncion
anthi uihi ch u he on
a h Side the Xaxi
Cipp
Max(o,X) .

Rel

hiSyre
e fonhoy Cled
RELU i u 4he e' anej
e funcHo
whid mufor athe Coubined
tnfu
ayeCll edAHUaho foncHe). So
Relu i'4 auhvahby forcion.

Deped h e type a
+aus formaoy heede hee Can be
oi ffeaenf- kind t athuahon runchio).