1

www.Prozhe.com

90-91

www.Prozhe.com

Ministry of Science, Research and Technology of Islamic Republic of IRAN

University of Applied Science and Technology

Parsabad1 College

Course
Associate degrees of Computer Software

Project Title

Neural network
Supervisor

M.babavand

Authors
Mehdi azizi

First Semester - Fall 90-91


........................................
/ ( )
.

1 .................................................................................................................................
2...............................................................................................................................................

4..................................................................................................................................
-1-1 4..................................................................................................................................
-1-2 4........................................................................................................................
-1-3 4.......................................................................................................................
-1-4 5.......................................................................
-1-5 5......................................................................................
-1-6 6..........................................................
-1-7 - 7.....................................
-1-8 8...........................................
-1-9 8..............................................................................
-1-10 10.......................................................................................... perceptron
-1-11 11...................................................................................................... Perceptron
-1-12 12......................................................................................................
-1-13 13......................................................................................................................
14............................................................................... Particle Swarm Optimitation(PSO( -1-14

17..........................................................................................
-2-1 17..................................................................................................................................
-2-2 17................................................................................
-2-317...................................................................................................................................
-2-4 18................................................................................................

 -2-5 19.........................................................................................................................
-2-6 21..........................................................................................................
-2-7 24....................................................................................
-2-8 28...................................................................................................................
-2-9 29 ..........................................................................................................................

31..............................................
-3-1 31..................................................................................................................................
-3-2 31....................................
-3-3 31..................................................................................................................................
-3-4 32.........................................................................................................
-3-5 34..................................................................................................................
-3-6 36......................................................................................................................
-3-7 37...........................................................................................................................

40................................
-4-1 40..................................................................................................................................
-4-2 40......................
-4-3 40..................................................................................................................................
-4-4 41.................................................................................................................
-4-5 42..........................................................................................................................
( ) 45..................................................
45...................................................................................................................................
46.....................................................................................................................................
47............................................................................................................................

:2-1 18 ......................................................................................................
21 .............................................................................................................................. cnn :2-2
:3-2 26 ......................
:4-2 27 ......................................................
:5-2 28 ...........................................................
:6-2 mse trainin 29 ..............................................................................
:7-2 29 ..................................................
:1- 3 33 ............................................................................................
:2-3 34 ...........................................................................................................
:3-3 35 ................................................................................................
: :4-3 & 36 ......................................................&
:5-3 37 ............................................................................................
:6-3 38 ...................................
:1-4 43 ...........................................
:2-4 44 ........................................................


.

.
.
ANN .

.
: perceptron


.
ANN
.


feedforward
.


-1-1

.
1943 neurophysiologist Warren
McCulloch Walter Pits .
.
-2-1
(( )Artificial Neural Network (ANN
.
.
()neurons ANN.
. ANN
.
. ANN .
-3-1
.

.
.
.


.

Minsky Papert Minsky . Papert 1969

.
.
1943 neurophysiologist Warren McCulloch
Walter Pits .
.
-4-1


.
.
" " .
-1-5
:
.
: ANN
. ( : ) Real time ANN


.
:

.
-1-6
.

.
.

.
.
.
( )
.


.
.
.

.

 .
.
.

.
(
) .

.
-1-7 -


.
dendrites
axon
. synapse
axon axon

.

axon .
synapses .

 -1-8

.
.
.
-1-9
.1
({=1Pi,Ti)i
} l Pi Ti Pi .
Pi ai Ti

Pi Ti
( Pi Ti ).
. k ( Pi(k
. ( Ti(k
.
.
.

. (
Ti) Pi
.

.2 :

.
. on-line
on-line & off-line . off-line
.
. on-line

.
on-line - .


.

.
.
.
.3

. .
( ) .
.


.
-1-10 perceptron

Perceptron :
perceptron . n
. Wi q
.
Perceptron :
Perceptron n .
Perceptron =a .Wi.Xi q .
0 1.
Perceptron
Perceptron
. OR AND NOT
Perceptron AND NOT AND OR
. Perceptron
.
Perceptron . A 5*5
( encode) . ( ) Perceptron 25
:
=q 25e . 1e < < 0 1Perceptron 1 -1 .

10

 -1-11 Perceptron

Perception (
) .
Perceptron 1X 2X
. Perceptron
1 8 . 1X
2X . 4 .
perceptron 0 10
. 8 8
d .
d=1 0 1 2 . a = 5
10 .
. 2 4 a = 10
8 .
( ) Reset . B
2 4 a = 24
1d. 1W 2d. 2W B .
8 .
.

.

11

 -1-12
perceptron
.
-X +X = X :
: +X
: -X
, , , Xk 2, X 1S x= X () X
Xi X X Sx ( ).
Wk k . (
.) 0=1W :
C k k .
)1
X ,
X , Ck
0k :
= 2+0= WK 1+0= WK 0WK
0WK X.

,
.

12

 -1-13
.
.

.
.
Swarm behavior
. Swarm .
.
Swarm intelligence
.
.

.
Swarm .
.
.
. Swarm

Swarm :
Function optimization, Finding optimal roots, scheduling, structural optimization, Image and data
analysis
Swarm . ( Ant

)Colony ( )Bird Flocks .

13

Particle Swarm Optimitation(PSO( -1-14

PSO
.
.
particle PSO . particle
. particle Swarm
particle .
particle
Particle . Swarm
.
:Particle swarm Optimitation Algorithm

PSO particle

.
( )x,y 2+y2F(x,y)=x .
x-y . Swarm
3 .

. Swarm
Swarm . Ant colony
. Swarm intelligence

14

 .
.

15

intelligence

Swarm


-1-2
.

ANN .
.
.
2 2

.
.
.
.
.
.
-2-3
,ANN .
.
ANN .
.

17

 real time .

DSP real time .
ANN .
-2-4
( )1 f ).( .
0.04 .

: 1-2

( )1 .

18

 . a-2
. 0.04 ( .)b-2
Lyapunov c-2 . Lyapunov
. d-2 e-2
0.01 0.06 . f-2
.
-2-5

. .
.
. ( )3
.

. .
.

19

)(a () = 0.04

( )d ( = (e0.01

) (b () = 0.04

) ) ( = (f0.06

) (c Lyapunov

) )

.
.
.
.
:

20

 CNN : 2-2

-2-6
. p y BP
.
-1 :

) Pd( ) a2( .
-2 :

21

LW1.1

22

 IW1.1

( )6
. :

23

 gradient descent
training . ( )11 .

wmk-1 bmk m k .
Sm .
MSE ( 1 5)
update
. MSE
. MSE

.
-2-7

.
training off line . TDL

24

 . TDL .

. ( )4 .

. ( )5
.
= 0.01= 0.9 1.05 0.7
. .
-1 .
-2 training .
-3 . MSE
training ( )4 .
-4 .
-5 (.)2

25

 : 3-2

gradient descent BP
. ( )7 MSE .

26

 : 4-2

27

 -2-8
( )8 .
.
. ( )9
.

: 5-2

28

 : 6-2 MSE trainin

: 7-2

-2-9
:
-1
.
-2 .
-3 .
-4 on line .

29


-3-1
Armstrong
.
.
.
.
.
.
-3-2

.
. Elman
.
-3-3
Armstrong
.
.
.
.
.

31

 .
.

-3-4 -
Hatz :
x .

32

 : 1-3 -

:
. .
. ( )a- Hatz
y = x . y = x
. .
. ( )b-
.

33

 -3-5

( ) .
.

. . t
t+ .
Elman .
.

: 2-3 .

.


( ) .
. ( )
. Lyapunov ( ) . ,>
. ,= .

34

 ,= . ( )
.

: 3-3 .

. ,= x ,= x
. ( )
. ,= x ,= x
.

35

 : 4-3 & &

-3-6
.

. .
.
.
Hamming FFT .
f . , =
f/ f/ ( -
.)b . ,=

36

 .
,=
. Hnon
.

: 5-3 ,a : (. ),

-3-7

.
.

37

 : 6-3

38


-4-1

.

.
.
-4-2

. Lyapunov Halanay


. .
.
-4-3
-

.
( )DNNs
.
DNN .

40


. [ ] 16
. [ ]28
. [ ]31
.

. [ ]29
.
DNN
.
DNN
Lyapunov . Halanay
-
( )LMIs .
-4-4
A . .
}{E T I .
x2 :
( t( ( D+y(t .
DNN :

41

x(t) = (x1(t),x2(t),,xn(t))TRn .
C= diag(c1,c2,,cn) >0 i
.

A = (aij )nn

(bij )nn .

fj

=B

gj

j > 0 .
( f (x(t))=(f1(x1(t )), f2(x2(t)), . . . , fn(xn(t)))T Rn

g(x(t))=(g1(x1(t1(t))), g2(x2(t2(t))), . . . . ,

)gn(xn(t n(t))))T Rn

-4-5
DNNs .
LMI

42

 .
.

.

: 1-4 .

43

 : 2-4 .

44



-1 . . . :
1383
-2 . : 1382
-3 " " 12
66 69
-4 " ( " )2 _ 52 1383 210
211
-5 "
" _ 30
-6 " " 1376

45


1- Metaxiotis , Kostas & John Psarras (2004) "The Contribution of Neural networks and
genetic algoritms to business decision support "Management decision , vol 42 ,no .2, Emerald
group publishing limited , pp. 229.242
2- Curry , B & L. Moutinho (1993) "Neural Network in marketing : Modelling consumer
Responses to Advertising Stimuli "European Journal of marketing , vol 27 , no . 7 , MCB
university press , pp 5. 20
3- Wray , B , A. palmer & D. Bejou (1994) " Using Neural Network Analysis to evaluate
4- Buyer Seller Relationships " European Journal of Marketing , vol 28 , no. 10 , MCB
university press , pp 32.48
5- Venugopal .V & W. Beats ( 1994 ) " Neural networks and Statistical Techniques in
marketing research " Marketing intelligence & planning , vol 12 , no. 7 , MCB university
press , pp 30 . 38
6- Davies , F , L . Moutinho & B . Curry (1996 ) " ATM user attitudes : a neural network
analysis " , marketing intelligence & planning , vol 14 , no . 2 , MCB university press , pp 26 .
32

46


Abstract
Basic instructions for the preparation of a paper for the Amirkabir Journal are presented. This
document is itself an example of the desired layout and can be used as a template. The document
contains information for all formats, type sizes, and typefaces in required styles, without need to
define any. Style rules are provided to explain how to handle equations, units, figures, tables,
abbreviations, and acronyms. Sections are also devoted to the preparation of acknowledgments,
references, and authors' biographies
words in one or two paragraphs, and cannot contain equations, 180The English abstract is limited to
figures, tables, or references. It should concisely state what was done, how it was done, principal
results, and their significance
Key words : preparation presented- template acronyms.

47

48