1 views

save

- rtqphysics
- Katz Ingles
- ajeee-2-3-10
- ECE 225 Experiments
- Particle Swarm Optimization
- TOC FINAL
- Learnabout Sin Wave
- 2D PSO.pdf
- 2
- Energy Aware CH Selection Using PSO
- 8_summary
- NARMA model
- Wave Practice 2
- Paper50.pdf
- H1 Physics J2 CT1 2013 Paper 2 Solutions
- Time History Method
- SILIBUS_sEM1DFOI4
- Doppler Experiment
- Paper-Effectiveness of Snubber as a Pressure Pulsation Limiting Unit
- LabView_Exercise
- Hybrid of Ant Colony Optimization and Gravitational Emulation Based Load Balancing Strategy in Cloud Computing
- Lect_34
- AD 0011687
- AutoLab Impedance tutorial
- Problems Vibrations and Waves_Physics_7_Ed Serway-2.pdf
- Abstract Does Not Have Unit in Order
- Walter Russell.docx
- final paper 6-6-13
- calcul_perete_izolat
- QMLect2probsSOLN
- DAFTAR PUSTAK1.docx
- Artikel 32
- Prosedur Pelaksanaan Edaran SKPMg2 2018-1
- Dozvoljene Namernice u Restrikcji
- Embarazo Precoz
- Chuong_10_iy4ta.pdf
- Trilogia Cósmica 1 - Além do Planeta Silencioso - C. S. Lewis.pdf
- Undangan Halal Bihalal Menuntut
- 09.01.28 Article The Independent - The Business of Propaganda.pdf
- Image Completo
- Michael Aaron book 1.pdf
- Efek Hormonal Pada Ovulasi Dan Pemijahan Ikan
- Bill Evans Transcriptions - 2 pieces.pdf
- The Craft of the Musical Composition
- uji validitas dan reabilitas.docx
- Desain Menu Makanan_06!03!18
- 7. SKK dr Anak
- Barroco
- Fomulir A
- A Briet History.pdf
- CAMES.doc
- Buenas Practicas Manipulacion Alimentos CARE
- 20.pdf
- Common GDCR
- APORTE COLABORATIVO ingles.docx
- GANGGUAN ASAM BASA
- Sistem Portal
- 5 COMPUTO METRICO PONENCIA 1.pdf
- Lógica-con-cubos-01-SOL
- Carmen.pdf
- AURELL.2015.Model for Installation Cost Management
- 8.SHEN
- 47fe1e6506abbbd2d41c2bc92c54b11704de
- 22b.patterson Gpops II August 2013
- 10.1.1.669.794
- 8.HO
- MELIONES_A Web-based Three-tier Control and Monitoring Application for Integrated Facility Management of Photovoltaic Systems
- 2017-119
- IoT Lecture Public
- 37.SHEN
- USSDEK_High-Sensitivity Gas Detection and Monitoring System for High-Risk Welding Activity
- Estratigrafia y Sedimentologia de La SUC
- IYONI II_Gas Monitor and Cap Lamp Combination
- 15.CHAO
- 12.HUANG
- COLLAZOS_Rediseño del sistema productivo utilizando técnicas de distribución de planta.pdf
- 26.WANG
- Van de WEIJER.2006_Coloring Local Feature Extraction
- SERRE.2007_Robust object recognition with cortex-like mechanism.pdf
- 24.TEO
- KLOESEL_A Technology Pathway for Airbreathing, Combined-cycle, Horizontal Space Launch Through SR-71 Based Trajectory Modeling
- LI.2012_Automatic Woven Fabric Classification Based on SVM
- SCHMIDHUBER.2015_Deep Learning in Neural Networks. an Overview
- KELLER_Single Row Layout Models
- 20.SIVA
- KANG.2015_Automatic Classification of Woven Fabric Structure Based on Computer Vision Techniques
- 3.CHEN
- NILSBACK.2006_A Visual Vocabulary for Flower Classification
- Patterson Gpopsii Usersguide
- 16.Ramazan

**SWARM OPTIMIZATION SYSTEM
**

ENDER OZCAN AND CHILUKURI K. MOHAN

eozcan/mohan@top.cis.syr.edu

2-120 CST Department of EECS

Syracuse University, Syracuse, NY 13244-4100, U.S.A.

ABSTRACT:

Particle Swarm Optimization (PSO) is a recently proposed approach,

based on social behavior of organisms such as birds and

g. In addition to providing a tool for optimization. PSO provides a population-based search procedure. the trajectories of even a simple particle swarm optimization system have not been formally obtained. In research results reported so far. In other words. 1997. The best positions encountered by a particle and its neighbor determine the parti- cle's trajectory along with other PSO parameters. e.shes (Kennedy and Eberhart. Search is conducted by \ ying" particles in the space. scattering suddenly. PSO is similar to modern GAs and memetic algorithms. This paper provides the trajectory equations for various parameter values in closed form. 1995).. another important aspect of the PSO approach is its applicability in analyzing socio-cognition of hu- man and arti. \Particle Swarm Optimization" (PSO) (Kennedy and Eberhart. a PSO system attempts to balance exploration and exploitation by combining local and global search methods. where each individual is abstracted as a \particle" that ies around in a multidimensional search space. then regrouping again. but in an unpredictable manner. This new approach combines notions of evolutionary computation and swarm theory (Kennedy. INTRODUCTION Birds in a group ock synchronously. 1995). Studies to simulate the underly- ing rules of bird social behavior led to a new approach for optimizing real-valued functions. 1997). In this aspect.

1997) suggests that knowledge is optimized by social interaction. Both Eberhart and Angeline advocated focusing on hybrid implementations. In proposing the PSO approach. Angeline (1998) performed an empirical comparison of PSO with EP. exper- imenting with dierent functions.cial agents. and that thought processes are not completely separate for dierent individuals. Experimental results demonstrated that the PSO algorithms were competitive. Eberhart and Shi (1998) show that the behavior of a PSO system falls in be- tween genetic algorithms and evolutionary programming. Kennedy (1998. initialization techniques and dimensionality. based on principles of social psychology. . they involve interpersonal communication.

all previous research on PSO systems has pro- vided empirical results and informal analyses. This paper presents the . To the best of our knowledge.

crucial to understand the dynamics of how particle behavior depends on parameters for making the right choices of parameter values.rst for- mal analysis of a traditional simple particle system. PSO ALGORITHM Each particle in a PSO system is associated with a point in a multidimensional search space in which we are attempting to .

nd an optimal location with respect to a .

Pj (t). vi.tness function f . :::. (t). (t).d(t)) 1 2 N (Pi). :::. where Pi(t) = (xi. is de. We will use the following terminology: P (t) is a population of m particles in a multidimensional space at time step t. Pm(t)) 1 Pi(t) is the ith particle in a d dimensional space at time step t. the neighborhood of a particle Pi . (t). where P (t) = (P (t). xi. (t). :::. :::. :::. vi.d(t)) 1 2 The velocity of Pi(t) is represented in a d dimensional space as Vi(t) = (vi. xi. Pi(t).

in the context of a prede.ned as all those particles Pk such that Pi and Pk are \near" each other.

ned topology. De.

such that Pj 2 N (Pi ) and f (Pj (t00)) f (Pk (t 1)) for all t00 t 1 and Pk 2 N (Pi ).ne Pj (t) (global best) to be the best position of a particle Pj at time (00 ) step t. De.

1)(Pi (t) Pi(t 1)) + 1 1 ( ) c U (0. ( ) Using the above notation. 1)(Pj (t) Pi(t 1)) 2 2 (00 ) (3) . 1)(Pi (t) Pi (t 1)) + 1 1 ( ) c U (0. (1998) suggested modifying Equation 1.ne Pi (t) (local best) to be the best previous position of Pi at time ( ) step t.1) is a uniformly dis- 1 2 tributed random number in [0. 1)(Pj (t) Pi(t 1)) 2 2 (00 ) (1) Pi(t) = Pi (t 1) + Vi (t) (2) where c and c are two positive constants and U(0. each particle Pi moves according to the following equation: Vi(t) = Vi (t 1) + c U (0. for all t t 1. incorporating an inertia weight w.1]. Shi et al. such that f (Pi (t)) f (Pi (t 1)). as follows: Vi (t) = wVi (t 1) + c U (0.

particles are placed in the space randomly. Initially. If the topology is de.

1). Particles start with a constant initial velocity. resembling the approach of KNUX (Maini et al. = c U (0. and xi (t) = p are constants and imposing the initial condi- 1 2 tions v(0) = v and x(0) = x . 1 1 1 2 2 2 Assuming . it often helps to begin by examining a simpler version of it. then move to their new location. SIMPLIFYING THE PSO SYSTEM In order to understand the behavior of a complex system. we simplify analyses by considering systems with only one dimension in the search space for the case where Pj (t) = Pi (t) . For PSO systems. A simple 0 0 particle's behavior is de. 1994). then Pj (t) becomes the best (00 ) solution found so far. Then Equations 1 and 2 simplify to: (00 ) ( ) vi(t) = vi(t 1) + ( + )(xi (t) xi(t 1)) 1 2 (4) xi(t) = xi(t 1) + vi(t) (5) where = c U (0..ned such that all particles are assumed to be neighbors. 1). we can further simplify the system. They update their velocities.

0 0 0 The following closed form can be obtained by using generating functions or any method for solving non-homogeneous linear recurrence equations for the displacement. 1 2 By substitution. we obtain the following recursion from Equations 6 and 7: x(t) = (2 )x(t 1) x(t 2) + p (8) with initial conditions.ned by the following equation: v(t) = v(t 1) x(t 1) + p (6) x(t) = x(t 1) + v(t) (7) where = + . x(1) = x (1 ) + v + p. x(t) = ((2 + )=2)t) + . x(0) = x .

((2 )=2)t) + p (9) where q = 4 2 (10) .

= (x p)( + )=(2) v = 0 0 (11) = x p .

0 (12) TRAJECTORY OF A SIMPLE PARTICLE The signi.

Given the assumption that a particle has visited a local optimum at .cance of Equation 9 is that at any time of the run we can deter- mine the trajectory of an isolated particle whose personal best is the same as the global best.

The roots of parabola U are at 0 and 4. Increasing may have a similar eect as increasing the velocity with a higher magnitude. it will increase its step size exponentially at each time step. We can an- alyze the trajectory equation in two domains. allowing it to search in a larger space. As we increase the initial velocity. Complex From Equations 9. The trajectory equation becomes: 0 x(t) = (qv =)(((2 + )=2)t ((2 )=2)t) 0 (13) = 4 2 (14) If U = 4 > 0 then is a positive real number. Recall that 0. with an increase in the speed proportionate to the initial velocity (x(t) = v t( 1)t). When a particle is in the zone where is real. choosing this location as a starting point for our search (x = p = 0). can be described as an oscillatory graph bounded by exponential functions. We can rewrite the trajectory equations as: x(t) = zt + . Real is a real number when = 0. the particle will move 0 in the in opposite directions at consecutive time steps. The initial velocity determines the steepness of the envelope by which this oscillation is bounded. = 4 and > 4. is a complex number when 0 < < 4. 0 Case > 4: The trajectory of a particle.x = 0.12. since the particle might stray out of the search space and not come back. the envelope will diverge faster and this will cause the step size of particle to increase further. Case = 0: This is a special case. 2 < (Real) and 2 = (Complex). producing the following recursive trajectory equation: x(t) = 2x(t 1) x(t 2) (15) Solving this equation yields x(t) = (x p) + v t 0 0 (16) Note that given x = p = 0. the particle will move in the initial direction with 0 the initial velocity forever (x(t) = v t). This will necessitate a control action. as determined by Equations 13. otherwise it is a complex 2 number.14. let us analyze the trajectory of a simple particle. along with other parameters. 0 Case = 4: The recursive trajectory equation becomes as follows: x(t) = 2x(t 1) x(t 2) + 4p (17) The closed form for Equation 17 is: x(t) = ((x p) + (2(x p) v )t)( 1)t + p 0 0 0 (18) It is obvious from Equation 18 that given x = p = 0.

zt 1 2 (19) .

where z = (2 + 0)=2 1 (20) z = (2 0)=2 2 (21) .

= (x p)( + )=(2 ) v = 0 0 0 0 0 (22) = xq p .

0 (23) = i j 4j 0 2 (24) Assuming x = p = 0 the trajectory equation simpli.

a `good' par- ticle in this zone might get stuck searching the regions that have already been searched. unless another particle in its neighborhood . Note that in sin(2 ) is the frequency of the sine wave. In other words. Due to the periodic nature of the trajectory equation. our choice of parameters determines the direction and step size of a particle.es to: 0 x(t) = (2v =jj0jj)sin(atan(jj0jj=(2 ))t) 0 (25) This equation implies that the trajectory of a simple particle in complex zone is a sinusoidal wave and our choice of parameters determines the amplitude and the frequency of the wave. Also recall that atan is an increasing function. with period T = 1= .

setting the other parameters constant. Whenever > 2. the psine waves will be lagging behind p by . Meanwhile we will have a wave whose frequency is relatively smaller. jj0jj becomes < 1. Case = 2: The term x(t 1) drops out in Equation 8. For a simple particle. as described below: Case 0 < 2 3 0:268: The amplitude of the sine wave will increase. search is conducted by increasing step sizes in the space. We can divide thispdomain into subregions depending on . 0 Case 2 + 3 < < 4: The amplitude p of the sine wave will increase with . . intelligent parameter adaptation methods can be incorporated into the original PSO equations. The simulations of Kennedy in 1998a correspond exactly to our analytical results. Using type 1. amplitude of the sine wave will bep approximately v . CONCLUSIONS We have formalized the behavior of a simple particle. since jj0jj becomes < 1. Based on our results. as decreases. amplitude of the sine waves will be positive. the trajectory equation becomes: x(t) = v sin(t=2) 0 (26) Notice that for < 2. reducing the frequency which is inversely proportional to the period of a sine wave. Since jj0jj is also bounded by a maximum of 5 in magnitude. Case 2 3 < < 2 and 2 < 2 +p 3 3:732: jj0jj becomes > 1. which gives us a sense of what the trajectories of particles in a PSO system might look like. Note that similar to the 0 < 2 3 case. empirically supporting our formal analyses. there are four search types.nds a better point. making the period larger.

In other types.Due to this behavior. In type 3. a particle may get stuck and repeat exploring a part of the search space already visited. For other types. since it might take a particle out of the search space without letting it return. the amplitude of the sine wave is approximately the initial velocity. the amplitude is magni. In types 2 and 4. type 1 might not be favored. a particle follows a path on a sinusoidal wave searching a space bounded by the amplitude of the sine wave.

rather than the modi. Our results support the traditional PSO.ed.

Y. 8. pp. Shape Matching Using Genetic Algorithms. (1997). Vol. Ozcan. The Seventh Annual Conf. Inertia weight arranges the boundaries in between types (cases). 1998.. IEEE Service Center. Kennedy. The Seventh Annual Conf. Y. Piscataway. Comparison between Genetic Algorithms and Particle Swarm Optimization. A wave with a high frequency or amplitude is not necessarily a good wave for a particle. H. on Systems. on Evolutionary Programming. The Seventh Annual Conf. Note that limiting the velocity (Vmax) seems to help the particle to \jump" onto another wave. Each particle attempts to \catch" another wave randomly.. J. R. IEEE Service Center. of IEEE Int. (1997). (1994). NJ. (1998). (1995). and Shi. Conf. R. (1998). Eberhart. (1998a).. Particle swarm optimization. Piscataway. and Ranka. Kennedy.. PhD Disserta- tion. pp. Indiana). Knowledge-based Nonuniform Crossover. 56-76. Complex Systems. C. C. and Eberhart. Proceedings of IEEE Int..... (Perth. J. R. on Evolutionary Computation (Indianapolis. IEEE Service Center. E. 257-293. 303-308. on Neural Networks. Mehrotra. Shi. Parameter Selection in Particle Swarm Optimization. J. Australia). Piscataway. and Eberhart. pp. Kennedy. More details can be found in Ozcan. J. K. (1998). Evolutionary Optimization versus Particle Swarm Op- timization: Philosophy and Performance Dierences. Mohan. Kennedy. 42. NJ.. 1998). The Seventh Annual Conf. 1942-1948.. on Evolu- tionary Programming. Conf.. . and Cybernetics. Journal of Con ict Resolution. S.. trying to move to an op- timal location. Kennedy. Proceedings of Conf.. 4104-4109. Thinking is social: Experiments with the adaptive culture model. J. Proc.. Particles \surf" the search space on sine waves. A discerete binary version of the particle swarm algorithm. The particle swarm: social adaptation of knowledge. Man. and Eberhart. R.. on Evolutionary Programming.. REFERENCES Angeline. pp.ed one with inertia weight (Shi and Eberhart. on Evolutionary Programming. (1998). NJ.. (1998). P. C. The Behavior of Particles. Maini.

- rtqphysicsUploaded byjamesyu
- Katz InglesUploaded bypedrosndval
- ajeee-2-3-10Uploaded byyarra teja
- ECE 225 ExperimentsUploaded bydnav1984
- Particle Swarm OptimizationUploaded byMuhammad Massab Khan
- TOC FINALUploaded byharinima
- Learnabout Sin WaveUploaded byAnupam Shakya
- 2D PSO.pdfUploaded bysyrine2112
- 2Uploaded bynidharshan
- Energy Aware CH Selection Using PSOUploaded byLavanya Roy Sharma
- 8_summaryUploaded byDorJon
- NARMA modelUploaded byecommr
- Wave Practice 2Uploaded bySoyoko U.
- Paper50.pdfUploaded byPratik Choudhary
- H1 Physics J2 CT1 2013 Paper 2 SolutionsUploaded byMichael Leung
- Time History MethodUploaded byV.m. Rajan
- SILIBUS_sEM1DFOI4Uploaded byZulaikha Zulkifli
- Doppler ExperimentUploaded byanirudh
- Paper-Effectiveness of Snubber as a Pressure Pulsation Limiting UnitUploaded byDhanny Miharja
- LabView_ExerciseUploaded bySitikus1950
- Hybrid of Ant Colony Optimization and Gravitational Emulation Based Load Balancing Strategy in Cloud ComputingUploaded byAnonymous kw8Yrp0R5r
- Lect_34Uploaded byFebrio Erdhi Sadewa
- AD 0011687Uploaded byOskar Dirlewanger
- AutoLab Impedance tutorialUploaded byHee-lak Lee
- Problems Vibrations and Waves_Physics_7_Ed Serway-2.pdfUploaded byNathalia Acevedo
- Abstract Does Not Have Unit in OrderUploaded byJulius_Ian_D_L_2866
- Walter Russell.docxUploaded byJohnEch
- final paper 6-6-13Uploaded byapi-253562120
- calcul_perete_izolatUploaded byandreibadica
- QMLect2probsSOLNUploaded byMark Eichenlaub

- AURELL.2015.Model for Installation Cost ManagementUploaded byAnonymous PsEz5kGVae
- 8.SHENUploaded byAnonymous PsEz5kGVae
- 47fe1e6506abbbd2d41c2bc92c54b11704deUploaded byAnonymous PsEz5kGVae
- 22b.patterson Gpops II August 2013Uploaded byAnonymous PsEz5kGVae
- 10.1.1.669.794Uploaded byAnonymous PsEz5kGVae
- 8.HOUploaded byAnonymous PsEz5kGVae
- MELIONES_A Web-based Three-tier Control and Monitoring Application for Integrated Facility Management of Photovoltaic SystemsUploaded byAnonymous PsEz5kGVae
- 2017-119Uploaded byAnonymous PsEz5kGVae
- IoT Lecture PublicUploaded byAnonymous PsEz5kGVae
- 37.SHENUploaded byAnonymous PsEz5kGVae
- USSDEK_High-Sensitivity Gas Detection and Monitoring System for High-Risk Welding ActivityUploaded byAnonymous PsEz5kGVae
- Estratigrafia y Sedimentologia de La SUCUploaded byAnonymous PsEz5kGVae
- IYONI II_Gas Monitor and Cap Lamp CombinationUploaded byAnonymous PsEz5kGVae
- 15.CHAOUploaded byAnonymous PsEz5kGVae
- 12.HUANGUploaded byAnonymous PsEz5kGVae
- COLLAZOS_Rediseño del sistema productivo utilizando técnicas de distribución de planta.pdfUploaded byAnonymous PsEz5kGVae
- 26.WANGUploaded byAnonymous PsEz5kGVae
- Van de WEIJER.2006_Coloring Local Feature ExtractionUploaded byAnonymous PsEz5kGVae
- SERRE.2007_Robust object recognition with cortex-like mechanism.pdfUploaded byAnonymous PsEz5kGVae
- 24.TEOUploaded byAnonymous PsEz5kGVae
- KLOESEL_A Technology Pathway for Airbreathing, Combined-cycle, Horizontal Space Launch Through SR-71 Based Trajectory ModelingUploaded byAnonymous PsEz5kGVae
- LI.2012_Automatic Woven Fabric Classification Based on SVMUploaded byAnonymous PsEz5kGVae
- SCHMIDHUBER.2015_Deep Learning in Neural Networks. an OverviewUploaded byAnonymous PsEz5kGVae
- KELLER_Single Row Layout ModelsUploaded byAnonymous PsEz5kGVae
- 20.SIVAUploaded byAnonymous PsEz5kGVae
- KANG.2015_Automatic Classification of Woven Fabric Structure Based on Computer Vision TechniquesUploaded byAnonymous PsEz5kGVae
- 3.CHENUploaded byAnonymous PsEz5kGVae
- NILSBACK.2006_A Visual Vocabulary for Flower ClassificationUploaded byAnonymous PsEz5kGVae
- Patterson Gpopsii UsersguideUploaded byAnonymous PsEz5kGVae
- 16.RamazanUploaded byAnonymous PsEz5kGVae