Professional Documents
Culture Documents
Abstract
Model order reduction (MOR) is a process of finding a lower order model for the original high order system with reasonable accuracy in order to sim-
plify analysis, design, modeling and simulation for large complex systems. It is desirable that the reduced order model preserves the fundamental prop-
erties of the original system. This paper presents a new MOR technique of multi-input multi-output systems utilizing the firefly algorithm (FA) as an
artificial intelligence technique. The reduction operation is proposed to maintain the exact dominant dynamics in the reduced order model with the
advantage of substructure preservation. This is mainly possible for systems that are characterized as multi-time scale systems. Obtaining the reduced
order model is achieved by minimizing the fitness function that is related to the error between the full and reduced order models’ responses. The new
approach is compared with recently published work on firefly optimization for MOR, in addition to three other artificial intelligence techniques; namely,
invasive weed optimization, particle swarm optimization and genetic algorithm. As a result, simulations show the potential of the FA for the process of
MOR.
Keywords
Model order reduction, firefly optimization, artificial intelligence, singular perturbation approximation, dominant dynamics
optimization problems (Fister et al., 2013). Heuristic opera- The reduced order model, on the other hand, is obtained as
tion is referred to as discovering solutions by trial and error in
a reasonable amount of time and that there is no guarantee x_ r (t) = Ar xr (t) + Br u(t)
ð3Þ
that optimal solutions are reached. Stochastic is described as yr (t) = Cr xr (t)
it uses some kind of randomization in searching for a set of
solutions. The FA is inspired by the flashing behavior of fire- where Ar 2 <nr 3 nr , Br 2 <nr 3 m and Cr 2 <p 3 nr : Note that
flies as they search for their targets. In which it attracts other the feed-through Dr has been eliminated in order to produce
fireflies formatting. The idea of attractiveness and informa- a strictly proper model. The model is motivated by the SP
tion passing is what leads to the FA inspiration (Fister et al., technique. The SP objective in the reduced order model is
2013). achieved by maintaining the full order dominant dynamics in
In this paper, the ability of the FA technique to produce the reduced order model, as motivated by singular perturba-
relatively acceptable reduced order models while maintaining tion method. To achieve such an objective, the multi-time-
the system’s main characteristics will be investigated. The idea scale state matrix Ar is designed to have the following form
has been motivated by the singular perturbation approxima-
2 3
tion (SPA) (Alsmadi et al., 2014a). The paper proposes a new l1 a12 a13 a14 a1nr
MOR technique of MIMO systems utilizing the firefly opti- 60 l2 a23 a24 7
6 .. .. .. 7
mization method. The reduction process is performed in two 6 7
6 . . . 7
parts; the first one uses the dominant pole method, while the 6 .. 7
6 : 0 lb . 7
second utilizes the firefly optimization method. The reduction 6 7
Ar = 6
6 : 0 s1 a1 7
7
operation is proposed to maintain the exact dominant 6 : 7
6 0 a1 s1 7
dynamics in the reduced order model with the advantage of 6 .. 7
substructure preservation (SP). This is mainly possible for 6 0 0 . a(nr 2)nr 7
6 7
4 0 sp a 5
systems that are characterized as multi-time scale systems. p
Obtaining the reduced order model is achieved by minimizing 0 : : : 0 ap sp
the fitness function that is related to the error between the full ð4Þ
and reduced order models’ responses. Simulation results show
the potential of the FA as an artificial intelligence technique where the original system dominant eigenvalues (real and/or
for the process of MOR. The new technique is compared with complex) are preserved in the diagonal, with time scale
recently published work on firefly for MOR. The results pre- arrangement set as li, i = 1, 2, . b (real) and si 6ai , i = 1,
sented in this paper show the superiority of the proposed FA 2, . p (complex). Notice that for this reduced-order model
method over the other methods. In addition, the work pre- nr = (b + 2p)\n, and a reduction can be performed to any
sented will compare the results of the proposed FA reduction time scale as appropriate. It is important to mention that for
technique with some other artificial intelligence optimization an efficient MOR of multi-time-scale systems (i.e. dominant
techniques; namely, invasive weed optimization (IWO) and none dominant dynamic categories), the following condi-
(Mehrabian and Lucas, 2006), particle swarm optimization tion is to be satisfied (with li being negative real parts)
(PSO) (Kennedy and Eberhart, 1995) and genetic algorithm
(GA) (Abo-Hammour et al., 2011; Alsmadi et al., 2011c). ldominant dl1 . l2 . . lb , l . s, and s1 . s2 . . sp
The paper is organized as follows. In Section 2, we present ð5Þ
the mathematical framework for developing the MOR model
parameters estimation method. In Section 3, we present simu- where all of the elements in (5) are considered as dominant
lation results. In Section 4, a discussion is presented. Finally, dynamics (the real and complex distinct eigenvalues). The
we give some concluding remarks in Section 5. modal form is chosen, as given in (4), which implies that the
elements as aij (i and j = 1,.nr) are set to zero. On the other
hand, the reduction operation is performed by eliminating the
Problem formulation non-dominant dynamics given by
optimization problems. Fireflies use a system of flashes to advantages suggest the use of the FA to increase the efficiency
communicate. They use their light to attract others. A firefly without deterioration of approximation accuracy for model
emits light from a tiny organ called a lantern, where a bio- reduction.
chemical reaction takes place. The reaction releases energy in After initialization, each firefly is compared against all of
the form of light. Every species of flashing firefly has its own the other fireflies, and will move towards every brighter firefly
pattern. These unique patterns let males and females of the encountered. Once a bright firefly is found, the distance
same species recognize one another in the dark (Fister et al., between the fireflies, has to be calculated. Different forms of
2013). distance calculation can be used; however, in general the
To govern the algorithm and create a modeled firefly’s Cartesian distance is appropriate. The Cartesian distance
behavior, there are three notes to be taken. Firstly, the fire- between two fireflies in D-dimensional space can be calcu-
flies are unisex; therefore, any firefly could be attracted to lated as follows (Alsmadi et al., 2016)
any of the other fireflies. Secondly, the attractiveness is deter- vffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi
mined by their brightness, where a less bright firefly will move u D
uX
towards a brighter one. Finally, the brightness of a firefly is rij = xi xj = t
(xi, d xj, d )2 ð9Þ
proportional to the value of the function being minimized d=1
(Fister et al., 2013).
The locations of the fireflies must be considered when com- where xi and xj are the position vectors for firefly i and j,
paring the brightness of any two fireflies. In the real world, if respectively, with xi (n) representing the position value for the
a firefly is searching for another, it can only see so far (Fister nth dimension. The movement of a less attractive firefly i
et al., 2013). The farther another firefly, the less bright it will towards a more attractiveness firefly j is given by (Yang,
be to the vision of the first firefly. This is due to the light 2009)
intensity decreasing under the inverse square law. That is, the
light intensity of a firefly with ‘‘r’’ distance between any two 2 1
xi = xi + b0 egrij (xj xi ) + a(rand ) ð10Þ
fireflies will be reduced by a factor of 1=r. The air will also 2
absorb part of the light as the firefly travels, which will further
where xi is the current position of the firefly within the solu-
reduce the perceived intensity. The light intensity I(r) varies
tion space. The combination of the elements in the second
according to the following equation (Rahkar-Farshi and
term represents the firefly’s attractiveness, as seen by the other
Behjat-Jamal, 2016)
fireflies. A random adjustment is given in the movement of
2 the firefly with a representing a scaling parameter to control
I(r) = I0 egr ð7Þ the amount of randomness. The scaling parameter a 2 ½0, 1,
with being
where I0 denotes the light intensity of the source, g 2 ½0, ‘
represents the light absorption coefficient that controls the
0 Corresponds to no randomness
decrease in the intensity of light. ð11Þ
1 Corresponds to fully being random
The attractiveness, b, of fireflies is proportional to their
light intensities, I(r). Therefore, a similar equation to (7) can
Notice that rand (a MATLAB Command) is a uniformly dis-
be defined to describe the attractiveness b (Rahkar-Farshi
tributed random number, in which rand 2 (0, 1) (Yang, 2009).
and Behjat-Jamal, 2016)
2
b(r) = b0 egr ð8Þ FA optimization approach
where b0 is the initial attractiveness at (r = 0). FA is based on the objective function and corresponding fit-
To start the search operation algorithm, the fireflies are ness levels used to find the optimal solution. It is an iterative
placed in random locations. The location of a firefly corre-
sponds to the values of the parameters for the objective func-
tion to be solved (Rahkar-Farshi and Behjat-Jamal, 2016).
For any two flashing fireflies, as seen in Figure (1), the less
bright firefly (FFi) moves toward the brighter one (FFj)
according to the attractiveness b, regardless of their sex. The
attractiveness is proportional to the light intensity, I, observed
by the partner, which monotonically decreases as the distance
between two fireflies increases. This is due to the inverse
square law and the absorption coefficient of light. The bright-
est firefly moves randomly (Hachino et al., 2015).
The FA consists of only the basic arithmetic operations
and does not require complicated coding and genetic opera-
tions such as crossovers and mutations of the GA. In addi-
tion, the performance and computational cost of the FA are
shown to be better than those of other population-based algo-
rithms such as the GA and the POS (Lohrer, 2013). These Figure 1. Fireflies formatting search process.
2878 Transactions of the Institute of Measurement and Control 41(10)
Simulation examples
This section presents some simulation results and comparison
diagrams that have been used to compare the proposed FA
approach with other known algorithms. MATLAB software
tools were utilized for the simulations. The parameters of the
proposed FA technique were used to design the state matrix
are shown in Table 1.
Example 1
As an illustrative example, we will consider a Single-Machine
Infinite-Bus (SMIB) power system, shown in Figure 3, to
examine the proposed FA approach. The parameter values
are given as specified in Parmar et al. (2007). The machine is
supplying power through a step-up transformer and a high-
Figure 2. FA MOR flowchart. voltage transmission line to an infinite grid. The XT and XL in
Alsmadi et al. 2879
Table 1. FA parameters.
Parameter Value
with eigenvalues given as: l = {-18.9311 6 2.0250i, -12.1968, The proposed method is first investigated for SISO type
-9.6484, -2.1313, -0.8972 6 1.3560i, -0.2394 6 3.2350i,- systems, which for this example, the second column of the sys-
0.1001}. tem input matrix and the second row of the output system
Indeed, there exist different methods for determining the matrix are eliminated. Thus, performing the reduction opera-
dominant dynamics of a given system. In this paper, however, tion, the following 6th order reduced model was obtained
we will use the traditional method, which is by inspecting the
2880 Transactions of the Institute of Measurement and Control 41(10)
Figure 7. Frequency responses for the 6th reduced order and the 10th
Figure 5. Step responses for the 6th reduced order and the 10th full
full order models.
order models.
The selection of this 5th order model shows that the dominant
Figure 6. Impulse responses for the 6th reduced order and the 10th full dynamics of the original system presented exactly in the
order models. reduced order model, which can be seen as
2 3 2 3
0:2394 3:2350 0 0 0 0 1:8080
6 3:2350 0:2394 0 0 0 0 7 6 2:2090 7
6 7 6 7
6 7 6 7
6 0 0 0:8972 1:3560 0 0 7 6 1:2650 7
x_ r ðtÞ = 6
6
7xr ðtÞ + 6
7
7
6 0:8226 7uðtÞ
6 0 0 1:3560 0:8972 0 0 7 6 7
6 7 6 7
4 0 0 0 0 2:1313 0 5 4 0:7837 5
0 0 0 0 0 0:1001 0:07042
yr ðtÞ = ½1:324 0:1057 0:9861 4:997 4:026 0:01518 xr ðtÞ
with eigenvalues given as {-1, -2, -3, -4, -5, -6, -7, -8}.
Observing the dynamics (eigenvalues) of this system, it is seen
that the system is not a two-time scale type; however, it is
found that the dominant dynamics are seen in the poles {-1, -
6}. Hence, the reduction process is performed correspond-
ingly. As a result, the following 2nd order reduced model is
obtained
17:198052s + 6:0524
Gr (s) =
s2 + 7s + 6
16:91s + 5:255
Gmodel1 (s) =
s2
+ 6:87s + 5:26
17:0989s + 5:0742
Gmodel2 (s) = 2
Figure 11. Step responses for the full 10th order (solid line), firefly s + 6:9722s + 5:1514
reduced 4th order (dotted light line), and proposed FA reduced 4th
order models (dotted dark line).
The simulation results are presented in Figure 12. In part of
the comparison, it is important to mention that the original
exact dominant dynamics are only preserved by the new
approach.
method is superior and has a potential advantage in provid-
ing reduced order models with SP and relative accuracy of
system response. Example 3
In this example, we consider a 9th order system evaluated by
Example 2 Desai and Prasad (2013) and Boby and Pal (2010). The system
is given by the following transfer function
In this example, we consider an 8th order SISO system evalu-
ated by Desai and Prasad (2013) and Mukherjee et al. (2005).
The system is given as follows
Figure 12. Step and frequency responses for the full 8th order, Model1 reduced 2nd order, Model2 reduced 2nd order and proposed FA reduced 2nd
order models.
Alsmadi et al. 2883
Figure 13. Step and frequency responses for the full 8th order, Model1 reduced 2nd order, Model2 reduced 2nd order and proposed FA reduced 2nd
order models.
with eigenvalues given as {-1, -161i, -162i, -163i, -164i}. methods is based on the values of the RMSE, which repre-
Observing the dynamics (eigenvalues) of this system, it is seen sented as equation (16).
that the system is not a two-time scale type; however, it is con- The results in Table (2) show that proposed FA has the
sidered for comparison purposes, keeping in mind that preser- second-best solution after PSO optimization with RMSE of
ving the exact dominant dynamics in the reduced order is only 0.002.
performed in the proposed method. Table (3) presents the evaluations of FA results in Alsmadi
Performing the FA reduction technique, and focusing on et al. (2016) and the proposed FA, with results seen as much
the dynamics {-1, -161i}, the following 3rd order reduced better in the proposed work.
model is obtained When FA simulation results were compared with other
methods’ results, such as GA, PSO algorithm and IWO, in
0:50532s2 + 0:4003s + 2:0 solving MOR problems, it was found that FA transcends the
Gr (s) =
s3 + 3s2 + 4s + 2 other methods in the error sense by leading to better (lower)
RMSE. Also, it is noted that the FA was more accurate and
while Desai and Prasad (2013) and Boby and Pal (2010), cor- the success rate was remarkably better than the other men-
respondingly, found the following reduced orders, tioned algorithms.
0:08717s2 + 0:3142s + 0:493
Gmodel1 (s) =
s3 + 1:494s2 + 1:34s + 0:493
0:5058s2 1:9848s + 3:5341
Gmodel2 (s) = 3
s + 3s2 + 5:5341s + 3:5341
which provided the simulation results shown in Figure 13. In
short, it is seen that each method has its advantages and
shortcomings.
Discussion
In comparing the performance of the proposed method with
others, Figure (14) shows five different diagrams, comparing
between the original system of example one, without reduc-
tion and reduced models using four different optimization
techniques: IWO (Mehrabian and Lucas, 2006), PSO
(Kennedy and Eberhart, 1995), GA (Abo-Hammour et al.,
2011) and the proposed algorithm (firefly optimization) for
fourth order reduction. The comparison between these Figure 14. Comparison of step responses for four different techniques.
2884 Transactions of the Institute of Measurement and Control 41(10)
Table 2. Evaluation of methods. Alsmadi OMK, Abo-Hammour ZS, Al-Smadi AM and Abu-Al-
Nadi DI (2011b) Genetic algorithm approach with frequency
Method Generation RMSE SP selectivity for model order reduction of MIMO systems. Mathe-
matical and Computer Modelling of Dynamical Systems 17(2):
GA 200 0.0033 Achieved 163–181.
IWO 1000 0.0038 Achieved Alsmadi OMK, Abo-Hammour ZS, Al-Smadi AM and Saraireh SS
PSO 500 0.0024 Achieved (2011c) A robust and efficient genetic algorithm for solving a
Proposed FA 500 0.0025 Achieved chemical reactor problem: Theory, application and convergence.
Transactions of the Institute of Measurement and Control 34(5):
594–603.
Alsmadi OMK, Abo-Hammour ZS, Saraireh SS and Marzouq AA
(2014a) Substructure preservation sylvester-based model order
Table 3. Evaluation of methods.
reduction with application to power systems. Electric Power Com-
ponents and Systems 42(9): 914–926.
Method Generation RMS SP Steady State
Alsmadi OMK, Abu-Al-Nadi DI and Abo-Hammour ZS (2014b)
error
Partical swarm optimaization for MOR singularly perturbed sys-
FA paper of 2500 0.0289 Achieved Not Achieved tems with critical frequency preservation and application to power
Alsmadi et al. systems simplified modeling. Journal of Circuits, Systems and
(2016) Computers 23(5): 1–20.
Proposed FA 500 0.0020 Achieved Achieved Antoulas AC, Sorensen DC and Gugercin S (2001) A survey of model
reduction methods for large-scale systems. Contemporary mathe-
matics 280: 193–220.
Benner P, Gugercin S and Willcox K (2015) A survey of projection-
based model reduction methods for parametric dynamical systems.
Conclusions SIAM Review 57(4): 483–531.
We examined the problem of MOR for multi-time scale sys- Boby P and Pal J (2010) An evolutionary computation based
tems. The reduction process was performed using the firefly approach for reduced order modelling of linear systems. In: IEEE
International Conference on Computational Intelligence and Com-
optimization technique. This approach was able to produce
puting Research (ICCIC), Coimbatore, India, 28–29 December
reduced order models with the advantage of substructure pre- 2010.
servation, as to maintaining the system dominant dynamics in Chen C and Shieh L (1968) A Novel Approach to Linear Model Sim-
the reduced order. The performance of the proposed method plification. International Journal on Control 8(2): 561–570.
was compared with recently published work concerning MOR Chidambara MR (1967) Further Comments by M.R. Chidambara.
via the firefly method. Simulation results show the potential IEEE Transaction on Automatic Control AC-12: 799–800.
of the FA as an artificial intelligence technique for the process Davison EJ (1966) A Method for Simplifying Linear Dynamic Sys-
of MOR. In addition, the results of the proposed FA reduc- tems. IEEE Transactions on Automatic Control AC-11(1): 93–101.
tion technique were compared with three other optimization Desai SR and Prasad R (2013) A new approach to order reductionus-
ing stabilityequation and big bang big crunch optimization. Sys-
techniques, namely, IWO, PSO and GA. The results show
tems Science and Control Engineering Journal 1(1): 20–27.
some superiority of the proposed FA over the other methods.
Fister I, Yang X and Brest J (2013) A comprehensive review of firefly
algorithms. Swarm and Evolutionary Computation 13(3): 34–46.
Funding Gharaibeh EA (2016) Design of reduced order controller for multi-
time-scale power systems via firefly optimization. MS Thesis, Yar-
The author(s) received no financial support for the research, mouk University, Irbid, Jordan.
authorship, and/or publication of this article. Gugercin S and Antoulas AC (2004) A survey of model reduction by
balanced truncation and some new results. International Journal of
Control 77(8): 748–766.
References Hachino T, Tanigawa K, Takata H, Fukushima S and Igarashi Y
Abo-Hammour ZS, Asasfeh AG, Al-Smadi AM and Alsmadi OMK (2015) Frequency-weighted model reduction using firefly algo-
(2011) A novel continuous genetic algorithm for the solution of rithm. Journal of Automation and Control Engineering 3(3):
optimal control problems. Optimal Control Applications and Meth- 222–227.
ods 32(4): 414–432. Iglesias A (2013) Firefly Algorithm for explicit b-spline curve fitting
Abu-Al-Nadi DI, Alsmadi OMK and Abo-Hammour ZS (2011) to data points. Mathematical Problems in Engineering 2013: 1–12.
Reduced order modeling of linear MIMO systems using particle Kennedy J and Eberhart R (1995) Particle swarm optimization. In:
swarm optimization. The Seventh International Conference on IEEE International Conference on Neural Networks 4, pp. 1942–
Autonomic and Autonomous Systems, Venice, Italy, May 2011, pp. 1948. Perth, WA: IEEE.
62–66. IARIA. Lohrer MF (2013) A comparison between the firefly algorithm and
Alsmadi OMK, Abo-Hammour ZS, Abu-Al-Nadi DI and Saraireh particle swarm. Dissertation, Graduate Honor College, Oakland
SS (2016) Soft Computing Techniques for Reduced Order Model- University.
ing: Review and Application. Intelligent Automation & Soft Com- Mehrabian AR and Lucas C (2006) A novel numerical optimization
puting 22(1): 125–142. algorithm inspired from weed colonization. Ecological informatics
Alsmadi OMK, Abo-Hammour ZS and Al-Smadi AM (2011a) Artifi- 1: 355–366.
tial neural network for the discrete model order reduction with Mukherjee S, Satakshi S and Mittal RC (2005) Model order reduction
substructure preservation. Applied Mathematical Modelling 35(9): using response-matching technique. Journal of the Franklin Insti-
4620–4629. tute 342(5): 503–519.
Alsmadi et al. 2885
Parmar G, Mukherjee S and Prasad R (2007) Reduced order model- Yadav JS, Patidar NP, Panda S and Ardil C (2012) evolutionary tech-
ling of linear MIMO systems using genetic algorithm. Interna- niques for model order reduction of large scale linear systems.
tional Journal of Simulation Modelling 6(3): 173–184. International Journal of Electrical, Computer, Electronics and Com-
Rahkar-Farshi T and Behjat-Jamal S (2016) A multimodal firefly opti- munication Engineering 6(9): 1–7.
mization algorithm based on Coulomb’s Law. International Journal Yang XS (2009) Firefly algorithms for multimodal optimization. Sto-
of Advanced Computer Science and Applications 7(5): 134–141. chastic Algorithms: Foundations and Applications, [5th Interna-
Salimbahrami B and Lohmann B (2006) Order reduction of large tional Symposium [Lecture Notes in Computer Science book series
scale second-order systems using Krylov subspace methods. Lin- (LNCS, Volume 5792)] Sappora, Jappan, 26–28 October 2009,
ear Algebra and its Applications 415: 385–405. pp. 169–178.
Wilson DA (1970) Optimum solution of model-reduction problem.
Proceedings of the Institution of Electrical Engineering. IEEE
117(6): 1161–1165.