Professional Documents
Culture Documents
Optimization of Complex Nonlinear Systems Using Genetic Algorithm
Optimization of Complex Nonlinear Systems Using Genetic Algorithm
https://doi.org/10.1007/s41870-020-00421-z
ORIGINAL RESEARCH
123
Int. j. inf. tecnol.
GA relies on the mechanism of natural selection [5–8]. There have been notable development in its application
The algorithm was developed by John Holland [5, 6]. GA to solve nonlinear system of equations by improving the
is a heuristic search algorithm which works by encoding a traditional Genetic algorithm by well conditioning of sys-
potential solution. It helps in finding solutions even for a tem of nonlinear equations using calculus based variant
multi-dimensional search space [5]. GA also proves to be a gradient descent method [11], in Cycle Gas Turbine sim-
very good tool in handling the problems involving large ulation by arranging the equations by fixed point method
number of parameters. Hence, its extensive analysis and [12], parameters estimation by multi-crossover real coded
suitability to terminate with better approximate solutions genetic algorithm [13], line search sequential quadratic
have helped in its successful applications in many areas programming [14], multi-objective optimization using
including real-world problems [9–11]. The areas where GA Genetic algorithm for several benchmark problems [15],
has been successfully applied are artificial creativity, analytical existence of solution based on Matrix inversion
computer architecture, multimodal optimization, robotics, principle with Schur complement for road safety measure
scheduling, etc. [7, 9, 10]. It has also been successfully [16].
applied in aircraft wing design problems, financial time The performance of genetic algorithm is also concerned
series analysis, portfolio management and many more. This with the structure of the algorithm. To strengthen the
technique is now also being used in many applications searching efficiency of GA, numerous researchers have
including solution of NP problems [5, 7]. The solution of attempted to enhance the basic structure of GA by inte-
non-linear equations also comes under this preview. grating particle swarm optimization [17], symmetric and
The organization of the paper is as follows. Section 2 of harmonious individuals [18], augmented langrangian
this paper presents the literature review. Section 3 covers function [19], stochastic design solver based on variants of
the background. Section 4 includes the proposed model. GA [20], global and tabu search [21], set based genetic
The next section reports the results of the experiments algorithm [22].
carried out, and the last section concludes.
3 Genetic algorithm
2 Literature review
Over few decades, the use of GA has developed into a
A systematic literature review is essential to find all the vigorous problem solving and optimization technique in
evidence concerning various aspects of research issues [4]. diverse range of fields. GA is based on the biological
In this work, the review was essential to find how GA has process of the natural selection. GA is a heuristic technique
been applied for equation solving and to find the gaps in the which works on encoding potential solution [5, 6, 8].
existing methods. The review has been carried out to GA relies on the notion of survival of the fittest, which
associate genetic operations derived from nature. GA is
• Summarize methods applying GA to equation solving
initialized by a set of possible solution, where each indi-
• Find the gaps in the existing methods
vidual is represented by a chromosome. Chromosomes
• Appropriately position GA in the present context
consist of the smallest biological unit called genes. Each
The detailed literature review carried out considered pri- chromosome constitutes number of small units known as
mary studies and a few secondary studies as well [4]. It cells. There are many approaches to translate the members
may be stated here that the procedure stated by Kitchenham of solution space into chromosomes. One of the approaches
[4] was followed to make the results of the review free is to first tranforming each individual into a bit string, then
from any bias and to understand the application of the end-to-end integrating the parameters of bit string as genes
method (in this case, the GA) across a wide range of set- in a DNA strand to form a chromosome as shown in Fig. 1.
tings. Moreover, the methodology of the review has been Each chromosome represents a solution in the solution
stated to make the process repeatable. space, which may not be optimal initially. To obtain an
The study shows that GA being stochastic approach is optimal solution, genetic operators are applied on the initial
more popular than the deterministic. The reason behind is set of solution space. Since the process is inspired by
that stochastic approaches can easily deal with problems biological genetics, the reproduction functions used to
having huge search space. They does not require any priori
mathematical analysis to handle a problem. And advance-
ment in computational technology contribute in high
probability for stochastic approaches to find the optimal
solution in a short period of time.
Fig. 1 A chromosome
123
Int. j. inf. tecnol.
123
Int. j. inf. tecnol.
be done with the help of many methods like roulette wheel Table 1 Comparing values of fitness functions based on a multi-
selection, tournament selection etc. Out of which, Roulette objective optimization problem comprising two functions f1 and f2
wheel section method is commonly used as it increases the Cases f1 f2 Fitness function
probability of fittest chromosome being chosen and hence
jf1 þ f2 j jf1 j þ jf2 j
better fitter generation is created for arriving at an optimal
solution. I 9.34 - 8.5 0.84 17.84
The present work proposes a model to find the solution II 2.34 - 1.5 0.84 3.84
of non-linear equations, which has been one of the most III - 2.34 1.5 0.84 3.84
precarious tasks for both computing and mathematics fra- IV - 2.34 - 1.5 3.84 3.84
ternity. The solution of many problems, directly or indi- V 2.34 1.5 3.84 3.84
rectly, depends on the correct root of an equation. Finding VI 0.34 - 0.5 0.84 0.84
root is a search process; wherein the search of the root is to VII -1 1 0 2
be conducted from a huge search space. The search process
becomes easy if ‘fitness’ is associated with all the candi-
date solutions. To accomplish this task, many conventional
methods are available.The next section presents the pro- optimal value. The aim of the work is to search for those
posed model and methodology adopted to justify the values which help in optimizing each function fi simulta-
applicability of Genetic Algorithm in equation solving. neously rather than, merely focusing on the overall value of
fitness function. To understand the argument, let us con-
sider the following example. In the following Table 1, the
4 Proposed model values of two functions f1 and f2 at various points have
been given.
A system of non linear equation may be defined as: It may be noted that out of the sum of absolute ðjf1 j þ
9
f1 ðxÞ ¼ 0 > jf2 jÞ and the absolute of sum ðjf1 þ f2 jÞ, the former is more
>
>
> suitable. In the above example, we can observe that the
f2 ðxÞ ¼ 0 >
>
=
absolute of sum ðjf1 þ f2 jÞ is giving lower or same value,
.. > ð1Þ
than the sum of absolute ðjf1 j þ jf2 jÞ. As per case IV and V,
.>>
>
>
> the sum of absolute and the absolute of sum of functions
;
fn ðxÞ ¼ 0 gave same value when, both f1 and f2 are, either positive or
negative. Now, if we study case I and VII, we observe that
where fi , is a linear or a non-linear function, can be con-
the two functions are achieving extreme values, which are
sidered as mapping a vector x ¼ ðx1 ; x2 ; . . .; xn Þt of the n- nowhere close to zero. Thus, although the absolute of sum
dimensional space Rn to real line [1]. The solution of the is lower but optimality of individual functions is lost. In
above set of equations is a set of values of variables xi , such subsequent cases, it may be noted that the sum of absolute
that the values of each of the above functions fi at those is coming out to be lowest in case VI and, in addition by
points are zero. observation, we can clearly analyze that each function is
being optimized in case VI only, as both functions fi are
4.1 Fitness function comparatively very close to zero than in other cases. The
difference between two approaches is much clearer, when
The most important ingredient of GA is the fitness func- two functions achieve values in opposite signs. Thus, this is
tion. In the earlier works [15, 19], the fitness function was the justification of using sum of absolute, that is, jf1 j þ jf2 j
taken as jf1 þ f2 þ f3 þ þ fn j, however, in the present over absolute of sum as fitness function in our work.
work, the fitness function has been changed to
jf1 j þ jf2 j þ þ jfn j. We claim that by choosing the sum 4.2 Methodology
of absolutes of the objective functions jf1 j þ jf2 j þ þ
jfn j over the previous techniques [15, 19], which used the The given set of equations is, first, encoded. This is because
absolutes of sum the of the objective functions GA works on the coded version (genotypes) and not on the
jf1 þ f2 þ f3 þ þ fn j, the solution would improve. The original set (phenotypes). The method employees double
reason is that we are considering the problem as multi- vector coding to encode the given set of equations. It may
objective optimization problem Eq. 1 in which, each be stated here that this has been done after experimenting
objective function fi is to be optimized systematically. The with various coding techniques. This is followed by setting
earlier approaches helped in attaining lower fitness func- the parameters of Genetic Algorithm. The scaling function,
tion value even if, the individual functions fi do not achieve
123
Int. j. inf. tecnol.
Table 3 Selected parameters of the proposed GA for multi-dimensional problems with single function
Parameters Population size Scaling function Selection function Mutation function Crossover function Generations Ratios/fractions
mutation function and other parameters are set. In this in two subsections. In the first subsection, multi-dimen-
work, the rank scaling function has been used due to its sional test problems in single function are considered and
better performance while carrying out empirical analysis. in the second subsection, three multi-dimensional bench-
The experiment are carried out for Roulette wheel due to mark problems viz. Interval Arithmetic application, Com-
its robustness property. The Gaussian technique is selected bustion problem, Neurophysiology application are
for carrying out the mutation, as the results using this discussed. The experiments are conducted in MATLAB
technique are far superior as compared to other techniques. code on i3 machine with 6 GB RAM.
The ratios/fractions take the default values.
5.1 Multi-dimensional problems in single function
123
Int. j. inf. tecnol.
Table 5 Minimum values of tournament and Roulette wheel selec- Algorithm (BFA) [23], Spiral Dynamic Algorithm (SDA)
tion function with population size 200 [23], Hybrid Spiral Dynamic Bacteria Chemotaxis Algo-
No. of generations Selection rithm Type-R (HSDBC-R) [23], Hybrid Spiral Dynamic
Bacteria Chemotaxis Algorithm Type-S (HSDBC-S) [23],
Tournament Roulette wheel
Traditional GA [24] and Improved GA by Dao et al. [24],
200 are shown in Table 4.
G 0.02590 0.007036 From Table 5, we can make observation that the pro-
U 0.7530 0.7517 posed GA is able to get the optimal solutions which is too
150 close to the global optimal. For second function, the opti-
G 0.01660 0.00669 mal fitness value is improved by 107 . Even for third
U 0.7522 0.7561 function, the proposed algorithm is giving better results by
100 105 . Similary, in rest of the cases also we can see that the
G 0.01474 0.00799 optimal fitness value is better than all other optmization
U 0.7517 0.7537 algorithms. Thus, we can clearly say that, the proposed GA
51 outperforms, BFA, SDA, HSDBC-S, HSDBC-R [23],
G 0.01430 0.00201 Traditional GA as well as Improved GA [24] while opti-
U 0.7522 0.7532 mizing multi-dimensional problems with single function.
50 Along with, the convergence history of each function is
G 0.01613 0.01203 presented in Figs.5, 6, 7, 8, 9 and 10. The information
U 0.7818 0.7836 related to number of generations given by x involved in
convergence of each function and mean fitness given by
G Gaussian function, U uniform function
y has also been shown in figures.
ranging from 15 to 60, and then the proposed algorithm has 5.2 Multi-dimensional benchmark problem
been applied to solve these case study problems for each with several functions
dimension. The algorithm is given 30 runs for each case.
The results are presented in terms of the best fitness value With this sub-section, the applicability of GA in handling
and average fitness value (viz. Best and Mean, respec- multi-dimensional problems with several functions has
tively). To evaluate the robustness of the work, the results been explored by considering benchmark problems. How-
by the proposed algorithm, and solutions obtained by six ever, GA has been already applied to optimize some linear
other optimization algorithms, namely, Bacterial Foraging
123
Int. j. inf. tecnol.
and nonlinear systems with two functions in our earlier work is compared with earlier results proposed by Gravi-
works [25, 26]. tational search algorithm (GRAV) [31], Intelligent tuned
Here, the methodolgy as discussed in previous section, harmony search algorithm (ITHS) [32], Evolutionary
is implemented, and the verification is done by taking algorithm (EA) [15], Cuckoo optmization algorihtm (COA)
standard problems [15, 19, 27–30]. The experiment is then [33].
repeated 30 times. The results obtained by the proposed
123
Int. j. inf. tecnol.
9
5.2.1 Case study f1 ðxÞ ¼ x1 0:25428722 0:18324757x4 x3 x9 >>
>
>
>
Firstly, the following set of case study problem expressed f2 ðxÞ ¼ x2 0:37842197 0:16275449x1 x10 x6 >
>
>
>
>
>
by Eq. 2 is used to carry out the experiment and establish f3 ðxÞ ¼ x3 0:27162577 0:16955071x1 x2 x10 >
>
>
>
the premise that the Roulette wheel selection and Gaussian >
>
f4 ðxÞ ¼ x4 0:19807914 0:15585316x7 x1 x6 >>
>
>
mutation function perform better than the others. The >
>
>
results obtained have been depicted in Table 5. And then, f5 ðxÞ ¼ x5 0:44166728 0:19950920x7 x6 x3 =
three standard problems have been solved in Sects. 5.2.2– ð3Þ
f6 ðxÞ ¼ x6 0:14654113 0:18922793x8 x5 x10 >
>
>
5.2.4 >
>
) >
>
f7 ðxÞ ¼ x7 0:42937161 0:21180486x2 x5 x8 >>
x2 y2 ¼ 0 >
>
>
ð2Þ f8 ðxÞ ¼ x8 0:07056438 0:17081208x1 x7 x6 >>
>
1 jx yj ¼ 0 >
>
>
f9 ðxÞ ¼ x9 0:34504906 0:19612740x10 x6 x8 >
>
>
>
Afterwards, Gaussian function for mutation and Roul- >
>
ette wheel selection function has been used for the f10 ðxÞ ¼ x10 0:42651102 0:21466544x4 x8 x1 ;
benchmark problems.
The above problem (Eq. 3) has been considered as a multi-
objective optimization problem (Eq. 4) as
5.2.2 Interval arithmetic application
minfi ðxÞ ¼ 0 ð4Þ
This test problem is proposed from arithmetic
where 2 xi 2 8i ¼ 1; 2; . . .; 10 and
[15, 19, 27–29]. This problem consists of following a set of
x ¼ ðx1 ; x2 ; x3 ; x4 ; x5 ; x6 ; x7 ; x8 ; x9 ; x10 Þ.
complex system of nonlinear equations having ten
The parameters used by the proposed methodology are
variables:
listed in Table 6 and then, experiment is performed 30
times. The best solution obtained as well as the best
123
Int. j. inf. tecnol.
function values are presented in Table 7. The table also In Table 7, we present the optimal results by the pro-
contains various statistical results showing the minimum posed method and other algorithms. And, the graphical
value of the fitness function (fbest ) alongwith standard comparison for best fitness values is presented in Fig. 11.
deviation, computation time in seconds and, number of On comparison, we can conclude that the present technique
function evaluations (feval ). obtains the best simulation results in terms of objective
123
Int. j. inf. tecnol.
Table 6 Selected parameters of the proposed GA for multi-dimensional problems with several functions
Parameters Population size Scaling function Selection function Mutation function Crossover function Generations Ratios/fractions
Values 500 Rank Roulette wheel Gaussain Single point 1000 Default
9
function values, fitness function as well as standard f1 ðxÞ ¼ x2 þ 2x6 þ x9 þ 2x10 105 >
>
>
deviation. >
>
5 >
>
f2 ðxÞ ¼ x3 þ x8 3:10 >
>
>
>
5 >
5.2.3 Combustion problem f3 ðxÞ ¼ x1 þ x3 þ 2x5 þ 2x8 þ x9 þ x10 5:10 > >
>
>
>
>
5 >
>
In this test problem, a complex nonlinear algebraic system f4 ðxÞ ¼ x4 þ 2x7 10 >
>
>
>
governing combustion problem at temperature 3000 C >
>
7
f5 ðxÞ ¼ x1 x2 ð0:5140437Þ10 x5 =
[15, 19, 27, 30] has been taken under consideration. The ð5Þ
equations are as follows: f6 ðxÞ ¼ 2x22 ð0:1006932Þ106 x6 >
>
>
>
>
>
>
>
f7 ðxÞ ¼ x24 ð0:7816278Þ1015 x7 >
>
>
>
>
>
f8 ðxÞ ¼ x1 x3 ð0:1496236Þ106 x8 >
>
>
>
>
>
>
f9 ðxÞ ¼ x1 x2 ð0:6194411Þ107 x9 >
>
>
>
>
;
f10 ðxÞ ¼ x1 x22 ð0:2089296Þ1014 x10
123
Int. j. inf. tecnol.
123
Int. j. inf. tecnol.
123
Int. j. inf. tecnol.
function and three multi-dimensional problems with sev- 16. N’Guessan A (2010) Analytical existence of solutions to a system
eral functions. Then, after solving the standard problems, of nonlinear equations with application. J Comput Appl Math
234(1):297–304
we compare the findings with other optmization tech- 17. Abd-El-Wahed WF, Mousa AA, El-Shorbagy MA (2011) Inte-
niques, namely BFA, SDA, HSDBC-S, HSDBC-R [23], grating particle swarm optimization with genetic algorithms for
Traditional GA as well as Improved GA [24] for problems solving nonlinear optimization problems. J Comput Appl Math
with single function, and GRAV [31], ITHS [32], EA [15] 235(5):1446–1453
18. Ren H, Wu L, Bi W, Argyros IK (2013) Solving nonlinear
and, COA [33] for problems involving many functions. We equations system via an efficient genetic algorithm with sym-
conclude that the proposed technique provides promising metric and harmonious individuals. Appl Math Comput
results for each test problems in comparison with the 219(23):10967–10973
solutions obtained by other algorithms. As a part of future 19. Pourrajabian A, Ebrahimi R, Mirzaei M, Shams M (2013)
Applying genetic algorithms for solving nonlinear algebraic
development work, the author intend to use the developed equations. Appl Math Comput 219(24):11483–11494
technique for handling more complex multi-objective 20. Raja MAZ, Sabir Z, Mehmood N, Al-Aidarous ES, Khan JA
optmization problems like Feature selection problem [34], (2015) Design of stochastic solvers based on genetic algorithms
potential energy function [35] and many more. for solving nonlinear equations. Neural Comput Appl 26(1):1–23
21. Ramadas GCV, Fernandes EMGP (2012) Self-adaptive combi-
nation of global tabu search and local search for nonlinear
equations. Int J Comput Math 89(13–14):1847–1864
22. Gong D, Wang G, Sun X, Han Y (2015) A set-based genetic
References algorithm for solving the many-objective optimization problem.
Soft Comput 19(6):1477–1495
1. Balagurusamy E (1999) Numerical methods. Tata McGraw-Hill 23. Nasir ANK, Tokhi MO (2015) Novel metaheuristic hybrid spiral
Education, Bangalore dynamic bacteria-chemotaxis algorithms for global optimisation.
2. Grewal BS, Grewal JS (2014) Numerical methods in engineering Appl Soft Comput 27:357–375
and science with programs in C, C?? and MATLAB, Khanna, 24. Dao SD, Kazem A, Marian R (2016) An improved structure of
India genetic algorithms for global optimisation. Prog Artif Intell
3. Sharma JK (2013) Operations research: theory and applications. 5(3):155–163
MacMillan Publishing Pvt. Ltd., New York 25. Mangla C, Bhasin H, Ahmad M, Uddin M (2017) Novel solution
4. Kitchenham B (2001) Guidelines for performing systematic lit- of nonlinear equations using genetic algorithm. In: Manchanda P,
erature reviews in software engineering. EBSE Technical Report Lozi R, Siddiqi A (eds) Industrial mathematics and complex
EBSE-2007-03 systems. Industrial and applied mathematics. Springer, Singa-
5. Goldberg DE (1989) Genetic algorithms in machine learning, pore, pp 249–257. https://doi.org/10.1007/978-981-10-3758-0_17
search and optimization. Addison-Wesley Longman Publishing 26. Mangla C, Ahmad M, Uddin M (2018) Genetic algorithm based
Co., Inc., Boston optimization for system of nonlinear equations. Int J Adv Technol
6. Holland J (1975) An introductory analysis with applications to Eng Exp 5(44):187–194
biology, control, and artificial intelligence. Adaptation in natural 27. Hentenryck PV, Mcallester D, Kapur D (1997) Solving polyno-
and artificial systems. MIT Press, Cambridge mial systems using a branch and prune approach. Soc Ind Appl
7. Crosby JL (1973) Computer simulation in genetics. Wiley, Math 34(2):797–827
London 28. Hong H, Stahl V (1994) Safe starting regions by fixed points and
8. Fogel DB (1998) Evolutionary computation: the fossil record. tightening. Computing 53(3–4):323–335
IEEE Press, Piscataway 29. Moore RE (1979) Methods and applications of interval analysis.
9. Chandra GR, Ramchand K, Rao H (2016) Tumor detection in Society for Industrial and Applied Mathematics
brain using genetic algorithm. Proc Comput Sci 79:449–457 30. Morgan A (2009) Solving polynomial systems using continuation
10. Li N, Li Y, Sun M, Kong H, Gong G (2017) An optimization for engineering and scientific problems. Society for Industrial and
method for task assignment for industrial manufacturing organi- Applied Mathematics, Philadelphia
zations. Appl Intell 47(4):1144–1156 31. Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a
11. Bianchini N, Fanelli S, Gori M (2001) Optimal algorithms for gravitational search algorithm. Inf Sci 179(13):2232–2248
well-conditioned nonlinear systems of equations. IEEE Trans 32. Yadav P, Kumar R, Panda SK, Chang CS (2012) An intelligent
Comput 50(7):689–698 tuned harmony search algorithm for optimisation. Inf Sci
12. Rovira A, Valdés M, Casanova J (2005) A new methodology to 196:47–72
solve non-linear equation systems using genetic algorithms. 33. Abdollahi M, Lotfi S, Abdollahi D (2012) Solving systems of
Application to combined cyclegas turbine simulation. Int J nonlinear equations using the Cuckoo Optimization Algorithm.
Numer Methods Eng 63(10):1424–1435 In: Bigham BS (eds) Proceedings of the third international con-
13. Chang WD (2006) An improved real-coded genetic algorithm for ference on contemporary issues in computer and information
parameters estimation of nonlinear systems. Mech Syst Signal sciences. CICIS’12,Brown Walker Press, Florida, pp 191-194
Process 20(1):236–246 34. Tawhid MA, Dsouza KB (2018) Hybrid binary dragonfly
14. Nie P (2006) An SQP approach with line search for a system of enhanced particle swarm optimization algorithm for solving
nonlinear equations. Math Comput Model 43(3):368–373 feature selection problems. Math Found Comput 1(2):181–200
15. Grosan C, Abraham A (2008) A new approach for solving non- 35. Tawhid MA, Ali AF (2017) A hybrid grey wolf optimizer and
linear equations systems. IEEE Trans Syst Man Cybern Part A genetic algorithm for minimizing potential energy function.
Syst Hum 38(3):698–714 Memet Comput 9(4):347–359. https://doi.org/10.1007/s12293-
017-0234-5
123