Professional Documents
Culture Documents
net/publication/319031467
CITATIONS READS
0 372
5 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Bo Liu on 26 July 2018.
Abstract I Ching (Chinese characters: ) philosophy, I Ching, also known as Classic of Changes, (Chinese
stemming from ancient Chinese culture, is Chinese view of characters: ) and its underlying changing philosophy
empiricism, world outlook and dialectics. Over thousands of have implications on the balance of moderateness and
years of evolving and interpretation, its cosmological wisdom appropriateness, by which it is contended that power/destiny
has broad and profound influences not only on Chinese can be well generated/controlled [1]. The core concepts lie in
prevailing philosophy, but also on westerns. I Ching I Ching, including identification, vision and action [2].
concentrates on the virtue of being moderate and appropriate, Specifically, by grasping the historical and current
representing the balance by which it is contended that information, one can identify current state by classification,
power/destiny can be well generated/controlled. Among the
then act or respond reasonably based on current states and
whole 64 hexagrams in I Ching, is the QIAN hexagram which
is ranked in the first place, standing for the strong action and
future vision, so that long-term success could be achieved.
the everlasting desire for success. Behind I Ching philosophy The philosophical implication inspired by I Ching has
lie the thinking and action models of optimization, specifically, profound influences not only on Chinese but also on worlds7
identification from changing states, embracing vision, and religion, psychoanalysis, business, literature, art, even
optimal action obeying the balance of moderateness and mathematics [2-4]. For instance, "Self-Discipline and Social
appropriateness. I Ching philosophy could act as the driving Commitment" which stems from I Ching serves as the motto
force to establish and develop new optimization scheme. In this of Tsinghua University, which has been stimulating scholars
regard, enlightened by I Ching philosophy, particularly the and students to devote themselves to improve social welfare
QIAN hexagram, we propose I Ching philosophy inspired so as to make a better world [5]. Leibnitz stated that Chinese
optimization, labeled as ICO for continuous optimization has independently developed their own binary system in I
problems. Characterized by population-based, stochastic, Ching [6].
iterative, and empiricism inspired features, the ICO evolves the
population of solutions by multiple searching operators As observed ahead, behind I Ching philosophy lie the
derived from underlying mechanism of the QIAN hexagram, thinking and action models of optimization, specifically,
as expected that the balance between global exploration and identification from changing states, embracing vision, and
local exploitation can be well achieved. Specifically, the whole optimal action obeying the balance of moderateness and
population is divided into four subpopulations, each of which appropriateness. I Ching philosophy could act as the driving
corresponds to one solid line (state in the QIAN hexagram), force to establish and develop new optimization scheme. In I
then five search operators are developed to perform the Ching, surrounding environment, human behaviors as well as
learning, emerging, controlling, chasing and stabilizing their coupling relationships are abstracted into 64 hexagrams,
operations on each subpopulation. The performances of the which are the foundation of I Ching divination [7]. Among
proposed ICO are investigated on well-known testing the whole 64 hexagrams in I Ching, is the QIAN hexagram
benchmarks and digital IIR filter designing problem which is (Chinese characters: ) which is ranked in the first place
crucial in control field. Comparisons with several state-of-the-
[1]. The implication behind QIAN hexagram is classic of
art algorithms show the efficacy of the proposed ICO
algorithm.
changes, the strong action, the everlasting desire for success,
and harmony between man and nature [2]. In this regard,
KeywordsContinuous optimization, digital IIR filter enlightened by I Ching philosophy, particularly the QIAN
designing, I Ching, population based algorithm, the QIAN hexagram, researchers may embark on the development of
hexagram. novel optimization mechanism as an important complement
for optimization field.
I. INTRODUCTION
Due to the complexities of optimization problems,
Originating in 1000-750 BC from ancient Chinese culture, optimization techniques have caught much attention from
various fields [8-14]. So far researchers have proposed
This work was supported in part by National Natural Science various kinds of methods based on different optimization
Foundation of China (Grant Nos.71390331, 61673058), National Science
Fund for Distinguished Young Scholars of China (Grant No. 61525304), mechanisms to tackle difficulties [15-20]. For instance, the
Defense Industrial Technology Development Program, and Key Research gradients based exact solution techniques (e.g., steepest
Program of Frontier Sciences, Chinese Academy of Sciences (QYZDB- descent method, conjugate gradients method and quasi-
SSW-SYS020). newton method) which utilize the first or second order
hexagram). Each of the four solid lines from the bottom up QIAN (Chinese Characters: )
corresponds to subpopulation called the bottom layer
solutions, the useful solutions, the satisfactory solutions, the
near-optimal solutions, respectively. And the fifth solid line
corresponds to the best solution at current generation, which
serves as an archive. And the top solid line in the QIAN
354
line number/correponds to line type/stands for hexagram is positive and upward, so the influence from the
Top(6) Even number /Yin Dotted line /Yin upper lines (stages) is more important than that from the
Fifth(5) Odd number /Yang Solid line /Yang
lower ones. Since everyone in the state of QIAN is working
Fourth(4) Dotted line /Yin
and chasing, individuals can either move forward step by
Even number /Yin
step or fall down/collapse quickly.
Third(3) Odd number /Yang Solid line /Yang
Second(2) Even number /Yin Dotted line /Yin As show in Fig.2, the initial line (the bottom layer) stands
Initial(1) Odd number /Yang Solid line /Yang for the individuals of the population (group or team) who
have no experience to make contributions to the team they
JIJI/Harmony (Chinese Characters: ) belong to. Since they are most likely to be eliminated by the
group, they have to make lots of effort to become better. The
Fig. 1. The QIAN and JIJI hexagrams in I Ching second line corresponds to the useful ones who have already
achieved small successes. In this stage, they are potential and
The core concepts lie in I Ching, including identification attract attention. The third line refers to the satisfactory ones
from changing states, embracing vision, and optimal action who become leaders of the group though not the best, who
obeying the balance of moderateness and appropriateness [2]. want to control their destiny in order to avoid falling. The
1) Identification from the changing states fourth line refers to the near optimal ones who are leaders of
By grasping the historical and current information, one the group who want to chase their dream in order to become
can identify current condition by classification. Specifically, the best/top one. The fifth line denotes the best one in the
one can identify the state (hexagram) where he is in as well group who needs to make the position stable. The top line
as his development stage (line position) of the state by I refers to the best one in the history.
Ching philosophy, e.g., one acts like the initial line of the
QIAN hexagram at the beginning stage of his way to success. Benefit from the Benefit from the
neighborhood above corresponding line
2) Embracing vision
By analyzing reasonably based on the future vision, long-
top global best solution
term success could be achieved. '7+ ('#,#(' '
changed during the developing process, e.g., after one has fifth generation best solution
achieved some small targets, his condition transfers fourth near-optimal solutions
according the mechanism in the QIAN hexagram (from the
initial line to the second line). third satisfactory solutions
355
experiences and knowledge are too superficial to benefit the b) Compute the objective values, sort them by
population, and accordingly some less useful solutions descending order and partition the sorted population into four
should be eliminated. Since they are most likely to be subpopulation according to their updated ratios p c ( t ) ,
eliminated, they have to make lots of effort to become better c
1, , 4 .
by the learning operator. The second line corresponds to the
useful solutions who have survived from the bottom layer c) Reallocate the individuals between subpopulations. As
solutions. In this stage, these potential solutions perform the for the individual in satisfactory solutions (the third line) at
emerging operations so as to attract more attention. The third generation t, if it belonged to bottom layer solutions (the
line refers to the satisfactory solutions of generation, and to initial line) at generation t-1, then move it to useful solutions
avoid fails controlling operation is exerted. The fourth line (the second line). As for the individual in near-optimal
symbolizes the near optimal solutions and chasing operator solutions (the fourth line), if it belonged to useful solutions
is used. The fifth line is the best solution in the current (the second line), then move it to satisfactory solutions (the
generation, and stabilizing operation is imposed so as not to third line); if it belonged to bottom layer solutions (the initial
fail. The top line refers to the best solutions so far. Besides, line) at generation t-1, then move it to useful solutions (the
the relationships in I Ching, binate and nearby, as shown in second line).
Table I, also have strong influences on searching and
optimization performances. For instance, solutions of the 2) Operators
three lines from the bottom up could benefit a lot from the Four search operators, i.e., learning, emerging,
better ones in the top three lines. Meanwhile, the solutions of controlling, chasing are designed to perform the global and
the upper lines have the inclinations to improve themselves local searches on subpopulations, and stabilizing operator is
by learning from the individuals belonging to the top lines, proposed for refining the best solution at current generation.
which is illustrated in Fig. 2. a) Learning operator: As for the bottom layer solutions,
B. Implementation of ICO update X i ( t ) according to Eq. (3):
1) Population partition W i ( t )
X i ( t ) 1 * S i (t) (3)
In ICO, the initial population are generated randomly.
The i-th individual of dimension d at generation t is where W i ( t ) is a trial solution for X i ( t ) , 1 denotes the step
represented as X i ( t )
[ x i ,1 , x i , 2 ,..., x i , d ] , i
1, , P ( P is the length for the bottom layer solutions learning, S i (t) is the
size of the population). We divide the whole population into perturbation which is computed by Eq. (4):
four subpopulations (i.e., bottom layer solutions, useful
solutions, satisfactory solutions, and near-optimal solutions) S i ( t )
v ( t ) * 0 . 1 * ( lb R . * ( ub lb )) (4)
according to the following rule. where v(t) is a discounted factor linearly decreasing from 1
Case 1: Partition of the initial population at the first to 0.01 with generations; ub and lb denote the upper bounds
generation t
0 and the lower bounds of the searching space;
R
[ rand 1 , rand 2 ,..., rand d ] is a d-dimensional random
a) Initialize the proportions of each subpopulation in the
weight vector, and each element rand j is uniformly
total population, that is the ratio of subpopulation size to the
overall size, e.g., p c ( t ) denotes the ratio of c-th distributed in [0,1].
subpopulation size to the overall size at generation t where If the X i ( t ) is kept in the bottom layer subpopulation for
c
1, , 4 corresponding to the first four lines from the more than 3 consecutive generations, then the trial solution is
bottom up. For the first generation t
0 , the p 1 ( 0 ) , p 2 ( 0 ) , generated by Eq. (5):
p 3 ( 0 ) , and p 4 ( 0 ) are user specified;
W i (t)
X k ( t ) 1 * S i (t) (5)
b) Compute the objective value f ( X i ) for each
where X k (t) is randomly chosen in near-optimal solutions.
individual X i ( t ) , and sort them by descending order for
minimization problem; b) Emerging operator: As for the useful solutions,
perform the emerging operation as follows:
c) Partition the overall sorted population into four
subpopulation according to their ratios p c ( 0 ) , c
1, , 4 . W i ( t )
X i ( t ) R1 . * ( X ( t ) X i (t)) R 2 . * ( X ( t ) X i (t))
k best
From Eq. (1), it can be seen that the ratio of bottom layer W i ( t )
X i ( t ) R1 . * ( X k ( t ) X i (t)) R 2 . * ( gbest ( t ) X i (t)) (7)
solutions is forced to be decreasing with the generation.
356
where X k ( t ) denotes the solution randomly chosen from BEGIN
near-optimal solutions; gbest ( t ) denotes the best solution Population Initialization
achieved so far; R 1 and R 2 denote the d-dimensional Partition of the initial population at the first generation
random weight vectors. While (Termination Condition Is Not Satisfied) Do
Obtain trial solutions W i ( t ) by applying the five
d) Chasing operator: For the near-optimal solutions, searching operators (learning, emerging,
perform this operator according to Eq. (8): controlling, chasing, and stabilizing) to related
W i ( t )
X i ( t ) R1 . * ( X best ( t ) X i (t)) 4 * S i ( t ) (8) subpopulations;
where 4 denotes the step length; S i ( t ) denotes the Compute the objective value f (W i ) ;
perturbation which is computed by Eq. (4).
e) Stabilizing operator: Stabilizing operation is imposed Update X i (t ) ;
to the best solution at current generation according to Eq. (9):
Partition of the evolved population
W i ( t )
X i ( t ) 5 * S i (t) (9)
End
where 5 denotes the step length, and S i ( t ) denotes the Output the best one.
perturbation which is computed by Eq. (4). END
Fig. 3. the general framework of algorithm
If the X i ( t ) is kept as the best solution for more than 3
consecutive generations, then the trial solution is generated To demonstrate the effectiveness and the efficiency of
by Eq. (10): the proposed algorithm, we compare the ICO with several
state-of-the-art optimization algorithms such as Particle
W i ( t )
X i ( t ) R . * ( mean ( t ) X i ( t ) ) (10) Swarm Optimization (PSO) [42], Teaching Learning Based
where mean(t) denotes the average value of solutions at Optimization (TLBO) [43] and Water Wave Optimization
generation t. (WWO) [44]. The parameter settings for the above
algorithms are as follows:
3) Updating criteria
For individuals belong to satisfactory solutions and near- ICO: p 1 ( 0 )
0 . 4 , p 2 ( 0 )
0 . 4 , p 3 ( 0 )
0 . 1 , p 4 ( 0 )
0 .1 ,
optimal solutions, greedy scheme is used: , 4
1 , 5
0 . 5 , and the population size is 20;
1
2
357
The searching curves for IIR filter design problem Comparisons with several state-of-the-art algorithms
example 1 are illustrated in Fig. 4, from which it could be demonstrated the efficacy of the proposed ICO algorithm. In
observed that ICO has a faster trend to global optima than the future work, we will refine the ICO algorithm and extend
PSO, TLBO and WWO. its application field.
fBR 0.3979 1.5569e-6 0.3997 0.0018 0.3984 0.0005 0.4960 0.3703 0.4021 0.0153
fH3 -3.8628 3.4218e-6 -3.8601 0.0027 -3.8621 0.0007 -3.8572 0.0035 -3.8571 0.0070
fH6 -3.2581 0.0643 -3.1597 0.1224 -3.2005 0.1062 -2.8943 0.3995 -3.0212 0.4291
fSH -186.7283 0.0026 -184.7165 2.0143 -185.1955 1.5311 -180.3265 10.1718 -182.1840 5.3599
358
IEEE Transactions on Evolutionary Computation, vol. 19, no. 5, pp. [31] J. J. Liang, A. K. Qin, P. N. Suganthan, and S. Baskar,
644-658, 2015. 4(&)*"'+#. %*'#'! )*,#% +/*& (),#* (* !%(%
[12]
'!'!''+'!4&++-#%#'! (),#,#(' ( &-%,#&(% -',#('+6 IEEE transactions on
blocks: a case study on evolutionary optimization+ transfer learning evolutionary computation, vol. 10, no. 3, pp. 281-295, 2006.
(* *(-,#'! )*(%&+6 Memetic Computing, vol. 7, no. 3, pp. 159- [32] J. J. Liang, and P. N. Suganthan, "Dynamic multi-swarm particle
180, 2015. swarm optimizer with local search." Evolutionary Computation, 2005.
[13] S. Li, L. J. #-'"#4*#,#(' (*+"(*,-term traffic based The 2005 IEEE Congress on, 2005, pp. 522-528.
('&(# #(),#'-*%',/(*$6System Engineering [33] #
"('
#'4'),#&#zing Method Based
Theory and Practice, no. 09, pp. 2045-2049, 2012. on Autonomous Animals: Fish-+/*& %!(*#,"&6 System
[14] "'! ' "' 41*# -NEH algorithm for Engineering Theory and Practice, no. 11, pp. 32-38, 2002.
solving no-wait flexib%* %(/ +"() +"-%#'! )*(%&6 System [34] K. Price, R. Storn, and J. Lampinen, Differential Evolution A
Engineering Theory and Practice, no. 03, pp. 802-809, 2014. Practical Approach to Global Optimization. Berlin, Germany:
[15] S. Salhi, Handbook of Metaheuristics, 2rd ed, Springer, NewYork, Springer, 2005.
2014. [35] #'
"''!'
'4'),#."1*#(),#*
[16] B. Liu, L. Wang, and Y. Liu, "A unified framework for population- based on particle swarm and differential evolution for global
based metaheuristics, " Annals of Operations Research, vol. 186, no. (),#,#('6Science China Information Sciences, vol. 53, no. 5, pp.
1, pp. 231-262, 2011. 980-989, 2010.
[17] L. Wang, Intelligent Optimization Algorithms with Applications, [36] B. Xin, J. Chen, J. Zhang,
'! ' '! 41*##2#'!
Beijing, China: Tsinghua University & Springer Press, 2001. differential evolution and particle swarm optimization to design
)(/* -%(),#*+*.#/',0('(&16IEEE Transactions on
[18] J. Snyman, Practical mathematical optimization: an introduction to Systems, Man, and Cybernetics, Part C (Applications and Reviews),
basic optimization theoryy and classical and new gradient-based vol. 42, no. 5, pp. 744-767, 2012.
algorithms, NewYork, : Springer, 2005.
[37] D. Dasgupta, Artificial Immune Systems and Their Applications.
[19]
#' 4 (&)*"'+#. +-*.1 ( #,'++ ))*(0#&,#(' #' Springer, 1998.
.(%-,#('*1 (&)-,,#('6 Soft computing, vol. 9, no. 1, pp. 3-12,
2005. [38] C. L. P. Chen, T. Zhang, L. Chen and S. C. Tam, "I-Ching Divination
Evolutionary Algorithm and its Convergence Analysis," IEEE
[20]
#' '
*'$ 4 .(%-,#('*1 (),#,#(' #' -'*,#' Transactions on Cybernetics, vol. 47, no. 1, pp. 2-13, Jan. 2017.
environments- +-*.16 IEEE Transactions on evolutionary
computation, vol. 9, no. 3, pp. 303-317, 2005. [39] C. L. P. Chen, T. Zhang, L. Chen and S. C. Tam, "A novel
evolutionary algorithm solving optimization problems," Proceedings
[21] C. R. Hwang, "Simulated annealing: theory and applications," Acta
of 2014 IEEE International Conference on Systems, Man, and
Applicandae Mathematicae, vol. 12, no. 1, pp. 108-111, 1988.
Cybernetics , 2014, pp. 557-561.
[22] J. H. Holland, Adaptation in Natural and Artificial Systems. Ann
[40] B. Liu, L. Wang, and Y .H. Jin, et al. 4Improved particle swarm
Arbor, MI, USA: University of Michigan Press, 1975.
optimization combined with chaos,6 Chaos, Solitons & Fractals, vol.
[23] T. Bäck, Evolutionary Algorithms in Theory and Practice. Oxford, 25, no. 5, pp. 1261-1271, 2005.
UK: Oxford University Press, 1996.
[41] M. A. Sharifi, H. Mojallali, "A modified imperialist competitive
[24] L. J. Fogel, Artificial Intelligence Through Simulated Evolution, algorithm for digital IIR filter design," Optik - International Journal
Hoboken, NJ, USA: John Wiley & Sons, 1966. for Light and Electron Optics, vol. 126, no. 21, pp. 2979-2984, 2015.
[25] X. Yao, Y. Liu, and G. Lin, "Evolutionary programming made faster, [42] Y. Shi, and R. C. Eberhart, "A modified particle swarm optimizer,"
" IEEE Transactions on Evolutionary computation, vol.3, no.2, pp. Proceedings of IEEE International Conference on Evolutionary
82-102,1999. Computation, pp. 69373, 1998.
[26] H. P. Schwefel, Evolution and Optimum Seeking. NewYork, USA: [43] R. V. Rao, V. J. Savsani, and D. P. Vakharia, "Teaching3learning-
John Wiley & Sons, 1995. based optimization: A novel method for constrained mechanical
[27] J. R. Koza, Genetic programming. Cambridge, MA: MIT Press, 1992. design optimization problems," Computer-Aided Design, vol. 43, pp.
[28] E. Bonabeau, M. Dorigo, and G. Theraulaz, Swarm Intelligence: 303-315, 2011.
From Natural to Artificial Systems. Oxford University Press,1999. [44] Y. J. Zheng, "Water wave optimization: A new nature-inspired
[29] J. Kennedy, R. C. Eberhart, and Y. Shi, Swarm Intelligence. San metaheuristic," Computer & Operations Research, vol.55, pp. 1-11,
Francisco, CA, USA:Morgan Kaufmann Publishers, 2001. 2005.
[30] M. Dorigo, and L. M. Gambardella, "Special section on ant colony
optimization," IEEE Transactions on Evolutionary Computation vol.
6, pp. 3173319, 2002.
359
VI. APPENDIX
GP: Goldstein-Price: (d=2)
2 2 2
f G ( x )
[1 ( x 1 x 2 1 ) ( 19 14 x 1 3 x 1 14 x 2 6 x 1 x 2 3 x 2 )]
2 2 2
[30 (2 x 1 - 3 x 2 ) (18 - 32 x 1 12 x 1 48 x 2 - 36 x 1 x 2 27 x 2 )],
- 2 x i 1, i
1, 2
5 .1 2 5 2 1
fB (x)
(x2 x1 x1 6 ) 10 ( 1 ) cos x 1 10 ,
4
2
8
5 x 1 10 , 0 x 2 15
4 d
a
2
fH (x)
c i exp[ (x p ij ) ]
ij j
i
1 j
1
0 x i 1 , i
1,2,..., d
5 5
fS (x)
{
i cos( i 1 ) x 1 i }{
i cos( i 1 ) x 2 i}
i
1 i
1
10 x i 10
2 4 6
1 0 .4 z 0 . 65 z 0 . 26 z
H d [z
1
]
2 4 6
1 0 . 77 z 0 . 8498 z 0 . 6486 z
1 2 3 4 5
b 0 b1 z b2 z b3 z b4 z b5 z
H [z
1
]
1 2 3 4 5
1 a1 z a2z a3z a4z a5z
Example 2:
2 4 5 6
1 1 .8 z 1 . 04 z 0 . 05 z 0 . 192 z
H d [z
1
]
2 4 6
1 0 .8 z 0 . 17 z 0 . 56 z
1 2 3 4 5
b 0 b1 z b2 z b3 z b4 z b5 z
H [z
1
]
1 2 3 4 5
1 a1 z a2z a3z a4z a5z
360