Recent Trends in Nature Inspired Computation

with Applications to Deep Learning

Vandana Bharti
Computer Science and Engineering
Indian Institute of Technology (BHU)
Varanasi, Uttar Pradesh, India
vandanabharti.rs.cse17@iitbhu.ac.in
Bhaskar Biswas
Computer Science and Engineering
Indian Institute of Technology (BHU)
Varanasi, Uttar Pradesh, India
bhaskar.cse@iitbhu.ac.in
Kaushal Kumar Shukla
Computer Science and Engineering
Indian Institute of Technology (BHU)
Varanasi, Uttar Pradesh, India
kkshukla.cse@iitbhu.ac.in

Abstract—Nature-inspired computations are commonly rec-
ognized optimization techniques that provide optimal solutions
to a wide spectrum of computational problems. This paper
presents a brief overview of current topics in the field of nature-
inspired computation along with their most recent applications
in deep learning to identify open challenges concerning the
most relevant areas. In addition, we highlight some recent
hybridization methods of nature-inspired computation used to
optimize the hyper-parameters and architectures of a deep
learning framework. Future research as well as prospective deep
learning issues are also presented.
Index Terms—nature-inspired computation, neuroevolution,
dynamic optimization, evolutionary algorithms, deep learning
I. INTRODUCTION
There is a wide range of high-performance optimization
methods available for problems formulated as convex opti-
mization [1]. However, many problems arising in important
application domains pose non-convex problems. In particular,
these problems are often noisy, stochastic and have limitations
that change dynamically. This is where nature inspired
computation (NIC) methods are often applied as they have
been shown to be highly successful when dealing with such
difficult problem domains. NIC is the generalization of bio-
inspired computing and evolutionary computing where, in each
case, algorithms are derived from the natural phenomenon
of the surrounding environment, nature or habitats. These
computing methods have led to the formation of algorithms
called Nature Inspired Algorithms (NIA) [2].
NIA have achieved enormous popularity in latest years
in tackling problems belong to NP hard (NPH) and NP
complete (NPC) complexity classes and solving hard opti-
mization tasks whose real solution is unknown. The objective
of developing such algorithms is to optimize engineering
problems. Engineering problems are becoming progressively
complex and difficult to optimize as the world moves towards
industrialisation. In order to deal with these scenario, NIA are
crafted and tested on numerical benchmark functions [3] for
single and multi-objective optimization, and designed to solve
NPH problems with high-dimensions.
A lot of promising NIAs have appeared over the last
two decades [4]. In this respect, Grey wolf optimiza-
tion (GWO), Whale Optimization Algorithm (WOA), Harris
Hawks Optimizer (HHO), Particle swarm optimization (PSO),
Bat algorithm, Cuckoo search algorithm (CS), Artificial bee
colony, Harmony search (HS), Ant colony optimization (ACO)
and Invasive weed optimization algorithm are just a few to
mention. At this stage, there is a need to discuss in holistic
manner about principles, ideas, applications, problems and
solutions linked to the use of NIA.
Recently, Deep Learning (DL) has emerge as a hot topic,
presenting impressive results with NIA. DL, a buzzword for
today’s era of artificial intelligence (AI) researchers, involves
machine learning (ML) methods that emphasize high-level
data representation learning rather than task-specific learning
[5]. DL has been extensively used due to advances in hardware
and the development of computational fast and efficient
optimization algorithms [6]. In addition, DL can be used to
evaluate and mine exciting Big Data models [7]. Like several
other fields of problem, DL also consist of an optimization
problem within itself which may be single or multi-objective,
constrained or unconstrained and convex or non-convex.
The application diversity of NIC algorithms is enormous and
the literature is growing quickly. Therefore, this paper only
tries to present a state-of-the-art of NIC latest developments
with its most recent application for DL to discover the optimal
structure of DL. Furthermore, we also present the work done
to optimize a DL model’s parameters and hyperparameters for
a specified search space within a sensible and reasonable span
of time. In addition to exploring the recent work on applying
these optimization techniques to DL, this paper also discusses
some significant future research directions in order to enhance
synergy between NIC and DL.
The paper is organized as follows: Section-2 presents new
trends in NIC. The most recent applications of NIC in DL
are discussed in Section-3 followed by conclusion and future
direction in Section-4.
II. W HATS N EW IN NATURE -I NSPIRED C OMPUTATION
NIC sought to develop novel computing methods by
monitoring how natural phenomena act to solve complex
problems in different environmental circumstances.The pri-
mary goal of NIC is to create computational models and
efficient algorithms based on natural intelligence discovered
in chemical, physical and biological systems. This has led to
ground-breaking studies that has created new branches such as

978-1-7281-2791-0/20/$31.00 2020
c IEEE 294
 Fig. 1: Graphical representation of the areas within nature inspired computation and some of their recent applications.
neuro-evolution, swarm intelligence, evolutionary computing
and artificial immune systems. NIC techniques are applied
in the areas of physics, biology, engineering, economics, and
even management.
There is a wide spectrum of domains such as transportation,
portfolio optimization, supply chain management, agriculture,
healthcare, remote sensing, industrial problems, complex
networks like social networks, wireless sensor network, and
many more, attract the research community to solve these
as an optimization problem. Graphical representation of the
areas within nature inspired computation are depicted in Fig.1.
After observing recent research and application, we have
divided the work into two subclasses, one of which involves
theoretical studies such as convergence analysis, stability
analysis, and multidisciplinary studies with NIA and other
belongs to real-world applications of NIA embedded ML and
DL models. Multidisciplinary studies integrate concepts of
distinct domains with these nature-inspired techniques and
resulted in new better performing optimizer such as CHAOS
theory from mathematics is integrated with several swarm
based algorithms [8]–[10] superposition theorem, big bang
theory and black hole from physics give rise to new optimizer
[11], [12]. Recent trends in this domain show that research
communities are attracted towards multidisciplinary studies
and their integration with model to improve the quality
of solution and try to reduce the exhaustive computation.
Moreover, several researches demonstrate that researchers are
now solving the real world and challenging applications by
treating them as an optimization problem that can be a single-
objective, many-objective, dynamic objective, hierarchical in
nature and many more [13]–[15].
Furthermore, latest work demonstrates that research com-
munities are continuously striving to develop promising and
10th International Conference on Cloud Computing, Data Science & Engineering (Confluence)
effective optimizers inspired by natural phenomenon, animal
behavior and physical science [16], [17]. Apart from these,
the new popular research area emerges as an introduction of
Chaos theory in NIA. Chaos theory has random, dynamic, non-
repetitive and ergodic properties. Due to its dynamic property
it ensures the different solutions given by algorithms even
on the complex multi-modal landscape. Since, most of the
NIA belongs to stochastic algorithms in which randomness
is achieved by using probabilistic theory such as Gaussian
distribution or uniform distribution now a days to accelerate
the convergence and to enhance the diversity of the NIA
chaos theory is used. Due to its ergodicity its performs
searches at higher speed. This novel approach has been
widely utilized in various NIA and its applications [18].
Another challenging area is convergence analysis which is
still unexplored. Only few works are there that tried to solve
this by using markov chain model [19]. Hybrid model of
existed NIA to enhance the performance of optimizer and
ML embedded with NIA are few recent development which
are used either for feature selection or model parameter
optimization and solving several real world applications [20],
[21]. Self adaptive NIA [22], cellular automata based NIA
[23], [24], surrogate assisted NIA [25] and new innovation in
multiobjective optimization and many objective optimization
are the new attraction for solving versatile application [26],
[27]. There is a continuous innovation in technology which
results more complex problems and need better optimizer
which leads to design new complex benchmarks such as high
scale benchmarks for validating optimizer [28]. From last few
months it has been observed that DL which is highly popular in
almost every domain of application also integrates with nature
inspired optimizers and here it comes new complex,interesting
and challenging area to be explored more.
295
 Fig. 2: Applications of nature inspired computations in Deep Learning.
III. R ECENT A PPLICATIONS OF NIC IN D EEP L EARNING
NIC is a fascinating new area along with DL that promises
real-world applications with things like threat detection, mo-
tion tracking, robotics, medical imaging, aerodynamic design
optimization, source localization and many more. Recently,
neuro-evolution popularized by Stanley and Miikkulainen
with DL gained extensive popularity, refers to the artificial
intelligence paradigm that concerns the design of ANNs,
including their topology, optimum weights and learning rules,
using simulated evolution.
DL is a branch of machine learning that imitates the
thought process of human brain to learn high level abstract
features in data automatically by using hierarchical layers
with complex structure. Currently, it becomes most vibrant
research domain which attracts extraordinary attention from
academia as well as industry. The optimization of DL models
through nature inspired technique is a subject of curiosity
and debate in computer science, the major application area of
this hybrid model in real world applications are autonomous
vehicles, biometrics, medical image analysis, data science,
machine vision and learning and many more. However, in
this article we are focusing on NIA in deep learning that
is neuro-evolution and parameter optimization etc. DL model
is a collective concept of sequence of algorithms and model
which includes but not limited to Long Short-Term Memory
Networks (LSTM), Convolutional Neural Networ k(CNN),
Generative Adversarial Network (GAN), AutoEncoders (AE),
and Echo State Network (ESN) as shown in Fig.2.
A. Long-Short-Term-Memory Networks
LSTM are recurrent deep neural network (DNN) model.
Recently, LSTM network is trained by five nature inspired
optimizer namely Genetic Algorithm (GA), Gravitational
296 10th International Conference on Cloud Computing, Data Science & Engineering (Confluence)
Search, CS, GWO, PSO, and applied on cervical cancer that
achieved accuracy above than 96% in [29]. In another research
work Li et al. [30] proposed competitive random search based
on GA and also proposed Evolutionary Attention based LSTM
(EA-LSTM) for multivariate time series forecasting. Results
have shown that the use of competitive random search to
train EA-LSTM not only enables long-term dependence on
time series prediction, but can also effectively use local data
in a sampling window based on different scales of attention
distribution. The proposed model also delivered robust and
competitive performance as compare to other baseline method.
In [31] Ai et al. proposed EELSTM technique to train
the population of LSTM network for forecasting time series
data. In this research they applied the conceptual evolutionary
cycle for evolving pool of LSTM network in order to achieve
more accurate forecast. Farzaneh et al. [32] developed a novel
method based on GA and Bi-LSTM for melody generation.
Here GA is used to generate a population of melodies which is
further evaluated by Bi-LSTM and those having highest score
is selected. Camero et al. [33] explored the mean absolute
error (MAE) based random sampling method for multi-layer
architecture and proposed the algorithm based on Evolutionary
search for optimizing an RNN using random MAE sampling
as a heuristic search. They showed that proposed technique
is training free and low cost for comparing deep RNN
architectures and a very useful heuristic method for optimizing
architecture. In another recent work by Kim and Cho [34] a
model for efficient prediction of residential power demand by a
PSO-based CNN-LSTM neural network was proposed. They
used PSO to find optimal CNN-LSTM hyperparameters for
the household power consumption data set and obtained the
lowest RMSE compared to conventional techniques.
B. Convolutional Neural Networks
A CNN is a class of DNN most frequently used for visual
imaging analysis. Recently, Dixit et al. [35] developed a new
methodology to find the optimum deep CNN framework for
texture recognition tasks. In this work They applied the whale
optimization algorithm (WOA) at two different stages. One is
to optimize the values of the filters in the convolution layer
and the second one is for optimizing parameters- weight and
biases values of fully connected layers.
In [36] Strumberger et al. presented a framework called FA-
CNN where firefly algorithm (FA) is used to select optimum
CNN architecture on MNIST dataset. For this work they
optimized number of convolutional and dense layers, number
of kernels per layer and the size of the kernel. In another
article an efficient and precise Distributed Denial of Service
(DDoS) detection method is introduced in [37] using Social
Lion Behavior with CNN. The proposed method of detection
is powerful enough to detect DDoS attacks within the lowest
magnitude of traffic attack and acheived 98.2% accuracy on
the data set which is collected in real time using a mininet.
A novel method PSOCNN for searching deep CNN ar-
chitecture for image classification proposed in [38]. Beside
this, a novel directly encoding technique is also proposed
for comparative analysis of variable length CNNs. Lu et al.
[39] presented a new evolutionary neural architecture search
NSGA-Net which explores potential CNN architecture based
on multiple conflicting objectives namely error metric and
computational complexity. The proposed framework achieves
3.85% test error rate for CIFAR-10 dataset. Sun et al. [40]
also presented an automated evolution of CNN architecture
by applying GA based on ResNet and DenseNet blocks.
A CNN-based corner detection method for grayscale images
is proposed in [41]. In this method,the CNN’s original
processing scheme is altered to include a nonlinear operation
in the image to enhance the contrast of local information.
Further, evolutionary-fuzzy-integral based CNNs (EFI-CNNs)
for age and gender-based facial classification was proposed in
[42]. The outputs obtained from trained CNNs have been used
as input to the EFI and the final fuzzy integral rule has been
selected either from the Sugeno or Choquet during testing.
Finally, PSO was used to find optimum fuzzy density values.
In other recent work, Jones et al. [43] assessed the effec-
tiveness and precision of using an evolutionary algorithm to
search the CNNs topology and configuration for automatically
locating the galaxies in the Avoidance Zone with an accuracy
of 91.75%. Beside this, Zhu et al. in [44] examined the
neuro-evolution to automatically design CNN topologies and
developed a new solution based on Artificial Bee Colony on
the MNIST dataset.
C. Generative Adversarial Networks
In DL, the GANs began a revolution. This revolution has
brought about some significant breakthroughs in research.
Recently, a new model combining neuroevolution and coevo-
lution in the GAN training algorithm was presented in [45].
The proposed model used loss function as a fitness for the
10th International Conference on Cloud Computing, Data Science & Engineering (Confluence)
discriminator population and Frchet Inception Distance (FID)
at the generator side.They experimented using on MNIST
dataset and observed that this model solved mode collapse
problem partially. This work evidenced that FID score is
a good metric for generator but for discriminator side it
needs to evaluate competitive metric. They extended this work
and presented an improved model COEGAN in [46] based
on neuroevolution and coevolution technique. To implement
coevolutionary strategies, COEGAN uses the adversarial
aspect of GAN components in the training algorithm. As
compare to their earlier work, in this they extended and
followed the approach of DeepNEAT. The experimental results
on MNIST and Fashion MNIST datasets shows that proposed
COEGAN achieved a better FID score as well as less number
of layers than DCGAN and random search model. Through
this work they tried to demonstrate the efficiency of the
evolutionary method because of its mechanism of transferring
weight through generations.
In [47] Wang et al. came with new idea of evolutionary
GAN (E-GAN) to overcome the problem of instability and
mode collapse during training of GAN and its variants. They
proposed stable and improved version of GAN and utilized
different adversarial training objective as a mutation operator
for individual generator updation and evolve a population of
generators to adapt the dynamic environment.This model is
validated on CIFAR10, CelebA and LSUN bedroom dataset
and acheived convincing results for image generation.They
suggested video generation and text generation can be con-
sidered for this model. An new evaluation metric based on
brain inspired network named as neuroscore for GAN was
proposed in [48]. The proposed metric for GAN is consistent
for human perception and need lesser number of samples for
computation.
D. Deep Belief Networks
DBN is a class DNN comprised of various layers of both
directed and undirected edges of the graphic model. Recently,
Sabar et al. [49] proposed an evolutionary hyperheuristic
framework to optimize DBN parameters automatically for the
problem of image reconstruction. This framework presented
a high-level approach for automating the operator’s selection
process and a number of low-level approaches to develop
novel parameter settings for DBN while in another research
Lin et al. [50] developed a model for wind speed forecasting
using a DBN with GA called DBNGA. They used GA to
determine DBN parameters and both wind speed information
and multiple weather factors are used to forecast wind
speed. In [51] Sree et al. introduced a novel framework
called TPSO-DBN that utilizes a new improved PSO namely,
Temperature-Controlled PSO (TPSO) to pre-train a DBN. In
order to get faster convergence, they attempted to minimize
the stagnation of particles in the population. The proposed
model is evaluated for Tamil phoneme classification problem
with 89.2% classification accuracy.
Imbalanced data handling is one of the major challenge for
classifier. To overcome this issue Ismail and Mohammad in
297
[52] incorporated the GA and bootstrap sampling into DBN
and tested on imbalance class data. The findings showed a
performance improvement when using Evolutionary DBN with
bootstrap sampling. Recently China. Li et al. [53] proposed
a deep feature-learning strategy to predict short-term traffic
flows using supervised learning methods with multi-objective
PSO (MOPSO). In this MOPSO is used to optimize certain
parameters in deep belief networks to obtain traffic flow
forecast for the next day.
The problem of hyperparameters tuning in Deep Boltzmann
Machine’s was investigated in [54] using NIC with different
backgrounds such as fireflies algorithm, variant of harmony
search (IHS), Adaptive Inertia Weight PSO (AIWPSO) and
variants of differential evolution etc. For validation of pro-
posed techniques they used three publicly available datasets
for binary image reconstruction and also performed the
Wilkoxon signed-rank test. Experimental results have shown
that evolutionary and memory based methods may be more
appropriate for DBM / DBN hyperparmeter tuning.
E. Autoencoders and Echo State Networks
AE are DNNs that are used to replicate the input at
the output layer. Recently, convolutional autoencoders with
differential evolution (DE) for creating stroke trajectory
writing model and its quality assessment system was presented
in [55]. This novel learning framework allows a robot to
efficiently learn how to write Chinese calligraphy automati-
cally. Jian-Bo Yu [56] presented a novel stacked denoising
autoencoders (SDAE) algorithm, called manifold regularized
SDAE (MRSDAE) with PSO for gearbox fault detection in
which manifold regularization and feature engineering are
smoothly integrated into the deep network.
In another recent work, Silhan et al. [57] proposed a novel
SAE and presented automatic and adaptive hyperparameters
optimization where layer wise training is done. This approach
is validated on MNIST, Fashion MNIST, and the Year
Prediction Million Song Database and showed promising
results. Charte et al. in [58] showed how to automate AE
architecture using evolutionary methods. In this approach they
initially proposed a coding to incorporate the AE configuration
in a chromosome. Then, two evolutionary possibilities are
contrasted against search space. In another research by
Rodriguez et al. [59] used genetic programming (GP) to design
the AE structures for high dimensional data representation
learning .It also includes a partitioning system with high-
dimensional input representations for distributed and online
learning.
Further, Chouikhi et al. in [60] introduced multi layered
echo state neteork (ML-ESN) for the first time as an
autoencoder to extract the new features from the given dataset.
A novel and effective bi level evolutionary approach using
MOPSO and PSO is experimented for both noisy and noise
free environment.
IV. CONCLUSIONS
Nature is incredibly interesting and yet to be interpreted full
of intriguing occurrences. Undiscovered paradigms underneath
298 10th International Conference on Cloud Computing, Data Science & Engineering (Confluence)
this science will certainly proceed to foster new developments
in NIA, with performance and computing effectiveness. The
paper presents a short survey on recent applications of NIA
in DL. In this paper, we expressed our vision for NIC, which
calls for a deep reflection on the research directions that the
world should follow in the future.
NIA involve setting parameters on their own, and the best
systematic way of achieving optimal parameter values for
NIA remains an open research issue. The addition of NIA
in DL therefore constitutes extra parameter values. However,
the parameter values of the DL models can be decreased as
some of the parameters can be automatically determined by
the NIA algorithms. This would have a multiplier effect on
the DL in a situation where the NIA parameter values are not
strong enough to deliver great performance. This may have
resulted in the model to caught in local minima by reducing
its performance.
Future research should be on the NIA driven by parame-
terless values to eradicate the need for human interference in
setting parameters values. We hope to be autonomous in future
DL models.
R EFERENCES
[1] Y. Nesterov, Lectures on convex optimization. Springer, 2018, vol. 137.
[2] X.-S. Yang, Nature-inspired metaheuristic algorithms. Luniver press,
2008.
[3] M. Molga and C. Smutnicki, “Test functions for optimization needs,”
Test functions for optimization needs, vol. 101, 2005.
[4] A. Darwish, “Bio-inspired computing: Algorithms review, deep analysis,
and the scope of applications,” Future Computing and Informatics
Journal, vol. 3, no. 2, pp. 231–246, 2018.
[5] Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” nature, vol. 521,
no. 7553, p. 436, 2015.
[6] A. Lopez-Rincon, A. Tonda, M. Elati, O. Schwander, B. Piwowarski,
and P. Gallinari, “Evolutionary optimization of convolutional neural
networks for cancer mirna biomarkers classification,” Applied Soft
Computing, vol. 65, pp. 91–100, 2018.
[7] X.-W. Chen and X. Lin, “Big data deep learning: challenges and
perspectives,” IEEE access, vol. 2, pp. 514–525, 2014.
[8] R. Garcı́a-Ródenas, L. J. Linares, and J. A. López-Gómez, “A
memetic chaotic gravitational search algorithm for unconstrained global
optimization problems,” Applied Soft Computing, vol. 79, pp. 14–29,
2019.
[9] H. Bouchekara, “Solution of the optimal power flow problem consider-
ing security constraints using an improved chaotic electromagnetic field
optimization algorithm,” Neural Computing and Applications, pp. 1–21,
2019.
[10] G. I. Sayed, A. Tharwat, and A. E. Hassanien, “Chaotic dragonfly
algorithm: an improved metaheuristic algorithm for feature selection,”
Applied Intelligence, vol. 49, no. 1, pp. 188–205, 2019.
[11] H. A. Abdulwahab, A. Noraziah, A. A. Alsewari, and S. Q. Salih, “An
enhanced version of black hole algorithm via levy flight for optimization
and data clustering problems,” IEEE Access, 2019.
[12] A. Baykasoğlu and M. E. Şenol, “Weighted superposition attraction algo-
rithm for combinatorial optimization,” Expert Systems with Applications,
vol. 138, p. 112792, 2019.
[13] R. Logesh, V. Subramaniyaswamy, V. Vijayakumar, X.-Z. Gao, and G.-
G. Wang, “Hybrid bio-inspired user clustering for the generation of
diversified recommendations,” Neural Computing and Applications, pp.
1–20, 2019.
[14] C.-B. Cheng, H.-S. Shih, and E. S. Lee, “Metaheuristics for multi-
level optimization,” in Fuzzy and Multi-Level Decision Making: Soft
Computing Approaches. Springer, 2019, pp. 171–188.
[15] M. A. Tawhid and V. Savsani, “Multi-objective sine-cosine algorithm
(mo-sca) for multi-objective engineering design problems,” Neural
Computing and Applications, vol. 31, no. 2, pp. 915–929, 2019.
[16] W. Long, J. Jiao, X. Liang, S. Cai, and M. Xu, “A random opposition-
based learning grey wolf optimizer,” IEEE Access, vol. 7, pp. 113 810–
113 825, 2019.
[17] A. A. Heidari, S. Mirjalili, H. Faris, I. Aljarah, M. Mafarja, and
H. Chen, “Harris hawks optimization: Algorithm and applications,”
Future Generation Computer Systems, vol. 97, pp. 849–872, 2019.
[18] D. Tian, X. Zhao, and Z. Shi, “Chaotic particle swarm optimization
with sigmoid-based acceleration coefficients for numerical function
optimization,” Swarm and Evolutionary Computation, p. 100573, 2019.
[19] X.-S. Yang and X.-S. He, “Mathematical analysis of algorithms: Part i,”
in Mathematical Foundations of Nature-Inspired Algorithms. Springer,
2019, pp. 59–73.
[20] M. M. Mafarja and S. Mirjalili, “Hybrid binary ant lion optimizer with
rough set and approximate entropy reducts for feature selection,” Soft
Computing, vol. 23, no. 15, pp. 6249–6265, 2019.
[21] C. Huang, Y. Li, and X. Yao, “A survey of automatic parameter
tuning methods for metaheuristics,” IEEE Transactions on Evolutionary
Computation, 2019.
[22] M. Isiet and M. Gadala, “Self-adapting control parameters in particle
swarm optimization,” Applied Soft Computing, vol. 83, p. 105653, 2019.
[23] R. Vafashoar and M. R. Meybodi, “Cellular learning automata based
bare bones pso with maximum likelihood rotated mutations,” Swarm
and evolutionary computation, vol. 44, pp. 680–694, 2019.
[24] Y. Wang, H. Liu, Z. Yu, and L. Tu, “An improved artificial neural
network based on human-behaviour particle swarm optimization and
cellular automata,” Expert Systems with Applications, vol. 140, p.
112862, 2020.
[25] P. Jiang, Q. Zhou, J. Liu, and Y. Cheng, “A three-stage surrogate model
assisted multi-objective genetic algorithm for computationally expensive
problems,” in 2019 IEEE Congress on Evolutionary Computation (CEC).
IEEE, 2019, pp. 1680–1687.
[26] Y. Du, T. Wang, B. Xin, L. Wang, Y. Chen, and L. Xing, “A data-
driven parallel scheduling approach for multiple agile earth observation
satellites,” IEEE Transactions on Evolutionary Computation, 2019.
[27] A. Santiago, B. Dorronsoro, A. J. Nebro, J. J. Durillo, O. Castillo, and
H. J. Fraire, “A novel multi-objective evolutionary algorithm with fuzzy
logic based adaptive selection of operators: Fame,” Information Sciences,
vol. 471, pp. 233–251, 2019.
[28] C. Yue, B. Qu, K. Yu, J. Liang, and X. Li, “A novel scalable test
problem suite for multimodal multiobjective optimization,” Swarm and
Evolutionary Computation, vol. 48, pp. 62–71, 2019.
[29] A. Q. B. Silva, “Predicting cervical cancer with metaheuristic optimizers
for training lstm,” in International Conference on Computational
Science. Springer, 2019, pp. 642–655.
[30] Y. Li, Z. Zhu, D. Kong, H. Han, and Y. Zhao, “Ea-lstm: Evolutionary
attention-based lstm for time series prediction,” Knowledge-Based
Systems, 2019.
[31] S. Ai, A. Chakravorty, and C. Rong, “Evolutionary ensemble lstm based
household peak demand prediction,” in 2019 International Conference
on Artificial Intelligence in Information and Communication (ICAIIC).
IEEE, 2019, pp. 1–6.
[32] M. Farzaneh and R. M. Toroghi, “Melody generation using an interactive
evolutionary algorithm,” arXiv preprint arXiv:1907.04258, 2019.
[33] A. Camero, J. Toutouh, and E. Alba, “A specialized evolutionary strategy
using mean absolute error random sampling to design recurrent neural
networks,” arXiv preprint arXiv:1909.02425, 2019.
[34] T.-Y. Kim and S.-B. Cho, “Particle swarm optimization-based cnn-lstm
networks for forecasting energy consumption,” in 2019 IEEE Congress
on Evolutionary Computation (CEC). IEEE, 2019, pp. 1510–1516.
[35] U. Dixit, A. Mishra, A. Shukla, and R. Tiwari, “Texture classification
using convolutional neural network optimized with whale optimization
algorithm,” SN Applied Sciences, vol. 1, no. 6, p. 655, 2019.
[36] I. Strumberger, E. Tuba, N. Bacanin, M. Zivkovic, M. Beko, and
M. Tuba, “Designing convolutional neural network architecture by the
firefly algorithm,” in 2019 International Young Engineers Forum (YEF-
ECE). IEEE, 2019, pp. 59–65.
[37] D. Arivudainambi, V. K. KA, and S. S. Chakkaravarthy, “Lion ids: A
meta-heuristics approach to detect ddos attacks against software-defined
networks,” Neural Computing and Applications, vol. 31, no. 5, pp. 1491–
1501, 2019.
[38] F. E. F. Junior and G. G. Yen, “Particle swarm optimization of deep
neural networks architectures for image classification,” Swarm and
Evolutionary Computation, 2019.
10th International Conference on Cloud Computing, Data Science & Engineering (Confluence)
[39] Z. Lu, I. Whalen, V. Boddeti, Y. Dhebar, K. Deb, E. Goodman, and
W. Banzhaf, “Nsga-net: neural architecture search using multi-objective
genetic algorithm,” in Proceedings of the Genetic and Evolutionary
Computation Conference. ACM, 2019, pp. 419–427.
[40] Y. Sun, B. Xue, M. Zhang, and G. G. Yen, “Completely automated
cnn architecture design based on blocks,” IEEE transactions on neural
networks and learning systems, 2019.
[41] E. Cuevas, M.-A. Dı́az-Cortes, and E. Mezura-Montes, “Corner detection
of intensity images with cellular neural networks (cnn) and evolutionary
techniques,” Neurocomputing, vol. 347, pp. 82–93, 2019.
[42] C.-J. Lin, C.-H. Lin, C.-C. Sun, and S.-H. Wang, “Evolutionary-
fuzzy-integral-based convolutional neural networks for facial image
classification,” Electronics, vol. 8, no. 9, p. 997, 2019.
[43] D. Jones and G. Nitschke, “Evolutionary deep learning to identify
galaxies in the zone of avoidance,” arXiv preprint arXiv:1903.07461,
2019.
[44] W. Zhu, W. Yeh, J. Chen, D. Chen, A. Li, and Y. Lin, “Evolutionary
convolutional neural networks using abc,” in Proceedings of the 2019
11th International Conference on Machine Learning and Computing.
ACM, 2019, pp. 156–162.
[45] V. Costa, N. Lourenço, and P. Machado, “Coevolution of generative
adversarial networks,” in International Conference on the Applications
of Evolutionary Computation (Part of EvoStar). Springer, 2019, pp.
473–487.
[46] V. Costa, N. Lourenço, J. Correia, and P. Machado, “Coegan: evaluating
the coevolution effect in generative adversarial networks,” in Proceed-
ings of the Genetic and Evolutionary Computation Conference. ACM,
2019, pp. 374–382.
[47] C. Wang, C. Xu, X. Yao, and D. Tao, “Evolutionary generative
adversarial networks,” IEEE Transactions on Evolutionary Computation,
2019.
[48] Z. Wang, Q. She, A. F. Smeaton, T. E. Ward, and G. Healy, “Neuroscore:
A brain-inspired evaluation metric for generative adversarial networks,”
arXiv preprint arXiv:1905.04243, 2019.
[49] N. R. Sabar, A. Turky, A. Song, and A. Sattar, “An evolutionary hyper-
heuristic to optimise deep belief networks for image reconstruction,”
Applied Soft Computing, p. 105510, 2019.
[50] K.-P. Lin, P.-F. Pai, and Y.-J. Ting, “Deep belief networks with genetic
algorithms in forecasting wind speed,” IEEE Access, vol. 7, pp. 99 244–
99 253, 2019.
[51] B. L. Sree and M. Vijaya, “Temperature controlled pso on optimizing
the dbn parameters for phoneme classification,” International Journal of
Speech Technology, vol. 22, no. 1, pp. 143–156, 2019.
[52] A. R. Ismail, O. A. Mohammad et al., “Evolutionary deep belief
networks with bootstrap sampling for imbalanced class datasets,”
International Journal of Advances in Intelligent Informatics, vol. 5,
no. 2, pp. 123–136, 2019.
[53] L. Li, L. Qin, X. Qu, J. Zhang, Y. Wang, and B. Ran, “Day-ahead
traffic flow forecasting based on a deep belief network optimized by the
multi-objective particle swarm algorithm,” Knowledge-Based Systems,
vol. 172, pp. 1–14, 2019.
[54] L. A. Passos and J. P. Papa, “A metaheuristic-driven approach to fine-
tune deep boltzmann machines,” Applied Soft Computing, p. 105717,
2019.
[55] X. Gao, C. Zhou, F. Chao, L. Yang, C.-M. Lin, T. Xu, C. Shang,
and Q. Shen, “A data-driven robotic chinese calligraphy system using
convolutional auto-encoder and differential evolution,” Knowledge-
Based Systems, 2019.
[56] J.-B. Yu, “Evolutionary manifold regularized stacked denoising autoen-
coders for gearbox fault diagnosis,” Knowledge-Based Systems, vol. 178,
pp. 111–122, 2019.
[57] T. Silhan, S. Oehmcke, and O. Kramer, “Evolution of stacked autoen-
coders,” in 2019 IEEE Congress on Evolutionary Computation (CEC).
IEEE, 2019, pp. 823–830.
[58] F. Charte, A. J. Rivera, F. Martı́nez, and M. J. del Jesus, “Automating
autoencoder architecture configuration: An evolutionary approach,” in
International Work-Conference on the Interplay Between Natural and
Artificial Computation. Springer, 2019, pp. 339–349.
[59] L. Rodriguez-Coayahuitl, A. Morales-Reyes, and H. J. Escalante,
“Evolving autoencoding structures through genetic programming,”
Genetic Programming and Evolvable Machines, pp. 1–28, 2019.
[60] N. Chouikhi, B. Ammar, A. Hussain, and A. M. Alimi, “Bi-level multi-
objective evolution of a multi-layered echo-state network autoencoder
for data representations,” Neurocomputing, vol. 341, pp. 195–211, 2019.
299