BULGARIAN ACADEMY OF SCIENCES

INSTITUTE OF INFORMATION AND

COMMUNICATION TECHNOLOGIES

ABSTRACT
A DISSERTATION SUBMITTED FOR THE DEGREE
OF DOCTOR OF PHILOSOPHY

DISTRIBUTED SYSTEM FOR TIME SERIES FORECASTING

WITH EVOLUTIONARY ALGORITHMS AND
ARTIFICIAL NEURAL NETWORKS

Scientific Area:
4 Natural Sciences, Mathematics and Informatics
Professional Direction:
4.6 Informatics and Computer Science
Scientific Specialty:
01.01.12 Informatics

Candidate:
Todor Dimitrov Balabanov

Promoter:
prof. Vassil Vassilev
assoc. prof. Krassimira Genova

Consultant:
prof. Milena Lazarova

Sofia - 2017
 Research Topic and Motivation

Research Topic and Motivation

A major flaw in the training of artificial neural networks with

evolutionary algorithms is the fact that almost there is no implementation of
the full-connected artificial neural networks training. The second major
drawback is that generally artificial neural networks are used in two phases -
training and operation. The problems described by time series is characterized
with grow as time progress and naturally artificial neural networks sould be
re-training, to the new information. Using exact numerical methods (such as
the most popular back propagation) is effective, but relatively inapplicable in
artificial neural network with full-connected topology. In the literature there
are presented numerous hybrid models for training artificial neural networks
with exact numerical methods in combination with methods of heuristic
optimization. Third, although minor problem is proper selection of appropriate
and accurate heuristics for making hybrid training. In the literature there is a
relatively small overlap of artificial neural networks trained in a distributed
environment so that maximum benefit of parallel implementation of
optimization algorithms from the group of evolutionary algorithms and
population algorithms.

Aims and Tasks of the Dissertation

To solve the problems identified in the thesis the following objectives

are distinguished: 1. Realization of models of full-connected artificial neural
networks; 2. Implementation of algorithms for continuous training, even
during operation of the artificial neural networks; 3. Implementation of a
hybrid combination presented in the literature by exact and heuristic
algorithms for artificial neural networks training; 4. Implementation of a
software system as a client-server application running in a distributed
computing environment.

To achieve the objectives outlined, group of tasks are targeted. As the

main task of the thesis is the realization of a model of artificial neural

Todor Balabanov IICT-BAS Sofia 2017 p. 1

 Research Topic and Motivation

networks (C ++ and JavaScript implementation) as fully-connected topology.

This task consists of two pieces - an implementation of the client application
and implementation of the server application. Second in importance is the task
of continuos fully-connected artificial neural networks training. The training
must take place in a continuous 24/7 cycle. For this purpose algorithms
suitable for continuous distribution of tasks from server to client should be
available and continuous training of local copies of artificial neural networks
that support client machines. Third in importance is the task of appropriately
combining algorithms such as genetic algorithms and differential evolution
algorithms and back propagation, so that the duration of the training of
artificial neural networks to be reduced. The fourth most important task is
related to the technical implementation of the system and carrying out the
necessary experiments to confirm the effectiveness with which it works.

List of Publications

1. Balabanov, T., Zankinski, I., Simeonova, V., Forecasting Time Series with Artificial
Neural Networks and Differential Evolution in Distributed Environment, IIT-BAS Working
Papers, IIT/WP-268B, ISSN:1310-652X, 2010.
2. Balabanov, T., Forecasting with Heuristic Approaches in a Distributed
Environment, Proceedings of Anniversary Scientific Conference 40 Years Department of
Industrial Automation, ISBN:978-954-465-043-8, 163-166, 2011.
3. Balabanov. T., Zankinski I., Dobrinkova N., Time Series Prediction by Artificial
Neural Networks and Differential Evolution in Distributed Environment, Large-Scale Scientific
Computing, Lecture Notes in Computer Science, vol. 7116, ISBN:978-3-642-29842-4,
DOI:10.1007/978-3-642-29843-1_22, 198-205, 2011.
4. Balabanov, T., Avoiding Local Optimums in Distributed Population based Heuristic
Algorithms, Proceedings of the XXII International Symposium Management of energy,
Industrial and Environmental Systems, ISSN:1313-2237, 83 - 86, 2015.
5. Balabanov, T., Zankinski, I., Barova, M.. Distributed Evolutionary Computing
Migration Strategy by Incident Node Participation. Large-Scale Scientific Computing, Lecture
Notes in Computer Science, 9374, Springer International Publishing Switzerland, ISBN:978-3-
319-26520-9, DOI:10.1007, 203 - 209, 2015.
6. Balabanov, T., Genova, K., AJAX Distributed System for Evolutionary Algorithms
based Artificial Neural Networks Training, Proceedings of the XXIV International Symposium
Management of energy, Industrial and Environmental Systems, ISSN:1313-2237, 49 - 52, 2016.
7. Balabanov T., Keremedchiev D., Goranov I., Web Distributed Computing For
Evolutionary Training Of Artificial Neural Networks, International Conference InfoTech-2016,

Todor Balabanov IICT-BAS Sofia 2017 p. 2

 Research Topic and Motivation

Varna - St. St. Constantine and Elena resort, Bulgaria, ISSN:1314-1023, 210-216, 2016.
8. Balabanov, T., Genova, K., Distributed System for Artificial Neural Networks Training Based
on Mobile Devices, Proceedings of International Conference Automatics and Informatics2016,
ISSN:1313-1850, 49 - 52, 2016.

Chapter 1 - Overview of Forecasting Time Series

Systems

Forecasting time series is a complex task that is used in many areas

with a lot of research in the field. To create predictive software systems
require multiple skills and knowledge. The importance of the tasks of
forecasting is so great that they are used in almost every sphere of human life
(temperature, rainfall, power supplies, etc.).

Analysis - problems, goals and tasks

Forecasting of financial time series with the help of heuristics

formulate a set of problems that can be pointed as objectives of the thesis, and
these goals can be broken down into tasks that will lead to achieving the goals.

A major drawback of the discussed solutions for artificial neural

networks training with evolutionary algorithms is the fact that there is almost
no occurrence of full-connected artificial neural networks training. The second
major drawback in the existing examined solutions is that generally artificial
neural networks are used in two phases - training and operation. The problems
described in the terms of the time series is characterized with growth and
naturally artificial neural networks should be constantly re-trained to fulfill the
newly obtained information. Using exact numerical methods (such as the most
popular back propagation) is effective, but relatively inapplicable in artificial
neural network with full-connected topology. In the literature thee are
numerous hybrid models for artificial neural networks training with exact
numerical methods in combination with heuristic optimization methods. Third,
although minor problem is proper selection of appropriate and accurate

Todor Balabanov IICT-BAS Sofia 2017 p. 3

 Chapter 1 - Overview of Forecasting Time Series Systems

heuristics for making hybrid training. In researched information sources

relatively little overlap opportunities are seen for artificial neural networks
training in a distributed computing environment so that maximum benefit to
be obtained by optimization algorithms in the groups of evolutionary
algorithms and population algorithms.

The objectives of the thesis are as follows: 1. To implement models of

full-connected artificial neural networks; 2. To implement algorithms for
continuous training, even during operation of artificial neural networks; 3. To
implement the hybrid combination presented in the literature between exact
numerical and heuristic algorithms for artificial neural networks training ; 4.
To develop a software system as a client-server application running in a
distributed computing environment.

To achieve the objectives a series of tasks were formulated. The main

task of the thesis is the implementation of a model of artificial neural networks
in C ++ and JavaScript as fully-connected topology. This task consists of two
pieces - an implementation of the client application and an implementation of
the server application. Second in importance is the task of continuous training
of fully-connected artificial neural networks. The training must take place in a
24/7 cycle for this purpose there should be available algorithms suitable for
continuous distribution of tasks from the server to the client applications and
continuous training of local copies of artificial neural networks supported on
the client machines. Third in importance is the task of appropriately
combining algorithms such as genetic algorithms and differential evolution
algorithms with back propagation, so that the duration of the training of
artificial neural networks to be reduced. The fourth most important task is
related to the technical implementation of the system and carrying out the
necessary experiments to confirm the effectiveness with which it works.

Chapter 2 - Model for Time Series Forecasting with

Artificial Neural Networks Trained by Evolutionary
Algorithms

Todor Balabanov IICT-BAS Sofia 2017 p. 4

 Chapter 2 - Model for Time Series Forecasting with Artificial Neural
Networks Trained by Evolutionary Algorithms

The complexity of the task of time series forecasting requires the

development of faster acting algorithms that lead to predictions with greater
accuracy. The basis of artificial neural networks predictions is the idea of
training based on a sequence data for the recent period. The choice of training
algorithm can be made of two main areas - exact numerical optimization
methods and heuristic optimization method. Applying appropriate heuristic
algorithms may lead to their use in the distributed environment and
significantly speed up the process of training.

Proposed Forecasting System

he thesis is propose for the purpose of forecasting a mathematical

model based on artificial neural networks to be used. The training is done with
differential evolution in the form of calculations in a distributed environment.
The allowed types of topologies are: 1) Multi-layer perceptron; 2) Multi-layer
recurrent; 3) Full-connected networks. The proposed model is based on the
classic artificial neural network. As a summation function is proposed the
usage of a linear function.

Fig. 2.1 Training system based on DE and ANN in a distributed environment (left) and sharing
tasks in a distributed computing system (right).

The training of artificial neural networks are implemented using

differential evolution. In the systems for distributed environment calculations
the centralized server distributes calculating tasks to the remote computers
(Fig. 2.1 - Step 1). At certaine moment in time the remote computers perform

Todor Balabanov IICT-BAS Sofia 2017 p. 5

 Chapter 2 - Model for Time Series Forecasting with Artificial Neural
Networks Trained by Evolutionary Algorithms

the task (Fig. 2.1 - Step 2). When the client complete the calculation of the
assigned task it returns the result to the server (Fig. 2.1 - Step 3). These three
general steps in this process are repeated until there is a working server and
client computers attached to it.

In the parallel implementation of differential evolution local copies of

the artificial neural network and the differential evolution are created
[BAZA2010]. The training is carried out locally by each chromosome in the
population indicates a single point (individual) in the search space. While
different individuals are grouped relatively close to each other in this space.
Upon separation of the calculations on a plurality of computers, like grouping
of individuals can result in a local study of the different areas in the space of
solutions (the search space) [BATO2011]. In this aspect, the most important is
the synchronization policy by the synchronization process includes the
broadcasting of the best individuals and their collection in one centralized
place (in client-server architecture). This set of globally most fitted individuals
can be used when creating of the local sub populations is done. In the presence
of a large number of customers, the server load can be lower by reducing the
frequency of communication with the clients.

Chapter 3 - Practical Implementation of Time Series

Forecasting Software System with Artificial Neural
Networks and Evolutionary Algorithms

In MetaTrader 4 trading platform all information is programmatically

accessible by means of the built-in programming language called MQL4. The
trade terminal MetaTrader 4 provides visualization of information from time
series.

Todor Balabanov IICT-BAS Sofia 2017 p. 6

 Chapter 3 - Practical Implementation of Time Series Forecasting Software
System with Artificial Neural Networks and Evolutionary Algorithms

Fig. 3.1 Quotes EUR / USD in MetaTrader 4.

Programing API of MetaTrader 4 allows quotes for each currency pair

to be provided outside the trading terminal with normalization applied in
advance. The chart specifies the highest level achieved, then the lowest level
achieved and the values of each bar normalize in the range 0.0-1.0. This
normalization step is necessary because using artificial neural network works
with signals in the range 0.0-1.0. The second reason for the performance of
normalization is the presence of multiple currency pairs that have different
nominal values. For example, the ratio EUR/USD is in the range of 1.13510
(information to date 10.20.2015), while the ratio USD/JPY is around 119 830
(information to date 20.10.2015). Once the artificial neural network offered its
forecast the operation of scaling reverses the output to minimum and
maximum value on the graph.

Traders receive the currency pair quotes from a centralized server.

This organization allows the computer of every trader to launch additional
module for calculations (proposed in the thesis) to perform calculations on the
artificial neural networks training. The proposed calculation module is a
standard executable file that reads the quotations recorded by MQL4 in text
files. The training of a specific topology artificial neural networks for specific
quotes, in a particular time interval can be distributed among multiple
computers.

Todor Balabanov IICT-BAS Sofia 2017 p. 7

 Chapter 3 - Practical Implementation of Time Series Forecasting Software
System with Artificial Neural Networks and Evolutionary Algorithms

Backend Module for Monitoring and Tuning of the System

The module for monitoring and system tuning is used to set the
parameters under which runs the training of artificial neural networks. The
module was developed as a Java Applet and it can be accessed by different
computer systems using a standard web browser. The administrative module is
intended solely for system operators who are in the role of trusted employees.
Additionally, the security level in the DBMS limit access to data only within
the local network infrastructure.

Fig. 3.2 ANN visualization screenshot [NIRA2012] [ANMO2011] (left) and main web page of
the public information system (right).

The most significant opportunity of the back-end system is the

visualization of an artificial neural network with all connections, as weights
and/or activities as well. Neurons in the network are displayed with different
colors according to the role held in the network (input, output, or internal
shifting). Location of neurons to visual space can be changed by using the
mouse and keyboard (Fig. 3.2 left).

Front-end Module of the Information System

Todor Balabanov IICT-BAS Sofia 2017 p. 8

 Chapter 3 - Practical Implementation of Time Series Forecasting Software
System with Artificial Neural Networks and Evolutionary Algorithms

Front-end module is a web site developed with HTML, CSS and PHP.
The aim of public module is to present information system, which is for public
use. The public information includes a list of various artificial neural networks
in the DBMS, different efficiency by which individual networks are trained
and their service identifier within the DBMS (Fig. 3.3 - right).

The overall system includes various modules, some of which are

available for public use. List of publicly available modules is shown in the
additional web page. Also front-end contains a web page with contact
information.

Chapter 4 - Application of the Forecasting System and

Analysis of the Experimental Results

With increasing number of nodes in artificial neural networks, the

number of weights increased significantly, which could further impede the
training process, especially for more complex topology of artificial neural
networks. The first direction of research is what topology of artificial neural
networks would be most effective for the purposes of the forecasting. The
classical three-layered artificial neural network and full-connected artificial
neural network are examined. Not only the number of layers and the particular
set of connections between them are important is also essential the total
number of neural nodes.

An important point in the study is the choice of type of input and

output data used in the artificial neural networks. In terms of output, it is
desirable to obtain directly an estimated value (specific number or the
difference of the predicted point relative to the current). In terms of inputs are
present the following options: 1. To submit time value; 2. To submit a
dimension value of a previous time; 3. To submit a set of values of magnitude
in previous moments; 4. To submit differences in the value of the magnitude
of previous moments; 5. To submit a combination of previous values of the
magnitude and timing information.

Todor Balabanov IICT-BAS Sofia 2017 p. 9

 Chapter 4 - Application of the Forecasting System and Analysis of the
Experimental Results

Incident nodes participation in a distributed computing

system

In the proposed distributed computing system the main population is

on a central unit (server). Each client is attached to the system and receives a
subset of the global population (Fig. 4.1 - left). After this initial initialization
optimization is carried out on a local level, such as the central node is
informed only for better individuals from the local population compared with
the already known best global achievements.

Fig. 4.1 Incident nodes participation in a distributed computing system (left) and comparison
between the incident nodes participation and ring topology (right).

The central unit serves as a repository of individuals with the best

achieved vitality of local optimization procedures (a form of elitism). This part
of the system for the exchange of individuals between computing nodes was
presented in [TBIZ2015], as a comparison between incident nodes
participation and exchange of information in a ring topology.

From the experiments done it is visible that the incident nodes

participation converges better (Fig. 4.1 right).

Todor Balabanov IICT-BAS Sofia 2017 p. 10

 Chapter 4 - Application of the Forecasting System and Analysis of the
Experimental Results

Comparison Between C ++ and JavaScript for Forward

Pass of ANN Training

In this study [BAGE2016a] a model for artificial neural networks

training is presented with the usage of differential evolution as training
algorithm. The training of artificial neural networks is implemented in a
distributed computing environment and the network is presented in the form of
JavaScript code. The communication with the central node is performed by
usage of asynchronous AJAX requests.

The performance of JavaScript execution is the main leading argument

this language to be avoided in carrying out large-volume calculations or
computations that require greater accuracy.

Fig. 4.2 Comparison for performance for information distribution in ANN, at the forward pass
of the training between C ++ and JavaScript. On the X axis are the number of neurons, and the
Y axis is the performnce in milliseconds (left) and standard deviation during propagation of
information in ANN, at the formard pass between C ++ and JavaScript. Along the X axis is the
number of neurons, and the Y axis is the standard deviation (right).

In order to check the difference in the performance of the proposed

AJAX-JavaScript solution there were made a series of experiments with
feedforward pass in an artificial neural network. The freedforward pass is
encoded in two separate modules of the VitoshaTrade system - respectively
module in C ++ and JavaScript module. As is evident from Fig. 4.2 (left), that
the performance is comparable to networks of 10 to 100 neurons. Each

Todor Balabanov IICT-BAS Sofia 2017 p. 11

 Chapter 4 - Application of the Forecasting System and Analysis of the
Experimental Results

experiment was executed 30 times and the average values are presented in the
figure [BAKE2016].

In terms of performance languages as C++ and JavaScript are

comparable, but the stability of the calculation process is better in C++, which
can be seen in Fig. 4.2 (right), which reflects the mean square deviation of the
time needed for computation. This difference is mainly due to the presence of
an interpreter and a web browser, something that is not present in the
calculations with C++. In the category languages as C++ program is initially
translated to assembly language, and then to machine code.

The implementation of calculations in a distributed environment as

AJAX web-based system leads to a very high degree of scalability in the
system. Distributed computing can run on any device supporting modern web
browser which are capable to run JavaScript and AJAX. Since the calculation
is carried out within the web browser, which in turn is a process of the
operating system, and it in turn runs on physical hardware, although
comparable in performance boost, the calculations are less reliable (presence
of interpreter ) than they were in the implementation of languages like C/C++
or Assembler.

Comparison Between Different ANN Topologies

In time series forecasting with artificial neural networks the two most
recent model networks are classical three-layered network without recurrent
connections and network with recurrent connections. The experiments carried
out with three-layer networks that have different size of the hidden layer and
the fully connected network (each node is connected with each other,
including it selves). With the full connectivity the effect of short-term memory
in the network is targeted .

For comparison between the full-connected and three-layer network

topology of 28-12-5 is selected. Fully connected network consists of 45 nodes.

Todor Balabanov IICT-BAS Sofia 2017 p. 12

 Chapter 4 - Application of the Forecasting System and Analysis of the
Experimental Results

Both networks are trained with genetic algorithms with the following
parameters for the genetic algorithm: Population size - 37; Probability of
crossover - 0.9; Probability of mutation - 0.03; Title elite elements - 0.1;
Arguments for a race selection - 2; Type crossing - binary; Type mutation -
random delta vector; Condition for optimization end - 24 hours.

Both networks are trained in equal conditions. The condition for the
end of the training is the expiry of a fixed period of time, namely 24 hours. As
a result of training, fully-connected network shows better parameters for less
epochs of training. For multi-layer perceptron 296037 epochs are needed. The
best achieved individual in the population has fitness of 656.1699030329493
and the error of the artificial network is 317.7286234453099, while fully-
connected network needed 294003 epochs with best fitness value of
656.169903010489 and network error of 317.0226357675591.

Having more weights in a fully-connected network results in a slow

process of training, but the presence of recurrent connections allows the
formation of short-term memory in artificial neural networks and at
considerably longer training that gives priority to this model.

Comparison Between Three-Layered ANNs with Different

Size in the Hidden Layer

The experiments were carried out with multilayer perceptron (3

layers). The input submits 25 values from the past period and on the output are
5 values are expected (the future values). For the purposes of the experiment
data are divided into three subsets: 1. Training data; 2. Validation data; 3.
Testing data. The tested topologies have size of the hidden layer of 30 to 1
nodes. All experiments were performed at the same intervals. Fig. 4.3 (left)
shows the difference in the number of epochs according the size of the hidden
layer.

Todor Balabanov IICT-BAS Sofia 2017 p. 13

 Chapter 4 - Application of the Forecasting System and Analysis of the
Experimental Results

Fig. 4.3 Number training epochs at the same time training interval, but different size of the
hidden layer (left) and average error done by ANN with training of network topology of three
layers, the size of the hidden layer ranges from 30 to 1 (right).

In the experiments the average error that the networks of varying

topology do is evaluated. The aim is to establish in which values of the size of
the hidden layer the network is most effective. Error calculation is made only
using data from the testing subset. These are data that are not used in the
process of training and validation.

Fig. 4.3 (right) clearly shows that the most promising are the models
with 22, 12 and 9 elements in the hidden layer, which corresponds to the
topologies of networks: 1. 25-22-5; 2. 25-12-5; 3. 25-9-5.

Comparison of Forecasting Effectiveness at Different Input

Data Window

For the three most effective model pointed in Fig. 4.3 (right), were
carried out further experiments with the size, which has a time window from
past periods. The amount of time window has been studied from 35 to 5 values
as the window to predict future results is fixed only to 5 values.

Todor Balabanov IICT-BAS Sofia 2017 p. 14

 Chapter 4 - Application of the Forecasting System and Analysis of the
Experimental Results

Fig. 4.4 Number training epochs at the same time interval training, but different size of the
input layer (left) and average error done by ANN during training of network topology of three
layers, where the size of the input layer ranges from 35 to 5 (right).

From Fig. 4.4 (left) it is clear that the size of the input layer almost has
no effect on the number of periods during which the training is held in a fixed
interval of time (1 hour). Also, it is clearly noticeable that the size of the
hidden layer directly affects the number training epoches at a fixed time
interval. The slowest training is on hidden layer of 22 elements, the fastest
training is on hidden layer of 9 elements.

In Fig. 4.4 (right) clearly appears in which values of the input layer
artificial neural network has achieved the lowest error for the proposed
estimate. For the size of the hidden layer of 22 elements the most effective
input layer has 29 elements. In a hidden layer of 12 elements the most
effective input layer has 28 elements. And in the hidden layer of the 9
elements the most effective input layer has 26 elements. Of the three options
best results are obtained with a hidden layer of 12 elements, which is about
half of the input layer.

Conclusions

Todor Balabanov IICT-BAS Sofia 2017 p. 15

 Conclusions

Summary of Dissertation Achievements and Ideas for

Future Work

In the dissertation there are presented main results obtained from

studies conducted in methods for predicting time series, algorithms and
software systems for solving problems in the field of forecasting. The purpose
of this research is the development of heuristic approaches to machine self-
adaptive forecasting. Based on these approaches heuristics and algorithms
have been proposed to -enhance performance in artificial neural networks
training. Accelerated performance in artificial neural networks training is
particularly important for predicting time series, as the phase of training is
significantly slower than the stage of operating itself. The characteristics of
these methods and algorithms, the quality of the proposed design, and good
program implementation are the basis for the creation of an effective software
system for time series forecasting in the field of currency markets.

The results achieved in the dissertation outlines the following

directions for future research, such as study of the proposed heuristic
approaches for demand forecasting in other areas, not just in terms of currency
markets; Expanding the programming system to include other methods for
predicting time series, in order to more efficient comparative analysis;
Expanding the capabilities of the web-based interface in the system and even
performing calculations in a distributed environment based on calculations in
mobile devices.

Contributions

Scientific-Applied Contributions

1. An analysis of current heuristic methods for predicting time series is

done. It presents developments in the field that clearly outline the advantages
of heuristic approaches for training artificial neural networks as more practical

Todor Balabanov IICT-BAS Sofia 2017 p. 16

 Conclusions

than exact numerical methods (Chapter 1, 1.7.1).

2. Improved heuristic approaches for training artificial neural networks
(Chapter 2, 2.6.3) are developed. Were investigated properties of the
proposed heuristic approaches and results are presented that they expand the
machine learning capabilites (Chapter 4, 4.3.1).
3. Two machine learning methods (1. Incident nodes participation; 2.
Differential evolution for training fully connected networks in a distributed
environment) and algorithmic schemes (based on the proposed heuristic
approaches) for predicting time series (Chapter 2, 2.6.7 and Chapter 4, 4.1)
are created.

Applied Contributions

1. Software development and design of interactive software system for

forecasting time series data on currency markets, which realizes the proposed
heuristics for machine learning. The system features a simple and with
informative interface (Chapter 3, 3.4, 3.5 and 3.6).

Bibliography

1. [ANMO2011] Anatchkov, M., system visualization and manipulation of artificial

neural networks, TUES to TU, 2011.
2. [BATO2011] Balabanov. T. Prediction of heuristic approaches in a distributed
environment, Proceedings of Anniversary Scientific Conference 40 Years Department of
Industrial Automation, ISBN: 978-954-465-043-8, 163-166, 2011.
3. [BATO2015] Balabanov, T., avoiding local optimum population in heuristic
algorithms in a distributed environment, Proceedings of the XXII International Symposium
Management of energy, industrial and environmental systems, ISSN: 1313-2237, 83-86, 2015.
4. [BAGE2016a] Balabanov, T., Genova, K., AJAX distributed system for training
artificial neural networks with evolutionary algorithms, Proceedings of the XXIV International
Symposium Management warm energy facilities and systems, energy management, industrial
and environmental systems, ISSN: 1313 -2237, 49-52, 2016.
5. [BAKE2016] Balabanov T., Keremedchiev D., Goranov I., Web Distributed
Computing For Evolutionary Training Of Artificial Neural Networks, International Conference
InfoTech-2016, Varna - St. St. Constantine and Elena resort, Bulgaria, ISSN:1314-1023, 210-
216, 2016.

Todor Balabanov IICT-BAS Sofia 2017 p. 17

 Bibliography

6. [TBIZ2015] Balabanov, T., Zankinski, I., Barova, M., Distributed Evolutionary

Computing Migration Strategy by Incident Node Participation. Large-Scale Scientific
Computing, Lecture Notes in Computer Science, 9374, Springer International Publishing
Switzerland, ISBN:978-3-319-26520-9, DOI:10.1007, p 203-209, 2015.
7. [BAZA2011] Balabanov. T., Zankinski I., Dobrinkova N., Time Series Prediction by
Artificial Neural Networks and Differential Evolution in Distributed Environment, Large-Scale
Scientific Computing, Lecture Notes in Computer Science, vol. 7116, ISBN:978-3-642-29842-
4, DOI:10.1007/978-3-642-29843-1_22, 198-205, 2011.
8. [BAZA2010] Balabanov T., I. Zankinski, Simeon C., Forecasting time series with
artificial neural networks and differential evolution in distributed environment, preprints of IIT,
IIT / WP-268B, ISSN: 1310-652X, 2010.
9. [MTMQ2015] MetaTrader 4, MetaQuotes Software Corp., (2015, October 20)
http://www.metatrader4.com/
10. [NIRA2012] Nikolova, R. Development of a system for graphing and visual
manipulation of artificial neural networks NBU Sofia, 2012.

Todor Balabanov IICT-BAS Sofia 2017 p. 18