BUS VOLTAGES CALCULATION BY USING ANN
Document By
SANTOSH BHARADWAJ REDDY
Email: help@matlabcodes.com
Engineeringpapers.blogspot.com
More Papers and Presentations available on above site
ABSTRACT
An attempt has been made in this work to
apply the Concepts of Artificial Neural
Networks to a load-flow analysis which is
basic for any type of study on a power system
and ANN concepts are applied to this.
To apply ANN to a load-flow study, the
network has to be trained to get various
weights and biases. For this purpose, a load-
flow study on a typical IEEE 14-Bus,
system has been conducted using the
Newton-Raphson method developed for this
purpose. Various load patterns are selected
from this analysis and the various voltages
and angles are used to train the network.
Using the code developed for this purpose,
the network is trained to get the values of
weights and biases.
Using this information, the voltages and angles
for the network to any different load
pattern has been determined successfully.
The correctness of this method is again
verified by conventional load-flow method.
In other words, applying ANN concepts
load-flow studies can be conducted
without using conventional methods.
ANN application is very much useful in real
time application of a power system.
The authors are with the Department of Electrical and
Electronic Engineering,1. Padmasri Dr. B. V. Raju
Institute of Technology, Narsapur, Medak, Andhra
Pradesh, India (e-mail: bhoopal_veni@yahoo.co.in).
1.0 Introduction :
Load flow solution is a solution of the network
under steady state condition subject to certain
inequality constraints under which the system
operates. The load flow solution gives the
nodal voltages and phase angles and hence
the power injection at all the buses and
power flows through interconnecting power
channels. Load flow solution is essential for
designing a new power system and for
planning extension of the existing one for
increased load demand.
1.1 Development of load flow equation :
It can be seen that the load flow equations are
nonlinear and they can be solved by an iterative
method.
1.2 Newton Raphson Method :
This method is used to solve the load flow
eqns as given in the above. The use of the
polar Newton Raphson method certainly
simplifies the calculation and results in
smaller computation time.
These eqn’s after linearization can be rewritten
in matrix form as:
 ∆P   J 1 J 2  ∆δ 
∆Q  =  J 3 J 4  ∆V 
    
It is well known that a small change in phase
angle changes the flow of active power
and does not affect much the flow
of reactive power. Similarly a small change in
nodal voltage affects the flow of reactive
power where as active power practically
does not change. Keeping these facts in
mind, the set of linear load flow equation
given in eqn (1.12) can be written as follows
: neural networks. A tremendous growth in the
∆P  J 1 0  ∆δ 
∆Q  =  0 J 4
 
    ∆V 
Here J1 corresponds to the elements ∂P / ∂ δ
which exist.
J2 corresponds to the elements ∂P / ∂|V| which
do not exist and, therefore, are zero.
J3 Corresponds to the elements ∂Q / ∂ δ which
do not exist and, therefore, are zero.
J4 corresponds to the elements ∂Q / ∂|V| which
exist.
NEURAL NET WORKS
2.1 BACK GROUND :
The development of artificial
neural networks (ANNs) began approximately
50 years ago (Mc Cullach and Pitts, 1943),
inspired by a desire to understand the human
brain and emulate its functioning. Within the
last decade it has experienced a huge
resurgence due to the development of more
sophisticated algorithms and emergence of
powerful computation tools.
Extensive research has been
deviated to investigating the potential of
artificial neural networks as computational
tools that acquire, represent and compute
mapping from one multivariate input space to
another (Wassernabm 1989). The ability to
identify a relationship from given patterns
make it possible for ANNs to solve large-scale
complex problems such as pattern recognition,
nonlinear modeling, classification, association
and control.
Although the idea of ANNs was
proposed by McCulloch and Pitts (1943)
over fifty years ago, the development of
ANN techniques has experienced a renaissance
only in the last decade due to Hopfield’s effort
(Hopfield, 1982) in iterative auto association
interest of this computational mechanism has
occurred since Rumelthart et al (1986)
rediscovered a mathematically rigorous
theoretical framework for neural networks, i.e.
back propagation algorithm. Consequently,
ANNs have found application in such diverse
areas as neurophysiology, physics, biomedical
engineering, electrical engineering, computer
science, acoustics, cybernetics, robotics, image
processing, financing and others.
2.2 Introduction to Artificial Neural
Network :
ANN is a massively parallel-
distributed information processing system that
has certain performance characteristics
resembling biological neural networks of the
human brain (haykin, 1994). ANNs have been
developed as a generalization of mathematical
models of human cognition (or) neural biology.
Their development is based on the rules that :
1). Information processing occurs at many
single elements called nodes also referred as
units, cells or neurons,
2). Signals are passed between nodes through
connection links.
3). Each connection link has an associated
weight that represents its connection strength.
4). Each node typically applies a nonlinear
transformation called activation function to its
net input to determine its output signal.
A neural network is characterized by its
architecture that represents the pattern of
connection between nodes, its method of
determining the connection weights and the
activation function. A typical ANN consists of
a number of nodes that are organized according
to a particular arrangement. One-way of
Classifying neural networks is by the number
of layers: Single, bi-layer and multi-layer (most
back propagation networks).
ANNs can also be categorized
based on the direction of information flow and
processing. In a feed forward network, the
nodes are generally arranged in layers, starting
from a first input layer and ending at the final
output layer. There can be several hidden
layers with each layer having one (or) more
nodes. Information passes from the input to
the output side. The nodes in one layer are
connected to those in the next but not to those
in the same layer. Thus, the output of a node in
a layer is only a dependent on the inputs it
receives from previous layers and the
corresponding weights. On the other hand, in a
recurrent ANN, information flows through the
nodes in both directions from the input to the
output side and vice – versa. This is generally
achieved by recycling previous network
outputs as current inputs, thus allowing- for
feedback. Sometimes, lateral connections are
used where nodes within a layer are also
connected.
In most networks, the input layer
receives the input variables for the problem at
hand. This consists of all quantifies that can
influence the output. The input layers thus
transparent and is a means of providing
information to the network. The output layer
consists of values predicated by the network
and thus represents model output. The number
of hidden layers and the numbers of nodes in
each hidden layer are usually determined by a
trial and error procedure. The nodes within
neighboring layers of the network are fully
connected by links. Fig 2.1 shows the
configuration of a feed forward three layer
ANN. These kinds of ANNs can be used in a
wide variety of problems, such as storing and
realling data, classifying patterns, performing
general mapping from input pattern to output
pattern, grouping similar patterns or finding
solutions to constrained optimization problems.
In this figure X is a system input vector
composed of a number of causal variables that
influence system behavior, Y is the system
output vector composed of a number of
resulting variables that represents the system
behavior. Out
Hidde
Input put
n
Ntw Layer laye
Layer
rk r
Inpu
t Netw
X ork
Outp
ut
Y
Fig 2.1: The configuration of a feed
forward three layer ANN.
2.3 Mathematical Aspects: -
A schematic diagram of a
typical Jth node is shown in fig.2.2. The inputs
to such a node may come from system causal
variables (or) outputs of other nodes depending
on the layer that the node is located in. these
inputs form an input vector X=(x1,…xi…xn).
The sequence of weights leading to the node
form a weight vector Wj = (wij…wij…wnj).
Where wij represents the connection weight
from the ith node in the preceding layer to jth
node.
The output of node j, yj is
obtained by computing the value of function
with respect to the inner product of vector X
and w1 minus bj. Where b is the threshold
value, also called the bias, associated with this
node. In ANN, the bias bj of the node must be
exceeded before it can be activated. The
following equation defines the operation.
yj = f(X. Wj – bj) -------------- (2.1)
X b
1 W j ANN are adapted through a continuous process
1j
X Y
i
W f j
ij
X W
n nj
Fig.2.2: A Schematic
diagram of node j
The function f is called an activation function.
Its functional form determines the response of
a node to the total input signal it receives. The
most commonly used form of f(.) in eqn (2.1)
is sigmoid function given as.
f(t) = 1/1+e-net ------------(2.2)
The sigmoid function is a
bounded, monotonic, non decreasing function
that provides a graded, nonlinear response.
This function enables a network to map any
nonlinear process. The popularity of the
sigmoid function is partially attributed to the
simplicity of its derivative that will be used
during training process. Some researchers also
employ bipolar sigmoid and hyperbolic tangent
as activation functions-both of which are
transformed from the sigmoid function. A
number of such nodes are organized to form a
artificial neural network.
2.4 Network Training :
In order for an ANN to generate
an output vector Y = (y1,y2,…..yp) that is as
close as possible to the target vector T = (t1,y2,
……tp), a training process, also called
learning, is employed to find optimal weight
matrices W and bias vectors V, that minimize a
predetermined error function that usually has
the form.
E = Σ Σ (Yi – ti) ------------(2.3)
Here ti is component of desired output
T, Yi is the corresponding ANN output, p is the
number of the output nodes and P is the
number of training patterns. Training is a
process by which the connection weights of an
of stimulation by the environment in which the
network is embedded. There are primarily two
types of training supervised and unsupervised.
A supervised training algorithm requires an
external teacher to guide the training process.
This typically implies that a large number of
examples (or) patterns of inputs and outputs are
required for training. The inputs are cause
variables of a system and the outputs are the
effect variables. This training procedure
involves the iterative adjustment and
optimization of connection weights and
threshold values for each of nodes.
The primary goal of training is to
minimize the error function by searching for a
set of connection strengths and threshold
values that cause the ANN to produce outputs
that are equal (or) close to targets. After
training has been accomplished, it is hoped that
the ANN is then capable of generating
reasonable results given new inputs. In
contrast, an unsupervised training algorithm
does not involve a teacher. During training,
only an input data set is provided to the ANN
that automatically adapts its connection
weights to cluster those input patterns into
classes with similar properties.
2.5 Back – Propagation :
Back – propagation is perhaps
the most popular algorithm for training ANNs.
It is essentially a gradient descent technique
that minimizes the network error function- equ
(2.3). Each
input pattern of the training data set is passed
through the network from the input layer to the
output layer. The network output is compared
to desired target output, and an error is
computed based on equ (2.3). This error is
propagated backward through the network to
each node and correspondingly the connection
weights are adjusted based on equation :
∂E
∆Wij (n) = −ε + α∆Wij ( n − 1)
∂Wij
-------(2.4)
Where ∆ Wij(n) and ∆ Wij(n-1)
are weight increments between node I
and j during the nth and (n-1)th epoch. A similar
equation is written for connection of bias
values. In eqn (2.4), and are called learning
rate and momentum, respectively. The
momentum factor can speed up training in very
flat regions of the error surface and help
prevent oscillations in the weights. A learning
rate is used to increase the chance of avoiding
the training processes being trapped in local
minima instead of global minima. The back
propagation algorithm involves two-steps. The
first step is a forward pass, in which the effect
of the input is passed forward through the
network to reach the output layer. After the
error is computed, a second step starts
backward through the network. The errors at
the output layer are propagated back towards
the input layer with the weights being modified
according to equ (2.4).
Back- Propagation is a first
order method based on steepest gradient
descent, with the direction vector being set
equal to the negative of the gradient vector.
Consequently, the solution often follows a
zigzag path while trying to reach a minimum
error position, which may slow down the
training process. It is also possible, which may
slow down the training process. It is also
possible for the training process to be trapped
to be trapped in the local minimum despite the
use of a learning rate.
3. Artificial Neural Networks
3.1 Back Ground:
Artificial Neural
Networks represent the promising new
generation of information processing networks.
Advances have been made in applying such
systems for problems that have been found to
be difficult for traditional computation.
Artificial Neural Networks have widely
been used in electric power engineering. For
energy management, Artificial Neural
Networks have solved the load-flow and
optimal power flow problems.
However most existing Artificial
Neural Networks for electric power
applications have been designed using real
numbers. In power engineering, application
such as load-flow analysis, phasor evaluation,
signal processing and image processing mainly
involve complex numbers.
Although conventional Artificial Neural
Networks are able to deal with complex
numbers by treating the real and imaginary
parts independently, it will show in this paper
that their behavior is not so satisfactory.
A new approach is introduced in this
paper where a computational Artificial Neural
Networks, particularly designed for
manipulation of complex number in electric
power systems.
It will be shown that this new ‘complex
‘Artificial Neural Network has a superior
performance on operations and computations
and computations of complex numbers as
compared with the conventional ‘real’
counterparts. The complex Artificial Neural
Network is implemented to estimate bus
voltages in a load-flow problem.
3.2 Conventional ANN for real numbers:
Fig 3.1 shows a typical
Artificial Neural Network for real numbers
where there are n number of input nodes , in
number of hidden nodes and one number of
output node: 3 layers in total. Ofcourse, this
network is freely extensible to any number of
layers. All values of x and w in the Network
are real numbers and all outputs ‘0’ are real
numbers within an interval [0,1].
The pre-subscript of
each w indicates the layer to which that w
belongs. A set of desirable outputs, dk for
k=1,2,……l, corresponding to a set of inputs,
xj ,j=1,2,….n, is used as a training set. The 4.1 LOAD FLOW SOLUTION:
standard sigmoid function is employed and the 4.1.1 GENERATION OF TRAINING
following equations hold. PATERNS:
1 Power at load buses is varied
Ok = k = 1,2,...l
 m  over a range of 0.05 to 0.10 keeping the power
1 + exp − ∑ Wki hi  of the other buses constant. The training
 i =1  patterns are generated by using load flow
program for each combination of loads. The
1 inputs to the ANN are real and reactive powers
hi = i = 1,2,...m
 n  of load buses.
1 + exp − ∑Wij xi 
 j =1 
For each training bus are taken to be having 2
inputs which are voltage magnitude and phase
---------(3.1)
angle. Similarly for the outputs. The training
patterns for this case are taken as 57 pairs and
desired error is 0.1 and learning rate is 0.02 is
selected.
The following energy function E is being
4.1.2 TRAINING THE NEUTRAL
NETWORK:
minimized:
There is no fixed method of
choosing the number of hidden nodes. The
1 l
E= ∑ [ ok − d k ] 2 number of hidden nodes is randomly chosen
2 k =1 ----------(3.2) and various values are tried till satisfactory
results are obtained. Two types of training have
3.3 New Artificial Neural Networks for been employed; the first one is done by using
real ANN.
Complex Numbers:
In this paper (IEEE-14 bus) the trained buses
Fig 3.2a shows the basic are 4, 9, 11, 12, 13 and the tested buses are 5,
elements of the newly designed Artificial 10 and 14. The number of inputs is 10, hidden
Neural Networks for complex numbers. For the nodes are taken as 2 and the number of outputs
operation of a basic function, say z=wx, where is 10.
x is the input complex number, w is the
weighting and z is the output complex number, The algorithm for training the neural
Zr + jzi = (wr + jwi)(xr + jxi)= (wrxr – wixi) + network is as follows:
1. Apply the input vector to the input
j(wixr – wrxi) ---------(3.3) units.
2. Calculate the net input values to the
where j = √-1 hidden layer units Netjh =
Σ Whjixi + θ jh for I =
For the addition of two complex 1,2,………….n. Where Wji is
numbers. x1 and x2, the operation is clearly connection weight and θ jh is bias
shown . These basic elements form the value.
foundation of the newly designed ANN for 3. Calculate the outputs from the hidden
complex numbers developed in this paper. layers:
4. Ij = fjh (netjh)
 5. Move to the output layer. calculate the the conventional real ANN is better in the
net input values to each unit. following aspects.
6. Netko = Σ WkjIi + θ ko It seems that there is an
7. Calculate the outputs: improved ability to evaluate cases not falling
8. Ok = fko(netko) within the training zone. Finally, the sigmoid
9. Calculate the error terms for the output function employed in our ANN automatically
units: handles the whole complex space with an
10. δ ko = (yk-ok)fko(netko) absolute magnitude smaller than or equal to
11. Calculate the error terms for the hidden one.
terms: The time taken for conducting
12. δ jh=fhj(nethj)Σ δ kowokj load-flow study using ANN is less than that
13. Notice that the error terms on the required by Newton-raphson method, the
hidden units are calculated before the occurancy of the result being almost the
connection weights to input layer units same. Hence it can be concluded that a load-
have been updated. flow study using ANN is particularly suitable
14. Update weights on the input layer: for real time applications.
Wkj (t+1) = Wkjo(t) + η δ ko ij
o REFERENCES
1) Update weights on the
hidden layer: 1. Neural Networks Algorithms
Whji = Whji(t) + η δ jh xi Applications and Programming
Techniques by James. A. Freeman
Comparison of computation voltages for and David.M.Skapura.
ANN and NR
2. NGUYEN, T.T. ; Neural Networks
Load-flow, IEE proc., Gener, Transm.
S. Bus NR ANN Error
Distrib., 1995.
N Voltag voltage voltage
o e
1 V5 1.0060 - 1.0000 - 3.8400e- 3. W.L.Chan, A.T. PSo L.L.Lai; Initial
j0.1557 j0.1881 004 Application of complex
2 V10 1.0114 - 1.0000 - 2.5000e- Artificial Neural Networks to Load –
j0.2747 j0.2883 004 flow Analysis, IEE Proc.
3 V14 0.9924 - 1.0000 - -1.2900e- Gener., Transm.Distrib., Nov 2000.
j0.2867 j0.2814 004
4. Power System Control and Stability
by P.M. Anderson and A.A.Foud.
For the evaluation of computation time, the 5. Computer Methods in power ‘system
MATLAB commands TIC and TOC are used. Analysis by Stagg and El-Abiad.
6. Modern Power System Analysis by
CONCLUSION I.J.Nagrath and D.P.Kothari.
In this work Load-flow is 7. Electrical Power System by C.L.
conducted on typical IEEE 14 bus system and Wadhwa.
different load patterns are obtained. This load- 8. MATLAB Version 5.1 Copyright
flow study is made using a load flow program 198497 The Mathworks.
developed in this work using Newton-Raphson 9. Neural Networks Toolbox Version
method. By using these patterns the voltage at 2.0 02-Jan-97.
a particular busbar is estimated using two 10. Document By
trained ANNs. From this it is concluded that 11. SANTOSH BHARADWAJ REDDY
12. Email: help@matlabcodes.com
13. Engineeringpapers.blo
gspot.com
14. More Papers and
Presentations available on
above site