See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/332464143

Application of Big Data Analytics pertaining to Power system Security

Conference Paper · April 2019

CITATIONS READS

0 224

2 authors:

R. Thamizhselvan Ramesh Kumar Selvaraju

Annamalai University Annamalai University
8 PUBLICATIONS   0 CITATIONS    5 PUBLICATIONS   27 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Application of Machine learning Algorithms to Power system Security Assessment Problems View project

All content following this page was uploaded by R. Thamizhselvan on 17 April 2019.

The user has requested enhancement of the downloaded file.

International Conference on Communication and Electronics Systems ( ICCES 2018)

Application of Big Data Analytics pertaining

to Power system Security
Thamizhselvan Ramalingam
Assistant Professor (on Deputation)
Department of Electrical Engineering,
Annamalai University
Tamilnadu,India-608002
tamil2012au@gmail.com
Rameshkumar Selvaraju
Assistant Professor (on Deputation)
Department of Electrical Engineering,
Annamalai University
Tamilnadu,India-608002
rameshkumar.au@gmail.com
Karthikeyan Shanmugam
Assistant Professor (on Deputation)
Department of Electrical Engineering,
Annamalai University
Tamilnadu,India-608002
karthikaueee79@gmail.com

Thirunavukkarasu jayaraman Saravanan Manikam

Assistant Professor (on Deputation) Assistant Professor
Department of Electrical Engineering, Department of Electronics and communication Engineering,
Annamalai University Annamalai University
Tamilnadu,India-608002 Tamilnadu,India-608002
arasujkm@yahoo.co.in saravananm180982@gmail.com

Abstract— Today, the power industry is experiencing
tremendous changes both in the scale of power grid and in the
system complexity along with the fast installation of computers
and communication of smart devices. Erection of a smart
power system, Big data analytics has become essential in the
energy industry which gratify an interconnected, distributed
resources, consumption calculation and future prediction. It is
clear that, a huge amount of measurement data including
production, operation, control, trading and consumption are
continuously collected, communicated, and processed in an
amazing speed. Big data is a rising technology which applies to
data sets where data size is too large and common data related
technology tools are hard to generate, manage, and operate
under multiple-limits. Existing Data analysis schemes based on
Conventional methods will not be correlated in space and time,
and it is tough to design a unified and generalized power
system model. In this paper reviews the applications of big data
analytics using machine learning algorithms to indicate
uncertainties in power system within its feature characteristics.
Keywords— Big Data Analytics, Feature selection, Machine
Learning algorithms, Power system Security
I. INTRODUCTION
Based on Big Data Analytics (BDA) and cloud technology,
an integrated architecture can be used in the smart power
system which optimizes power transmission, controlling
power consumption, indicates changes in power demand and
quality in supply, etc [1]. The highlight of smart power
network over standard power system is hold up of two way
communication between the functions that validates the data
exchange between utilities with dynamism. So, the huge
volume of captured data stores automatically under offline
or cloud management [2] via internet is necessary to create
big impact on data knowledge, i.e. referred as 'data storage'.
Within this automated process of BDA, a fast predictive
methodology is necessary to develop a model that can
analyze the system status based on the data knowledge.
These are all main assets in power system analysis while
supporting decision making in control, monitor, protection,
reliability and efficiency of power system operation. it is
clear that, these data's are hardly utilized and predicts
massive insecurity associated with it [3], [4].
Now a days, big data has been attracting increasing
attention from many academicians, industries and
government [5], [6]. ‗Big Data‘ is a term that defines the
huge volume of data that is growing exponentially [7]. The
process of data analytics includes extracting the useful
information from the data by building all possible relations
among various data. This makes big data to appear even
bigger. The volume of data i.e. pronounced as 'Big Data' is
provides too much information to a human data analyst
relevant to any field [8]. Considering of this issue with power
system, the collection of huge data through PMU's in
SCADA and EMS which is really uncomfortable and time-
consuming process. This plight deeply creates an impact to
get insights by correlating the data, crunching information
and understanding patterns of the data, etc [9], [10].
So, Machine Learning (ML) has proposed to training the
models by feeding their datasets and making algorithms can
problem-solving and decision making within BDA
automated process [11]. Along with newer technological
updates like Internet of Things (IoT), big data analytics with
ML based Prediction analysis will be smarter with electric
utilities [12]. Developing a smart big data applications using
IOT, the list of mandatory tools are Hadoop ecosystem,
including Hadoop Distributed File System, Hadoop Map
Reduce, Apache Sqoop, Spark, Hive, Zeppelin, Play
Framework, HTML and web based libraries for visualization
such as Amcharts.js. Sqoop is a tool designed for efficiently
transferring bulk data between relational databases and
Apache Hadoop [13]. Spark provides four main libraries than
can be combined in the same application. SQL and Data
Frames for data manipulation. MLlib for machine learning
algorithms. GraphX for graph computations. Spark
Streaming for streaming workloads. Spark offers developer
API‘s in Java, Python, Scala and R [14]. Apache Hive is a
data warehouse infrastructure that provides data
summarization, querying, and analysis [15]. this paper work
does not have any target to justifies all of the feature
advantages in BDA. it proposes only the effectiveness of
Machine learning based classification and how it helps to
improving the data exchange between the usage of electrical
utilities.

IEEE Xplore ISBN:978-1-5386-4765-3

International Conference on Communication and Electronics Systems ( ICCES 2018)

II. CONCEPT OF BIG DATA resilience, technology adoption, and energy demand
management.
A. Characteristics of Big Data
 Predict equipment failures and power outages,
The main characteristics of big data are volume, velocity, allowing utilities to optimize the level of protection.
veracity, variety and value [7] as shown in Fig. [1]. The  Improve the operating efficiency of electrical
details are generation, transmission, and distribution.
 Integrate intermittent power sources (i.e. renewable)
more efficiently and effectively.
Volume
 Control Engineers and consumers to make better
decisions, based on data and empirical investigation,
Veracity rather than on intuition or past-practice.
Velocity

Big data

Value Variety

Figure 1: Characteristics of Big Data

Volume: The term ‗Big data‘ itself has volume hidden on it.
The required Data is collected from various sources through
online and offline. These huge volume of good quality data
makes the analysis healthier. Sometimes storing and
managing this amount of data becomes difficult.
Velocity: the rate at which the data is generated in the data
base. It deals with determining how fast the data is generated
from various sources through the real world, online and
offline. Figure 2: Features of Big data analytics in Power
Variety: Data is available in many formats like system
numbers,text, images,videos, etc,. These accounts to the C. Sources of Data generation in Big data analytics
variety of data.
Value: Big data analytics enable utilities to derive great In this paper, the objective of PSBDA is to assess the
value from data to support real time operations, strategic very large volumes of data from various components in the
decisions and system planning. smart networks and grids using sensors such as PMU‘s
Veracity: this enables the reliability and quality of data integrated intelligent Power electronic devices as shown in
Fig. 3 and transform these data into meaningful inputs for
B. Concept of Big data Analyticsin Electrical utilities power system security analysis [17]. The outcome of these
Electrical power systems are extremely complex with an learning applications may identify some operating trends
immediate need of matching millions of demand leading to anticipate future failures, and consequently,
requirements with supply [3], [7]. Big Data Analytics and
advanced information technologies hold the promise of
improved system reliability, greater energy efficiency, and
lower costs for consumers.

Big Data Analytics allow the massive amounts of data

generated by electronic sensors, smart grid technologies,
electricity supply, grid operations, and customer demands
have to be coordinated, analyzed, tacit, and effectively
utilized in control centres as shown in Fig. 2. It concludes as
follows [16],

 Develop models and simulations of the electrical grid

and infrastructure to improve their reliability,

IEEE Xplore ISBN:978-1-5386-4765-3

International Conference on Communication and Electronics Systems ( ICCES 2018)
provide timely and accurate insights for predictive analysis.
Figure 3: Sources of Power system data generation in BDA
III. APPLICATION OF MACHINE LEARNING ALGORITHMS FOR
POWER SYSTEM SECURITY
The main aim of use BDA in Power system is to extract
useful information (value) from the data. The field of
Machine Learning provides a ground for scientists to explore
learning models and learning algorithms that can help
machines (e.g., computers) learn the system from data [11].
Feature Training ML
Data
selection process Classifier
Samples
Testing
Classification
with
Classifier
Security
Index
Figure 4: Pattern classification using ML Algorithms
The first step is to generate data set by performing load
flow analysis in real time or repository in a cloud
management. Once the data are collected the next step be
data pre-processing. In this step, the data from various
sources as well as variety of formats and possibly containing
missing or erroneous values are extracted using feature
selection algorithms. The data are then transformed to the
target repository‘s format, after which data are loaded into a
repository in cloud management. Now, some informed
actions or decisions can be made through training and
testing process in pattern classification thus pertaining
system security as shown in Fig. 4.
A. Support Vector Machine
In this paper, the design of pattern classification was
based on Support Vector Machine (SVM). SVM performs
the task of classification by first mapping the input data to a
multidimensional feature space and then constructing an
optimal hyper plane classifier separating the two classes
with maximum margin. SVM performs minimization of
error function by an iterative training algorithm to construct
an optimal hyper plane [18].
Consider a training set T = {xi, yi}, where xi is a real
valued n-dimensional input vector and yi ∈ {+1,−1} is a label
that determines the class of data instance, xi. The SVMs are
employed for such two class problems. The optimal hyper
plane (line between two classes) is determined by an
orthogonal vector (w) and a bias (b). The points closest to the
optimal separating hyper plane with the largest margin ρ are
called as Support Vectors (SVs) as shown in Fig. 5. To
construct this optimal separating hyper plane, the SVM
classifier solves the following primal problem described as
an optimization problem.
IEEE Xplore ISBN:978-1-5386-4765-3
Figure 5: The linear separating hyper plane with optimal
margin
1 T 𝑁
Min w, b, ξ w w + C 𝑖=1 𝜉𝑖 (1)
2
Subject to Constraints
yi(wT ϕ(xi ) +b) ≥ 1- ξi; ξi ≥ 0, i = 1, 2… N (2)
In Eq. 1 and Eq. 2, Where w is the weight vector of the hyper
plane, C is the penalty parameter proportional to the amount
of the constraint violation, ξi is the slack variable, ϕ (.) is a
mapping function called ‗kernel‘ function and b is the
threshold. The kernel function maps data in input space to
feature space where they are linearly separable [19], [20].
B. Feature Selection Process
All the variables portray the power system network
may not contain useful information in classification. Thus,
reducing is the unwanted variables from the dataset which
improves classifier performance [21]. The F-value feature
selection is used as the criterion function for selection of a
variable as feature as given in Eq. 3.
𝑚 𝑠 −𝑚 𝑖
F= (3)
𝜎𝑠2 +𝜎𝑖2
Where, ms - Mean of the variable in the secure class; mi-
Mean of the variable in the insecure class; 𝜎𝑠2 - Variance of
the variable in the secure class; 𝜎𝑖2 - Variance of the variable
in the insecure class.
The selection of features begins with the computation
of F-values for all components (variables) of pattern vector
in the training set. The variable with the largest F value is
selected as the first feature. Let this variable be z1. When
selecting other features, redundant information is omitted by
discarding these variables which are correlated to z1, i.e.
those variables having a correlation coefficient greater than
0.8 [22].
IV. RESULTS AND DISCUSSION
The proposed SVM based classification has been
implemented on IEEE 118 bus power system [23] which is
considered as smart network for BDA.
A. Data set Generation in real time
The Process of data set generation has been initiated at
any appropriate time period chosen in Energy Management
Systems (EMS) or control centres, it can be seen that the
fluctuations in generation and load have been accounted up
to ± 30%. The threshold setting of security limit for bus
voltages in entire network was taken as 0.90 to 1.10 p.u. The
preset MVA limit of transmission lines in this network is
assumed up to 130% of loading [22]. Based on the real time
analysis, The patterns or variables are generated from the
load flow results with presence of normal and line faults
happens one at a time or multiple lines at a time. The details
of data set generation are shown in Table 1.
International Conference on Communication and Electronics Systems ( ICCES 2018)
Table 1 Generation of Data set
Generated Variables Feasible no. of Variables
Vi and δi 118 each
PGi 19
QGi 54
PDi and QDi 99 each
Pi-j , Pj-i , Qi−j , Qj-i , Si-j ,
186 each
Ploss and Qloss
It can be seen that, initially 1001 operating states were
recorded as feasible input variables, later 410 input variables
were selected from 1001 variables due to implementation of
F-value feature selection. Here, both the set of input
variables has been considered for SVM based classification
separately.
For a possible of 1063 cases as operating scenarios
(reputations), 744 operating scenarios are found to be secure
and the remaining 319 cases are found to be insecure.
Further, this data set is randomly split into training and
testing phases.
By adjusting the SVM parameters and different
kernels, The Performance evaluation of SVM classifier in
BDA has been obtained. The results of SVM classifier with
and without Feature selection has been presented in Table 2.
Table 2 performance evaluation of ML classifier
Testing
Performance
Training All With feature
Evaluation
Variables selection
100 92.48
Accuracy (%) 100 (213/213)
(850/850) (197/213)
7.51
Error (%) 0 (0/850) 0 (0/213)
(16/213)
During the testing phase, the classification accuracy of
classifier with FS is 100 %. It is evident that the
performance of SVM classifier is satisfactory. So,
deployment of machine learning models to analyze this data
can help to generate useful information about Power system
security. Following the confrontation, under BDA especially
its Operational and Enterprise analytics will indicate some
features such as asset maintenance, outage management,
distribution optimization, real-time monitoring and
visualization of data in smart power network.
V. CONCLUSION
A unique feature of big data analytics using machine
learning algorithms for power system security. The smart
network includes generation units, transmission lines and
distribution systems have involved sufficiently to create
powerful data analytics manages system security. By the
combination of these techniques, it is possible to know and
expect load demand, generation volume and system
disturbance, and then regulate the control automatically and
quickly so the grid and other electrical utilities can be
improved and avoid instabilities. In this work, IEEE 118 bus
system has been used to demonstrate for obtaining some of
the key features of big data analytics.
ACKNOWLEDGMENT
IEEE Xplore ISBN:978-1-5386-4765-3
We wish to thank the authorities of Annamalai
University, Annamalainagar and authorities of Deputed
institutions, Tamilnadu, India who has provided the time to
work and prepare this paper.
REFERENCES
[1] V. S. Thiyagarajan, A. Ayyasamy, ―Privacy Preserving Over Big
Data Through VSSFA and MapReduce Framework in Cloud
Environment‖, Wireless Personal Communications, pp. 1-25, 2017.
[2] K. Venkatachalapathy, V. S. Thiyagarajan, A. Ayyasamy and K.
Ranjani, ―Big data with cloud virtualization for effective resource
handling‖, International journal of control theory and applications,
vol. 9, no. 2, pp. 435-444, May 2016.
[3] B. A. Schuelke-Leech, B.Barry, M.Muratori, and B. J., Yurkovich,
―Big Data issues and opportunities for electric utilities‖, Renewable
and Sustainable Energy Reviews ,Vol. 52, pp. 937-947, 2015.
[4] U.S. Department of Energy, ―Smart Grid system report ‖,2009.
[Online]Available:https://www.smartgrid.gov/files/systems_report.p
df, 2009.
[5] J. Shibily and E.A. Jasmin, ― Big Data Analytics for Distribution
System Monitoring in Smart Grid ‖, International Journal of Smart
Home , Vol. 11, No. 5, pp. 21-32, 2017.
[6] L.Hua, Z. Junguo and L.Fantao, ―Internet of things technology and
its applications in smart grid‖, Indonesian Journal of Electrical
Engineering and Computer Science, Vol.12, No.2, pp. 940-946,
2014.
[7] P.Zikopoulos and C. Eaton,―Understanding big data: Analytics for
enterprise class hadoop and streaming data‖, McGraw-Hill Osborne
Media, 2011.
[8] E. Giglioli, C. Panzacchi and L. Senni, ―How Europe is approaching
the smart grid‖, McKinsey & Company, 2010.
[9] A. Faruqui, S. Sergici and A.Sharif, ―The impact of informational
feedback on energy consumption—A survey of the experimental
evidence‖, Energy, Vol. 35, No. 4, pp. 1598-1608, 2010.
[10] M.Hassanalieragh, A. Page, T. Soyata, G. Sharma, G. Mateos, and
S. Andreescu, ―Health monitoring and management using Internet-
of-Things (IoT) sensing with cloud-based processing: Opportunities
and challenges‖, IEEE international conference on services
computing (SCC) , pp. 285-292, 2015.
[11] T. G. Dietterich, ―Machine-learning research: Four current
directions,‖ AI Magazine, vol. 18, no. 4, pp. 97–136, 1997.
[12] F. Xia, L.T. Yang, L.Wang, and A.Vinel, ―Internet of
things‖, International Journal of Communication Systems, Vol.25,
No.9, pp. 1101-1102, 2012.
[13] The Apache Software Foundation, ―Apache Spark: Lightning-fast
cluster computing‖ 2016, [Online]. Available:
http://spark.apache.org/.
[14] The Apache Software Foundation, ―APACHE HIVE TM‖ The
Apache Software Foundation‖, 2014. [Online]. Available:
https://hive.apache.org.
[15] The Apache Software Foundation, ―Apache Sqoop,‖
The Apache Software Foundation, Online]. Available:
http://sqoop.apache.org/, 2016.
[16] H.Jiang, K.Wang, Y. Wang, M. Gao ,and Y. Zhang, ―Energy Big
Data: A Survey, , Special Section On Theoretical Foundations For
Big Data Applications: Challenges And Opportunities‖, IEEE
Access, Vol. 4, 2016.
[17] C.C. Chang and C. J. Lin, ―LIBSVM: a Library for Support Vector
Machines‖, 2001. (Software Available at
http://www.csie.ntu.edu.tw/~cjlin/libsvm.)
[18] N. Christianini, J. Shawe-Taylor, ―An Introduction to Support
Vector Machines and Other Kernel-based Learning Methods‖, MIT
Press, Cambridge, 2000.
[19] R. Herbrich, ―Learning Kernel Classifiers: Theory and Algorithms‖,
MIT Press, 2001.
[20] J.Min, and Y. Lee, ―Bankruptcy Prediction Using Support Vector
Machine with Optimal Choice of Kernel Function Parameter‖,
Expert Systems with Applications, Vol. 28(4), pp. 603–614, 2005.
[21] M.Dash, and H.Liu, ―Feature Selection for Classification, Intelligent
data analysis, Vol.1 (3), pp.131-156,1997.
International Conference on Communication and Electronics Systems ( ICCES 2018)

[22] C.K. Pang, A.J. Koivo, and A.H. El-Abiad. ―Application of Pattern
Recognition to Steady-State Security Evaluation in a Power
System‖, IEEE Transactions on Systems, Man and Cybernetics, Vol.
3, No. 6, pp. 622– 631,1973.
[23] http://www.ee.washington.edu/research/pstca (Power System Test
Case Archive), 1996.

IEEE Xplore ISBN:978-1-5386-4765-3

View publication stats