Professional Documents
Culture Documents
1 Multi-Agent System For Distributed Management of Microgrids
1 Multi-Agent System For Distributed Management of Microgrids
Abstract—In market operations, distributed generators (DGs) to supply reliable electricity and reduce energy prices. In addi-
and price-sensitive loads participate in a microgrid energy market tion, microgrids are expected to improve power quality, reduce
implemented in JADE. Each DG and each price-sensitive load transmission losses, provide system reliability and enable inte-
is represented by the respective agents which perform various
functions such as scheduling, coordination and market clearing gration of DGs and renewable sources [7]. An IEEE standard [8]
subject to system, DG and load constraints. Each agent is as- was also established which provides a set of guidelines for in-
signed to one of the several agent objectives which maximizes terconnection of distributed energy resources (DERs). Further-
either DG or load surpluses or both. In simulated operation of more, microgrids have the capability to operate in either grid
a microgrid, hourly power reference signals and load control connected or islanded mode. In grid connected mode, micro-
signals from JADE are passed to DG and load models developed
in MATLAB/Simulink using MACSimJX. Simulated operation grids aim at satisfying demand through local generation. Excess
of DGs and loads are studied by performing simulations under or deficit power in a microgrid can be absorbed or supplied by
different agent objectives. Results from simulation studies demon- the grid respectively. In islanded mode, power balance within
strate the effectiveness of implementing multi-agent system (MAS) the microgrid must be observed between generation and demand
in the distributed management of microgrids. in order to maintain system frequency and stability.
Index Terms—Deregulated energy market, distributed genera- Market operations and distribution networks become increas-
tion, JADE, MACSimJX, microgrid, multi-agent system. ingly complex as the power industry moves towards decen-
tralization [9]. The presence of DERs at distribution voltage
level will inevitably change the way power flows within the
I. INTRODUCTION network causing it to change from a passive to an active one.
Consequently, centralized supervisory control and data acqui-
sition (SCADA) which was originally designed for traditional
T HE general trend of distributed generator (DG) installa-
tions at distribution voltage level coupled with advances
in communication and control, increased environmental aware-
passive networks may be inadequate to cope with the high pen-
etration of DERs and complex control decisions due to the lack
of flexibility and extensibility [10]. Moreover, assumptions ap-
ness and escalating fuel prices have generated a significant in-
plied to conventional power systems may not be valid for active
terest in the research of microgrids [1]. High penetration of DG
distributed systems which raise challenges in the operation of
technologies such as diesel engines, combined cooling heat and
microgrids [11].
power generating units (CCHPs), microturbines (MTs), photo-
Main issues regarding integration of DERs are also high-
voltaics (PVs), wind turbines (WTs) and fuel cells have trans-
lighted in [12]–[14] which primarily include 1) the need for
formed regulated power generation into restructured entities [2].
scheduling and dispatch of DGs under supply and demand
As a result, integration of DGs has become an important aspect
uncertainties, 2) design of new market models that enables
for successful operation of microgrids among other operational
competitive participation within a microgrid, 3) development of
and technical challenges faced [3], [4].
market and control mechanisms which exhibits plug-and-play
The concept of microgrids [5], [6] basically involves DGs,
for seamless integration of DERs, 4) cooperation and control
renewable energy sources, clusters of controllable loads and en-
which are distributed and realized with minimal information
ergy storage systems (ESSs) operating in a coordinated manner
exchange with the central controller and finally, 5) communi-
cation networks which are based on standard components such
as TCP/IP protocol. Most of these issues can be addressed by
Manuscript received March 14, 2013; revised July 10, 2013, November 07,
2013, and March 26, 2014; accepted April 29, 2014. This work was supported providing an agent platform with a common communication
by the Singapore National Research Foundation under its Campus for Research interface in the distributed system [15].
Excellence and Technological Enterprise (CREATE) programme, Cambridge
MAS has been widely proposed as a feasible approach for
Centre for Carbon Reduction in Chemical Technology (C4T) and Cambridge
Centre for Advanced Research in Energy Efficiency in Singapore (CARES) Ltd. managing complex distributed systems [16]. The extension of
Paper no. TPWRS-00309-2013. MAS into microgrid applications is also evident in [17]–[19]
Y. S. Foo. Eddy and H. B. Gooi are with the School of Electrical and
where various research activities ranging from agent based
Electronic Engineering, Nanyang Technological University, Singapore 639798
(e-mail: fooy0027@ntu.edu.sg; ehbgooi@ntu.edu.sg). market operation, fault protection schemes and distributed
S. X. Chen is with DNV GL Energy (formerly KEMA), Singapore 118227 energy management systems to real time implementations.
(e-mail: nosper@pmail.ntu.edu.sg).
In addition, proposed guidelines and requirements on the use
Color versions of one or more of the figures in this paper are available online
at http://ieeexplore.ieee.org. and applications of MAS in power systems are discussed in
Digital Object Identifier 10.1109/TPWRS.2014.2322622 detail [20], [21]. Key motivation for proposing MAS in power
0885-8950 © 2014 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
TABLE I
MICROGRID NETWORK PARAMETERS
TABLE III
BIDDING RATES ( , IN $/MWh/MW) OVER 24-H PERIOD
Fig. 12. DG 1 profits with different agent objectives over a study day.
Fig. 9. Simulated load scheduling and system losses.
TABLE IV
DISTRIBUTED GENERATORS REVENUE AND PROFIT OVER 24-H PERIOD
TABLE V
LOAD ENERGY COSTS AND SAVINGS OVER 24-H PERIOD
of $0.82 over the 24-h period which is due to a higher gener- TABLE VI
ation cost compared to the revenue collected. RESULTS OF DG AND LOAD FOR 14-BUS SYSTEM OVER 24-H PERIOD
Table V shows the load costs and savings for each load agent
under different agent objectives. It is observed that load agents
assigned to maximizing the DG and load surpluses yield op-
timal savings. In addition, load savings are significantly higher
when load agents are assigned the optimization objectives com-
pared to base objective. Load 3 has negative savings under the
base objective indicating that the amount payable by Load 3 is
higher than the load cost. Since Load 1 reports the highest sav-
ings under the base objective, the total load savings for the mi-
crogrid remains positive despite negative savings from Load 3.
From the results in Tables IV and V, it is evident that maxi-
mizing both DG and load surplus objective provide optimal ben-
efits to both the DGs and the loads and is not biased to either
side. Similar trends are also observed for each hour during the
study day. During each hourly interval, DG and Demand Agents
coordinate and trade according to assigned agent objectives. At
the end of each trading session, the UG Agent maintains power
balance by accepting all sale requests from DG agents having
excess generation and accepting all purchase requests from De-
mand Agents having unsatisfied load. This shows the effective-
ness of agents in handling various conditions.
TABLE VII [4] K. T. Tan, P. L. So, Y. C. Chu, and M. Z. Q. Chen, “Coordinated control
MARKET RESULTS FOR 14-BUS SYSTEM OVER 24-H PERIOD and energy management of distributed generation inverters in a micro-
grid,” IEEE Trans. Power Del., vol. 28, pp. 704–713, 2013.
[5] N. Hatziargyriou, H. Asano, R. Iravani, and C. Marnay, “Microgrids,”
IEEE Power Energy Mag., vol. 5, pp. 78–94, 2007.
[6] R. H. Lasseter, A. Akhil, C. Marnay, J. Stephens, J. Dagle, R. Gut-
tromson, A. Meliopoulous, R. Yinger, and J. Eto, U.S. Department of
Energy, “The CERTS microgrid concept,” in White Paper for Trans-
mission Reliability Program Office of Power Technologies, 2002.
[7] F. Katiraei, R. Iravani, N. Hatziargyriou, and A. Dimeas, “Microgrids
management,” IEEE Power Energy Mag., vol. 6, pp. 54–65, 2008.
[8] IEEE Standard for Interconnecting Distributed Resources With Elec-
tric Power Syst., IEEE Std. 1547, 2003, reaffirmed 2008.
[9] M. K. Kouluri and R. K. Pandey, “Intelligent agent based micro grid
control,” in Proc. 2011 2nd Int. Conf. Intelligent Agent and Multi-Agent
Systems (IAMA), 2011, pp. 62–66.
[10] J. Zeng, J. Wu, J.-F. Liu, L.-M. Gao, and M. Li, “An agent-based ap-
proach to renewable energy management in eco-building,” in Proc.
IEEE Int. Conf. Sustainable Energy Technologies, 2008 (ICSET 2008),
2008, pp. 46–50.
[11] M. D. Ilić and S. X. Liu, Hierarchical Power Systems Control: Its Value
in a Changing Industry (Advances in Industrial Control). New York,
NY, USA: Springer, 1996.
[12] P. Dondi, D. Bayoumi, C. Haederli, D. Julian, and M. Suter, “Network
did not participate in the market operation during the 24-h pe- integration of distributed power generation,” J. Power Sources, vol.
106, pp. 1–9, 2002.
riod. From Table VII, when compared to the base objective, it [13] J. A. P. Lopes, N. Hatziargyriou, J. Mutale, P. Djapic, and N. Jenkins,
is observed that DGs yield higher profits and loads have higher “Integrating distributed generation into electric power systems: A
savings. They follow the same trend as those of the 7-bus mi- review of drivers, challenges and opportunities,” Electr. Power Syst.
Res., vol. 77, pp. 1189–1203, 2007.
crogrid system. [14] K. De Brabandere, K. Vanthournout, J. Driesen, G. Deconinck, and
R. Belmans, “Control of microgrids,” in Proc. IEEE Power Eng. Soc.
VI. CONCLUSION General Meeting, 2007, 2007, pp. 1–7.
[15] P. Piagi and R. H. Lasseter, “Autonomous control of microgrids,” in
This paper presents a MAS approach for distributed manage- Proc. IEEE Power Eng. Soc. General Meeting, 2006, 2006, p. 8.
ment of microgrids. The proposed MAS was developed using [16] M. Wooldridge, “Intelligent agents,” in Multi-Agent Systems, G. Weiss,
Ed. Cambridge, MA, USA: MIT Press, Apr. 1999, pp. 3–51.
IEEE FIPA standards, and market operations were coordinated [17] A. L. Dimeas and N. D. Hatziargyriou, “Operation of a multiagent
with implementation of the microgrid. Simulation studies and system for microgrid control,” IEEE Trans. Power Syst., vol. 20, pp.
results demonstrate the effectiveness of the proposed distributed 1447–1455, 2005.
[18] T. Logenthiran, D. Srinivasan, and A. M. Khambadkone, “Multi-agent
market operation and control technique displaying much po- system for energy resource scheduling of integrated microgrids in a
tential for the autonomous operation of microgrids. It is found distributed system,” Electr. Power Syst. Res., vol. 81, pp. 138–148,
that maximizing the benefit for both energy buyers and sellers 2011.
[19] M. Pipattanasomporn, H. Feroze, and S. Rahman, “Multi-agent sys-
promotes unbiased transactions between them. The proposed tems in a distributed smart grid: Design and implementation,” in Proc.
market structure can be extended to manage a larger network IEEE/PES Power Syst. Conf. and Expo., 2009 (PSCE ’09), 2009, pp.
comprising numerous participants. Furthermore, the proposed 1–8.
[20] S. D. J. McArthur, E. M. Davidson, V. M. Catterson, A. L. Dimeas, N.
approach can be implemented in actual microgrids with minimal D. Hatziargyriou, F. Ponci, and T. Funabashi, “Multi-agent systems for
additional software cost by replacing the Simulink models with power engineering applications part I: Concepts, approaches, technical
the actual microgrid and the communication network interface challenges,” IEEE Trans. Power Syst., vol. 22, pp. 1743–1752, 2007.
[21] S. D. J. McArthur, E. M. Davidson, V. M. Catterson, A. L. Dimeas, N.
between MACSimJX and actual microgrids can be achieved D. Hatziargyriou, F. Ponci, and T. Funabashi, “Multi-agent systems for
through TCP/IP and the necessary SCADA I/O devices. Simula- power engineering applications part II: Technologies, standards, tools
tion studies have shown that the proposed distributed system is for building multi-agent systems,” IEEE Trans. Power Syst., vol. 22,
pp. 1753–1759, 2007.
capable of handling the economical and technical requirements [22] H. S. V. S. Kumar Nunna and S. Doolla, “Multiagent-based distributed-
of microgrids. Coordination of multiple microgrids will be con- energy-resource management for intelligent microgrids,” IEEE Trans.
sidered in the future which will reinforce the research and de- Ind. Electron., vol. 60, pp. 1678–1687, 2013.
[23] B. Ramachandran, S. K. Srivastava, C. S. Edrington, and D. A. Cartes,
velopment of smart grids. “An intelligent auction scheme for smart grid market using a hybrid im-
mune algorithm,” IEEE Trans. Ind. Electron., vol. 58, pp. 4603–4612,
2011.
REFERENCES [24] C. Yuen, A. Oudalov, and A. Timbus, “The provision of frequency
[1] L. Xuan and S. Bin, “Microgrids—An integration of renewable energy control reserves from multiple microgrids,” IEEE Trans. Ind. Electron.,
technologies,” in Proc. China Int. Conf. Electricity Distribution, 2008 vol. 58, pp. 173–183, 2011.
(CICED 2008), 2008, pp. 1–7. [25] D. P. Bertsekas and D. A. Castanon, “A forward/reverse auction al-
[2] A. G. Tsikalakis and N. D. Hatziargyriou, “Centralized control for op- gorithm for asymmetric assignment problems,” Comput. Optim. Appl.,
timizing microgrids operation,” IEEE Trans. Energy Convers., vol. 23, vol. 1, pp. 277–297, Dec. 1992.
pp. 241–248, 2008. [26] Java Agent Development Framework (JADE) [Online]. Available:
[3] M. A. Lopez, S. Martin, J. A. Aguado, and S. de la Torre, “Market- http://jade.tilab.com/
oriented operation in microGrids using multi-agent systems,” in Proc. [27] C. R. Robinson, P. Mendham, and T. Clarke, “MACSimJX: A tool for
2011 Int. Conf. Power Eng., Energy and Electr. Drives (POWERENG), enabling agent modelling with Simulink using JADE,” J. Phys. Agents,
2011, pp. 1–6. vol. 4, no. 3, 2010.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
[28] FIPA, The Foundation for Intelligent Physical Agents Standard [On- Y. S. Foo. Eddy (S’09) received the B.Eng. degree in
line]. Available: http:/www.fipa.org/ electrical and electronic engineering from Nanyang
[29] D. Gautam and N. Mithulananthan, “Optimal DG placement in Technological University, Singapore, in 2009, where
deregulated electricity market,” Electr. Power Syst. Res., vol. 77, pp. he is currently pursuing the Ph.D. degree in the Lab-
1627–1636, 2007. oratory for Clean Energy Research, School of Elec-
[30] R. Treinen, Locational Marginal Pricing (LMP): Basics of Nodal trical and Electronic Engineering.
Price Calculation [Online]. Available: http://www.caiso.com/docs/ His research interests are multi-agent systems, mi-
2004/02/13/200402131607358643.pdf crogrid energy management systems, electricity mar-
[31] D. Phillips, Nodal Pricing Basics [Online]. Available: http://www. kets, and renewable energy resources.
ieso.ca/imoweb/pubs/consult/mep/LMP_NodalBasics_2004jan14.pdf
[32] C. Marnay and G. Venkataramanan, “Microgrids in the evolving
electricity generation and delivery infrastructure,” in Proc. 2006 IEEE
Power Eng. Soc. General Meeting, 2006, p. 5.
[33] M. Ilic-Spong, J. Christensen, and K. L. Eichorn, “Secondary voltage
control using pilot point information,” IEEE Trans. Power Syst., vol. H. B. Gooi (SM’95) received the B.S. degree from
3, pp. 660–668, 1988. National Taiwan University, Taipei, Taiwan, in
[34] J. M. Guerrero, J. C. Vasquez, J. Matas, L. G. de Vicuna, and M. 1978, the M.S. degree from the University of New
Castilla, “Hierarchical control of droop-controlled AC and DC micro- Brunswick, Fredericton, NB, Canada, in 1980,
grids—A general approach toward standardization,” IEEE Trans. Ind. and the Ph.D. degree from Ohio State University,
Electron., vol. 58, pp. 158–172, 2011. Columbus, OH, USA, in 1983.
[35] Y. A. R. I. Mohamed and A. A. Radwan, “Hierarchical control system From 1983 to 1985, he was an Assistant Pro-
for robust microgrid operation and seamless mode transfer in active fessor with the Electrical Engineering Department,
distribution systems,” IEEE Trans. Smart Grid, vol. 2, pp. 352–362, Lafayette College, Easton, PA, USA. From 1985 to
2011. 1991, he was a Senior Engineer with Empros (now
[36] S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, Siemens), Minneapolis, MN, USA, where he was re-
2nd ed. Upper Saddle River, NJ, USA: Prentice Hall, 2003. sponsible for the design and testing coordination of domestic and international
[37] T. Logenthiran, D. Srinivasan, A. M. Khambadkone, and A. Htay Nwe, energy management system (EMS) projects. In 1991, he joined the School
“Multiagent system for real-time operation of a microgrid in Real-Time of Electrical and Electronic Engineering, Nanyang Technological University,
Digital Simulator,” IEEE Trans. Smart Grid, vol. 3, pp. 925–933, 2012. Singapore, as a Senior Lecturer, where he has been an Associate Professor since
[38] S. Chowdhury, S. P. Chowdhury, and P. Crossley, Microgrids and Ac- 1999. His current research focuses on microgrid EMSs, electricity markets,
tive Distribution Networks. London, U.K.: IET, 2009. spinning reserve, energy efficiency, and renewable energy sources.
[39] A. J. Wood and B. F. Wollenberg, Power Generation Operation & Con-
trol. New York, NY, USA: Wiley, 1984.
[40] S. X. Chen and H. B. Gooi, “Jump and shift method for multi-objec-
tive optimization,” IEEE Trans. Ind. Electron., vol. 58, pp. 4538–4548, S. X. Chen (M’13) received the B.S. dual degree
2011. in power engineering and business administration
[41] Singapore Electricity Price Information [Online]. Available: from Wuhan University, China, the M.S. and Ph.D.
http://www.emcsg.com/marketdata/priceinformation degrees in Power Engineering from Nanyang Tech-
[42] W. Hua, H. Sasaki, J. Kubokawa, and R. Yokoyama, “An interior point nological University (NTU), Singapore, in 2007,
nonlinear programming for optimal power flow problems with a novel 2008, and 2012, respectively.
data structure,” IEEE Trans. Power Syst., vol. 13, pp. 870–877, 1998. From 2012 to 2013, he was a research fellow
of Energy Research Institute at NTU, Singapore.
Currently, he is a consultant working at the Clean
Technology Center in DNV GL Energy (formerly
KEMA). His research interests are smart energy
management systems, energy efficiency, power system operation and planning,
renewable energy sources, and energy storage systems.