Professional Documents
Culture Documents
AbstractThis paper proposes a multiagent-based optimal during an outage, a microgrid can be isolated from the host
microgrid control scheme using a fully distributed diffusion grid and should be able to continue operation in standalone
strategy. A two-level cooperative optimization multiagent system mode with indeterminate broken communication links and
is adapted for distributed energy resources economic dispatch.
The lower level implements an adaptive droop scheme based scarce generation resources. In such circumstances, fully dis-
on online no-load frequency adjustments. The upper level tributed adaptive agent discovery methods are more favorable
implements distributed communication using diffusion between than centralized data acquisition methods in order to ensure
neighboring agents for optimal microgrid management. The resiliency.
proposed control scheme enables peer-to-peer communication Due to the low-inertia nature of microgrids, sophisticated
among the agents without the necessity of a centralized con-
troller, and simultaneously performs resource optimization while control systems and optimization methods are required to
regulating the system frequency. The results are compared effectively coordinate stochastic (non-dispatchable) and dis-
with centralized and consensus-based optimization algorithms. patchable distributed energy resources (DER). Thus far, a num-
We have concluded that the proposed algorithm is superior ber of centralized methods have been proposed for optimal
over consensus algorithms in terms of convergence speed and microgrid control. In [7], a model predictive control using sup-
utilizes reduced communication infrastructure compared to cen-
tralized controllers. Simulation demonstrations were conducted port vector machines and mixed integer linear programming
along with experimental results from a hardware-based micro- methods were used for microgrid optimization under time-
grid using an industrial multiagent framework. The simulation varying operational constraints. A genetic algorithm-based
and experimental results show that the proposed method and multi-objective optimization methodology was applied for DC
the agent framework can be deployed in real-world micro- microgrid systems [8]. Another study reported a stochastic
grids and offer superior decision making on optimal microgrid
control. optimal operation of microgrids using chaotic binary particle
swarm optimization [9]. Niching evolutionary algorithm was
Index TermsCooperative control, distributed control, diffu- used for optimal dispatch of DERs and storage systems in
sion strategy, multiagent, microgrid, optimization.
islanded microgrids [10]. An adaptive predictive supervisory
control concept using dynamic stochastic optimization was
proposed to smoothen PV and wind generator intermittent out-
put powers [11]. Resiliency [12], frequency control [13] and
I. I NTRODUCTION
islanding-based optimization [14] methods were reported. An
HE MICROGRID concept has been proposed to stimulate
T renewable energy penetration in existing power systems
by improving reliability and resiliency [1], [2]. The future grid
adjustable droop parameter based optimization was proposed
in [15]. Although centralized optimization methods require
less communicational bandwidth and computational burden,
will be restructured as a cyber-physical system which has they are more susceptible to single point failures, which can
components not only to carry power flow, but also to trans- easily jeopardize the resiliency in case of partial power outages
mit data for advanced distributed control capability [3], [4]. and broken communication links.
Legacy power grid control schemes rely mostly on power- In contrast to centralized controls, the emerging smart
line communications and Ethernet in order to collect and grid concept compels microgrids to adopt distributed coop-
distribute information. However, resiliency requirements call erative methods as a result of the highly dynamic behavior
for a redundant wireless communication architecture that can of microgrids. Distributed control approaches intend to pro-
provide alternative data routes in case of link failures [5], [6]. vide adaptive agent discovery through online peer-to-peer
In both wired and wireless communication infrastructures, communication enabling neighbor negotiations. The imple-
Manuscript received February 16, 2016; revised May 23, 2016; accepted mentation of distributed control is established using multiagent
June 27, 2016. Date of publication July 7, 2016; date of current version systems (MAS), which are composed of intelligent agents
June 19, 2017. This work was supported by grants from the U.S. Department that cooperate to achieve a global or local objective func-
of Energy and the Office of Naval Research. Paper no. TSG-00217-2016.
The authors are with the Energy Systems Research Laboratory, ECE tion. Embedded decision-making algorithms and individual
Department, Florida International University, Miami, FL 33174 USA (e-mail: behaviors facilitate the benefit maximization of the agents.
mohammed@fiu.edu). So far, a large number of microgrid distributed optimiza-
Color versions of one or more of the figures in this paper are available
online at http://ieeexplore.ieee.org. tion methods have been proposed in the literature. In [16],
Digital Object Identifier 10.1109/TSG.2016.2587741 a replicator dynamic theory-based multiagent system was
1949-3053 c 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
1998 IEEE TRANSACTIONS ON SMART GRID, VOL. 8, NO. 4, JULY 2017
TABLE I
D IFFUSION VS . C ONSENSUS C ONVERGENCE C OMPARISON the frequency regulation is also easier due to the increase in
inertia and/or droop support.
B. Optimization Diffusion
The previous diffusion formulation includes a stochastic
gradient in the information sharing (also known as estimation)
problem. However, in optimization diffusion, the marginal
cost functions of the DERs are used instead. First the global
problem is defined:
n
Jglob (w) = Ji (w) (14)
i=1
min Jglob (w) (15)
w
TABLE II
DER C OEFFICIENTS FOR S IMULATION
Fig. 13. Microgrid islanding DER power output and battery energy storage
system state of charge.
Fig. 11. Information sharing performance comparison. and the DERs were operating at their optimum points consid-
ering the constant marginal cost of the utility electric rate.
Initially, the microgrid was exporting power to the external
grid and the energy storage had already reached an equilib-
rium on its state of charge due to the fixed marginal cost. As
shown in Fig. 13, exactly at 2 AM, the PCC of the utility grid
is opened and the power export was terminated. As the lower
level control, the droop controllers act immediately by reduc-
ing the outputs of both DERs and the storage system started
to absorb some amount of the power into the battery system.
Then, as the upper level control, the diffusion strategy takes
over by adjusting the no-load reference points of the DERs.
Fig. 12. Cost optimization comparison (Centralized vs Diffusion). First the secondary response recovers the nominal frequency
after the grid agent drops out of the w vector and the remain-
TABLE III ing DERs need to maintain the net power demand balance.
T OTAL C OST C OMPARISON
Then, the optimization process continues adjusting the assets
to their economic dispatch points according to the changing
net power demand within the microgrid.
Since the net power demand was relatively low at this time,
the marginal cost of the microgrid (optimal point) was also
low (lower than the utility rates). Therefore, as also shown in
Fig. 13, the battery not only absorbs power due to the droop
The optimization of the cost functions are compared ver- controller, but continues to charge until finding a new equi-
sus a centralized solution in Fig. 12. As can be seen, the librium SOC that moves with the net demand. This course of
cost directly corresponds with the net power demand shown in action corresponds to the behavior designed into the energy
Fig. 11. It is also shown how the total cost of the distributed storage cost function as described in Section II-C.
control scheme closely tracks that of the centralized scheme Due to the extra power being generated during the islanding
(which represents the absolute optimum given system-wide event, the frequency of the system rises to 60.3 Hz as shown
conditions and cost knowledge). Table III presents the aggre- in Fig. 14. The primary droop control suppresses the initial
gated costs over a 24-hour period for an islanded microgrid. frequency rise by immediately dropping the power outputs of
The proposed distributed optimization scheme is validated as all dispatchable assets to protect the system from going beyond
the total cost is only 0.11% above the centralized solution. acceptable conditions as seen in the zoomed-in Fig. 14.
To provide some real-world context, the average cost per Once the frequency is suppressed, the secondary control
MWh for this scenario is $171/MWh or $0.171/kWh (with an kicks in through the MAS to mitigate the residual error and put
average load of around 1.2MW and total energy requirement of the system back to the nominal frequency value. The voltage
28.7MWh). This is high compared to current electrical rates in shoots up further around 10% up to 132V as a transient, but
the U.S. markets, however this would be an islanded micro- is kept within safe levels. Diffusion then keeps the frequency
grid that would not benefit from bulk-generation economies very close to the nominal as the net demand fluctuates.
of scale. To compare the diffusion strategy with a centralized solu-
To scrutinize the performance of the proposed control, the tion, the adaptive droop no-load frequency adjustments were
most drastic event, an unintentional islanding, was demon- compared side by side. The centralized solution implements
strated. In grid-tied operation, the net power demand was low the adaptive droop adjustments to operate the asset at the exact
2006 IEEE TRANSACTIONS ON SMART GRID, VOL. 8, NO. 4, JULY 2017
Fig. 14. Microgrid islanding transient analysis. Fig. 17. Agent platform and laboratory setup at FIU.
[28] C. Li, M. Savaghebi, J. C. Vasquez, and J. M. Guerrero, Multiagent Ricardo de Azevedo (S14M16) received the B.S.
based distributed control for operation cost minimization of droop con- degree (Hons.) in electrical and computer engineer-
trolled AC microgrid using incremental cost consensus, in Proc. 17th ing from Rice University, Houston, TX, USA, in
Eur. Conf. Power Electron. Appl. (EPE15 ECCE-Europe), Geneva, 2008, and the M.S. degree in electrical engineering
Switzerland, 2015, pp. 19. from Florida International University, Miami, FL,
[29] R. Roche, B. Blunier, A. Miraoui, V. Hilaire, and A. Koukam, USA, in 2016.
Multi-agent systems for grid energy management: A short review, in From 2008 to 2012, he was a Systems Engineer
Proc. IECON 36th Annu. Conf. IEEE Ind. Electron. Soc., Glendale, AZ, with Lehman Brothers, Barclays Capital and
USA, 2010, pp. 33413346. Goldman Sachs, New York, NY, USA. Since 2012,
[30] F. Y. S. Eddy and H. B. Gooi, Multi-agent system for optimization he has been a Systems Engineer in FL, USA. His
of microgrids, in Proc. IEEE 8th Int. Conf. Power Electron. ECCE research interests are in the area of smart grids,
Asia (ICPE & ECCE), 2011, pp. 23742381. microgrids, distributed control, optimization, machine learning, renewable
[31] Z. Wang, W. Wu, and B. Zhang, A fully distributed power dis- energy, and energy storage.
patch method for fast frequency recovery and minimal generation cost
in autonomous microgrids, IEEE Trans. Smart Grid, vol. 7, no. 1, Mehmet Hazar Cintuglu (S12) received the B.S.
pp. 1931, Jan. 2016. and M.S. degrees in electrical engineering from
[32] J. W. Simpson-Porco et al., Secondary frequency and voltage con- Gazi University, Ankara, Turkey, in 2008 and
trol of islanded microgrids via distributed averaging, IEEE Trans. Ind. 2011, respectively. He is currently pursuing the
Electron., vol. 62, no. 11, pp. 70257038, Nov. 2015. Ph.D. degree with the Energy Systems Research
[33] F. Dorfler, J. Simpson-Porco, and F. Bullo, Breaking the hierarchy: Laboratory, Electrical and Computer Engineering
Distributed control & economic optimality in microgrids, IEEE Trans. Department, College of Engineering and Computing,
Control Netw. Syst., to be published. Florida International University, Miami, FL, USA.
[34] J. Chen and A. H. Sayed, Diffusion adaptation strategies for distributed From 2009 to 2011, he was a Power Systems
optimization and learning over networks, IEEE Trans. Signal Process., Project Engineer with an electric utility company
vol. 60, no. 8, pp. 42894305, Aug. 2012. in Turkey. His current research interests include
[35] J. Chen and A. H. Sayed, Distributed Pareto optimization via dif- multiagent systems, distributed control, cyber physical systems for active
fusion strategies, IEEE J. Sel. Topics Signal Process., vol. 7, no. 2, distribution networks, and microgrids.
pp. 205220, Apr. 2013.
[36] S.-Y. Tu and A. H. Sayed, On the influence of informed agents on
learning and adaptation over networks, IEEE Trans. Signal Process., Tan Ma (M16) received the B.Eng. degree
vol. 61, no. 6, pp. 13391356, Mar. 2013. in automation and the M.E. degree in con-
[37] D. E. Olivares et al., Trends in microgrid control, IEEE Trans. Smart trol theory and control engineering from the
Grid, vol. 5, no. 4, pp. 19051919, Jul. 2014. Huazhong University of Science and Technology,
[38] N. Li, L. Chen, and S. H. Low, Optimal demand response based on China, in 2007 and 2009, respectively, and the
utility maximization in power networks, in Proc. IEEE Power Energy Ph.D. degree in electrical engineering from the
Soc. Gen. Meeting, Detroit, MI, USA, 2011, pp. 18. Electrical and Computer Engineering Department,
[39] G. Binetti, A. Davoudi, F. L. Lewis, D. Naso, and B. Turchiano, Florida International University, Miami, FL, USA,
Distributed consensus-based economic dispatch with transmission in 2015. He was a Post-Doctoral Research Fellow
losses, IEEE Trans. Power Syst., vol. 29, no. 4, pp. 17111720, with the Energy Systems Research Laboratory, ECE
Jul. 2014. Department, Florida International University, from
[40] L. Xiao and S. Boyd, Fast linear iterations for distributed averaging, 2015 to 2016. He is currently a Senior Power Systems Engineer with Power
Syst. Control Lett., vol. 53, no. 1, pp. 6578, 2004. Wright Technology, Palm Beach, FL, USA.
[41] M. H. Cintuglu, H. Martin, and O. A. Mohammed, An intelligent multi His research interests include power system operations, control and protec-
agent framework for active distribution networks based on IEC 61850 tion, artificial intelligence applications to power systems, energy conservation
and FIPA standards, in Proc. 18th Int. Conf. Intell. Syst. Appl. Power and alternate energy sources, and smart grid power systems design and
Syst. (ISAP), Porto, Portugal, 2015, pp. 16. optimization.
[42] M. H. Cintuglu and O. A. Mohammed, Multiagent-based decentralized
operation of microgrids considering data interoperability, in Proc. IEEE Osama A. Mohammed received the masters and
Int. Conf. Smart Grid Commun. (SmartGridComm), Miami, FL, USA, Doctoral degrees in electrical engineering from
2015, pp. 404409. Virginia Tech, in 1981 and 1983, respectively.
[43] IEEE 14-Node Test Systems. Accessed on Sep. 24, 2015. [Online]. He is a Professor of Electrical Engineering and
Available: http://www.ee.washington.edu/research/pstca/ the Director of the Energy Systems Research
[44] C. Grigg et al., The IEEE reliability test system-1996. A report pre- Laboratory, Florida International University, Miami,
pared by the reliability test system task force of the application of FL, USA.
probability methods subcommittee, IEEE Trans. Power Syst., vol. 14, He has performed research on various topics in
no. 3, pp. 10101020, Aug. 1999. power and energy systems including design opti-
[45] G. Binetti, A. Davoudi, D. Naso, B. Turchiano, and F. L. Lewis, A dis- mization and physics passed modeling in electric
tributed auction-based algorithm for the nonconvex economic dispatch drive systems and other low frequency environments.
problem, IEEE Trans. Ind. Informat., vol. 10, no. 2, pp. 11241132, He is a world renowned leader in electrical energy systems. He also authored
May 2014. a book and several book chapters. He has current active research projects for
[46] Z. J. Towfic and A. H. Sayed, Adaptive penalty-based distributed several federal agencies dealing with power system analysis and operation,
stochastic convex optimization, IEEE Trans. Signal Process., vol. 62, smart grid distributed control and interoperability, cyber physical systems,
no. 15, pp. 39243938, Aug. 2014. co-design of cyber and physical components for future energy systems appli-
[47] V. Salehi, A. Mohammed, A. Mazloomzadeh, and O. Mohammed, cations, electromagnetic signature, wideband gap devices and switching, and
Laboratory-based smart power system, part I: Design and system ship power systems modeling and analysis. He has published over 450 articles
development, IEEE Trans. Smart Grid, vol. 3, no. 3, pp. 13941404, in refereed journals and other IEEE refereed international conference records
Sep. 2012. in the above areas.
[48] V. Salehi, A. Mohamed, A. Mazloomzadeh, and O. A. Mohammed, Prof. Mohammed was a recipient of the IEEE Power and Energy
Laboratory-based smart power system, part II: Control, monitoring, Society Cyril Veinott Electromechanical Energy Conversion Award and the
and protection, IEEE Trans. Smart Grid, vol. 3, no. 3, pp. 14051417, 2012 Outstanding Research Award from Florida International University. He
Sep. 2012. is an elected fellow of the Applied Computational Electromagnetic Society.