Professional Documents
Culture Documents
4, OCTOBER 2012
Game-Theoretic Communication
Structures in Microgrids
Nishantha C. Ekneligoda, Member, IEEE, and Wayne W. Weaver, Member, IEEE
Abstract—This paper presents a game-theoretic communication constant generation [7]. In this construct, the power-flow
structure, which is a network constructed among distributed problem must be numerically solved as described in [8]
controllers in the microgrid. This helps to share local controller under the general assumption that generation matches demand
information, such as control input, individual objectives among
controllers, and finds a better optimized cost for the individual at all times. In SSPS, most of the cases loads and sources
objectives. The modeling follows a game-theoretic framework are equipped with power-electronic interfaces (PEIs). Some
for the energy conversion and control elements inside small-scale devices, such as synchronous generators or line-connected
power systems (SSPS) or microgrids. These elements form teams motors, do not require a PEI. However, in this paper, it is
to optimize performance and operation based on available infor- assumed that all loads and sources are connected through a PEI.
mation and communication. The team players are able to minimize
a common objective when there is communication, and shift to the Therefore, in an SSPS, the load and sources can be modeled as
individual local objectives when communication fails. This paper dynamic energy resources since the elements are controlable
also presents analysis to determine the minimal performance PEI [9]. In a game-theoretic modeling approach, these dynamic
standards for the given level of communicated information. Then quantities are called players in the system. Then, the control
it shows optimal information mixing for team player modeling. In system should provide the required flexibility of the players to
addition, a Stackelberg model is proposed for the microgrid with
a leader-follower modeling approach. The last part of this paper ensure operation as a single aggregated system. The modeling
shows possible examples with network contingency study with discussed in this paper is based on microgrids but, the discussed
team player participation. methods can be easily applied to other types of SSPSs as well.
Index Terms— Communication structures, distributed control, Many techniques have been reported in the literature to study
game theory, microgrids, player local objectives, team players. power systems and microgrid dynamics and control, including
game-theoretic approaches [7]. However, the application of
game theory to the communication structure in microgrids is
I. INTRODUCTION limited. Game theory captures the nature of strategic situations,
or games, where an individual’s successful choices depends on
more communication channels are available in the network. relationship between these two vectors can be written as the
This causes complexity, increased cost, and increased failure nodal equations
modes [7]. Therefore, there is a tradeoff between the level of
improvement that a player archives versus increased commu-
nication. The discussions in [17] and [18] show the georouting (1)
schemes algorithm operating with neighboring devices infor-
mation and comparison methods. These discussions form a All vectors are of dimension , with representing
detailed analysis of the impact of neighbors information on the number of buses. In general, the bus admittance matrix
cooperative analysis. is symmetric and is a function of line admittances and
In this paper, a player by player (pbp) optimization is used shunt-to-ground load resistances of the system. The process of
to find the Nash equilibrium (NE) of team players with com- solving nodal equations in (1) and the busbar voltage calcula-
munication. The NE [7], [15], [16] is a operating point where tion is discussed in [7] and [8]. Based on the work presented
no player has an incentive to change its current control deci- in [7] it is useful to define the source player team set , the
sion. By changing his or her control decision from equilibrium load player team set , and the remaining voltage bus set in
each player receives a lost for their new team objective. The pbp the SSPS. This set categorization is important in the examples
optimization works with optimizing one player while keeping section while defining player objectives. Then, the player
the remainder constant. In this way, the initial noncooperative objective function can be modeled in the general form
game is transformed into cooperative game sets, which show
(2)
improvements in overall objectives. In cooperative game, there
is no single optimal strategy that is preferable to all others and where is the input terminal resistances of the players other
can lead to a non-zero-sum game. In nonzero-sum games, the in- than . The term is the objective function for player in terms
teracting parties’ aggregate gains and losses are either less than of , , and . The Nash equilibrium (denoted by ) is found
or more than zero, whereas in zero-sum games, the interacting at a point so that
parties’ aggregate gains and losses are added to zero.
This paper will discuss the individual noncooperative Nash (3)
strategy compared to the different team cooperative strategies.
In each method, attention is given to reduce the level of infor- In other words, at NE, a player has minimized its cost function
mation necessary to achieve a significant improvement. In ad- under all of the other players reactions. At such a equilibrium
dition, it shows the optimum information mixing of the players. point, the player objective is and optimal player con-
In this way, players can operate in an NE while communica- trol decision is given by
tion exists. Then, if communication fails, they can switch to the
local individual strategy while maintaining a minimal level of
Pareto optimality for the noncooperative game. In a Pareto op-
timal solution, the player cannot increase his or her utility payoff
without reducing the payoff of another. III. TEAM MODELING
Finally, a Stackelberg concept is proposed for a leader-fol- The NE discussed in Section II may or may not be the global
lower-based organization [15]. Under this modeling, a leader minimum of a player and could be improved given the forma-
achieves a better operating point than the team equilibrium. tion of cooperative teams within the microgrid. Normally, team
However, this improvement causes the followers to obtain players have similar requirements within the system and may
weaker operating points than the team equilibrium. This ap- be physically close. For example, multiple loads that are oper-
proach can be useful in systems with high priority or changing ating near each other can form a team. Likewise, source players
priority elements. The last section of this paper is focused on could team together, or teams could be made up of a mix of
contingency analysis with team player participation. The main sources, loads, and storage players. It is then useful to study the
goal of this paper is to show how the team player participation possibility of improving the overall utility of the system by in-
improves the player objectives in the microgrid. The particular troducing cooperative teams with communication. In this paper,
structure (ac or dc) is relatively immaterial for this particular different communication structures will be proposed and mod-
work and, therefore, the simpler dc power system was consid- ified to determine an optimal set of information. Under each
ered. modification, the corresponding minimization function of the
players will be changed.
The objectives within an electrical power system can be con-
sidered as continuous and bounded. However, determining the
convexity of highly nonlinear power system equations is a com-
II. PLAYER OBJECTIVES IN A MICROGRID
plicated task. Therefore, in such a situation, it is necessary to use
modeling and simulations in a heuristic turn-based method [7] to
The PEI can be modeled as a controllable dynamic player obtain an equilibrium. In this method, the first player optimizes
in the system as discussed in [7]. Consider a microgrid with its operating space and others remain at their initial conditions.
and as the bus voltage and injected current vectors. If Then first player fixes its local control input and the next player
represents the bus admittance matrix of this microgrid, then the starts optimizing its operating space while the remaining players
2336 IEEE TRANSACTIONS ON POWER DELIVERY, VOL. 27, NO. 4, OCTOBER 2012
are fixed. Next, the opportunity goes to the third player and this
process is repeated for all players in the team. The next round
starts again in a similar fashion starting with the first player from
its equilibrium found in the previous round. This process will re-
peat until all of the players find an operating point where neither
wants to move from their equilibrium.
However, this does not guarantee that the new equilibrium
has lower costs over the noncooperative game. In such situa-
tions, by obtaining player’s local objectives under the new equi-
librium, the improvement of the objective can be checked. How-
ever, checking the convexity or direct analytic calculation of
partial derivatives for KKT conditions of these highly nonlinear Fig. 1. Team player formation only with neighboring information.
power system equations is difficult. As a result, evaluating par-
tial derivatives at the equilibrium points found in the turn-based
approach, it is possible to make an approximate test for the KKT the local objective and is added to the weighted value of the
conditions at the NE, if it is modeled as a constraint problem. neighboring objective. Fig. 1 shows the modeling structure con-
However, this NE may not be the global minimum or the best sidering only information from the immediate neighbor clock-
NE that can be obtained from an analytic solution. Anyway, it wise. Therefore, the communication channel required per player
provides a practical solution which is close to an NE. is reduced to one. Mathematically, this can be proven consid-
If a communication channel exists among all players in the ering the team player objective in (4) with ’s equal to 1. From
team, then they can minimize a common objective function above, is the team objective, which means
which may yield a better value for the individual local objec- is also a team objective for the considered team. However, (6)
tives. However, when communication fails, they can switch shows that another person-by-person game exists that defines
back to the purely local objectives. The mathematical proof the local objective as depicted in Fig. 1. This modeling reduces
followed here considers the load teams which can be easily the communication required per player to only neighboring in-
applied to the source team as well. One possible cooperative formation. Therefore, a modification of the team objective func-
team objective function is tion is proposed as
(4)
(6)
where are the weighting factors, is the number of players where ’s are the scaler weighting factors of converter objec-
in the network, and are the individual player objectives. tives. The players operation will be shifted to a new point which
The weighted common objective has two equilibrium points is obtained from (5) and (6) as
[15]. However, the distributed controllers need to consider a
player-by-player optimality. Therefore, the NE equilibrium
can be found using the turn-based approach discussed before.
However, the new NE will be a local minima for the team (7)
objectives under each local control decision. Therefore, the
equilibrium point can be obtained with a simultaneous solution To achieve an improvement, it is necessary to have a lower cost
of of the team player’s local objectives under the new equilibrium.
Communicating with an immediate neighbor may be accurate
(5) and economically useful (lower cost). The reason is that it needs
only one communication channel per player for communicating
The partial derivative of with respect to in (5) repre- with a neighboring payer. Further, it has low failure modes. In
sents the rate of change of player team objective variation with contingency analysis, the failure of neighboring information and
respect to the local control decision. The local control is chosen all information cases is discussed. These two example cases give
as the converter input impedance. Obtaining a closed-form so- the fundamental idea and can be easily explored for other cases.
lution of the highly nonlinear power system equation of type
(5) is generally not feasible. In addition, in a team there should
have at least three players. As a result, team players-based mod- IV. STAKELBERG MODEL
eling and related equations are highly nonlinear. In such situa- In some cases in team modeling, it is useful to give priority
tions, it is necessary to obtain the solution using the turn-based to one player within a team by defining a leader. Based on the
approach [7]. In addition, the availability of many players in choice of the leader, the remaining controllers act like followers.
the team needs a higher level of communication among players This modeling is important and useful in a microgrid of high pri-
under a common objective. ority loads. The Stackelberg concept helps to define a team in
Consider the modified team objectives shown in Fig. 1 where such an approach. The literature shows that the Stackelberg con-
each individual players objective is weighted with a factor of cept-based modeling can be split into three different categories
EKNELIGODA AND WEAVER: GAME-THEORETIC COMMUNICATION STRUCTURES IN MICROGRIDS 2337
(8) Fig. 2. Nine-bus dc power system with load and source teams [7].
where is the optimal response set of the follower’s
group and is defined for each by
The remaining bus set is defined as . In addition,
all of the line resistances are 0.087 p.u. in the following exam-
and (9) ples.
Fig. 3. Players’ transition from initial point to equilibrium with only sharing
neighboring information.
TABLE I
PLAYER LOCAL COST RESULTS Fig. 4. Illustration of individual versus team objectives.
TABLE II
PLAYER LOCAL COST IN THE SOURCE TEAM EXAMPLE
Next, a source team participation strategy is demonstrated. In Next, the effects of forming a load team and a source team si-
this model, the load converter control strategy was kept constant multaneously in the system are considered. The constants used
and source converters change their control strategies to mini- for source and load players are the same as in the previous exam-
mize objectives. The source player minimization objective was ples of Sections V-B and C. However, this case simulation was
chosen as limited to one information improvement which includes only
the neighboring player local objective value, and the results are
(13) shown in Table III. In this case for the used local objective, do
EKNELIGODA AND WEAVER: GAME-THEORETIC COMMUNICATION STRUCTURES IN MICROGRIDS 2339
TABLE III
NEW EQUILIBRIUM UNDER LOAD AND SOURCE TEAM PARTICIPATION
TABLE IV
STAKELBURG COST IN EACH HIERARCHY
A. Effect of Source Changes in the System Fig. 8 shows the players equilibrium transition during the
total loss of communication in the system. This is possible in
Assume that the source player 1 is of the following profile: cases where lightning stroke changes the entire communication
in a system. In these cases, each player optimizing an objec-
,
(19) tive is shifted from team objective to individual objectives as
otherwise.
a loss of communication. Therefore, each player shows signif-
The time corresponds to the point where system players have icant transition from initial to the new equilibrium. In this par-
18 turns during transition. In this case, the players equilibrium ticular example, source team players take a larger time period
has transitioned as shown in Fig. 6. Source player 1 suddenly to reach equilibrium than the load players.
changes its generation to a lower value of 0.5 p.u. These results In the aforementioned approaches, the power-flow solution
are not unlike in a photovoltaic system when a large cloud casts was obtained without considering the slack bus. In other words,
a shadow on a solar panel, or in a wind turbine when the wind sources have the freedom to change their injected power with
dies. According to Fig. 6, the load team needs a higher number demand changes. Therefore, this system operates with a dis-
of turns to reach its equilibrium. Source player 1 keeps his or her tributed slack bus, where every source adjusts the mismatch [7].
control decision constant while the other sources change their In hardware implementation, fast communication of informa-
actions. tion among team players is required. If the communication delay
EKNELIGODA AND WEAVER: GAME-THEORETIC COMMUNICATION STRUCTURES IN MICROGRIDS 2341
[4] T. Gruzs and J. Hall, “Ac,dc or hybrid power solutions for today’s
telecommunications facilities,” in Proc. IEEE Int. Telecommun. Energy
Conf., 2000, vol. 1, pp. 361–368.
[5] M. Gelniak and C. Shen, “Power management strategy based on game
theory for fuel cell hybrid electric vehicles,” in Proc., IEEE Veh.
Technol. Conf., 2004, vol. 6, pp. 4422–4426.
[6] M. Chandorkar and D. Divan, “Control of parallel connected inverters
in standalone ac supply systems,” IEEE Trans. Ind. Appl., vol. 29, no.
1, pp. 136–143, Jan./Feb 1993.
[7] W. W. Weaver and P. T. Krein, “Game-theoretic control of small-
scale power systems,” IEEE Trans. Power Del., vol. 24, no. 3, pp.
1560–1567, Jul. 2009.
[8] M. Crow, Computational Methods for Electric Power Systems, 1st
ed. Boca Raton, FL: CRC, 2004.
[9] W. Weaver, “Dynamic energy resource control of power electronics in
local area power networks,” IEEE Trans. Power Electron., vol. 26, no.
Fig. 8. Equilibrium changes with loss of total communication in the system. 3, pp. 852–859, Mar. 2011.
[10] G. Owen, Game Theory, 3rd ed. London, U.K.: Academic Press,
2001.
[11] H. Singh, “Introduction to game theory and its applicin electri power
is negligible, then the information adding, objective minimiza- markets,” in Proc. IEEE Comput. Appl. Power, 1999, vol. 12, pp.
tion, and player control position detection can be determined 18–22.
[12] Z. Li, “A differential game modelling approach to dynamic traffic as-
through the software system. Then, the corresponding signal signment and traffic signal control,” in Proc. IEEE Int. Conf. Syst., Man
can be injected to the required hardware system to operate in Cybern., 2003, vol. 1, pp. 849–855.
real time. However, in real-time operation, it is necessary have [13] T. Alpcan and T. Basar, “A globally stable adaptive congestion con-
trol scheme for internet-style networks with delay,” IEEE/ACM Trans.
a fast control system in order to have better performance. Oth- Netw., vol. 13, no. 6, pp. 1261–1274, Dec. 2005.
erwise, it will create failure modes in the system. [14] W. Saad, H. Zhu, M. Debbah, A. Hjorungnes, and T. Basar, “Coali-
tional game theory for communication networks,” in Proc. IEEE Signal
Process. Mag. Conf., 2009, vol. 26, pp. 77–97.
IX. CONCLUSION [15] T. Basar and G. J. Olsder, Dynamic Noncooperative Game Theory, 2nd
The formulation of team players in microgrids helps to ed. Philadelphia, PA: SIAM, 1999.
[16] D. Galati and M. Simann, “Effectiveness of the nash strategies in com-
improve the objectives of the system elements. The potential petitive multi-team target assignment problems,” in Proc. IEEE Conf.
level of improvement depends on the level of communication Decision Control, 2004, vol. 43, pp. 4856–4861.
available. In each method, players form teams and modify [17] M. Biagi, S. Greco, and L. Lampe, “Neighborhood-knowledge based
geo-routing in PLC,” in Proc. IEEE Int. Symp. Power Line Commun.,
the minimization objectives. The direct solution for equilib- 2012, pp. 7–12.
rium for highly nonlinear power system equations is difficult. [18] M. Ahmed and L. Lampe, “Parametric and nonparametric methods
The turn-based approach improves the solution to obtain the for power line network topology inference,” in Proc. IEEE Int. Symp.
Power Line Commun. Appl., 2012, pp. 274–279.
equilibrium under each team model of converter teams. The
improved model using neighboring information is important Nishantha C. Ekneligoda (M’12) received the
to reduce the required information level. However, during B.S. and M.S. degrees in electrical engineering
from the University of Moratuwa, Sri Lanka, in
information mixing, a significant sensitivity for player local ob- 2003 and 2005, respectively, the MSME degree in
jectives is seen. Therefore, to achieve optimum improvement, mechanical engineering from Southern Methodist
it is necessary to mix information under the optimum value. University, Dallas, TX, in 2008, and the Ph.D. degree
in electrical power from Michigan Technological
The Stackleberg concept helps to allocate bigger portions of University, Houghton.
resources for given players depending on the requirements. His research interests include power system con-
Expanding this analysis for different converter objectives, trols; power electronics; nonlinear, optimal, and dis-
tributed controls; and renewable energy systems.
multiple team participation and different methods of objective
mixing are possible future directions of research. In addition,
it is necessary to observe the sensitivity of each mixing factor
under each model. Also, forming teams for dynamic differential Wayne W. Weaver (S’03–M’08) received the B.S.
degree in electrical engineering and the B.S. degree
games is an interesting future topic of this paper. Then, the in mechanical engineering from GMI Engineering
game will be a path optimization instead of point optimization. and Management Institute, MI, in 1997, and the M.S.
and Ph.D. degrees in electrical engineering from the
University of Illinois, Urbana, in 2004 and 2007,
REFERENCES respectively.
[1] R. H. Lasseter and P. Paigi, “Microgrid: A conceptual solution,” Currently, he is an Assistant Professor in the De-
in Proc. IEEE Power Electron. Specialists Conf., 2004, vol. 1, pp. partment of Electrical Engineering, Michigan Tech-
4285–4290. nological University, Houghton. He was a Research
[2] R. S. Balog and P. T. Krein, “Bus selection in multibus dc power sys- and Design Engineer with Caterpillar Inc., Peoria, IL,
tems,” in Proc. IEEE Elect. Ship Technol. Symp., 2007, vol. 1, pp. from 1997 to 2003. From 2006 to 2008, he was a Researcher with the U.S. Army
281–287. Corp of Engineers, Engineering Research and Development Center (ERDC),
[3] S. Mollov, A. Forsyth, and M. Maily, “System modelling of advanced Construction Engineering Research Lab (CERL), Champaign IL, focusing on
electric power distribution architechtures in large aircraft,” in Proc. distributed and renewable energy technology research.
Soc. Automotive Eng. Power Syst. Conf., 2000, vol. 1, pp. 163–169. Dr. Weaver is a registered professional engineer in the State of Illinois.