Professional Documents
Culture Documents
1 s2.0 S1364032115016421 Main
1 s2.0 S1364032115016421 Main
art ic l e i nf o a b s t r a c t
Article history: Microgrid equipped with heterogenous energy resources and a bank of energy storage devices presents
Received 8 November 2014 the idea of small scale distributed energy management (DEM). DEM facilitates the minimization of the
Received in revised form transmission and operation costs, peak load and environmental pollution. Microgrid also enables active
8 October 2015
customer participation by giving them the access to the real time information and control. The capability
Accepted 27 December 2015
Available online 2 February 2016
of fast restoration against physical/cyber attack, integration of renewable energy resources and infor-
mation and communication technologies (ICT) make microgrid as an ideal candidate for distributed
Keywords: power systems. The energy management system of microgrid can perform real time energy forecasting of
Optimization renewable resources, energy storage elements and controllable loads in making proper short term
Algorithms
scheduling to minimize total operating costs. Cost benefit analysis of microgrid reveals that cooperation
Microgrid
among different microgrids can play an important role in the reduction of import energy cost from the
utility grid. Cooperation among microgrids in smart microgrid network (SMN) brings the energy sharing
and management issues. In this paper we present a review of existing optimization objectives, con-
straints, solution approaches and tools used in microgrid energy management. This review paper can
provide a foundation to embark on an in depth study in the area of energy management for smart
microgrid network.
& 2016 Elsevier Ltd. All rights reserved.
Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1665
2. Related work (energy management problem in microgrids). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1665
2.1. Reports and publications which are utilized in the practice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1666
2.2. Objective functions of energy management problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1666
2.3. Constraints in energy management problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1667
2.4. Optimization types used in energy management problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1667
2.4.1. Linear programming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1667
2.4.2. Non-linear programming. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1672
2.4.3. Stochastic programming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1674
2.4.4. Dynamic programming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1674
2.4.5. Non-differential programming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1675
2.5. Solution approaches of energy management problem. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1675
2.5.1. Heuristic approach. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1675
2.5.2. Agent based approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1676
2.5.3. Evolutionary approach. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1676
2.5.4. Model predictive control approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1678
2.5.5. Neural network approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1678
n
Corresponding author.
E-mail address: alagan@ee.ryerson.ca (A. Anpalagan).
http://dx.doi.org/10.1016/j.rser.2015.12.259
1364-0321/& 2016 Elsevier Ltd. All rights reserved.
A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683 1665
and energy purchase cost from the utility companies. These opti- based systems. They argued that the applications that require
mization formulations have been classified on the basis of Objec- batteries to serve as a backup energy service rather than a cycling
tive functions, constraints, optimization types, solution types and service will find that PbA batteries are better choice. The roof top
tools used to solve the energy management problem in microgrids. microgrid system comprising of two wind turbines with a total
capacity of about 6.4 kW and photovoltaic system with a capacity
2.1. Reports and publications which are utilized in the practice of 3.6 kW has been investigated in [51]. Performance analysis of
the developed model showed that the variation in wind can be
It is due to the realization of the dire need of replacing con- effectively taken care by combine operation with PV system along
ventional fossil fuel based energy resources with renewable with battery storage. The results also verified that the intermittent
energy resources that different organizations are contributing to nature of the renewable sources can be handled effectively by
achieve this objective. These organizations are contributing using hybrid system. The following section describes some com-
towards the development of the microgrid in different aspects as monly used objective functions in energy management problem.
shown in Table 2. For example, in [3], the standards and technol-
ogies of the microgrid are elaborated. A vision report, Grid 2030 2.2. Objective functions of energy management problem
[46] by the US department of energy, highlights the necessity of
microgrid and its future growth. In [47], a pilot project at Santa The energy management in microgrid can have different
Rita Jail Campus, about 70 km east of San Francisco is elaborated. objective functions. These objective functions are based on user
This project is the true demonstration of microgrid as it is locally preferences, geographical area, equipment installed in microgrid,
controlled system and can operate both grid connected and capacity of microgrid, government regulations, types of tariff,
islanded mode [48]. The technical report [49] suggests policy energy storage and generation. Fig. 1 presents the types of opti-
recommendations for a microgrid demonstration program, with mization used to solve the problem of energy management.
specific recommendations for China. This report also outlines the A collection of objective functions is described in Tables 3–6.
drivers for microgrids emphasizing renewable energy, identifies Table 3 presents objectives related to capital and operational costs
the barriers to microgrid development and suggests potential of microgrid. Operational costs include production costs, fuel costs,
solutions, and lists policy recommendations. An energy system maintenance costs, start-up and shut-down costs, degradation
costs and purchase costs from the utility grid in case of shortage.
model (ESM) has been developed in [50] to perform the realistic
Table 4 describes the objectives of battery and other storage
battery modeling and economic evaluation. The authors compared
devices such as hydrogen storage and ultra-capacitors. Objectives
Aqueous Hybrid Ion (AHI) based microgrids with lead acid (PbA)
related to Costs and efficiencies of Charging and discharging is also
included. In Table 6, miscellaneous objectives namely power los-
Table 1
Existing reviews/surveys relating to optimization microgrid. ses, penalty costs, worst case net transaction costs and dis-
satisfaction costs are presented. Table 5 shows the carbon emis-
Ref. no. Review type MG mode of operation sions and penalty costs for these emissions [61]. Single and multi-
objective work is presented in Table 7.
OFS Generic OF Const. Tools Standalone Grid connected
The multi-objective optimization is considered in [62–75]. In
[32] √ √ √ √ √ [62], authors describe a multi-objective framework to minimize
[33] √ √ power losses, carbon emissions, generation and capital costs.
[34] √ √ Supply and frustration costs are discussed in [63]. Zhao et al. [64]
[35] √ √ √
[36] √ √ √ √
present a minimization objective of fuel, maintenance and startup
[37] √ √ √ √ costs. In [65], authors used a multi-objective approach to minimize
[38] √ √ the generation and storage costs. The authors use a multi-objective
[39] √ √ √ paradigm in [66] to minimize shortage, storage and grid costs. Ma
[40] √ √ √
et al. [67] present minimization of consumer bill and dissatisfac-
[41] √ √ √
tion costs. In [68], financial gain of user and penalty cost are
OFS, optimization function specific; OF, optimization function; Const., constraints; combined in multi-objective optimization. Financial gain of user is
MG, Microgrid. maximized while penalty cost is minimized. A multi-objective
Table 2
Reports and publications which are utilized in the practice.
Academics Industry Government Regulatory Statistics/ analysis Future plan/ prediction Pilot project
[3] √ √
[47] √ √
[49] √ √
[50] √ √
[51] √ √
[52] √ √
[53] √ √
[54] √ √
[55] √ √
[56] √ √
[57] √ √
[58] √ √
[59] √ √
[60] √ √
A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683 1667
approach to maximize the best set of sellers and weights is dis- limits for a safe and economic operation. All types of loads, such as
cussed in [69,70,76,77]. Jiang et al. [71] propose a multi-objective residential, commercial and industrial, consume electric power
optimization of revenue while considering loads, supply, storage according to their operating limits. These are consumption or load
and grid costs. The authors consider all costs of supply, storage and constraints. Battery or other storage devices such as hydrogen and
penalty costs due to loadshedding. A multi-objective optimization ultra-capacitors have limits for charge and discharge rate. These
frame work has been considered in [72] to maximize the economic storage elements also have a specific limit of discharge. Excessive
benefit of the microgrid. Nguyen et al. [73] present a multi- charge and discharge rates affect life time and efficiency of these
objective methodology. The methodology includes minimization elements. All of these operating limits are taken as storage con-
of grid, star-up and shut-down, operating, demand response, straints. Operational constraints are used for spinning, non-
loadshedding, penalty of wind and solar costs separately. Garca spinning reserves, ramping limits and start-up and shut-down
[74] proposes a multi-objective optimization technique to mini- rates of generating elements. In some countries like the US,
mize the cost of grid, battery, ultra-capacitor and hydrogen. Pen- existing prices of selling and purchasing electricity from grid in
alty costs of operation and carbon emissions are considered in case of excess or shortage, e.g. real time electric prices depend
[75]. Guyen et al. [78] use a multi-objective paradigm to minimize upon the online load, as the load exceeds certain specified limit,
fuel consumption costs and maximize charge/discharge efficiency. energy price goes on increasing. This scheme reduces peak load on
In [79], a multi-objective optimization is considered to maximize supplying units.
the revenue from loads and to minimize supply cost and worst Microgrids rely more on renewable energy resources to reduce
case net transaction cost. Minimization of generation, operation, carbon emissions. Wind, solar and fuel cell energy resources are
start-up and purchase cost is discussed in [80]. In [18], authors being integrated into microgrid. Wind and solar energies are
present a multi-objective approach to maximize benefit due to uncertain and have specific output limits. Fuel cell also has specific
lower time of use (ToU) prices and minimize hourly capital and operating limits. These operating conditions are taken as con-
storage costs of energy storage elements. To maximize reliability straints while solving the optimization formulations related to the
index of microgrid and minimize allocation costs of distributed energy management for microgrids utilizing renewable resources.
generation (DG) and line loss index, a multi-objective approach is
proposed in [81–83]. Corso et al. [84] focus on minimization of fuel 2.4. Optimization types used in energy management problem
costs, carbon emissions, and energy losses (supply–demand). A
multi-objective problem to minimize the payment of dispatchable Various optimization techniques have been used by the
loads and cost of supply is considered in [85]. research community to tackle the problem of energy management
Single objective approach is presented in [28,86–92]. The in microgrids. Fig. 2 presents the types of optimization used to
minimization of import energy from grid [28], Gaussian distance solve the problem of energy management. The preceding section
between the consumption pattern of home appliances [86], grid discusses the relevant work related to each specific technique.
costs [87,88], tracking error [89], supply costs [90,91] and gen-
eration cost [92] are the single objective formulations. 2.4.1. Linear programming
A microgrid consisting of hybrid renewable energy systems has
2.3. Constraints in energy management problem been modeled by using a linear programming in [112] to reduce
the demand fluctuations and improve energy balance. The authors
In real life, the optimal energy management system for argued that the demand fluctuations could be reduced up to 19%.
microgrid is affected by a number of constraints. Table 8 presents Mixed integer linear programming (MILP) has been proposed in
constraints related to the objectives discussed earlier. Constraints various articles to solve different energy related problems. For
of power generation are the maximum and minimum power example in [99], total annualized cost has been minimized by
output limits. A distributed generator must operate within these optimally selecting different system components and renewable
1668 A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683
Table 3
Objective functions for minimization of capital and operational cost.
price.
Shut-down and start-up costs [73] X
NH X
NM X
NG
NH, NM and NG are the number of hours, microgrids and distributed gen-
F¼ ðSU k;i;t þ SDk;i;t Þ
(18) erators respectively, SU k;i;t is the start up Cost function, SDk;i;t is the shut
t ¼1i¼1k¼1
down cost function.
Operating cost [73] X
NS X
NH X
NM X
NG
NH, NM, NG and NS are the number of hours, microgrids, distributed gen-
F¼ ρs C P sk;i;t
(19) erators and scenarios respectively, ρs is probability of scenarios s ¼ 1,2 … C is
s¼1 t ¼1i¼1k¼1
production cost function, P sk;i;t is output power of the ith generator
Xh
Operating cost [94] F¼ ðC mgd
t ðpmgd;eim
t pmgd;eex
t Þ þ C ngs
t pt
ngs;gim
The bidirectional exchange of electricity with the main grid is modeled by
t AT
decision variables pmgd;eim
t and pmgd;eex
t , natural gas imports from the utility
þ C evh;eim pevh;eim
t ÞΔt þ C fri;buf ðetfri;buf ;pop company are modeled by decision variable pngs;gim , pevh;eim represents the
t t
;prp ;pop
þ efri;buf
t Þ þ C hhw;buf ðehhw;buf
t charging rate of the EV's battery, Ctmgd represents the rate of electricity from
i (20)
þ ethhw;buf ;prp Þþ C boi;csc vboi
t þC
chp;csc chp
vt micro grid, Ctngs represents the rate of natural gas, C evh;eim represents the
depreciation rate of the electric vehicles battery.
6 h
X
Grid costs [74] wsale and wpur are the cost functions, Psale and Ppur are selling/purchasing
F¼ wsale ðP sale ðt k þ j Þ P sch
sale ðt k ÞÞ
2
powers, tk and t k þ j are the time intervals, Psch is scheduled energy
j¼1
i (21) exchanged with main grid.
Total costs [90] Ni X
X Nj þ wpur ðP pur ðt k þ j Þ P sch
pur ðt k ÞÞ
2
Cij is capital cost, Nij is power rating of distributed generator j in microgrid i,
F¼ C ij N ij þ M ij
i¼1j¼1
(22) Mij operational and maintenance cost of unit j in microgrid i.
Table 3 (continued )
þ C Sd ðtÞ P Sd ðtÞþ C Sd ðtÞ P Sd ðtÞ storage battery 1 maximal power discharge limits in each time interval t,
i i 2i 2i
P SC ðtÞ represents storage battery 1 maximal power charge limits in each
C SC ðtÞ P SC ðtÞ C SC ðtÞ P SC ðtÞ i
i i 2i 2i
time interval t.
þ C ENSi ðtÞ P ENSi ðtÞ
Nd X
X n
(39)
C EX i ðtÞ P EX i ðtÞ
i¼1t ¼1
▵
C i ðtÞ P 2i ðtÞ
F ¼ C K þ C B þ C PV þ C grid (40)
Operational cost of Smart Poly- CK, CB and CPV are the costs incurred for the operation of the two cogen-
generation Microgrid [98] eration gas turbines, the two boilers and the photovoltaic system respec-
tively. Whereas the Cgrid is the cost due to the electricity exchange with
external grid.
F ¼ C INV þ C OP þ C PUR SAL (41) C PUR
Total annualized cost of the micro- GRID þ C CARBTAX C GRID INV is investment cost, COP operating cost, CGRID purchase cost from grid,
grid [99] CCARBTAX penalty cost for carbon emissions and CGRIDSAL is a sale cost to the
main grid.
Total cost of hybrid energy system Cost ðMinðCostÞÞ Where λ1 and λ2 are the weighing factors that can be defined by the
F ¼ λ1
[100] MaxðCostÞ MinðCostÞ designer, A is the index of availability and Cost is the total cost including
A ðMinðAÞÞ (42) initial and operational cost.
λ2
MaxðAÞ MinðAÞ
Total cost [101] X
N
Xi is the electrical active-power generated (kW) and f i ðX i Þ is the electrical
F¼ X i f i ðX i Þ
(43) generation cost function ($/kW h).
i¼1
Operational cost [102] XN
Pi is the power output related to the DG unit i in kilowatt hours, FCi is the
F¼ FC i ðP i Þ þ P b P B P s P S þ M i ðP i Þ
(44) fuel consumption cost related to the DG unit i, in dollars per kilowatt hour,
i¼1
Pb is the actual hour electricity buying price in dollars per kilo Watt hour, PB
is the amount of purchased electricity, Ps is the actual hour electricity selling
price in dollars per kilowatt hour, PS is the sold electricity in kilowatt hours
and Mi is the maintenance cost related to the DG unit i in dollars per kilo-
watt hour.
F ¼ F DEG þ F MT OP (45) Where C OP indicates operation and maintenance costs of MG, SC represents
Operation and maintenance cost t t þ C t þ SC t t t
[103] startup costs of DEG.
a
Hot startup cost is ….
1670 A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683
Table 4
Minimization objectives of energy storage.
resources for the smartgrid. The MILP framework proposed in spillage. A generic mixed integer linear programming model has
[113] tackles the problem of optimal distributed generation by been proposed in [94,118] to minimize the operating cost of a
dividing it into two phases, namely site planning model and residential microgrid. A mixed integer linear program optimiza-
capacity planning model. The authors argued that their proposed tion has been used in [119] for the operation of energy storage in
model was computationally efficient with better optimal solution. microgrids. The technique is focused to minimize the electricity
In [71], a novel double-layer coordinated control approach for usage cost and battery operation cost. A mixed-integer linear
microgrid energy management is proposed. The proposed programming model has been proposed in [120] for the optimal
approach involves two layers: the schedule layer and the dispatch design and operation of an energy system consisting of combined
layer. The schedule layer is a mixed integer linear program (MILP). heat and power. The proposed model has been used to formulate a
The schedule layer provides an economic operation scheme based
multi-objective function to minimize the capital and operational
on forecasting data, while the dispatch layer provides power of
costs along with minimization of the CO2.
controllable units based on real-time data. Energy management
The authors in [28,121] proposed a Cost-Aware Smart Micro-
problem of a standalone MG integrated with RES has been for-
grid Network (CoSMoNet) scheme that facilitates economic power
mulated as MILP problem in [114,115] to minimize the operation
transactions within the microgrid network. The scheme based on
cost and penalties related to unmet energy. In [116], the authors
integer linear programming (ILP) matches the excess energy in the
present an optimization model to study the increase in self-
consumption of PV power by smart charging EVs using smart storage elements of microgrid network to the demands of other
grid technology. microgrid network whose load cannot be accommodated by their
A MILP is used to solve the multi-objective framework in local supply. The authors argued that CoSMoNet enables cost-
[73,117]. The framework facilitates an efficient tradeoff between efficient power transactions among microgrid communities,
low operation cost and good energy services to the end users. The increases the utilization of renewable energy, reduces the depen-
objective includes the cost of power exchange with the main grid, dency of the microgrids to the main grid and reduction of load on
the startup and shutdown costs, the operating cost of distributed the main grid. The preceding section summarizes the work done in
generators, the payment for demand response load, the penalty the area of energy management for microgrids by using non-linear
costs for involuntary load curtailment and renewable energy programming.
A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683 1671
Table 5
Minimization objectives of carbon emissions.
Table 6
Minimization of miscellaneous objectives.
N X
X n
24 X
Power losses [62] d is interval, h is hour, i is the no. of distributed generators, Pig is generated
F¼ P g;h;d P c;h;d Δt
i i (62) power, Pic is consumed power and Δt is time taken
d¼1h¼1i¼1
n
Frustration cost [63] hX 1
n
h is hour, rh is energy price at h, hn is the most preferred slot for the appliance
F ¼ δa ¼ ðh hÞj r h r n j a, da is the duration of activation of appliance a, rh is the current energy price
h¼1
in slot h, r n is the average energy price in slot hn and K is the deadline of the
X
K
þ
n
ðh ðh þ da ÞÞj r h r n j (63) current schedule
n
h ¼ ðh þ da Þ
Table 6 (continued )
Table 8
Constraints table.
Ref Supply Demand Storage Operation Prices Wind Solar Fuel cell Carbon emissions
[62] ✓ ✓
[63] ✓ ✓
[107] ✓ ✓
[64] ✓ ✓ ✓ ✓ ✓
[65] ✓ ✓ ✓
[108] ✓
[66] ✓
[67] ✓ ✓
[68] ✓ ✓
[69] ✓ ✓ ✓
[71] ✓ ✓ ✓ ✓ ✓
[87]
[88] ✓ ✓ ✓
[72] ✓ ✓ ✓
[73] ✓ ✓ ✓ ✓ ✓
[74] ✓ ✓ ✓
[75] ✓ ✓
[109] ✓
[110] ✓ ✓
[90] ✓ ✓
[78] ✓ ✓ ✓ ✓ ✓
[85] ✓
[79] ✓ ✓
[28] ✓ ✓ ✓
[80] ✓ ✓
[111] ✓ ✓
[18] ✓ ✓
[81] ✓ ✓
[84] ✓ ✓ ✓
[92] ✓ ✓
Fig. 2. Optimization-types.
The automation level in a microgrid is a complex, non-linear renewable resources in microgrids and proper relation among
and discrete optimization problem. The authors in [124] presented different microgrids and the utility grid are the critical challenges.
a procedure which is a scenario-based search method using local Capacities of renewable resources are to be optimized for reliable
automation and remote control strategies in a combinatory man- supply of energy lower cost. In [90], the problem is formulated as a
ner considering achievable benefits for each scenario. The authors non-linear mixed-integer program which minimizes capital and
simulated their proposed methodology on a sample microgrid. annual operational costs of renewable energy subject to a variety
The authors in [64] solved an operation scheduling problem of system and unit constraints. With a broader use of distributed
based on integer non-linear programming for renewable-powered generation and storage, many buildings and campuses will
microgrids. The problem involves the least-cost unit commitment become microgrids. Specific supply-side and demand-side aspects
(UC) and the associated dispatch challenges, while meeting the include on-site renewable generation, storage technologies, elec-
load, environmental, and system operating requirements. A new tric cars, dynamic pricing, and load management. A non-linear
concept, probability of self-sufficiency (PSS), is presented to indi- mixed integer optimization is used in [80] to solve these technical
cate the probability of microgrid to meet local demand in a self- challenges.
sufficient manner. The mixed-integer UC problem is solved from a The authors formulated a long term scheduling optimization
convex optimization perspective. The coordination among problem of a grid-tied renewable energy microgrid with hybrid
1674 A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683
energy storage as mixed quadratic program (MQP) in [72,125]. The The following sub-section presents the review of dynamic
lifetime, degradation, start up/down, operation and maintenance programming used for optimal energy management in microgrids.
costs of the hybrid energy storage system are included. A non-
linear model is presented for continuous/discrete dynamics and 2.4.4. Dynamic programming
switching between different operating conditions. An MQP is used A dynamic model is proposed in [63] which requires customers
in [74] to optimize short-term regulation services of a grid- to submit energy demand schedules and actively monitor energy
connected and renewable powered microgrid. A non-linear con- price signals. In this suggested scheme, microgrid is required to
strained multi-objective optimization is applied in [126,127] to the relay energy forecast information to the main grid. Moreover,
environmental and economic problems of the microgrid consisting customers have to participate in energy bids and to respond to
of hybrid energy sources. The authors considered operation and energy management signals in real time. Hence, smart system is
maintenance costs as well as emission of harmful gases. presented that independently executes all these tasks without
prompting of the end users. The microgrid is equipped with dis-
2.4.3. Stochastic programming tributed generation, grid connection, energy storage elements and
In [128], the authors have used stochastic linear programming various loads. A dynamic program is used to minimize energy cost
approach for the optimal modeling of reliability of microgrids and and maximize battery's lifetime simultaneously [65]. For this, the
to solve the scheduling issues of batteries. A framework for
authors suggested that the central controller of microgrid has to
sequential Monte Carlo simulations is developed in [129] to seek
find out the best pattern of charging and discharging the battery.
the performance of autonomous microgrid having ability to
This can be achieved by using time-of-use (TOU) grid electricity
interconnect with other microgrids for adequate load service.
rates. The electricity consumption patterns in a household are
Detailed models of the various microgrid components and inter-
modeled by a mixture of Gaussian distributions. The dynamic
connection policies are provided. Authors used stochastic program
programming is used to solve the problem [86]. Using the sym-
to minimize the exposure of each microgrid to vulnerabilities. A
stochastic energy and reserve scheduling method for a microgrid metrized generalized Kullback–Leibler divergence as a distance
which considers various types of demand response (DR) programs measure of the distributions, authors have extracted typical pat-
has been proposed in [130]. In the proposed scheme, all types of terns of the consumption of hierarchical clustering.
customers namely residential, commercial and industrial ones can Authors have proposed a dynamic contract mechanism to
take part in demand response programs which will be considered regulate microgrids energy purchasing over time in [66]. The
in either energy or reserve scheduling. To accommodate maximum proposed contract sets time-specific purchasing commitments for
user preferences and minimize the cost of electricity, a multi- a microgrid to fulfill the requirements of its load, while providing
objective dynamic stochastic programming model has been for- the microgrid with flexibility to change future commitments. A
mulated in [131]. A probabilistic energy management system to stochastic dynamic program is used to update commitments
optimize the operation of the microgrid based on an efficient point according to the current storage status and future load prediction.
estimate method is proposed in [132,133]. The authors have used An energy consumption scheduling problem is formulated as
the proposed method to model the uncertainty associated with dynamic program on the basis of a real time pricing strategy in
the wind power generation systems and the solar power genera- [67]. The energy consumption scheduling problem is cast into a
tion systems, the market prices and the load demands. In non-cooperative energy consumption game, in which consumers
[134,135], the authors have proposed a probabilistic approach for compete with each other to minimize their usage cost. Authors
the energy and operation management of renewable microgrids have argued that the non-cooperative energy consumption game
under uncertain environment. In [136], the authors have proposed has a unique Nash equilibrium point, i.e., optimal energy con-
a strategy for constructing microgrids with optimized supply sumption solution. The critical issues to be addressed for a grid-
adequacy. The problem has been formulated as multi-objective connected microgrid include the amount of renewable power that
optimization. The authors used three different types of algorithms can be fed to the utility grid and the related energy price. In
at different stages namely tabu search optimization algorithm, [68,140], the authors presented the demand side energy man-
graph theory related algorithms and forward-back-ward-based agement for a grid-connected household with a locally generated
probabilistic algorithm. They argued that the proposed planning photovoltaic energy and solved this optimization formulation by
framework can help utility engineers and system planners in using Dynamic Programming.
designing microgrids capable of working in island mode. A new In [69], an agent-based energy-management system is pre-
stochastic programming algorithm is presented in [137] for reac-
sented to facilitate power trading among microgrids with demand
tive power scheduling of a microgrid. The authors used a multi-
response and distributed storage. The dynamic programming is
objective function to minimize the loss and to maximize the
used to utilize diversity in load consumption patterns of the end
reactive power reserve and the security margin of voltage. The
users and energy availability from the distributed generation and
authors argued that Particle Swarm Optimization algorithm per-
storage. The proposed approach facilitates demand response in
formed better as compared to stochastic programming algorithm.
reducing the peak demand and minimizing the cost of electricity.
A probabilistic gravitational search algorithm has been used in
[134,135] for the optimal energy and operation management of a The authors in [75] presented a scheme of day ahead operational
microgrid consisting of hybrid renewable energy sources and planning. The unit commitment problem is solved using dynamic
energy storage devices including hydrogen storage. A stochastic programming. The objective of the program is to minimize CO2
optimization formulation has been used in [138] to minimize the equivalent emissions, the fuel consumption or a tradeoff between
expected operational cost of the microgrid and power losses. The these two. To reduce uncertainty in forecasted values for solar
proposed technique also considered the intermittent nature of the production or load demand, a smart energy manager recalculates
renewable sources. An improved PSO has been used in [139] to the generators power references 1 h ahead if necessary. In [78],
solve the scheduling problem of an MG composed of the combined dynamic programming is used to optimize the analysis for energy
cooling, heating and power (CCHP) units, PV panels, wind turbines, and power management in microgrid. The microgrid has renew-
and storage batteries. The authors illustrated the benefits of the able energy resources and diesel generators to supply its loads.
proposed solution to the real-time dispatching by considering the The total daily cost of the system is minimized while the total
uncertainty of renewable energy in day-ahead scheduling. efficiency of the energy storage unit is maximized.
A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683 1675
Fig. 3. Solution-types.
objective approach involves an efficient tradeoff between low achieving user-defined objectives. In their article different chal-
operation cost and good energy service for end users [73]. A lenges are discussed that are faced by operating a distributed
heuristic algorithm has been used to solve the problem of total architecture that must self-organize to appropriately coordinate
cost of power exchange with the main grid, the startup and the cooperative behavior of agents.
shutdown costs, the operating cost of distributed generators, the
payment for demand response load, the penalty costs for invo- 2.5.3. Evolutionary approach
luntary load curtailment, and renewable energy spillage. In [75], The coordination among renewable resources and the proper
the authors have used a heuristic strategy to solve the objective of communication among the microgrids and the utility grid are
minimizing CO2 equivalent emissions, the fuel consumption or a critical challenges. Capacities of renewable resources are to be
tradeoff between these two. To reduce uncertainty in forecasted optimized for reliable supply of energy at lower cost. In [90], the
values for PV production or load demand, a smart energy manager optimal capacity planning has been proposed by using evolu-
calculates the generators power references 1 h ahead if necessary. tionary strategy which minimizes capital and annual operational
Specific supply-side and demand-side aspects of buildings and cost of renewable energy subject to a variety of system and unit
campuses have been solved using heuristic methods. These constraints. In [98], the authors have focused on a mathematical
buildings and campuses have on-site renewable generation, sto- model developed to optimally manage the smart polygeneration
rage technologies, electric cars, dynamic pricing, and load man- microgrid in order to minimize daily operational costs and carbon
agement [80]. In [29,150,151], the authors present an idea of dioxide emission. A multi-objective approach has been adopted in
energy sharing among microgrids in a smart microgrid network to [158] to formulate the objective functions focusing on charging/
increase reliability. An algorithm based on heuristic methods has discharging cost, losses and voltage profile. The authors proposed
been used. This reliability means supplying power to the loads an algorithm based on differential evolution to solve the problem.
using the energy generated in the microgrid network without Short Term Load Forecast (STLF) for microgrids has the highly non-
purchasing power from the main grid. A reliable overlay topology smooth and non-linear behavior of the load time series. Char-
design scheme is presented to maximize the usage of renewable acteristics of the load time series of traditional power systems are
energy in the network. The planning issue of distributed gen- described. A new bi-level prediction strategy is presented for STLF
erators at different locations is presented in [81,152]. The authors of microgrids in [159]. The proposed approach is composed of a
have used heuristic methods to tackle the problem. The multi- feature selection technique and a forecast engine (including neural
objective function is normalized to form a minimized optimal cost network and evolutionary algorithm) in the lower level as the
function when the capacities and the number of distributed gen- forecaster. This approach is used as an enhanced differential evo-
erators and the demands at various locations are known. lution algorithm in the upper level to optimize the performance of
In [92,153], the authors have proposed a new active power the forecaster. The proposed prediction strategy is evaluated by
dispatch algorithm capable of managing microgrid generation to the real-life data of a university campus in Canada.
demand online in grid-tied mode. The algorithm also minimizes
the greenhouse gas emissions, and optimizes running costs of 1. Swarm Optimization: In [62], the authors proposed a Glow
distributed resources. A heuristic approach based on cost function Warm Swarm Optimization (GWSO) approach to the problem
of microsources has been tested to solve different power dispatch of optimal sizing of distributed energy resources in medium
optimization problems. The authors argued that their proposed voltage or low voltage microgrids. In [109], the optimization of
scheme outperforms the other state of the art optimization an innovative device operation is presented for traffic energy
methods, in terms of global costs and emissions, system stability harvesting applications. The optimization problem is solved by
and computational resources requirements. means of Particle Swarm Optimization (PSO) to get the best
efficiency and reduce the overall impact on the environment.
2.5.2. Agent based approach The authors in [160] focused on microgrid management in
An agent-based energy-management system is presented in scenarios belonging to unique stakeholder. They proposed a
[69,76] to facilitate power trading among microgrids with demand novel combination of optimization algorithms to exploit differ-
response and distributed storage. This system finds a way to utilize ent control capabilities of the envisioned devices (schedulable,
diversity in load consumption patterns of the end users and dimmable and thermal-like), including renewable sources and
energy availability from the distributed generation and storage. electric vehicle fleets. In [161], the performance of a standalone
The proposed approach facilitates demand response in reducing hybrid system consisting of a wind generator and photovoltaic
the peak demand and minimizing the cost of electricity. Demand (PV) system has been simulated. The authors have used a
side energy management is important for the optimal energy general regression neural network with an improved PSO
planning to reduce the cost of power purchase from the main grid algorithm to extract the maximum power from wind and PV
[154,155,130]. In [110], a framework is proposed that maintains an energy sources. A hybrid renewable energy system with battery
auction market, in which energy sellers and buyers shall practice storage and diesel generator is considered in [162,163]. The
trading. This framework uses distributed energy storage as a part Multi-Objective Particle Swarm Optimization (MOPSO) method
of demand side management. It enables end users with low is used to find the best configuration of the system and for
priority loads to participate in demand response. sizing the components. The PSO algorithm has been used in
In [70], the authors have proposed an agent based intelligent [164,165] to control the flow of the active and reactive power
energy management system to facilitate power trading among between the main grid and the microgrid consisting of dis-
microgrids and allow users to participate in demand response. The tributed generation. The authors argued that the proposed
proposed system uses demand response, diversity in electricity algorithm ensures that the required load power is shared
consumption patterns of the customers and availability of power equally between the microgrid and the utility company.
from distributed generators as the vital sources in managing 2. Ant Colony Optimization: Ant Colony Optimization (ACO)
power in the system. It has been found that multi-agent based method for renewable integrated microgrid is used in an
demand response is successful in decreasing the system peak in intelligent supervisory controller that utilizes dispatch control.
addition to cost benefit for the customers with high priority index. The approach solves the rapid microgrid power management
A distributed agent based microgrid control strategy is presented problem given complex constraints and objectives including
in [156,157] that is capable of coordinating and cooperatively environmental, fuel/resource availability, and economic
A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683 1677
Table 9
Tools used in energy management.
Anylogic [181] General purpose modeling and simulation Control systems, traffic, system dynamics XJ Technologies
tool for discrete, continuous and hybrid manufacturing, supply chain, logistics,
systems, UML-based OO modeling, block- telecom-networks, computer systems,
based flowchart modeling, statecharts (state mechanics, chemical engineering, water
machines), differential and algebraic equa- treatment, military and education
tions and explicit modeling in Java
CPLEX [28,29] An IBM framework with C, Cþ þ , Java, .NET Linear optimization, quadratic convex IBM
and Python libraries, mathematical problem optimization
solver
DigSILENT Power Factory [146] Geographical diagrams and enhanced tools Standard power system analysis needs, DigSILENT
for visualizing topological networks struc- handling wind power and distributed
tures, supporting standards and tests for generation design
power system, integration with GIS, DMS
and EMS
DSTATCOM [141] Compensating device, similar to STATCOM, Acts as a source or sink for reactive power S and C Electric
based on power electronic voltage source on electricity networks, used on AC Company
converter, member of the FACTS family transmission networks
devices
DSpace [182] Open source software for organizations capture and describe digital material DSpace Foundation
using a submission workflow module, or a
variety of programmatic ingest options,
distribute an organization's digital assets
over the web through a search and
retrieval system, preserve digital assets
over the long term
FuseViz [183] A framework for web-based services of Addresses the challenges posed by large, Oracle Corporation
smart environments live, heterogenous, dynamic data streams
from autonomous data sources and lay
user with two basic features fusion and
visualization
GAMS [88,73,85] Algebraic modeling language, High level Modeling and solving linear, non-linear GAMS develop-
modeling system for mathematical optimi- and mixed integer optimization, allows ment Corporation
zation, input format to NEOS server, inte- hybrid algorithms combining different
gration to solvers as BARON, COIN-OR, solvers
CONOPT, CPLEX, DICOPT, GUROBI, MOSEK,
SNOPT and XPRESS
LINDO Global GAMS and LINDOGlobal are same Same applications LINDO Systems
MATLAB/ Simulink Multi-paradigm numerical computing Matrix manipulations, Plotting of func- Math-Works
[64,65,67,68,71,87,129,178,124,185,75,178] environment, fourth generation program- tions and data, implementation of algo-
ming language rithms, creation of user interfaces, com-
patible languages are C, C þ þ, Java,
Fortran
MATPOWER [129] A package of Matlab M. files, simulation too Solving optimal power flow problems PSERC at Cornell
for researchers, planning and analysis too University
power systems
PSCAD/ EMTDC [141,143,111] Simulator used by engineers and research- It is used in planning, designing, devel- Manitoba HVDC
ers for AC power systems, power electronics, oping new concepts, testing ideas, Research Center
HVDC, flexible AC transmission systems understanding what happened when
(FACTS), distribution systems and flexible equipment failed, commissioning, pre-
controllers paration of specification and tender
documents, teaching and research
REST J F [186] Structural style software for development of Used in the designing of HTTP 1.1 and URI, Roy Fielding
Web Services, alternative to distributed describes desired web architecture, iden-
computing SOAP tifies existing problem, compares alter-
native solutions
SIMPLORER [182] A comprehensive suit of tools for simula- Modeling, simulating and analyzing dif- Ansoft corporation
tions, simulation models with electric circuit ferent programs
components, block elements and State
machine structures, graphical interface, fast
and reliable simulation algorithms
SCENRED [73] Tool for the reduction of scenarios modeling Stochastic and deterministic programs GAMS develop-
the random data processes, provides 3 sce- ment Corporation
nario, reduction of algorithms, collection of
C þ þ routines, reduced problem is then
solved in GAMS
VERA [80] A vision screening programm comprised of – Visual tests Visual Technology
different tests as DISTANCE VISUAL ACUITY, Applications, Inc.
FARSIGHTEDNESS, PHORIA
considerations. This method finds Pareto optimal dispatch objective framework is focused to minimize generator annual
solutions for the microgrid [166]. cost, carbon emissions of the overall system and line losses. The
3. Genetic Algorithm: In [84,167], an optimization framework has model uses the hourly power production of distributed energy
been proposed that considers the management of storage resources and the hourly storage element level as decision
systems concentrated at some of the grid buses. The multi- variable. Non-dominated Sorting GA-II (NDSGA-II) approach is
1678 A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683
used to solve the problem. Authors have used genetic algorithm maximum power from the wind and photovoltaic energy sources. The
in [64] to solve the operation scheduling problem in renewable- authors have proposed a general regression neural network with an
powered microgrids. The problem is used to determine the improved particle swarm optimization algorithm.
least-cost unit commitment (UC) and the associated dispatch,
while meeting load, environmental, and system operating 2.5.6. Round robbin approach
requirements. A probability-based idea, namely the probability The power consumption models of transaction and commu-
of self-sufficiency (PSS), is introduced to indicate the probability nication based applications are presented into a modified simple
of microgrid meeting local demand in a self-sufficient manner. power consumption (MSPC) model of a server. The Round Robin
In [18,168], a smart energy management system (SEMS) is (RR) approach is used to select one of the servers for mixed types
proposed to optimize the operation of the microgrid. The SEMS of applications so that the total power consumption of servers can
involves energy storage system (ESS) and modules of power be reduced [108].
forecasting, management and optimization.
A matrix real-coded genetic algorithm (MRC-GA) optimization 2.5.7. Gauss Seidel approach
module is presented to achieve a practical method for load In [87], the Fuzzy logic and Gauss Seidel (GS) approach is used
management involving three different operation policies. The to maximize the balance/revenue due to power trade between
genetic algorithm has been used in [169] to model the operation microgrid and the utility grid. Five different scenarios are tested
of microgrid for the objective of minimizing the operational and for local load and microgrid assembly operation.
maintenance cost. Genetic algorithm has also been used in [170]
for the evaluation of a typical microgrid participating in a power 2.5.8. SD Riccati equation approach
market under hybrid electricity market policy to maximize the The authors have designed an optimal controller to get a tra-
net present worth of the hybrid microgrid consisting of photo- jectory tracking for non-linear systems to minimize a quadratic
voltaic cell, fuel cell and battery bank. A multiobjective optimi- cost function. The developed optimal control law is a result of the
zation has been used in [171] to minimize power generation solution of Hamilton–Jacobi–Bellman (HJB) and SD Riccati equa-
cost and to maximize the useful life of lead–acid batteries. The tions. The HJB equation is used for state-dependent coefficient
authors have used nondominated sorting genetic algorithm to factorized non-linear systems. The presented scheme is used to
solve the problem. A multiobjective approach to multi- ensure an efficient power flow exchange between different sour-
microgrid system design has been proposed in [172,173] to ces in a microgrid with the help of power converters [89].
maximize the utility of microgrid system components.
2.6. Tools used to solve energy management problem
2.5.4. Model predictive control approach
A multi-objective framework has been considered in [65,174–176] Table 9 presents a collection of tools used to solve the problems
to model the energy management in microgrids. The proposed model of energy management in microgrids. Their use in particular work
considers the microgrid to be composed of distributed generation, grid are discussed below.
connection, energy storage elements and various loads. Model Pre-
dictive Control (MPC) approach is used to minimize energy cost and 2.6.1. Anylogic
maximization of battery's lifetime simultaneously. For these objectives, Anylogic is a general purpose modeling and simulation tool for
microgrid central controller has to find the best pattern of charging discrete, continuous and hybrid systems. The simulation uses an
and discharging the battery. Energy management problem is solved agent based and system dynamics modeling. In [181], a draft
using Model Predictive Control (MPC) to maximize the economical model has been developed in Anylogic using system dynamics to
benefit of the microgrid while minimizing the use cost of each storage demonstrate basic features of several smart houses, equipped with
system [72]. The MPC approach is used to solve the optimization demand side management capabilities, renewable resources, dis-
problem of maximizing the economical benefit and minimizing the tributed storage and basic electricity price base consumption
degradation causes of each storage system. In order to capture both controller. Obtained results were close to the desired results.
continuous/discrete dynamics and switching between different oper-
ating conditions, the plant is modeled with the framework of mixed 2.6.2. CPLEX
logic dynamic (MLD) [74,177]. In [28] Cost-Aware Smart Microgrid Network (CoSMoNet)
design scheme is presented. This scheme enables economic power
2.5.5. Neural network approach transactions within the SMGN. CoSMoNet is based on an Integer
The Artificial Neural Networks (ANN) approach can be used to Linear Programming (ILP) formulation that has been solved using
forecast load and availability of energy resources at microgrids in CPLEX. This problem compares the excess energy in the storage
different daily, seasonal, and yearly scenarios. For example, the layered units of a group of smart microgrids to the demands of other
ANNs strategy is developed and trained with Levenberg–Marqurardt microgrids whose load cannot be accommodated by themselves.
Back Propagation algorithm in [178]. The proposed idea can be used in Obtained results show that CoSMoNet provides cost-efficient
today's real time energy infrastructure to minimize the risks of future power transactions among microgrid communities, increased
energy crisis with enhanced reliability and smooth cooperation among utilization of renewable energy, reduced load on the grid and
microgrids deployed at different locations. In [179], the authors pre- dependency of the microgrids to the utility grid. Similarly, CPLEX is
sented a hybrid artificial intelligence technique comprising of simu- used to solve the problem of energy sharing among different
lated annealing (SA) and ant colony optimization (ACO) techniques to microgrids in Smart Microgrid Network (SMN) [29].
solve a complex energy resource management problem with a large
number of resources, including electric vehicles connected to the 2.6.3. DigSILENT Power Factory
electric network. A new recurrent neural network approach has been DigSILENT Power Factory tool is used to solve the approach
proposed in [180] to determine the optimal amount of power over a proposed by the Swiss2Grid project. The proposed method is a
time horizon of one week for hybrid renewable energy resources in decentralized approach to load management. A household uses a
order to minimize the power acquired from the utility grid and to local algorithm, based on voltage and frequency measures, shifts
maximize the power generation from renewable energy sources. An the pre-emptiable loads relative to time. The approach helps to
optimization framework has been proposed in [161] to extract the minimize the costs for the consumer and to maximize the grid
A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683 1679
stability. The voltage drop of low voltage network is evaluated interconnection with other microgrids on each microgrid's secur-
using the DIgSILENT grid simulator. For each time step, the ity and reliability as measured using standard risk indices [129].
household simulator determines the load imposed on the grid at
the point of common coupling. Such data is automatically impor- 2.6.10. PSCAD/EMTDC
ted in DIgSILENT, and a power-flow computation is triggered [146]. The proposed power control, energy sharing and management
among distributed energy resources in multiple interconnected
2.6.4. DSTATCOM microgrids is validated through extensive simulation studies using
In [141], the interconnected microgrids share, energy available PSCAD/EMTDC [141,143,111].
form renewable energy resources, the surplus energy among their
neighbors. This requires a control mechanism for voltage regula- 2.6.11. Java REST services developed in Glassfish 3.1 application
tion. DSTATCOM is used to solve this challenge. server
A potentially common platform in a smart grid city requires fast
2.6.5. DSpace development of applications for energy services. Such energy
DSpace is used to test a model of composite energy storage sys- services have been analyzed and implemented in a wider enter-
tem. This system involves battery and ultra-capacitors with dynamic prize system architecture. The authors provide an insight on the
energy management in a microgrid. This proposed power converter functionality, usage, development, challenges and experience of
configuration and the energy management scheme can actively energy services. All the services have been implemented as Jave
distribute the power demand among the different energy storage REST services on Glassfish 3.1 Application server [186].
elements. Results are presented to show the feasibility of the pro-
posed scheme [182]. 2.6.12. SIMPLORER
SIMPLORER is used to test a model of composite energy storage
2.6.6. FuseViz system [182]. The system involves battery and ultra-capacitors with
In [183], the FuseViz is used to develop a web-based application dynamic energy management in microgrids. This proposed power
for integrated electricity consumption and contextual information converter configuration and the energy management scheme can
visualization. actively distribute the power demand among the different energy
storage elements.
2.6.7. GAMS
GAMS is an algebraic modeling language, high level modeling 2.6.13. SCENRED
system for mathematical optimization, input format to NEOS server SCENRED has been used to solve multi-objective formulation of
and integration to solvers such as BARON, COIN-OR, CONOPT, CPLEX, power exchange with the main grid, the startup and shutdown costs,
DICOPT, GUROBI, MOSEK, SNOPT and XPRESS. Applications are for the operating cost, the payment for demand response load, the pen-
modeling and solving linear, non-linear and mixed integer optimiza- alty costs for involuntary load curtailment, and renewable energy
tion. The tool supports hybrid algorithms combining different solvers. spillages [73].
GAMS is used to solve the objective function of power exchange with
the main grid, the startup and shutdown costs, the operating cost of 2.6.14. VERA
distributed generators (DGs), the payment for demand response load, VERA can solve a combination of problems including unit com-
the penalty costs for load and renewable energy spillage [88,73,85]. mitment, economic dispatch, fuel switching, balancing of local gen-
eration with utility purchases, and optimal utilization of the capacity of
2.6.8. MATLAB/Simulink storage devices. VERA is used to formulate the supply-side problem
MATLAB is a multi-paradigm numerical computing environ- with the integration of renewable generation and storage [80].
ment. It is 4th generation programming language and used for
matrix manipulations, plotting of functions and data, imple-
mentation of algorithms and creation of user interfaces. Compa- 3. Conclusion and future work
tible languages are C, C þ þ , Java and Fortran. The tool is being
widely used in solving the problems of energy management. In this paper, we provide a compendium of optimization objectives,
Home appliance and operation scheduling problems, multi- constraints, tools and algorithms for energy management in micro-
objective energy management problems, analysis, modeling and grids. The paper also provides the detailed discussion of optimization
simulation problems of microgrids are being solved using MATLAB techniques, solution approaches and tools used to solve energy man-
[64,65,67,68,71,87,129,178,78,81,184]. Simulink is a data flow agement problem in microgrids. A brief review of Linear optimization,
graphical programming language. It has customizable set of block non-linear optimization, integer and mixed integer optimization and
libraries and has tight integration with rest of MATLAB environ- stochastic optimization is also described for Microgrid energy man-
ment. Applications include modeling, simulating, control theory agement. A number of approaches have been used by the research
and digital signal processing for multi-domain dynamic systems. community to solve the energy management problem in microgrids.
In microgrids, it is used to solve the problems of optimal auto- The approaches include heuristic, agent-based, model predictive con-
mation level, modeling and simulation, environmental and eco- trol, evolutionary algorithms, round robbin, Gauss Seidel, and SD
nomical optimization of long term planning [124,185,75,178]. Riccati equation. The tools used to solve energy management problem
include the Anylogic, CPLEX, DigSILENT Power Factory, GAMS, Matlab/
2.6.9. MATPOWER Simulink, MATPOWER, PSCAD/EMTDC, SIMPLORER, SCENRED and
MATPOWER is used to support a simulation framework that VERA. This work will provide foundation for further investigation of
utilizes sequential Monte Carlo simulations to investigate the the cost effective energy management techniques for Smart Microgrid
performance of autonomous microgrids. In autonomous system, Network (SMN).
microgrids have the ability to interconnect to achieve adequate
load service. In order to minimize the exposure of each microgrid References
to vulnerabilities, minimal number of interconnections is desired.
Various simulation results show the impact of storage capacity, [1] Farhangi H. The path of the smart grid. IEEE Power Energy Mag 2010;8
intermittent distributed energy resources (DERs) and (1):18–28.
1680 A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683
[2] Green K, González SR, Wijtvliet R. Innovative energy storage solutions for [31] Cox, W, Considine T. Structured energy: microgrids and autonomous trans-
future electromobility in smart cities. In: Proceedings of the conference on active operation. In: 2013 IEEE PES innovative smart grid technologies (ISGT).
design, automation and test in Europe. EDA Consortium; 2013. p. 1730–4. IEEE; 2013. p. 1–6.
[3] Kroposki B, Basso T, DeBlasio R. Microgrid standards and technologies. In: [32] Fathima AH, Palanisamy K. optimization in microgrids with hybrid energy
Power and energy society general meeting-conversion and delivery of electrical systems—a review. Renew Sustain Energy Rev 2015;45:431–46.
energy in the 21st century, 2008 IEEE. IEEE; 2008. p. 1–4. [33] Basu AK, Chowdhury S, Chowdhury S, Paul S. Microgrids: energy manage-
[4] Belmoubarik S, Bilil H, Aniba G, Hayar A. Power management for collabora- ment by strategic deployment of dersa comprehensive survey. Renew Sus-
tive microgrids. In: 2013 20th international conference on telecommunica- tain Energy Rev 2011;15(9):4348–56.
tions (ICT). IEEE; 2013. p. 1–5. [34] Palizban O, Kauhaniemi K, Guerrero JM. Microgrids in active network man-
[5] Gouveia C, Moreira C, Lopes J. Microgrids emergency management exploiting agement part i: Hierarchical control, energy storage, virtual power plants,
ev, demand response and energy storage units. In: 2013 IEEE Grenoble and market participation. Renew Sustain Energy Rev 2014;36:428–39.
PowerTech (POWERTECH). IEEE; 2013. p. 1–6. [35] Omid Palizban, Kauhaniemi Kimmo, Guerrero. Josep M. Microgrids in active
[6] Gallardo-Lozano J, Milanés-Montero MI, Guerrero-Martínez MA, Romero- network management–Part II: Hierarchical control, energy storage, virtual
Cadaval E. Electric vehicle battery charger for smart grids. Electric Power Syst power plants, and market participation. Renew. Sustain. Energy Rev.
Res 2012;90:18–29. 2014;36:428–39.
[7] Suryanarayanan S, Rietz R, Mitra J. A framework for energy management in [36] Zhou K, Yang S, Chen Z, Ding S. Optimal load distribution model of microgrid
customer-driven microgrids. In: 2010 IEEE power and energy society general in the smart grid environment. Renew. Sustain. Energy Rev. 2014;35:304–10.
[37] Rémy Rigo-Mariani, Sareni Bruno, Roboam Xavier, Turpin Christophe. Opti-
meeting. IEEE; 2010. p. 1–4.
mal power dispatching strategies in smart-microgrids with storage. Renew.
[8] Etz R, Patarau T, Daraban S, Petreus D. Microgrid model for fast development
Sustain. Energy Rev. 2014;40:649–58.
of energy management algorithms. In: 2012 35th international spring
[38] Gu W, Wu Z, Bo R, Liu W, Zhou G, Chen W, et al. Modeling, planning and
seminar on electronics technology (ISSE). IEEE; 2012. p. 297–302.
optimal energy management of combined cooling, heating and power
[9] Stamp J, Stinebaugh J. Microgrid modeling to support the design processes.
microgrid: a review. Int J Electric Power Energy Syst 2014;54:26–37.
In: 2012 IEEE power and energy society general meeting. IEEE; 2012. p. 1–1.
[39] Gamarra C, Guerrero JM. computational optimization techniques applied to
[10] Li Z, Yang F, Mohagheghi S, Wang Z, Tournier J, Wang Y. Toward smart dis-
microgrids planning: a review. Renew Sustain Energy Rev 2015;48:413–24.
tribution management by integrating advanced metering infrastructure.
[40] Serna Suarez I, Ordonez-Plata G, Carrillo-Caicedo G. Microgrid's energy
Electric Power Syst Res 2013;105:51–6. management systems: a survey. In: 2015 12th international conference on
[11] Ding M, Zhang Y, Mao M. Key technologies for microgrids—a review. In: the European energy market (EEM). IEEE; 2015. p. 1–6.
International conference on sustainable power generation and supply, 2009. [41] Hernandez L, Baladron C, Aguiar JM, Carro B, Sanchez-Esguevillas AJ, Lloret J,
SUPERGEN'09. IEEE; 2009. p. 1–5. et al. A survey on electric power demand forecasting: future trends in smart
[12] Brenna M, Falvo M, Foiadelli F, Martirano L, Massaro F, Poli D, et al. Chal- grids microgrids and smart buildings. IEEE Commun Surv Tutor 2014;16
lenges in energy systems for the smart-cities of the future. In: 2012 IEEE (3):1460–95.
international energy conference and exhibition (ENERGYCON). IEEE; 2012. p. [42] Hippert HS, Pedreira CE, Souza RC. Neural networks for short-term load fore-
755–62. casting: a review and evaluation. IEEE Trans Power Syst 2001;16(1):44–55.
[13] Mariam L, Basu M, Conlon MF. A review of existing microgrid architectures. J [43] Fu Q, Nasiri A, Bhavaraju V, Solanki A, Abdallah T, Yu DC. Transition man-
Eng 2013;2013. agement of microgrids with high penetration of renewable energy; 2014.
[14] Suryanarayanan S, Mitra J. Enabling technologies for the customer-driven [44] Tran D, Khambadkone AM. Energy management for lifetime extension of
microgrid. In: IEEE power & energy society general meeting, 2009. PES'09. energy storage system in micro-grid applications; 2013.
IEEE; 2009, p. 1–3. [45] Schmitt L, Kumar J, Sun D, Kayal S, Venkata S. Ecocity upon a hill: microgrids and
[15] Vasquez JC, Guerrero JM, Miret J, Castilla M, De Vicuna LG. Hierarchical the future of the European city. IEEE Power Energy Mag 2013;11(4):59–70.
control of intelligent microgrids. IEEE Ind Electron Mag 2010;4(4):23–9. [46] U.S. Department of Energy, “grid 2030—a national vision for electricity's
[16] Liu N, Tang Q, Zhang J, Fan W, Liu J. A hybrid forecasting model with para- second 100 years”. Technical report. Available: 〈http://www.ferc.gov/event
meter optimization for short-term load forecasting of micro-grids. Appl calendar/files/20050608125055-grid-2030.pdf〉.
Energy 2014;129:336–45. [47] DeForest N. Integration & operation of a microgrid at Santa Rita jail; 2012.
[17] Hernández L, Baladrón C, Aguiar JM, Carro B, Sánchez-Esguevillas A, Lloret J. [48] Marnay C, DeForest N, Lai J. A green prison: the santa rita jail campus
Artificial neural networks for short-term load forecasting in microgrids microgrid. In: Power and energy society general meeting, 2012 IEEE. IEEE;
environment. Energy 2014;75:252–64. 2012. p. 1–2.
[18] Chen C, Duan S, Cai T, Liu B, Hu G. Smart energy management system for [49] Romankiewicz J. International microgrid assessment: governance, incen-
optimal microgrid economic operation. IET Renew Power Gener 2011;5 tives, and experience (imagine). In: The European council for an energy-
(3):258–67. efficient economy? s 2013 summer study on energy efficiency, Hyeres,
[19] Niknam T, Azizipanah-Abarghooee R, Narimani MR. An efficient scenario- France, June 3–8 2013; 2014.
based stochastic programming framework for multi-objective optimal [50] Hittinger E, Wiley T, Kluza J, Whitacre J. Evaluating the value of batteries in
micro-grid operation. Appl Energy 2012;99:455–70. microgrid electricity systems using an improved energy systems model.
[20] Kuznetsova E, Li Y-F, Ruiz C, Zio E. An integrated framework of agent-based Energy Convers Manag 2015;89:458–72.
modelling and robust optimization for microgrid energy management. Appl [51] Gaonkar DN, Jayalakshmi N, Raghvendra P. Performance study of roof top
Energy 2014;129:70–88. wind solar microgrid system in isolated mode of operation. In: 2014 IEEE
[21] Marzband M, Sumper A, Ruiz-Álvarez A, Domínguez-García JL, Tomoiagă B. international conference on power electronics, drives and energy systems
Experimental evaluation of a real time energy management system for stand- (PEDES). IEEE; 2014. p. 1–6.
alone microgrids in day-ahead markets. Appl Energy 2013;106:365–76. [52] Speer B, Miller M, Schaffer W, Gueran L, Reuter A, Jang B, et al. role of smart
[22] Velik R, Nicolay P. Grid-price-dependent energy management in microgrids grids in integrating renewable energy. In: National renewable energy
laboratory (NREL), Golden, CO, United States. Technical report; 2015.
using a modified simulated annealing triple-optimizer. Appl Energy
[53] Alford R, Dean M, Hoontrakul P, Smith P. Power systems of the future: the
2014;130:384–95.
case for energy storage, distributed generation, and microgrids. Zpryme
[23] Mohamed A, Mohammed O. Real-time energy management scheme for
Research & Consulting. Technical report; 2012.
hybrid renewable energy systems in smart grid applications. Electric Power
[54] Bayindir R, Hossain E, Kabalci E, Billah KMM. Investigation on North Amer-
Syst Res 2013;96:133–43.
ican microgrid facility. Int J Renew Energy Res 2015;5(2):558–74.
[24] Ammad-uddin M. Performance analysis of centralized, distributed and
[55] Ranaboldo M, Domenech B, Reyes GA, Ferrer-Martí L, Moreno RP, García-
hybrid demand load control architecture for smart power grid. In: 2013 IEEE
Villoria A. Off-grid community electrification projects based on wind and
energytech. IEEE; 2013. p. 1–6. solar energies: a case study in nicaragua. Solar Energy 2015;117:268–81.
[25] Mohamed A, Salehi V, Mohammed O. Real-time energy management algo- [56] Paleta R, Pina A, Santos Silva C, et al. Polygeneration energy container:
rithm for mitigation of pulse loads in hybrid microgrids. IEEE Trans Smart designing and testing energy services for remote developing communities.
Grid 2012;3(4):1911–22. IEEE Trans Sustain Energy 2014;5(4):1348–55.
[26] Olivares DE, Cañizares CA, Kazerani M. A centralized optimal energy man- [57] Domenech B, Ferrer-Martí L, Lillo P, Pastor R, Chiroque J. A community
agement system for microgrids. In: 2011 IEEE power and energy society electrification project: combination of microgrids and household systems fed
general meeting. IEEE; 2011. p. 1–6. by wind, PV or micro-hydro energies according to micro-scale resource
[27] Iqbal M, Azam M, Naeem M, Khwaja A, Anpalagan A. Optimization classifi- evaluation and social constraints. Energy for Sustain. Dev. 2014;23:275–85.
cation, algorithms and tools for renewable energy: a review. Renew Sustain [58] Eichman J, Harrison KW, Peters M. Novel electrolyzer applications: providing
Energy Rev 2014;39:640–54. more than just hydrogen. National Renewable Energy Laboratory; 2014.
[28] Erol-Kantarci M, Kantarci B, Mouftah HT. Cost-aware smart microgrid net- [59] Del N, EA ODN. United States Department of Energy; 2015.
work design for a sustainable smart grid. In: 2011 IEEE GLOBECOM work- [60] Fregosi D, Ravula S, Brhlik D, Saussele J, Frank S, Bonnema E, et al. Com-
shops (GC Wkshps). IEEE; 2011. p. 1178–82. parative study of dc and ac microgrids in commercial buildings across dif-
[29] Erol-Kantarci M, Kantarci B, Mouftah HT. Reliable overlay topology design for ferent climates and operating profiles: Preprint. NREL (National Renewable
the smart microgrid network. IEEE Netw 2011;25(5):38–43. Energy Laboratory (NREL), Golden, CO, United States). Technical report; 2015.
[30] Sortomme E, El-Sharkawi M. Optimal power flow for a system of microgrids [61] Kuramochi T, Ramírez A, Turkenburg W, Faaij A. Techno-economic prospects
with controllable loads and battery storage. In: Power systems conference for CO2 capture from distributed energy systems. Renew Sustain Energy Rev
and exposition, 2009. PSCE'09. IEEE/PES. IEEE; 2009. p. 1–5. 2013;19:328–47.
A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683 1681
[62] Riva Sanseverino E, Di Silvestre M, Graditi G. A generalized framework for [90] Logenthiran T, Srinivasan D, Khambadkone AM, Sundar Raj T. Optimal sizing
optimal sizing of distributed energy resources in micro-grids using an of distributed energy resources for integrated microgrids using evolutionary
indicator-based swarm approach; 2013. strategy. In: 2012 IEEE congress on evolutionary computation (CEC). IEEE;
[63] Adika CO, Wang L. Autonomous appliance scheduling for household energy 2012. p. 1–8.
management; 2013. [91] Kumar Nunna H, Doolla S. Multiagent-based distributed-energy-resource
[64] Zhao B, Shi Y, Dong X, Luan W, Bornemann J. Short-term operation sche- management for intelligent microgrids. IEEE Trans Ind Electron 2013;60
duling in renewable-powered microgrids: a duality-based approach; 2014. (4):1678–87.
[65] Hooshmand A, Asghari B, Sharma R. A novel cost-aware multi-objective [92] Alvarez E, Lopez AC, Gómez-Aleixandre J, de Abajo N. On-line minimization
energy management method for microgrids. In: 2013 IEEE PES innovative of running costs, greenhouse gas emissions and the impact of distributed
smart grid technologies (ISGT). IEEE; 2013. p. 1–6. generation using microgrids on the electrical system. In: 2009 IEEE PES/IAS
[66] Duan L, Zhang R. Dynamic contract to regulate energy management in conference on sustainable alternative energy (SAE). IEEE; 2009. p. 1–10.
microgrids. In: 2013 IEEE international conference on smart grid commu- [93] Gamez Urias ME; Sanchez EN; Ricalde LJ, Electrical Microgrid optimization
nications (SmartGridComm). IEEE; 2013. p. 660–5. via a new recurrent neural network, in Systems Journal, IEEE, vol. 9, 3, p.
[67] Ma K, Hu G, Spanos CJ. Energy consumption scheduling in smart grid: A non- 945–953, 2015. http://dx.doi.org/10.1109/JSYST.2014.2305494.
cooperative game approach. In: 2013 9th Asian control conference (ASCC). [94] Kriett PO, Salani M. Optimal control of a residential microgrid. Energy
IEEE; 2013. p. 1–6. 2012;42(1):321–30.
[68] Adika CO, Wang L. Energy management for a customer owned grid-tied [95] Mehleri E, Sarimveis H, Markatos N, Papageorgiou L. Optimal design and
photovoltaic micro generator. In: 2013 IEEE power and energy society gen- operation of distributed energy systems: application to Greek residential
eral meeting (PES). IEEE; 2013. p. 1–5. sector. Renew Energy 2013;51:331–42.
[69] Kumar Nunna H, Doolla S. Energy management in microgrids using demand [96] Hristiyan Kanchev, Colas Francis. Vladimir Lazarov, Bruno Francois. Emission
response and distributed storages multiagent approach. IEEE Trans Power reduction and economical optimization of an urban microgrid operation
Deliv 2013;28(20):939–47. including dispatched pv-based active generators. Sustainable Energy, IEEE
[70] Nunna H, Doolla S. Demand response in smart distribution system with Transactions on 2014;5(4):1397–405.
multiple microgrids. IEEE Trans Smart Grid 2012;3(40):1641–9. [97] Khodr H, El Halabi N, García-Gracia M. Intelligent renewable microgrid
[71] Jiang Q, Xue M, Geng G. Energy management of microgrid in grid-connected scheduling controlled by a virtual power producer: a laboratory experience.
and stand-alone modes. IEEE Trans Power Syst 2013;28(30):3380–9. Renew Energy 2012;48:269–75.
[72] Garcia F, Bordons C. Optimal economic dispatch for renewable energy [98] Bracco S, Delfino F, Pampararo F, Robba M, Rossi M. A mathematical model
microgrids with hybrid storage using model predictive control. In: IECON for the optimal operation of the university of genoa smart polygeneration
2013-39th annual conference of the IEEE industrial electronics society. IEEE; microgrid: evaluation of technical, economic and environmental perfor-
2013. p. 7932–7. mance indicators. Energy 2014;64:912–22.
[73] Nguyen DT, Le LB. Optimal energy management for cooperative microgrids [99] Mehleri ED, Sarimveis H, Markatos NC, Papageorgiou LG. A mathematical
with renewable energy resources. In: 2013 IEEE international conference on programming approach for optimal design of distributed energy systems at
smart grid communications (SmartGridComm). IEEE; 2013. p. 678–83. the neighbourhood level. Energy 2012;44(10):96–104.
[74] Garcia F, Bordons C. Regulation service for the short-term management of [100] Shadmand Mohammad B, Robert S. Balog. Multi-objective optimization and
renewable energy microgrids with hybrid storage using model predictive design of photovoltaic-wind hybrid system for community smart DC
control. In: IECON 2013-39th annual conference of the IEEE industrial elec- microgrid. Smart Grid. IEEE Transactions on 2014;5(5):2635–43.
tronics society. IEEE; 2013. p. 7962–7. [101] Alvarez E, Campos AM, Arboleya P, Gutiérrez AJ. Microgrid management with
[75] Kanchev H, Lazarov V, Francois B. Environmental and economical optimi- a quick response optimization algorithm for active power dispatch. Int J
zation of microgrid long term operational planning including pv-based Electric Power Energy Syst 2012;43(1):465–73.
active generators. In: 2012 15th international power electronics and [102] Chaouachi A, Kamel RM, Andoulsi R, Nagasaka K. Multiobjective intelligent
motion control conference (EPE/PEMC); September 2012. p. LS4b–2.1–1– energy management for a microgrid. IEEE Trans Ind Electron 2013;60
LS4b–2.1–8. (4):1688–99.
[76] Kuznetsova E, Ruiz C, Li Y-F, Zio E. Analysis of robust optimization for [103] Hemmati M, Amjady N, Ehsan M. System modeling and optimization for
decentralized microgrid energy management under uncertainty. Int J Electric islanded micro-grid using multi-cross learning-based chaotic differential
Power Energy Syst 2015;64:815–32. evolution algorithm. Int J Electric Power Energy Syst 2014;56:349–60.
[77] Asimakopoulou GE; Vlachos AG; Hatziargyriou ND, Hierarchical decision [104] Igualada L, Corchero C, Cruz-Zambrano M, Heredia F-J. Optimal energy
making for aggregated energy management of distributed resources. In: management for a residential microgrid including a vehicle-to-grid system.
proceedings of the power systems, IEEE Transactions on, vol. 30, 6, p.3255– IEEE Trans Smart Grid 2014;5(July (4)):2163–72.
3264, 2015. [105] Moradi MH, Eskandari M. A hybrid method for simultaneous optimization of
[78] Nguyen TA, Crow ML. Optimization in energy and power management for dg capacity and operational strategy in microgrids considering uncertainty in
renewable-diesel microgrids using dynamic programming algorithm. In: electricity price forecasting. Renew Energy 2014;68:697–714.
2012 IEEE international conference on cyber technology in automation, [106] Nunna H, Doolla S. Demand response in smart microgrids. In: 2011 IEEE PES
control, and intelligent systems (CYBER). IEEE; 2012. p. 11–6. innovative smart grid technologies—India (ISGT India). IEEE; 2011. p. 131–6.
[79] Zhang Y, Gatsis N, Giannakis GB. Robust energy management for microgrids [107] Parise G, Martirano L, Parise L. Ecodesign of ever net-load microgrids. In:
with high-penetration renewables. IEEE Trans Sustain Energy 2013;4 2012 IEEE industry applications society annual meeting (IAS). IEEE, 2012, p.
(4):944–53. 1–6.
[80] Stluka P, Godbole D, Samad T. Energy management for buildings and [108] Enokido T, Takizawa M. An integrated power consumption model for dis-
microgrids. In: 2011 50th IEEE conference on decision and control and Eur- tributed systems. IEEE Trans Ind Electron 2013;60(2):824–36.
opean control conference (CDC-ECC). IEEE; 2011. p. 5150–7. [109] Pirisi A, Grimaccia F, Mussetta M. An innovative device for energy harvesting
[81] Lin N, Zhou B, Wang X. Optimal placement of distributed generators in in smart cities. In: 2012 IEEE international energy conference and exhibition
micro-grid. In: 2011 International conference on consumer electronics, (ENERGYCON). IEEE; 2012. p. 39–44.
communications and networks (CECNet). IEEE; 2011. p. 4239–42. [110] Nunna H, Doolla S. An intelligent energy management framework to incor-
[82] Viral R, Khatod D. Optimal planning of distributed generation systems in dis- porate demand response and storage in microgrids. In: 2012 annual IEEE
tribution system: a review. Renew Sustain Energy Rev 2012;16(70):5146–65. India conference (INDICON); December 2012. p. 1063–8.
[83] Pepermans G, Driesen J, Haeseldonckx D, Belmans R, Dhaeseleer W. Dis- [111] Solanki A, Montoya LF, Fu Q, Nasiri A, Bhavaraju V, Abdallah T, et al. Managing
tributed generation: definition benefits and issues. Energy Policy 2005;33 intermittent renewables in a microgrid. In: 2012 IEEE PES innovative smart
(60):787–98. grid technologies (ISGT). IEEE; 2012. p. 1–6.
[84] Corso G, Di Silvestre ML. Ippolito M, Sanseverino ER, Zizzo G. Multi-objective [112] Quiggin D, Cornell S, Tierney M, Buswell R. A simulation and optimisation
long term optimal dispatch of distributed energy resources in micro-grids. study: towards a decentralised microgrid, using real world fluctuation data.
In: 2010 45th international universities power engineering conference Energy 2012;41(1):549–59.
(UPEC). IEEE; 2010. p. 1–5. [113] Kaur S, Kumbhar G, Sharma J. A minlp technique for optimal placement of
[85] Ng SK, Zhong J. Smart dispatch of controllable loads with high penetration of multiple dg units in distribution systems. Int J Electric Power Energy Syst
renewables. In: 2012 IEEE PES transmission and distribution conference and 2014;63:609–17.
exposition (T&D). IEEE; 2012. p. 1–6. [114] Mazzola S, Astolfi M, Macchi E. A detailed model for the optimal management
[86] Hino H, Shen H, Murata N, Wakao S, Hayashi Y. A versatile clustering method of a multigood microgrid. Appl Energy 2015;154:862–73.
for electricity consumption pattern analysis in households. IEEE Trans Smart [115] Silvente J, Kopanos GM, Pistikopoulos EN, Espuña A. A rolling horizon opti-
Grid 2013;4(2):1048–57. mization framework for the simultaneous energy supply and demand plan-
[87] Manjili Y, Rajaee A, Jamshidi M, Kelley B. Intelligent decision making for ning in microgrids. Appl Energy 2015;155:485–501.
energy management in microgrids with air pollution reduction policy. In: [116] van der Kam M, van Sark W. Smart charging of electric vehicles with pho-
2012 7th international conference on system of systems engineering (SoSE); tovoltaic power and vehicle-to-grid technology in a microgrid; a case study.
July 2012. p. 13–8. Appl Energy 2015;152:20–30.
[88] Asimakopoulou GE, Dimeas AL, Hatziargyriou ND. Leader–follower strategies [117] Wakui T, Kinoshita T, Yokoyama R. A mixed-integer linear programming
for energy management of multi-microgrids; 2013. approach for cogeneration-based residential energy supply networks with
[89] Ornelas-Tellez F, Jesus Rico-Melgoza J. Optimal tracking control for energy power and heat interchanges. Energy 2014;68:29–46.
management systems in microgrids. In: 2013 IEEE 56th international mid- [118] Zhang D, Shah N, Papageorgiou LG. Efficient energy consumption and
west symposium on circuits and systems (MWSCAS). IEEE; 2013. p. 489–92. operation management in a smart building with microgrid. Energy Convers
1682 A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683
Manag 2013;74:209–22 [Online]. Available: 〈http://www.sciencedirect.com/ [145] Zhang M, Chen J. The energy management and optimized operation of
science/article/pii/S0196890413002355〉. electric vehicles based on microgrid. IEEE Trans Power Deliv 2014;29(June
[119] Malysz P, Sirouspour S, Emadi A. An optimal energy storage control strategy (3)):1427–35.
for grid-connected microgrids. IEEE Trans Smart Grid 2014;5(4):1785–96. [146] Rivola D, Giusti A, Salani M, Rizzoli AE, Rudel R, Gambardella LM. A decen-
[120] Bracco S, Dentici G, Siri S. Economic and environmental optimization model tralized approach to demand side load management: the swiss2grid project.
for the design and the operation of a combined heat and power distributed In: IECON 2013-39th annual conference of the IEEE industrial electronics
generation system in an urban area. Energy 2013;55:1014–24. society. IEEE; 2013. p. 4704–9.
[121] Liu L, Ma X, Sun J. An investigation of the relationship between economic [147] Karavas C-S, Kyriakarakos G, Arvanitis KG, Papadakis G. A multi-agent
growth and electricity consumption with different industrial structures in decentralized energy management system based on distributed intelligence
different regions in China. In: 2013 48th international universities' power for the design and control of autonomous polygeneration microgrids. Energy
engineering conference (UPEC). IEEE; 2013. p. 1–6. Convers Manag 2015;103:166–79.
[122] Bonamy Robin, Daniel Chillet, Sébastien Bilavarn, Olivier Sentieys. Power [148] Nandar A, Supriyadi C. Robust pi control of smart controllable load for frequency
consumption model for partial and dynamic reconfiguration. In Reconfigur- stabilization of microgrid power system. Renew Energy 2013;56:16–23.
able Computing and FPGAs (ReConFig), 2012 International Conference on, pp. [149] Al-Saedi W, Lachowicz SW, Habibi D, Bass O. Voltage and frequency reg-
1-8. IEEE, 2012. ulation based dg unit in an autonomous microgrid operation using particle
[123] Comodi G, Giantomassi A, Severini M, Squartini S, Ferracuti F, Fonti A, et al. swarm optimization. Int J Electric Power Energy Syst 2013;53:742–51.
Multi-apartment residential microgrid with electrical and thermal storage [150] Oureilidis KO, Demoulias CS. Microgrid wireless energy management with
devices: Experimental analysis and simulation of energy management stra-
energy storage system. In: 2012 47th international universities power engi-
tegies. Appl Energy 2015;137:854–66.
neering conference (UPEC). IEEE; 2012. p. 1–6.
[124] Khederzadeh M. Optimal automation level in microgrids; 2013.
[151] Song N-O, Lee J-H, Kim H-M, Im YH, Lee JY. Optimal energy management of
[125] Etxeberria A, Vechiu I, Camblong H, Vinassa J-M. Hybrid energy storage
multi-microgrids with sequentially coordinated operations. Energies 2015;8
systems for renewable energy sources integration in microgrids: A review.
(8):8371–90.
In: IPEC, 2010 conference proceedings. IEEE; 2010. p. 532–7.
[152] Wang Z, Chen B, Wang J, Kim J, Begovic MM. Robust optimization based
[126] Mohamed FA, Koivo HN. Multiobjective optimization using mesh adaptive
optimal dg placement in microgrids. IEEE Trans Smart Grid 2014;5(5):2173–
direct search for power dispatch problem of microgrid. Int J Electric Power
Energy Syst 2012;42(1):728–35. 82.
[127] Wang S, Fan X, Han L, Ge L. Improved interval optimization method based on [153] Hussain A, Khan ZH, Khalid A, Iqbal M. A comparison of pulse compression
differential evolution for microgrid economic dispatch. Electric Power techniques for ranging applications. In: Computational intelligence for
Compon Syst 2015;43(16):1882–90. decision support in cyber-physical systems. Springer; 2014. p. 169–91.
[128] Cardoso G, Stadler M, Siddiqui A, Marnay C, DeForest N, Barbosa-Póvoa A, [154] Teive R, Vilvert S. Demand side management for residential consumers by
et al. Microgrid reliability modeling and battery scheduling using stochastic using direct control on the loads; 2002.
linear programming. Electric Power Syst Res 2013;103:61–9. [155] Karnouskos S. Demand side management via prosumer interactions in a
[129] Giacomoni AM, Goldsmith SY, Amin SM, Wollenberg BF. Analysis, modeling, smart city energy marketplace. In: 2011 2nd IEEE PES international con-
and simulation of autonomous microgrids with a high penetration of ference and exhibition on innovative smart grid technologies (ISGT Europe).
renewables. In: 2012 IEEE power and energy society general meeting. IEEE; IEEE; 2011. p. 1–7.
2012. p. 1–6. [156] Colson C, Nehrir M. Agent-based power management of microgrids including
[130] Zakariazadeh A, Jadid S, Siano P. Smart microgrid energy and reserve sche- renewable energy power generation. In: 2011 IEEE power and energy society
duling with demand response using stochastic optimization. Int J Electric general meeting. IEEE; 2011. p. 1–3.
Power Energy Syst 2014;63:523–33. [157] Dobakhshari AS, Azizi S, Ranjbar AM. Control of microgrids: Aspects and
[131] Ioakimidis CS, Oliveira LJ, Genikomsakis KN, Dallas PI. Design, architecture prospects. In: 2011 IEEE international conference on networking, sensing and
and implementation of a residential energy box management tool in a control (ICNSC). IEEE; 2011. p. 38–43.
smartgrid. Energy 2014;75:167–81. [158] Moradi MH, Abedini M, Hosseinian SM. Improving operation constraints of
[132] Mohammadi S, Mozafari B, Solimani S, Niknam T. An adaptive modified microgrid using phevs and renewable energy sources. Renew Energy
firefly optimisation algorithm based on Hong's point estimate method to 2015;83:543–52.
optimal operation management in a microgrid with consideration of uncer- [159] Amjady N, Keynia F, Zareipour H. Short-term load forecast of microgrids by a
tainties. Energy 2013;51:339–48. new bilevel prediction strategy. IEEE Trans Smart Grid 2010;1(3):286–94.
[133] Khodaei A; Bahramirad S; Shahidehpour M, Microgrid Planning Under [160] Enrich R, Skovron P, Tolós M, Torrent-Moreno M. Microgrid management
Uncertainty, In: proceedings of the Power Systems, IEEE Transactions on, vol. based on economic and technical criteria. In: 2012 IEEE international energy
30, no.5, p. 2417–2425, 2015 http://dx.doi.org/10.1109/TPWRS.2014.2361094. conference and exhibition (ENERGYCON). IEEE; 2012. p. 551–6.
[134] Niknam T, Golestaneh F, Malekpour A. Probabilistic energy and operation [161] Ou T-C, Hong C-M. Dynamic operation and control of microgrid hybrid power
management of a microgrid containing wind/photovoltaic/fuel cell genera- systems. Energy 2014;66:314–23.
tion and energy storage devices based on point estimate method and self- [162] Borhanazad H, Mekhilef S, Gounder Ganapathy V, Modiri-Delshad M, Mir-
adaptive gravitational search algorithm. Energy 2012;43(1):427–37. taheri A. Optimization of micro-grid system using mopso. Renew Energy
[135] Niknam T, Golestaneh F, Shafiei M. Probabilistic energy management of a 2014;71:295–306.
renewable microgrid with hydrogen storage using self-adaptive charge [163] Moradi MH, Abedini M, Tousi SR, Hosseinian SM. Optimal siting and sizing of
search algorithm. Energy 2013;49:252–67. renewable energy sources and charging stations simultaneously based on
[136] Arefifar SA, Mohamed Y, El-Fouly TH. Supply-adequacy-based optimal con- differential evolution algorithm. Int J Electric Power Energy Syst
struction of microgrids in smart distribution systems. IEEE Trans Smart Grid 2015;73:1015–24.
2012;3(3):1491–502. [164] Al-Saedi W, Lachowicz SW, Habibi D, Bass O. Power quality enhancement in
[137] Khorramdel B, Raoofat M. Optimal stochastic reactive power scheduling in a autonomous microgrid operation using particle swarm optimization. Int J
microgrid considering voltage droop scheme of dgs and uncertainty of wind
Electric Power Energy Syst 2012;42(1):139–49.
farms. Energy 2012;45(1):994–1006.
[165] Al-Saedi W, Lachowicz SW, Habibi D, Bass O. Power flow control in grid-
[138] Wencong Su, Wang Jianhui, Roh Jaehyung. Stochastic energy scheduling in
connected microgrid operation using particle swarm optimization under
microgrids with intermittent renewable energy resources. Smart Grid, IEEE
variable load conditions. Int J Electric Power Energy Syst 2013;49:76–85.
Transa 2014;5(4):1876–83.
[166] Colson C, Nehrir M, Wang C. Ant colony optimization for microgrid multi-
[139] Zhejing Bao; Qin Zhou; Zhihui Yang; Qiang Yang; Lizhong Xu; Ting Wu. A
objective power management. In: Power systems conference and exposition,
Multi Time-Scale and Multi Energy-Type Coordinated Microgrid Scheduling
2009. PSCE'09. IEEE/PES. IEEE; 2009. p. 1–7.
Solution—Part II: Optimization Algorithm and Case Studies, in Power Sys-
[167] Ustun TS, Ozansoy C, Zayegh A. Distributed energy resources (der) object
tems, IEEE Transa., vol. 30, 5, p. 2267–2277, 2015.
[140] Sechilariu M, Locment F, Wang B. Photovoltaic electricity for sustainable modeling with iec 61850–7–420. In: 2011 21st australasian universities
building efficiency and energy cost reduction for isolated dc microgrid. power engineering conference (AUPEC). IEEE; 2011. p. 1–6.
Energies 2015;8(8):7945–67. [168] Manshadi SD; Khodayar ME, Resilient Operation of Multiple Energy Carrier
[141] Shahnia F, Chandrasena RP, Rajakaruna S, Ghosh A. Autonomous operation of Microgrids, in Smart Grid, IEEE Transactions, 6, (5), p. 2283–2292, 2015
multiple interconnected microgrids with self-healing capability. In: 2013 http://dx.doi.org/10.1109/TSG.2015.2397318.
IEEE power and energy society general meeting (PES). IEEE; 2013. p. 1–5. [169] Provata E, Kolokotsa D, Papantoniou S, Pietrini M, Giovannelli A, Romiti G.
[142] Gavagsaz-Ghoachani R, Martin J-P, Nahid-Mobarakeh B, Davat B. An e- Development of optimization algorithms for the leaf community microgrid.
learning tool for power control and energy management in dc microgrids. Renew Energy 2015;74:782–95.
In: 2013 7th IEEE international conference on e-learning in industrial elec- [170] Mohammadi M, Hosseinian S, Gharehpetian G. Ga-based optimal sizing of
tronics (ICELIE). IEEE; 2013. p. 102–7. microgrid and dg units under pool and hybrid electricity markets. Int J
[143] Wasiak I, Pawelek R, Mienski R, Gburczyk P. Using energy storage for energy Electric Power Energy Syst 2012;35(1):83–92.
management and load compensation in lv microgrids. In: 2012 IEEE 15th [171] Zhao B, Zhang X, Chen J, Wang C, Guo L. Operation optimization of standa-
international conference on harmonics and quality of power (ICHQP). IEEE; lone microgrids considering lifetime characteristics of battery energy storage
2012. p. 904–8. system. IEEE Trans Sustain Energy 2013;4(4):934–43.
[144] Jardini JA, Tahan C, Gouvea M, Ahn SU, Figueiredo F. Daily load profiles for [172] Wei-Yu Chiu; Hongjian Sun; Vincent Poor H. A Multiobjective Approach to
residential, commercial and industrial low voltage consumers. IEEE Trans Multimicrogrid System Design, Smart Grid, IEEE Trans., 6, 5, p. 2263–2272,
Power Deliv 2000;15(1):375–80. 2015 http://dx.doi.org/10.1109/TSG.2015.2399497.
A. Ahmad Khan et al. / Renewable and Sustainable Energy Reviews 58 (2016) 1664–1683 1683
[173] Baldi S, Karagevrekis A, Michailidis IT, Kosmatopoulos EB. joint energy [181] Morvaj B, Lugaric L, Krajcar S. Demonstrating smart buildings and smart grid
demand and thermal comfort optimization in photovoltaic-equipped inter- features in a smart energy city. In: Proceedings of the 2011 3rd international
connected microgrids. Energy Convers Manag 2015;101:352–63. youth conference on energetics (IYCE). IEEE; 2011. p. 1–8.
[174] Prodan I, Zio E. A model predictive control framework for reliable microgrid [182] Zhou H, Bhattacharya T, Tran D, Siew TST, Khambadkone AM. Composite
energy management. Int J Electric Power Energy Syst 2014;61:399–409. energy storage system involving battery and ultracapacitor with dynamic
[175] Parisio A; Rikos E; Glielmo L, A Model Predictive Control Approach to energy management in microgrid applications. IEEE Trans Power Electron
Microgrid Operation Optimization, Control Systems Technology, IEEE Trans., 2011;26(3):923–30.
22, 5, p. 1813–1827, 2014 http://dx.doi.org/10.1109/TCST.2013.2295737. [183] Ghidini G, Das SK. Improving home energy efficiency with e 2 home: A web-
[176] Bruni GS, Mulone Cordiner V, Rocco V, Spagnolo. F. A study on the energy based application for integrated electricity consumption and contextual
management in domestic micro-grids based on Model Predictive Control information visualization. In: 2012 IEEE third international conference on
strategies. Energy Convers. Manag. 2015;102(2015):50–8. smart grid communications (SmartGridComm). IEEE; 2012. p. 471–5.
[177] Kuznetsova E, Li Y-F, Ruiz C, Zio E, Ault G, Bell K. Reinforcement learning for [184] Liu X, Wang P, Loh PC. A hybrid ac/dc microgrid and its coordination control.
microgrid energy management. Energy 2013;59:133–46. IEEE Trans Smart Grid 2011;2(2):278–86.
[178] Jaganmohan Reddy Y, Pavan Kumar Y, Sunil Kumar V, Padma Raju K. Dis- [185] Strelec M, Macek K, Abate A. Modeling and simulation of a microgrid as a
tributed anns in a layered architecture for energy management and main- stochastic hybrid system. In: 2012 3rd IEEE PES international conference and
tenance scheduling of renewable energy hps microgrids. In: 2012 Interna- exhibition on innovative smart grid technologies (ISGT Europe). IEEE; 2012.
tional conference on advances in power conversion and energy technologies p. 1–9.
(APCET). IEEE; 2012. p. 1–6. [186] Karnouskos S, Da Silva PG, Ilic D. Energy services for the smart grid city. In:
[179] Sousa T, Vale Z, Carvalho JP, Pinto T, Morais H. A hybrid simulated annealing 2012 6th IEEE international conference on digital ecosystems technologies
approach to handle energy resource management considering an intensive (DEST). IEEE; 2012. p. 1–6.
use of electric vehicles. Energy 2014;67:81–96.
[180] Gamez Urias ME; Sanchez EN; Ricalde LJ, Electrical Microgrid Optimization
via a New Recurrent Neural Network, in Systems Journal, IEEE, 9, 3, p. 945–
953, 2015 http://dx.doi.org/10.1109/JSYST.2014.2305494.