You are on page 1of 9

Sustainable Energy, Grids and Networks 24 (2020) 100391

Contents lists available at ScienceDirect

Sustainable Energy, Grids and Networks


journal homepage: www.elsevier.com/locate/segan

Long-term profit for electric vehicle charging stations: A stochastic


optimization approach

Erfan Bagherzadeh, Ali Ghiasian , Abdorreza Rabiee
Department of Engineering, Shahrekord University, Iran

article info a b s t r a c t

Article history: Electric vehicles are gradually finding their position as an alternative to fossil fuel vehicles. To
Received 21 February 2020 accelerate the replacement process, a number of new infrastructural facilities such as charging stations
Received in revised form 27 July 2020 (CS) have to be widely deployed. In order to encourage the private sector to invest in this area,
Accepted 17 September 2020
it is necessary to introduce a combination of business and technical model for CS that comprises
Available online 22 September 2020
management tools for guaranteeing their long-term profit. Given that the price of electricity and the
Keywords: number of vehicles drive to the CS are random variables, the proposed model should consider all
Electric vehicle these uncertainties. In this paper, the desired model is introduced by utilizing stochastic optimization
Profit framework. Long-term Durable Profit for Charging Station (DPCS) algorithm is proposed to maximize the
Charging station long-term profit of CS owner. By means of the DPCS algorithm, CS owner can decide on the electricity
Stochastic optimization sales price, vehicle entrance and number of working pumps at each time interval. Simulation results
Delay show that the CS owner would have an increase of 107% in profit at a cost of incurring 80% more
Queue
delay to vehicles. If a parking barrier is used in the CS, the achievable profit would be increased by
12% and the waiting delay of vehicles would be decreased by 25%.
© 2020 Elsevier Ltd. All rights reserved.

1. Introduction retailer [3]. It is of much interest to the investors to intelligently


determine the selling price of energy in such a way that their
Rapid development of electric vehicle (EV) technology is going customers satisfaction is kept at high level while their profit is
to create a considerable revolution in transportation and electric- also guaranteed. One of the prohibiting factor for securing CS
ity industry. The universal EV market was valued at $118,864.5 owner profit is the uncertainty in electricity market price [3],
million in 2017, and is predicted to reach $567,299.8 million which is the price that CS owner has to pay to buy electricity from
by 2025 [1]. The production of electric vehicles is recognized as the grid. A branch of research direction is devoted to predict the
a promising solution to air pollution by reducing emissions of electricity price, e.g. [3–6]. They use different statistical tools to
greenhouse gases [2]. estimate the future price based on the history of previous market
Development of EV technology incorporates a number of new price databases.
Another approach to deal with the uncertainty in electricity
infrastructural facilities into business. One of the inevitable struc-
price is to incorporate the electricity price as a random variable
tural requirements of EVs is charging stations (CS). Similar to
into mathematical models upon which the results are not relied
conventional gas station, CS is a place where EV is plugged to get
on a specific probability distribution function. The complexity
charged. A public CS may have one or several charging pumps as
of deciding on energy selling price increases when the energy
shown in Fig. 1. In fact, EVs might need to recharge their batteries
purchase price is assumed as a random variable from the owner
in daily trips and the assumption that vehicles can always be
of CS viewpoint. But, this approach is much more robust to
charged at home or work place causes practical challenges for environmental impacts on variation of electricity price.
long distance journeys. This has created a new business. Public The selling price should not only cover all the costs of CS, but
CSs similar to gas stations in different locations of city such as also guarantee the long-term profit of the CS owner while keeping
shopping centers and alongside streets and highways is going to customers contentment as well. A business plan in which the
emerge as a subject of personal investment. The CS owner buys long-term investor profits are guaranteed is more likely to be of
electrical energy from the grid and sells it to the EV owner as a interest.
Not only the price, but also the quality of service is impor-
∗ Corresponding author. tant to customers (EV owner is the customer in our proposed
E-mail addresses: erfan710bs@yahoo.com (E. Bagherzadeh), CS model). The customers satisfaction is inversely proportional
ghiasian.ali@sku.ac.ir (A. Ghiasian), rabiee@sku.ac.ir (A. Rabiee). to their waiting time in CS [7] which refers to the delay that

https://doi.org/10.1016/j.segan.2020.100391
2352-4677/© 2020 Elsevier Ltd. All rights reserved.
E. Bagherzadeh, A. Ghiasian and A. Rabiee Sustainable Energy, Grids and Networks 24 (2020) 100391

• An stochastic optimization framework has been proposed


to maximize the long-term profit of a CS owner where the
vehicle arrival, energy purchase price and vehicle SoC were
considered as random variables/parameters.
• Taking into account the above-mentioned randomness in
problem formulation, Durable Profit for Charging Station
(DPCS) algorithm has been devised to maximize the long-
term profit of the CS owner.
• It is proved that DPCS algorithm can get as much close to the
optimal solution as desired by adjusting a control parameter.
The trade-off would be longer delay.
Fig. 1. A Charging Station Model. • In the stochastic optimization problem, in addition to the
energy selling price, the owner of CS could control the
number of working charging pumps.
Table 1
Sample information of the EV charging time [8]. • The impact of installing a parking barrier on the attainable
Vehicle Empty to full charging time profit has also been studied.
Model Battery Range 3.7 kW 7 kW 22 kW 43–50
• Simulation results show how the DPCS algorithm works well
slow fast fast kW rapid in real world.
Nissan LEAF 40 kWh 143 11 h 6 h 6 h 1 h
(2018) miles
The paper will proceed with Section 2 presenting a brief literature
review. Section 3 introduces the system model and problem
Tesla Model S 100 kWh 255 27 h 15 h 6 h 2 h
(2019) miles formulation. The proposed DPCS algorithm is also presented in
Section 3. In Section 4 the performance evaluation of the pro-
Mitsubishi 13.8 kWh 24 4 h 4 h 4 h 40 min
Outlander miles posed algorithm is carried out. Finally, the conclusion of the paper
(2018) is presented in Section 5.

2. Related works
customers tolerate from when they arrive at the CS until the time
As the electric vehicle industry is growing, the scope of as-
they leave the CS by a battery full of charge. After arriving at the
sociated research fields are expanding as well. Some research
CS, the EV may encounter vehicles that have entered the station
studies are dealing with the effect of home plug vehicles on peak
earlier and have not yet left it. Thus, the waiting time of a specific
load shaping [10–12] while some others are working to model
vehicle comprises of two parts:
the probabilistic movement of EVs and their impact on nodal
(a) The queuing time
(b) The time to charge its battery charging demand [13]. Vehicle to grid (V2G) terminology is used
The former is associated to the charging time of queuing in scenarios that EV can discharge its energy to the grid in order to
vehicles in front, while the latter is dependent on the vehicle obtain revenue [14,15]. Smart charging and discharging of EVs in
model, battery SoC, battery capacity (size), charging rate of vehi- V2G could have a great impact on vehicle owner profit maximiza-
cle, charging rate of CS pump and environmental factors. Table 1 tion [9,16,17] as well as load balancing [10,18]. However, those
shows a typical information of EV charging time. The time it takes studies does not consider the long-term profit of the CS owner.
to charge an electric vehicle depends on the battery capacity and Focusing on Quality of Service (QoS) offered to the customers,
the speed (rate) of the charging pumps. The charging time varies [7] has investigated the pricing strategies of maximizing revenue
between 40 min to more than 20 h. For example, Tesla Model S of CS owner in a charging service market without specifically
vehicle which is equipped by a 100 kWh battery needs 15 h to get looking in to the long term characteristics of the solution. The
fully charged with a 7 kW charger. However, if this vehicle plugs QoS is assumed to be inversely proportional to the waiting time
into a rapid charger, the charging time would reduce to 2 h. of the customers where M/M/c1 queuing model is used to analyze
Given that the waiting time is not a deterministic parameter the waiting time of the customers. It is remarkable that the
and the attainable profit of the CS owner is closely related to the arrival and service time of customers have not been proven to
customer waiting time, any proposed CS model should consider be respectively Poisson and Exponential processes in practice.
these random phenomena into account. Not only is the number Therefore, this paper is not limited to M/M/c queuing model.
of vehicles in the queue a random variable, but also their SoC and By using fuzzy queuing theory, the impact of EVs charging on
battery capacity. power grid has been studied in [19].
As stated above, a number of random variables affect the In addition to business and marketing aspects, the emergence
business aspect of CS investment. In this paper, the stochastic op- of CS was the motivation for scientist to conduct researches in
timization method is applied to maximize the long-term profit of other areas related to the EV technology. A branch of studies is
the CS owner while keeping all the mentioned random variables devoted to model the random behavior of EVs and their energy
into account. The overall mathematical framework for long-term demands. In [20] an algorithm was proposed that predicts the
profit maximization in this paper is established at the presence number of EVs in a region and the amount of required energy
of uncertainty in the electricity market price without any prior from CSs. Then according to the forecasting, the location of CSs
assumption on its probability mass function. has been determined. In this paper, the arrival time of vehicles
Its been shown that, when there are a number of random to the CS is modeled by a stochastic process that can have any
events in the system such as the electricity price, the arrival of the arbitrary distribution. Then, the proposed model is able to capture
vehicles to the CS and the state of charge (SoC) of each vehicle, all the random behavior of vehicles.
the short time pricing and scheduling strategy for CS, does not
essentially guarantee the long-term profit of CS owner [9]. So, our 1 M/M/c refers to a classical queuing model in which the arrival process is
main focus in this article is on maximizing the long-term profit. modeled by Poisson, the service time is Exponential random process and the
The contributions of this paper are as follows: number of servers is c.

2
E. Bagherzadeh, A. Ghiasian and A. Rabiee Sustainable Energy, Grids and Networks 24 (2020) 100391

In [21], the optimal location and size of the CS were identified 3. System model
with an analytical framework aimed at minimizing the total cost
of CS construction. Some more budget and grid constraints as In this section, the system model and formulation of the opti-
well as traffic characteristics have been considered in CS localiza- mization problem to maximize the long-term profit of CS owner
tion and placement in [22,23]. While the placement of charging is introduced.
station is of great significance, this paper addresses the problem Consider a CS that has an owner or manager who wants to
of long-term profit optimization, assuming that the localization buy electricity from the grid and to sell it to EVs. The price of
studies are performed and the station is built in the right place. electricity in the market from the owner’s point of view is a
To predict driving behaviors of drivers in an urban area, a large
random process. Fig. 1 shows the proposed CS model.
recorded database of driving cycles have been used in [24], where
The SoC of vehicles and their battery capacity are assumed to
charging locations are assumed to be at home or work place. Then
be random variables. The amount of electricity power required
the impact of EV charging on power system has been studied.
The increasing number of EVs in the grid will lead to new peak by the cars is termed demand. From the CS point of view, cars are
demand. In [25], a decentralized charging control system has been random demands, whose arrival times to the station are random
proposed in which the charging process of the EVs are controlled as well. Time is assumed to be discrete and slotted. In other
in a distributed manner with the aim of increasing the number words, t ∈ {1, 2, . . . , T } and each time slot is called an interval.
of simultaneously charging EVs without the need of more grid An interval is the minimum amount of time a vehicle may need
capacity investment. Investigating the impact of EVs on power to be full charged. The value of demands at interval t is indicated
grid capacity is beyond the scope of this paper. by a(t). In other words, the sum of all vehicle demands entering
The charging rate of each EV can be controlled by dynamically the CS at time interval t is denoted by a(t).
allocating charging power to individual charging connector [26]. It is assumed that the purchase price, f (t), and selling price,
To minimize queuing time and to maximize network capacity s(t), will not change within an interval. At the beginning of each
utilization, an algorithm has been developed in [26] based on fast interval, the station declares the price of the sale of electricity to
charging capability of the CS. the vehicles. In addition, the station must decide at the start of
The business aspect of CS deployment is another emerging each interval how many of its charging pumps, n (t ), will work.
branch of research. The profit maximization problem for CS in- It should be noted that as more charging pumps are working,
vestors has been investigated in [27] where stations are equipped more energy should be purchased from the grid. Another decision
with an energy storage system (ESS). The time horizon of the variable is whether the station accepts new vehicle arrival at the
proposed bidding framework has considered the day-ahead elec-
beginning of each interval or not. This variable is represented by
tricity market and did not take a long time analysis in to account.
m (t ). Then, the CS owner have three decision variables n (t ) , s(t)
The profit maximization of CS owner has been considered by
and m(t) to decide on them at each interval.
dynamic pricing and scheduling of EVs in [17]. The queueing
As stated above, when a vehicle enters the CS, it has a charging
dynamics was simplified in [17] by assuming that each EV re-
quires a constant charging power. It means that the SoC of the demand according to its SoC. The vehicle demands may not be
vehicles are supposed to be a constant value. Another assumption served over an interval, due to lack of sufficient resources. To
in [17] is that CS owner is eligible to exclude the head of queue illustrate the proposed model, let us take an example.
vehicles from charging after they were waiting a long time in the Illustrative Example: Suppose that three vehicles arrived at the
queue. This assumption was taken to guarantee an upper bound CS with 50, 80 and 100 kWh demands respectively and lets
for average waiting delay. In this article, the aforementioned m (t ) = 1 to make the example simple. In other words, 230
limitations in the problem formulation are not considered.
kWh of demand has come to the station at this interval. An
Instead of CS, a battery swapping station (BSS) was proposed
interval duration is supposed to be 1 h. Different demands are
in [28] for smart microgrid environment and a price-incentive
due to different battery capacity, the remaining energy of the
management policy has been devised to simultaneously maxi-
battery and vehicle model (e.g., truck, bus, motorcycle, car, etc.,
mize the profit of BSS and to minimize the cost of EVs.
In our previous work, a long-term profit maximization al- See Table 1 as an example). Let us assume that each charging
gorithm for CS owner has been proposed in [9]. In that paper, pump is capable of charging 10 kW, which is a typical moderate
different charging prices are offered to the EVs in order to provide charging rate. For simplicity, assume that demands are multiple
an opportunity of ‘‘paying more, waiting less’’ strategy. Then, of 10 kWh. Suppose the station decides to use two of its charging
customers participate in a bidding strategy providing them an pumps (i.e., n (t ) = 2). Therefore, the charge capacity of the
option to purchase according to their budget. However, in [9] the station at this time interval will be 20 kWh, and two cars can
amount of required energy for each vehicle is considered as a start their charging at the same time. At the end of the interval,
constant value which is the same for all vehicles. In practice, not 20 kWh of 230 kWh demand is served, and the remaining 210
only the SoC of EVs is a random parameter when they go into kWh must be served at later intervals.
the CS, but the capacity of the batteries are also different which The example above shows that a queue of demands may
results in different amount of required energy per vehicle. be formed due to instantaneous larger arrival rate than system
In this paper, a different trade-based CS model is proposed in capacity of charge. The queue of demands is represented with
which the electricity price, the arrival of the EVs and the SoC are Q (t). The dynamics of Q (t) over time is as follows:
considered as random variables (or parameters) with arbitrary
distribution. To maximize the long-time profit of the CS owner, Q (t + 1) = [Q (t ) − C · n (t )]+ + a (t ) · m(t) (1)
stochastic optimization framework is utilized in which the selling
price and the number of working charging pumps are the opti- where the constant parameter C is the charging capacity of each
mization variables. Unlike the head of queue dropping strategy charging pump. In Eq. (1) [X ]+ = max [0, X ]. To see the dynamic
in [17], our proposed model investigates the impact of rejecting of the system in curse of time, an illustrative sample path of
a vehicle at the time of its entrance to the CS, on delay and profit. system processes is shown in Fig. 2 where Q (0) = 0.
In other words, the impact of availing automatic parking barrier In practice, the arrival of vehicles at the CS depends on the
on long-term profit and delay is studied. The salient feature of the selling price and the length of the queue of the CS. If a station is
proposed method is that, knowledge of future behavior of drivers too crowded or the selling price of electricity is expensive, vehicle
and the required charging power does not need to be known a may refuse entry and may go to another station in the city (See
priory in the proposed model. Fig. 1). To consider this behavior in the proposed model, it is
3
E. Bagherzadeh, A. Ghiasian and A. Rabiee Sustainable Energy, Grids and Networks 24 (2020) 100391

Table 2
Nomenclature.
Parameter Comment
a(t) Charging demand (kWh)
amax Maximum amount of demand
f (t) Purchase price to electricity market ($/kWh)
C Charging capacity of each charging pump (kWh)
λ Expected value of a(t) (kWh)
V Algorithm parameter
T Number of intervals
K Maximum number of available charging pumps
n(t) Number of active charging pumps
m(t) Binary variable to model parking barrier
s(t) Selling price to vehicles ($/kWh)
Q(t) Queue of demands (kWh)
θ (t) Profit ($)
θ Long term expected profit ($)
ρ The ratio of average arrival rate to the maximum
departure rate

price would be s(t). The architecture of the proposed model is


shown in Fig. 1 and its associated optimization problem is to
jointly control the selling price and the number of active charging
pumps to maximize the long-term profit of the owner. The strong
stability [30] of the waiting queue is guaranteed by constraint (5)
where Q̄ is the long term average of demand queue (refer to the
definition of long term average in Eq. (3)). Constraint (6) imposes
Fig. 2. An illustrative dynamic of system variables.
that the decision variable m (t ) is a binary variable. Constraint
(7) indicates that the total number of available charging pump
is K . However, the CS owner may decide to use any number of
them. Constraint (8) puts an upper bound on the selling price. The
assumed that the random process a(t) can have any arbitrary dis-
necessary condition for queue stability is that the upper limit of
tribution. The price-sensitive behavior of vehicle owner is studied
the arrival process a(t) should be less than the CS capacity. This
in more details in [29].
The selling price (s(t)) is upper bounded by marketing policy constraint is shown in (9). The letter C refers to charging capacity
such that customers do not leave the CS because of a very higher of each charging pump. Meanwhile, the maximum power drawn
price than other competitors. In addition, for the provided model by the CS from the power grid is C .K .
to cover a wide range of applications, it is assumed that the The list of parameters used throughout the manuscript and
electricity purchase price (f (t)) is also a random variable with any their description is presented in Table 2.
arbitrary distribution. Note that the emerging telecomm technologies provide the
required communication infrastructure such that EVs and CS can
3.1. Problem formulation exchange selling price and waiting time information remotely. An
EV can decide to go to a CS which best suits its budget and delay
The profit of the CS owner and its long-term average is calcu- constraint. Thus, the proposed model and algorithm is applicable
lated by Eqs. (2) and (3) respectively. in real world.

θ (t ) = m (t) · a (t ) · s (t ) − C · n (t ) · f (t) (2)


t
3.2. Problem solution
1∑
θ̄ = lim E {θ (τ )} (3)
t →∞ t To solve the optimization problem P0 , the framework of Lya-
τ =1
punov drift plus penalty (d.p.p) technique [30] is used, in which
In Eq. (3), E refers to the expected value. In order to maximize
a parametric algorithm is introduced and is executed at each
long term profit of the CS owner, the subsequent optimization
interval while the stability of queue (Constraint (5)) is guaran-
problem is formulated,
teed. It is proved in Theorem 1 that the optimal solution of P0
Problem P0 : max θ̄ (4) is attainable by adjusting the parameter of the algorithm. The
m(t ),s(t ),n(t)
Lyapunov function and its drift is defined below,
The optimization is subject to constraint (1) and the following 1
ones, Lyapunov function: L [Q (t )] ≜ Q 2 (t) (10)
2
Q̄ < ∞ (5) Lyapunov Drift:
m (t ) ∈ {0, 1} (6) ∆[Q (t )] ≜ E[ {L [Q (t + 1)] − L [Q (t )]}| Q (t )] (11)
n (t ) ∈ {0, 1, . . . , K } (7) If optimization decisions are made every slot t to minimize
0 ≤ s(t) ≤ smax (8) ∆[Q (t )], then queue length is steadily pushed towards a lower
backlog state, which intuitively preserves queue stability.
a (t ) ≤ amax ≤ C · K (9)
So far, the objective function that should be minimized has
It is noticeable that when a vehicle arrives at time interval not yet been introduced. The objective function is incorporated
t, regardless of its departure interval, its electricity purchase by adding an appropriate penalty function to ∆[Q (t )].
4
E. Bagherzadeh, A. Ghiasian and A. Rabiee Sustainable Energy, Grids and Networks 24 (2020) 100391

The penalty function is defined as the negative of profit func-


tion. Then, instead of taking steps to minimize ∆[Q (t )], optimiza-
tion variables are taken every slot t to minimize the following
drift-plus-penalty (d.p.p) expression,
d · p · p = ∆ [Q (t )] − V · E[ θ (t)| Q (t )] (12)
The method of designing the algorithm is to first calculate
an upper bound for the d.p.p . Then an algorithm is designed to
minimize the obtained upper bound at each time interval.
By substituting (10) and (11) in (12) ,
Fig. 3. DPCS Algorithm.
d · p · p = E [ {L [Q (t + 1)] − L [Q (t )]}| Q (t )] (13)
− V · E {m (t ) · a (t ) · s (t ) − C · n (t ) · f (t )}| Q (t )
{ }⏐ bound in (19), two separate and independent terms have to
1 2 1
Q (t + 1) − Q 2 (t ) ⏐⏐ Q (t ) be minimized. That is, after observing Q (t ) , a(t) and f (t ), two

=E
2 2 separate optimization problems given below should be solved
− V · E {m (t ) · a (t ) · s (t ) − C · n (t ) · f (t )}| Q (t ) concurrently.
The term Q (t + 1) can be replaced by Eq. (1), Problem P1 : min{C .n(t)[V .f (t ) − Q (t )]} (20)
{ n(t)
1
d·p·p=E [max [Q (t ) − C · n (t ) , 0] (14) Problem P2 : min {m (t ) · a(t)[Q (t ) − V · s(t)]} (21)
2 m(t ),s(t)
}⏐
1 Both problems P1 and P2 have threshold-based solution as
+ m (t ) · a (t ) ]2 − Q 2 (t ) ⏐⏐ Q (t )

2 follows,
Problem P1 Solution:
− V · E{m (t ) · a (t ) · s (t ) − C · n (t ) · f (t )}| Q (t )
if Q (t ) > Vf (t )
{
K
Given the inequality [max [Q − x, 0] + a]2 ≤ Q2 + x2 + a2 + n (t ) = (22)
2Q(a − x) for all Q > 0, a > 0, x > 0 [30], Eq. (14) can be 0 other w ise
rewritten as Problem P2 Solution:
( ) {
1 {
m (t ) = 0
d·p·p≤ · E Q (t) + C · n (t) + m (t ) · a (t )
2 2 2 2 2
(15) if Q (t ) ≥ Vsmax ⇒ (23)
2 S (t ) = Any v alue
+ 2Q (t ) [m (t ) · a (t ) − C · n (t )]
m (t ) = 1
{
if Q (t ) < Vsmax ⇒
( ) }⏐
1
· Q 2 (t ) ⏐⏐ Q (t ) S (t ) = smax


2
To apply Problem P1 and P2 solutions, DPCS algorithm is de-
− V · E{m (t ) · a (t ) · s (t )
vised as follows (see Fig. 3),
− C · n (t ) · f (t )}| Q (t ) The performance of the proposed algorithm has been proved
Noting that n(t) ≤ K and a(t) ≤ amax , then in Theorem 1.
( ) ( )
1 2 2 1 Theorem 1. Given that a(t) and f (t ) are independent and identi-
d·p·p≤ ·C ·K + a2max (16)
2 2 cally distributed (i.i.d.) stochastic processes over time and assuming
+ E [Q (t ) [m (t ) · a (t ) − C · n (t )]]| Q (t ) that Q (0) = 0, the performance gap between the long-term profit
(θ̄ ) achieved by DPCS algorithm and its optimum value (θ ∗ ) comply
− V · E [m (t ) · a (t ) · s (t ) with the following formula:
− C · n (t ) · f (t )]| Q (t )
M
θ ∗ − θ̄ ≤ (24)
By defining M ≜ 12 .C2 .K2 + 12 .a2max Eq. (16) is replaced by
( ) ( )
V
(17).
where M = 2 .C2 .K2 + 2 .a2max is a constant value and V is an
(1) (1)

d · p · p ≤ M + Q (t ) · E [m (t ) · a (t ) − C · n (t )]| Q (t ) (17) input parameter to the algorithm which is chosen by the CS owner
in order to make a trade off between customers delay and attainable
+ V · E [C · n (t ) · f (t )]| Q (t )
profit.
− V · E [m (t ) · a (t ) · s (t )]| Q (t )
The terms in relation (17) is reordered to form the following Proof. In order to prove the theorem, it is noticeable that DPCS
equation, algorithm minimizes the right hand side of the inequality (18) at
each time interval. That is, among all the existing algorithms, the
d · p · p ≤ M + Q (t ) · E [m (t ) · a (t )]| Q (t ) (18) proposed algorithm has the lowest value for the upper bound of
− V · E [m (t ) · a (t ) · s (t )]| Q (t ) the relation (18). When DPCS algorithm is executed, the upper
bound termed UDPCS . Therefore, the relation (18) is rewritten as
− Q (t ) · E [C · n (t )]| Q (t )
follows,
+ V · E [C · n (t ) · f (t)]| Q (t )
d · p · p ≤ UDPCS (t) (25)
d · p · p ≤ M + E {m (t ) · a (t ) [Q (t ) − V · s (t )]}| Q (t ) (19)
According to the stochastic optimization framework [30], the
+ E {C · n (t ) [V · f (t ) − Q (t )]}| Q (t )
optimum profit θ ∗ is achievable by (a, f )−only random algorithm,
Now, an algorithm is designed to observe Q (t ) at each in- where (a, f ) − only is a class of algorithms that randomly gener-
terval and minimize the above bound. The optimization vari- ates solution after observing input parameters, a(t) and f (t ). The
ables are n (t ), m(t) and s (t ). Therefore, to minimize the derived solution of this algorithm is called sR (t), mR (t) and nR (t). Then,
5
E. Bagherzadeh, A. Ghiasian and A. Rabiee Sustainable Energy, Grids and Networks 24 (2020) 100391

there exists an algorithm from the class of (a, f ) − only such that 4. Performance evaluation
its execution at each time interval results in the Eqs. (26) and
(27) It is remarkable that the optimum probability distribution In this section, the performance of DPCS via different simula-
of the (a, f ) − only random algorithm is unknown to us, but its tion setups is evaluated.
availability is used here.
4.1. Simulation setup
E [θR (t )] = (26)
E [sR (t ) · mR (t ) · a (t ) − f (t ) · C · nR (t )] = θ ∗ All of the simulations have run for T = 10, 000 time intervals,
E[C · nR (t ) − mR (t ) · a (t )] ≥ 0 (27) unless otherwise stated. The duration of a time interval is set to 1
h. To model different battery types, three kinds of battery with 40,
As the (a, f ) − only algorithm does not depend on Q (t), 60 and 85 kWh capacity are considered. Each incoming vehicle’s
Eqs. (26) and (27) can be rephrased as follows, battery is randomly chosen among the above-mentioned types.
E [sR (t ) · mR (t ) · a (t ) − f (t ) · C · nR (t )]| Q (t) = θ ∗ (28) In practice, vehicles with lower remaining charge (SoC) are more
likely to go to the CS. To consider this behavior, it is assumed
E [C · nR (t ) − mR (t ) · a (t )]| Q (t) ≥ 0 (29) that assume that the SoC of 70% of arrival vehicles are randomly
Given that our proposed algorithm is chosen among all the chosen from interval (0,30) percent while the remaining 30% have
algorithms (including (a, f )− only) in a way that the upper bound their SoC in the range (31,80) percent of full charge. Vehicles
in Eq. (18) is minimized, the following relation is obtained. with above 80% battery charged would not drive to the CS. The
value of C and K are set to 12.5 kWh and 10 respectively and
d · p · p(t) ≤ UDPCS (t) ≤ URND (t) (30) thus CSmax would be 125 kWh. Demand arrival is assumed to be
where URND is the upper bound achieved by running (a, f ) − only a stochastic process with uniform distribution with average λ. The
random algorithm. After substituting Eq. (12) in (18), necessary condition for keeping the queue stable is that the ratio
of average arrival rate to the maximum departure rate must be
∆ [Q (t )] − V · E[ θ (t )| Q (t )] (31) less than one. This value is termed ρ and obviously ρ = Kλ.C . The
≤ M + Q (t ) · E [mR (t ) · a (t )]| Q (t ) horizontal axes in simulation figures is set to ρ which is changed
by altering the value of λ. The purchase price f (t) is randomly
− V · E [mR (t ) · a (t ) · sR (t )]| Q (t )
chosen from the set {12, 14, 16, 18, 20} and smax = $20.
− Q (t ) · E [C · nR (t )]| Q (t )
+ V · E [C · nR (t ) · f (t)]| Q (t ) 4.2. Simulation results
By using Eq. (28), the inequality (31) is rewritten,
In order to see the logic of the proposed DPCS algorithm, a
∆ [Q (t )] − V · E [ θ (t )| Q (t )] (32) short trace simulation results for ten step-by-step intervals is
≤ M − V θ ∗ + Q (t ) · E [mR (t ) · a (t ) − C · nR (t )]| Q (t ) evaluated first. Then, the long-term performance of the algorithm
has been evaluated.
Then, relation (32) is reduced to relation (33) by considering
inequality (29) referring to the negative sign of the last term in Short Trace: Initially, the simulation results for ten consecutive
(32). time intervals have been recorded to see the behavior of the
algorithm in a short time random trace. For this setup, ρ =
∆ [Q (t )] − V · E[ θ (t )| Q (t )] ≤ M − V θ ∗ (33) 0.5, C = 12.5 kWh, V = 10 and K = 10. The outputs are shown
in Table 3, where the results of running DPCS algorithm, i.e., n (t ) ,
Inserting definition (11) in (33) results in
m(t) and s(t) are distinguished by bold font in three columns at
E[ {L [Q (t + 1)] − L [Q (t )]}| Q (t )] − V · E[ θ (t )| Q (t )] ≤ M − V θ ∗ the center. If Q (t ) − Vf (t ) > 0 then n(t) is set to its maximum
value and if Q (t ) − VSmax > 0 then m(t) is set to zero. These
(34)
two conditions intuitively means that when the demand queue
Now by utilizing the law of iterated expectation, grows up, the system should work by its maximum capacity
and no more arrival is allowed to reduce the vehicle congestion.
E{L [Q (t + 1)] − L [Q (t )]} − V · E[θ (t )] ≤ M − V θ ∗ (35) The attainable profit is negative at time intervals that no vehicle
The relation (35) is correct for all t, so that by incorporat- arrival occurs because CS have to buy electricity for charging
ing telescoping sum technique as defined in [30], the following previously entered vehicles in the queue, while it gains no money
inequality is obtained, as no vehicle is allowed to enter.
D−1
∑ Long Run: First, the impact of parameter V on average queue
E {L [Q (D)] − L [Q (0)]} − V · E [θ (τ )] ≤ D · (M − V θ ∗ ) (36) length and on average profit is presented. Average queue length
τ =0 represents the average delay of vehicles by little law [30]. Fig. 4
By dividing both sides of (36) by D.V and noting that L [Q (0) shows the average queue with respect to the incoming load
= 0], it is given that ρ . As it is observed, increasing the amount of V causes more
congestion in demand queue for any amount of ρ . This behavior
D−1
E {L [Q (D)]} 1 ∑ M can be justified by looking into Eq. (12). The parameter V has the
− · E [θ (τ )] ≤ − θ∗ (37) role of weighting factor in drift plus penalty (d.p.p) optimization,
D·V D V
τ =0 where the optimization target is to minimize the sum of queue
The inequality (37) can be rephrased in (38) because E {L [Q drift and to maximize the profit (or equivalently minimize the
(D)]}>0, negative form of profit) at the same time. This action can be
D−1
seen in relation (22) as well. By increasing the amount of V ,
1 ∑ M more demand should be backlogged in the queue to turn on
· E [θ (τ )] ≥ θ ∗ − (38)
D V the charging pumps. This leads to more average queue length.
τ =0
Instead, an increase in parameter V results in more profit as
Now, by taking the limit as D → ∞, the proof completes. ■ demonstrated in Fig. 6.
6
E. Bagherzadeh, A. Ghiasian and A. Rabiee Sustainable Energy, Grids and Networks 24 (2020) 100391

Table 3
Short trace simulation results.
T a(t) f (t ) Q (t) θ (t ) n(t) m(t) S(t) Q (t ) − V .f (t) Q (t ) − V .Smax
1 119 16 0 2380 0 1 20 −160 −200
2 85 14 119 1700 0 1 20 −21 −81
3 98 18 204 −2250 10 0 0 24 4
4 25.28 16 79 505.6 0 1 20 −81 −121
5 89.76 14 104.28 1795.2 0 1 20 −35.72 −95.72
6 46.56 18 194.04 −1318.8 10 1 20 14.04 −5.96
7 39.84 14 115.6 796.8 0 1 20 −24.4 −84.4
8 46.56 20 155.44 931.2 0 1 20 −44.56 −44.56
9 15.36 16 202 −2000 10 0 0 42 2
10 170 14 77 3400 0 1 20 −63 −123

Fig. 4. The impact of parameter V on average queue length in DPCS algorithm.

Fig. 5. The impact of parameter V on average profit in DPCS algorithm.

As it was expected, growing of ρ results in more queue con- and allow all the vehicles to move in to the CS. In the other
gestion and more profit as well. This is because the vehicle arrival baseline algorithm, it is assumed that the number of charging
rate is increased and the capacity of CS is constant. Therefore, pumps is fixed. The two reference algorithms are called FreeArv
more vehicles have to wait in the queue before they get charged. (referring to Free Arrival) and AllPmpOn (referring to All Pump
More vehicles entering to the CS leads to more profit. On) respectively. The parameter V is set to 100 in the following
Now, the performance of the DPCS algorithm is evaluated in simulation setups. Fig. 6 shows the average queue length of
comparison with the two reference algorithms obtained from our demands. Noting that ρ = Kλ.C , to increase ρ , the average of λ
proposed solution. The reference algorithms are similar to DPCS should be increased. As the incoming load becomes larger, the
except in a decision variable. In one of them, m (t ) is set to one delay increases in all algorithms (by little law [30]). When there
all the time. In fact, it removes the entrance control variable is no control over the number of working pumps, it is assumed
7
E. Bagherzadeh, A. Ghiasian and A. Rabiee Sustainable Energy, Grids and Networks 24 (2020) 100391

Fig. 6. Average demand queue length versus charging demand. Fig. 7. Average Profit versus charging demand.

that all of them are working all the times (i.e., n (t ) = K , all
the time). Obviously, in such a scenario that is termed AllPmpOn,
less average queue is observed as shown in Fig. 6. The reason is
that the CS is working by its maximum service rate when all the
pumps are On. Therefore, the cars receive their charge in less time
and leave the station. However, Fig. 7 illustrates that AllPmpOn
strategy constitutes larger cost and less profit compared to DPCS
and FreeArv approaches. The reason is that regardless of the
purchase price, the station owner should buy electricity from the
grid at all time intervals.
In case there is no control over vehicle arrivals and the parking
barrier is always open (i.e., m (t ) = 1 all the time in problem
formulation), the queue length grows more often as shown in
Fig. 6 by FreeArv marker. Then the average queue length is more
than AllPmpOn scheme. The attainable profit of FreeArv is higher
than AllPmpOn. It is because despite of AllPmpOn, in FreeArv Fig. 8. The superiority of DPCS algorithm to the FreeArv algorithm.
policy the number of running pumps and thus the electricity
purchase decision is a controllable parameter. For this reason,
in solving the optimization problem, some charging pumps are
turned off when the price of electricity is high. This strategy leads
to more profit in cost of more vehicle delays. In DPCS algorithm, it
is possible to control both arrivals and number of working pumps.
Therefore, by suffering a moderate delay, more profit is attainable
as depicted in Fig. 7. As demonstrated in Figs. 4 and 5, the DPCS
approach is able to balance the delay and profit by adjusting the
value of V.
Simulation results show that DPCS algorithm outperforms
FreeArv in terms of profit and delay. In Fig. 8 it is observed
that DPCS achieves 12% more profit on average. Its average delay
is 25% less than FreeArv. It is inferred from simulations that
DPCS outperforms AllPmpOn in terms of profit, but AllPmpOn
is superior to DPCS in terms of delay. Fig. 9 demonstrates the
superiority of DPCS in percentage for all the demand loads. The
attainable profit of DPCS is 107% more than AllpumOn while it Fig. 9. Comparison of DPCS and AllPmpOn algorithms.
causes 80% more delay to vehicles on average.

5. Conclusion
decide on the electricity sales price, vehicle entrance and number
In this paper, a combination of commercial and technical of working pumps at each time interval. Simulation results show
model for electrical vehicle charging stations has been proposed that the CS owner can achieve any desired profit value (as long as
with the aim of maximizing the long-term profit of CS owner. this value is less than the proven optimal one) by using a parking
To consider the random parameters such as electricity price and barrier and by controlling the number of working pumps in cost
vehicle arrival, a stochastic optimization problem has been devel- of imposing more average delay to customers. This trade-off is
oped for the model. In the proposed model, vehicles have to wait finely adjustable by the algorithm parameter V. It is demonstrated
in a queue before they get charged. By utilizing Lyapunov Drift that the CS owner would have an increase of 107% in profit at a
analysis, an algorithm called DPCS was developed to solve the cost of incurring 80% more delay to vehicles. If a parking barrier
optimization problem. It is proved that DPCS achieves close-to- is used in the CS, the achievable profit would be increased by 12%
optimal performance. By applying DPCS algorithm, CS owner can and the waiting delay of vehicles would be decreased by 25%.
8
E. Bagherzadeh, A. Ghiasian and A. Rabiee Sustainable Energy, Grids and Networks 24 (2020) 100391

Declaration of competing interest [15] H. Zhang, Z. Hu, Z. Xu, Y. Song, Evaluation of achievable vehicle-to-grid
capacity using aggregate PEV model, IEEE Trans. Power Syst. 32 (1) (2017)
784–794.
The authors declare that they have no known competing finan-
[16] A. Alavi Eshkaftaki, A. Ghiasian, A. Rabiee, Smart charge and discharge
cial interests or personal relationships that could have appeared scheduling of electric vehicle (EV) to maximize the profit of EV owner,
to influence the work reported in this paper. Univ. Isfahan 8 (3) (2017) 75–82.
[17] Y. Kim, J. Kwak, S. Chong, Dynamic pricing, scheduling, and energy
References management for profit maximization in PHEV charging stations, IEEE Trans.
Veh. Technol. 66 (2) (2017) 1011–1026.
[18] Q. Wang, X. Liu, J. Du, F. Kong, Smart charging for electric vehicles: A
[1] R. Kumar, Electric vehicle market size, share; growth | industry fore-
survey from the algorithmic perspective, IEEE Commun. Surv. Tutorials 18
cast 2025, Allied Mark. Res. (2019) [Online]. Available: https://www.
(2) (2016) 1500–1517.
alliedmarketresearch.com/electric-vehicle-market (Accessed 18 May 2019).
[19] E. Munoz, E. Ruspini, Using fuzzy queuing theory to analyze the im-
[2] W.J. Requia, M. Mohamed, C.D. Higgins, A. Arain, M. Ferguson, How clean
pact of electric vehicles on power networks, in: 2012 IEEE International
are electric vehicles? Evidence-based review of the effects of electric
Conference on Fuzzy Systems, 2012, pp. 1–8.
mobility on air pollutants, greenhouse gas emissions and human health,
[20] A.Y.S. Lam, Yiu-Wing Leung, Xiaowen Chu, Electric vehicle charging station
Atmos. Environ. 185 (2018) 64–77.
placement: Formulation, complexity, and solutions, IEEE Trans. Smart Grid
[3] K. Zare, S. Nojavan, B. Mohammadi-Ivatloo, Optimal bidding strategy of
5 (6) (2014) 2846–2856.
electricity retailers using robust optimisation approach considering time-
[21] Z. Liu, F. Wen, G. Ledwich, Optimal planning of electric-vehicle charging
of-use rate demand response programs under market price uncertainties,
stations in distribution systems, IEEE Trans. Power Deliv. 28 (1) (2013)
IET Gener. Transm. Distrib. 9 (4) (2015) 328–338.
102–110.
[4] F. Ziel, R. Steinert, Electricity price forecasting using sale and purchase
[22] A. Rajabi-Ghahnavieh, P. Sadeghi-Barzani, Optimal zonal fast charging
curves: The X-model, Energy Econ. 59 (2016) 435–454.
station placement considering urban traffic circulation, IEEE Trans. Veh.
[5] R. Weron, Electricity price forecasting: A review of the state-of-the-art
Technol. (2016) 1.
with a look into the future, Int. J. Forecast. 30 (4) (2014) 1030–1081.
[23] Z. Sun, X. Zhou, J. Du, X. Liu, When traffic flow meets power flow: On
[6] F. Ziel, Forecasting electricity spot prices using lasso: On capturing the
charging station deployment with budget constraints, IEEE Trans. Veh.
autoregressive intraday structure, IEEE Trans. Power Syst. 31 (6) (2016)
Technol. 66 (4) (2017) 2915–2926.
4977–4987.
[24] S. Shahidinejad, S. Filizadeh, E. Bibeau, Profile of charging load on the grid
[7] Binyan Zhao, Yi Shi, Xiaodai Dong, Pricing and revenue maximization for
due to plug-in vehicles, IEEE Trans. Smart Grid 3 (1) (2012) 135–141.
battery charging services in PHEV markets, IEEE Trans. Veh. Technol. 63
[25] R. Torabi, C. Sabino, A. Gomes, Development of an algorithm to control and
(4) (2014) 1987–1993.
optimize the coordinated charging process of a group of electric vehicles,
[8] PodPoint, How long does it take to charge an electric car? | pod point, Pod-
in: Smart SysTech 2014; European Conference on Smart Objects, Systems
Point (2019) [Online]. Available: https://pod-point.com/guides/driver/how-
and Technologies, 2014, pp. 1–5.
long-to-charge-an-electric-car (Accessed 03 Jun 2019).
[26] F.H. Malik, M. Lehtonen, Minimization of queuing time of electric vehicles
[9] A. Rabiee, A. Ghiasian, M.A. Chermahini, Long term profit maximization
at a fast charging station, in: 2017 IEEE PES Innovative Smart Grid
strategy for charging scheduling of electric vehicle charging station, IET
Technologies Conference Europe (ISGT-Europe), 2017, pp. 1–6.
Gener. Transm. Distrib. 12 (18) (2018) 4134–4141.
[27] M.R. Sarker, H. Pandžić, K. Sun, M.A. Ortega-Vazquez, Optimal operation of
[10] G. Binetti, A. Davoudi, D. Naso, B. Turchiano, F.L. Lewis, Scalable real-time
aggregated electric vehicle charging stations coupled with energy storage,
electric vehicles charging with discrete charging rates, IEEE Trans. Smart
IET Gener. Transm. Distrib. 12 (5) (2018) 1127–1136.
Grid 6 (5) (2015) 2211–2220.
[28] M. Zhang, J. Chen, The energy management and optimized operation of
[11] S. Shao, M. Pipattanasomporn, S. Rahman, Demand response as a load
electric vehicles based on microgrid, IEEE Trans. Power Deliv. 29 (3) (2014)
shaping tool in an intelligent grid with electric vehicles, IEEE Trans. Smart
1427–1435.
Grid 2 (4) (2011) 624–631.
[29] Y. Zhang, P. You, L. Cai, Optimal charging scheduling by pricing for EV
[12] N.G. Paterakis, O. Erdinc, A.G. Bakirtzis, J.P.S. Catalao, Optimal household
charging station with dual charging modes, IEEE Trans. Intell. Transp. Syst.
appliances scheduling under day-ahead pricing and load-shaping demand
20 (9) (2018) 3386–3396.
response strategies, IEEE Trans. Ind. Informatics 11 (6) (2015) 1509–1519.
[30] M.J. Neely, Stochastic network optimization with application to communi-
[13] D. Tang, P. Wang, Probabilistic modeling of nodal charging demand based
cation and queueing systems, Synth. Lect. Commun. Networks 3 (1) (2010)
on spatial-temporal dynamics of moving electric vehicles, IEEE Trans.
1–211.
Smart Grid (2015) 1.
[14] T. Mao, W. Lau, C. Shum, H.S.-H. Chung, K.-F. Tsang, N.C.-F. Tse, A regulation
policy of EV discharging price for demand scheduling, IEEE Trans. Power
Syst. 33 (2) (2018) 1275–1288.

You might also like