Journal of Physics: Conference Series

PAPER • OPEN ACCESS You may also like

- A denoising model based on multi-agent
Architecture design of battery energy storage reinforcement learning with data
transformation for digital tomosynthesis
coordinated control system based on Multi-Agent Kibok Nam, Dahye Lee and Seungwan
Lee

mechanism - Successive lag cluster consensus on

multi-agent systems via delay-dependent
impulsive control
To cite this article: Xuan Qiu et al 2022 J. Phys.: Conf. Ser. 2258 012057 Xiao-Fen Qiu, , Yin-Xing Zhang et al.

- Clustering Storage Method for Digital

Evidence Storage Using Software Defined
Storage
Afif Mohammad Faruq, Setiawan
View the article online for updates and enhancements. Mukhammad Andri and Prayudi Yudi

This content was downloaded from IP address 49.204.9.201 on 09/07/2023 at 18:41

ICAACE-2022 IOP Publishing
Journal of Physics: Conference Series 2258 (2022) 012057 doi:10.1088/1742-6596/2258/1/012057

Architecture design of battery energy storage coordinated

control system based on Multi-Agent mechanism

Xuan Qiu1a*, Chun-sheng Tang1b*, Wen-hao Dong1c

1
College of Automation, Nanjing University of Posts and Telecommunications, Nanjing
210023, China
a* b*
qx199901@163.com, tcs2357419378@163.com, cdongwh123456@163.com

Abstract—Energy storage can realize rapid voltage, frequency support and energy adjustment,
and is an important guarantee for promoting the efficient consumption of renewable energy and
the safe and stable operation of the power system. The flexible adjustment of energy storage is
not only affected by its own characteristics, but also closely related to the operation control mode
of energy storage. Based on the PQ constant power and virtual synchronization control strategy
of the battery energy storage system, this paper constructs the operation architecture of the
battery energy storage system based on the Multi-Agent cooperative mechanism, and further
gives the energy storage system Multi-Agent cooperative control system’s application scenarios
in active frequency modulation and reactive voltage regulation. Research shows that this
architecture helps to fully tap the potential of aggregation and regulation of multi-point
decentralized energy storage facilities and meet the flexible regulation needs of the power system
under the access of high-permeability intermittent renewable energy.

1.Introduction
With the large-scale integration of distributed renewable energy such as photovoltaics and wind power
into the grid, the intermittent, random and volatility of its output will bring negative impacts and impacts
on the safe and stable operation of the grid [1-3]. Battery energy storage can achieve rapid voltage,
frequency support [4-5] and energy adjustment, and is an important guarantee for promoting the efficient
consumption of new energy and the safe and stable operation of the power system.
The flexible adjustment of energy storage is not only affected by its own characteristics, but also
closely related to the operation control mode of energy storage. Literature [6-7] divides energy storage
frequency modulation into auxiliary traditional power frequency modulation and demand-side
distributed energy storage cluster frequency modulation according to operating modes. Aiming at the
frequency and voltage regulation of energy storage converters, literature [8-9] proposed several
improved methods for converter droop control.
Aiming at the operation control of energy storage converter and the overall system, this paper takes
the Multi-Agent mechanism as the core, elaborates the operation strategy of energy storage PQ constant
power control and virtual synchronization control in detail, and builds the Multi-Agent cooperative
control architecture of battery energy storage system. The two-way flow of information ensures the
transient active response of the local layer and the stable and reasonable distribution of the coordination
layer, and provides the application scenarios of Multi-Agent collaborative control in active frequency
modulation and reactive voltage regulation, which is more important for subsequent energy storage. The
realization of the Agent cooperative control architecture provides a reference scheme.

Content from this work may be used under the terms of the Creative Commons Attribution 3.0 licence. Any further distribution
of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.
Published under licence by IOP Publishing Ltd 1
ICAACE-2022 IOP Publishing
Journal of Physics: Conference Series 2258 (2022) 012057 doi:10.1088/1742-6596/2258/1/012057

2. Basic Theory and Structure of Multi-Agent System

2.1Basic concept of Multi-Agent System

Agent refers to an independent individual who can complete a specific task. In a complex environment,
the Agent can perceive the surrounding environment information, and solve problems through judgment,
planning, and decision-making methods based on the current state, relevant knowledge and rules, and
has a certain degree of autonomy and self-adaptation.
The general Agent structure includes a perceptron module, a reasoning calculation module, a rule
module and a communication module. Agent plays a role through the coordination between the four
modules. The perceptron module perceives the information of the external environment while updating
internal data and passing it to the inference calculation module; the inference calculation module is the
core module of the Agent and is responsible for obtaining information from the other three modules,
make intelligent decisions through inference and calculation, and then return the information to the other
three modules; the rule module stores the rules and operation steps that determine the task execution;
the function of the communication module is to set the information transfer mode between the current
Agent and other Agents, transfer information, and realize the coordination work between the current
Agent and other Agents.
Multi-Agent System (MAS) is composed of multiple Agents that are independent of each other in
spatial locations and software networks, and have communication capabilities and reasoning learning
capabilities, and are interconnected systems with more powerful processing capabilities. MAS can
resolve the conflict between the constraints of the problem to be solved and the objective function by
coordinating the competition and cooperation between the Agents.

2.2 Multi-Agent System architecture

The structure of MAS mainly refers to the communication and control mode between Agents, which
determines the pros and cons of the entire system. Generally speaking, the structure of MAS includes:
centralized structure, distributed structure and hybrid structure.
Hybrid MAS contains the excellent characteristics of centralized and distributed structures, and can
be used well in complex environments, it has one or several management control Agents. The
management control Agent only performs overall management and control on some Agents under
certain rules, and participates in and realizes the analysis, planning and commands between these Agents.
Other Agents at the same level are equal to each other, and they can make optimal decisions through
competition and cooperation. Hybrid MAS is a commonly used MAS structure.

3. Battery Energy Storage Control Strategy

3.1PQ charge and discharge control

The constant power control method is also called the PQ control method, which reduces load peaks and
fills load valleys by maintaining a constant power output of energy storage. The design ideas[10] are as
follows:
The relationship between the three-phase voltage u and amplitude U m of the converter output after
the dq coordinate transformation is shown in formula (1),
 
  （1）
  2   2   U m cos t  
cos t cos  t   cos  t   
ud    3   3    2   U m 
   U m cos  t     
u  
 q   sin t sin t  2   2     3   0 
    sin  t  
  3   3    2 
U m cos  t  
  3 

It can be seen from the above formula that ud is a constant and uq is equal to 0.
Assuming that id 、iq are the d-axis and q-axis components of the converter output current in the dq
rotating coordinate system, the instantaneous active and reactive power expressions of the converter in

2
ICAACE-2022 IOP Publishing
Journal of Physics: Conference Series 2258 (2022) 012057 doi:10.1088/1742-6596/2258/1/012057

this coordinate system are shown in formula (2):

 P  ud id  uqiq （2）

Q  uqid  uqiq
Assuming that Pref and Qref are the given reference active and reactive power respectively, according
to (1) and (2), the reference current of the converter can be obtained as:
 Pref
idref  u （3）
 d

i   Qref
 qref ud
Since ud is a constant, the active and reactive power output by the converter can be controlled by
controlling the d-axis and q-axis components of the current. The active current id determines the active
power P, and the reactive current iq determines the reactive power Q. So as long as the reference value
of d-axis and q-axis current is tracked, the tracking of active power and reactive power can be realized.

3.2Virtual synchronization control

The Virtual Synchronous Generator (VSG) control strategy uses the inverter to simulate the active
frequency droop output characteristics and the reactive voltage droop output characteristics of the
synchronous generator, and at the same time considers the synchronous motor stator voltage equation
and rotor motion equation. The energy storage converter can simulate the external characteristics of the
synchronous machine, as shown in the following formula:
 d   N  1
J
 dt
  P  P   D   N 
N ref e （4）

  d
 dt
Where:  is the electrical angular velocity;  N is the synchronous electrical angular velocity;  is
the electrical angle; J is the virtual moment of inertia; D is the damping coefficient; Pref is the active
power reference value; Pe is the VSG output (instantaneous) active power; among which torque the
relationship between and power is approximately Te  Pe / N  Pe /  .
Adding traditional synchronous motor speed control to power electronic control is an important part
of VSG. The resulting active power-frequency control block diagram of the virtual synchronous
generator is shown in the figure below.

Fig.1 Active power-frequency control block diagram

The VSG reactive power-voltage control equation is:

E   Dq U n  U o    Qref  Qe   /  Ks  （5）
Where: U n is the rated voltage amplitude; Dq is the reactive power-voltage coefficient; K is the
reactive voltage integral coefficient; Qref is the reactive power reference value; Qe is the VSG output
(instantaneous) reactive power. The reactive power-voltage control block diagram of the virtual
synchronous generator is shown in the figure below.

3
ICAACE-2022 IOP Publishing
Journal of Physics: Conference Series 2258 (2022) 012057 doi:10.1088/1742-6596/2258/1/012057

Uo Qe E
- Dq +-
1
+
Un Qref
+
K s

Fig.2 Reactive power-voltage control block diagram

4. Multi-Agent Mechanism for Battery Energy Storage

The Multi-Agent collaboration framework of the battery energy storage system is shown in Figure 3,
the coordination Agent is connected to the executive Agent and the power grid dispatching center
through dual network cables, using the IEC 61850 communication protocol. The executive Agent is
mainly for the regulation of the battery and the PCS part. It can use the sensor to monitor the battery and
PCS operating conditions, and control the PCS action through the built-in PQ control and virtual
synchronous control mode to achieve autonomous control. Each executive Agent can be associated with
each other. In addition to the ability to monitor key parameters in the area and maintain safe and stable
operation, it also has the ability to coordinate with the executive Agents in the neighboring area.
Coordination Agent can dispatch instructions to be reasonably consumed in each battery unit through
allocation algorithms and optimization rules. Among them, the optimization rule is mainly based on the
following criteria: when the energy storage unit is in a discharged state, the energy storage unit with a
larger SOC should output more power, and the energy storage unit with a smaller SOC should output
less power; conversely, when the energy storage unit is in the charging state, the energy storage unit
with a larger SOC should absorb less power, and the energy storage unit with a smaller SOC should
absorb more power.
Power grid
dispatch Scheduling layer
center

Coordination Coordination
...
Agent1 Agentn

Coordination layer

Ethernet

Local layer
Executive Executive
Agent1 ... Agentn

PCS1 ... PCSn

Battery1 ... Batteryn

Fig.3 Multi-Agent collaborative architecture of battery energy storage system

5. Multi-Agent Collaborative Control Application Scenarios

5.1 Active power-frequency control

The active-frequency support scenario under the Multi-Agent cooperative control mechanism is shown
in Figure 4. When the frequency is disturbed, the executive Agent detects the disturbance information
through the perceptron, stores the relevant information in the database and uses the virtual
synchronization algorithm actively responds to disturbances and provides a certain amount of inertia
support. When the executive Agent cannot eliminate the disturbance or the corresponding battery SOC
status has reached the upper and lower limits, the executive Agent requests assistance from the
coordination Agent through the communication module and the optimization module selects the most

4
ICAACE-2022 IOP Publishing
Journal of Physics: Conference Series 2258 (2022) 012057 doi:10.1088/1742-6596/2258/1/012057

suitable cooperative executive Agent according to the optimization rules. The power distribution module
determines the active power adjustment amount of each PCS participating in frequency modulation
according to the dispatching instructions of the large power grid and the information fed back by the
lower-level Agents, and the database stores the relevant information of the frequency modulation process.

Large power grid dispatching instructions

Coordination Agent
Communication Power
module distribution
module

Preferred
database
module

Assist Executive Agent Request Executive Agent Frequency

Communication Communication disturbance
sensor sensor
module module

Executive Executive Regulate PCS

decision database database decision
module
module

Fig.4 Active power-frequency control scenario

5.2Reactive power-voltage regulation

The Multi-Agent collaborative architecture of the battery energy storage system proposed in this paper
fully considers the moderate charging and generating of energy storage to participate in the grid voltage
regulation, thereby avoiding the large voltage fluctuations caused by frequent switching of
capacitors/reactors. The specific regulation method is shown in Figure 5. Coordination Agent can
determine the reactive power required for grid voltage regulation and the remaining reactive power
margin of energy storage from the real-time voltage information fed back by the lower-level Agent.
When the required reactive power output is not greater than the reactive power margin, the energy
storage alone undertakes the voltage regulation task; if the required reactive power output is greater than
the reactive power margin, the coordination Agent requests the grid to call the capacitor/reactor to
undertake the regulation voltage task, and refined voltage regulation by energy storage auxiliary
capacitor/reactor.
Real-time voltage
information

YES Required reactive power output

<reactive power margin
NO

Energy storage alone

Capacitors/reactors are Energy storage refinement

mainly responsible for assistance
Fig.5 Reactive power-voltage control scenario

5
ICAACE-2022 IOP Publishing
Journal of Physics: Conference Series 2258 (2022) 012057 doi:10.1088/1742-6596/2258/1/012057

6. Conclusion
Aiming at the problem of energy storage operation control, this paper constructs a Multi-Agent
mechanism-based battery energy storage system coordination control system architecture, and proposes
corresponding operation control strategies and application scenarios, and draws the following
conclusions:
（1）The proposed control strategy of the battery energy storage system overcomes the lack of
synchronization support ability and the charging and discharging of the energy storage at a constant
power under the condition of high penetration of renewable energy connected to the grid, realizes the
active response to disturbances on the energy storage side and ensures the safe and stable operation of
large power grids.
（2）The proposed system architecture combines upper-level instruction scheduling and lower-level
information feedback through communication modules to achieve two-way circulation of information,
enabling a large number of distributed energy storage facilities with scattered locations and different
forms to have communication, perception and so on, give full play to the aggregation and regulation
potential of distributed energy storage facilities, change the status quo that distributed energy storage is
difficult to effectively participate in system regulation, and provide a reference plan for subsequent
research on energy storage operation control technology.

References
[1] S. Razavia, Ehsan, R. Mohammad, S. Iavadib, et al. Impact of Distributed Generation on Protection
and Voltage Regulation of Distribution Systems: A Review[J]. Renewable and Sustainable
Energy Reviews, 2019, 105:157-167.
[2] Zhen-xing Li, Bin Tian, Xiang-gen Yin, et al. Active distribution network protection with distributed
power sources and random loads[J]. High Voltage Technology, 2017, 43(04):1231-1238.
[3] Shou-xiang Wang, Li-ke Song, Xin Shu. Adaptive overcurrent protection scheme for active
distribution network with distributed power generation and multi-load high penetration
access[J]. High Voltage Technology, 2019, 45(06):1783-1794.
[4] Dong-yuan Liu. Research on Operation Control Strategy of Energy Storage System Participating in
Grid Frequency Modulation[D]. Northeast Electric Power University, 2018.
[5] Zhi-peng Lv, Wan-xing Sheng, Qing-chang Zhong, et al. Virtual synchronous generator and its
application in microgrid[J]. Journal of Chinese Electrical Engineering Science. 2019, 34(20):
4226-4241.
[6] Delille, Gauthier, Francois, et al. Dynamic frequency regulation using multilevel energy storge in
remote area power supply system[J]. IEEE Transactions on Power Systems, 2019, 34(1):163-
170.
[7] Zhao H, Hong M, Lin M, et al. Voltage and frequency regulation of microgrid with battery energy
storage systems[J]. IEEE Transactions on Smart Grid, 2019, 10(1): 414-424.
[8] Tian-yuan Cao, Min-xiao Han, Wen-qiang Xie, et al. AC/DC power inverter parallel control
technology research status quo analysis[J]. Journal of Electrotechnics. 2019, 34(20): 4226-
4241.
[9] Tian-yang Zhang. Lead to more carbon battery parallel operation of the converter control strategy[D].
Northeast Electric Power University, 2019.
[10] Da-wei Yan, Gang Wei, Yin Hu, et al. Reliability and economy coordinated micro grid energy
optimization[J]. Automation of Electric Power Systems, 2012, 36(08):18-23+51.