Professional Documents
Culture Documents
Published in:
Proceedings of 2022 IEEE/IAS Industrial and Commercial Power System Asia
Publication date:
2022
Document Version
Peer reviewed version
Citation (APA):
Cheng, X., Li, C., & Liu, X. (2022). A Review of Federated Learning in Energy Systems. In Proceedings of 2022
IEEE/IAS Industrial and Commercial Power System Asia (pp. 2089-2095)
https://doi.org/10.1109/ICPSAsia55496.2022.9949863
General rights
Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright
owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.
Users may download and print one copy of any publication from the public portal for the purpose of private study or research.
You may not further distribute the material or use it for any profit-making activity or commercial gain
You may freely distribute the URL identifying the publication in the public portal
If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately
and investigate your claim.
A Review of Federated Learning in Energy Systems
Xu Cheng Chendan Li Xiufeng Liu
Section of Energy Markets Department of Marine Technology Department of Technology,
Smart Innovation Norway Norwegian University of Science and Technology Management and Economics
Halden, Norway Trondheim, Norway Technical University of Denmark
xu.cheng@ieee.org chendan.li@ntnu.no Produktionstorvet, Denmark
xiuli@dtu.dk
Abstract—With increasing concerns for data privacy and own- commercial competition, and technical barrier reasons [2]. At
ership, recent years have witnessed a paradigm shift in machine the legal level, governments or organizations around the world
learning (ML). An emerging paradigm, federated learning (FL), are also increasingly committed to data privacy protection.
has gained great attention and has become a novel design for
machine learning implementations. FL enables the ML model For example, the European Union has enforced the General
training at data silos under the coordination of a central server, Data Protection Regulation (GDPR) since 2017 [3]. Third,
eliminating communication overhead and without sharing raw the computing resource requirements for traditional centralized
data. In this paper, we conduct a review of the FL paradigm model training are relatively high due to the management of
and, in particular, compare the types, the network structures, large amounts of data sets. Last, data transmission over the
and the global model aggregation methods. Then, we conducted
a comprehensive review of FL applications in the energy domain network is vulnerable to cyberattacks and introduces overhead.
(refer to the smart grid in this paper). We provide a thematic Therefore, there is a pressing need for a feasible solution to
classification of FL to address a variety of energy-related prob- address these issues.
lems, including demand response, identification, prediction, and Federated learning (FL) is an ideal paradigm, which was
federated optimizations. We describe the taxonomy in detail first introduced by Google in 2016 [4]. FL is essentially
and conclude with a discussion of various aspects, including
challenges, opportunities, and limitations in its energy informatics a distributed learning approach, where multiple distributed
applications, such as energy system modeling and design, privacy, clients train machine learning models separately using their
and evolution. own local data under the coordination of a central server,
Index Terms—Review, Federated Learning, Energy sector, then the server aggregates the trained models into a final
Distributed learning, Privacy and security global model. Training is an iterative process that involves
updating local models and aggregating the global model until
I. I NTRODUCTION the model converges or the training reaches the predefined
Today the demand for energy is increasing rapidly in the number of interactions. FL is a major shift from centralized
global, due to population and economic growth. The building and expensive machine learning to a distributed manner that
sector accounts for 40% of total energy consumption and 60% can use many distributed computing resources. This learning
of electricity consumption [1]. Distributed energy resources paradigm improves data privacy, as the raw data remain on
are a viable solution to address this problem by integrating the local device, eliminating network overhead as only the
distributed energy systems at users. Distributed energy systems model updates are exchanged. In recent years, FL has been
have the characteristics of high efficiency, low loss, low used successfully in industries related to IoT and edge com-
pollution, and flexible operations. On the other hand, for puting, mainly for privacy protection, but it is attracting more
electricity supply, smart grids have intensively adopted the and more interest. Some literature reviews were performed
Internet of Things (IoT), smart meters, and advanced com- not only on FL technology itself, such as the different FL
munication networks (e.g. 5G) and data management systems, architectures and their learning settings, e.g., [5]–[10], but
which form an advanced energy management infrastructure. also its applications, e.g., [11]–[15]. However, there is still
Smart grids and distributed energy systems together form no systematic review of FL applications in energy. This is
a giant energy of the Internet (IoE) to provide stable and likely due to more research efforts in areas directly related
sustainable energy to end users. However, several prominent to the protection of personal information privacy, such as
issues arise with the provision of various energy services, the medicine, healthcare, and insurance. On the contrary, the
management of massive data, and the offloading of computing literature on FL in energy is much fewer and all of them
workloads from the cloud. First, data privacy becomes a emerged within the last two years. However, we have seen
major concern as customer data is often used to train data- that growth is fast and its applications go beyond addressing
driven models, e.g., for detecting malicious nodes in IoE. data privacy, which is raising great research attention in the
Therefore, it has to access private customer information, such energy community. Therefore, we believe that it is necessary to
as consumption profiles and habits, to train the model. Second, conduct a systematic review. In this paper, we will classify and
data owners may not be willing to share their data to a summarize the different solutions based on FL and their ap-
centralized server for model training, mainly due to privacy, plications in the energy sector. Moreover, unlike other reviews
Central Server
of FL technologies which focus on different architectures and
complementary technologies to enhance FL, we pay special
attention to different aggregate algorithms to generate the
global model. This review can help advance understanding of
FL technology and promote its use cases in the energy sector.
In summary, this paper makes the following contributions. Global Model Aggregation
response programs, and customized energy management solu- and distribution. The advantage of applying federated-based
tions. Although research has been conducted on personalized optimization is that it supports heterogeneous models, i.e., the
recommendations based on FL in other fields, its applications model structure does not need to be consistent across different
in the energy sector remain an open problem that is interest- nodes. Therefore, an ensemble-like heterogeneous distributed
ing to investigate. Finally, energy involves many distributed optimization model can be established to help with decision
optimization problems, including production, transportation, making regarding energy planning or supply.
We are aware that energy is a very broad concept that has [11] L. Li, Y. Fan, M. Tse, and K.-Y. Lin, “A review of applications in
many subdomains. For example, depending on the types of federated learning,” Computers & Industrial Engineering, vol. 149, p.
106854, 2020.
energy, it can be divided into water, electricity, gas, heat, etc., [12] F. A. KhoKhar, J. H. Shah, M. A. Khan, M. Sharif, U. Tariq, and
each with its own life cycle for an energy system. In addition, S. Kadry, “A review on federated learning towards image processing,”
there are many other energy-related research areas, including Computers & Electrical Engineering, vol. 99, p. 107818, 2022.
market, price, regulation, and policies. Therefore, FL has a [13] R. S. Antunes, C. A. da Costa, A. Küderle, I. A. Yari, and B. Eskofier,
“Federated learning for healthcare: Systematic review and architecture
wide potential in energy. proposal,” ACM Transactions on Intelligent Systems and Technology
(TIST), 2022.
V. C ONCLUSION AND FUTURE WORK [14] M. Ali, F. Naeem, M. Tariq, and G. Kaddoum, “Federated learning
for privacy preservation in smart healthcare systems: A comprehensive
FL is an emerging computing paradigm. In this paper, we survey,” arXiv preprint arXiv:2203.09702, 2022.
presented a systematic review of FL and its applications in [15] M. Liu, S. Ho, M. Wang, L. Gao, Y. Jin, and H. Zhang, “Federated
learning meets natural language processing: A survey,” arXiv preprint
the energy sector. We first introduced the concept of FL, the arXiv:2107.12603, 2021.
technical advances especially about the research of solutions, [16] X. Cheng, F. Shi, Y. Liu, X. Liu, and L. Huang, “Wind turbine blade
network structures, and global model generation algorithms. icing detection: a federated learning approach,” Energy, vol. 254, p.
124441, 2022.
Then, we investigated various solutions and applications of FL [17] S. Feng and H. Yu, “Multi-participant multi-class vertical federated
in energy, mainly involving demand-response programs, user learning,” arXiv preprint arXiv:2001.11154, 2020.
characteristics identification, customer segmentation, energy [18] Y. Liu, Y. Kang, C. Xing, T. Chen, and Q. Yang, “A secure federated
prediction, and optimization. We also discussed the technical transfer learning framework,” IEEE Intelligent Systems, vol. 35, no. 4,
pp. 70–82, 2020.
challenges and opportunities of the FL technology itself and [19] X. Cheng, W. Tian, F. Shi, M. Zhao, S. Chen, and H. Wang, “A
enumerated its opportunities in the energy sector. We hope blockchain-empowered cluster-based federated learning model for blade
that this survey will help researchers refine FL techniques and icing estimation on iot-enabled wind turbine,” IEEE Transactions on
Industrial Informatics, 2022.
provide useful reference material for researchers in the energy [20] B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas,
field. “Communication-efficient learning of deep networks from decentralized
In the future work, we will improve our review in a more data,” in Artificial intelligence and statistics. PMLR, 2017, pp. 1273–
1282.
systematic way and update the latest research advances on FL
[21] T. Li, A. K. Sahu, M. Zaheer, M. Sanjabi, A. Talwalkar, and V. Smith,
and its applications in energy. We also intend to develop an FL “Federated optimization in heterogeneous networks,” Proceedings of
benchmarking and evaluation tool, as no such tool is available Machine Learning and Systems, vol. 2, pp. 429–450, 2020.
to date. [22] H. Wang, M. Yurochkin, Y. Sun, D. Papailiopoulos, and Y. Khaz-
aeni, “Federated learning with matched averaging,” arXiv preprint
arXiv:2002.06440, 2020.
R EFERENCES [23] C. Li, O. B. Fosso, M. Molinas, Y. Jingpeng, and P. Raboni, “Defining
three distribution system scenarios for microgrid applications,” in 2020
[1] Y. Li, S. Kubicki, A. Guerriero, and Y. Rezgui, “Review of building IEEE 4th Conference on Energy Internet and Energy System Integration
energy performance certification schemes towards future improvement,” (EI2). IEEE, 2020, pp. 982–987.
Renewable and Sustainable Energy Reviews, vol. 113, p. 109244, 2019.
[24] C. Li, M. Molinas, O. B. Fosso, N. Qin, and L. Zhu, “A data-
[2] X. Cheng, F. Shi, Y. Liu, J. Zhou, X. Liu, and L. Huang, “A class- driven approach to grid impedance identification for impedance-based
imbalanced heterogeneous federated learning model for detecting icing stability analysis under different frequency ranges,” in 2019 IEEE Milan
on wind turbine blades,” IEEE Transactions on Industrial Informatics, PowerTech. IEEE, 2019, pp. 1–6.
2022.
[25] C. Li, S. K. Chaudhary, M. Savaghebi, J. C. Vasquez, and J. M. Guerrero,
[3] P. Voigt and A. Von dem Bussche, “The eu general data protection regu-
“Power flow analysis for low-voltage ac and dc microgrids considering
lation (gdpr),” A Practical Guide, 1st Ed., Cham: Springer International
droop control and virtual impedance,” IEEE Transactions on Smart Grid,
Publishing, vol. 10, no. 3152676, pp. 10–5555, 2017.
vol. 8, no. 6, pp. 2754–2764, 2016.
[4] J. Konečnỳ, H. B. McMahan, F. X. Yu, P. Richtárik, A. T. Suresh, and
D. Bacon, “Federated learning: Strategies for improving communication [26] J. Lin, J. Ma, and J. Zhu, “Privacy-Preserving Household Characteristic
efficiency,” arXiv preprint arXiv:1610.05492, 2016. Identification With Federated Learning Method,” IEEE Transactions on
[5] T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, “Federated learning: Smart Grid, vol. 13, no. 2, pp. 1088–1099, 2022.
Challenges, methods, and future directions,” IEEE Signal Processing [27] S. Lee and D.-H. Choi, “Federated Reinforcement Learning for En-
Magazine, vol. 37, no. 3, pp. 50–60, 2020. ergy Management of Multiple Smart Homes With Distributed Energy
[6] X. Yin, Y. Zhu, and J. Hu, “A comprehensive survey of privacy- Resources,” IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,
preserving federated learning: A taxonomy, review, and future direc- vol. 18, no. 1, pp. 488–497, Jan. 2022.
tions,” ACM Computing Surveys (CSUR), vol. 54, no. 6, pp. 1–36, 2021. [28] J. Gao, J. Gao, W. Wang, Z. Liu, F. R. M. Billah, and B. Campbell,
[7] C. Zhang, Y. Xie, H. Bai, B. Yu, W. Li, and Y. Gao, “A survey on “Decentralized Federated Learning Framework for the Neighborhood: A
federated learning,” Knowledge-Based Systems, vol. 216, p. 106775, Case Study on Residential Building Load Forecasting,” SenSys, 2021.
2021. [29] M. N. Fekri, K. Grolinger, and S. Mir, “Distributed load forecasting
[8] V. Mothukuri, R. M. Parizi, S. Pouriyeh, Y. Huang, A. Dehghantanha, using smart meter data: Federated learning with Recurrent Neural
and G. Srivastava, “A survey on security and privacy of federated Networks,” International Journal of Electrical Power & Energy Systems,
learning,” Future Generation Computer Systems, vol. 115, pp. 619–640, 2021.
2021. [30] A. Taik, B. Nour, and S. Cherkaoui, “EMPOWERING PROSUMER
[9] D. C. Nguyen, M. Ding, P. N. Pathirana, A. Seneviratne, J. Li, and COMMUNITIES IN SMART GRID WITH WIRELESS COMMUNI-
H. V. Poor, “Federated learning for internet of things: A comprehensive CATIONS AND FEDERATED EDGE LEARNING,” IEEE WIRELESS
survey,” IEEE Communications Surveys & Tutorials, 2021. COMMUNICATIONS, vol. 28, no. 6, pp. 26–33, Dec. 2021.
[10] K. J. Rahman, F. Ahmed, N. Akhter, M. Hasan, R. Amin, K. E. Aziz, [31] Y. Wang, I. L. Bennani, X. Liu, M. Sun, and Y. Zhou, “Electricity Con-
A. M. Islam, M. S. H. Mukta, and A. N. Islam, “Challenges, applications sumer Characteristics Identification: A Federated Learning Approach,”
and design aspects of federated learning: A survey,” IEEE Access, vol. 9, IEEE TRANSACTIONS ON SMART GRID, vol. 12, no. 4, pp. 3637–
pp. 124 682–124 700, 2021. 3647, Jul. 2021.
[32] S. Bahrami, Y. C. Chen, and V. W. S. Wong, “Deep Reinforcement
Learning for Demand Response in Distribution Networks,” IEEE Trans-
actions on Smart Grid, vol. 12, no. 2, pp. 1496–1506, 2021.
[33] J. Lin, J. Ma, and J. Zhu, “A Privacy-Preserving Federated Learn-
ing Method for Probabilistic Community-Level Behind-the-Meter Solar
Generation Disaggregation,” IEEE Transactions on Smart Grid, vol. 13,
no. 1, pp. 268–279, 2022.
[34] Y. Li, Y. Li, J. Li, J. Li, and Y. Wang, “Privacy-preserving Spa-
tiotemporal Scenario Generation of Renewable Energies: A Federated
Deep Generative Learning Approach.” IEEE Transactions on Industrial
Informatics, 2021.
[35] A. T. Thorgeirsson, A. T. Thorgeirsson, A. T. Thorgeirsson, S. Scheub-
ner, S. Funfgeld, and F. Gauterin, “Probabilistic Prediction of Energy
Demand and Driving Range for Electric Vehicles With Federated Learn-
ing,” IEEE Open Journal of Vehicular Technology, 2021.
[36] M. Wen, R. Xie, K. Lu, K. Lu, L. Wang, L. Wang, K. Zhang, and
K. Zhang, “FedDetect: A Novel Privacy-Preserving Federated Learning
Framework for Energy Theft Detection in Smart Grid,” IEEE Internet
of Things Journal, 2021.
[37] M. Savi and F. Olivadese, “Short-Term Energy Consumption Forecasting
at the Edge: A Federated Learning Approach,” IEEE access : practical
innovations, open solutions, vol. 9, pp. 95 949–95 969, 2021.
[38] H. Wang, C. Si, and J. Zhao, “Fed-NILM: A Federated Learning-based
Non-Intrusive Load Monitoring Method for Privacy-Protection,” Energy
Conversion and Economics, 2021.
[39] Y. M. Saputra, D. T. Hoang, D. N. Nguyen, E. Dutkiewicz, M. D.
Mueck, M. D. Mueck, and S. Srikanteswara, “Energy Demand Prediction
with Federated Learning for Electric Vehicle Networks,” arXiv: Signal
Processing, 2019.
[40] R. A. Sater and A. B. Hamza, “A Federated Learning Approach to
Anomaly Detection in Smart Buildings,” arXiv: Learning, 2020.
[41] W.-T. Lin, W.-T. Lin, W.-T. Lin, G. Chen, and Y. Huang, “Incentive
edge-based federated learning for false data injection attack detection
on power grid state estimation: A novel mechanism design approach,”
Applied Energy, 2022.