Professional Documents
Culture Documents
A Hybrid Event Detection Approach For Non-Intrusive Load Monitoring
A Hybrid Event Detection Approach For Non-Intrusive Load Monitoring
1, JANUARY 2020
Abstract—Non-intrusive load monitoring (NILM) is a practical consumption information feedback to consumers will reduce
method to provide appliance-level electricity consumption energy waste [3].
information. Event detection, as an important part of event-based
NILM methods, has a direct impact on the accuracy of the ulti-
mate load disaggregation results in the entire NILM framework.
A. Review of NILM
This paper presents a hybrid event detection approach for rel-
atively complex household load datasets that include appliances In recent years, the widespread implementation of smart
with long transients, high fluctuations, and/or near-simultaneous meters has made appliance load monitoring (ALM) a promis-
actions. The proposed approach includes a base algorithm based ing way to cut energy consumption. A meter-level system,
on moving average change with time limit, and two auxiliary
algorithms based on derivative analysis and filtering analysis. namely non-intrusive load monitoring (NILM), is a practi-
The structure, steps, and working principle of this approach are cal method to provide appliance-level electricity consumption
described in detail. The proposed approach does not require information to both customers and utilities. NILM system
additional information about household appliances, nor does it aims to monitor appliances switching-on and -off actions, their
require any training sets. Case studies on different datasets are working durations, and other relevant information. Through
conducted to evaluate the performance of the proposed approach
in comparison with several existing approaches including log these data, NILM is able to decompose overall power con-
likelihood ratio detector with maxima (LLD-Max) approach, sumption into the power usage of individual appliances. Unlike
active window-based (AWB) approach, and generalized likelihood intrusive load monitoring (ILM), the NILM technique uses
ratio (GLR) approach. Results show that the proposed approach simple hardware (one sensor per house) but complex software
works well in detecting events in complex household load datasets (more computing) to achieve its goal. In this way, less sen-
and performs better than the existing approaches.
sor is needed which has benefits of low cost, easy installation,
Index Terms—Non-intrusive load monitoring, event detection, removal and maintenance. Due to its unique characteristics, the
household appliances. NILM technique could be used in energy management, power
security, abnormal action detection and demand response (DR)
for utilities while assisting customers to understand bills, plan
I. I NTRODUCTION monthly budget, and save money.
OSSIL fuels are the largest energy sources for electric- Existing NILM methods can be roughly classified into
F ity generation in the U.S., about 62% of which are from
natural gas and coal in 2018 [1]. An average of 29.0 bil-
event-based and non-event-based depending on the require-
ment of obtaining appliance events. The changes or discon-
lion cubic feet per day (BCF/d) natural gas was consumed tinuities in power signal are called events or edges which
for electricity generation in 2018 and is expected to increase are treated as state transitions points in NILM. Event-based
by 1.3% in 2019 [2]. The large consumption of these energy method requires the process of event detection and classifica-
sources and their increasing trend make energy conservation tion in order to further identify the appliances. Fig. 1 illustrates
a challenging task. Meanwhile, a growing attention towards the active power measurements of a household lighting system
environmental issues, such as carbon dioxide emission reduc- which is recorded in the lab. The state transition points of each
tion, global warming mitigation, and sustainable development, appliance are labelled as events shown in Fig. 1.
requires a reasonable way to manage energy wisely. Since
37.4% of the electricity were consumed by the residential
B. Review of Existing Event Detection Approaches
sector, it is imperative to take actions to save energy in this
sector. Some studies indicate that by providing the energy The purpose of the event detection process in a NILM
system is to detect the times when state transition actions
Manuscript received March 21, 2019; revised May 9, 2019 and May 31, occur from the aggregated measurements. The state transi-
2019; accepted June 18, 2019. Date of publication June 25, 2019; date of cur- tion actions normally include appliance turn-on, turn-off, speed
rent version December 23, 2019. Paper no. TSG-00424-2019. (Corresponding adjustments, and function/mode changes. An accurate event
author: Zuyi Li.)
The authors are with the Electrical and Computer Engineering Department, detection approach is the prerequisite for precise load iden-
Illinois Institute of Technology, Chicago, IL 60616 USA (e-mail: tification and valid power consumption estimation. In this
mlu14@hawk.iit.edu; lizu@iit.edu). section, we review two categories of existing event detec-
Color versions of one or more of the figures in this paper are available
online at http://ieeexplore.ieee.org. tion approaches and evaluate the performance of two typical
Digital Object Identifier 10.1109/TSG.2019.2924862 statistical event detection approaches.
1949-3053 c 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
LU AND LI: HYBRID EVENT DETECTION APPROACH FOR NILM 529
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
530 IEEE TRANSACTIONS ON SMART GRID, VOL. 11, NO. 1, JANUARY 2020
Fig. 2. The plots of active power and CUSUM results in both methods of Fig. 3. The plots of active power and LLD-Max results in a lighting system.
a lighting system.
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
LU AND LI: HYBRID EVENT DETECTION APPROACH FOR NILM 531
Fig. 6. The plots of event detection results by using different window sizes
with and time limit in a lighting system.
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
532 IEEE TRANSACTIONS ON SMART GRID, VOL. 11, NO. 1, JANUARY 2020
TABLE I
T YPICAL D URATIONS OF T RANSIENT P ERIODS OF M AJOR A PPLIANCES
Fig. 7. The plots of event detection results by using moving average algorithm
with and without time limit in a lighting system.
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
LU AND LI: HYBRID EVENT DETECTION APPROACH FOR NILM 533
Fig. 10. The turn-on transient and their derivatives of type 1 appliances. Fig. 13. The Speed adjustment transient of a range hood and its derivatives.
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
534 IEEE TRANSACTIONS ON SMART GRID, VOL. 11, NO. 1, JANUARY 2020
xj − xj−1
f = (10)
h
xj − 2xj−1 + xj−2
f = (f ) = (11) Fig. 14. Peak detection result after smoothing.
h2
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
LU AND LI: HYBRID EVENT DETECTION APPROACH FOR NILM 535
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
536 IEEE TRANSACTIONS ON SMART GRID, VOL. 11, NO. 1, JANUARY 2020
TABLE III
R ECORD OF A PPLIANCES ACTIVITIES IN H OUSE 1
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
LU AND LI: HYBRID EVENT DETECTION APPROACH FOR NILM 537
Fig. 18. Active power plots of house 1 measurements. Fig. 21. Event detection results of filtering.
TABLE IV small appliance has actions during the fluctuation power, this
N UMBER OF E VENTS A FTER E ACH A LGORITHM
approach still has ability to detect them. In Fig. 22, we
compare the detection results with LLD-Max algorithm [14].
From the results, the LLD-Max algorithm detects one false
event and loses one true event results from long-transient and
close-action.
other false alarms are far from others which means they are B. Household Appliance Actions With Short Time Interval
not caused by long transients. This case contains lighting system of a residential house
Fig. 21 shows the events detection results of filtering and which includes two 40W incandescent lights, two 24W
final results. The first plot depicts the event detection results compact fluorescent lights (CFLs) and a 24W LED. Near-
after filtering method applied to the original data. In this pro- simultaneous actions, which mean that multiple state changes
cess, false events caused by oscillation are filtered by this occur within a short period of time (4s and less in this exper-
algorithm. The removed events are described in the second iment), are taken in this experiment. The purpose of this
plot. The last plot shows the final results which contains all the combination is to test the performance of an event detec-
20 true events without false event. Table IV records the number tion approach to detect near-simultaneous actions. The overall
of event detection results after applying each algorithm. test lasted about 31 minutes and the detailed appliance events
In this case, the proposed hybrid approach detects all the are shown in Table V. The corresponding plots and detection
true events including some complex ones without causing results are shown in Fig. 23.
false alarm. It proves that this approach has ability to cap- In the detection results, all the 18 events are detected by the
ture events with complex transients and fluctuations. When algorithm even when the time difference between two events
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
538 IEEE TRANSACTIONS ON SMART GRID, VOL. 11, NO. 1, JANUARY 2020
TABLE V
R ECORD OF A PPLIANCES ACTIVITIES IN L IGHTING S YSTEM
TABLE VI
P ERFORMANCE E VALUATION OF E VENT D ETECTION A LGORITHM
TABLE VII
E VENTS R ESULTS A FTER E ACH A LGORITHM
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
LU AND LI: HYBRID EVENT DETECTION APPROACH FOR NILM 539
TABLE VIII
P ERFORMANCE E VALUATION OF E VENT D ETECTION A LGORITHM IN [9] real house measurement with different sampling rates to prove
its robustness to multiple meters with distinct frequencies.
It should be pointed out that while individual algorithms
in the proposed approach use existing statistical methods,
their combined use to address the unique problems under the
TABLE IX
P ERFORMANCE E VALUATION OF E VENT D ETECTION A LGORITHM context of event detection and the guidelines to choose the
parameters in those algorithms are beneficial to researchers in
the area of NILM. In addition, the use of derivative analy-
sis under the context of event detection for NILM to remove
false alarms caused by appliances with long and complex tran-
sitions, to the best of our knowledge, is the first of its kind.
As indicated before, we take simultaneous events as one event
The use of filtering analysis as the third step instead of the first
which results in 889 true events occurring at different times.
step of the proposed approach to remove false alarms caused
In addition, the 94.15% TPP proves the proposed approach
by appliances with high fluctuations is also unique. In com-
can be applied in situations with different sampling rates.
parison, filtering analysis is generally used as the first step,
The low FPP means less false alarms are triggered. Generally,
which in our opinion may eliminate some true events.
a higher sampling frequency often provides a better resolution
The proposed approach calculates the mean values of the
and more details, on the other side, it brings more uncertain-
aggregated data in the base algorithm once the new data are
ties to the algorithm. Therefore, the proposed method is robust
collected from the meter. Then the corresponding derivatives
to sampling frequency in some cases.
are computed. The filtering analysis recalls the base algorithm
when filtering is applied to the aggregated data. Therefore,
IV. C ONCLUSION the computational burden increases along with the increase in
In this paper, we propose a hybrid approach for event detec- sampling rates of the meter. However, this approach does not
tion in NILM. It does not require additional information other require advanced calculation or training. Thus, this approach
than the aggregated data collected from a single meter. This can be applied as an on-line method. The detection lag is
approach works without knowing historical data about appli- decided by the largest window used in the approach which is
ance and houses. In addition, it can improve the detection the time threshold of multiple events (2s in this paper).
performance of events which are caused by complex transition Our future work is to apply the proposed hybrid approach
period. It also has some abilities to be used in complex situa- to other electrical parameters such as current, reactive power
tions such as near-simultaneous actions and high fluctuations and power factor to seek for a better performance. We will
appliance. apply the proposed approach to more measurements under dif-
Rather than using a single step, the proposed hybrid ferent conditions to find a practical way for large-scale real
approach uses one base algorithm and two auxiliary algorithms house implementation. Meanwhile, more types of appliances
to detect events and remove false events at the same time. In with complex state transitions in residential and small com-
this process, the base algorithm uses a strict condition to cap- mercial houses will be tested using the proposed approach.
ture as many true events as possible. Each auxiliary algorithm Furthermore, we are now working on the survey of load sig-
aims to remove certain type of false alarm caused by appli- natures in various categories to find a more general guideline
ances with long and complex transitions and high fluctuations. on parameter selection based on type and scale of houses.
Derivative analysis relies on geometrical characters of appli-
ance to find true events among multiple results. It removes
the false events on the same appliance transient. The filtering A PPENDIX
analysis is to remove the wrongly detected events caused by L IST OF S YMBOLS
fluctuation of large appliance. In order to prevent true events For the convenience of reference, all symbols used in this
from being removed by mistake, derivative peaks comparison paper are listed as follows.
is introduced to ensure the accuracy of this removal. The aux- Symbol Definition
iliary algorithms remove the detected false events caused by n Number of samples within the sliding window
the base algorithm step by step and finally obtain as many true Mean Moving average value
events as possible. The entire approach provides a simple way X Electrical parameter (e.g., real power, reactive power,
for event detection without requiring additional information current, and power factor)
about house or appliance. It also does not need training or an S Cumulative sum value
event library. ds Detection statistics result
In this paper, we evaluate the proposed approach in special μ Mean value within the preset window size
cases and public dataset. The results show that it is compet- Pth Power threshold
itive with other algorithms. Moreover, it does not need to Mpre Window size to find local peaks which is called
restrict application condition and it has ability to deal with maxima precision in the references
special actions of household appliance such as close-action, f , f First-order and second-order derivatives
complex transition period and small appliance action among H Uniform spacing
large fluctuation working device. We also test the algorithm in X Time-series data
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.
540 IEEE TRANSACTIONS ON SMART GRID, VOL. 11, NO. 1, JANUARY 2020
t Time difference between two continuous events [11] Z. M. Nopiah, M. N. Baharin, S. Abdullah, M. I. Khairir, and
Tth Given time threshold in base algorithm C. K. E. Nizwan, “Abrupt changes detection in fatigue data using
the cumulative sum method,” J. WSEAS Trans. Math., vol. 7, no. 12,
d First-order derivative of aggregated data pp. 708–717, Dec. 2008.
ε Preset value to get rid of the effect of noise [12] K. N. Trung, O. Zammit, E. Dekneuvel, B. Nicolle, C. N. Van, and
t1 Time difference between two continuous peaks or G. Jacquemod, “An innovative non-intrusive load monitoring system for
commercial and industrial application,” in Proc. IEEE Int. Conf. Adv.
valleys Technol. Commun. (ATC), Hanoi, Vietnam, Oct. 2012, pp. 10–12.
Tth,1 Given time threshold in derivative analysis algorithm [13] Z. Zhu, Z. Wei, B. Yin, S. Zhang, and X. Wang, “A novel approach for
e Error event detection in non-intrusive load monitoring,” in Proc. IEEE Conf.
Energy Internet Energy Syst. Integr. (EI2), Beijing, China, Nov. 2017,
i, j Subscript: index for samples and parameters pp. 1–5.
t Subscript: index for time periods [14] L. Pereira, “Developing and evaluating a probabilistic event detector for
meas Subscript: measurement value non-intrusive load monitoring,” in Proc. Sustain. Internet ICT Sustain.
(SustainIT), Funchal, Portugal, Dec. 2017, pp. 37–46.
true Subscript: true value [15] W. S. Cleveland, “Robust locally weighted regression and smoothing
noise Subscript: noise value. scatterplots,” J. Amer. Stat. Assoc., vol. 74, no. 368, pp. 829–836, 1979.
[16] A. Savitzky and M. J. E. Golay, “Smoothing and differentiation of data
by simplified least squares procedures,” Anal. Chem., vol. 36, no. 8,
R EFERENCES pp. 1627–1639, 1964.
[17] K. Anderson, A. Ocneanu, D. Benitez, D. Carlson, A. Rowe, and
[1] Annual Energy Outlook 2019 With Projections to 2050, Energy Inf.
M. Berges, “BLUED: A fully labeled public dataset for event-based
Admin., Washington, DC, USA, Jan. 2019.
non-intrusive load monitoring research,” in Proc. Workshop Data Min.
[2] Short-Term Energy Outlook, Energy Inf. Admin., Washington, DC, USA,
Appl. Sustain. (SustKDD), Beijing, China, 2012, pp. 1–5.
Jan. 2019
[3] K. Ehrhardt-Martinez, K. A. Donnelly, and J. A. Laitner, “Advanced
metering initiatives and residential feedback programs: A meta-review
for household electricity-saving opportunities,” Amer. Council Energy
Mengqi Lu received the B.S. degree in electrical
Efficient Econ., Washington, DC, USA, Rep. E105, Jun. 2010.
engineering from Zhengzhou University, Zhengzhou,
[4] E. Holmegaard and M. B. Kjaergaard, “NILM in an industrial setting:
China, in 2012, the M.S. degree in electrical engi-
A load characterization and algorithm evaluation,” in Proc. IEEE Int.
neering from George Washington University, DC,
Conf. Smart Comput. (SMARTCOMP), St. Louis, MO, USA, May 2016,
USA, in 2014, and the Ph.D. degree in elec-
pp. 1–8.
trical engineering from the Illinois Institute of
[5] A. G. Ruzzelli, C. Nicolas, A. Schoofs, and G. M. P. O’Hare, “Real-
Technology, Chicago, in 2019. His research interests
time recognition and profiling of appliances through a single electricity
include power market operation, microgrids, and
sensor,” in Proc. 7th Annu. IEEE Commun. Soc. Conf. Sensor Mesh Ad
smart home.
Hoc Commun. Netw. (SECON), Boston, MA, USA, 2010, pp. 1–9.
[6] G. W. Hart, “Nonintrusive appliance load monitoring,” in Proc. IEEE,
vol. 80, no. 12, pp. 1870–1891, Dec. 1992.
[7] L. K. Norford and S. B. Leeb, “Non-intrusive electrical load mon-
itoring in commercial buildings based on steady-state and transient
load-detection algorithms,” Energy Build., vol. 24, no. 1, pp. 51–64,
1996. Zuyi Li (SM’09) received the B.S. degree in electri-
[8] A. GirMay and C. Camarda, “Simple event detection and disaggre- cal engineering from Shanghai Jiaotong University,
gation approach for residential energy estimation,” in Proc. 3rd Int. Shanghai, China, in 1995, the M.S. degree in electri-
Workshop Non Intrusive Load Monitor. (NILM), Vancouver, BC, Canada, cal engineering from Tsinghua University, China, in
May 2016, p. 22. 1998, and the Ph.D. degree in electrical engineering
[9] M. Berges, E. Goldman, H. S. Matthews, L. Soibelman, and from the Illinois Institute of Technology, Chicago,
K. Anderson, “User-centered nonintrusive electricity load monitoring for in 2002, where he is currently a Professor with the
residential buildings,” J. Comput. Civil Eng., vol. 25, no. 6, pp. 471–480, Electrical and Computer Engineering Department
Nov. 2011. and the Associate Director of the Robert W. Galvin
[10] K. D. Anderson, M. E. Bergés, A. Ocneanu, D. Benitez, and Center for Electricity Innovation. His research
J. M. F. Moura, “Event detection for non-intrusive load monitoring,” in interests include economic and secure operation of
Proc. 38th Annu. Conf. IEEE Ind. Electron. Soc., Montreal, QC, Canada, electric power systems, cyber security in smart grid, renewable energy
Oct. 2012, pp. 3312–3317. integration, and power system protection.
Authorized licensed use limited to: King Mongkut's University of Technology Thonburi. Downloaded on June 14,2023 at 02:54:24 UTC from IEEE Xplore. Restrictions apply.