Professional Documents
Culture Documents
Algorithm For Detection of Change Point in On-Line Monitoring Data
Algorithm For Detection of Change Point in On-Line Monitoring Data
Monitoring Data
M. B. Anoop1; K. Balaji Rao2; and N. Lakshmanan3
Abstract: The detection of abrupt changes in observed/estimated physical processes is an issue of concern in many applications. An
algorithm for single change point detection in Gaussian white noise processes is presented in this paper. The algorithm progressively
includes and analyzes the observed data points, and hence is suitable for detection of change point in on-line monitoring data. Two
example problems are presented, wherein Monte Carlo simulation technique is used, to illustrate the proposed algorithm. The performance
of the algorithm with respect to changes in shift amplitude, intensity of the signal, and rate of sampling are studied, and the observed
trends indicate that the proposed algorithm possesses the desirable properties of change detection algorithms.
DOI: 10.1061/共ASCE兲1076-0342共2008兲14:1共33兲
CE Database subject headings: Noise; Algorithms; Gaussian process; Monitoring; Data processing; Signal processing.
Introduction crack during the passage of load 共Ziehl and Lamanna 2003兲.
Remaining life assessment and damage modeling of structural
Many practical problems arising in quality control, signal pro- systems and assemblages requires identification of time of occur-
cessing, and fault detection and monitoring in industrial plants rence of damage event for the structural system. This necessitates
can be modeled with the aid of parametric models in which pa- the need for the development of suitable change point detection
rameters are subject to abrupt changes at unknown time instants algorithms.
共Basseville and Nikiforov 1993兲. In such cases, detection of The development of algorithms for change point detection is
abrupt changes in observed/estimated physical processes is an an area of active research with applications in various disciplines
issue of concern. For example, when studying the displacement 共Basseville and Nikiforov 1993; Kailath 1998; Perreault et al.
response process of a single degree of freedom elastoplastic os- 1999; Vellekoop and Clark 2003; Jann 2000; Staudacher et al.
cillator exited by a Gaussian white noise 共GWN兲 共Tarp-Johansen 2005兲. The approaches adapted for solving change-point problems
and Ditlevsen 2000兲, it is of interest to determine when response include maximum likelihood, Bayesian, Bayes-type, nonparamet-
has entered the plastic domain. In many engineering applications, ric, as well as decision theoretic procedures 共Jandhyala et al.
the processes can be considered a GWN, and it is important to 1999兲. Most of these approaches are based on time-domain analy-
estimate the instant at which one-step shift in mean level of the sis. But, in some cases, it may be required to analyze data in both
GWN occurs. For example, when health of the structure is being time and frequency domains. For instance, a step shift in the mean
monitored, readings of strain from embedded strain gauges along of the signal is localized in time domain, whereas a change in
with embedded sensors of temperature and humidity are typically variance is more localized in the frequency domain 共Ganesan et
used to study the state of health. With the occurrence of a damage al. 2004兲. Thus, if the interest is to detect changes in both mean
event, there will be a shift in the mean level of the signal from the and variance, the data should be analyzed using a time-frequency
sensor/gauge. For instance, Fig. 1 shows the strains recorded approach. Wavelet-based change point detection methods, which
using a strain gauge at the midspan of a girder of the Bonnet can extract both time- and frequency-related information, have
Carre Spillway Bridge during an extreme overload 共Ziehl and been investigated by many researchers 共Mallat and Hwang 1992;
Lamanna 2003兲, from which it is noted that there is an increase in Antoniadis and Gijbels 2002; Ganesan et al. 2004; Raimondo and
mean strain with the passage of the overload. The increase in Tajvidi 2004; Ko and Vannucci 2006兲. However, the application
mean strain after the passage of the overload has been attributed of wavelet-based methods to on-line change point detection is
to either the malfunction of strain gauge or the development of a restricted by the noncausality of the wavelet, which introduces a
time delay in the computation of wavelet coefficients at
1
Scientist, Structural Engineering Centre, CSIR Campus, Taramani, nondyadic locations 共Ganesan et al. 2004兲. Also, the dyadic dis-
Chennai 600 113, India. cretization requires the signal to be of dyadic length for the de-
2
Scientist, Structural Engineering Research Centre, CSIR Campus, composition to take place.
Taramani, Chennai 600 113, India. E-mail: balajiserc1@yahoo.com With the development of more comprehensive strategies for
3
Director, Structural Engineering Research Centre, CSIR Campus, monitoring the health of long-span bridges and the developments
Taramani, Chennai 600 113, India. in smart sensor technology, digital data acquisition, and in low-
Note. Discussion open until August 1, 2008. Separate discussions
cost wireless sensors 共Pines and Aktan 2002; Lynch et al. 2003;
must be submitted for individual papers. To extend the closing date by
one month, a written request must be filed with the ASCE Managing
2004; Farrar et al. 2006兲, there is a need to develop algorithms for
Editor. The manuscript for this paper was submitted for review and pos- change point detection in on-line monitoring data recorded/
sible publication on September 5, 2006; approved on August 27, 2007. cached in a central location and analyzed in real-time for auto-
This paper is part of the Journal of Infrastructure Systems, Vol. 14, No. mated diagnosis of structural health. In this study, the emphasis is
1, March 1, 2008. ©ASCE, ISSN 1076-0342/2008/1-33–41/$25.00. to develop an algorithm for detection of shift in the mean when
冋 冕 册
paper is organized as follows: the proposed algorithm for change ⬁
point detection of on-line monitored data is presented in the next A
d共t兲 = 共t兲 − xdF共x兲 y共t兲dt 共5兲
section, followed by two example problems. In the first example, I t
the performance of the proposed algorithm is studied with respect
to changes in: 共1兲 shift amplitude; 共2兲 intensity of the signal; and
共3兲 rate of sampling are studied. In the second example, the algo- A
d⌳共t兲 = 关⌳共t兲 + F共t兲 − 1兴y共t兲dt 共6兲
rithm is applied to a practical case study of identifying time of I
corrosion initiation in a reinforced concrete bridge girder. The
concluding remarks are given in the last section. satisfying the initial conditions
冕
⬁
Proposed Algorithm for Change Point Detection in ⌳共0兲 = 1, 共0兲 = xdF共x兲 共7兲
−⬁
On-Line Monitoring Data
It is noted from Eq. 共4兲 that ⌳共t兲⫽likelihood ratio in the problem
It is assumed that the observed continuous time random process of testing two hypotheses: H0 : y共t兲 = 共t兲 共no change has oc-
兵Y共t兲 , t 艌 0其 has the following form: curred兲; H1 : y共t兲 = AU共t − 兲 + 共t兲 共change has occurred兲.
Y共t兲 = AU共t − 兲 + 共t兲, t艌0 共1兲 F共兲⫽known distribution function, decided based on engineer-
ing judgment, for the time of shift. At t = 0, as no information on
where 兵共t兲 , t 艌 0其 = standard Gaussian white noise process with
y共t兲 is available, the optimal estimate for time of shift, ˆ 共0兲, will
zero mean and Dirac delta function correlation function 共i.e.,
be the mean of F共兲. This can be noted from the initial condi-
具共t兲典 = 0 , 具共t兲共t + 兲典 = I␦共t − 兲兲; where I = intensity of the white
tions given by Eq. 共7兲. As long as the available information 关i.e.,
noise process. 共t兲 represents the randomness in the system per-
y共t兲兴 is favoring the null hypothesis H0, 共i.e., no shift in the mean
formance with time. Eq. 共1兲 indicates that the perfect state of the
has occurred兲, the optimal estimate for the time of shift will not
sensor/gauge is represented by a GWN process and any changes
change. Once the shift in mean has occurred, there will be a
occurring in the process represented by the first term of the equa-
change in the optimal estimate indicating that the available infor-
tion. In this equation, A = shift in the mean of the observed process
mation is now favoring the alternative hypothesis H1.
兵Y共t兲 , t 艌 0其 and in many practical problems the shift of the mean
Eqs. 共4兲–共6兲, which are used to describe the properties of the
level can be interpreted as the disruption in the process, which
might have occurred due to change of state of the system under Bayes estimator, suggest that for fixed ˆ 共t兲, ⌳共t兲, the value of the
observation. U共t − 兲 is a unit step function defined as follows: Bayesian estimate at the time 共t + u兲 is given only by the quantities
共t兲 =
冏冕0
t
ˆ 共x兲dx − ˆ 共t兲 · t 冏 共9兲
兩ˆ 共0兲 − ˆ 共t兲兩
The time of shift is value to which 共t兲 converges 共or when the
successive values of 共t兲 do not differ by more than a specified
tolerance兲. The efficacy of the algorithm can be estimated by
computing the delay for detection 共defined as the difference be-
tween the actual time of shift and the predicted time of shift兲. As Fig. 2. Schematic representation of problem considered in
the entire observed time history of the process need not be con- Example 1
event leading to step shift in the mean for each realization of the
observed process, are generated.
In the present study, the amplitude of shift, A, is assumed to be
1.0, and the width of the sliding window is taken to be 10 years
共i.e., N = 500 in this case兲. Fourth-order Runge–Kutta method is
used for solving ordinary differential equations 共5兲 and 共6兲 to
determine ˆ 共t兲 关Eq. 共4兲兴 and the time of shift is determined using Fig. 4. Typical realizations of the observed process without and with
Eq. 共8兲 for each realization of the process. the shift 共time of occurrence of damaging event= 6.04 years兲
Fig. 6. Comparison of actual and predicted times of shift for increase in variance 共representing the intensity兲, probability con-
Example 1
tent of y共t兲, at any given time, contributing toward hypothesis H1
is lower in the event of a shift.
and standard deviation of error in detection for these values of Performance with respect to Changes in Sampling Rate of
shift amplitude are shown in Fig. 9. It is noted that as the value of Signal
the shift amplitude increases, mean and standard deviation of
error in detection decreases. Thus, the predictions are improving The sampling rate of the signal is varied as 50, 10, 2, 1, and 0.2
with increase in shift amplitude, which is expected as for higher per year. The mean and standard deviation of error in detection
shift amplitudes, the probability content of y共t兲, at any given time, obtained are shown in Fig. 11. It is noted from Fig. 11 that, as
contributing toward the hypothesis H1 is higher in the event of a expected, the mean and standard deviation of error in detection
shift. increase with decrease in the sampling rate.
ti =
d2
4D
冋 冉 冊册
erf−1
cs − ccr
cs
−2
共10兲
surface chloride content, and critical chloride content are treated
as random variables in this study. The values of mean and stan-
dard deviation of these random variables are given in Table 1. The
where d = clear cover to reinforcement; D = diffusion coefficient mean and standard deviation of time-to-corrosion initiation is de-
for chlorides in concrete; cs = surface chloride content, and ccr
termined using a first order approximation, and it is assumed that
= critical chloride content. To account for variations in workman-
ti follows a lognormal distribution 共Balaji Rao et al. 2004兲. The
ship and exposure conditions, cover depth, diffusion coefficient,
Fig. 10. Variation of error in detection with change in variance of signal 共amplitude of shift= 1.0兲
Fig. 11. Variation of error in detection with change in sampling rate of signal 共amplitude of shift= 1.0兲
冋册
具共ˆ ML共T兲 − 兲2兩 = x典 = 26 2
A
I 2
共1 + o共1兲兲 共12兲
References
Conclusions
Andrade, C., Alonso, M. C., and Gonzalez, J. A. 共1990兲. “An initial effort
An algorithm for detecting the change point in on-line monitored to use the corrosion rate measurements for estimating rebar durabil-
data is presented. The usefulness of the algorithm is studied with ity.” Corrosion rates of steel in concrete, ASTM STP 1065, N. S.
the help of two examples, and the performance of the algorithm Berke, V. Chaker, and D. Whiting, eds., American Society for Testing
with respect to changes in: 共1兲 shift amplitude,;共2兲 intensity of and Materials, Philadelphia, 29–37.
Anoop, M. B., Balaji Rao, K., and Appa Rao, T. V. S. R. 共2002兲. “Ap-
signal; and 共3兲 rate of sampling are studied. Observed trends in-
plication of fuzzy sets for estimating the service life of reinforced
dicate that the algorithm possesses desirable properties of change concrete structural members in corrosive environments.” Eng. Struct.,
detection algorithms. The algorithm has the limitation that it can 24共9兲, 1229–1242.
only be used for change point detection when the observed pro- Anoop, M. B., Balaji Rao, K., and Appa Rao, T. V. S. R. 共2003兲. “A
cess is a realization of a GWN process. Also, there is a need to methodology for durability-based service life design of reinforced
validate the performance of the algorithm using experimental concrete flexural members.” Mag. Concrete Res., 55共3兲, 289–303.
data. Further studies are being carried out to improve the perfor- Antoniadis, A., and Gijbels, I. 共2002兲. “Detecting abrupt changes by
mance of the algorithm, and to develop similar algorithms for wavelet methods.” Nonparametric Statistics, 14共1–2兲, 7–29.
detection of change-points in non-Gaussian processes. Balaji Rao, K., Anoop, M. B., Gopalakrishnan, S., Manjuprasad, M., and
Lakshmanan, N. 共2004兲. “Seismic vulnerability analysis of corrosion-
affected reinforced concrete structures.” SERC Project Rep. No. SS-
OLP09441-RR-2004-3, Structural Engineering Research Centre,
Acknowledgments Chennai, India.
Balaji Rao, K., Anoop, M. B., and Lakshmanan, N. 共2006兲. “An algo-
This paper is being published with the kind permission of the rithm for detection of change point in on-line monitoring data.” SERC
Director, SERC, Chennai. The authors are thankful to the review- Project Rep. No. SS-OLP11641/COR12-RR-2006-4, Structural Engi-
neering Research Centre, Chennai, India.
ers for their helpful comments and suggestions.
Basseville, M., and Nikiforov, I. V. 共1993兲. Detection of abrupt changes:
Theory and applications, Prentice-Hall, Englewood Cliffs, N.J.
Baweja, D., Roper, H., and Sirivivatnanon, V. 共1999兲. “Chloride-induced
Appendix steel corrosion in concrete: Part 2—Gravimetric and electrochemical
comparisons.” ACI Mater. J., 96共3兲, 306–313.
Bureau of Indian Standards 共BIS兲. 共2000兲. “Indian Standard code of prac-
The maximum likelihood estimator 共MLE兲, ˆ ML共t兲, can be ob- tice for plain and reinforced concrete.” IS 456-2000, Indian Standards
tained from the observations y t0 from the relations given below Institution, New Delhi, India.
共Fishman 1986兲 Chow, E. Y., and Willsky, A. S. 共1984兲. “Bayesian design of decision
rules for failure detection.” IEEE Trans. Aerosp. Electron. Syst.,
max z共t兩x兲 = z共t兩ˆ ML共t兲兲 20共6兲, 761–774.
x苸关0,t兴 Cottis, R. A., Al-Awadhi, M. A. A., Al-Mazeedi, H., and Turgoose, S.
共2001兲. “Measures for the detection of localized corrosion with elec-
where trochemical noise.” Electrochim. Acta, 46共24–25兲, 3665–3674.
Farrar, C. R., Park, G., Allen, D. W., and Todd, M. D. 共2006兲. “Sensor
冕
t
A A2 network paradigms for structural health monitoring.” Struct. Control
z共t兩x兲 = y共u兲du − 共t − x兲 for all t 艌 x 共11兲 Health Monit., 13共1兲, 210–225
I 2I
x Fishman, M. 共1986兲. “Bayesian mean square estimation of the instant of
one-step shift of the mean level of white Gaussian noise.” Detection
ˆ ML共t兲 does not, in general, have the property given by Eq. 共7兲.
of changes in random processes, L. Telksnys, ed., Optimization Soft-
In the asymptotic case, that is, when A2T / I → ⬁ the conditional ware Inc. Publication Division, New York.
mean square error for the Bayesian ˆ 共T兲 and ˆ ML共T兲 of the esti- Ganesan, R., Das, T. K., and Venkataraman, V. 共2004兲. “Wavelet-based
mates have the form multiscale statistical process monitoring: A literature review.” IIE