Professional Documents
Culture Documents
A R T I C L E I N F O A B S T R A C T
Keywords: Calculation of the decision threshold and detection limit of a measurement, or measurement method, are crucial
Decision threshold in order to decide if an analyte is present or not and with what confidence it can be quantified. That decision is
Detection limit important in view of possible actions if something would be detected. In this work, a method for calculating these
Minimum detectable activity
limits using a Monte Carlo method is presented. In the Monte Carlo method any a priori distribution (e.g. normal
MDA
Monte Carlo
distribution, rectangular distribution, triangular distribution) of an input quantity can be selected. Differences
between the Monte Carlo calculated characteristic limits and the ones calculated according to ISO 11929:2010 is
presented. Moreover, suggestions how to calculate the detection limit when it can not be calculated according to
the ISO 11929:2010 are given.
* Corresponding author. Swedish Defence Research Agency (FOI), CBRN Defence and Security, SE-164 90, Stockholm, Sweden
E-mail address: henrik.ramebeck@foi.se (H. Rameb€
ack).
https://doi.org/10.1016/j.apradiso.2019.108949
Received 8 May 2019; Received in revised form 4 September 2019; Accepted 15 October 2019
Available online 18 October 2019
0969-8043/© 2019 Elsevier Ltd. All rights reserved.
H. Rameb€
ack et al. Applied Radiation and Isotopes 156 (2020) 108949
increasing the uncertainty it will be at negative infinity whereafter it Basically, determining if something is present in a sample is nothing
will stay negative. The consequence is that the MDA can not be defined, else than hypothesis testing, i.e. determine at a pre-defined probability
since negative MDA is non-physical. Such large uncertainties in the level if two distributions are different or not. Actually, based on a hy
conversion factor include situations like in situ gamma spectrometric pothesis test one calculates which instrumental signal that is needed in
measurements, and for samples with large unknown inhomogenities order to decide at a pre-set significance level if a radionuclide under
(Glavi�c-Cindro et al., 2017). (An in situ gamma spectrometric measure study is present in the sample, e.g. which signal level results in a
ment for an unknown radionuclide distribution in and/or on the ground significantly different activity distribution compared to the distribution
might be seen as equivalent to a large unknown inhomogeneity.) of the background. The decision threshold is defined as the (1-α)
Another situation is attenuation in samples with an unknown composi percentile of the PDF when no analyte is present, i.e. the risk of detecting
tion, and especially when measuring radionuclides emitting low energy something not present is α. The MDA is then computed from the mean of
gamma photons like 210Pb with gamma spectrometry, although there the activity distribution having its β percentile equal to the decision
are ways to correct for this attenuation (Cutshall et al., 1983). Finally, threshold, e.g. the risk of not detecting something present, while there is,
this would also be the situation for waste measurements where large is β.
drums are to be measured and the uncertainty in the detection efficiency The decision threshold according to ISO 11929:2010 can be calcu
might be large due to a combination of radionuclide and material dis lated explicitly, whereas the MDA would need an iterative approach
tributions as well as sample matrix composition. (ISO 11929:2010, 2010), but explicit equations for calculating MDA has
In this work a Monte Carlo Method (MCM) for calculating charac been derived (de Felice et al., 2017; Glavi�c-Cindro et al., 2017), which
teristic limits is presented. The method can handle any predefined will work in most applications. However, there might be situations when
probability distribution of the conversion factor (or of any quantity the uncertainty in the conversion factor will exceed the limit for which
included in the conversion factor). In particular, the characteristic limits the MDA cannot be calculated with the uncertainty propagation method.
as a function of the uncertainty in the correction factor for efficiency In this work, the characteristic limits as calculated with the MCM were
transfer (kET) in gamma ray spectrometry (Vidmar et al., 2010) was compared to limits calculated using such explicit expressions.
studied. The modelled distributions of kET included rectangular distri The model used in this work can be seen as a single channel analyzer
bution, triangular distribution, normal distribution, truncated normal (or as in the gamma spectrometric case a dual channel analyzer), where
distribution and log normal distribution. one region of interest is set in an energy region where a peak is expected,
and another region of interest is set just above the peak in order to
2. Theory determine N’BG used for calculating the Nnet needed to just match the
pre-set criteria of the MDA. Using this approach it is assumed that the
2.1. Model for the MCM background is flat enough in the studied energy interval. If this would
not be the case, another background can be set below the peak (in en
The model equations used in the MCM for calculating the decision ergy) and the average of the limits can be calculated. In this work it was
threshold and MDA were assumed that the background is uncorrelated to analytical peaks in the
spectrum (Berlizov, 2007). The equation used for the explicit calcula
ðNnet þ NBG Þ N ’BG
A¼ (1) tions (de Felice et al., 2017):
tmeas ⋅ε0 ⋅Iγ
- Decision threshold:
Ncal
ε¼ (2) qffiffiffiffiffiffiffiffiffiffi
tcal ⋅Acal ⋅Iγ
Lc ¼ kw 2N ’BG (4)
(3)
0
ε ¼ ε⋅kET
where w is the conversion factor for calculating the decision threshold in
activity units (here w ¼ 1/(tmeas⋅ε⋅Iγ⋅kET)), k ¼ k1-α is the quantile for the
where A is the decision threshold or MDA expressed in activity units,
specified error of the first kind (k1-α ¼ 1.645 if α ¼ 5%), and N’BG the
Nnet is the net number of counts in a measurement, NBG and N’BG the
number of counts in a region of interest for estimation of the
number of counts in the background at two locations close in energy
background.
(paired observation) during the measurement, tmeas the measurement
time, ε0 the measurement efficiency for the geometry used and Iγ the
- MDA:
photon emission probability. In this work N’BG can be seen as the
pffiffiffiffiffiffiffiffiffiffi
background in the Compton continuum in a gamma spectrometric k2 þ 2k 2NBG
measurement for a region, having the same width as the region of in MDA ¼ w (5)
1 k21 β u2rel ðwÞ
terest at the peak location with NBG as the number of background counts
in the Compton continuum. Here it was assumed that the measurement where k1-β is the quantile for the pre-set risk of not detecting anything
time of the background count was the same as for the sample mea present in a sample (e.g. k1-β ¼ 1.645 if β ¼ 5%) and urel(w) is the relative
surement, which would be the case in gamma spectrometry if the uncertainty of the conversion factor. Here k ¼ k1-α ¼ k1-β has been
different regions of interests have the same width. Observe that for a assumed. In this work, the same measurement set-up as presented earlier
single point calibration the uncertainty of the photon emission proba was used (Rameba €ck and Lindgren, 2018). The only difference is in Eq.
bility will cancel out. In the efficiency calibration (single point cali (1), where the influence of a background has been included.
bration with the same radionuclide as in the measurement) the number
of counts was Ncal during the time tcal using an activity standard with an
activity Acal. Eq. (3) gives the corrected efficiency due to efficiency 2.2. MCM
transfer applying the correction factor kET. This correction can be
needed due to differences in geometries between the calibration and the Here, in order not to overload the notation, random quantities and
measurement, and/or differences in attenuation if the matrices are corresponding samples are used interchangeably. All quantities were
significantly different. It should be stated that although gamma ray considered random quantities, except the measurement times tm and tcal
spectrometry was used in this work as an example, Eqs. (1)–(3) can be which were considered as constants. Each input quantity were sampled
applied to any radioanalytical method after replacing some of the input according to its known, or assumed, PDF. Moreover, an activity sample
quantities with the specific ones for any other particular method. percentile was estimated by the empirical percentile of the MC sample.
The MCM was similar to the one used by Rameba €ck and Lindgren
2
H. Rameb€
ack et al. Applied Radiation and Isotopes 156 (2020) 108949
Fig. 1. The PDFs of the measurand when no analyte is present and when the Fig. 2. The PDFs when no analyte is present and with the analyte present at a
analyte is present at a level equal to the MDA for a low uncertainty (1%, k ¼ 2) level of the MDA for a rectangular distribution having a half-width of 95%
in the conversion factor. The vertical lines represents here the 95% percentile for kET.
for the PDF of the decision threshold, and the 5% percentile for the MDA.
(30.15 � 0.86) Bq, k ¼ 1. Discarding the 0.001 and 0.999 percentiles
(2018) (Rameba €ck and Lindgren, 2018) utilizing Microsoft Excel 2013 resulted in discarding the 100 lowest and 100 largest values in the
(Microsoft Corporation, WA, USA). For each input quantity, 100 000 calculation if 100000 samples were used.
samples were generated according to assumed predefined PDF (rectan The calculation of the decision threshold is straight forward: it is
gular PDF, triangular PDF, Gaussian PDF, truncated Gaussian PDF and simply the chosen percentile representing the risk of false positives. In
lognormal PDF). One difference compared to the earlier work by this work α ¼ 5% was chosen, i.e. the decision threshold is then the 95%
Rameb€ack and Lindgren (2018) was that the number of counts was percentile of the PDF for the measurand when no analyte is present.
modelled using a Poisson distribution. Inverse transform sampling was Then the net number of counts for the MDA was iterated in order for the
used throughout, where a uniform probability sample is generated, and 5% percentile of the PDF of the MDA to match the 95% percentile for the
then the inverse cumulative distribution function is applied. However, decision threshold. When a truncated Gaussian was chosen for model
inverse transform sampling from a Poisson distribution in Excel is not ling of kET, the mean value for the original untruncated distribution was
possible since its inverse cumulative distribution function is not imple changed in order to get a mean value for the truncated distribution equal
mented. This was solved by sampling from the binomial distribution for to one. For the lognormal distribution, the mean value of kET was also
a low probability p and large number of trials n, since the binomial always equal to one. The criteria in the iteration of the MDA was that the
distribution then will reduce to the Poisson distribution (Larson and percentiles should match within about 1%.
Marx, 1990). The probability sample was generated using Excel’s
pseudo-random number generator from the function RAND(). When a 3. Results and discussion
truncated Gaussian was used for kET, the probability sample was trun
cated at the lower end in order to restrict kET to positive values only. The First, the MCM was tested relative Eqs. (4) and (5). The result is
rationale for this is that the efficiency ε0 should only be positive. In this shown in Fig. 1. The decision threshold and MDA agreed within 0.5%
work, kET was restricted to be 0.01 as its lowest value for the truncated between the MCM and Eqs. (4) and (5) when the uncertainty in kET was
case. Of course, this restriction is arbitrary and could have any value, low (1%). At low uncertainties in kET the explicit equations should be
and is to be chosen by the analyst based on previous experiences and/or expected to work well. Moreover, since the number of counts for the
scientific judgement. The triangular distribution was always modelled as background was high, and the uncertainties of all input quantities in the
being equilateral. Sampling from different PDF has been described conversion factor had a low uncertainty, one would expect the PDF for
earlier (JCGM 101, 2008). the decision threshold and the MDA to be Gaussian, which is actually the
From 100 000 runs the decision threshold was estimated using the case here.
PERCENTILE function in Excel. Here, the 95% percentile of the PDF for For a non-Gaussian and wide PDF of the conversion factor, a non-
the measurand when no analyte is present and corrected for background Gaussian PDF of the measurand when no analyte is present and when
was defined as the decision threshold. The MDA was estimated as the present at the level of the MDA will be obtained as can be seen in Fig. 2.
mean value for the PDF having a 5% percentile equal to the 95% This is due to the fact that the model is non-linear and to the impact of a
percentile of the decision threshold. In order to achieve more stable non-Gaussian input quantity. The same was observed earlier regarding
mean values from the calculation of the MDA when the uncertainty of the uncertainty for non-linear models with large uncertainties
kET was large (>40%) and its PDF was modelled as a non-truncated (Rameba €ck and Lindgren, 2018).
Gaussian, a trimmed mean was used (Leonowicz et al., 2005). The
trimmed mean was achieved by simply discarding the outermost per
centiles of the MDA distribution, typically the 0.001 and 0.999 per 3.1. Decision threshold
centiles. This resulted in dramatically more stable mean values. For a
relative standard uncertainty of kET of 60% the mean value of the MDA In ISO 11929:2010 the calculation of the critical limits are based on
was (34 � 23) Bq, k ¼ 1, if all 100000 samples were used (standard de propagation of uncertainties. One consequence of this is that the un
viation based on 10 replicates with 100000 samples in each calculation). certainty of the conversion factor w will not have any influence on the
If the 0.001 and 0.999 percentiles of the MDA are discarded, the MDA¼ decision threshold since the term comprising the relative uncertainty in
the conversion factor will be zero for a zero net signal (NBG-N’BG ¼ 0,
3
H. Rameb€
ack et al. Applied Radiation and Isotopes 156 (2020) 108949
Fig. 3. PDFs of the net signal for two blanks, Eq. (1) when Nnet ¼ 0, having
Fig. 5. The PDF of the MDA in one simulation for a standard uncertainty of the
either an uncertainty or no uncertainty in the conversion factor. No uncertainty
conversion factor of 62%. Here, the 5% percentile was at about A ¼ -30 Bq.
in kET represents the case using propagation of uncertainties.
Increasing the net number of counts will not help, but rather decrease the
5% percentile.
4
H. Rameb€
ack et al. Applied Radiation and Isotopes 156 (2020) 108949
Acknowledgement
Fig. 6. MDA calculated using uncertainty propagation and with the MCM
assuming different PDF of the conversion factor. The MDA for the triangular This work was funded by the Swedish Ministry of Defence, project
PDF of kET is hidden among the curves for the Gaussian, rectangular and no. A404619.
truncated Gaussian cases. Small fluctuations in some of the plotted series is due
to a relatively small inherent variability in the MCM, in particular for large Appendix A. Supplementary data
uncertainties in the conversion factor. This does not influence the gen
eral results.
Supplementary data to this article can be found online at https://doi.
org/10.1016/j.apradiso.2019.108949.
propagation gives good results up to about a relative uncertainty in the
conversion factor of 35–40%. Moreover, by restricting the correction References
factor kET to being only positive, it is possible to calculate MDA even
above 61% relative uncertainty in the conversion factor. This restriction Berlizov, A.N., 2007. Limits of detection in the presence of the correlated background.
would be justified by the fact that otherwise it would give negative J. Radioanl. Nucl. Chem. 271, 363.
Currie, L.A., 1968. Limits for qualitative detection and quantitative determination.
efficiencies. Application to radiochemistry. Anal. Chem. 40, 586.
In this work different shapes for the PDF of kET were used, involving Cutshall, N.H., Larsen, I.L., Olsen, C.R., 1983. Direct analysis of 210Pb in sediment
Gaussian, rectangular, triangular, truncated Gaussian, and lognormal samples: self-absorption corrections. Nucl. Instrum. Methods Phys. Res. 206, 309.
de Felice, P., Jerome, S., Petrucci, A., 2017. Practical implementation of ISO 11929:
shapes. These are examples exploring consequences of assumptions 2010. Appl. Radiat. Isot. 126, 256.
regarding the PDF of kET when e.g. limited knowledge is present of the Glavi�c-Cindro, D., Korun, M., Vodenik, B., Zorko, B., 2017. Calculation of the detection
input quantity. Of course, other PDF would be interesting to explore, limits by explicit expressions. Appl. Radiat. Isot. 126, 267.
ISO 11929:2010, 2010. Determination of the Characteristic Limits (Decision Threshold,
which furthermore, restrict the conversion factor to only positive values. Detection Limit and Confidence Interval) for Measurements of Ionizing Radiation-
Moreover, the choice of PDF for kET should be based on previous Fundamentals and Application. the International Organization for Standardization,
knowledge if that exist. If such knowledge does not exists, it has to be Geneva, Switzerland.
ISO 11929-1, 2019. 2019. Determination of the Characteristic Limits (Decision
assumed based on e.g. scientific judgement and that assumption involves
Threshold, Detection Limit and Coverage Interval) for Measurements of Ionizing
the assumption of the PDF. This is the normal way according to GUM for Radiation- Fundamentals and Application- Part 1: Elementary Applications. The
Type B evaluations using uncertainty propagation as well. International Organization for Standardization, Geneva, Switzerland.
ISO 11929-2, 2019. 2019. Determination of the Characteristic Limits (Decision
For e.g. spectroscopic measurements, more information about the
Threshold, Detection Limit and Coverage Interval) for Measurements of Ionizing
background can be obtained by setting a wider region of interest (which Radiation- Fundamentals and Application- Part 2: Advanced Applications. The
would be equivalent to the case when the background is measured International Organization for Standardization, Geneva, Switzerland.
longer than the sample). However, here it has been assumed that the ISO 11929-3, 2019. 2019. Determination of the Characteristic Limits (Decision
Threshold, Detection Limit and Coverage Interval) for Measurements of Ionizing
width of the two regions are equal. It has also been assumed that the Radiation- Fundamentals and Application- Part 3: Applications to Unfolding
calculation is done for the case when no analyte is present in the sample. Methods. The International Organization for Standardization, Geneva, Switzerland.
If the analyte is present in the sample, the calculation of the decision JCGM 100, 2008. 2008. GUM 1995 with Minor Corrections. Evaluation of Measurement
Data-Guide to the Expression of Uncertqinty in Measurement.
threshold and MDA still can be done with a small modification of the JCGM 101:2008, 2008. Evaluation of Measurement Data-Supplement 1 to the “Guide to
model equation, Eq. (1), (de Felice et al., 2017). the Expression of Uncertainty in Measurement”-Propagation of Distributions Using
At the very end of this study, there were new ISO standards issued Monte Carlo Methods.
Larson, R.J., Marx, M.L., 1990. Statistics. Prentice Hall, New Jersey.
relating to the calculation of characteristic limits in e.g. the measure Leonowicz, Z., Karvanen, J., Shishkin, S.L., 2005. Trimmed estimators for robust
ment of radionuclides (ISO 11929-1, 2019; ISO 11929-2, 2019; ISO averaging of event-related potentials. J. Neurosci. Methods 142, 17.
11929-3, 2019). In particular the ISO 11929–2 relates to the work pre Rameb€ ack, H., Lindgren, P., 2018. Uncertainty evaluation in gamma spectrometric
measurements: uncertainty propagation versus Monte Carlo simulation. Appl.
sented here. In the light of the newly issued ISO standards this work is a
Radiat. Isot. 142, 71.
direct application of the guidance given for calculating decision limit Sima, O., L�epy, M.-C., 2016. Application of GUM supplement 1 to uncertainty of Monte
and MDA in radiometric measurements when commonly used uncer Carlo computed efficiency in gamma-ray spectrometry. Appl. Radiat. Isot. 109, 493.
Vidmar, T., Vodenik, B., Ne�cemer, M., 2010. Efficiency transfer between extended
tainty propagation will be inappropriate.
sources. Appl. Radiat. Isot. 68, 2352.
Wilson, M.D., Rocke, D.M., Durbin, B., Kahn, H.D., 2004. Detection limits and goodness-
4. Conclusions of-fit measures for the two-component model of chemical analytical error. Anal.
Chim. Acta 509, 197.