You are on page 1of 21

Downloaded from journal.pda.

org on January 19, 2016

Charting and Evaluation of Environmental Microbial


Monitoring Data
Raphael Bar

PDA J Pharm Sci and Tech 2015, 69 743-761


Access the most recent version at doi:10.5731/pdajpst.2015.01079
Downloaded from journal.pda.org on January 19, 2016

TECHNOLOGY/APPLICATION

Charting and Evaluation of Environmental Microbial


Monitoring Data
RAPHAEL BAR

BR Consulting, Rehovot, Israel 76247; email: rbar@netvision.net.il ©PDA, Inc. 2015

ABSTRACT: Statistical tools are required to organize and present microbial environmental monitoring data for the purpose
of evaluating it against regulatory action limits and of determining if the microbial monitoring process is in a state of
control. This paper applies a known methodology of a simple and straightforward construction of control XmR (X data
and moving range) charts of individual microbial counts as they are or of contamination rates derived from them,
irrespective of the type of the parent data distribution and without the need to transform the data into a normal distribution.
Plotting of monthly and cumulative sample contamination rates, as newly suggested by USP ⬍1116⬎, is also shown. Both
types of the control charts and plots allow an evaluation of the behavior of the microbial monitoring process. After
addressing the magnitude of microbial counts expected in environmental monitoring samples, this paper presents the
rationale behind the use of XmR charts. Employing data taken from environmental monitoring programs of pharmaceu-
ticals manufacturing facilities, this paper analyzes examples of (1) microbial counts from passive or active air sampling in
area Grade D or B or Class 100,000 in XmR charts, (2) contamination recovery rates as suggested by USP ⬍1116⬎ from
active air samples in area Grade B and contact plates in area Grade C, and (3) instantaneous contamination rates with
calculations illustrated on microbial counts of contact plates in area Grade D.

KEYWORDS: Statistical process control (SPC), Control charts of individual values, Control limits, Poisson distribution,
Normal distribution, Controlled rooms, Contamination recovery rates, Instantaneous contamination rates, USP ⬍1116⬎.

LAY ABSTRACT: Pharmaceutical companies conduct environmental monitoring programs, and samples of air (active and
passive sampling) and of surfaces (contact plates) are routinely tested for microbiological quality. Thus, hundreds of
microbial counts of tested environmental monitoring samples are routinely generated and recorded. Statistical tools are
required to organize and present this abundant data for the purpose of evaluating it against regulatory action limits and
determining if the microbial monitoring process is a state of control. This paper has a two-fold purpose. The first purpose
is to provide microbiologists and quality assurance personnel simple and straightforward tools of statistical process control
for evaluating the behavior of the microbial monitoring process: individual XmR (X data and moving range) control charts
of microbial counts as they are or of rates derived from them are constructed irrespective of the type of the parent data
distribution and without the need to transform the data into a normal distribution. Plotting of monthly and cumulative
sample contamination rates, as newly suggested by USP ⬍1116⬎, is also shown. The second purpose is to present
examples of the charting of (1) microbial counts, (2) contamination recovery rates as suggested by USP ⬍1116⬎, and (3)
instantaneous contamination rates using data taken from environmental monitoring programs of pharmaceuticals manu-
facturing facilities.

Introduction performance is stable and under a control state. Such a


review can detect a trend or a shift in EM performance
Regulatory agencies expect pharmaceutical companies, that could be related to factors such as the effectiveness
and particularly those that manufacture sterile drug prod- of the agents and/or cleaning and sanitization procedures
ucts, to review and analyze the microbial environmental employed in the manufacturing facilities. Regulatory
monitoring (EM) data for determining whether the EM guides (1–3) impose action limits on the classified areas,
and companies often apply additional alert limits. Re-
cently, the USP 38 (4) suggested in a newly revised
chapter ⬍1116⬎ a new metric called contamination
doi: 10.5731/pdajpst.2015.01079
recovery rate, which is defined as the rate at which

Vol. 69, No. 6, November–December 2015 743


Downloaded from journal.pda.org on January 19, 2016

environmental samples are found to contain any level of the methodology explained and advocated by Wheeler
contamination. For example, an incident rate of 1% in his numerous writings (10 –17).
would mean that only 1% of the samples taken have any
contamination regardless of colony number. This con- After addressing the magnitude of microbial counts
cept of contamination recovery rate represents a new expected in EM samples and the construction of an
paradigm introduced by USP and is definitely different XmR (X data and moving range) chart, this paper will
from the current approach based on current action limits present the rationale behind the use of XmR charts and
spanning the range of 1–200 cfu set by U.S. Food and give examples of the charting of
Drug Administration (FDA) guidance (3) and the Euro-
pean Union (EU) GMP Annex 1 (1) for the classified 1. microbial counts
environments. Irrespective of whether the EM data are
evaluated against action limits as required by regula- 2. contamination recovery rates as suggested by USP
tory agencies or against a limit for the contamina- ⬍1116⬎
tion recovery rate as suggested by USP, it is re-
quired to demonstrate that the classified area is 3. instantaneous contamination rates
maintained under an adequate microbial control.
using data taken from EM programs of pharmaceuti-
cals production facilities.
Common statistical approaches for analyzing micro-
bial counts revolve around applying Poisson law, as
Common Bioburden Levels of EM Samples
USP ⬍1223⬎ encourages us to do (5, 6), or around
fitting the data to other distributions (7). Conven-
Regulatory documents of the EU and FDA impose
tional statistical thinking would dictate that col-
maximal limits of microbial contamination varying
lected microbial counts first be statistically evalu-
between 1 and 200 cfu in an EM sample. These
ated for a fit (goodness-of-fit test) to a given
limits, which are in fact taken to be action limits,
distribution—such as Poisson or normal distribu- are 1, 5, 10, 25, 50, 100, and 200 cfu in an EM
tions, in the case of low and large counts, respec- sample in the European GMP Annex 1 (1), while
tively—and then be plotted onto control charts based those of the FDA guide (3) are 1, 3, 5, 7, 10, 50, and
on either Poisson or normal distributions. When the 100 cfu in an EM sample. If we evaluate these
number of zero counts is higher than that expected maximal levels of microbial counts with a Poisson
from Poisson distribution, fitting to either Poisson or distribution, as advocated by USP ⬍1223⬎ (5), then
normal distributions usually fails, and then one can try one can estimate with the following equation
to fit the data set to the two-parameter negative bino-
Control Limits ⫽ ␮ ⫹ 3 冑␮
mial distribution (9). This procedure requires ad-
(1)
vanced statistical analysis, and Hoffman (9) and Jarvis
(10) present examples on how to do so. But more the true average counts (␮) expected in the EM samples
often, efforts are made into transforming counts (e.g., having the above cited regulatory action levels. Table I
log or square transformations, etc.) to fit a normal lists the estimated average counts that lead to the
distribution prior to generating control charts. When upper control limits that are almost identical to the
the number of zero counts becomes excessively high, formal regulatory limits. So, the actual counts in
that is, a microbial contamination becomes a rare common EM samples are expected to vary between
event, data such as number of noncontamination op- the lower and upper control limits around the true
portunities between two successive contamination averages spanning the range of 0.6 –160 cfu per EM
events or time between contamination events are often sample.
fitted to either a geometric or Weibull distribution and
then plotted on a g-chart or t-chart, respectively. XmR Charts of Microbial Counts

In contrast, this paper draws control charts from mi- Microbial colonies counted on plates for surfaces
crobial counts as they are or rates derived from them, (contact plates) and for passive (settling plates) or
irrespective of the type of the parent data distribution active (1m 3 ) air sampling are taken to be individual
and without the need to transform the data into a values per site monitored and are evaluated with a
normal distribution. By doing so, this paper follows chart of individual data (XmR), in contrast to the

744 PDA Journal of Pharmaceutical Science and Technology


Downloaded from journal.pda.org on January 19, 2016

TABLE I
Expected Average Microbial Counts in EM Samples Having the Regulatory Maximal Poisson Three-Sigma
Limits, Practically Identical with the Regulatory Limits

Formal Action Expected Count Lower Control Upper Control


Limit Average (␮) Limit Limit
1 0.1 0.0 1.05
3 0.6 0.0 2.9
5 1.0 0.0 4.0
7 2.4 0.0 7.0
10 4.0 0.0 10.0
25 13.0 2.2 23.8
50 30.0 13.6 46.4
100 70.0 44.9 95.1
200 160.0 122.1 197.9

common average and range chart. On the XmR a. The 3 sigma limits of the control charts are viewed
chart, counts or contamination rates are plotted on as empiric limits that include a high percentage of
the X chart with control limits calculated from the data (10, 12).
short-term variation estimated from the difference
between one data point and the subsequent point b. Data distribution needs not be normal (12). The
(moving range of two, mR) (18). Thus, the average above three sigma limits are applicable to all data
or the median of all consecutive ranges are used to distributions. Wheeler has calculated that the three-
calculate the 3 sigma limits of both the X chart and sigma limits of various differently shaped distribu-
the mR chart with the following equations: tions (e.g., normal, exponential, chi-square, etc.)
will result in more than 97.5% of the data included
If the variation is based on the average moving range within these limits (12) when a process is operated
(10, 11): predictably. Often, one attempts to fit a normal
distribution to data in order to have 99.73% of the
Limits of X ⫽ X៮ ⫾ 2.6596 data included between three-sigma limits, entailing
only a minute proportion of out-of-control (OOC)
⫻ Average Moving Range (2)
data of 0.27%. However, in real processes, the
proportion of OOC data is often higher. For in-
Upper Limit of mR ⫽ 3.268
stance, the percent of OOC data in the examples
⫻ Average Moving Range (3) evaluated in this paper is 4.3%, 2.0%, 11.5%, and
9.3% of the data recorded. Thus, if one adopts 2.5%
If the variation is based on the median moving range as an empirical upper limit of percent OOC data
(10, 11): points, then the fit to a normal distribution is not a
requirement.
Limits of X ⫽ X៮ ⫾ 3.145
c. Data need not be transformed to fit a normal dis-
⫻ Median Moving Range (4)
tribution (12). Nonlinear transformations can even
distort the data, hide the signals, and change the
Upper Limit of mR ⫽ 3.865
results of the analysis (12).
⫻ Median Moving Range (5)
d. Basing the control limits on a certain data distribution
Rationale for Using XmR Process Behavior Charts is valid provided it is shown to remain constant
throughout the monitoring of the process (13, 16, 20).
The approach, originally based on Shewhart and For instance, c-charts or g-charts are viable if the
widely interpreted by Wheeler (10, 13) is based on the underlying distribution parameters remain constant
following main elements: throughout. However, this is often an unrealistic as-

Vol. 69, No. 6, November–December 2015 745


Downloaded from journal.pda.org on January 19, 2016

Figure 1

Poisson chart (upper) and XmR chart (lower) of computer randomly generated 10000 data following Poisson
distribution with ␮ ⴝ 4 counts. Only the last 100 data points are shown for the sake of the plot clarity.

sumption (20). Similarly, the assumption that the av- of the distribution such as the true value and its
erage contamination (Poisson distribution) in a site confidence intervals. However, if the purpose is to be
within a clean room is constant when sampled daily able to monitor the behavior of a process, that is, to be
or weekly or monthly is most unlikely. This very able to state that the process behaves predictably or
reason is a good justification per se for not basing not, and to be able to point out an OOC situation that
control limits of a control chart on the assumed dis- may take place at a frequency less than 2.5%, then the
tribution. Instead, the XmR chart captures the process empirical process XmR chart is a credible and suitable
variation from the data as is and derives the empiric way to do it.
control limits (14).
In order to demonstrate the applicability of the XmR
Thus, one can use microbial counts as they are with charts to microbial counts that follow a Poisson dis-
three sigma limits for generating control charts in tribution with average counts of 4 cfu or 70, as sug-
order to evaluate the behavior of the EM process. gested by Table I, tens of thousands of data points
were randomly computer generated with a Minitab 17
While controversies over the relationship between and plotted on control charts based on Poisson distri-
control charting and hypothesis testing have been re- butions and as XmR charts. However, for the sake of
ported and discussed (19), it is critically important to clarity, Figures 1 and 2 were recorded with only the
make a clear distinction between inference statistics last 100 data points (9901–10,000) and these figures,
and statistical process control (SPC) (15). Selecting a just like the complete figures, show that Poisson and
proper distribution and goodness-of-fit tests are cer- XmR charts reveal visibly similar control limits as
tainly needed if the purpose is to estimate parameters well as highly similar fractions of OOC data points

746 PDA Journal of Pharmaceutical Science and Technology


Downloaded from journal.pda.org on January 19, 2016

Figure 2

Poisson chart (upper) and XmR chart (lower) of computer randomly generated 10000 data following Poisson
distribution with ␮ ⴝ 70 counts. Only the last 100 data points are shown for the sake of the plot clarity.

exceeding the three sigma limits. The exact percent- 70, and 160 cfu) that are expected to represent com-
ages of these OOC data points were counted from mon bioburden levels in EM samples. Table II lists the
additional control charts plotted with the Minitab 17 results, which happen to be essentially identical for
for other levels of microbial counts (␮ ⫽ 1, 4, 13, 30, both Poisson and XmR charts.

TABLE II
Calculated Percentages of Out-of-Control (OOC) Data Points Exceeding the Upper (UCL) and Lower
(LCL) Three-sigma Control Limits in Poisson and XmR Charts of Computer-Generated Random 10000
Data from a Poisson Distribution with Various ␮ Values

% OOC Data
Poisson XmR
Formal Action Expected Average Below Above Below Above
Limit Count (␮) LCL UCL Total LCL UCL Total
5 1 0 170 1.7 0 170 1.7
10 4 0 62 0.62 0 62 0.62
25 13 3 42 0.45 3 42 0.45
50 30 5 23 0.28 5 23 0.28
100 70 5 21 0.26 5 21 0.26
200 160 9 19 0.28 14 19 0.33

Vol. 69, No. 6, November–December 2015 747


Downloaded from journal.pda.org on January 19, 2016

Figure 3

Poisson chart (upper) and XmR chart (lower) of computer randomly generated 30 data following Poisson
distribution with ␮ ⴝ 13 counts.

In practice, control charts are initially plotted on a Examples of XmR Control Charts of EM
number of data points, typically 20 –30, and one can Microbial Counts
compare the behavior of Poisson and XmR charts
drawn from the same data points. Figure 3 is such an Example 1: Microbial Counts in Settling Plates for
example of 30 data points randomly selected from a Passive Air Sampling in Class 100,000
Poisson population with ␮ ⫽ 13. Obviously, the
control limits will differ somewhat as they are cal- Figure 5 shows microbial of settling plates in a
culated differently, but they are similar. The impor- 100,000 class room collected over a period of ten
tant point is that it may be concluded that the months. Each count is a sum of the individual counts
process behaves predictably either according to a obtained on both Sabouraud’s dextrose agar (SDA)
Poisson c-chart or to an XmR chart. Occasionally, a and triptic soy agar (TSA) petri dishes. None of the 23
borderline data point may appear located close to data points follow either Poisson or normal distribu-
a control limit in one type of chart and outside the tions as shown by goodness-of-fit test results of P ⫽
control limit in another type of chart. Such a case is 0.00 made with a Minitab 17. Hence, while drawing a
shown in Figure 4, which plots Poisson data with c-chart is not justified in this case, one can attempt to
␮ ⫽ 4: count data point 10 is slightly lower than the apply data transformation and indeed, the data were
upper control limit of the c-chart but slightly above transformed first with log (count ⫹ 1) and plotted in
that of the XmR chart. Such an occasional OOC Figure 6 along with a log transformed value of 1.71 as
point is not frequent and if it occurs, and it can only the action limit. Data point 21 is shown to be OOC.
prompt an investigation, but the overall behavior of The same result is also observed in Figure 5, in which
the process conveyed by both types of charts re- the original counts are plotted on an XmR chart. This
mains essentially the same. figure shows an extreme count of 232 cfu, which is

748 PDA Journal of Pharmaceutical Science and Technology


Downloaded from journal.pda.org on January 19, 2016

Figure 4

Poisson chart (upper) and XmR chart (lower) of computer randomly generated 30 data following Poisson
distribution with ␮ ⴝ 4 counts.

well above the formal action limit of 50 cfu. The XmR Grade D environment. Each count is a sum of the
chart can be further adjusted to the data values by individual counts obtained on both SDA and TSA
omitting data point 21 for calculation of the three petri dishes. Unlike the previous example, the
sigma limits (Figure 7). No counts exceed the upper counts here are in general lower and include more
control limit of 27.3 (⬃ 27 cfu) and the control chart zero counts. About 25% of the data are zero and this
shows that the process behaves predictably until usually makes a fit to either a Poisson or normal
observation 20, following which, the two subse- distribution less likely. Indeed, none of the 49
quent microbial counts are OOC and call for an counts follow either Poisson or normal distributions
investigation. Indeed, the high mR values at the as shown by goodness-of-fit test results of P ⫽ 0.00
subsequent observations 21 and 22 are OOC data, made with a Minitab 17. Furthermore, conversion of
and this supports the OOC situation detected in the the data with log (count ⫹ 1) or square root
X chart. Since Figures 7–10 are XmR charts, which (count ⫹ 0.5) transformations did not normalize the
record counts as they are, a line of a regulatory data, as evidenced by the resulting P-values, which
action limit was added for conveniently signaling a are lower than 0.05. Once again, one can directly
deviation from this limit. plot the original counts onto an XmR chart and
obtain a plot that depicts realistically the behavior
Example 2: Microbial Counts in Settling Plates for of the microbial monitoring process in this Grade D
Passive Air Sampling in Grade D environment. Indeed, Figure 8 shows a well-be-
haved microbial monitoring process of the specific
Figure 8 shows microbial counts on settling plates site monitored, which does not exceed an upper
collected almost weekly for a 1 year period in a limit of 9.92 cfu (⬃10 cfu) except for a single OOC

Vol. 69, No. 6, November–December 2015 749


Downloaded from journal.pda.org on January 19, 2016

Figure 5

XmR chart of microbial counts of passive air samples recorded in Class 100,000 environment.

data point at 17. One can recalculate the control Example 3: Microbial Counts in Settling Plates for
limits disregarding this OOC point and obtain a Active Air Sampling in Grade D
slightly narrower upper limit of 8.92 cfu (⬃9 cfu).
In either case, the counts are well below the regu- Figure 9 shows microbial counts on TSA plates
latory action limit of 100 cfu. collected almost weekly with a microbiological air

Figure 6

XmR chart of log transformed microbial counts of passive air samples recorded in Class 100,000 environment.

750 PDA Journal of Pharmaceutical Science and Technology


Downloaded from journal.pda.org on January 19, 2016

Figure 7

XmR chart of microbial counts of passive air samples recorded in Class 100,000 environment after omitting the
extreme count of 232 cfu.

sampler during a 1 year period in a Grade D envi- counts follow either Poisson or normal distributions
ronment. About 23% of the data are zero and again, as shown by goodness-of-fit test results of P ⫽ 0.00
this usually makes a fit to either a Poisson or normal made with a Minitab 17. Furthermore, conversion of
distribution less likely. Indeed, none of the 52 the data with log (count ⫹ 1) or square root

Figure 8

XmR chart of microbial counts of passive air samples recorded during one year in area Grade D.

Vol. 69, No. 6, November–December 2015 751


Downloaded from journal.pda.org on January 19, 2016

Figure 9

XmR chart of microbial counts of active air samples recorded during one year in area Grade D.

(count ⫹ 0.5) transformations did not normalize the number of noncontaminated samples (count ⫽ 0) is
data as evidenced again by the resulting P-values, so large that the average count may now get closer
which are lower than 0.05. So, Figure 9 is an XmR to 1 cfu or can become ⬍1 cfu. In the latter case,
chart with the control limits calculated from a me- whenever the average count is ⬍1, the XmR chart
dian range (eqs 4 and 5) in order to minimize the becomes inefficient for interpreting a control chart
impact of the extreme counts rather than with the (16). An attempt to re-draw the XmR chart with all
usual averages range (eqs 2 and 3). One can also the OOC data points (data points 3, 25, 26, 38, and
decide to draw the control limits with all high 45) omitted in the calculation of the control limits
counts disregarded. makes the average count ⬍1 (average count ⫽ 0.65
cfu). Under these conditions, one can switch to a
Example 4: Microbial Counts in Settling Plates for different approach that is based on evaluation of
Active Air Sampling in Grade B contamination as a rare event.

Figure 10 shows microbial counts on TSA plates Evaluation of Contamination Rates of EM Samples
collected almost weekly with a microbiological air for Cases of Rare Contaminations
sampler during a 1 year period in a Grade B envi-
ronment. About 68.5% of the data are zero and When the majority of the EM samples show no mi-
again, this usually makes a fit to either a Poisson or crobial growth, as is the practical and regulatory ex-
normal distribution much less likely. As in the pectation from environments of Class 100, Grades A
previous example, none of the 54 counts follow and B, then the occurrence of a single contaminated
either Poisson or normal distributions of original or plate becomes a special event, a rare event. Other
transformed counts, as shown by goodness-of-fit examples of rare events include hospital-acquired in-
test results of P ⫽ 0.00 made with a Minitab 17. The fections, medication errors, or rare deviations in man-

752 PDA Journal of Pharmaceutical Science and Technology


Downloaded from journal.pda.org on January 19, 2016

Figure 10

XmR chart of microbial counts of active air samples recorded during one year in area Grade B.

ufacturing processes. In EM, a contaminated sample is a. The Number of Noncontamination Opportunities


viewed as a rare event, irrespective of whether its between Contamination Events
shows, for example, 1, 5, or 15 cfu. Thus, instead of
monitoring the very few contamination events, one This number is used to generate a g-chart (based on
can track the values that follow. geometric distribution) or the time elapsed between

TABLE III
Percent Monthly and Cumulative Percent Contamination Recovery Rate Calculated per USP <1116> on
Microbial Counts of Active Air Sampling in Classified Area Grade B

# of
Samples # of Cumulative
Tested Cumulative Contaminated Cumulative # of Monthly % %
per # of tested Samples per Contaminated Recovery Recovery
Month Month samples month Samples Rate Rate
Jan 5 5 4 4 80.0 80.0
Feb 4 9 1 5 25.0 55.6
Mar 2 11 0 5 0.0 45.5
Apr 5 16 2 7 40.0 43.8
May 4 20 3 10 75.0 50.0
Jun 5 25 2 12 40.0 48.0
Jul 5 30 1 13 20.0 43.3
Aug 4 34 0 13 0.0 38.2
Sep 4 38 1 14 25.0 36.8
Oct 5 43 2 16 40.0 37.2
Nov 6 49 1 17 16.7 34.7
Dec 5 54 0 17 0.0 31.5

Vol. 69, No. 6, November–December 2015 753


Downloaded from journal.pda.org on January 19, 2016

90.0
Monthly and Cumulave % Contaminaon Recovery Rates
80.0 80.0
80.0 Monthly
75.0
% Recovery Rate
70.0

% Contaminaon Recovery rate


Cumulave
% Recovery Rate
60.0 55.6
50.0
50.0 45.5
48.0
43.8 43.3
40.0 40.0 38.2 40.0
40.0 36.8 37.2
34.7
31.5
30.0 25.0 25.0
20.0
20.0 16.7

10.0
0.0 0.0 0.0
0.0
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
Figure 11

Monthly and cumulative contamination recovery rates (per USP <1116>) calculated from the microbial counts
of active air samples recorded during one year in area Grade B (see Table III).

contamination events to generate a t-chart (based on to be unrealistic, this possibility is not followed in this
either Weibull or exponential distributions) (17). paper.

These control charts for rare events are available in b. The Percent Microbial Contamination
commercial statistical software programs but prior to Recovery Rate
their use, the data need to demonstrate a goodness-of-
fit. In any case, as explained above, the use of these This metric, as previously mentioned, was recently
special control charts assumes a constant underlying suggested by USP ⬍1116⬎. The recommended max-
probability of the given distribution throughout the imal rate limits for the various International Organi-
long period of EM data collection. Since this is taken zation for Standardization (ISO) classified environ-

TABLE IV
Percent Monthly and Cumulative Excursions Rate of Microbial Counts of Active Air Sampling in Classified
Area Grade B
# of Samples
Tested per Cumulative # of # of Excursions Cumulative # Monthly % % Cumulative
Month Month Tested Samples per Month of Excursions Excursions Excursions Rate
Jan 5 5 1 1 20.0 20.0
Feb 4 9 0 1 0.0 11.1
Mar 2 11 0 1 0.0 9.1
Apr 5 16 0 1 0.0 6.3
May 4 20 0 1 0.0 5.0
Jun 5 25 1 2 20.0 8.0
Jul 5 30 1 3 20.0 10.0
Aug 4 34 0 3 0.0 8.8
Sep 4 38 1 4 25.0 10.5
Oct 5 43 0 4 0.0 9.3
Nov 6 49 1 5 16.7 10.2
Dec 5 54 0 5 0.0 9.3

754 PDA Journal of Pharmaceutical Science and Technology


Downloaded from journal.pda.org on January 19, 2016

Figure 12

Monthly and cumulative excursions (above Alert and Action limits) rates calculated from the microbial counts
of active air samples recorded during one year in area Grade B (see Table IV).

ments for production of sterile products are ⬍1%, tabulated or plotted as a function of time. But, the
⬍3%, ⬍5%, and ⬍10% for ISO 5, 6, 7, and 8, respec- monthly (or weekly) recovery rates determined with eq 6
tively. USP ⬍1116⬎ states that the actual monitoring can also be plotted on an XmR chart to evaluate the
data should be retabulated monthly. The monthly con- environmental process performance as expressed by ei-
tamination rate is given by: ther a decrease or an increase in the monthly contami-
nation rate, a trend upward or downward, or a stable
Monthly % Contamination Recovery Rate behavior within control limits. In Class 100 and Grade A
Number of contaminations within a given month
⫽ ⫻ 100% environments, the counts are expected to be mostly zero,
Number of samples tested within a given month
and many times all counts are zero. In the latter case, one
(6)
can only state that the percent contamination recovery
The cumulative contamination rate can be calculated rate is estimated with:
with:
% Contamination Recovery Rate
Cumulative % Contamination Recovery Rate
1
Number of all contaminations obtained till ⬍ ⫻ 100%
a given month Total number of zero samples ⫹ 1
⫽ ⫻ 100% (7)
Total number of samples tested (8)
till a given month

where the total number of samples includes those of While the USP ⬍1116⬎ limits of contamination recov-
the given month. ery rates appear to be suitable to ISO 5 and 6 or Grade A
and B environments, where contamination is expected to
The contamination recovery rate, expressed as a cumu- be rare, they appear to be rather very stringent for the
lative percentage of contaminated EM samples from all ISO 7 and 8 environments. The newly revised Parenteral
tested samples can be updated at least monthly and Drug Association (PDA) technical report states indeed

Vol. 69, No. 6, November–December 2015 755


Downloaded from journal.pda.org on January 19, 2016

80.0
Monthly and Cumulave % Contaminaon Recovery Rates
75.0
Monthly
70.0 % Recovery Rate
Cumulave

% Contaminaon Recovery rate


60.0 % Recovery Rate
50.0
50.0

40.0 36.4
33.3
31.3 30.0
30.0 25.0 25.0
20.0 20.7
20.0 18.2 17.1
15.4 14.0 12.5
10.0
0.0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
0.0
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
Figure 13

Column graph of monthly and cumulative contamination recovery rates (per USP <1116>) calculated from
contact plates recorded during one year in area Grade C.

that the recovery rates for ISO 7 and 8 environments may % Instantaneous Contamination Rate
not be obtainable. Indeed, a recovery rate limit of 10% (Number of contaminations per
for ISO class 8 (class 100000) implies that 90% of the
samples tested should show no growth despite the fact 100 time units)
that they are sampled from a nonsterile environment. In 1
any case, PDA Technical Report 13 makes the wise ⫽ ⫻ 100%
Number of time units between
suggestion that if one wishes to track the recommended two successive contaminations ⫹ 1
recovery rates, it should be done parallel to the presently
(10)
binding regulatory action limits (7).

If EM samples are not tested regularly with time, then


c. The Instantaneous Contamination Rates
the instantaneous rate is expressed as the percent of
contaminated samples from the number of all samples
The instantaneous rate may be determined as the num-
tested since the last contamination during the specified
ber of contaminations per a unit of time (e.g., day,
time period, using eq 11.
week, month) if EM samples are tested regularly with
time. The rate is instantaneous when calculated from
the number of unit times elapsed from the previous % Instantaneous Sample Contamination Rate
contamination to the present one (including the time (Number of contaminations
unit where the contamination occurred) (17) and is
per 100 samples)
expressed as the number of contaminations per unit of
time (eq 9) or as the number of contaminations per 100 1
⫽ ⫻ 100%
time units (eq 10). Number of samples between two
successive contaminations ⫹ 1
Instantaneous Contamination Rate (Number of (11)
contaminations per time unit)
It is worth noting that while eq 6 determines the
1 percent of contaminated samples obtained within a

Number of time units between two successive month from all samples tested during that month, eq
contaminations ⫹ 1 11 expresses the percent of contaminated samples per
(9) 100 samples from the previous contamination to the

756 PDA Journal of Pharmaceutical Science and Technology


Downloaded from journal.pda.org on January 19, 2016

Figure 14

Line graph of monthly and cumulative contamination recovery rates (per USP <1116>) calculated from
contact plates recorded during one year in area Grade C (same data as Figure 13).

present one. Plotting the instantaneous rates (from eqs tion recovery rates as suggested by USP ⬍1116⬎. The
9, 10, or 11) on XmR charts again allows one to depict high proportion of zero counts renders the data set
the monitoring process behavior, informing when the more suitable for a direct evaluation of the percent
performance improves (lower contamination rate), di- incident and cumulative sample rates of contamina-
minishes (higher contamination rate), trends upward tions. Accordingly, the counts of the Grade B area,
or downward, or behaves predictably. plotted in Figure 10, are regrouped per month and the
monthly percent and the cumulative sample rates of
Examples of Charting of EM Contamination Rates contaminations were calculated with eqs 6 and 7,
respectively. These are listed in Table III and plotted
Example 5: Microbial Contamination Recovery Rate in in Figure 11 for better visualization.
Settling Plates for Active Air Sampling in Grade B
In this specific case, the rates are quite high, in con-
The data set that was plotted on an XmR chart (Figure trast to the much lower USP limits of ⬍1% or ⬍5% if
10) is reanalyzed to evaluate the percent contamina- Grade B is equated to ISO 5 (at rest) or ISO 7 (in

TABLE V
Instantaneous Sample Contamination Rates in Classified Area Grade D*

# of Non- Instantaneous Sample Instantaneous % Sample


Date of Contaminated Contamination Rate Contamination Rate
Contamination Samples (contamination per sample) (contaminations per 100 samples)
02.01.13 — — —
18.04.13 12 0.077 7.7
22.04.13 0 1.000 100.0
06.05.13 1 0.500 50.0
21.05.13 1 0.500 50.0
11.06.13 3 0.250 25.0
02.07.13 3 0.250 25.0
28.07.13 3 0.250 25.0
24.12.13 22 0.043 4.3
* This data is used for illustrating similar calculations for classified environments of Class 100, ISO 5, and Grade A.

Vol. 69, No. 6, November–December 2015 757


Downloaded from journal.pda.org on January 19, 2016

Figure 15

Percent instantaneous sample contamination rates (number of contaminated samples per 100 samples tested)
calculated from contact plates recorded during one year in area Grade D (see Table V).

operation) classes, respectively. Interestingly, only numbers of the contamination rates are also annotated
one count (11 cfu) exceeds the EU GMP limit of 10 on top of the columns in the chart.
cfu, showing again that the USP approach is certainly
more stringent. The cumulative sample contamination PDA technical report 13 (7) suggests monitoring the
rate may decrease or increase from month to month excursions rate as well, that is, the fraction of the samples
and this behavior is explained when the monthly rate exceeding the alert limit and/or action limit. Table IV
is also simultaneously evaluated. For instance, the lists the monthly number of EM samples exceeding the
cumulative rate dropped from 55.6% in February to alert and action limits among the same data set presented
45.5% in March because no contaminated samples in Table III for Grade B. Figure 12 is a visual display of
were detected during March. Instead of tabulated data, the percent excursions rate and it is seen that each
a chart such as Figure 11 has the advantage of an decrease of the monthly rate entails a decrease of the
easier visual display of data behavior. The calculated corresponding cumulative excursions rate.

TABLE VI
Example of Instantaneous Contamination Rates in Classified Area Grade D*

Date of # of Days Till Instantaneous Contamination Instantaneous % Contamination


Contamination Contamination Rate (contamination per day) Rate (contaminations per 100 days)
2/1/2013 — — —
18/4/2013 106 0.009 0.9
22/4/2013 4 0.250 25.0
06/05/2013 14 0.071 7.1
21/05/2013 15 0.067 6.7
11/06/2013 21 0.048 4.8
02/07/2013 21 0.048 4.8
28/07/2013 26 0.038 3.8
24/12/2013 149 0.007 0.7
* This data is used for illustrating similar calculations for classified environments of Class 100, ISO 5, and Grade A.

758 PDA Journal of Pharmaceutical Science and Technology


Downloaded from journal.pda.org on January 19, 2016

Figure 16

Percent instantaneous contamination rates (number of contamination events per 100 days) calculated from
contact plates recorded during one year in area Grade D with the extreme rate omitted (see Table VI).

Example 6: Microbial Contamination Recovery events. This is often applicable for cases of rare events
Rate in Contact Plates in Grade C as expected in the classified environments of Class
100, ISO 5, or Grade A. However, this usually requires
This example depicts recovery rates for contact plates many data points across several years in order to
in classified area Grade C. The contact plates are both calculate instantaneous rates between two rare con-
SDA and TSA plates and any single contaminated taminations. Counts in contact plates in the Grade D
plate is taken as a contamination event. The recovery area are used to illustrate the calculations and the
rates were calculated according to USP guidance with charting even though the contamination is not rare
eqs 6 and 7 and are plotted as a column chart in Figure enough. Table V lists the number of noncontaminated
13. This figure reveals a clear decreasing trend of samples between two successive contaminated sam-
cumulative recovery rates and this is explained by the ples as well as the instantaneous sample contamination
absence of contamination during the months June– rate, expressed per 100 samples, that was calculated
December (the monthly recovery rates are zero). In-
with eq 11. These rates are plotted in Figure 15 and
terestingly, despite the high recovery rates, all counts
show how the contamination rate (number of contam-
(not shown) were below the EU GMP limit of 25 cfu.
inations per 100 samples tested) varies with time and
that on the average, 36 contaminations occur every
Alternatively, one may prefer to plot the same recov-
100 samples. If one omits data point 3 (date of
ery rates in a line chart rather than in a column chart
in order to visualize better any existing trend. This is 22.04.13) for calculating the control limits, one would
shown in Figure 14 along with a USP limit of 5% if obtain a lower contamination rate with narrower con-
Grade C is equated to ISO class 7 (at rest). If addi- trol limits.
tional data of the subsequent year are plotted on the
same chart and the contamination events remain rare, Example 8: Instantaneous Contamination Rates in
the curve of the cumulative recovery rate will continue Contact Plates in Grade D
its trend downward and meet the USP limit.
Fundamentally, rate is expressed per a unit of time and
Example 7: Instantaneous Sample Contamination one can plot the number of contamination events per a
Rates in Contact Plates in Grade D unit of time (e.g., per day). The dates in Table V are
contamination dates and one can calculate the number
As previously explained, the instantaneous rate refers of days elapsed between two contaminations. Table VI
to a rate between two successive contamination lists the number of days until the next contamination

Vol. 69, No. 6, November–December 2015 759


Downloaded from journal.pda.org on January 19, 2016

(inclusive of the contamination day). The instanta- Use; Annex 1: Manufacture of Sterile Medicinal
neous contamination rate (per day) calculated with eq Products, 2008.
9 and the instantaneous percent contamination rate
(per 100 days) calculated with eq 10 are listed in Table 2. WHO Technical Report Series 961. Annex 6:
VI. Either rate can be plotted on an XmR chart and the WHO Good Manufacturing Practices for Sterile
percent contamination rate is shown in Figure 16. Pharmaceutical Products, World Health Organiza-
When the extreme data point 3 (at 22.04.13) is ig- tion, 2011.
nored, the chart shows that, on average, 4.11 contam-
inations occur every 100 days. 3. Guidance for Industry for Sterile Drug Products
Produced by Aseptic Processing: Current Good
Conclusions Manufacturing Practice, U.S. Food and Drug Ad-
ministration, 2004.
A simple statistical process control tool, the XmR
chart of individual values, can be used to plot and 4. USP General Chapter ⬍1116⬎ Microbiological
depict the behavior of the environmental microbial Control and Monitoring of Aseptic Processing
monitoring process. To this purpose, microbial counts Environments, USP 38/NF 33.
of environmental samples are plotted as they are,
irrespective of the parent data distribution and with no 5. USP General Chapter ⬍1223 ⬎ Validation of
need to undergo a mathematical transformation. The Alternative Microbiological Methods, USP 38/NF
three-sigma control limits, computed from the moving 33.
ranges that capture the short-term process variation,
include at least 97.5% of any parent data distribution, 6. Hussong, D.; Madsen, R. Analysis of environmen-
and any microbial count point beyond these limits is tal microbiology data from cleanroom samples.
taken to be a rare occurrence and considered to be an Pharmaceutical Technology, Aseptic Processing
OOC point. Microbial counts from passive or active 2004, 28 (5, SUPP), 10 –15. http://images.alfres-
air sampling in area Grade D or B or Class 100,000 co.advanstar.com/alfresco_images/pharma/2014/
were employed to construct XmR charts. 08/22/cc05da25-54a1-4fc9-84bb-e5c341b2b57e/
article-95525.pdf; accessed Dec. 31, 2014.
When microbial contamination becomes a rare event
as in classified areas of Grade A or B or ISO 5, 7. PDA Technical Report No. 13 (Revised): Funda-
instantaneous rates of contamination between two suc- mentals of an Environmental Monitoring Pro-
cessive contamination events, expressed per unit of gram. Parenteral Drug Association, 2014.
time or per sample tested, can be plotted on an XmR
chart that depicts the behavior of the microbial mon- 8. Hoffman, D. Negative binomial control limits for
itoring process. Alternatively, monthly and cumulative count data with extra-Poisson variation, Pharm.
sample contamination recovery rates, suggested re- Statistics 2003, 2 (2), 127–132.
cently by USP ⬍1116⬎, can be plotted in column or
line charts that allow a visible evaluation of any ex- 9. Jarvis, B. Statistical Aspects of the Microbiolog-
isting trend. Examples of plots of these sample con- ical Examination of Foods, 2nd ed.; Academic
tamination recovery rates as well as of rates of excur- Press: Amsterdam, Netherlands, 2008; p 30.
sion beyond alert and action limits are given for
microbial counts of active air samples in area Grade B 10. Wheeler, D. J.; Chambers, D. S. Understanding
and contact plates in area Grade C, all recorded during Statistical Process Control, 4th ed.; SPC Press:
1 year. Knoxville, TN, 2010.

References 11. Wheeler, D. J. Individual charts done right and


wrong: how does your software rate? Quality
1. EudraLex, The Rules Governing Medicinal Digest [Online] 2010 http://www.qualitydigest.
Products in the European Union. Vol. 4: EU com/inside/quality-insider-column/individual-
Guidelines to Good Manufacturing Practice: charts-done-right-and-wrong.html (accessed
Medicinal Products for Human and Veterinary December 31, 2014).

760 PDA Journal of Pharmaceutical Science and Technology


Downloaded from journal.pda.org on January 19, 2016

12. Wheeler, D. J. Are you sure we don’t need nor- 16. Wheeler, D. J. What is chunky data?: What hap-
mally distributed data? Quality Digest [Online] pens when the measurement increment gets too
2010 http://www.qualitydigest.com/inside/ large? Quality Digest [Online] 2011 http://
twitter-ed/are-you-sure-we-don-t-need-normally- www.qualitydigest.com/inside/quality-insider-
distributed-data.html (accessed December 31, article/what-chunky-data.html (accessed Decem-
2014). ber 31, 2014).

13. Wheeler, D. J. Myths about process behavior 17. Wheeler, D. J. Working with rare events: what
charts: how to avoid some common obstacles to happens when the average count gets very
good practice. Quality Digest [Online] 2011 small? Quality Digest [Online] 2011 http://
http://www.qualitydigest.com/inside/quality- www.qualitydigest.com/inside/quality-insider-
insider-article/myths-about-process-behavior- article/working-rare-events.html (accessed De-
charts.html (accessed December 31, 2014). cember 31, 2014).

14. Wheeler, D. J. What makes the XmR chart work? 18. PDA Technical Report No. 59: Utilization of sta-
Quality Digest [Online] 2012 http://www.quality- tistical methods for production monitoring. Par-
digest.com/inside/quality-insider-article/what- enteral Drug Association, 2012.
makes-xmr-chart-work.html (accessed December
31, 2014). 19. Woodall, W. H. Controversies and contradictions
in statistical process control. J. Qual. Technol.
15. Wheeler, D. J. Statistics and SPC: two things 2000, 32 (4), 341–330.
sharing a common name can still be different.
Quality Digest [Online] 2014 http://www.quality- 20. Laney, D. B. Improved control charts for attri-
digest.com/inside/quality-insider-column/statis- butes. Quality Engineering 2002, 14 (4), 531–
tics-and-spc.html (accessed December 31, 2014). 537.

Vol. 69, No. 6, November–December 2015 761


Downloaded from journal.pda.org on January 19, 2016

An Authorized User of the electronic PDA Journal of Pharmaceutical Science and


Technology (the PDA Journal) is a PDA Member in good standing. Authorized Users are
permitted to do the following:

·Search and view the content of the PDA Journal


·Download a single article for the individual use of an Authorized User
·Assemble and distribute links that point to the PDA Journal
·Print individual articles from the PDA Journal for the individual use of an Authorized User
·Make a reasonable number of photocopies of a printed article for the individual use of an
Authorized User or for the use by or distribution to other Authorized Users

Authorized Users are not permitted to do the following:


·Except as mentioned above, allow anyone other than an Authorized User to use or access the
PDA Journal
· Display or otherwise make any information from the PDA Journal available to anyone other
than an Authorized User
·Post articles from the PDA Journal on Web sites, either available on the Internet or an Intranet,
or in any form of online publications
·Transmit electronically, via e-mail or any other file transfer protocols, any portion of the PDA
Journal
·Create a searchable archive of any portion of the PDA Journal
·Use robots or intelligent agents to access, search and/or systematically download any portion
of the PDA Journal
·Sell, re-sell, rent, lease, license, sublicense, assign or otherwise transfer the use of the PDA
Journal or its content
·Use or copy the PDA Journal for document delivery, fee-for-service use, or bulk reproduction or
distribution of materials in any form, or any substantially similar commercial purpose
·Alter, modify, repackage or adapt any portion of the PDA Journal
·Make any edits or derivative works with respect to any portion of the PDA Journal including any
text or graphics
·Delete or remove in any form or format, including on a printed article or photocopy, any
copyright information or notice contained in the PDA Journal

You might also like