Professional Documents
Culture Documents
VALIDATION
ON
CHEMICAL
TESTING
By: M. A. Mercado
30 Sept – 01 Oct. 2019
OBJECTIVES
To learn the basic concepts and processes on
method validation.
To understand and guide the chemists/analysts
establish single-laboratory method validation
procedure.
COURSE OUTLINE
1
WHY CONDUCT METHOD VALIDATION?
To ensure that the method is fit for use.
Provides greater confidence in the laboratory’s
results.
Provides a solid knowledge and experience of the
practical details of performing the method,
including awareness of any critical steps in the
process.
Identifies and quantifies sources of potential
errors
2
FULL VALIDATION AND
SINGLE-LABORATORY VALIDATION
Full validation / Collaborative Study:
- an examination of the characteristics of the
method in an interlaboratory study.
Single-laboratory validation:
Method selection
Conduct Validation
3
METHOD VALIDATION PROCESS
Extent of the validation work:
Example for pharmaceutical
Type of analytical application
Performance Quantitative Quantification
characteristics Identification test for Limit test for of main
test impurity impurity component
Selectivity √ √ √ √
Limit of detection √
Limit of quantification √
Working range
including linearity √ √
Trueness (bias) √ √
Precision (repeatability
and intermediate
precision) √ √
PERFORMANCE CHARACTERISTICS
4
PERFORMANCE CHARACTERISTICS:
SELECTIVITY AND SPECIFICITY
Selectivity: the degree to which a method can
quantify the analyte accurately in the presence of
interferences.
Ability to measure the analyte of interest in
samples to which specific interferences have been
deliberately introduced (those likely to be present
in samples) and likely, on chemical principles, to
respond to the test.
PERFORMANCE CHARACTERISTICS:
SELECTIVITY/SPECIFICITY
Specificity: the ability of the method to measure
analyte in the presence of components which may
be expected to be present.
Often used interchangeably with “selectivity”; the
term “selectivity” is often preferred than
“specificity”
Specificity can be considered as “100%
selectivity”
Should be conducted during the validation of
identification tests, determination of impurities
and assay.
5
PERFORMANCE CHARACTERISTICS: LIMIT OF
DETECTION AND LIMIT OF QUANTIFICATION
Number of determinations/observations:
- The number of replicates (n) should be sufficient
to obtain an adequate estimate of the standard
deviation.
- Typically between 6 and 15 replicates are
considered necessary; 10 replicates are often
recommended in validation procedures/protocols.
PERFORMANCE CHARACTERISTICS:
LIMIT OF DETECTION
Determination of Limit of Detection (LOD):
1. Analysis of samples with known concentrations
of analyte and by establishing the minimum level
at which the analyte can be reliably detected.
* May be used for non-instrumental methods
but may also be used with instrumental
methods.
PERFORMANCE CHARACTERISTICS:
LIMIT OF DETECTION
Determination of Limit of Detection (LOD):
2. Based on signal-to-noise ratio
- Performed by comparing measured signals from
samples with known low concentrations of
analyte with those of blank samples and
establishing the minimum concentration at
which the analyte can be reliably detected.
- A signal-to-noise ratio between 3 or 2:1 is
generally considered acceptable for estimating
the detection limit.
*Can only be applied to analytical procedures
which exhibit baseline noise.
6
PERFORMANCE CHARACTERISTICS:
LIMIT OF DETECTION
Determination of Limit of Detection (LOD):
3. Based on the Standard Deviation of the
Response and the Slope
Standard Deviation of the Blank
Calibration Curve
DL = 3.3σ divided by S
where σ = the standard deviation of the response
S = the slope of the calibration curve
PERFORMANCE CHARACTERISTICS:
LIMIT OF DETECTION
Determination of Limit of detection (LOD):
3a. Standard Deviation of the Blank:
measurement of the magnitude of analytical
background response is performed by
analyzing an appropriate number of blank
samples and calculating the standard
deviation of these responses.
PERFORMANCE CHARACTERISTICS:
LIMIT OF DETECTION
Determination of Limit of Detection (LOD):
3b. Based on the Calibration Curve:
a specific calibration curve should be studied
using samples containing an analyte in the
range of DL. The residual standard deviation
of a regression line or the standard deviation
of y-intercepts of regression lines may be
used as the standard deviation.
7
PERFORMANCE CHARACTERISTICS:
LIMIT OF DETECTION
Determination of Limit of Detection (LOD):
Example:
Trial No. Blank, mg/L
1 0.05
2 0.05
3 0.1
4 0.05
5 0.1
6 0.05
7 0.05
mean 0.064
Std dev 0.024
(t ) student coefficient
Note: t = at 95%
df= 6 1.943
confidence level
LOD =
mean + t (std dev) 0.112 mg/L
PERFORMANCE CHARACTERISTICS:
LIMIT OF DETECTION
Determination of Limit of Detection (LOD):
Example: Abs Conc, mg/L
0.002 0.01
0.0039 0.02
0.0058 0.03
0.0082 0.04
0.014 0.05
PERFORMANCE CHARACTERISTICS:
LIMIT OF QUANTIFICATION
Determination of Limit of Quantification (LOQ):
1. Analysis of samples with known concentrations
of analyte and by establishing the minimum level
at which the analyte can be quantified with
acceptable accuracy and precision.
* May be used for non-instrumental methods
but may also be used with instrumental
methods
8
PERFORMANCE CHARACTERISTICS:
LIMIT OF QUANTIFICATION
Determination of Limit of Quantification (LOQ):
2. Based on signal-to-noise ratio
- Performed by comparing measured signals from
samples with known low concentrations of
analyte with those of blank samples and
establishing the minimum concentration at
which the analyte can be reliably quantified.
- A signal-to-noise ratio between 10:1.
PERFORMANCE CHARACTERISTICS:
LIMIT OF QUANTIFICATION
Determination of Limit of Quantification (LOQ):
3. Based on the Standard Deviation of the
Response and the Slope
Standard Deviation of the Blank
Calibration Curve
may be expressed as:
DL = 10σ divided by S
where σ = the standard deviation of the response
S = the slope of the calibration curve
PERFORMANCE CHARACTERISTICS:
LIMIT OF QUANTIFICATION
Determination of Limit of Quantification (LOQ):
3a. Standard Deviation of the Blank:
measurement of the magnitude of analytical
background response is performed by
analyzing an appropriate number of blank
samples and calculating the standard
deviation of these responses.
9
PERFORMANCE CHARACTERISTICS:
LIMIT OF QUANTIFICATION
Determination of Limit of Quantification (LOQ):
3b. Based on the Calibration Curve:
a specific calibration curve should be studied
using samples containing an analyte in the
range of QL. The residual standard deviation
of a regression line or the standard deviation
of y-intercepts of regression lines may be
used as the standard deviation.
PERFORMANCE CHARACTERISTICS:
LIMIT OF QUANTIFICATION
Determination of Limit of Quantification (LOQ):
Example:
Trial No. Blank, mg/L
1 0.05
2 0.05
3 0.1
4 0.05
5 0.1
6 0.05
7 0.05
mean 0.064
Std dev 0.024
PERFORMANCE CHARACTERISTICS:
LIMIT OF QUANTIFICATION
Determination of Limit of Quantification (LOQ):
Example: Abs Conc, mg/L
0.002 0.01
0.0039 0.02
0.0058 0.03
0.0082 0.04
0.014 0.05
10
METHOD DETECTION LEVEL
(MDL - BASED ON SMEWW)
Determine the method detection level (MDL) for
each analyte of interest and method to be used
before data from any samples are reported.
As a starting point, use an estimate of five times
the estimated detection limit.
If calculated MDL is not within a factor of l0 of the
value for the known addition, repeat at a more
suitable concentration.
Conduct MDL determinations at least annually (or
other specified frequency) for each analyte and
method in use at the laboratory.
11
PERFORMANCE CHARACTERISTICS:
LINEARITY
PERFORMANCE CHARACTERISTICS:
LINEARITY
Evaluation of linearity:
1. By visual inspection of a plot of signals as a
function of analyte concentration or content.
2. If there is a linear relationship, test results
should be evaluated by appropriate statistical
methods: example: by calculation of a regression
line by the method of least squares.
Note: In some cases, to obtain linearity between
assays and sample concentrations, the test data
may need to be subjected to a mathematical
transformation prior to the regression analysis.
PERFORMANCE CHARACTERISTICS:
LINEARITY
Evaluation of linearity: by visual inspection of a
plot of signals
0.35
0.3
0.35 0.25
0.3 0.2
Abs
0.25 0.15
0.2 0.1
Abs
0.15 0.05
0.1 0
0.05 0.00 0.20 0.40 0.60 0.80 1.00 1.20
Conc, mg/L
0
0.00 0.20 0.40 0.60 0.80 1.00 1.20
Conc, mg/L
12
PERFORMANCE CHARACTERISTICS:
LINEARITY
0.2
Abs
0.15
0.1
0.05
0
0.00 0.20 0.40 0.60 0.80 1.00 1.20
Conc, mg/L
PERFORMANCE CHARACTERISTICS:
WORKING RANGE
PERFORMANCE CHARACTERISTICS:
WORKING RANGE
13
PERFORMANCE CHARACTERISTICS:
TRUENESS
Trueness:
- Degree of agreement of the mean value from a
series of measurements with the reference value
or true value.
- Normally expressed quantitatively as bias.
PERFORMANCE CHARACTERISTICS:
TRUENESS
Bias: can be expressed simply as:
% Recovery:
PERFORMANCE CHARACTERISTICS:
TRUENESS
% Spike Recovery:
14
PERFORMANCE CHARACTERISTICS:
TRUENESS
Example: Expected recovery as a function of analyte
concentration (from AOAC)
PERFORMANCE CHARACTERISTICS:
PRECISION
Precision:
- Measure of how close results are to one another.
- Usually expressed as standard deviation.
- Three (3) quantitative determination:
1. repeatability
PERFORMANCE CHARACTERISTICS:
PRECISION
Repeatability: measurements performed by a
single analyst using the same equipment over a
short timescale.
Intermediate precision: measurements are made
in a single laboratory but under conditions that
are more variable than repeatability conditions,
(e.g. different analysts, extended timescale,
different set of equipment).
Reproducibility: measurements are made with
the same test methods on identical test items in
different test facilities with different analysts
and different equipment.
15
PERFORMANCE CHARACTERISTICS:
PRECISION
Evaluating precision results:
- Requires sufficient replicate measurements to be
made on suitable materials.
- The materials should be representative of test
samples in terms of matrix and analyte
concentration, homogeneity and stability.
- The replicates should also be independent, i.e.
the entire measurement process, including any
sample preparation steps, should be repeated.
PERFORMANCE CHARACTERISTICS:
PRECISION
Evaluating precision results:
- The minimum number of replicates specified
varies with different protocols, but is typically
between 6 and 15 for each material used in the
study (Eurachem)
- a minimum of 9 determinations covering the
specified range for the procedure; e.g., 3
concentrations/3 replicates each. (ICH)
- a minimum of 6 determinations at 100% of the
test concentration (ICH)
PERFORMANCE CHARACTERISTICS:
PRECISION
Example: Expected precision (repeatability) as a
function of analyte concentration (from AOAC)
16
PERFORMANCE CHARACTERISTICS:
PRECISION
Example: Predicted relative standard deviation of
reproducibility (from AOAC)
PERFORMANCE CHARACTERISTICS:
RUGGEDNESS/ROBUSTNESS
Ruggedness/robustness:
- A measure of its capacity to remain unaffected by
small, but deliberate variations in method
parameters.
- Provides an indication of the method’s reliability
during normal usage.
- The evaluation of robustness should be
considered during the development phase and
depends on the type of procedure under study.
PERFORMANCE CHARACTERISTICS:
RUGGEDNESS/ROBUSTNESS
Ruggedness/robustness:
- Tested by deliberately introducing small changes
in the procedure and examining the effects in the
results
- Examples of typical variations: concentration of
reagent; pH of solution, temperature of reaction,
extraction time, flow rate, different columns.
17
PERFORMANCE CHARACTERISTICS:
RUGGEDNESS/ROBUSTNESS
Evaluation of Ruggedness/robustness:
1. Using “F-test”: comparing 2 precision (SD) with
the hypothesis are not significantly different.
2. Using ANOVA (analysis of variance): analyze
the differences among group means in a sample.
Ruggedness study is in most cases not necessary
at the single-laboratory level.
18
REFERENCES / REGULATION AGENCIES /
INDUSTRIAL COMMITTEES
1. AOAC
2. United states Pharmacopeia
3. US FDA
4. ICH (International Conference on
Harmonization)
5. US EPA
6. Codex Alimentarius
7. Eurachem Method Validation Guide
8. IUPAC
QUALITY ASSURANCE
AND
QUALITY CONTROL
IN
CHEMICAL
LABORATORY
OBJECTIVES
19
COURSE OUTLINE
QUALITY CONCEPT
What is Quality?
Conformance to requirements / specifications
Fitness to purpose
Getting it right, first time, every time
Customer Satisfaction
QUALITY CONCEPT
20
QUALITY ASSURANCE VS QUALITY CONTROL
21
QUALITY ASSURANCE PROGRAMS
Should be able to accomplish
the following:
Establish Standard Operating
Procedures (SOP) for each step
of the laboratory testing process
starting from sample handling
to reporting of results.
Define administrative
requirements: mandatory
recordkeeping, data evaluation,
and internal audits to monitor
adherence to SOPs.
22
GOOD LABORATORY PRACTICES (GLP)
GLP should not only be confused
with standards for laboratory safety
- appropriate gloves, glasses &
clothing to handle lab materials
safely.
GLP is a quality system concerned
with the organizational process and
the conditions under which
laboratory study / test / experiments
are planned, performed, monitored,
recorded, archived and reported.
23
5 “S” CONCEPT
5 “S”: a process for creating and maintaining
an organized, clean, and high performance
work place, which serves as a foundation for
continuous improvement activities
1. Sort Out (Seiri) - housekeep
2. Set in Order (Seiton) - organize
LEAN TECHNIQUES
LEAN: a manufacturing/production system
best characterized as relentlessly eliminating
waste from all of its activities and operations.
Principles of LEAN:
Identify the value
Establish pull
Seek perfection
24
AUDIT AND INSPECTION
Conduct of inspection
- Inspection: an examination of a
product, process, service, or
installation or their design and
determination of its conformity with
specific requirements or, on the basis
of professional judgment, with general
requirements (ISO/IEC 17020
definition).
- Regular inspection of the facility and
all the resources related to laboratory
activities.
- Use of checklist as a good tool when
conducting inspection.
25
HOMOGENEITY OF THE TEST ITEM
The laboratory sample is the material received by
the laboratory and usually must be reduced in
bulk and fineness to an analytical sample from
which the test portions are removed for analysis.
Conduct homogeneity test as necessary.
26
PURITY OF THE REAGENTS
Grades of Chemicals:
- Reagent grade A.C.S.
- Guaranteed Reagent (GR)
- AR
- Primary standard
- USP grade
- Technical grade
TYPE OF GLASSWARE
Laboratory vessels serve three functions: storage
of reagents, measurement of solution volumes,
and confinement of reactions.
Depending on the manufacturer, various trade
names are used for specific brands possessing
special properties such as resistance to heat,
shock, and alkalies. Example: Kimax- or Pyrex-
brand glass is a relatively inert all-purpose
borosilicate glass
TYPE OF GLASSWARE
Volumetric glassware: accurately calibrated
glassware for precise measurements of volume.
This group includes volumetric flasks, volumetric
pipets, and accurately calibrated burets.
Volumetric apparatus is calibrated to contain or
to deliver a definite volume of liquid.
Solutions must be measured at the temperature
at which the apparatus was calibrated.
Consider frequency of calibration.
27
PREPARATION OF REAGENTS AND
STANDARD SOLUTIONS
Proper labeling
INTERMEDIATE CHECKS
28
VALIDITY CHECKING
Calibration check
- For calibration curve, standard solutions should
be analysed within the required range of
concentration.
- The ideal calibration curve is linear within its
most useful range, with a regression coefficient of
0.99 or greater.
- The standard curve is then verified by the
analysis of a midpoint standard concentration.
VALIDITY CHECKING
Use of blank
- Method blank: a sample containing all
components except analyte, and it is taken
through all steps of the analytical procedure.
Processed simultaneously with and under the
same conditions as samples containing an
analyte of interest through all steps of the
analytical procedure.
- Run in order to evaluate the system for high
biased readings of background contamination.
VALIDITY CHECKING
Use of blank
- Field blank: reagent water that has been bottled
in the laboratory, shipped with sample bottles to
the sampling site, processed and preserved as a
routine sample and returned with the routine
samples to the laboratory for analysis.
Purpose: assess contamination from field
conditions during sampling.
29
VALIDITY CHECKING
Use of blank
- Trip blank: a clean sample of a matrix that is
taken from the laboratory to the sampling site
and transported back to the laboratory without
having been exposed to sampling procedures.
Typically, analyze only for volatile compounds.
Purpose: assess contamination introduced during
shipping and field handling procedures.
VALIDITY CHECKING
Recovery check
- A sample spiked with a known amount of the
variable should be tested in each batch and the
closeness of fit to the expected value calculated.
- In some cases this procedure also provides a
check on accuracy but, in assays where a variable
is extracted from the original matrix (such as in
many sample clean-up procedure), it can be used
to monitor the extraction step.
Replicate testing
- Tool to check precision.
- Since the samples are analysed using the same
method, equipment and reagents, the same bias
should affect all results.
- Evaluation of results varies and may depend on
test method/reference.
30
PRECISION AND ACCURACY CHECKS
31
USE OF CONTROL CHARTS
Control charts: monitors variance in a process
over time and alerts the business to unexpected
variance which may cause defects.
Principle of control charts is that internal quality
control data can be graphically plotted so that
they can be readily compared and interpreted
Criteria for evaluation: references; test method;
Westgard rule
32
USE OF CONTROL CHARTS
Chart analysis:
(a) Control limit—If one measurement exceeds a
CL, repeat the analysis immediately. If the
repeat measurement is within the CL, continue
analyses; if it exceeds the CL, discontinue
analyses and correct the problem.
33
USE OF CONTROL CHARTS
Chart analysis:
c) Trending—If seven successive samples are on
the same side of the central line, discontinue
analyses and correct the problem
34
PROFICIENCY TESTING (PT) AND
INTERLABORATORY COMPARISON TEST (ICT)
Normalized Error
35
PROFICIENCY TESTING (PT) AND
INTERLABORATORY COMPARISON TEST (ICT)
Normalized Error:
When the value of |En| ≤ 1 (i.e. between -1 and
+1), the results are considered satisfactory.
When the value of |En| > 1 (i.e. greater than +1
or less than -1), the results are considered
unsatisfactory.
- Z-Score:
- statistical measurement of a score’s relationship
(i.e. how many standard deviations above or
below the population mean) to the mean in a set
of scores.
- used to review the results of all participants and
identify outliers and exclude their data from
proficiency testing results.
Z-Score:
36
PROFICIENCY TESTING (PT) AND
COMPARISON TEST (ICT)
37
USE OF BLIND SAMPLES
EVALUATION OF QC DATA
Review your data
Frequency of review of the data
What to do when results are not within the
defined criteria
38
39