This action might not be possible to undo. Are you sure you want to continue?

**Quality Assurance and Quality Control in the Analytical Chemical Laboratory
**

A Practical Approach

.© 2009 by Taylor & Francis Group, LLC

A N A LY T I C A L C H E M I S T R Y S E R I E S

Series Editor

Charles H. Lochmüller

Duke University

Quality and Reliability in Analytical Chemistry, George E. Baiulescu, Raluca-Ioana Stefan, Hassan Y. Aboul-Enein HPLC: Practical and Industrial Applications, Second Edition, Joel K. Swadesh Ionic Liquids in Chemical Analysis, edited by Mihkel Koel Environmental Chemometrics: Principles and Modern Applications, Grady Hanrahan Quality Assurance and Quality Control in the Analytical Chemical Laboratory: A Practical Approach, Piotr Konieczka and Jacek Namie´ snik

.© 2009 by Taylor & Francis Group, LLC

A N A LY T I C A L C H E M I S T R Y S E R I E S

**Quality Assurance and Quality Control in the Analytical Chemical Laboratory
**

A Practical Approach

Piotr Konieczka • Jacek Namie´ snik

Boca Raton London New York

CRC Press is an imprint of the Taylor & Francis Group, an informa business

.© 2009 by Taylor & Francis Group, LLC

Jacek Namiesnik.com and the CRC Press Web site at http://www. LLC CRC Press is an imprint of Taylor & Francis Group. (CCC). or other means. no part of this book may be reprinted. LLC 2009000685 . III.taylorandfrancis. paper) 1. now known or hereafter invented. Quality assurance and quality control in the analytical chemical laboratory : a practical approach / Piotr Konieczka. II.crcpress. or utilized in any form by any electronic. transmitted. without written permission from the publishers. Piotr. but the author and publisher can‑ not assume responsibility for the validity of all materials or the consequences of their use. microfilming. Reasonable efforts have been made to publish reliable data and information.com . Chemistry. including photocopying. or in any information storage or retrieval system. For organizations that have been granted a photocopy license by the CCC. If any copyright material has not been acknowledged please write and let us know so we may rectify in any future reprint. mechanical. Analytic‑‑Qualitative. Except as permitted under U. QD75. I. 978‑750‑8400. Inc. cm. Government works Printed in the United States of America on acid‑free paper 10 9 8 7 6 5 4 3 2 1 International Standard Book Number‑13: 978‑1‑4200‑8270‑8 (Hardcover) This book contains information obtained from authentic and highly regarded sources. Library of Congress Cataloging‑in‑Publication Data Konieczka.4. and are used only for identification and explanation without intent to infringe. Chemical laboratories‑‑Quality control. For permission to photocopy or use material electronically from this work. Namiesnik. a separate system of payment has been arranged.CRC Press Taylor & Francis Group 6000 Broken Sound Parkway NW. 2.com/) or contact the Copyright Clearance Center.S. ‑‑ (Analytical chemistry) Includes bibliographical references and index. reproduced. an Informa business No claim to original U. please access www.copyright. Title. Trademark Notice: Product or corporate names may be trademarks or registered trademarks. Suite 300 Boca Raton. Copyright Law. Series. p.copy‑ right.Q34K66 2009 542’. ISBN 978‑1‑4200‑8270‑8 (hardcover : alk. FL 33487‑2742 © 2009 by Taylor & Francis Group.© 2009 by Taylor & Francis Group.S. Jacek. 222 Rosewood Drive. CCC is a not‑for‑profit organization that pro‑ vides licenses and registration for a variety of users. The authors and publishers have attempted to trace the copyright holders of all material reproduced in this publication and apologize to copyright holders if permission to publish in this form has not been obtained. and recording.com (http://www. MA 01923. Danvers.1‑‑dc22 Visit the Taylor & Francis Web site at http://www.

..............................8....... ....8................................ 38 References...............1 Shewhart Charts......9 Control Charts................... 17 1...............................2 v ..................1 Confidence Interval Method [3]....8...........................8..8.............. 16 1....................18 Kolmogorov-Smirnov Test [2. 27 1.....................15 Z Score [10.........................6 Hartley’s Fmax Test [3]......... 11]...... xiii Chapter 1 Basic Notions of Statistics.........................8....................7 1....................... ..... 39 1.....8 Morgan’s Test [3]......................8........................7 Statistical Hypothesis Testing....................... 23 1......2 Shewhart Chart Preparation..................... 4]...............................7 Bartlett’s Test [3].................................................................................................1 Characterization of Distributions.........5 1..................................1 1........................ix About the Authors............ ..8 Statistical Tests.......................... 12..........................1 Introduction.4 Measures of Dispersion....................1 Distributions of Random Variables......... 4................................. 18 1..............................................8...2 Critical Range Method [3]..............xi List of Abbreviations.......................8... 21 1..................... 11].....24 1..............13 Grubbs’ Test [6............ 10 1................................. 12 1...28 1....... 29 1......................7 1................ 14]........................11 Significant Digits: Rules of Rounding...........8........................2................. 22 1...8...............9...........................12 Cochran’s Test [6]..................... 13 1.............1 1............................................ 15 1....................... 10 1............................................................................ 30 1....................8......Contents Preface.............................................................................5 Measures of Asymmetry.......4 Chi Square Test [3]....................................................................................................................................10 Linear Regression................................................................... 13]................8..........8........10 Cochran-Cox Test [3].8 1....8... 29 1............................................................5 Snedecor’s F Test [3..................... 4]...8................17 Mandel’s Test [6.....9 Student’s t Test [3.............8........................................6 Measures of Concentration....... 27 1.............. 7]......26 1................................................. 29 1.........................© 2009 by Taylor & Francis Group.........................................3 Dixon’s Q Test [3........................ 36 1............. LLC .................9...... 16 1.........3 Measures of Location............. 5]....................................................................................16 En Score [10............3 1...........................................................1 1.... 19 1........8........................................14 Hampel’s Test.11 Aspin-Welch Test [3].......

........................................................1 General Information......................... ......................© 2009 by Taylor & Francis Group......... LLC ...............................................................3..............1 5............ 67 4.........4 Practical Application of CRM........3 4............... 77 Introduction.............................................................................3.................................................................................. 49 Introduction.................................................... 49 Role of Traceability in Quality Assurance/Quality Control System.......................................5 Conclusion...2 Representativeness... 95 5........................................................................46 References...........................................................2 4......1 3..............2 5..................3...................................................5 Certified Value........ 55 Chapter 4 Uncertainty......... 57 Definitions [1–3].4 Tools Used for Uncertainty Estimation.........84 5....................... 59 4................................................................ 58 4.......3 Quality Assurance System............................... 57 Methods of Estimating Measurement Uncertainty...................................4 Conclusion................. 41 2...........4 Stability.............. 82 5..................... .. 49 3.................................................................................80 5.. 73 References....................... 42 2.............................................1 4.................................................................... 95 References........................... 67 4..............3....... 41 2.... 57 Introduction................ 82 5............................................................................................ 77 Parameters that Characterize RMs..3..............................................................................................................................................4 Conclusions.........3.................. 69 4...............................3 ..............................................................................................................1 Procedure for Estimating the Measurement Uncertainty According to Guide to the Expression of Uncertainty in Measurement...................... 51 3...3 Definitions [1]............ 77 Definitions [1........................................................... ... 85 5... 41 2..................................................................................................................................... 82 5......................................................46 Chapter 3 Traceability....3 Homogeneity............vi Contents Chapter 2 Quality of Analytical Results................................ 2]......................... 74 Chapter 5 Reference Materials.................6 Calibration Uncertainty............1 Definitions [1–3].................2 Introduction. 55 References...........................................................................................................................................................................................7 Conclusion...................5 Uncertainty and Confidence Interval.80 5.............................................2 3..............

........... 145 Determinations for Blank Samples.... 7...........2............................2.3..... ......2 Comparison of Measurement Results Obtained in a Two-Level Study (for Two Samples with Various Analyte Concentrations)........................................... 123 6.......3..........................................................3......... 148 7....2........................97 Introduction.....2.................................................................................................... 146 7...... 2]. 120 6............ ............3 6.....................3.........2 Introduction........... 136 7..................© 2009 by Taylor & Francis Group...... .......3 Limit of Detection and Limit of Quantitation.....2 6........................................................................................................... 130 Chapter 7 Method Validation............97 6.....2 Calculation of LOD Based on the Numerical Value of the S/N Ratio......1 Comparisons of Results Obtained Using Various Procedures..............2.................3........................................... 134 7....7 Testing the Correctness of the Determined LOD...........................97 Classification of Interlaboratory Studies...............6 Calculation of LOD Based on a Given LOQ......... ........... 131 7..5 Calculating LOD Based on the Standard Deviation of Signals and the Slope of the Calibration Curve.....2..3.......................... 164 7.................................... 98 Characteristics and Organization of Interlaboratory Comparisons........1 Visual Estimation........ 129 References..5.........................................2......... 101 6........Contents vii Chapter 6 Interlaboratory Comparisons.. 160 7............................................6 Conclusions.. 147 7.3.............................................2...6.......................2.1 6.....5 Sensitivity.........4 Graphical Method.... 134 7........... LLC .......................... 145 7..............................2...........5 Presentation of Interlaboratory Comparison Results: Statistical Analysis in Interlaboratory Comparisons...................... 144 7.................... 146 7.........................6 Precision.......................................2 Linearity............1 Selectivity......................................1 Manners of Estimating the Standard Deviation.............................. 143 7........... 102 6......................... 131 Characterization of Validation Parameters.....2...2..... 166 .....5.....4 Range.... 164 7.............3 Calculation of LOD Based on ...2..................................................1 7................................4 Definitions [1...........................................2.

...2..................................................................................................© 2009 by Taylor & Francis Group..2.................................. LLC ......1 Measurement Errors.....................7................. ...... 174 7........................................2............................ 217 Index.............. 196 7.......... 195 7............................ ........................................ 173 7...................................................2....................................7 .......204 References.viii Contents Accuracy and Trueness................................................ ........ 214 Appendix............................8 Robustness and Ruggedness......................... ................4 Conclusions........ 231 7.............9 Uncertainty.

The theoretical part of the book contains information on questions relating to quality control systems. particularly among those who are interested in QA/QC. The user’s own data should be copied only into yellow marked cells (be sure that your data set fits the appropriate datasheet). calculation of the margin of error. It should be noted that in order to obtain correct calculations. a constructed calculation datasheet (Excel) is attached. estimating uncertainty. For all examples.© 2009 by Taylor & Francis Group. in some cases. additional data such as graphs and conclusions are also included. Solution data will be calculated and can be read from green marked cells. etc. ix . and an increase in knowledge about the practical application of statistical tools during analytical data treatment. using statistical tests. With its comprehensive coverage. The accompanying CD contains more than 60 Excel datasheet files. as well as government agencies and legislative bodies. it is possible to use it on different data sets. each consisting of three main components: problem. After saving an Excel file on the hard disk. including definition of all tools. LLC . and solution. understanding of their uses. it may also prove useful to the scientific community.Preface The aim of this book is to provide practical information about quality assurance/ quality control (QA/QC) systems. We hope that with this book. data. Although this book is primarily designed for students and academic teachers. we can contribute to a better understanding of all problems connected with QA/QC. The practical part includes more than 60 examples relating to validation parameter measurements. it is necessary to use it appropriately. this book can be of particular interest to researchers in the industry and academia. which makes problem solving easier.

the Jan Hevelius Scientific Award of Gdańsk City (2001). He is the receipient of various awards. He has been the head of the Department of Analytical Chemistry since 1995. DSc 1985-GUT. Jacek Namieśnik (MSc 1972-GUT. xi . Prof. has been employed at Gdańsk University of Technology since 1989 and is currently working as a tutor. born in 1949. Currently a full professor. DSc 2008-GUT). PhD 1994. he has 7 patents to his name. born in 1965. and Fellow of the International Union of Pure and Applied Chemistry (IUPAC) since 1996.About the Authors Piotr Konieczka (MSc 1989. PhD 1978-GUT. has been employed at Gdańsk University of Technology since 1972. LLC . He was director of the Centre of Excellence in Environmental Analysis and Monitoring in 2003–2005. Among his published scientific papers are 7 books. as well as chairman of the Committee of Analytical Chemistry of the Polish Academy of Sciences since 2007. His research interests include environmental analytics and monitoring and trace analysis. 6 book chapters.© 2009 by Taylor & Francis Group. and more than 40 papers. His research interests include metrology. as well as more than 70 lectures and communications. more than 300 papers. he has also served as vice dean of the Chemical Faculty (1990–1996) and dean of the Chemical Faculty (1996–2000 and 2005–present). and trace analysis. environmental analytics and monitoring. including Professor honoris causa from the University of Bucharest (Romania) (2000). and the Prime Minister of Republic of Poland Award (2007). and more than 350 lectures and communications published in conference proceedings. 1998). His published scientific output includes 1 book.

List of Abbreviations AAS ANOVA BCR CDF CITAC CL CRM CV CVAAS EN GC GLP GUM IAEA ICH IDL ILC IQR IRMM ISO IUPAC JCGM LAL LOD LOQ L-PS LRM LWL MB M-CS MDL M-PS NIES NIST NRCC PRM PT QA(1) QA(2) QA/QC Atomic Absorption Spectrometry ANalysis Of VAriance Bureau Communautaire de Reference (Standards. and Testing Programme–European Community) Cumulative Distribution Function Cooperation on International Traceability in Analytical Chemistry Central Line Certified Reference Material Coefficient of Variation Cold Vapor Atomic Absorption Spectrometry European Norm Gas Chromatography Good Laboratory Practice Guide to the Expression of Uncertainty in Measurement International Atomic Energy Agency International Conference on Harmonization Instrumental Detection Limit InterLaboratory Comparisons InterQuartile Value Institute for Reference Materials and Measurements International Organization for Standardization International Union of Pure and Applied Chemistry Joint Committee for Guides in Metrology Lower Action (control) Limit Limit of Detection Limit of Quantification Laboratory-Performance Study Laboratory Reference Material Lower Warning Limit Method Blank Material-Certification Study Method Detection Limit Method Performance Study National Institute for Environmental Studies National Institute of Standards and Technology National Research Council of Canada Primary Reference Material Proficiency Test Quality Assessment Quality Assurance Quality Assurance/Quality Control xiii . Measurements. LLC .© 2009 by Taylor & Francis Group.

LLC .xiv List of Abbreviations QC QCM RH RM RSD S/N SD SecRM SI SOP SRM UAL USP UWL VIM VIRM Quality Control Quality Control Material Relative Humidity Reference Material Relative Standard Deviation Signal-to-Noise ratio Standard Deviation Secondary Reference Material Le Systeme Internationale d’Unités Standard Operating Procedure Standard Reference Material Upper Action (control) Limit United States Pharmacopea Upper Warning Limit Vocabulaire International des Termes Fondamentaux et Généraux de Métrologie European Virtual Institute for Reference Materials .© 2009 by Taylor & Francis Group.

for example: • How exact the result of determination is. Statistics is not only art for art’s sake. A result is a consequence of a measurement. It is a very useful tool that can help us find answers to many questions. because it may clear many doubts and answer many questions associated with the nature of an analytic process. and equal to 0 for arguments approaching negative infinity. a CDF is (not necessarily strictly) right-continuous. 1 . The set of obtained determination results creates a distribution (empirical).1 Introduction Mathematical statistics is a branch of mathematics that applies the theory of probability to examining regularities in the occurrence of certain properties of material objects or phenomena that occur in unlimited quantities.1 Characterization of Distributions The application of a certain analytical method unequivocally determines the distribution of measurement results (properties). 1. • Whether the investigated product fulfills the necessary requirements and/or norms.2 Distributions of Random Variables 1.© 2009 by Taylor & Francis Group.2. • A density function that is the derivative of the CDF: f(x) = F X ′ (x). with its limit equal to 1 for arguments approaching positive infinity. it is important to remember that statistics should be applied in a reasonable way.1 Basic Notions of Statistics 1. Yet. in practice. LLC . a CDF is described shortly by: FX (x) = P(X ≤ x). Each defined distribution is characterized by the following parameters: • A cumulative distribution function (CDF) X is determined by FX and represents the probability that a random variable X takes on a value less than or equal to x. here treated as independent random variables. Statistics presents these regularities by means of numbers. Statistics is especially helpful for analysts. • How many determinations should be conducted to increase the precision of a measurement.

© 2009 by Taylor & Francis Group. physiochemical property). SD) is characterized by the following properties: • an expected value μx • a median Me = μx • a variance SD2 Uniform distribution (also called continuous or rectangular) is a continuous probability distribution for which the probability density function within the interval 〈−a. Uniform distribution is characterized by: • an expected value μx = 0 • a median Me = 0 • a variance SD2 = a2/3 Triangular distribution over the interval 〈−a. characteristic inference is drawn using the analysis of a limited number of elements (samples) representing a fragment of the whole set that is described by the distribution. N (μx. +a〉 is constant and not equal to zero. LLC . content. +a〉 is characterized by: • an expected value μx = 0 • a median Me = 0 • a variance SD2 = a2/6 The distribution of a random variable provides complete information on an investigated characteristic (e.. defined by two parameters: mean (location) and standard deviation (scale). These parameters can be divided into four basic groups: • • • • measures of location measures of statistical dispersion measures of asymmetry measures of concentration .g. Unfortunately.2 Quality Assurance and Quality Control Below are the short characterizations of the most frequently used distributions: • normal distribution • uniform distribution (rectangular) • triangular distribution Normal distribution. The distribution is determined by a pair of parameters – a and +a. Normal distribution. It is an infinite family of many distributions. also called the Gaussian distribution (particularly in physics and engineering). but outside the interval is equal to zero. Statistical parameters are numerical quantities used in the systematic description of a statistical population structure. is a very important probability distribution used in many domains. it is not important whether the endpoints – a and +a are included in the interval. As a rule. concentration. Because this distribution is continuous. one may infer a characteristic using an estimation of some of its parameters (statistical parameters) or its empirical distribution. Then. such complete information is seldom available.

. • The arithmetic mean from a sample is a good approximation (estimation. • The arithmetic mean fulfills the condition: x min < x m < x max (1.1) Here are the selected properties of the arithmetic mean: • The sum of the values is equal to the product of the arithmetic mean and the population size.Basic Notions of Statistics 3 1. LLC .3) • The sum of squares of deviations of each value from the mean is minimal: ∑( x − x ) i m i =1 n 2 = min (1. estimator) of the expected value.3 Measures of Location Measures of location use one value to characterize the general level of the value of the characteristic in a population [1].2) • The sum of deviations of individual values from the mean is equal to zero: ∑ (x − x ) = 0 i m i =1 n (1.© 2009 by Taylor & Francis Group. The most popular measures of location are the following: • • • • arithmetic mean truncated mean mode quantiles: • quartiles • median • deciles Arithmetic mean is the sum of all the values of a measurable characteristic divided by the number of units in a finite population: xm = ∑x i =1 n i n (1.4) • The arithmetic mean is sensitive to extreme values of the characteristic.

4-quantiles are called quartiles. other means have been proposed. there may be more than one value that can be a mode. so that each part represents 1/4 of the sampled population. among which the extrema (minima or maxima) have a high uncertainty concerning their actual value [2]. . The first quartile (designated Q1) divides the population in a such a way that 25% of the population units have values lower than or equal to the first quartile Q1.4 Quality Assurance and Quality Control The truncated mean x wk is a statistical measurement calculated for the series of results. LLC . is calculated using all results. and half of them have values higher than or equal to the median. This is usually perceived as its advantage. The 2-quantile is called the median. The median measurement is the middle number in a population arranged in a nondecreasing order (for a population with an odd number of observations). and 100-quantiles are percentiles. but sometimes may also be regarded as a flaw. A median separates the higher half of a population from the lower half. because the same maximum frequency can be attained at different values. 10-quantiles are deciles. This mean. and 90% of the results have values greater than or equal to it. Quantiles are data values marking boundaries between consecutive subsets. A quartile is any of three values that divide a sorted data set into four equal parts. half of the units have values smaller than or equal to the median. the truncated mean. Its value is calculated according to the formula: x wk = n − k −1 1 k + 1 x( k +1) + x ( i ) + k + 1 x( n − k ) n i= k +2 ( ) ∑ ( ) (1. The second quartile Q2 is the median. less sensitive to outliers than the standard mean (only a large number of outliers can significantly influence the truncated mean) and standard deviation. Contrary to the arithmetic mean. the median is not sensitive to other units in a population. Quantiles Q are values in an investigated population (a population presented in the form of a statistical series) that divide the population into a certain number of subsets. In a set of results. even immense differences between outliers and the arithmetic mean do not affect its value. which transfers the extreme to an accepted deviation range — thanks to the application of appropriate iterative procedures.© 2009 by Taylor & Francis Group. The third quartile (designated Q3) divides the population in a such a way that 75% of the population units have values lower than or equal to the third quartile Q3. for example.5) where xwk = truncated mean n = number of results in the series k = number of extreme (discarded) results Mode Mo is the value that occurs most frequently in a data set. and 25% units have values higher than or equal to the quartile. or the mean of the two middle values (for those with an even number of observations). Hence. and 75% units have values higher than or equal to the first quartile. The first decile represents 10% of the results that have values lower than or equal to the first decile.

the standard deviation does not change. but does not give information on the variability of individual values of the characteristic in the population.6) It is a measure characterizing the empirical variability region of the examined characteristic. the greater the dispersion of results. the square root of the variance. Variance SD2 is an arithmetic mean of the squared distance of values from the arithmetic mean of the population.© 2009 by Taylor & Francis Group. Thus. In all other cases it has positive values. • If each measurement value is multiplied or divided by any constant value. The most popular measures of dispersion are: • • • • • range variance standard deviation average deviation coefficient of variation (CV) The range R is a difference between the maximum and minimum value of an examined characteristic: R = x max − x min (1.Basic Notions of Statistics 5 1. Properties of the standard deviation: • If a constant value is added to or subtracted from each value. the greater the value of the standard deviation SD. the standard deviation is also multiplied/divided by that same constant.4 Measures of Dispersion Measures of dispersion (variability) are usually used to determine differences between individual observations and mean value [1]. It must be remembered that dispersion of results occurs in each analytical process. It is described by the equation: SD = ∑( x − x ) i m i =1 n 2 n −1 (1.8) Standard deviation equals zero only when all results are identical. Yet it is not always observed. for example. is the measure of dispersion of individual results around the mean. . because of the resolution of a measuring instrument being too low. LLC .7) Standard deviation SD. Its value is calculated according to the formula: SD 2 = 1 n −1 ∑( x − x ) i m i −1 n 2 (1.

14) . LLC . For series with equal numbers of elements.© 2009 by Taylor & Francis Group.13) The mean absolute deviation D is an arithmetic mean of absolute deviations of the values from the arithmetic mean. the formula is simplified to the following equation: SDg = 1 k ∑ SD i =1 k 2 i (1. and it is always expressed in the same units as the results. It determines the mean difference between the results in the population and the arithmetic mean: D= 1 n ∑x −x i i =1 n m (1.6 Quality Assurance and Quality Control • Standard deviation is always a denominate number.9) Relative standard deviation (RSD) is obtained by dividing the standard deviation by the arithmetic mean: RSD = SD xm (1.10) Obviously.12) where k is the number of series of parallel determinations. The standard deviation of the arithmetic mean SD is calculated according to the following equation: SD = SD n (1. xm ≠ 0. If an expected value µx is known. the standard deviation is calculated according to the following formula: SD = ∑( x − µ ) i x i =1 n 2 n (1.11) The standard deviation of an analytical method SDg (general) is determined using the results from a series of measurements: SDg = 1 n−k ∑ SD ( n − 1) 2 i i i =1 k (1.

It is an absolute number. 1.Basic Notions of Statistics 7 The relationship between the mean and standard deviations for the same set of results can be presented as D < SD. The skewness coefficients are applied in comparisons to estimate the force and the direction of asymmetry. the greater asymmetry. the more slender the frequency curve and the greater the concentration of the values about the mean.5 Measures of Asymmetry A skewness (asymmetry) coefficient is an absolute value expressed as the difference between an arithmetic mean and a mode. These are absolute numbers.© 2009 by Taylor & Francis Group. usually presented in percentage points. Example 1. the greater their value. The CV is usually applied in comparing differences: • Between several populations with regard to the same characteristic • Within the same population with regard to a few different characteristics 1. The greater the value of the coefficient. give the following values: • • • • • • • • • • mean standard deviation relative standard deviation mean absolute deviation coefficient of variation minimum maximum range median mode .1 Problem: For the given series of measurement results. LLC .15) The CV is the quotient of the absolute variation measure of the investigated characteristic and the mean value of that characteristic. The CV is obtained by multiplying RSD by 100%: CV = RSD ⋅ 100% (1.6 Measures of Concentration A concentration coefficient K is a measure of the concentration of individual observations around the mean. The quartile skewness coefficient shows the direction and force of result asymmetry located between the first and third quartiles.

02 12. Formulating the null hypothesis and the alternative hypothesis The null hypothesis H0 is a simple form of the hypothesis that is subjected to tests.52 mg/dm3 12.34 12. mg/dm3: 1 2 3 4 5 6 7 8 9 10 11 12 13 Solution: Mean Standard deviation Relative standard deviation Mean absolute deviation Coefficient of variation Minimum Maximum Range Median Mode Excel file: exampl_stat01. based on probability.264 2.67 12.91 12.98 12. The alternative hypothesis is contrasted with the null hypothesis.98 mg/dm3 0.8 Data: result series.52 12.57% 12.34 12. law.79 12. assumed in order to explain some phenomenon. The plot of the testing procedure involves: 1. Statistical hypothesis testing means checking propositions with regard to a population that have been formulated without examining the whole population.34 mg/dm3 1.00 12. LLC . .98 mg/dm3 12.53 12.34 12.7 Statistical Hypothesis Testing A hypothesis is a proposition concerning a population.67 12.xls Quality Assurance and Quality Control 12.00 mg/dm3 12.32 mg/dm3 0.0257 0.48 mg/dm3 0.© 2009 by Taylor & Francis Group.12 12. or fact. A hypothesis requires testing.

Determination of the level of significance α Errors made during verification: Type I error — incorrectly rejecting the null hypothesis H0 when it is true. Statistica). It means that the value of the calculated test parameter is greater than the critical value of the test (read from a relevant table). according to the procedure of the selected test and are the basis for the calculation of the test statistic. In this case.© 2009 by Taylor & Francis Group. the conclusion that the null hypothesis may be true. Determining the critical region of a test The size of the critical region is determined by any low level of significance α. the null hypothesis H0 is rejected. The tests are constructed with the assumption that the CDF is known for the parent population.Basic Notions of Statistics 9 2. Nowadays. It means that the value of the calculated parameter is not greater than the critical value of the test (read from a relevant table). Calculation of a test’s parameter using a sample The results of the sample are processed in an appropriate manner. The basic classification of a statistical test divides tests into parametric and nonparametric ones. Otherwise. Conclusion The test statistic. 5. Type II error — accepting the null hypothesis H0 when it is false. the null hypothesis is not rejected. 3. Usually. If the calculated p value is smaller than the α value ( p < α). hence. . the procedure is limited to calculating the parameter p for a given set of data. is compared with the critical value of the test: −− If the value falls within the critical region. the goodness of fit in two populations.. it means that there is not enough evidence to reject the null hypothesis. 6. and its location is determined by the alternative hypothesis. statistical hypothesis testing is usually carried out using various pieces of software (e. after selecting an appropriate statistical test. 4. then the null hypothesis should be rejected as false. and the randomness of sampling. Nonparametric tests are used to test various hypotheses on the goodness of fit in one population with a given theoretical distribution. they are used to test propositions concerning arithmetic mean and variance. The p value is then compared with the assumed value of the level of significance α. Parametric tests serve to verify parametric hypotheses on the distribution parameters of the examined characteristic in a parent population.g. LLC . The choice of an appropriate test The test serves to verify the hypothesis. determined using the sample. −− If the value is outside the critical region.

application. Their description.1 Confidence Interval Method [3] Test Aim Requirements Confidence interval method Test whether a given set of results includes a result(s) with a gross error • set size 3–10 • unbiased series — an initially rejected uncertain result • only one result can be rejected from a given set Exclude from a set of results the result that was initially recognized as one with a gross error. and the values of xm and SD are calculated again. LLC . n is the entire size of a series. otherwise. various statistical tests can be used. . • set size 3–10 • unbiased series — an initially rejected doubtful result • only one result can be rejected from a given set Exclude from a set of results the result that was initially recognized as one with a gross error. If an uncertain result falls outside the limits of the confidence interval. xm the mean value for the unbiased series. and inference based on these tests are presented below. Appropriate tables with critical values for individual tests are given in the attachments at the end of the book (Appendix).16) Course of action Inference where xm is the mean for an unbiased series. together with an uncertain result. read for f = n – 2 degrees of freedom (Table A.© 2009 by Taylor & Francis Group. SD is the standard deviation for an unbiased series.10 Quality Assurance and Quality Control 1. it is compensated for in further calculations. tcrit is the critical parameter of the Student’s t test.17) Requirements Course of action where xi denotes uncertain result.8. Calculate the value of the parameter tcalc according to the following formula: tcalc = xi − x m SD (1.8 Statistical Tests During the processing of analytical results. 1. and SD the standard deviation for the unbiased series. Appendix).1. Calculate the endpoints of the confidence interval for a single result based on the following formula: g = x m ± tcrit n SD n−2 (1. it is rejected.

wα is the critical parameter determined for the number of degrees of freedom f = n – 2 (Table A. for α = 0.1. otherwise. and n is total number of a series. Requirements Course of action Inference .20) where xm denotes the mean for the biased series. SD is the standard deviation for the unbiased series. • set size >10 • biased series Calculate the endpoints of the confidence interval for an individual result using the formula: g = x m ± kα ⋅ SD (1. read for f = n – 2 degrees of freedom (Table A.65. together with an uncertain result. then the initially rejected result is included in further calculations and xm and s are calculated again. Appendix). tcrit is the critical parameter of the Student’s t test.01. kα = 1. from a normal distribution table: for α = 0. If tcalc ≤ tcrit(corr). kα is the confidence coefficient for a given level of significance α. Appendix). it is rejected and xm and SD are calculated again.05.Basic Notions of Statistics 11 Compare the value of tcalc with the critical value calculated according to the formula: tcrit (corr ) = tcrit ⋅ n n−2 (1. SD is the standard deviation for the unbiased series. If the uncertain result(s) falls outside the endpoints of the determined confidence interval. it is rejected and xm and SD are calculated again.18) Inference where n is the entire size of a series. If the uncertain result falls outside the endpoints of the determined confidence interval.© 2009 by Taylor & Francis Group.33. kα = 2. the initially rejected result is considered to have a gross error.2.19) Requirements Course of action Inference where xm is the mean for the biased series. • set size 3–10 • unbiased series — an initially rejected uncertain result • only one result can be rejected from a given set Calculate the endpoints of the confidence interval for an individual result using the formula: g = x m ± wα ⋅ SD (1. LLC .

© 2009 by Taylor & Francis Group. it is rejected.3. and z is the coefficient from the table for a given level of confidence α and n parallel measurements and f degrees of freedom (Table A. and xm and SD are calculated again. kα = 2. If the uncertain result falls outside the endpoints of the determined confidence interval. from a normal distribution table: for α = 0.2 Critical Range Method [3] Test Aim Requirements Course of action Critical range method Test whether a given set of results includes a result(s) with a gross error • set size >10 • known value of the method’s standard deviation — SDg Calculate the value of the range result according to the formula: R = xn – x1 Calculate the value of the critical range according to the formula: Rcrit = z ⋅ SDg (1.12 Quality Assurance and Quality Control Requirements Course of action • set size >10 • unbiased series — an initially rejected uncertain result • known value of the method’s standard deviation Calculate the endpoints of the confidence interval for an individual result using the formula: g = x m ± kα ⋅ SDg n n −1 (1. LLC . kα = 1. If R > Rcrit.21) Inference where xm is the mean for the unbiased series. the extremum result is rejected and the procedure is conducted anew. it is included in the series. Appendix). with n determinations in each series (most often. k ≥ 30) Inference Requirements .33. kα is the confidence coefficient for a given level of significance α.05. n = 2 or 3.65.22) where SDg is the standard deviation of the method. otherwise. 1. SDg is the standard deviation of the method. for α = 0.01. • known value of the mean range for the series — Rm • known results of k series of parallel determinations.8.

If one of the calculated parameters exceeds the critical value Qcrit. 1. read for the selected level of significance α and the number of degrees of freedom f = n.25) Course of action Inference Compare the obtained values with the critical value Qcrit (Table A. If Ri > Rcrit.© 2009 by Taylor & Francis Group. H1: In the set of results there is a result with a gross error. Calculate the value of the range R according to the formula: R = Xn − x1.8. the authors use a certain type of Dixon’s Q test that makes it possible to test a series comprising up to 40 results.24) Inference where zα is the coefficient from a table for a given level of confidence α and n parallel measurements in a series (Table A. . then the result from which it was calculated (xn or x1) should be rejected as a result with a gross error and only then should xm and SD be calculated. Calculate the value of parameters Q1 and Qn according to the formulas: Q1 = x 2 − x1 R Qn = x n − x n−1 R (1. .4. . the ith series of the measurement results is rejected. xn.3 Dixon’s Q Test [3. Appendix). In some studies [1]. 4] Test Aim Hypotheses Requirements Dixon’s Q test Test whether a given set of results includes a result with a gross error H0: In the set of results there is no result with a gross error. LLC . Appendix). . .Basic Notions of Statistics 13 Course of action Calculate the value of the range for each series according to the formula: Ri = x ni − x1i (1.23) Calculate the value of the critical range according to the formula: Rcrit = zα ⋅ Rm (1. • set size 3–10 • test whether a given set of results includes a result with a gross error Order the results in a nondecreasing sequence: x1.5.

xn. .27) Requirements Course of action Compare the obtained values with the critical value Qcrit (Table A. • set size 3–7 • test whether a given set of results includes a result with a gross error Order the results as a nondecreasing sequence: x1. Calculate the value of parameters Q1 and Qn according to the formulas: Q1 = x 2 − x1 R Qn = x n − x n−1 R (1. read for the selected level of significance α and the number of degrees of freedom f = n. . LLC . . .14 Quality Assurance and Quality Control Test Aim Hypotheses Requirements Course of action Dixon’s Q test Test whether a given set of results includes a result with a gross error H0: In the set of results there is no result with a gross error.6. • set size 8–12 • test whether a given set of results includes a result with a gross error Order the results as a nondecreasing sequence: x1. . .28) . Calculate the value of parameters Q1 and Qn according to the formulas: Q1 = x 2 − x1 x n−1 − x1 Qn = x n − x n−1 xn − x2 (1. Appendix). . • set size > 12 • test whether a given set of results includes a result with a gross error Order the results as a nondecreasing sequence: x1. . read for the selected level of significance α and the number of degrees of freedom f = n. xn. H1: In the set of results there is a result with a gross error. .26) Requirements Course of action Compare the obtained values with the critical value Qcrit (Table A.© 2009 by Taylor & Francis Group. Appendix). Calculate the value of parameters Q1 and Qn according to the formulas: Q1 = x3 − x1 x n− 2 − x1 Qn = x n − x n− 2 x n − x3 (1. . Calculate the value of the range R according to the formula: R = Xn − x1.6. . . xn.

then it may be inferred that the compared values of the standard deviation differ in a statistically significant manner — rejection of H0. read for the selected level of significance α and the number of degrees of freedom f = n. Inference . H1: The variance calculated for the series of results is different from the set value in a statistically significant manner.8. Calculate the chi square test parameter χ2 according to the formula: χ2 = n ⋅ SD 2 2 SDo (1. If one of the calculated parameters exceeds the critical value Qcrit.4 Chi Square Test [3] Test Aim Hypotheses Chi square (χ2) test Test if the variance for a given series of results is different from the set value H0: The variance calculated for the series of results is not different from the set value in a statistically significant manner. LLC . Appendix).Basic Notions of Statistics 15 Inference Compare the obtained values with the critical value Qcrit (Table A. 2 Compare the calculated value χ2 with the critical value χcrit for the assumed level of significance α and the calculated number of degrees of freedom f = n – 1 (Table A. If the calculated χ2 value does not exceed the critical value 2 ( χ 2 ≤ χcrit ). • normal distribution of results in a series Calculate the standard deviation for the series of results.© 2009 by Taylor & Francis Group. Appendix). and n is the number of results in an investigated set.29) Requirements Course of action where SD is the standard deviation calculated for the set of results. then it may be inferred that the calculated value of the standard deviation does not differ in a statistically significant manner from the set value — acceptance of H0. SDo is the set value of the standard deviation. 1.6.7. If the calculated χ2 value is greater than the critical value read 2 from the tables ( χ 2 > χcrit ). then the result from which it was calculated (xn or x1) should be rejected as a result with a gross error and only then should xm and SD be calculated.

5] Test Aim Hypotheses Snedecor’s F test Compare the standard deviations (variances) for two sets of results H0: The variances calculated for the compared series of results do not differ in a statistically significant manner. 1. Appendix). Calculate the Snedecor’s F test parameter according to the formula: n1 ⋅ SD12 n1 − 1 F= n2 2 ⋅ SD2 n2 − 1 Requirements Course of action (1. then it may be inferred that the calculated values for the standard deviation do not differ in a statistically significant manner — acceptance of H0.16 Quality Assurance and Quality Control 1. Note that the value of the expression should be constructed in such a way so that the numerator is greater than the denominator — the value F should always be greater than 1. If the calculated F value does not exceed the critical value (F ≤ Fcrit). SD2 denote the standard deviations for the two sets of results. LLC . n2 are the number of results for two sets.8.8.6 Hartley’s Fmax Test [3] Test Aim Hartley’s Fmax test Compare the standard deviations (variances) for many sets of results .30) Inference where SD1. Compare the calculated value with the critical value for the assumed level of significance α and the calculated number of freedom degrees f1 and f2 (where f1 = n1 – 1 and f2 = n2 – 1) (Table A. then it may be inferred that the compared values of the standard deviation differ in a statistically significant manner — rejection of H0.5 Snedecor’s F Test [3. If the calculated F value is greater than the critical value read from the tables (F > Fcrit).© 2009 by Taylor & Francis Group. 4.8. • normal distributions of results in a series Calculate the standard deviations for the compared series of results. and n1. H1: The variances calculated for the compared series of results differ in a statistically significant manner.

Calculate the value of the Fmax test parameter according to the formula: Fmax = 2 SDmax 2 SDmin (1. If the calculated Fmax value is greater than the critical value read from the tables (Fmax > Fmaxo). If the calculated Fmax value does not exceed the critical value (Fmax ≤ Fmaxo). 1. and the number of the compared series k (Table A. then it may be inferred that calculated standard deviations do not differ in a statistically significant manner — acceptance of H0. • the number of results in each series of the sets is greater than 2 Requirements . H1: The variances calculated for the compared series of results differ in a statistically significant manner. then it may be inferred that the compared standard deviations differ in a statistically significant manner — rejection of H0. • normal distributions of results in a series • numbers of results in each series of the sets greater than 2 • set sizes are identical • the number of series not greater than 11 Calculate the standard deviations for the compared series of results.Basic Notions of Statistics 17 Hypotheses Requirements Course of action H0: The variances calculated for the compared series of results do not differ in a statistically significant manner.9.7 Bartlett’s Test [3] Test Aim Hypotheses Bartlett’s test Compare the standard deviations (variances) for many sets of results H0: The variances calculated for the compared series of results do not differ in a statistically significant manner.31) Inference where SDmax.© 2009 by Taylor & Francis Group. Compare the calculated value with the critical value of the parameter for the assumed level of significance α. LLC . SDmin are the greatest and smallest value from the calculated standard deviations for the sets of results. H1: The variances calculated for the compared series of results differ in a statistically significant manner.8. the calculated number of degrees of freedom f = n – 1. Appendix).

ni is the number of parallel determinations in a given series. LLC .34) where n is the total number of parallel determinations.32) in which: c = 1+ 1 3 k −1 2 1 1 − ( ) ∑ n −1 n − k i =1 k i k (1. H1: The variances calculated for the compared series of results differ in a statistically significant manner.7.8 Morgan’s Test [3] Test Aim Hypotheses Morgan’s test Compare standard deviations (variances) for two sets of dependent (correlated) results H0: The variances calculated for the compared series of results do not differ in a statistically significant manner. and SDi is the standard deviation for the series i. Inference 1.© 2009 by Taylor & Francis Group.8. Calculate the value of a Q test parameter according to the formula: Q= 2 2. k is the number of the compared method (series). If the calculated Q value does not exceed the critical value 2 (Q ≤ χcrit ). • number of results in each series of the sets is greater than 2 Requirements . then it may be inferred that the calculated standard deviations do not differ in a statistically significant manner — acceptance of H0.303 n − k log SD o − c ( ) ∑ ( n − 1) log ( SD ) i 2 i i =1 k (1. 2 Compare the calculated value with the critical value of χcrit parameter for the assumed level of significance α and the calculated number of degrees of freedom f = k – 1 (Table A. If the calculated Q value is greater than the critical value read 2 from the tables (Q > χcrit ).18 Quality Assurance and Quality Control Course of action Calculate the standard deviation for the compared series of results. Appendix).33) SD o = 1 n−k ∑ SD ( n − 1) 2 i i n =1 (1. then it may be inferred that the compared standard deviations differ in a statistically significant manner — rejection of H0.

Compare the calculated t value with the critical value tcrit. 4] Test Aim Hypotheses Student’s t test Compare means for two series (sets) of results H0: The calculated means for the compared series of results do not differ in a statistically significant manner.1. 1. x2i denote the individual values of results for the compared sets.36) Calculate the value of parameter t according to the formula: t= (1 − L )( k − 2) L (1. LLC .8.© 2009 by Taylor & Francis Group. . If the calculated t value does not exceed the critical value tcrit.9 Student’s t Test [3. Appendix). so that the relation t ≤ tcrit is satisfied. H1: The calculated means for the compared series of results differ in a statistically significant manner. then it may be inferred that the compared standard deviations differ in a statistically significant manner — rejection of H0. then it may be inferred that the calculated standard deviations do not differ in a statistically significant manner — acceptance of H0. Calculate the regression coefficient r according to the formula: k r= k ∑x x −∑x ∑x 1i 2 i 1i i =1 i =1 i =1 k k k 2i 2 ∑ i =1 k 2 x1 i − ∑ i =1 k x1i 2 k ∑ i =1 k 2 x2 i − ∑ i =1 k x 2i (1. and x1i. a parameter for the assumed level of significance α and the calculated number of degrees of freedom f = k – 2 (Table A.35) Calculate the value of test L parameter according to the formula: L= ( 2 4 SD12 SD2 1− r2 2 SD12 + SD2 ) 2 ( ) 2 − 4r 2 SD12 SD2 (1.37) Inference where k is the number of pairs of results.Basic Notions of Statistics 19 Course of action Calculate the standard deviations for the compared series of results. If the calculated t value is greater than the critical value read from the tables (t > tcrit).

Section 1.39) Test Aim Hypotheses Requirements Course of action where xm is the mean calculated for the set of results.g. then it is inferred that the compared means differ in a statistically significant manner — rejection of H0. .38) Inference where x1m . If the calculated t value is greater than the critical value read from the tables (t > tcrit). LLC . • normal distribution of results in a series • the number of results in a series of sets is greater than 2 Calculate the mean and standard deviation for the series of results. μ is the reference (e. Student’s t test Compare the mean with the assumed value H0: The calculated mean does not differ in a statistically significant manner from the assumed value. Appendix). and SD1. Compare the calculated value with the critical value of a parameter for the assumed level of significance α and the calculated number of degrees of freedom f = n1 + n2 – 2 (Table A. Calculate the Student’s t test parameter according to the equation: t= xm − µ SD n (1. SD is the unit of deviation.20 Quality Assurance and Quality Control Requirements Course of action • normal distributions of results in a series • number of results in each series of the sets greater than 2 • insignificant variance differences for the compared sets of results (Snedecor’s F test. x2m denote the means calculated for the two compared sets of results.© 2009 by Taylor & Francis Group. SD2 are the standard deviations for the sets of results. If the t value does not exceed the critical value tcrit (t ≤ tcrit).. certified value). Calculate the Student’s t test parameter according to the equation: t= (x − x ) ( n − 1) SD + ( n − 1) SD 1m 2m 1 2 1 2 n1n2 n1 + n2 − 2 n1 + n2 ( 2 2 ) (1.1.5) Calculate the means and standard deviations for the series of results. then it may be inferred that the obtained means do not differ in a statistically significant manner — acceptance of H0. H1: The calculated mean differs in a statistically significant manner from the assumed value.8.

If the t value does not exceed the critical value tcrit (t ≤ tcrit). and n is the number of results..40) (1. it is inferred that the mean is different from the set value in a statistically significant manner — rejection of H0. for which the standard deviations (variances) differ in a statistically significant manner H0: The calculated means for the compared series of results do not differ in a statistically significant manner. • normal distribution of results in a series • the number of results in a series of sets is greater than 2 Calculate the means and standard deviations for the compared series of results.42) . x2m denote the means calculated for the two compared sets of results. Calculate the value of parameter C according to the formula: in which: z1 = 2 SD12 SD2 . Appendix).41) where x1m. and SD1.8. 1. the standard deviation of the set of results which the mean was calculated based on. Calculate the critical value of the parameter C (Ccrit) according to the formula: Ccrit = z1t1 + z2t2 z1 + z2 (1. H1: The calculated means for the compared series of results differ in a statistically significant manner. LLC . Compare the calculated value with the critical value of a parameter for the assumed level of significance α and the calculated number of degrees of freedom f = n – 1 (Table A.1.Basic Notions of Statistics 21 Inference e.10 Cochran-Cox C Test [3] Test Aim Cochran-Cox C test Compare the means for the series of sets of results.g. then it may be inferred that the obtained mean is not different from the set value in a statistically significant manner — acceptance of H0. SD2 are the standard deviations for the sets of results. and z2 = n1 − 1 n2 − 1 Hypotheses Requirements Course of action C= x1m − x 2 m z1 + z2 (1.© 2009 by Taylor & Francis Group. If the calculated t value is greater than the critical value read from the tables (t > tcrit).

8. the number of degrees of freedom. Compare the calculated C value with the calculated critical value Ccrit.45) . Appendix). then it is inferred that the obtained means differ from one another in a statistically significant manner — rejection of H0. Calculate the values of expressions described using the following equations: ν= x1m − x 2 m 2 SD12 SD2 + n1 n2 Hypotheses Requirements Course of action (1.22 Quality Assurance and Quality Control Inference where t1 and t2 denote the critical values read from the tables of the Student’s t distribution (Table A. for f1 = n1 – 1 and f2 = n2 – 1. then it may be inferred that the obtained mean values do not differ from one another in a statistically significant manner — acceptance of H0.1. respectively. and the level of significance. If the calculated C value is greater than the calculated critical value (C > Ccrit). If C does not exceed Ccrit (C ≤ Ccrit).43) SD12 n1 c= 2 SD12 SD2 + n1 n2 2 SD12 SD2 < n1 n2 (1. • normal distribution of results in a series • the number of results in a series of sets is greater than 6 Calculate the means and standard deviations for the compared series of results.© 2009 by Taylor & Francis Group. H1: Calculated means for the compared series of results differ in a statistically significant manner.11 Aspin-Welch Test [3] Test Aim Aspin-Welch test Compare the means for the series of sets of results for which the standard deviations (variances) differ in a statistically significant manner H0: Calculated means for the compared series of results do not differ in a statistically significant manner.44) in which (1. LLC . 1.

.© 2009 by Taylor & Francis Group.12 Cochran’s Test [6] Test Aim Cochran’s test Detection of outliers in a given set — intralaboratory variability test One-sided test for outliers — the criterion of the test examines only the greatest standard deviations • the number of results in a series (set) greater than or equal to 2. and the calculated values of c. then it may be inferred that the obtained means do not differ from one another in a statistically significant manner — acceptance of the hypothesis H0.8. it is inferred that the obtained means differ from one another in a statistically significant manner — rejection of the hypothesis H0. f 2.10.Basic Notions of Statistics 23 Inference where x1m . Appendix). f1. but only when the number of compared laboratories is greater than 2 • sets of results (series) with the same numbers • it is recommended to apply the tests before Grubbs’ test (Section 1.46) 2 i where SDmax is the maximum standard deviation in the investigated set (among the investigated laboratories). and thus νo (α. Compare the calculated value ν with the critical value νo for the corresponding level of significance α. 1. SD2 are the standard deviations for the sets of results. x2m denote the means calculated for the two compared sets of results. f 2 = n2 – 1.8. and SD1. If the value of ν does not exceed the critical value νo (ν ≤ νo ). If the calculated v value is greater than the calculated critical value (ν > νo ).13) Calculate the standard deviations for each of the compared sets of results. Calculate the value of parameter C using the formula: C= 2 SDmax Requirements Course of action ∑ SD i =1 p (1. and p is the number of standard deviations (the number of compared laboratories). LLC . c) (Table A. the number of degrees of freedom f1 = n1 – 1. SDi is the standard deviation for a given series (data from a laboratory).

then the investigated result is considered correct. the number of results in a series. it enables the detection of one outlier. and p the number of laboratories (Table A. p in an increasing sequence.24 Quality Assurance and Quality Control Inference Compare the calculated C value with the critical value for a given n value. Appendix). but only when the number of compared laboratories is greater than 2 • the same number of results in the sets (series) of results • it is recommended to apply this test before Cochran’s test (Section 1.47) Course of action Inference where xp is the value in the set of results considered to be an outlier.© 2009 by Taylor & Francis Group.13 Grubbs’ Test [6.12.05 and less than or equal to the critical value corresponding to the level of significance α = 0. . If the value of the test parameter is greater than the critical value corresponding to the level of significance α = 0. 7] Test Aim Requirements Grubbs’ test Detect outliers in a given set — interlaboratory variability test • the number of results in a series (set) is greater than or equal to 2. then the investigated result is considered an outlier.01.01.11.8. then the investigated result is considered correct. and SD is the standard deviation.8. If the numerical value of a respective test parameter is greater than the critical value corresponding to the level of significance α = 0. then the investigated result is an uncertain value. . 2. 1. Order the set of data xi for i = 1. the number of laboratories (Table A. xm is the mean. If the value of the calculated test parameter is less than or equal to the critical value corresponding to the level of significance α = 0. Appendix). thus it should be repeated until no outliers are observed in the remaining results Calculate the standard deviation for the set of results.05. Compare the calculated value Gp with the critical value for a given p value. . LLC . Calculate the value of parameter Gp according to the relation: Gp = (X p − Xm ) SD (1. If the value of the calculated test parameter is less than or equal to the critical value corresponding to the level of significance α = 0.05. .12) • with a single use. .

but only when the number of compared laboratories is greater than 2 • the same number of results in the sets of results (series) • it is recommended to apply this test before Cochran’s test (Section 1.1) = ∑( x − x ) m (1.01.50) SD(22. two (the greatest or the smallest) results may be rejected from the set of results Order the set of data xi for i = 1. .2 ) 2 . p ) ) . . or 2 (1. 2. If the value of the test parameter is greater than the critical value corresponding to the level of significance α = 0. and less than or equal to the critical value corresponding to the level of significance α = 0. Test Aim Requirements Grubbs’ test Detect outliers in a given set — interlaboratory variability test • the number of results in a series (set) is greater than or equal to 2. p in an increasing sequence.48) Calculate the values of parameters xm( p –1. then the investigated result is considered an outlier. p) = ∑( x − x i i =1 p i i =3 p− 2 m ( p−1. . and the course of action should be continued until there are no more outliers in the set of results.2) according to the equations: SD(2p−1.01. p) when testing two of the highest results or xm(1. according to the equations: x m ( p−1. . p) = 1 p −1 ∑ i =1 p− 2 xi . p) or SD(1.12) • in a given course of action. after rejection of this value from the set of results.2) for two of the lowest results.05. Calculate the values of parameter SDo according to the equation: SD = 2 o Course of action ∑( x − x ) i m i =1 p 2 (1.Basic Notions of Statistics 25 If the numerical value of a corresponding test parameter is greater than the critical value corresponding to the level of significance α = 0.2) = 1 p −1 ∑x i i =3 p (1. the test for the series of p – 1 results may be conducted again.49) Calculate the values of respective parameters: SD( p –1. or x m (1. then the investigated result is an uncertain value.© 2009 by Taylor & Francis Group.8. LLC .

5 ⋅ Me ri . Compare the values of |ri| with 4. If the value of the calculated test parameter is less than or equal to the critical value corresponding to the level of significance α = 0. after rejection of these values from the set of results. Calculate the median Me for all the results xi. Calculate the deviations of ri from the median for each result using the formula: ri = xi − Me ( ) (1. Appendix).01. p) 2 SDo . and the course of action should be continued until there are no more outliers in the set of results.8.51) Inference Compare the calculated value of G with the critical value for a given p value. Calculate the median deviations Me ri . then the investigated results are considered correct. or G = SD(2 1. Order the values of |ri| in an increasing sequence.52) Inference Calculate the absolute values |ri|. Test Aim Requirements Course of action Hampel’s test Detect outliers in a given set • the number of results in a series (set) is greater than 2 Order the values in an increasing sequence.05 and less than or equal to the critical value corresponding to the level of significance α = 0. then the investigated results are considered outliers. If the following condition is satisfied ri ≥ 4. If the numerical value of a corresponding test parameter is greater than the critical value corresponding to the level of significance α = 0.05.5 ⋅ Me ri (1. . the test for the series of p – 2 results may conducted again. where xi includes the interval from x1 to xn. If the value of a test parameter is greater than the critical value corresponding to the level of significance α = 0.01. 1.14 Hampel’s Test The Hampel test by some authors is called Huber’s test [8.2 ) 2 SDo (1.12.53) then the result xi is considered an outlier.© 2009 by Taylor & Francis Group. the number of laboratories (Table A. LLC . then the investigated results are uncertain.26 Quality Assurance and Quality Control Calculate the value of parameter G according to the equations: G= SD(2p−1. 9].

xref is the reference value. If En > 1. a result is considered satisfactory.8. .55) where u( xref ) is the standard uncertainty of the accepted value/ reference value. and SD is the deviation unit: The standard deviation calculated using all the values in a set. the estimation is unsatisfactory.16 En Score [10. 11] Test Aim Z score Detect uncertain results and outliers Applied during the processing of results of interlaboratory comparisons • the number of results in a series (set) is greater than 2 Calculate the Z score using the formula: Z= x lab − x ref SD (1. LLC . and u( xref ) the combined standard uncertainty of the reference values.57) where x lab is the value obtained by a given laboratory.8. Inference If Z ≤ 2. 11] Test Aim Requirements Course of action En score Estimation of results of interlaboratory comparisons • the number of results in a series (set) is greater than 2 Calculate En score using the formula: En = xlab − xref u(2xlab ) + u(2xref ) (1. xref is the assumed value/the reference value.54) Requirements Course of action where xlab is result obtained by a given laboratory. the estimation is satisfactory. a result is considered unsatisfactory. The modified standard deviation calculated using the relation: SDmod = SD 2 + u(2xref ) (1. 1.Basic Notions of Statistics 27 1. If Z ≥ 3.© 2009 by Taylor & Francis Group. Combined standard uncertainty calculated using the relation: u = u(2xlab ) + u(2xref ) (1. a result is considered uncertain.56) where u( xlab ) is the standard uncertainty of a value obtained by a given laboratory. If 2 < Z < 3 . Inference If En ≤ 1. u( xlab ) is the combined standard uncertainty result obtained by a given laboratory.15 Z Score [10.

Mandel’s k Determine the interlaboratory traceability of results • the number of results in a series (set) is greater than 2 Calculate the standard deviations SDi for each series of results for each laboratory. Calculate the values of parameter ki for a given series and for a given laboratory.01 or 0.28 Quality Assurance and Quality Control 1. corresponding to the Mandel h coefficients for a given level of significance (α = 0. according to the formula: hi = x mi − x m 1 ( p − 1) ∑ (x i =1 p − x m )2 (1.05) (Table A. On the graph of the values of parameter h. according to the formula: ki = SDi p Test Aim Requirements Course of action ∑ SDi2 (1. 12. 13] Test Aim Requirements Course of action Mandel’s h Determine the interlaboratory traceability of results • the number of results in a series (set) is greater than 2 Calculate the means xmi for each series of results for each laboratory.17 Mandel’s Test [6. mark the horizontal lines to test the data’s configuration.58) i where ni is the number of results for a given series obtained by a given laboratory.60) .59) mi Inference Make a graph of the values of parameter hi for each series in the sequence of laboratories. Calculate the values of parameter hi for a given series and for a given laboratory. and p is the number of laboratories. LLC . Appendix). Calculate the mean for results from a given series according to the formula: xm = ∑n ⋅ x i i =1 p mi ∑n i =1 p (1.13a or Table A.13b.8. The value of parameter hi greater than h needs to be checked from an analytical viewpoint.© 2009 by Taylor & Francis Group.

If the λn value does not exceed the critical value λα (λn ≤ λα ).13b.05) (Table A. The value of parameter ki bigger than k value needs to be checked from an analytical viewpoint.14. and Dn1n2 is the greatest value of differences between empirical distribution functions. according to the formula: λn = n1n2 Dn n n1 + n2 1 2 (1. Appendix). LLC . It enables fast and simple . On the graph of the values of parameter k. Calculate the values of parameter λn. 1.13a or Table A. 1.Basic Notions of Statistics 29 Inference Make a graph of the values of parameter ki for each series in the sequence of laboratories. 14] Test Aim Requirements Course of action Kolmogorov-Smirnov test Compare the distribution of two series of results • two series of results Calculate the empirical distribution functions for each series of results. Compare the λn value with critical value — λα for a given level of significance (Table A. Appendix).8. then it may be inferred that there are no statistically significant differences in distribution functions for both compared series. corresponding to the Mandel k coefficients for a given level of significance (α = 0. If the λn value does exceed the critical value λα (λn > λα ). This method of monitoring and regulating processes is a graphic procedure minimizing the number of necessary numerical operations and allowing systematic monitoring of the course of the process being subjected to control. the most frequently used charts are Shewhart charts.61) Inference where n1. mark the horizontal lines to test the data’s configuration.18 Kolmogorov-Smirnov Test [2. n2 denote the number of results for a given series.01 or 0. then it may be inferred that there are statistically significant differences in distribution functions for both compared series.© 2009 by Taylor & Francis Group.1 Shewhart Charts Control charts are used to test the stability of research results conducted in a given laboratory.9 Control Charts 1.9. In practice.

Limits of ±2SD are also marked. and the values of the observed characteristics (the mean) on the y-axis.. Mark the obtained measurement results for 20 consecutive samples.9.2 Shewhart Chart Preparation Preparation of a chart depicting mean and standard deviation (xm – SD) will be described as an example. or in other words the upper and lower warning limits. however. that is.© 2009 by Taylor & Francis Group. when a point appears outside the control limits ±3SD. • Test the hypothesis about a statistically insignificant difference between the obtained mean and the expected value using Student’s t test (Section 1. but the results obtained for control samples should be marked parallel to the received results for the investigated samples: . expressed either in time (e. The measurement is obtained from a series of measurement results obtained at approximately regular intervals. respectively). one line on either side of the central line. every hour) or quantity (e. after the initial rejection of outliers. therefore. The main role is played by an appropriate control chart. and thus fast correction and confirmation of the reliability of the research.g. hence. Limits of ±3SD (so-called action limits) show that approximately 99. • If the hypothesis is not rejected. The course of action in preparing the control chart is as follows: • Conduct 10–20 measurements for a standard sample. usually a graph with control limits depicted.g.7% of the values fall in the area bounded by the control lines. On such a graph. charts are prepared separately for each procedure.9). it is recommended that action be taken on the chart. both values should be determined for the unbiased series.. every batch). provided that the process is statistically ordered. The possibility of transgressing the control limits as a result of random incident is insignificantly small. and two statistically determined control limits. the values of a certain statistics measurement are registered.8. where SD is the standard deviation of the investigated characteristics. start preparation of the first chart: Mark the consecutive numbers of result determinations on the x-axis of the graph. the occurrence of any value from a sample falling outside these limits is simply warning about a possible transgression of the control limits. the upper and lower control limits (UAL and LAL. Mark a central line CL on the graph corresponding to the reference values of the presented characteristic.30 Quality Assurance and Quality Control detection of abnormalities in the configuration of the marked points. 1. LLC . • Calculate the mean xm and the standard deviation SD. Both the upper and lower limits on the chart are found within ±3SD from the central line. the limits of ±2SD are called warning limits (UWL and LWL).

If the mean values differed only in a statistically significant manner. −− Ten consecutive measurement points being found on the same side of the mean value. testing whether the process is not changing and remains statistically regulated. If a value marked on the chart falls outside any of the control limits or the series of values reflects unusual configurations. LLC . it is necessary to compare the mean obtained for test samples with the expected value. the process is not statistically regulated. but within the action limits. albeit the comparison should always involve two last charts. −− There exist three other signs indicating the occurrence of a problem in the analyzed arrangement. a new mean is calculated for the next chart as the arithmetic mean for the compared chart. not more often than two results per 20 determinations. If the standard deviations differ in a statistically significant manner. −− Two subsequent measurement points being outside warning limits. −− The occurrence of results between the warning limits and action limits is also acceptable. −− If a result for a test sample is found outside the action limits. then a control chart is the method used for continuously testing the statistical null hypothesis. In this situation. . Once the cause has been located and eliminated. it is considered satisfactory. For each new chart.5).8.© 2009 by Taylor & Francis Group. If the process is statistically regulated. calibration should be carried out again. and a new chart is prepared for the newly calculated values of xm and SD. a new chart should be prepared for parameters identical to those in the compared chart. but in the interval determined by the action limits. or seven consecutive results create a trend (decreasing or increasing). the standard deviation is calculated for the next chart as the arithmetic mean of the s values for the compared charts (the mean values are compared using the Student’s t test). Otherwise. however. When the difference between these values is statistically significant. on the same side of the mean value. If the means do not differ in a statistically significant manner. the results from this series (chart) should be rejected. one should compare the standard deviations obtained for the investigated chart and those obtained for a previous chart using the Snedecor F test (Section 1. If the standard deviations do not differ in a statistically significant manner. a new chart should be prepared for the values of the penultimate chart. and the process may then be halted or corrected. the process may be resumed and continued.Basic Notions of Statistics 31 −− If a determination result is located within the warning limits. one should detect the cause. namely: −− Three consecutive measurement points occurring outside the warning limits.

22 4.21 4.00 3.36 4.40 4.1005 4.2 Problem: Draw a Shewhart chart for the 20 given measurement results obtained for the test samples.14 4.50 4.27 4.32 4.© 2009 by Taylor & Francis Group.04 4.10 4.20 4. Data: result series: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Solution: Mean SD UAL UWL LWL LAL 4.03 4. LLC .07 4.20 0. Mark the central line.32 Quality Assurance and Quality Control Example 1.22 . and the warning and action lines.17 4.30 4.32 4.23 4.34 4.11 4.90 Data 4.12 4.23 4.

40 4.90 3.11 4.50 4.12 4.20 4.00 3.33 4. LLC . Data: result series: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Data 4.32 4.30 4.44 4.80 0 5 10 15 LWL LAL 20 CL UAL UWL 33 Excel file: exampl_stat02.Basic Notions of Statistics Graph: 4.34 4.xls Example 1.23 4.© 2009 by Taylor & Francis Group.41 4.12 4.08 4.11 Conclusion ! ok ok ok ok ok ok ! ok ok ok ok ok ok ok ok ok ok ok ok .18 4.20 4.01 4.32 4.15 4.60 4.17 4.35 4.3 Problem: Mark the following data from the previous example on the chart.11 4.00 4.10 4.

10 4.21 0.60 4.34 Solution: Mean1 SD1 Mean2 SD2 UAL UWL LWL LAL Graph: 4.90 3.40 4.40 4.101 4.128 4.© 2009 by Taylor & Francis Group.xls .50 4.30 4.90 UAL UWL CL LWL LAL 15 20 Excel file: exampl_stat03.00 3.20 4.50 4.80 0 5 10 Quality Assurance and Quality Control 4. LLC .00 3.20 0.

Mean SD UAL UWL LWL LAL Graph: 4.05.111 4.20 4. the values have been calculated as the means of the two previous charts.013 For the new chart. SD Mean n/(n – 1)SD2 F Fcrit(0.011 1.22 1. and then (with variances not differing in a statistically significant way) the mean were compared using the Student’s t test.031 18 0.80 0 5 10 15 LWL LAL 20 CL UAL UWL 4.200 0.40 3. The variances were compared using the Snedecor’s F test.90 3.85 0.05.30 4.101 4.60 4.98 3.456 2.51 4.19 0.10 4.xls .4 Problem: Draw a new chart based on the data from the previous example.50 4. 19) F < Fcrit t tcrit(0. LLC .40 4. 36) t < tcrit 20 0.88 Excel file: exampl_stat04.© 2009 by Taylor & Francis Group. Series 1 Series 2 No results. 17.Basic Notions of Statistics 35 Example 1.106 4.184 0. The remaining values were used to calculate the means and the standard deviation.00 3. n Standard deviation. Solution: Values 1 and 8 have been removed from the set of data.

10 Linear Regression Linear correlation is the most frequently used correlation in analytical chemistry. To determine the functional dependency that connects the output signal with analyte concentration. a linear regression method is applied. A decisive majority of analytical measurements uses the calibration stage. LLC . The equation of the linear regression is: y = b⋅x + a (1. together with a presentation of the determination method for the calibration chart parameters. we present below the course of action for the linear regression method. b: b= ∑ ∑ xi n i =1 i =1 n n yi − n 2 ∑x y i =1 n 2 i i =1 n i i ∑ i =1 n xi − n (1. It is also applied in determining some of the validation parameters of the analytical procedure.62) where y = dependent variable (output signal of the measuring instrument) x = independent variable (concentration of the determined analyte) a = intercept b = slope The following regression parameters are calculated [3]: • Slope. a: a= ∑ y − b∑ x i i =1 i =1 n i n (1.64) . such as: • accuracy — through the determination of systematic errors • linearity • limits of detection Therefore.© 2009 by Taylor & Francis Group. in which the values of the output signal are assigned to corresponding values of analyte concentration.36 Quality Assurance and Quality Control 1.63) ∑x • Intercept value.

r: n r= n n ∑ i =1 n i =1 n xi yi − 2 ∑ ∑y xi i =1 i =1 n 2 i i =1 n n i 2 ∑ x − ∑ x 2 i i i =1 ⋅ n ∑ y − ∑ y i i =1 n (1.66) ∑ i =1 n xi • Intercept.Basic Notions of Statistics 37 • Regression coefficient. SDxy : SDxy = ∑( y − Y ) i i i =1 n 2 n−2 (1. SDb : SDb = SDxy 2 ∑ i =1 n 1 xi2 − n (1.65) • Values of standard deviations for: • Slope.68) where: n = number of independent determination results for the standard solution samples from which the calibration curve has been determined yi = the value determined experimentally Yi = the value calculated from the determined regression equation . SDa: SDa = SDxy n ∑x i =1 n 2 i n ∑ i =1 n xi2 − ∑ i =1 xi 2 (1.© 2009 by Taylor & Francis Group.67) • Residuals. LLC .

2 then it should be presented with one digit after the decimal point: 375. If a result is a product of the following numbers: 11.23 15. That digit and all the subsequent digits are called significant.4 × 102 .1200 507. A value obtained from a calculation(s) should be recorded in an appropriate way. the number should be “read” from left to right until reaching the first digit that is not zero. the value of a result should be presented with the same number of digits after the decimal point as the value with the fewest number of digits after the decimal point. the significant digits are underlined: 230.8 For multiplication and division. if a result is the sum of numbers: 11.2 Then it should be presented with three significant digits: 73. strictly dependent on the notation of the values applied in the calculation(s).2113 0.80 0.38 Quality Assurance and Quality Control 1.11 Significant Digits: Rules of Rounding A problem with correct notation of the measurement results is usually associated with issues related to significant digits and the rules of rounding.© 2009 by Taylor & Francis Group.23 15.2113 0. For example.123 349. LLC . To determine how many significant digits there are in a number.0010823 20.63 × 104 34.546 0.123 349. Significant digits in the decimal notation of a given number are all the digits without initial zeros. the number of significant digits in a result should be the same as in the value with the fewest significant digits. In the example below.70 Calculations very often use values with different numbers of significant digits and different number of digits after the decimal point. After addition or subtraction.

. and Uytterhoeven M. Doerffel.P. 6.. “Spectrometric determination of silicon in food and biological samples: an interlaboratory trial.” Accred. 13.. V.. ISO 5725-2:1994. 1977 (in Polish). Assur..” Warszawa. Krska. Soares. Van Grieken. L. A.: Zygmunt B. Willemyns. 1982 (in Polish). H.. Assur. H. Cortez. P. 1989 (in Polish). At. 9. L. R. 7. Kozłowski. 11. Van Cauwenbergh. L.. Aut.. 2001 (in Polish). Anal. Verheyen....” Instytut Medycyny Pracy im.. Arnaud. WNT.. Bożyk.. 1979 (in Polish).© 2009 by Taylor & Francis Group. De Vos. Czermiński. WNT.. “Statystyczne kryteria oceny wyników i metod analitycznych w: Bobrański B. Linsinger.. S.. R.... 2004 (in Polish).” Accred. Hoenig.E. “Optymalizacja eksperymentu w chemii i technologii chemicznej.B.. i tłum. “Statistical evaluation of interlaboratory tests. “Metody statystyczne w badaniu jakości produktów żywnościowych i chemicznych. Iwasiewicz. Kandel. 2001.. Accuracy (trueness and precision) of measurement methods and results — Part 2: Basic method for the determination of repeatability and reproducibility of a standard measurement method. Ferreira. Centeno. J. Robberecht. M. PWN.. “Quality assurance and quality control in forest soil analyses: a comparison between European soil laboratories...C.J.” Warszawa. 2004. 2. ISO/IEC Guide 43-1 Proficiency testing by interlaboratory comparison — Part 1: Development and operation of proficiency testing schemes.... 331. 5. .L.J. 15. Delanote. Chem. 12. Clement. W. Prof. and Kafarow.V. H. “Statystyka dla studentów kierunków technicznych i przyrodniczych.. N.. “Metody statystyczne dla chemików. Koronacki. 8. Z. and Grasserbauer.. W. J. P. K. 1986 (in Polish). K.W. A... 9.... 688–694. Łódź. Moens. M. Lugowski.” Warszawa. “Statystyka dla chemików analityków. L. WNT. R.” J.. Riondato. W. B.. Spectrom.. Scheldeman. J. X.A. G. P. Qual. “Zapewnienie jakości analiz chemicznych. Knapp. 3. Paszek. J. F..” Fresenius Z.” Warszawa. 322–327.. M..” Warszawa. Benijts. E. Achnazarowa. This requirement frequently makes it necessary to round the obtained values down to the appropriate number of digits.A.... J. M.. P.. 1998. Anal. Quataert.: Analiza ilościowa związków organicznych.” Warszawa. Use of LRM in quality control: interlaboratory testing — EC Growth Projects TRAP-LRM/TRAP-NAS. References 1. Qual. and Sikorski. 2000. Davies. D’Haese. Deelstra. R.. 10. and Roskams. Z. Dobecki..Ł. Claes.L. M. J. 513–519. M. The notation of the determination requires presentation of the uncertainty value with two significant digits and a result with the same precision (same number of figures after the decimal point) as the uncertainty value. Lamberts. L. Taylor. PWN. and Mielniczuk. Cools. T.. 4. 14. and Rudzki. Nofera. 3. M. LLC . S. Van Dyck. “The influence of different evaluation techniques on the results of interlaboratory comparisons. J. Bastos. 1988. 735–743... WNT.Basic Notions of Statistics 39 It must be remembered that the number of significant digits given in the value of a result is strictly dependent on the calculated uncertainty value (see Chapter 5).

A new type of market arose. and quality of the work and organization. samples have to be collected in such a way that the most important criterion — that is.2 Introduction The past decade or so was undoubtedly a period of “information hunger. Measurement results must be reliable. more and more intense research is taking place with the aim of developing new methodologies and devices so that analytical results are a source of as much information as possible. This leads to the conclusion 41 . that — in other words — are characterized by the greatest information capacity possible. representativeness — is met. Therefore. The quality of information can be divided into components: quality of results. quality of the process. A program of quality control includes: • • • • Assuring a suitable level of staff qualifications Assuring the proper calibration of instruments and laboratory equipment Good laboratory practice (GLP) Standard procedures 2.© 2009 by Taylor & Francis Group. Quality control — a complex system of actions to obtain measurement (determination results) with the required quality level. LLC . but is based on the analyses of appropriate samples.of Analytical 2 Quality Results 2. where information is bought and sold. Analytical data on researched material objects are a specific type of information. Analytical quality — consistency of the obtained results (chemical analysis) with the accepted assumptions. quality of the instruments. This information is not usually obtained through an analysis of the whole object. which means that they must accurately (both truly and precisely) reflect the real content (amount) of analytes in a sample that is representative of the material object under research. but also in the economy and technology (related to control over the processes of manufacturing consumer goods).” Access to a variety of information sources facilitates decision making not only in politics. To satisfy the growing demand for analytical data.1 Definitions [1–3] Quality — the realization of specific requirements (which include the standards established by the quality control system in addition to accepted in-house requirements).

that determines and confirms its reliability. It is the quality of a result. The quality of results of analytical measurements must be assured in the first place to draw conclusions about the quality of the examined products. the notions of quality have a specific meaning. the quality of analytical measurements appears to have its own accumulative requirement: the quality of every product is a result of comparison of the obtained value with the reference value.© 2009 by Taylor & Francis Group.42 Quality Assurance and Quality Control that all developments in analytical chemistry are derived from the desire to obtain in-depth analytical data [4]. reliable) to the reference value. its (high) quality must be documented and maintained. In analytics. the expected or the standard one. 2. The system of quality estimation usually includes the following elements: • Tracking and estimating the precision of obtained results by periodic analysis of test samples • Estimation of accuracy by: • Analyses of certified reference samples • Comparison of obtained results with results obtained for the same sample using the reference method • Sample analyses after the addition of a standard • Comparative interlaboratory (intercomparison) exercises • Control charts • Suitable audit system . In addition. Results of analytical measurements are a type of a product of the chemical analyst’s work. For the obtained result to be comparable (authoritative. LLC . The notion of reliability is closely associated with the notion of quality. estimation. is a consequence of the following trends in analytics: • Decrease in the concentrations of analytes • Increase in the complexity of the matrix composition of the sample • Introduction of new notions associated with the application of metrology principles in analytics • Necessity of traceability documentation and estimating uncertainty as requisite parameters of an analytical result • Globalization and the associated necessity of comparing results in different laboratories This task poses a great challenge for analysts and draws attention to quality control and quality assurance (QC/QA) of the obtained results. The need for a uniform and defined control system. Both manufactured products and analytical results must have an appropriate quality. together with its control and assurance. and assuring the quality of analytical results.3 Quality Assurance System One of the basic trends in the recent development of analytical chemistry is the determination of lower and lower concentrations of analytes in samples with a complex matrix.

The elements of the quality system are interdependent. there are three systems of quality assurance in analytical laboratories [5]: • GLP • Accreditation of a laboratory according to EN 45001 or ISO Guide 17025 • Certification according to norms ISO of series 9000 The selection of the quality system. Quality assurance of analytical measurement results is a system comprising five interdependent elements [7]: • • • • • Assurance of measuring traceability of the obtained results Evaluation of uncertainty in obtained results of measurement Use of certified reference materials Participation in various interlaboratory comparisons Validation of the applied analytical procedures Only when the aforementioned tools are used is it possible to provide the authoritative (reliable) results of analytical measurements. . a schematic presentation of the elements of a quality control/quality assurance system used for obtaining reliable analytical results is shown [7].Quality of Analytical Results 43 At present. In Figure 2.1. it is indispensable to use both the certified reference materials and the analytical procedures subject to prior validation. The problem relating to quality assurance and control of measurement results is primarily associated with the insufficient amount of information concerning instruments used in the process and their application. although increasing attention is paid to the procedures of accreditation [6]. introduced by a given laboratory. To assure measuring traceability. is in principle voluntary. These are first of all statistical instruments based on metrology. LLC .1 Position and role of elements of a quality control/quality assurance (QC/QA) system for obtaining a reliable analytical result.© 2009 by Taylor & Francis Group. RELIABLE ANALYTICAL RESULT UNCERTAINTY TRACEABILITY REQUIREMENTS METHOD VALIDATION REFERENCE MATERIALS INTERLABORATORY COMPARISONS TOOLS FIGURE 2.

In the production of reference materials. compels the precise and very attentive “tracking” of the entire analytical procedure. This. those enabling the control of the procedure.” it is requisite to determine the influence of all possible parameters of an analytical procedure on the value of the combined uncertainty. is indispensable in the production of reference materials. On the other hand. Reference material is also characterized by the uncertainty value.© 2009 by Taylor & Francis Group. showing interrelationships between components. in turn. Although uncertainty is not one of the validation parameters. LLC . Interrelations among the components of a QA/QC system are presented in Figure 2. . as noted earlier.44 Quality Assurance and Quality Control During validation of an analytical procedure. TRACEABILITY UNCERTAINTY METHOD VALIDATION QA/QC SYSTEM REFERENCE MATERIALS INTERLABORATORY COMPARISONS FIGURE 2. it is obvious that determination of uncertainty increases the reliability of the obtained results. Estimation of measurement uncertainty. tolerance (elasticity) • Estimate uncertainty — which enables the control of the entire analytical procedure Interlaboratory comparisons involve both reference materials and analytical procedures.2 Components of the QC/QA system for an analytical process. analytical procedures are applied during the determination of homogeneity and stability of materials. this type of research serves to determine certified values for the manufactured reference materials. It is because during the design of the so-called “uncertainty budget.2. it is necessary to: • Use certified reference materials — determine the accuracy • Participate in interlaboratory research — determine the traceability.

A schematic representation of this concept is shown in Figure 2.3 Necessary parameters for a reliable analytical result. and the determination of the quality of the control system elements • Helping users to derive inferences on the quality system. analytical procedures usually involve two operations associated with calibration: • Periodic reliability test of indications of the instruments used by means of standard mixtures. Each of these elements. in order to be applicable. along with the determination and the control of the elements of the quality control. This can be achieved by: • Defining the basic notions of the quality system • Determining the simple and intelligible procedures used when using individual elements of the quality system • Providing clear and transparent dependencies (in which elements of metrology and mathematical statistics are used) enabling the “numerical” or “parametric” determination of each characteristic. Accordingly. containing strictly defined concentrations of analytes • Testing the reliability of the whole plot of the analytical conduct UNCERTAINTY X ± U SI TRACEABILITY FIGURE 2. These two parameters are the basic requirements for a reliable measurement result. must be defined in a way that is intelligible for the user.Quality of Analytical Results 45 Each element of the quality control system concerning the results of analytical measurements must be applied by any laboratory that wishes to obtain reliable results. a special case of such mixtures are “zero” mixtures used for: • Testing the zero position on the measuring scale of the instrument • Diluteness of standard mixtures.© 2009 by Taylor & Francis Group. It must also be clearly and intelligibly presented. The necessity of presenting the result together with these two basic parameters must be remembered by every “producer” of analytical results.3. based on determined values for each of its elements Every analyst should be aware that the basic and requisite parameters characterizing an analytical result are traceability and uncertainty. A requisite condition of assuring the appropriate quality of analytical results is the verification of the reliability of the used gauges and checking of the range of application and calibration of the analytical procedures. . LLC .

reference material samples are subject to the same processing and determinations as real samples. Such analytical results have no value and. the quality management system does not take into account these weak links of the analytical process. maintenance. etc. in a chemical analysis the power of the entire chain also depends on the power of its weakest link. albeit an important one. and also their transport. precision. and procedures [8]. if stages of sample preparation (extraction. range.. purifying extracts) have not been carried out properly. accuracy. References 1. control and assurance of quality of the analytical results should involve all stages of the analytical process. For the purpose of quality control in a laboratory work.46 Quality Assurance and Quality Control Realization of this operation can be achieved in two ways: • By addition of a standard to the analyzed sample • As a result of applying reference material samples Chemical analysis of any material can be described as a chain of decisions. actions. J. where the applicability test for the analytical method (validation) is only one stage.). This process must be an integral process. covering the previous notion of “method applicability range” (selectivity. repeatability. As in the case of any chain. and Namieśnik.). 2007 (in Polish). In general. the weakest links in the analytical process are not the elements acknowledged as components of chemical analysis (e. limit of detection. WNT. then even the most modern analytical instruments and complex computer techniques cannot improve the situation.g. can cause serious misinformation. such as: • Selection of materials to be sampled • Preparation of the sampling plan • Selection and use of techniques and devices necessary in sampling. Konieczka. but rather the stages that take place outside the analytical laboratory. LLC .© 2009 by Taylor & Francis Group. P. Moreover. Kontrola i zapewnienie jakości wyników pomiarów analitycznych. chromatographic extraction of mixtures or spectrometric detection). Hence. (eds. linearity. Comparison of the obtained result with the real analyte concentration in the reference material sample may give conclusions concerning the reliability of analytical works conducted in a given laboratory [9]. Warsaw. and storage If a given analytical laboratory is not responsible for the sampling stage.4 Conclusions For a laboratory to be able to deliver reliable and repeatable results.. This notion means the determination of the methodology characteristics. instead of being a source of information. 2. it is necessary to perform systematical calibration of analytical instruments and subject all analytical procedures to validation. .

2002.. Assur. PWN. Wiley-VCH.” Accred. LLC . 8. “The role of and place of method validation in the quality assurance and quality control (QA/QC) System. Mermet. “GLP and other quality assurance systems — a comparison. 7.. O. Instytut Medycyny Pracy im. Richter. 2004 (in Polish)... Chem.. M. Assur. “How to achieve international comparability for chemical measurements. Assur.Quality of Analytical Results 47 2. Valcárcel.. Współczesna chemia analityczna.-W. Analytical Chemistry: a Modern Approach to Analytical Science.B.M. (ed). Hembeck.. 2001 (in Polish). Hulanicki. J. Zapewnienie jakości analiz chemicznych.” Accred. . 177–184.” Crit. Dobecki. Qual. Anal.. and Rios.” Trends Anal. Łódź.. M. Qual. H. W..I. V. M.. 9.. Weinheim. Prof. and Valcárcel.. 13. 5. 2007. P. and Ponomareva. Chem.. A. Wybrane zagadnienia. 2000. J. Warsaw. 3. Qual. Paneva. A. Nofera. 1994. Konieczka.© 2009 by Taylor & Francis Group. Otto. 17–23.. “Quality assurance in analytical measurements. 4. 5. Rev. “Analytical chemistry and quality.. 173–190. 2004. 1999. 6. 418–422. 7. 266–268. M. 4.” Accred. 37.

initially in reference to measurements of physical properties. traceability is defined as “the ability to verify the history. Secondary standard — measurement standard established through calibration with respect to a primary measurement standard for a quantity of the same type. the notion of traceability itself was formulated much later. with stated quantity value and associated measurement uncertainty.2 Introduction Comparison of measurement results is sensible only when they are expressed in the same units or on the same scale. Primary standard — measurement standard established using a primary reference measurement procedure. National (measurement) standard — measurement standard recognized by national authority to serve in a state or economy as the basis for assigning quantity values to other measurement standards for the type of quantity concerned. traceability is defined not only as a property of a measurement result. sometimes of special construction. Working standard — measurement standard that is routinely used to calibrate or verify measuring instruments or measuring systems. each contributing to the measurement uncertainty.” In International Vocabulary of Basic General Terms in Metrology (VIM) [1]. The problem of traceability appeared with the first measurements carried out by man. Traceability — property of a measurement result whereby the result can be related to a reference through a documented unbroken chain of calibrations. or created as an artifact. chosen by convention. 3. used as a reference. Reference standard — measurement standard designated for the calibration of other measurement standards for quantities of a given type in a given organization or at a given location. location. but also as a 49 . in association with the development of metrological infrastructure.1 Definitions [1] Measurand — quantity intended to be measured. However. ISO 8402 [3]. or application of an item by means of recorded identification. In the handbook Quality Management and Quality Assurance Vocabulary. Traveling standard — measurement standard. LLC .© 2009 by Taylor & Francis Group.3 Traceability 3. but later with relation to chemical measurements [2]. International (measurement) standard — measurement standard recognized by signatories to an international agreement and intended to serve worldwide. intended for transport between different locations. (Measurement) standard (etalon) — realization of the definition of a given quantity.

6]. For example. SI FIGURE 3. one can qualify the uncertainty of the value measured. and each has its own requirements concerning the quality of an obtained result [4]. Such a series of comparisons is an uninterrupted chain illustrating the very property of traceability. .© 2009 by Taylor & Francis Group. Every day throughout the world.2. which could burden or lower the effectiveness of the entire process.1 The idea of traceability — an example of mass determination [6]. for mass determination. 1 kg mass standard (Sevres. These.50 Quality Assurance and Quality Control property of a reference standard. and the rationale and meaning behind it is presented in Figure 3.2 Rationale and meaning of traceability. The obtained measurement results should be traceable to respective international standards [5. a balance should be used that is regularly calibrated via weights with a calibration certificate that describes a reference to higher-order standard weights. The schematic presentation of traceability meaning is shown in Figure 3. Knowing uncertainty values at each step of this chain of comparisons. should be calibrated against the national standards related to the international prototype kilogram. in turn. millions of chemical analyses are carried out.1 [7]. In a general meaning. it can be described as a continuous and logical process that discourages weak or missing activity at any step of an analytic process. LLC . France) Oﬃcial copy of mass standard National mass standard (1 kg) Mass measurement FIGURE 3.

LLC . Assurance of traceability is realized by comparing given properties to a higher-order standard. In compliance with the content of VIM [1]: “traceability is a property of the result of a measurement or the value of a standard whereby it can be related to stated references. In compliance with the requirements of metrology. but to the value (property) represented by or produced using its [8]. which means the necessity of obtaining a representative dose of the examined . Thus. the result of a measurement depends substantially on the quality of the measuring instruments (rule. Traceability is primarily a feature of a result of measurement obtained with the use of a given measurement procedure. traceability. usually national or international standards.© 2009 by Taylor & Francis Group.” The quoted definition of traceability underlines the elements that are especially significant in chemical measurements. In measuring chemical values. In measuring physical properties. that is. This result must be related to a reference standard. and at every step uncertainty should be defined. 3. For chemical measurements. the result of measurement depends to a significant degree on the type of the sample and how the analytical procedure is conducted. respective scientific and legal metrology centers have emerged on an international scale. Because results of measurements of physical and chemical properties are the basis of many decisions. Chemical measurements usually require a sample preparation step. the science of measurement. Moreover. that is. and in principle does not depend on the type of examined object. scale) used. if the determined substance is available as a certified reference material.Traceability 51 The traceability could be achieved by comparison of result value with [2]: • • • • • SI unit value represented by well-stated standard value obtained by primary (absolute) method value obtained by reference (excellence) laboratory value obtained by group of laboratories in systematic PT scheme It should be noted that value of result is traceable not to the reference material (RM) or primary method. through an unbroken chain of comparisons all having stated uncertainties. because every physical or chemical operation can fracture this chain. thermometer. so that it may be expressed in suitable units. traceability is one of the most important elements of the quality of a result. then it can be treated as the last cell of an uninterrupted chain of comparisons. apart from the scale calibration of a gauge. the most important feature of reliable measurement result is its traceability in relation to the recognized standard with well-known metrological characteristics.3 Role of Traceability in Quality Assurance/Quality Control system The accuracy of an analytical result depends directly on the material used for calibration. the connection should be realized by means of an uninterrupted chain of comparisons. A critical step of assuring traceability in chemical measurements is the applied analytical procedure.

LLC . for solid samples. depend on the type of determined substance (analyte) and the type of matrix of the sample. the notion of accuracy is difficult to define. and. For this reason. For example. it is well known that a type of acid mixture used for mineralization influences the atomic absorption signal. and proving traceability is considerably more difficult. there is no organized metrological system similar to physical measurements realized by a system of standardizing laboratories. that is. The homogeneity of a sample (heterogeneity of composition) significantly influences the determination of the representative portion of the examined material. an analytical sample should be sufficiently large so that grain size is not a source of heterogeneity. In chemical measurements. As has been noted earlier. Therefore. the value of the measurand depends on the applied methodology and/or on the measurement conditions. The type of acid affects the process of atomization. dissolution or mineralization of a sample. . when measuring physical properties. a result of determination depends on the components accompanying the analyte. for example. calibration of instruments is not a significant source of problems. The most important difficulties are: • • • • • • • identifying the object of measurement (object of determination) interferences homogeneity of a sample (heterogeneity of composition) persistence of the sample sample preparation correctness of measurement realization determination of uncertainty Determination of the measurand is a crucial element in the selection of an analytical procedure. Thus the results can only be compared in the same measurement conditions. The greatest problem is assuring the traceability of the entire analytical process. In the case of chemical measurements. Traceability determination in chemical measurements is associated with many difficulties resulting from the need for sample preparation before the measurement process itself. an extremely important element that assures the quality of chemical measurement results is the validation of the entire measurement procedure and the estimated influence of sample components on the ultimate result of the measurement. and therefore the effectiveness of creating free atoms in the determined element. hence.52 Quality Assurance and Quality Control material. in chemical measurements. enrichment. and extraction (just to mention the most important physicochemical processes). In chemical measurements. This effect is extremely important with consideration to the entire chemical measurement and must be taken into account when validating a given measurement procedure. While planning analytical conduct.© 2009 by Taylor & Francis Group. In most cases. As noted earlier. an analyst must allow for the heterogeneity of a sample’s composition. the sample type does not have a significant influence on the measurement result. the influence of sample components on the analytical signal. the chain of connections with standards is always broken when a sample is physically or chemically modified in the analytical process. Interferences.

In practice. the problem of traceability assurance involves the accessibility of standards with a required level of analyte concentration. The calibration step is used for [11. Traceability should be shown for each parameter of a given procedure and should be carried out by calibration with suitable standards.© 2009 by Taylor & Francis Group. the proper functioning of instruments. and consequently international agreement on measurements [9]. Correct realization of a measurement depends primarily on the efficiency of the measuring instrument used and the maintenance of suitable measurement conditions. It is necessary to use reference standards for which traceability may be shown and which have known uncertainty. which obtain traceability. traceability for chemical measurements can be determined in two ways [10]: • By comparing an obtained value with reference measurements • By referring an obtained value to reference standards. the composition of a sample can change even over several minutes. Every physicochemical operation disrupts the chain of traceability. For example. A procedure enabling the determination of correlations between the value of a signal (indicated by an instrument) and the concentration of the examined substance in the sample is called calibration. 12]: • Assuring the correct performance of an instrument (instrument calibration) • Determining a clear dependence between a determined signal and a determined property (analytical calibration) For reference materials reproducing the chemical properties. For trace analysis. determined with a suitable accuracy (higher than the accuracy in the applied analytic methodology). which can be assured by calibration using suitable calibrants. An important part at this step is played by reference materials. which can assure traceability to standards. . that is to say. which in turn have a connection with the value obtained in reference measurements Reference values should come from specialist laboratories with good international reputations. a pH measurement requires calibration of an instrument and measurements at a suitable temperature. The traceability of measurement results depends on. among other things. LLC . In some cases. hence the necessity for exact knowledge concerning how the sample behaves over time. Uncertainties in reference standards comprise the uncertainty of a result obtained by a comparison with these standards. which implies a necessity for a detailed plan of action. fulfilling the traceability requirement for a typical analytical procedure demands the use of matrix reference materials. The preparation of a sample is the most important element causing difficulty in maintaining traceability. Determination of the uncertainty of a result is an integral part of traceability assurance.Traceability 53 The stability of a sample determines the measurement duration.

• The traceability of the applied standards. Many reference materials may have properties that for various reasons cannot be measured in units of mass or quantity. This has an undoubtable influence on the cost of preparing reference materials. and also technological reference materials [13]. that is. . damage. and preparing suitable reference materials poses an immense challenge. stability.© 2009 by Taylor & Francis Group. • Determine the uncertainty of the applied measurement procedure. analytes in samples occur in trace or ultratrace amounts. • Determine a strategy for proving traceability by selecting suitable standards and determining procedure calibration. and repairs. calibration. that is. a detailed and up-to-date history of the instruments containing descriptions of their installation. in order to determine the traceability of a given analytical procedure. and other parameters associated with the specific instrument. and origin must be clearly presented). That is why the notion of traceability and the associated notion of uncertainty are also two key problems in present-day metrology in analytical chemistry. and hence assuring the reliability of measurements. LLC . the properties of standard values that can be related to reference materials by an uninterrupted chain of comparisons of uncertainties associated with suitable reference materials and supplied documentary evidence giving the history of their production (in which significant properties such as homogeneity.54 Quality Assurance and Quality Control Here it must be remembered that very frequently. traceability should be considered in four ways [14]: • The traceability of analytical results. it is necessary to: • Determine the measurand. nor determined by means of precisely defined physical and chemical measurement methods. that is. • The traceability of an instrument. the assurance of the obtained analytical results referred to specific reference materials by an uninterrupted chain of comparisons of uncertainties associated with suitable reference materials (certification and history of their production). number of hours used. the possibility of obtaining traceable results after a correct process of validating all analytical conduct. that is. with special attention paid to maintenance. • Select a suitable measurement procedure and record a respective model equation. • The traceability of analytical methodology (procedures). sample processing. • Prove (by validation) the correctness of the selected measuring conditions and the model equation. In compliance with requirements stated in the EURACHEM /CITAC Guide [15]. For the purpose of obtaining a full and correct picture. is an element of analytical chemistry that is currently given considerable attention. Examples of such reference materials are biological reference materials attributed to a respective international unit by the World Health Organization. Assuring traceability.

Traceability

55

As noted earlier, one of the most important tools used for the purpose of traceability assurance in chemical measurements is the use of certified reference materials, which are extremely useful for: • Estimating the accuracy of new analytical procedures • Comparing different methods • Comparing and testing the competence of different laboratories Realization of traceability in chemical measurements by means of reference materials can be attained by using pure standard substances for calibration or suitable certified reference materials. It is very important to purchase reference material from a reputable distributor, which will assure the maintenance of traceability for a given value together with a given uncertainty value. The most important criteria for the selection of reference materials are primarily the agreement of matrix and concentrations of the determined substance. Moreover, it is necessary to allow for uncertainty provided by the manufacturer and to estimate to what extent this will be important in the uncertainty budget of the applied measurement procedure.

3.4 Conclusion

The main sense of traceability is to enable comparability of measurement results — either compare results of the measurements on the same sample or compare results on different samples [12]. In theory, all measurements can be tracked back to the base seven SI units [16]. Traceability is highly connected with uncertainty, comparability, utility, reliability, and validity. Traceability and uncertainty are necessary parameters for obtaining reliable results.

References

1. International Vocabulary of Metrology — Basic and General Concepts and Associated Terms (VIM), Joint Committee for Guides in Metrology, JCGM 200, 2008. 2. Valcárcel, M., and Rios A., “Traceability in chemical measurements for the end users,” Trends Anal. Chem., 18, 570–576, 1999. 3. Quality Management and Quality Assurance Vocabulary, ISO 8402, Geneva, 1994. 4. Walsh, M.C., “Moving from official to traceable methods,” Trends Anal. Chem., 18, 616–623, 1999. 5. De Bièvre, P., Kaarls, R., Peiser, H.S., Rasberry, S.D., and Reed W.P., “Protocols for traceability in chemical analysis: Part II. Design and use,” Accred. Qual. Assur., 2, 270– 274, 1997. 6. De Bièvre, P., and Taylor, P.D.P., “Traceability to the SI of amount of substance measurements: from ignoring to realizing a chemist’s view,” Metrologia, 34, 67–75, 1997. 7. Thomson, M., “Comparability and traceability in analytical measurements and reference materials,” Analyst, 122, 1201–1205, 1997. 8. King, B., “The practical realization of the traceability of chemical measurements standards,” Accred. Qual. Assur., 5, 429–436, 2000. 9. ISO Guide 35, Certification of reference materials. General and statistical principles, ISO, Geneva, 1989.

.© 2009 by Taylor & Francis Group, LLC

56

Quality Assurance and Quality Control

10. Bulska, E., and Taylor, Ph., “On the importance of metrology in chemistry,” in Namieśnik, J., Chrzanowski, W., and Żmijewska, P., eds., New Horizons and Challenges in Environmental Analysis and Monitoring, CEEAM, Gdańsk, 2003. 11. Valcárcel, M., and Rios, A., “Is traceability an exclusive property of analytical results? An extended approach to traceability in chemical analysis,” Fresenius J. Anal. Chem., 359, 473–475, 1997. 12. Williams, A., “Traceability and uncertainty — a comparison of their application in chemical and physical measurement,” Accred. Qual. Assur., 6, 73–75, 2001. 13. ISO Guide 30, Trends and definitions used in connections with reference materials, ISO, Geneva, 1992. 14. Marschal, A., Andrieux, T., Compagon, P.A., and Fabre, H., “Chemical metrology — QUID?” Accred. Qual. Assur., 7, 42–49, 2002. 15. EURACHEM/CITAC Guide, Traceability in Chemical Measurements. A guide to achieving comparable results in chemical measurement, 2003. 16. Buzoianu, M., and Aboul-Enein, H.Y., “The traceability of analytical measurements,” Accred. Qual. Assur., 2, 11–17, 1997.

.© 2009 by Taylor & Francis Group, LLC

4 Uncertainty

4.1 Definitions [1–3]

Uncertainty of measurement — nonnegative parameter characterizing the dispersion of the quantity values being attributed to a measurand, based on the information used. Definitional uncertainty — component of measurement uncertainty resulting from the finite amount of detail in the definition of a measurand. Standard uncertainty u( xi ) — uncertainty of a result xi of a measurement expressed as a standard deviation. Combined standard uncertainty uc( y) — standard measurement uncertainty that is obtained using the individual standard measurement uncertainties associated with the input quantities in a measurement model; standard uncertainty of a result y of a measurement when the result is obtained from the values of many of other quantities equal to the positive square root of a sum of terms, the terms being the variances or covariances of these other quantities weighted according to how the measurement result varies with these quantities. Uncertainty budget — statement of a measurement uncertainty, of the components of that measurement uncertainty, and of their calculation and combination. Expanded uncertainty U — product of a combined standard measurement uncertainty and a factor larger than the number 1. Coverage factor k — number larger than 1 by which a combined standard measurement uncertainty is multiplied to obtain an expanded measurement uncertainty; a coverage factor is typically in the range of 2–3, and for an approximately 95% level of confidence, k = 2. Type A evaluation (of uncertainty) — evaluation of a component of measurement uncertainty by a statistical analysis of measured quantity values obtained under defined measurement conditions. Type B evaluation (of uncertainty) — evaluation of a component of measurement uncertainty determined by means other than a type A evaluation of measurement uncertainty. Relative uncertainty ur ( xi ) — standard measurement uncertainty divided by the absolute value of the measured quantity value.

4.2 Introduction

Decisions made in many fields of science and other domains of life are based on the results of analytical studies. It is therefore obvious that their quality is increasingly important. Uncertainty of measurement is a component of uncertainty for all individual steps of an analytical procedure [4–7]. Hence, it is necessary to determine the sources and types of uncertainty for all these steps [8–10].

57

.© 2009 by Taylor & Francis Group, LLC

58

Quality Assurance and Quality Control

The main sources of uncertainty during sample analysis while using an appropriate analytical procedure may be [11]: • Inaccurate or imprecise definition of the measurand • Lack of representativeness at the step of collecting a sample from an examined material object • Inappropriate methodology of determinations • Personal deviations in reading the analog signals • Not recognizing the influence of all the external factors on the result of an analytical measurement • Uncertainty associated with the calibration of an applied measurement instrument • Insufficient resolution of the applied measurement instrument • Uncertainties associated with the applied standards and/or reference materials • Uncertainties of parameters determined in separate measurements and which are used in calculating the final result, such as physicochemical constants • Approximations and assumptions associated with using a given instrument, applied during measurement; or • Fluctuations of the measurement instrument gauge, over the course of repeated measurements, with seemingly identical external conditions There is a difference between measurement error and uncertainty. The error is a difference between the determined and expected values, and uncertainty is a range into which the expected value may fall within a certain probability. So the uncertainty cannot be used to correct a measurement result. This difference is schematically presented in Figure 4.1 [11].

**4.3 Methods of Estimating Measurement Uncertainty
**

There are several approaches for uncertainty estimation [12, 13]: • Bottom-up — based on an identification, quantification, and combination of all individual sources of uncertainty of measurement. The overall uncertainty is derived from the uncertainties of individual components. This method has high complexity and because of that it needs considerable time and effort; this approach is adapted by EURACHEM [2, 14].

Error

µx

xm Uncertainty

FIGURE 4.1 Schematic presentation of difference between error and measurement uncertainty [11].

.© 2009 by Taylor & Francis Group, LLC

value. which has the form of algebraic expression.1 Procedure for Estimating the Measurement Uncertainty According to Guide to the Expression of Uncertainty in Measurement Determining the uncertainty of a measurement increases its reliability. . The relation is described as follows: y = f ( x1 . and the standard uncertainty for each of them must be determined. . and its number of degrees of freedom. when a variable has a rectangular distribution. . unit.3. Each measurand has a name. 3. As noted before. Type B uncertainty is strictly associated with the probability distribution described by the distribution of a variable. For example. Values must be assigned to all the possible parameters that could affect the final result of the analysis. . 4.or intralaboratory validation studies (precision. xn — measurement values. and in turn allows comparison of results obtained in interlaboratory studies and helps users to decide the significance of any difference between the obtained result and the reference value.1) where y is the value of a result and x1. • Robustness-based — based on robustness tests from interlaboratory studies. According to the Guide to the Expression of Uncertainty in Measurement [2]. the following conditions must be satisfied: 1. 2. • Top-down — based on data obtained from interlaboratory studies (precision). x 2 x n ) (4. such as in the case of a standard’s purity. An appropriate mathematical model ties the value of a determination result (the one to be determined) with the observed values (measurement values). x2. • Validation-based — based on inter. along with the unit in which it is expressed. Modeling (usually mathematical modeling) must be applied to calculate the analysis result based on the measured parameters. Type A uncertainty is equal to a standard deviation of an arithmetic mean. The measurand in a given measurement must be clearly defined. The measurement procedure and the measurand must be defined. in order to determine the uncertainty of analysis result. standard uncertainty. and describes the relation between uncertainty and analyte content.© 2009 by Taylor & Francis Group. trueness.Uncertainty 59 • Fitness-for-purpose — based on a definition of single parameter called the fitness function. The observed quantity and the searched parameter (result) must also be clearly described. Calculation of uncertainty for the result of measurement is very easy and less time-consuming than a bottom-up approach. robustness). there are two methods for calculating standard uncertainty. the variable may assume (with equal . LLC .

which means that the value is in the range 〈– a. Data: Standard solution concentration.15 mg/dm3 Excel file: exampl_uncert01. LLC . +a〉.© 2009 by Taylor & Francis Group. but the occurrence of the mean value from the range is the most probable.1 Problem: Calculate standard uncertainty for the concentration of magnesium in a standard solution. we assume a rectangular distribution.2 Problem: Calculate the standard uncertainty for the concentration of magnesium in a standard solution.xls Example 4. Data: Standard solution concentration. Cst = 1001 ± 2 mg/dm3 Solution: Due to no additional information. u(Cst ) = 2 3 u(Cst ) = 1. Uncertainty given by the manufacturer have been calculated for coverage factor k = 2.xls u(Cst ) = 1 mg/dm3 . standard uncertainty is calculated accordingly: 2 u(Cst ) = k Excel file: exampl_uncert02.60 Quality Assurance and Quality Control probability) a value in the range 〈– a. When a variable has a triangular distribution. the calculated standard uncertainty is a 6 Example 4. and the calculated standard uncertainty is a 3 where a is the midpoint of the range 〈– a. Cst = 1001 ± 2 mg/dm3 Solution: Because value for k is given. +a〉 . +a〉. based on data given by the manufacturer. based on data given by the manufacturer.

8 cm3 Solution: u(Vfl ) = Excel file: exampl_uncert03. Assume triangular distribution.5) If the value of the analytical result is a quotient/product of the measurement values. Vfl = 500 ± 0.Uncertainty 61 Example 4. Data: Volume.xls 0. it is more convenient to apply relative uncertainties. The applied principles of uncertainty propagation in calculating the standard uncertainty of an analytical result.1). standard uncertainty is calculated by using the principle of uncertainty propagation expressed in the following formula: 2 uc ( y) = ∑ i =1 n δf 2 ux δxi ( i) 2 (4.© 2009 by Taylor & Francis Group.4) Due to the very frequent occurrence of individual measurement values being expressed in different units.3) then the value of the combined uncertainty is described by the following equation: uc( y) = u(2x1 ) + u(2x2 ) + … + u(2xn ) (4. For a given mathematical model that binds the final results of analysis with measured parameters (Equation 4.3 Problem: Calculate the standard uncertainty for the determination of volume 500 cm3 using volumetric flask.32 cm3 4. .2) When the value of an analytical result is the sum or difference of the measurement values y = x1 + x 2 + … + x n (4. LLC . A relative uncertainty is described by the following relation: ur ( xi ) = u( xi ) xi (4. based on data given by the manufacturer.8 6 u(Vfl ) = 0.

4 Problem: A standard Mg2+ solution was prepared.62 Quality Assurance and Quality Control y= x1x 2… x 3… (4. the basic solution was diluted as follows: We took 1 cm3 of basic sample solution by using a pipette with a volume of 1 cm3 and transferred it to a volumetric flask with a volume of 100 cm3.0017 (mol/dm3) cNaOH ± U(k = 2) = 0. the standard uncertainty should be multiplied by an appropriate coverage factor k. along with units for y and U ) • k factor value. After filling the flask to the line and mixing the solution. calculate the following: • The value of the combined and expanded uncertainty (for k = 2) for the obtained standard solution concentration.7) 5. Therefore. Presentations of the final result of the analysis as: result ± expanded uncertainty (after using an appropriate k factor). a correctly presented result of an analysis should be as follows: or Example 4. To calculate the value of the expanded uncertainty. with a basic diluted solution with a concentration of 1001 ± 2 mg/dm3.6 (%) . With the aim of obtaining a standard solution with a concentration of ~0. cNaOH ± U(k = 2) = 0.© 2009 by Taylor & Francis Group. To establish a uniform distribution for each of the measured parameters. Uncertainty calculated according to the aforementioned equation is a combined standard uncertainty of the final determination. and present indication results. 5 cm3 of solution was taken from it with the help of a pipette with a volume of 5 cm3 and was transferred to a volumetric flask with a volume of 100 cm3 and after being filled to the line. for which the expanded uncertainty has been calculated Thus.1038 ± 0. the final result of an analysis comprises the following: • Determination of the measured value and its unit • The result with the expanded uncertainty value ( y ± U.6) then the value of the combined relative uncertainty is described by the following equation: ur ( y) = ur2( x1 ) + ur2( x1 ) + … + ur2( xn ) (4. LLC . a standard solution was obtained with the predetermined concentration.5 mg/dm3.1038 mol/dm3 ± 1.

xls 0.0012 2 c ur(c) U(c) U Result Excel file: exampl_uncert04.501 ± 0. the basic solution was diluted as follows: A basic sample solution of 10 cm3 was taken using a pipette with a volume of 10 cm3 and was transferred to a volumetric flask with a volume of 100 cm3.02 u(Vf1) 0. with a basic diluted solution having a concentration of 1001 ± 2 mg/dm3.012 mg/dm3 Example 4. Data: Standard solution concentration Pipette 1 volume Flask 1 volume Pipette 2 volume Flask 2 volume Uncertainty of single measurement Cst 1001 Vp1 1 Vf1 100 Vp2 5 Vf2 100 u(Cst) 2 u(Vp1) 0. With the aim of obtaining a standard solution with a concentration of ~0.50 6.25 62.0115 0.75 6.5 mg/dm3.25 18.0012 0.0122 mg/dm3 2.Uncertainty • The participation percentage of each of the standard uncertainty values in the determined values of the combined uncertainty.0035 0.5 Problem: A standard Mg2+ solution was prepared.03 u(Vf2) 0.2 u(Vp2) 0.0122 0.© 2009 by Taylor & Francis Group. After .5005 mg/dm3 0.2 Rectangular (R) or triangular (T) mg/dm3 cm3 cm3 cm3 cm3 mg/dm3 cm3 cm3 cm3 cm3 R 63 Distribution Solution: Relative Uncertainty Contribution. % 6. LLC .25 ur Cst Vp1 Vf1 Vp2 Vf2 k 0.0012 0.4% 0.

28 9.09 ur Cst Vp1 Vf1 Vp2 Vf2 Vp3 Vf3 k 0.18 9. LLC .0012 2 . Data: Standard solution concentration Pipette 1 volume Flask 1 volume Pipette 2 volume Flask 2 volume Pipette 3 volume Flask 3 volume Uncertainty of single measurement 1001 Cst Vp1 10 Vf1 100 Vp2 5 Vf2 100 Vp2 10 Vf2 100 u(Cst) 2 u(Vp1) 0. 10 cm3 of solution was taken from it with the help of a pipette with a volume of 10 cm3 and was transferred to a volumetric flask with a volume of 100 cm3.2 Rectangular (R) or triangular (T) mg/dm3 cm3 cm3 cm3 cm3 cm3 cm3 mg/dm3 cm3 cm3 cm3 cm3 cm3 cm3 R Distribution Solution: Relative Uncertainty Contribution.09 27.0012 0.04 u(Vf2) 0. % 9.0012 0.08 18. and present indication results. • The participation percentage of each of the standard uncertainty values in the determined values of the combined uncertainty. calculate the following: • The value of the combined and expanded uncertainty (for k = 2) for the obtained standard solution concentration.© 2009 by Taylor & Francis Group.0023 0.0035 0.03 u(Vf2) 0.64 Quality Assurance and Quality Control filling the flask to the line and mixing the solution.2 u(Vp2) 0. 5 cm3 of solution was taken from it with the help of a pipette having a volume of 5 cm3 and was transferred to a volumetric flask with a volume of 100 cm3. To establish a uniform distribution for each of the measured parameters.18 9.2 u(Vp2) 0.0012 0.09 18.04 u(Vf1) 0. and after being filled to the line a standard solution was obtained with the predetermined concentration. After filling the flask to the line and mixing the solution.0023 0.

7 Problem: The weighed standard sample (Example 4. Assume a rectangular distribution of the parameters.4 cm3. Data: Mass (tarra) Mass (brutto) Uncertainty of single measurement Distribution 187.0053 0. calculate the expanded uncertainty of the mass measurement.82 mg 144. Assume a rectangular distribution of the parameter.xls 0. LLC . The mass was calculated as the difference of two mass measurements: gross (container with a sample. Assuming . Assuming the value of the coverage factor to be 2. Give a correct presentation of the mass measurement result.6 Problem: A standard sample was weighed for the preparation of a standard solution. The mass measurement was carried out using an analytical scale.5005 ± 0.5 u(mtarra) 0.Uncertainty c ur(c) U(c) U Result Excel file: exampl_uncert05.83 mg 0.5 mg.0053 mg/dm3 1.72 mg).1% 0.82 mg Example 4. Calculate the standard uncertainty of the mass measurement. 332.55 mbrutto 0.5005 mg/dm3 0.6) was put into a measurement flask (250 cm3) for which the manufacturer provided an uncertainty value equal to 0. 187.© 2009 by Taylor & Francis Group.5 u(mbrutto) Rectangular (R) or triangular (T) mg mg mg mg R Solution: mnetto u(mnetto) k U(mnetto) Result Excel file: exampl_uncert06. for which its manufacturer gave a measurement uncertainty of 0.72 mtarra 332.0053 mg/dm3 65 Example 4.83 ± 0.408 mg 2 0.xls 144.55 mg) and net (container. Calculate the combined standard uncertainty of the obtained standard solution concentration.

5 0.55 mbrutto 250 Vflask u(mtarra) 0.5 u(mbrutto) 0. and dissolving in a measurement flask (10 cm3). calculate the expanded uncertainty of the concentration.2 Rectangular (R) or triangular (T) mg mg cm3 cm3 cm3 mg mg cm3 cm3 cm3 R Distribution . Give a correct presentation of the result.72 332.8 Problem: The obtained standard solution (Example 4.4 u(Vflask) Rectangular (R) or triangular (T) mg mg cm3 mg mg cm3 R Solution: Concentration ur(concentration) k U(concentration) Result Excel file: exampl_uncert07. for which the manufacturer provided an uncertainty value 0.05 cm3.00199 2 0.0023 mg/cm3 0.05 u(Vpipette) 0.2 cm3.7) was dissolved by a 1:10 ratio.© 2009 by Taylor & Francis Group. calculate the expanded uncertainty of the concentration. sampling 1 cm3 of the original solution using a pipette for which the manufacturer provided an uncertainty value of 0.5 u(mbrutto) 0.5793 ± –0.5793 mg/cm3 0. Data: Mass (tarra) Mass (brutto) Flask volume Flask volume Pipette Uncertainty of single measurement mtarra 187.4 u(Vflask1) u(Vflask2) 0. Data: Mass (tarra) Mass (brutto) Flask volume Uncertainty of single measurement Distribution mtarra 187.0023 mg/cm3 Example 4. Give a correct presentation of the result. Assume a rectangular distribution of parameters.55 mbrutto 250 Vflask1 Vflask2 10 Vpipette 1 u(mtarra) 0.5 0.xls 0. Assuming the value of the coverage factor to be 2.72 332. Calculate the combined standard uncertainty of the obtained standard solution concentration.66 Quality Assurance and Quality Control the value of the coverage factor to be 2. LLC .

058 ± 0. respectively.5 Uncertainty and Confidence Interval In some cases. calculation of uncertainty may be limited to the calculation based on the value of that parameter.3. and n is the number of measurements. The most helpful tools used for that are [4. the value of uncertainty can be estimated as a confidence interval. • Ishikawa.013 mg/cm3 67 4. The basic principle of the uncertainty propagation is underlining the influence of the quantity with the highest value. The flow diagram and the Ishikawa diagram for the procedure of preparation of a standard solution are presented in Figures 4.2 Flow diagram for the procedure of preparation of standard solution. .2 and 4.1155 2 0.xls 0. or fishbone diagram — shows the influence parameters (sources of uncertainty) of a whole analytical procedure [15. if one of the parameters has a dominating influence over the uncertainty budget.Uncertainty Solution: Concentration ur(concentration) k U(concentration) Result Excel file: exampl_uncert08. 16].8) where SD is the standard deviation. Therefore.© 2009 by Taylor & Francis Group. LLC . then the expanded uncertainty may be calculated according to the following relation: U=k SD n (4. If that dominating parameter is the repeatability of measurements. Weighing of pure substance Dilution STANDARD SOLUTION FIGURE 4. or cause-and-effect.134 mg/cm3 0. 6]: • Flow diagram — drawn on the basis of information presented in detail in a standard operating procedure.0579 mg/cm3 0. 4.4 Tools Used for Uncertainty Estimation Correct estimation of uncertainty needs an understanding of whole analytical procedure by analyst.

© 2009 by Taylor & Francis Group. f ) SD n (4.05. Given this condition. LLC . Considering the unrepeatability as the main component of the uncertainty budget.9) For a level of significance of α = 0. Appendix). On the other hand. μg/dm3: 1 2 3 4 Data 71. the aforementioned equations are thus consistent.14 77.1. The series involved four determinations. Data: result series. Example 4.13 76.54 . Provide a correct presentation of the determination result.68 Mass of pure substance Quality Assurance and Quality Control Balance calibration Balance calibration Gross mass Tare mass Concentration of analyte in standard solution Flask calibration Temperature Volume of solvent Purity of substance FIGURE 4.53 72. the value of confidence interval could be calculated as: ∆x sr = t (α .9 Problem: The concentration of mercury was determined in water by using the cold vapor atomic absorption spectrometry (CVAAS) technique. For a level of significance of α = 0. the coverage factor k = 2.3 Ishikawa diagram for the procedure of preparation of standard solution. the parameter t ≈ 2 (Table A.05 and the number of degrees of freedom f →∞. calculate the expanded uncertainty of the determination result for k = 2.

© 2009 by Taylor & Francis Group.63)–(1.3 ± 2. usually using a method of consecutive dilutions • Incorrect approximation of measurement points using a regression curve Figure 4.6 Calibration Uncertainty A decisive majority of analytical measurements involve a calibration step. There are four sources of uncertainty due to the calibration step that can influence the standard uncertainty of a single measurement u( xsmpl ) [8. it is possible to determine and identify the uncertainty of the determined regression curve through the determination of confidence intervals. which is determined using linear regression.4 presents an example of a calibration graph along with the marked uncertainty values associated both with the reading of the signal values and the reference values.9075 μg/dm3 2 2.68) in Chapter 1. Those intervals are determined using a correlation that is described by the following equation: where ∆yi = Y ± SDxy ⋅ t(α .xls 74. Using a calibration curve.335 μg/dm3 2.10) ∆yi = confidence interval of the calculated value Y for a given value xi Y = values calculated based on the regression curve equation for given values xi . xstd ) i • The influence of the manner of preparing the standard samples. Standard uncertainty due to this step should be included in the uncertainty budget.Uncertainty Solution: Mean SD k U Result Excel file: exampl_uncert09.9075 μg/dm3 74. which is associated with the relative (comparative) character of measurements. f = n− 2) 1 ( xi − x m )2 + n Qxx (4.9 μg/dm3 69 4. a calibration curve technique is usually used. drawn based on Equations (1. At the calibration step. y ) • Uncertainty due to the determination of the reference value for standard samples — u( xsmpl . 17–19]: • Repeatability of reading the value of a signal y both for standard samples (based on measurements for which the calibration curve is determined) and for study samples — u( xsmpl . This step of the analytical procedure has influence on the combined uncertainty of the determination result for the real sample. LLC .

y ) = SDxy b 1 1 ( xsmpl − x m ) + + p n Qxx 2 (4.12) where u( xsmpl .9989 6 8 Content. y ) may be calculated using the determined regression parameters according to the following relationship: u( xsmpl . y ) = standard uncertainty for the determination of the xsmpl concentration due to the application of the determined calibration correlation b = direction coefficient of the calibration curve p = number of measurements (repetitions) carried out for a given sample .4 An example of a calibration graph along with the marked uncertainty values associated both with the reading of the signal values and the reference values.564x – 0. SDxy = residual standard deviation t(α. ppm 10 12 14 FIGURE 4.0291 r = 0.11) Standard uncertainty for xsmpl due to the uncertainty of calibration and linear regression method u( xsmpl .© 2009 by Taylor & Francis Group. f = n − 2) = Student’s t test parameter n = total number of standard samples used for the determination of the calibration curve (number of points) xi = value x for ∆yi is calculated xm = mean value x (x is most frequently the analyte concentration and is the mean of all the concentrations of a standard solution for which the measurement was made to make a standard curve) Qxx = parameter calculated according to a relation described by the equation: Qxx = ∑ (x − x ) i m i =1 n 2 (4.70 8 7 6 Signal 5 4 3 2 1 0 0 2 4 Quality Assurance and Quality Control y = 0. LLC .

13) Therefore. y ) . Because usually only one basic standard is used and then appropriate standard solutions are made (consecutive dilutions).14) Such an uncertainty value does not allow for the uncertainty associated with the manner of standard sample preparation.Uncertainty 8 7 6 Signal 5 4 3 2 1 0 0 2 4 6 8 Content.© 2009 by Taylor & Francis Group. the standard uncertainty of a result. If each standard sample is prepared by consecutive dilutions.5 A calibration curve along with the marked confidence intervals and the determined uncertainty value for the determination of an analyte’s concentration in an examined sample.564x – 0. y ) i (4. then the uncertainty budget must allow for the standard uncertainties associated with the step of standard sample preparation. LLC .5 presents a calibration curve along with the marked confidence intervals and the determined uncertainty value for the determination of an analyte’s concentration in an examined sample. Usually. xstd ) ≈ i u( xstd ) i n (4. xstd ) << u( xsmpl . . its value may be estimated by only considering the number of standard samples used at the calibration stage. ppm 10 12 14 y = 0. requires only the value u( xsmpl . Figure 4. standard uncertainty due to the application of standard solutions at the calibration step may be described by the following equation: u( xsmpl . associated with an applied calibration technique. The value of uncertainty for the determination of analyte concentration in the applied standard samples is usually significantly smaller compared to the uncertainty associated with the calculation of analyte concentration based on the determined calibration function: u( xsmpl .0291 r = 0.9976 71 FIGURE 4.

66 7.59 ppm 3 .11 2.32 2.32 4.97 6.12 4.76 5.54 3. Signal 1.23 3.67 5. making three independent measurements for each of the solutions.12 1.41 4.© 2009 by Taylor & Francis Group. ppm 2 2 2 4 4 4 6 6 6 8 8 8 10 10 10 12 12 12 Data y.10 Problem: A calibration curve was determined using determinations of analyte concentration in samples of six standard solutions.33 3.2 1.72 Quality Assurance and Quality Control Example 4.51 6.44 5. Calculate: • Regression parameters of the calibration curve • Confidence intervals • Uncertainty value of the determination value for the real sample due to calibration. for which three independent measurements were made and the result was calculated using the determined curve Data: results. ppm: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Result for sample Number of measurements for sample x. LLC .78 6.08 2.

. the basic tool for any analyst. a Residual standard deviation.y Regression coefficient. ppm 10 12 14 y = 0.05.16 ppm 2.Uncertainty Solution: n Slope.12 Excel file: exampl_uncert10.9976 210 0. f = n − 2) (from Table A. SDx. The certainty of the analytical result depends on the uncertainties occurring at all the steps of an analytical procedure. real) value. The ultimate goal for an analyst is to obtain a result that will most reliably reflect the expected (actual. LLC .5642x – 0.1433 0.0291 0. b Intercept.7 Conclusion Each analytical result derives from a conducted measurement.1.xls 4.1% 2. Appendix) Graph: 8 7 6 Signal 5 4 3 2 1 0 0 2 4 6 8 Content.9951 73 18 0.0291 R2 = 0. r Qxx Uncertainty for result due to calibration Relative uncertainty for result due to calibration t(α = 0.5642 −0.© 2009 by Taylor & Francis Group.

Quantifying Uncertainty in Analytical Measurements.. and De Loose.. JCGM 200. Hence. “Application of cause-and-effect analysis to potentiometric titration. J. 485–493.. 13. Lis. “Introduction to measurement uncertainty in chemical analysis.” Analyst.... Uncertainty occurs always and at any step of a measurement procedure. A. M. and Meinrath. Springer. Guide to the Expression of Uncertainty in Measurement (GUM). Muse. I. 7.. “Uncertainty and traceability: the view of the analytical chemist. G. “The role of and place of method validation in the quality assurance and quality control (QA/QC) System.. and Campos Gimenez.R. it is not a property that should result in additional difficulties during the measurement procedure. Risk.... Chem. eds. Qual. Chromatogr. and more exactly for each measurand. 185–193. E. 123. 1158. A. A. A.” Trends Anal. and Sansone. and Rauret. Qual.J.74 Quality Assurance and Quality Control The most crucial parameter affecting a measurement result’s uncertainty is the parameter with the highest uncertainty value. 1998. ISO. 382. Assur. M. 1652–1661. 5.” J. 15–24. 2005. 23. Principles of an approach using cause and effect analysis.-M. E. 237–241.” Trends Anal. Rev. 92–94. 15.R... Assur. M.” Accred. M. 10. Kufelnicki.. Chem. A... Sahuquillo. V. Manag. Combined uncertainty covers all sources of uncertainty that are relevant for all analyte concentration levels.. Anal. Taverniers. References 1. 16. EURACHEM. Geneva 1993. S.. 2007. P... Qual. V.. LLC .© 2009 by Taylor & Francis Group. Joint Committee for Guides in Metrology. RSC. 8. 2005.. 23. and Williams. “Uncertainty in environmental analysis: theory and laboratory studies. 7. Ellison. Assur.. G.. and the uncertainty of chemical measurements. A. 2002. 2005. Belli. R. Roy. Armishaw. 1998. S.” in Fajgelj. A.” Accred. 10. Assur. 6. Therefore. Konieczka. Chem.. 3... 1998. 2003.. 311–335. “A simplified approach to the estimation of analytical measurement uncertainty. U. S.. Bioanal. Chem. Traceability and measurement uncertainty of analytical results.. International vocabulary of metrology — Basic and general concepts and associated terms (VIM).L. Love. Populaire. Part 1. 2. “Evaluating uncertainty in analytical measurements: the pursuit correctness. 2000.. 3. 2nd edn. J.L. “Measurement uncertainty. Meyer. “Chemical metrology.” Accred. and Mecozzi. M. 218–224..R. Assess. Ellison. 8.. and Fouillac. 12.. Combining and Reporting Analytical Results. 2004. 5. 9. .” Accred. P. chemistry..” Int. 14. A. “Trends in quality in the analytical laboratory: I. 173–190. “Uncertainties related to sampling and their impact on the chemical analysis of groundwater. Qual. O.” Anal. 2007. 3. It is a “key indicator” of both fitness-for-purpose and reliability of results. Qual. 480–490. Berlin. 2007. “Using validation data for ISO measurements uncertainty estimation.J. 11...” Accred. S.” Crit. Rosslein. “Estimating measurement uncertainty in an afternoon. 37. Van Bockstaele. 1387–1392.E. Williams.L. 2008. Kadis. A case study in the practical application of measurement uncertainty. Assur. 4.. it is necessary to determine the sources and types of uncertainty for individual steps of an analytical procedure. 2004. Uncertainty is a basic property of each measurement. and Barwick... 95–100. Conti.

Uncertainty 75 17. 70.. Bonate.” Pure Appl. 116. “Basic statistical methods for analytical chemistry: Part 2.© 2009 by Taylor & Francis Group.” Analyst. 1992. Prediction and confidence intervals. “Guidelines for calibration in analytical chemistry.N. 993–1014. 531–532. . P.. 1991. 18.A.. J. K. “Concepts in calibration theory: Part IV. Chem.” LC-GC.. Calibration and regression methods.. 1998. 3–14. 19.L. and Currie. Miller. L. 10. LLC . Danzer.

which has been established as fit for its intended use in measurement or in examination of nominal properties.© 2009 by Taylor & Francis Group.1 [9]. The general classification of RMs is presented in Figure 5.5 Reference Materials 5. accompanied by documentation issued by an authoritative body and providing one or more specified property values with associated uncertainties and traceabilities. LLC .1 [8]. 77 . those that have a high and strictly defined level of purity.2 Introduction Reference materials (RMs) play a significant role in all the elements of a quality assurance system that evaluates the reliability of measurement results. Homogeneity — condition of having a uniform structure or composition with respect to one or more specified properties. sufficiently homogeneous and stable with reference to specified properties. or from a single supply unit — within-bottle homogeneity. and a detailed classification of RMs is presented in Table 5. 5. The range of their application is very wide [3–7]: • Validation of analytical procedures. 2] Reference material — material. packages. to maintain a stated property value within specified limits for a specified period. and standard solutions. Stability — ability of a reference material. is found to lie within the specified uncertainty limits. where RMs are used to determine precision and accuracy • Interlaboratory comparisons. as determined by tests on samples of specified size. Certified reference material — reference material. RMs may be divided into pure substances.) — between-bottle homogeneity. the samples being taken either from different supply units (bottles. using valid procedures. where they are applied as subject matter for studies • Estimating the uncertainty of a measurement • Documenting traceability With regard to the function that is used in a measurement process. when stored under specified conditions. RM is said to homogeneous with respect to a specified property if the property value.1 Definitions [1. etc.

or compound) stochiometrically and isotopically certified in amount of substance ratios with total impurities <10 µmol/mol Primary chemicals As above. density Materials characterized for one or more engineering property values (e. e. melting point. viscosity. tensile strength.g. PRM MATRIX-FREE . SecRMs NONCERTIFIED Primary reference materials.Quality control materials. but with limits of <100 µmol/mol Defined purity As above.. LLC . hardness. or surface characteristics) These principal categories are subdivided into subcategories as indicated in the following draft list.Laboratory reference materials. TABLE 5. being either pure chemical compounds or representative sample matrices.1 Classification of reference materials [8].1 Classification of Reference Materials Suitable for Chemical Investigations [9] Parameter Property Chemical composition Additional Remarks Reference materials (RMs).Pure substances . but with limits of <50 µmol/mol Biological and clinical properties Physical properties Engineering properties Miscellaneous Chemical nature Single major constituent .g. Other subcategories can be added at any time to address the needs of applicants seeking recognition of competence in producing types of RMs not currently listed High purity Pure specific entity (isotope. element. characterized for one or more chemical or physicochemical property values Materials characterized for one or more biochemical or clinical property values Materials characterized for one or more physical property values.78 Quality Assurance and Quality Control REFERENCE MATERIALS CERTIFIED MATRIX . either natural or with added analytes (e.Standard solutions FIGURE 5.. animal fats spiked with pesticides for residue analysis).© 2009 by Taylor & Francis Group. LRMs .. QCMs .g.Secondary reference materials.

© 2009 by Taylor & Francis Group. II Described linkage other than to SI No described linkage Primary reference materials Certified reference materials Laboratory reference materials Quality control materials Validation of analytical method Establishing measurement traceability Calibrating an instrument Assessment of a measurement uncertainty Assessment of a measurement method Recovery studies Quality control Preparation of the RM involves the following: • • • • • • • • • • • Material selection Obtaining an appropriate amount of the material Selection and purchase of appropriate containers. sifting. appropriate fraction grain size) Initial examination of the material’s homogeneity Determination of main components Putting the materials into containers Final examination of the material’s homogeneity Disinfection of the material (ensuring its biological stability) Determining humidity Organization of an interlaboratory comparison. in order to carry out a certification process . I. etc. Initial material preparation (grinding. LLC . labels.Reference Materials Parameter Matrix types Additional Remarks Major constituents 79 Traceability 0 Primary class I class II class III class IV class V class Uncertainty of With uncertainty determination value of analyte Without concentration uncertainty value Field of application Major constituents (in matrix) >100 mmol/kg or >100 mmol/dm3 Minor constituents Minor constituents (in matrix) <100 mmol/kg or <100 mmol/dm3 Trace constituents Trace constituents <100 µmol/kg or <100 µmol/dm3 Ultra trace Ultra trace constituents <100 nmol/kg constituents or <100 nmol/dm3 Pure specified entity certified to SI at the smallest achievable uncertainty Certified by measurement against class 0 RM or SI with defined uncertainty (no measurable dependence on matrix) Verified by measurement against class I or 0 RM with defined uncertainty Described linkage to class 0.

stable.1 General Information Certification of RMs is something more than just performing a series of accurate and precise measurements traceable to SI standards or to any other metrological system. It may be achieved in two ways: by sending the same material sample or sending material samples with the same parameters (homogeneous. stable.3 Parameters That Characterize RMs 5. penicillin vials. RMs should be prepared in such a way that they are homogeneous. A certification process involves preparation of a great number of homogeneous. are used mainly for the calibration of measuring instruments and checking analytical procedures [9. It is very important to pay special attention not only to the preparation of stable and homogeneous primary materials.3. and its availability. which are representative parts of a given production batch. and printing the attestation certificate A general procedure for preparing RMs is shown schematically in Figure 5.2 [8]. That is why CRMs occupy a higher position in the “metrological hierarchy. Uncertified RMs. and appropriately packaged samples. including the laboratory RM (cheaper and more available). stable since the moment of production until their use) [9]. It is also recommended to pack the RM samples into appropriate containers in the argon atmosphere (bottles with fillers. precision. The selection of the RM depends on the needs at a given time. which is reflected in their price and thus their availability. RM can perform its function only when each of its users receives a material with exactly the same parameters. or ampoules). One should take into account microbiological degradation.© 2009 by Taylor & Francis Group. and the uncertainty in determination of given parameters. standard deviations. which can be minimized by decreasing the content of water in the material to the level of 1–3% of relative humidity.” The requirements at the production stage. but also to sampling [11]. and have constant characteristics over a sufficiently long period. the type of analytical measurements in which it is going to be used. 10]. 5. calculating means. and the confidence intervals) • Determination of values attested to on the basis of hitherto formulated criteria.80 Quality Assurance and Quality Control • Statistical analysis of the obtained results (rejection of deviating results. according to ISO recommendations. are more rigorous. The parameters that characterize CRMs [12–18] are as follows: • • • • representativeness homogeneity stability certified value . LLC . No certified reference materials (laboratory reference material and material for quality control) and certified reference materials (primary reference material and certified reference material) differ in accuracy. stable during storage.

labels. . breaking down.g. drying..2 A general procedure for certified reference materials preparation — example for solid CRMs [8]. etc.Reference Materials Choosing material Obtaining appropriate amount of desired material Preliminary preparation of material (e. Preliminary evaluation of homogeneity Content determination of main components Distribution of material into containers Final homogeneity determination (inside one container and among containers) Sterilization of material (securing biological stability) Water content determination Organizing interlaboratory comparison conducting certiﬁcation procedure Statistical analysis of obtained results Determining certiﬁed values Printing of certiﬁcate CERTIFIED REFERENCE MATERIAL Continuation of studies on long-term stability 81 FIGURE 5. sieving) Preliminary determination of material’s stability Choosing and purchasing of proper containers.© 2009 by Taylor & Francis Group. LLC .

The stability of the RM is determined by using the analysis of the certified parameters in the samples of materials stored in a so-called reference temperature (with an assumption that in that temperature the composition of the RM does not change) in relation to samples stored in temperatures recommended for a given RM. LLC . It is carried out at the stage of distributing the RM into the appropriate containers.82 Quality Assurance and Quality Control 5. microbiological activity) that may affect its composition [16]. 5. the manner of processing.4 Stability A stability study. the user should be informed about the actual state of the material.3. achievement of the required similarity is not always possible. the value of a given parameter of the material should be stable over the whole validity period.2 Representativeness Representativeness is a property that describes a similarity between individual samples with regard to: • • • • • Matrix composition Analyte concentration Manner of the connection between the analytes and the matrix Type and concentration of interfering substances Physical state of the material For practical reasons. In such cases. next to the homogeneity study. During storage and transportation. humidity.3. 5.3. and how to achieve a representative sample of the material for further analysis.3 Homogeneity Homogeneity study is a comparison of the obtained results for the random samples of the RM. This value should be determined by the manufacturer of the RM and taken into account in the uncertainty budget of the certified value. but in the process of homogenization and stabilization a change may occur in the connection between the analyte and the matrix. oxygen. A user has no influence on between-bottle heterogeneity of the material. plays a decisive role in the production of RMs. Both sources of heterogeneity of reference materials are presented in Figure 5. A material should be homogeneous and stable.3. That is why it is necessary to define the minimum amount (mass) of the RM samples for the study.© 2009 by Taylor & Francis Group. light. However. . There are two types of homogeneity [13]: • Within-bottle homogeneity • Between-bottle homogeneity The influence of within-bottle heterogeneity of the material on the result of the certified value may be eliminated by sampling a greater amount of the material. the RM is exposed to the influence of various external factors (temperature.

for example. The studies are carried out for various temperatures and storage durations. usually stored in a lower temperature. (B) betweenbottle.3 Sources of reference materials heterogeneity: (A) within-bottle. shelf life) • Short-term stability (e..g. and the high repeatability of the measurements.Reference Materials 83 A B FIGURE 5. There are two types of RM stability: [14–16] • Long-term stability (e. stability is determined by comparing the results obtained for samples stored in the recommended conditions and for the reference samples. stability during transportation) Stability studies require the application of fast measurement methods.g. ..© 2009 by Taylor & Francis Group. low-mass samples. LLC . Studying the stability of RMs may be considered in two aspects: • classical (long term) • isochronous In case of the classical stability study. −40°C.

In contrast to pure substances and calibration solutions. methods that give the results directly in units of measurement or methods that allow the result to be expressed in those units through the application of mathematical equations from the appropriate physical and chemical theories • Measurements at a single laboratory using two or more methods. using the absolute methods. an additional stage is required: a complete change or the removal of the matrix. essential for certification [24]. by two or more analysts • Interlaboratory studies using one or several various methods. The final uncertainty value of the CRM. should include all the uncertainty sources described in the following equation [26]: 2 2 2 2 uCRM = ucert + ubott + uls + uss (5. that is. using one or more methods at one or several laboratories. The aim of material certification is to ascribe certain values of individual properties to a group or individual units. and must be documented by a complete uncertainty budget. in which each of the measurement series is carried out with the highest accuracy and traceability.1) where ucert = uncertainty of determining the certified value ubott = uncertainty associated with the within-bottle homogeneity uls = uncertainty associated with the long-term stability uss = uncertainty associated with the short-term stability . In this case. including the absolute methods It must be remembered that certification studies should be carried out by the laboratories with supreme and proven competence. as described in an appropriate ISO norm [19–22].3. Certification is based on material sample analyses. An isochronous stability study is based on deducing the stability of the RM on the basis of analyses of samples stored over a short period (several weeks) and at various temperatures (usually higher than the recommended storage temperature) [16].84 Quality Assurance and Quality Control Such studies are carried out a short time before the hitherto determined expiry date and may result in extending the validity period. The reliability of the obtained results of analytical measurements is a self-evident condition. matrix RMs cannot be certified using direct gravimetric measurement.© 2009 by Taylor & Francis Group. according to the guidelines presented by Guide to the Expression of Uncertainty in Measurement [25]. Thus the following solutions are applied [23]: • Measurements at a single laboratory. LLC .5 Certified Value RM certification is carried out according to strictly determined rules. 5.

iaea. due to the high heterogeneity of matrix compositions and the wide spectrum of analytes present in the examined samples. for example.net Using RMs requires compliance with the rules of good laboratory practice at laboratories that determine the trace components in the examined samples: • It is necessary to comply with the recommendations of the RM manufacturer.comar.virm. a key to the right choice. and help in finding an appropriate RM.© 2009 by Taylor & Francis Group. LLC .Reference Materials 85 5. therefore. Selection of the RM should allow for the following criteria: • • • • • • Availability (the issue of the matrix composition) Concentration range of the reference value Uncertainty value of the reference value Traceability of the reference value Required uncertainty value of the measurement Influence of the CRM uncertainty on the combined uncertainty of the measurement • Quality of the CRM manufacturer (competence. can be found in the following databases available at the Internet websites: http://www-naweb.de http://www.htm http://www. the validity period. concerning the minimum mass of the RM sampled.bam. A good knowledge of analytical procedures and the available materials is.org/nahu/nmrm/nmrm2003/browse. reputation) • Composition of the sample matrix • Price Detailed information concerning the RMs. .4 Practical Application of CRM These are the main issues associated with the application of the RMs [27–30]: • Determination of validation parameters — first of all their precision and accuracy • Examining the skills of an analyst or a laboratory • Routine control of precision and accuracy of the performed determinations • Laboratory accreditation • The quality control of performance of a given laboratory • Estimating measurement uncertainty • Monitoring and ensuring traceability • Calibration of measuring instruments It is not possible to prepare appropriate RMs for all the analytical tasks. and the manner of storage.

2. depending on the information on the two compared values. It seems practical to provide a graphical comparison of the reference (certified) value with the value obtained during the measurement (determined one). Because one of the main problems associated with this process is the interpretation and numerical presentation of the determined parameter. this book presents the basic formulas and correlations that help in selecting the manner of documenting the values of the determined parameters. TABLE 5.2 A Suitable Way of Graphically Comparing the Reference (Certified) Value with the Determined Value Conditions Reference value without providing the uncertainty (not a certified value) Graphical presentation Conclusions Determined value agreed with the reference value Reference value Determined value Conclusion impossible Reference value Reference value with the uncertainty Determined value Determined value agreed with the reference value Certiﬁed value Determined value . together with the associated conclusions are presented in Table 5. RMs are an essential tool for the determination of accuracy and/or precision.86 Quality Assurance and Quality Control • It is necessary to determine the concentration of water (in case of solid materials) for the RM samples taken simultaneously with the RM sample for the study. LLC .© 2009 by Taylor & Francis Group. • The used and nonused RM cannot be placed back into the container. Possible situations.

© 2009 by Taylor & Francis Group.28 μg/g. The certified value given by the manufacturer is 4. μg/g: 1 2 3 4 5 4. Using a graphical method.57 4.76 4. test the agreement of the obtained value with the certified value.64 ± 0.Reference Materials Conditions Determined value without a provided uncertainty Graphical presentation Conclusions Conclusion impossible 87 Certiﬁed value Reference value with the uncertainty Determined value Determined value agreed with the certified value Certiﬁed value Determined value with a provided uncertainty Determined value Determined value not agreed with the certified value Certiﬁed value Determined value Example 5. LLC .94 5.04 4.1 Problem: Five independent determinations of total mercury were carried out for the samples of the certified reference material NRCC-DORM-2 — dogfish muscle.82 . Data: result series.

μg/g: 1 2 3 4 5 6 Solution: Mean SD U (k = 2) 0.37 0. Data: result series.35 0.019 μg/g 0.34 0.2 Problem: Six independent determinations of total mercury were carried out for the samples of the reference material GBW 07601 — powdered human hair.© 2009 by Taylor & Francis Group.38 0.023 μg/g 0.83 μg/g 0.16 μg/g Determined Conclusion: An obtained value agreed with the certified one.18 μg/g 0. Excel file: exampl_RM01.39 0. test the agreement of the obtained value with the assigned value.372 μg/g 0. The assigned value given by the manufacturer is 0.88 Solution: Mean SD U (k = 2) Graph: 6 5 4 3 2 1 0 CRM Quality Assurance and Quality Control 4.40 .36 µg/g Using a graphical method. LLC .xls Example 5.

45 0.2 0.15 0.1 0.© 2009 by Taylor & Francis Group.Reference Materials Graph: 0.3 0.25 0. Excel file: exampl_RM02.2) . and the comparison of the determined values with the certified value.35 0.05 0 89 RM Determined Conclusion: An assigned value is in the range of obtained value ± uncertainty.4 0. The following options are feasible: 1. LLC .xls An alternative solution is to determine the conformity of the reference value with the determined value using appropriate tests. The following condition must be fulfilled: where SDdet = standard deviation for the measurement series for CRM n = number of measurements for CRM UCRM = expanded uncertainty for CRM and xCRM − UCRM < x det < xCRM + UCRM where xdet = determined value xCRM = certified value (5. A comparison of the standard deviation values in the series of measurements for CRM.3) SDdet n < UCRM (5. with the value of expanded uncertainty for CRM.

76 4.83 µg/g 0.4 µg/g.28 μg/g.4 Problem: Four independent determinations of lead were carried out for the samples of the certified reference material NIST-SRM 1633b — coal fly ash. µg/g: 1 2 3 4 70.8 70.2 ± 1. Data: result series. test the agreement of the obtained value with the certified value.xls Example 5. μg/g: 1 2 3 4 5 Solution: xdet SDdet n SDdet n UCRM xCRM xCRM − UCRM xCRM + UCRM 4. LLC . The certified value given by the manufacturer is 68.92 µg/g 4.82 SDdet n < UCRM xCRM − UCRM < xdet < xCRM + UCRM Conclusion: An obtained value agreed with the certified one.6 .94 5.57 4.64 µg/g 4.04 4. Data: result series.4 69.28 µg/g 4. Excel file: exampl_RM03. Using the aforementioned method.2 71.3 Problem: Five independent determinations of total mercury were carried out for the samples of the certified reference material NRCC-DORM-2 — dogfish muscle. Using the aforementioned method.080 µg/g 0.© 2009 by Taylor & Francis Group.18 µg/g 5 0.36 µg/g 4. test the agreement of the obtained value with the certified value. The certified value given by the manufacturer is 4.64 ± 0.90 Quality Assurance and Quality Control Example 5.

5 µg/g 0.© 2009 by Taylor & Francis Group.6 µg/g 91 SDdet n < UCRM xCRM − UCRM < xdet < xCRM + UCRM Conclusion: An obtained value did not agree with the certified one. LLC . that is why it is recommended to use its modified version: where u( xdet ) = combined uncertainty of the determined value u( xCRM ) = combined uncertainty of the certified value 3.8 µg/g 69. The value of parameter t is calculated according to the formula: t= x det − xCRM SDdet n (5.342 µg/g 1. Formula (5.2 µg/g 66. Comparison of the certified value with the determined value.5) . using the uncertainty values for both the values.6) t= x det − xCRM u(2xdet ) + u(2xCRM ) n (5. The following correlations are examined: x det − xCRM < 2 u(2xdet ) + u(2xCRM ) (5.4) does not allow for the uncertainty of the certified value.Reference Materials Solution: xdet SDdet n SDdet n UCRM xCRM xCRM − UCRM xCRM + UCRM 70.68 µg/g 4 0.4 µg/g 68.xls 2. Application of Student’s t test. Excel file: exampl_RM04.4) The calculated value should be compared with the critical value from the distribution values for an appropriate significance level (α) and the number of degrees of freedom f = n − 1.

94 5.323 Conclusion: An obtained value agreed with the certified one. Excel file: exampl_RM05. test the agreement of the obtained value with the certified value.5 Problem: Five independent determinations of total mercury were carried out for the samples of the certified reference material NRCC-DORM-2 — dogfish muscle.2 ± 1.xls Example 5.7) Satisfying the first relation implies conformity of the determined value with the certified value. The certified value given by the manufacturer is 68.28 μg/g.82 4.92 Quality Assurance and Quality Control x det − xCRM ≥ 2 u(2xdet ) + u(2xCRM ) (5.140 0.080 0.186 2 ( xCRM ) xdet − xCRM < 2 u(2xdet ) + u(2xCRM ) xdet − xCRM ≥ 2 u(2xdet ) + u(2xCRM ) +u 0.04 4. Data: result series.6 Problem: Four independent determinations of lead were carried out for the samples of the certified reference material NIST-SRM 1633b — coal fly ash.18 5 0. Using the aforementioned method.83 0.© 2009 by Taylor & Francis Group.64 ± 0. μg/g: 1 2 3 4 5 Solution: xdet SDdet n u( xdet ) u( xCRM ) xdet − xCRM 2 u 2 ( xdet ) 4. .4 μg/g.57 4.76 4. LLC . The certified value given by the manufacturer is 4. and satisfying the second relation denotes the lack of conformity between these values. Example 5.

Trueness value.xls 4.© 2009 by Taylor & Francis Group.9) .56 70. test the agreement of the obtained value with the certified value. μg/g: 1 2 3 4 Solution: xdet SDdet n u( xdet ) u( xCRM ) xdet − xCRM 2 u(2xdet ) + u(2xCRM ) 70.5 0.700 2. • If Z > 2.6 93 xdet − xCRM < 2 u(2xdet ) + u(2xCRM ) xdet − xCRM ≥ 2 u(2xdet ) + u(2xCRM ) Conclusion: An obtained value did not agree with the certified one.4 69. Data: result series. then the determined value agreed with the reference value. which can be calculated as the combined uncertainty of the certified value and the determined value.30 1. then the determined value did not agree with the reference value. The value of the Z score is calculated using the following formula: Z= x det − xCRM s (5. LLC . The application of Z score.8 70. Excel file: exampl_RM06.8) where s is the value of a deviation unit.68 4 0. The reasoning is carried out using the following relations: • If Z ≤ 2.Reference Materials Using the aforementioned method.2 71. can be presented as recovery and should be calculated according to the following equations: R= x det ⋅ 100% xCRM (5.342 0. due to application of CRMs.

94 5.64 0.64 ± 0.140 2 104.xls . calculate trueness as a recovery value for k = 2.28 μg/g.83 4. the calculated value of trueness is acceptable. Excel file: exampl_RM07. The certified value given by the manufacturer is 4. The value of trueness is usually given as: Trueness = R ± U (5.7 Problem: Five independent determinations of total mercury were carried out for the samples of the certified reference material NRCC-DORM-2 — dogfish muscle. Example 5.0% 6.11) and is most frequently expressed in %.94 Quality Assurance and Quality Control U = k⋅ (u 2 ( xdet ) + u(2xCRM ) x det + xCRM 2 ) (5. Using the obtained result.© 2009 by Taylor & Francis Group.8% 4.04 4. LLC .82 Conclusion: A value of 100% is in the range of calculated trueness value.10) The reasoning should be based on the following: if the range R ± U includes value 100%.76 4.18 5 0.57 4. μg/g: 1 2 3 4 5 Solution: xdet xCRM SDdet n u( xdet ) u( xCRM ) k R U 4.080 0. Data: result series.

H.. Kontrola i zapewnienie jakości wyników pomiarów analitycznych. as noted above. 37. version 2. 2004. P. in competence tests. P. 5. T.. However. “A need for clearer terminology and guidance in the role of reference materials in method development and validation. “The role of and place of method validation in the quality assurance and quality control (QA/QC) system.” Mikrochim. 277–281.” Accred.” Accred. T.” Accred. 1993. 442–449. 9. and Lamberty. JCGM 200... 6. Rasberry. Chem. J. It is recommended.” Fresenius J.J. M. 5. B. Joint Committee for Guides in Metrology. Qual.” Chemosphere.M.. R.© 2009 by Taylor & Francis Group. 370. Assur. 11. 1998. 123. J. which is why application of CRMs is usually limited to the verification of analytical procedures and only in some exceptional case to calibration (in comparative methods). 8. 23(6). Linsinger.N..P. “Reference materials: terminology and use. Assur. “CRMs for the 21st century: new demands and challenges. Anal...Reference Materials 95 Due to a limited number of CRMs. 2.. Schimmel. Their application. 539–542. Due to financial limitation... 2008. “A test atmosphere generation system for particle-bound PNA: development and use for evaluation of air sampling methods. 9. A. S.M. 2003. “Reference materials — an industry perspective. 20–25 (2001).. Pauwels. International vocabulary of metrology — Basic and general concepts and associated terms (VIM).. Kramer.P. eds. 111–114. RMs should be stored in conditions that guarantee the stability of their composition over the whole period of use. 1998. Lipp. 173–190. 8. 27. Majcen. Warszawa. is necessary in any laboratory. 1996. RMs must be applied in a rational way.. monitoring. and Pauwels. Anal.J. Van der Veen.5 Conclusion Production and certification of RM is very costly. 2001.. Chem.” Fresenius J. Konieczka. nor in interlaboratory comparisons. 6. and Lamberty. 87–93.. “The preparation of biological and environmental reference materials. Anal. however. 2307–2315. 10. and Otson. Assur. a widely known standard addition method is applied as an alternative means of determining trueness. Pauwels. LLC . Chem. P. LGC/VAM.H... 2004. References 1. J. Qual. “Reference materials in the world of tomorrow... it is not recommended to use CRMs for a routine intralaboratory statistical control.. and do not nullify the remaining elements of the quality system. Acta. Linsinger. H. it must be said that using CRM in a laboratory does not automatically ensure the obtainment of reliable results... Can’t one see the forest for the trees?” Trends Anal. Emons. A. Rev. . 4. 2007 (in Polish).D. 360. G.” Crit. Qual. 2007. Chem. 108–122. A.. 12. WNT. and ensuring the quality of analytical measurement results... and Gawlik. and Namieśnik. 3. CRMs play a crucial role in the system of estimation. “Homogeneity and stability of reference materials. Konieczka. N. Guidelines for the in-house production of reference materials.. Fellin. J. 7..

J. 454.M.” Accred. S.H. Caroli. and Kramer.. Anal. “The study of the stability of reference materials by isochronous measurements.. Lamberty.P. LLC .” Anal.. Mn.. Chem.. Assur. 16. “Certified reference materials for research in Antarctica: the case of marine sediment. 249–257. Lamberty..” Accred. “Some difficult problems still existing in the preparation and certification of CRMs. and Iamiceli.. 290–294..P. 27.. F. Linsinger... H. G.H. 59. “Uncertainty calculations in the certification of reference materials. 2000. Geneva.. J.. 2000.” Accred. 244–250. ISO.” Fresenius J. Qual.H. Schimmel. Lamberty..A. J. 21. ISO Guide 31. ISO Guide 30. “Uncertainty calculations in the certification of reference materials. . Forte. Lamberty. and Tack. Van der Veen.. 2001. 29... Geneva.L. Van der Veen.” Fresenius J. Van der Veen. G.. Sutherland. A. and Siekmann. Schimmel.H. 6. 395–399. C. Chem. H. A.M. Principles of analysis of variance.. “Evaluation of uncertainty of reference materials.. Dybczyński. 361–411. A. “ICP-AES and ICP-MS quantification of trace elements in the marine macroalga Fucus sample. “Determination of Al. R.J.J.” Accred.. Anal. Chem. J. G. A. 464– 469... Veen... Homogeneity study. 28. ISO Guide 35.. 14. 30.... 2000. Cu. and Schimmel. and Pauwels. 1998. Characterisation and certification. G.. 1998. 136–143. 26–30. 62. 360. H. Assur. Guide to the Expression of Uncertainty in Measurement (GUM)... a new candidate certified reference material. 1999. Quality system guidelines for the production of reference materials. 368. 126–130. 1977. 6.. 1992. A. 2001.96 Quality Assurance and Quality Control 13. J. Pauwels. 95–99. and Zn in certified reference materials using the optimized BCR sequential extraction procedure.1Lamberty. A.M. Fe. Geneva.” Fresenius J. Danko. and Pauwels.M. Chim. ISO. Lamberty.H. Chem.. A. 2002. Pauwels.P. 5. 1998. Assur... 2001.. and Schimmel. H. 5. J. and Gravatt.. Linsinger..C. 24. 17. “Quantification of the expected shelf-life of certified reference materials.. 361. and Pauwels. H.. Uriano. Certification of reference materials. Van der Veen. 6. A.. 25.. “Uncertainty calculations in the certification of reference materials. A.J. 2001. 23. Pauwels. A.. General and statistical principles. L. “Uncertainty calculations in the certification of reference materials. Trends and definitions used in connections with reference materials. 19. Rev.. S. 1. and Polkowska-Motrenko. 20. Pauwels.” Fresenius J. Assur. 1996. Anal.. T.. H. 22. Qual. J. S. Schimmel. T. Qual. Caimi. Assur..G. P. 3.” Accred. Anal..” Crit..© 2009 by Taylor & Francis Group.. “Estimation of the CRMs in accordance with GUM: Application to the certification of four enzyme CRMs. “The role of reference materials and reference methods in chemical analysis. J. Linsinger.M. 2000. Anal.” Microchem. Schumann. J.. 15.N. Qual. 257–263. 18. Robouch. Stability study. J. 26. R. A. 589. J.. 1989. T. O.” Microchem.. 1993. Senofonte... B.. Linsinger. 6.. and Pauwels. Geneva.M. ISO Guide 34. Qual. Pb. Chem.A. 2. 370. Geneva. Reference materials — Contents of certificates and labels.. Van der Veen. T. Acta. Caroli. and Pauwels. 4. A. 359–361. ISO. A.

Method performance study — interlaboratory research in which all participants act according to the same protocol and use the same test procedures to determine the characteristic features in a batch of identical test samples. Participation in these programs gives a laboratory a chance to compare its results with those obtained by other laboratories and to prove its competence. analyte concentration) in a tested material or a given sample. which can be especially significant for laboratories with accreditation or those applying for accreditation. usually with a determined uncertainty. undertake rectifying action [4].g. LLC . 97 . Ensuring a suitable quality of analytical results is essential because of the negative implications of presenting unreliable measurement results. Moreover. Certification study — a study that assigns a reference value to a given parameter (e. performance. and in the case of error detection.1 Definitions [1. participation in analytical interlaboratory comparative studies gives a laboratory a chance to search and detect unexpected errors using comparison with external standards and its own previous results. One of the most crucial means of that monitoring is participation in various interlaboratory studies [3]. 2] Interlaboratory comparisons — organization. A generalized scheme for conducting interlaboratory studies is shown in Figure 6.© 2009 by Taylor & Francis Group. Proficiency testing — determination of laboratory testing performance by means of interlaboratory comparisons.2 Introduction Demand for results as a source of reliable analytical information poses new challenges for analytical laboratories: they need to be especially careful in documenting the results and the applied research methods.1 [5]. 6.. and evaluation of tests on the same or similar test items by two or more laboratories in accordance with predetermined conditions.6 Interlaboratory Comparisons 6. The way to realize this goal is to implement a suitable quality assurance system at a laboratory through constant monitoring of the reliability of the analytical results and calibration.

98 Quality Assurance and Quality Control PROJECT Deﬁning an aim Choosing an organizer Choosing a sample Selecting participants Choosing analysis/study type IMPLEMENTATION Sample preparation Sending samples to participants Analysis of samples Sending the analysis results EVALUATION Analysis of results Sending evaluation results to participants REPORT FIGURE 6.3 Classification of Interlaboratory Studies Interlaboratory studies are organized to: • • • • • • Assess the reliability of measurement results Gain experience Increase the quality of conducted analytical determinations Create possibilities for proving the competence of a given laboratory Better understand the applied procedures Determine validation parameters .© 2009 by Taylor & Francis Group. LLC .1 A generalized outline for conducting interlaboratory studies [5]. 6.

it is possible to compare a few procedures. The obtained results are applied in estimating the characteristic parameters of the procedure: • • • • • • • Intra. and determinations as well as other details of the study are presented in the research protocol prepared by the organizer of the study. Interlaboratory comparisons may also be classified according to the aims and range of studies. This research may be conducted among laboratories that are . This may include the following: • • • • Method performance study Competence study Certification study Proficiency testing Method performance study is an interlaboratory comparison in which all participants act according to the same protocol and use the same test procedures to determine the characteristic features (specified in the protocol) in a batch of identical test samples. Accredited laboratories are obliged to provide certificates of participation in such programs. test samples. • The number of participants.Interlaboratory Comparisons 99 Laboratories that wish to confirm their competence should participate in at least one program of interlaboratory research. both on a national and international scale. with regard to the composition of the matrix. Competence study is a research in which one or more analyses are carried out by a group of laboratories using one or more homogenous and stable test samples and using a selected or routinely used procedure by each of the laboratories participating in the interlaboratory comparison. LLC . all participating laboratories apply the same set of guidelines for each procedure. it is necessary to conform to the following requirements: • The composition of the applied material or sample is usually similar to that of the materials or samples subjected to routine studies. The obtained sample results are compared with the results obtained by other laboratories or with a known or determined (guaranteed) reference value. • By using the same materials or test samples. analyte concentration.© 2009 by Taylor & Francis Group. and the statistical analysis of the obtained sets of results is conducted separately for each of the procedures. and the presence of interferents (research participants are usually informed about the composition of the matrix for the examined samples).and interlaboratory precision Systematic error Recovery value Internal parameters of quality assurance Sensitivity Limit of detection Applicability limit In this type of research.

analyte concentration. The choice of test material should be influenced by the maximum degree of similarity of the composition of samples. Proficiency testing may be conducted on the basis of the same material analysis. LLC . with regard to the mean level of analyte concentration and the homogeneity degree. In this case. under which the participant remains anonymous to the rest of the group. Proficiency testing is the most frequently conducted type of interlaboratory research. the participants do not know that these are proficiency studies and that the obtained samples are to be analyzed in a routine fashion [6]. Proficiency research is a tremendous challenge for laboratories that need to apply for accreditation based on the presentation of confirmation of their own competence. Certification study is a study that assigns a reference value to a given parameter (e. In the latter case. usually subjected to analysis with regard to the matrix composition and the level of analyte concentration. Such a material must be tested before it is distributed to the participants. It is a significant element in achieving and maintaining a suitable quality of results.100 Quality Assurance and Quality Control accredited or applying for accreditation in order to control the quality of determinations and the proficiency of researchers.g. physical property) in a tested material or a given sample. and a specific analytical procedure. There are six ways to enable the determination of the reference value [7]: • • • • • Measurement by a reference laboratory Certified value for CRM used as a test material Direct comparison of the proficiency test (PT) test material with CRM Consensus value from expert laboratories Formulation value assignment on the basis of proportions used in a solution or other mixture of ingredients with known analyte contents • Consensus value from participating laboratories . In the case of closed research. This research is usually carried out by laboratories with a confirmed competence (reference laboratories) to test the material. Proficiency testing may be conducted as an open (public) or a closed study (not public). using a procedure that ensures the estimation of the concentration (or any other parameter) with the smallest error and the lowest uncertainty value. In proficiency testing. These studies are conducted to test the achievements and competence of both the individual analysts using a given analytical procedure or measurement.© 2009 by Taylor & Francis Group. sample of the material being provided to all the participants at the same time for a simultaneous study or a round-robin test. the applied analytical procedure may be a top-down decision or the organizer may limit the choice to a prepared list.. Each laboratory is assigned an identification number. which is a candidate for the reference material. The obtained results are compared with the previously determined guaranteed (reference) value. some problems with the stability and homogeneity of samples may occur due to the spread of the studies over a longer time. the competence of participating laboratories is verified based on the determination of results of specified components in distributed samples (materials). usually with a determined uncertainty. which is why it is important to pay it a little more attention.

a thorough analysis of an analytical process. 6. LLC . the so-called key comparisons. it is necessary to check the work of individual laboratories because it gives them a chance to estimate the reliability of the analytical results of a given research team. It gives laboratories a chance to improve their competence. With regard to conditions. In the case of results distinctly deviating from the assumed range of acceptable results. • Subsamples randomly selected from a large batch of homogeneous material or test samples are simultaneously distributed to participating laboratories (the most popular type of proficiency testing). to check if the sample has not changed in an undesirable fashion. a sample may be taken back to the coordinating laboratory before a test by a subsequent participant. The achievement of these aims requires a painstaking and reliable organization of this research. It generally takes a long time before the participants get to know the obtained results. Moreover. with the cooperation of a control center.© 2009 by Taylor & Francis Group. proficiency testing is unusually time consuming. Taking into consideration the sample preparation used by participating laboratories. • Those examining the competence of laboratories during the performance of various types of analyses.Interlaboratory Comparisons 101 Sometimes. In this case. correct the hitherto existing mistakes. .4 Characteristics and Organization of Interlaboratory Comparisons As one can gather from this current discussion. After the initial research. • Product or material samples are divided into several parts and each participant receives one part of each sample (this type is called the split sample study). the participants try to find the causes of such discrepancies. each of the aforementioned types may be divided into three further categories: • Samples circulate successively from one laboratory to another. Moreover. there are two main types of proficiency studies: • Those examining the competence of the group of laboratories using the results from specifically defined types of analyses. interlaboratory comparisons are retrospective studies. proficiency testing accounts for only a small percentage of analyses conducted by laboratories and therefore does not reflect the full picture of routinely performed studies. produces a precise localization of sources and causes of errors and hence an improvement in the quality of analytical results. pilot studies are implemented to select the participants with suitable qualifications to participate in the actual proficiency studies. all participants gather to discuss the obtained results. which is why proficiency testing may not affect any decision on quality management. There are certain limitations associated with performance and participation in proficiency testing. and improve their performance in the next proficiency test. First of all. In reality.

the general mean (or reference value) is marked along with the determined uncertainty value. Diagrams of this type are usually presented in final reports by the organizers of interlaboratory comparisons and proficiency tests. The diagrams make it possible for participants to see how their results relate to the results provided by other participants. one may effectively use laboratory reference materials (LRM). 6. laboratory codes are marked. the individual results obtained by the laboratories and the uncertain values. assigning each result a code corresponding to the code number of the laboratory. and/or the applied procedures. make a diagram showing the distribution of individual determination results. To this end. Their production and certification is usually very expensive.© 2009 by Taylor & Francis Group.102 Quality Assurance and Quality Control Reference materials are a necessary tool to conduct interlaboratory comparisons. production. LLC . in the case of comparative methods. therefore the use of certified reference materials (CRM) should be limited to the verification of analytical procedures and. On the X axis. All reference materials should fulfill basic requirements with regard to similarity. a graph may be constructed where the results are marked from the lowest to the highest.5 Presentation of Interlaboratory Comparison Results: Statistical Analysis in Interlaboratory Comparisons The first stage of interlaboratory research result processing is the graphical presentation of results [8–11]. Due to economic reasons in interlaboratory comparisons. it should be limited to the calibration of the control and measuring instruments.1 Problem: For a given series of measurement results obtained by various laboratories and a given reference value and its uncertainty.8 14 16 10 11 14 18 . Data: results: Data lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 123 111 128 138 121 123 188 114 u 11 9. Detailed information on the characteristics. They are also a precious source of information for a potential customer or the accreditation office. homogeneity. and stability over a sufficiently long time. and implementation of the reference materials is presented in Chapter 5. On the Y axis. Example 6. and (optionally) the number of performed independent determinations.

the accuracy (and/or precision) of .© 2009 by Taylor & Francis Group. Respective documents define the precise manner of conduct for a specified type of research.Interlaboratory Comparisons lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 Solution: xref uref 250 230 210 190 xLab 170 150 103 188 122 121 142 125 132 129 121 198 131 158 193 122 111 23 15 11 13 12 17 19 21 28 14 18 13 14 17 140 11 130 110 90 70 Lab 2 Lab 22 Lab 8 Lab 5 Lab 11 Lab 16 Lab 10 Lab 21 Lab 1 Lab 6 Lab 13 Lab 3 Lab 15 Lab 18 Lab 14 Lab 4 Lab12 Lab 19 Lab 7 Lab 9 Lab 20 Lab 17 Lab Code 50 Excel file: exampl_PT01. The ultimate aim of all types of studies is to determine. and the selection of suitable tests and solutions depend on the type of research. LLC .xls The manner of conducting a statistical analysis of results obtained in interlaboratory comparisons. based on experimentally obtained numerical data.

8. On this basis. compare various procedures. for example. The accuracy of a given measurement procedure may be determined by comparing the assumed reference value with the mean value of results obtained using the said procedure. and conduct certification of the material or validation of a specified procedure. Example 6. the first of which is the number of results. and compared various tests used for outlier rejection.© 2009 by Taylor & Francis Group. Data: results: Data lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 123 111 128 138 121 123 188 . one may draw conclusions on the applied procedure and on the characteristics of the analyst. There are many reports in which authors critically examined.104 Quality Assurance and Quality Control measurement procedures. To this end. the distribution type is examined. analyzed. Elimination of outliers is especially crucial in a situation where the material used in the interlaboratory research is a material for which the reference value is determined based on the results of the very research. median. One checks if the occurrence of doubtful or deviating values may be explained by technical errors. The choice of a suitable test is conditioned by many factors. one may use the arithmetical mean. The normality of the distribution may be examined using. or the Hampel test. one may use the statistical tests of Cochran and Grubbs [12]. also called the Huber test [10. At the initial processing of data provided by the participants of interlaboratory comparisons. The next step in statistical analysis is to eliminate any deviating results. there are two useful methods of describing precision: repeatability and reproducibility of results obtained using the specified analytical procedures. when it is a certification study. or when the subject of the comparisons is not the reference material. a Kolmogorov-Smirnov test (Section 1. LLC . A large number of doubtful and/or deviating values (outliers) may suggest a significant discrepancy of the variance values or significant differences in the competence between individual laboratories participating in the project. In recording the variability of the results obtained using a given procedure. for example. Depending on the type of measurements and the requirements for the results. or lastly may question the suitability of the selected measurement procedure. using the Hampel test. Precision is associated with the conformity of the series of results. 12]. or the Winsorized mean (parameters presented and defined in Chapter 1).18).2 Problem: Find outliers in a given series of measurement results obtained by various laboratories.

5 15.5 71.5 4.Interlaboratory Comparisons lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 Solution: |ri| lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 Excel file: exampl_PT02.5 2.5 3.5 1. LLC .5 4.© 2009 by Taylor & Francis Group.5 66.5 5.5 15.5 61.5 11.5 Data 123 111 128 138 121 123 188 114 188 122 121 142 125 132 129 121 198 131 158 193 122 111 Outlier or Not OK OK OK OK OK OK Outlier OK Outlier OK OK OK OK OK OK OK Outlier OK Outlier Outlier OK OK 114 188 122 121 142 125 132 129 121 198 131 158 193 122 111 105 .5 5.5 5.5 5.5 31.5 61.5 4.xls 3.5 12.5 15.5 1.

5 13.40 13.6 13.47 12.9 11.3 Problem: Find outliers in the given sets of measurement results obtained in interlaboratory comparisons.8 11.8 11.093 0.4 Problem: Find outliers in the given sets of results obtained in interlaboratory comparisons from Example 6.1 12.6 14.7 Conclusion: Result obtained by laboratory “lab 6” is correct. Use the Cochran test to examine the intralaboratory variability.53 n p C C0.6 12.4 13.66 0.65 0.5 14. LLC .4 11.0 14.463 0.33 11.01 SD 0.05 C0.443 12.73 13.1 12.43 13.70 11. Apply the Grubbs’ test for one outlier to examine the interlaboratory variability. Data: results: lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 Solution: Mean lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 12.© 2009 by Taylor & Francis Group. .67 3 8 0.106 Quality Assurance and Quality Control Example 6.423 0.4 12.68 0.31 0.1 12.615 SD2 0.3.516 0.8 12.82 0.1 11.10 12.070 0.583 0.8 13.670 0. Excel file: exampl_PT03.1 11.76 0.211 0.1 12.26 0.0 13.1 10.6 13.430 0.xls Example 6.

688 min 2.53 3 8 12.7 107 Conclusion: Result obtained by laboratory “lab 5” is correct.0 14.70 11.8 13.5 14.4 11.1 10.© 2009 by Taylor & Francis Group.1 12. Excel file: exampl_PT04.126 12.xls To simultaneously determine the standard deviation as the measures of repeatability and reproducibility. LLC .5 13.73 13.8 12.8 11.274 2.4 12.33 11.01 G0.1 11. The obtained numerical data are divided into m groups according to their origin (m is the number of laboratories).43 13.Interlaboratory Comparisons Data: results: lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 Solution: lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 n p xm s Gp min/max G0.6 13.1 12.40 13.1 12.8 11.9 11.6 13.588 0.4 13.6 12.1 11.6 14.0 13. This analysis serves to verify the hypothesis that the means in the groups are identical against the alternative hypothesis (at least two means are different).47 12. When significant differences are found between the values of random errors (statistically significant differences in the variance values).1 12. .05 Mean 12.881 1. one may perform a one-factor (one-dimensional) variance analysis (ANOVA).10 12.

that is. the standard deviation being the measure of the respective variances.and intergroup degrees of freedom and calculate the standard deviation within individual groups and among the groups. characterizing the results obtained by using an analytical procedure. the total sum of the squared deviations from all measurements from the mean. Use Z score. The numerical value of the Z score parameter depends on the number and the type of data available to an analyst: • When only the mean values obtained from participating laboratories are known. consists of a few errors that are summed up according to the law of error propagation. the value of the parameter t(α. the reference values and the standard deviation sample are calculated according to all the results as the mean value and standard deviations after.5 Problem: In the series of measurement results given in Example 6. on the number of laboratories participating in the research.108 Quality Assurance and Quality Control the data are joined into groups for which the variance values are not statistically significantly different. The manner of calculating this parameter has been described in detail in Chapter 1 (Section 1.© 2009 by Taylor & Francis Group. find which results are satisfactory. Draw a graph with Z score values for each laboratory. of course. Situations in which a single factor completely explains a given phenomenon are rare.1. It shows that the interlaboratory studies should involve at least five laboratories. The essence of variance analysis is the division of the total variability. Data: results: Data lab 1 lab 2 lab 3 lab 4 lab 5 .15). with the identical value of the variance SD2.8. Below 4 degrees of freedom. The reliability of conclusions depends. LLC 123 111 128 138 121 . or when for some reason one expects deviation of the obtained measurement results from the normal distribution. The number of parallel determinations that is greater than 5 occurs only in special cases. Then one should determine the total intra. and which are unsatisfactory. The parameter that is most often used to evaluate the obtained results in interlaboratory comparisons is the Z score parameter. which are questionable. by the sum of squares describing the variability within groups and the sum of squares describing the variability among groups. An essential condition for conducting a correct interpretation of results for this analysis is the normal distribution of the population from which the samples were taken. The lower influence on the size of the certainty range is exerted by the number of parallel analyses conducted at a given laboratory. f ) increases considerably and the precision of the evaluation decreases. Example 6. and then the variance analysis is conducted for each group. A total error. to a great extent. rejecting the outliers.

16 −1. LLC 109 123 188 114 188 122 121 142 125 132 129 121 198 131 158 193 122 111 Conclusion Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Unsatisfactory Satisfactory Unsatisfactory Satisfactory Satisfactory Questionable Satisfactory Satisfactory Satisfactory Satisfactory Unsatisfactory Satisfactory Unsatisfactory Unsatisfactory Satisfactory Satisfactory 124.28 −0.40 8.Interlaboratory Comparisons lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 Solution: Z lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 −0.58 0.08 0.22 7.51 −0.43 1.4 8.90 0.10 −0.08 0.69 0.55 −0.40 2.51 −1.61 −0.97 8.16 7.40 −0.© 2009 by Taylor & Francis Group.5 .78 3.58 xm SD .28 −1.

Use Z score.00 0.00 2. find for a given reference value which results are satisfactory.00 Lab 22 Lab 11 Lab 16 Lab 10 Lab 21 Quality Assurance and Quality Control Lab 13 Lab 15 Lab 18 Lab 14 Lab12 Lab 19 Lab 20 Lab Code Excel file: exampl_PT05.00 8.xls • Known mean values obtained by participating laboratories and known reference value — the value of standard deviation is calculated according to the total set of measurement results — obviously after outliers are rejected. which are questionable.1.00 –2. LLC Lab 17 Lab 2 Lab 8 Lab 5 Lab 1 Lab 6 Lab 3 Lab 4 Lab 7 Lab 9 –4.00 . Draw a graph with Z score values for each of laboratory. and which are unsatisfactory.© 2009 by Taylor & Francis Group. Example 6.6 Problem: In the series of measurement results given in Example 6.110 Graph: 10. Data: results: Data lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 123 111 128 138 121 123 188 114 188 122 .00 Z-score 4.00 6.

LLC .Interlaboratory Comparisons lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 xref Solution: SD Z lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 −2.07 5.24 6.42 −0.67 −2.01 −3.24 −2.5 Conclusion Questionable Unsatisfactory Satisfactory Satisfactory Questionable Questionable Unsatisfactory Unsatisfactory Unsatisfactory Questionable Questionable Satisfactory Satisfactory Satisfactory Satisfactory Questionable Unsatisfactory Satisfactory Questionable Unsatisfactory Questionable Unsatisfactory 121 142 125 132 129 121 198 131 158 193 122 111 140 111 .67 −3.13 6.13 −2.42 −1.24 0.© 2009 by Taylor & Francis Group.24 −1.13 −3.06 2.42 8.26 −2.77 −0.30 −2.24 −2.85 −1.94 −1.01 5.

and the value of the reference combined uncertainty for a given material. Use Z score.112 Graph: 8.00 0.00 4. questionable.1.00 –4. find which of the results are satisfactory.© 2009 by Taylor & Francis Group. or unsatisfactory. Data: results: Data lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 123 111 128 138 121 123 188 114 188 . LLC Lab 17 Lab 2 Lab 8 Lab 5 Lab 1 Lab 6 Lab 3 Lab 4 . Example 6.7 Problem: In the series of measurement results given in Example 6.xls • Known mean values obtained by participating laboratories and known reference values.00 –2.00 6. for the given reference value and the combined uncertainty reference value.00 Quality Assurance and Quality Control Lab12 Lab 19 Lab 7 Lab 9 Lab 20 Lab 22 Lab 11 Lab 16 Lab 10 Lab 21 Lab 13 Lab 15 Lab 18 Lab 14 Lab Code Excel file: exampl_PT06.00 Z-score 2. Draw a graph with the Z score values for each laboratory.

27 −0.Interlaboratory Comparisons lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 xref uref Solution: Z lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 −1.64 −1.64 Conclusion Satisfactory Questionable Satisfactory Satisfactory Satisfactory Satisfactory Unsatisfactory Questionable Unsatisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Unsatisfactory Satisfactory Satisfactory Unsatisfactory Satisfactory Questionable 122 121 142 125 132 129 121 198 131 158 193 122 111 140 11 113 .00 −1.© 2009 by Taylor & Francis Group.73 5.73 0.36 4.09 −0.18 −1.64 4.73 −1.73 −1.36 −0.18 −1.36 −1.55 −2.82 −1.82 1.64 −1. LLC .64 −2.36 −2.55 4.

8 Problem: In a series of measurement results given in the Example 6. taking into consideration the combined uncertainty reference value.00 –2.00 1.8 14 16 10 11 14 18 23 15 .00 –1. Data: results: Data lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 123 111 128 138 121 123 188 114 188 122 u 11 9.00 Lab 2 Lab 22 Lab 8 Lab 5 Lab 11 Lab 16 Lab 10 Lab 21 Lab 1 –4. Example 6.00 Quality Assurance and Quality Control Lab 6 Lab 13 Lab 3 Lab 15 Lab 18 Lab 14 Lab 4 Lab12 Lab 19 Lab 7 Lab 9 Lab 20 Lab Code Excel file: exampl_PT07. Draw a graph with the Z score values for each laboratory.xls • Known mean values obtained in participating laboratories and known value of the reference combined uncertainty for a given material. LLC Lab 17 .00 3.00 0.00 –3.© 2009 by Taylor & Francis Group.1.114 Graph: 6. use Z score.00 5.00 Z-score 2.00 4.

51 0.© 2009 by Taylor & Francis Group.23 1.70 −1.09 −1.40 −0.11 −1. LLC .93 −0.85 3.Interlaboratory Comparisons lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 xref uref Solution: Z lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 −1.28 −1.43 Conclusion Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Questionable Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Unsatisfactory Satisfactory Satisfactory 121 142 125 132 129 121 198 131 158 193 122 111 140 11 11 13 12 17 19 21 28 14 18 13 14 17 115 .01 −1.80 1.97 −1.88 −0.50 −0.10 −1.97 −0.92 −0.09 2.67 −0.12 −0.22 0.

00 0.00 –3. It is calculated in instances when participants of a given study use various methods to evaluate the obtained results. It is assumed that: • If ε ≤ x . LLC Lab 2 Lab 22 Lab 5 Lab 8 Lab 11 Lab 1 Lab 6 Lab 21 Lab 10 Lab 13 Lab 16 Lab 3 Lab 18 Lab 15 Lab 14 Lab 4 Lab12 Lab 19 Lab 9 Lab 17 Lab 7 Lab 20 Lab Code –4. It is calculated using the formula: where ε = relative error (%) x lab = value of the result obtained by a given laboratory xref = reference value Evaluation of the obtained results is obvious in this case and depends on the range of analyte concentrations in a given sample.© 2009 by Taylor & Francis Group.xls Another parameter of the individual examination of measurement results is relative error.00 .00 –1.00 –2.00 Quality Assurance and Quality Control Excel file: exampl_PT08. assumed as a limit (permissible). the evaluation is satisfactory • If ε > x .00 Z-score 1. ε= ( xlab − xref ) 100% xref (6. and therefore there is no ground to assume a common value of the sample. the evaluation is not satisfactory where x denotes the relative systematic error (relative deviation).00 3.00 2.116 Graph: 4.1) .

1.0% . calculate the values of the relative errors and make an evaluation for the permissible error value ±20%. LLC .7 −8.1 34.Interlaboratory Comparisons 117 Example 6.3 Conclusion Satisfactory Unsatisfactory Satisfactory Satisfactory Satisfactory Satisfactory Unsatisfactory 123 111 128 138 121 123 188 114 188 122 121 142 125 132 129 121 198 131 158 193 122 111 140 20.1 −20.6 −1.© 2009 by Taylor & Francis Group.4 −13. Data: results: Data lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 xref x Solution: ε. % lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 −12.9 Problem: From the data given in Example 6.6 −12.

the standardized Z coefficient.6 41.8.7 −7. An opposite situation is possible — a result closer to the mean (compared with another result from a given series) but with the smaller value of extended uncertainty.9 −13.10 Problem: For the data given in Example 6.© 2009 by Taylor & Francis Group. En is a parameter that is decidedly less restrictive than.16).6 34. but within the accepted interval. Data: results: Data lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 123 111 128 138 121 123 188 114 u 11 9. for example.4 12.9 37.8 14 16 10 11 14 18 .7 Quality Assurance and Quality Control Satisfactory Unsatisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Unsatisfactory Satisfactory Satisfactory Unsatisfactory Satisfactory Unsatisfactory The next parameter for the individual evaluation (for each of the laboratories) of obtained results is En.7 −5.118 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 Excel file: exampl_PT09.3 −12.9 −20. Example 6. apply En Score. The method of its determination is described in detail in Chapter 1 (Section 1.6 1. solely attributable to the high value of the extended uncertainty.9 −13. may be considered an outlier.4 −10.1.9 −12.4 −6.xls −18. LLC . because of the inclusion of the uncertainty value. Results that are deemed satisfactory may include values significantly deviating from the mean.

97 −1.92 −0.28 −1.09 −1.23 1.67 −0.10 −1.11 −1.Interlaboratory Comparisons lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 xref uref Solution: lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 Excel file: exampl_PT10.22 0.01 −1.12 −0.43 Conclusion Unsatisfactory Unsatisfactory Satisfactory Satisfactory Unsatisfactory Unsatisfactory Unsatisfactory Unsatisfactory Unsatisfactory Satisfactory Unsatisfactory Satisfactory Satisfactory Satisfactory Satisfactory Satisfactory Unsatisfactory Satisfactory Satisfactory Unsatisfactory Unsatisfactory Unsatisfactory 188 122 121 142 125 132 129 121 198 131 158 193 122 111 140 11 23 15 11 13 12 17 19 21 28 14 18 13 14 17 119 .50 −0.40 −0.88 −0.51 0.xls En −1.85 3.93 −0.09 2.97 −0. LLC .70 −1.© 2009 by Taylor & Francis Group.80 1.

120 Quality Assurance and Quality Control 6. Whiskermax. Then. Whiskermin.5. and which procedure yields more accurate data. if the calculated value is equal to q1. . In the graphical presentation of results. not smaller than the limit equal q3 + 1. the maximum value in the set of results. the minimum value in the set of results. a diagram (plot) is drawn (separately for a given set of results). as 1. in the following manner: 1. for a given series marked by one point on the 0X axis. box plots may be used. for each subset. after which they are all put into one diagram. separate plots are drawn. On the same plot. if the calculated value is equal to q1. the values of median and quartiles (q1 and q3) are marked — it is a so-called box area representing the middle 50% of the data. each containing results obtained using a specific analytical procedure.1 Comparisons of Results Obtained Using Various Procedures In this type of comparison. not smaller than the limit equal q1 – 1. one may examine if the results obtained using various analytical procedures differ among themselves in a statistically significant way. then whiskermin is not marked on the diagram. Due to the type of construction of the graph. it is possible to conclude which of the analytical procedures were used more often. Based on data for which the diagrams (plots) are drawn. Results out of this range (lower than whiskermin or higher than whiskermax) are marked as outliers. b.© 2009 by Taylor & Francis Group. whiskers. In drawing such a plot. LLC . one should divide all the measurement results obtained for a given sample into subsets.5 · IQR. whiskers are marked as: a. 2. the difference between q3 and q1 • Determination of maximum values. 3.5 · IQR. then whiskermax is not marked on the diagram. On the 0Y axis.5 times the IQR Based on calculated values. one calculates the essential values based on the following reasoning: • Ordering the result in a nondecreasing sequence • Determination of median and quartiles: first (q1) and third (q3) • Determination of the interquartile value (IQR).

5 121.3 141.0 19.5 × IQR q3 + 1.© 2009 by Taylor & Francis Group. Data: results: Data lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 Solution: Median q1 q3 IQR 1. construct a box plot graph.5 × IQR q1 − 1.1.11 Problem: For the data given in Example 6. LLC .6 91.6 111 198 111 158 123 111 128 138 121 123 188 114 188 122 121 142 125 132 129 121 198 131 158 193 122 111 u 11 9.6 170.5 × IQR min max whiskermin whiskermax 126.Interlaboratory Comparisons 121 Example 6.8 29.8 14 16 10 11 14 18 23 15 11 13 12 17 19 21 28 14 18 13 14 17 .

122 xlab lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 lab 14 lab 15 lab 16 lab 17 lab 18 lab 19 lab 20 lab 21 lab 22 Graph: 180. LLC .0 140.0 0.0 80.0 100.© 2009 by Taylor & Francis Group.0 Quality Assurance and Quality Control Outlier or Not OK OK OK OK OK OK Outlier OK Outlier OK OK OK OK OK OK OK Outlier OK OK Outlier OK OK 123 111 128 138 121 123 188 114 188 122 121 142 125 132 129 121 198 131 158 193 122 111 WhiskerMAX Q3 Median Q1 WhiskerMIN xLab .0 120.0 60.0 40.0 20.0 160.

a graphical method — also called the Youden diagram [8] — may be used. The graph is constructed as follows: • Measurement results for both the obtained series are marked on the X and Y axes. LLC .Interlaboratory Comparisons Graph — modified (box plot): 180.0 80. to determine the presence of systematic errors.0 100. or • Determinations for two different samples In this case.0 0.0 40. • Solid lines are drawn (both vertical and horizontal) that reflect the values of main distribution estimators (arithmetic mean or median).0 140.© 2009 by Taylor & Francis Group. Application of this graph shows which of the participating laboratories achieved comparable results and which laboratory obtained deviating results.0 160.xls 6.and interlaboratory variability.0 120. .2 Comparison of Measurement Results Obtained in a Two-Level Study (for Two Samples with Various Analyte Concentrations) A two-level study is a study where each of the participating laboratories has performed the series of determinations: • Either two series per one sample.0 20.0 60. It is an easy and very effective method of comparing both intra. • Dotted lines are drawn (also vertical and horizontal) where distances from the solid lines represent values of the standard deviation from the values of main distribution estimators (arithmetic mean or median).0 xLab 123 Excel file: exampl_PT11.5.

9 11.124 Quality Assurance and Quality Control The distribution of points on such a constructed diagram is a source of information about what type of error has a dominant impact on the obtained measurement results.7 10.7 11.8 . then the majority of points are in the upper right or bottom left quarter of the graph.3 11. produce a Youden graph.6 11.8 14.5 Median 11. If a systematic error is the main cause of differences between the values of the measurement results obtained by the compared laboratories and the mean (median). LLC .7 11.8 11.© 2009 by Taylor & Francis Group.2 10. Example 6.7 13.12 Problem: For the two given series of measurement results for two examined samples obtained in the examining laboratories. the results are distributed in a random manner around the mean (median).8 11 10. It may indicate a positive or negative bias in the analytical procedure applied in a given laboratory.4 11 12. Data: results: Data Series 1 lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 lab 9 lab 10 lab 11 lab 12 lab 13 Solution: Series 1 Series 2 11.2 11.9 11.8 12.8 12.7 10.4 Series 2 12. When the main cause of the deviations from the mean or median are random errors.3 11.9 10.2 15.1 12.2 11.5 10.

xls Another. The application of these tests enables the presentation of the variability of results obtained by using a given analytical procedure and enables an evaluation of a given laboratory. quite common method of graphical presentation of the measurement results obtained by comparing laboratories is the application of Mandel h and k tests. LLC . The manner of conducting Mandel h and k tests is described in Chapter 1 (Section 1. .Interlaboratory Comparisons Graph: 16 15 14 Serie 2 13 12 11 10 9 8 8 9 10 11 12 Serie 1 13 14 15 16 125 Graph — modified (with 95% limit circle): 16 15 14 Serie 2 13 12 11 10 9 8 8 9 10 11 12 Serie 1 13 14 15 16 Excel file: exampl_PT12.8.17).© 2009 by Taylor & Francis Group. All laboratories may obtain on different levels of a study (for different analytes or for different concentrations of a single analyte) both positive and negative values of parameter h.

08 2.73 2.15 2.8 12.9 14.98 1.44 4.76 4.03 5.56 4.5 14.22 4.23 5.23 8.4 15.6 10 14.8 9.7 13.2 14.92 8.13 Problem: For a given set of results obtained in interlaboratory comparison.77 7.1 Level 5 11.5 11.34 2.78 1.5 10.98 4.3 6. LLC . calculate the values of Mandel’s h parameter.86 2.73 5.96 10.7 11 10.45 1.22 2.21 6.34 7.23 4. when a laboratory yields h values in the extreme range.55 2. Similarly.34 4. When graphs for h and k connected in groups corresponding to the individual laboratories show that the values of these parameters are close to the lines of critical values.3 13. the situation should be adequately explained. When the graph of the statistical parameter k indicates that a given laboratory deviates from the rest due to numerous high values. one may suppose that there is a source of bias for the results obtained by that laboratory. one should pay attention to a situation where all values of parameter h for a given laboratory are characterized with a positive or negative value. one should pay attention to the problem of systematic errors and the small repeatability of results (great variance value).65 2.45 8.2 13.56 Level 4 14.23 4.02 Level 2 7.54 5. Draw a graph showing the respective values of the calculated h parameters characterizing the sets of results obtained in individual laboratories.4 15.67 7.12 1.22 2. Moreover.© 2009 by Taylor & Francis Group. it shows a smaller repeatability of results obtained by the laboratory compared with the rest of the participants.8 11.54 7.8 14.44 1.4 10.32 4.4 11. When a laboratory tends to obtain only negative values for h.2 12 11 11.7 lab 2 lab 3 lab 4 lab 5 lab 6 .11 2.11 11.77 7.54 7.11 5.02 8.48 2.34 6.11 4.89 1.126 Quality Assurance and Quality Control The number of laboratories characterized with positive values of parameter h should approximate the number of laboratories characterized with negative values.8 16.01 8.3 11 12.56 4. and at the same time different from the sign (plus or minus) of parameter h obtained in other laboratories.83 7. Data: results: Level 1 lab 1 1 2 3 1 2 3 1 2 3 1 2 3 1 2 3 1 2 3 4.2 14 13.11 Level 3 2. Example 6.12 2.22 5.8 12. for example.01 2.03 2.21 7. it achieved an unusually high number of large values for h.67 9.

13474 Level 3 h 0.5 –1 –1.22 1.24180 0.3 8. Excel file: exampl_PT13.5 2 1.08 2. LLC .33181 −0.22323 −0.51103 −0.21330 0.56151 0.Interlaboratory Comparisons lab 7 1 2 3 1 2 3 4.57 13.71269 0.32 3.15017 −2.88 8.55 4.5 –2 –2.32112 0.40861 −1.02 7.49321 0.38729 1.11 8.11 9 2.35 3.45 8.51103 0.63583 0.77645 1.02508 0.6 11.06872 −2.66888 1.44 4.04319 −1. which indicates the occurrence of a systematic error source for the results obtained by this laboratory.99211 0.10230 −2.84978 0.23756 −0.1 13.98 9.56 1.5 0 –0.11 2.© 2009 by Taylor & Francis Group.45130 0.21952 1.76 8.18460 −0.2 11 12 12.26092 0.25142 Level 4 0.5 1 0.19003 −1.46858 −1.15886 0.83572 0.8 11.3 11.15118 1.5 –3 Lab 1 Lab 2 Lab 3 Lab 4 Lab 5 Lab 6 Lab 7 Lab 8 Level 2 −0.2 13. Results obtained by the other laboratories are within the permissible range of changes for all the determined analytes.21 3.26898 0.35552 −0.82 127 lab 8 Solution: Level 1 lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 Graph: 2.45 1.85611 Conclusion: Results obtained by “lab 4” for all analytes are much lower compared to those obtained by the rest — three of five analytes have exceeded the critical value for the 1% level of significance.25261 Level 5 0.72498 −0.xls .67 8.88856 0.

11 8.11 11.44 4.12 2.23 8.12845 0.37413 0.08 2.26287 0.6 11.35 3.15 2.45 1. Data: results: Level 1 lab 1 1 2 3 1 2 3 1 2 3 1 2 3 1 2 3 1 2 3 1 2 3 1 2 3 4.74823 1.45 8.8 12.2 12 11 11.68527 1.3 8.44274 Level 4 Level 5 .3 13.74083 0.77 7.2 13.74083 0.21 7.67 8.22 2.5 10.68527 1.5 14.8 11.37413 0.01 8.8 16.02 8.74823 1.34 6.8 11.08 2.98 4.128 Quality Assurance and Quality Control Example 6.1 13.1 13.71646 1.74823 1.57 Level 4 14.11 2.92 8.88 8.2 14 13.11 9 Level 3 2.73 2.22 4.01 2.2 Level 5 11.12845 0.21 6.8 14.2 13.54 7.7 11 10.12845 0.54 7.12 1.71646 1.03 2.37413 0.76 8.23 5.14 Problem: For a given set of results obtained in an interlaboratory comparison.86 2.74083 0.56 4.8 9.34 4.45 Level 2 7.23 4.21 3.02 7.77 7.44274 0.12845 0.44274 Level 2 0.56 2.74823 1.© 2009 by Taylor & Francis Group.89 1.7 11 12 12.26287 0.4 10.32 4.98 9.68527 1.9 14.68527 1.48 2.02 4.74823 1.45 1.7 13. Draw a graph showing the respective values of the calculated k parameters characterizing the sets of results obtained in individual laboratories.5 11.3 11 12.55 4.74083 0.22 5.71646 1. LLC .26287 0.22 2.44 1.4 15.3 11.8 12.67 7.71646 1.55 2.22 1.37413 0.2 14.96 10.65 2.83 7.76 4.68527 1.26287 0.44 4.26287 0.34 2.34 7.11 2.44274 Level 3 k 0.71646 1.67 9.03 5.74083 0. calculate the values of Mandel’s k parameter.37413 0.56 4.3 6.4 11.54 5.12845 0.23 4.11 5.73 5.11 8.82 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 Solution: Level 1 lab 1 lab 2 lab 3 lab 4 lab 5 lab 6 lab 7 lab 8 0.98 1.78 1.11 4.4 15.44274 0.6 10 14.56 1.32 3.

High marks/grades obtained in interlaboratory proficiency studies indicate a high quality of analyses performed by the participating laboratory. In other words. it is a system of mutual aid where a participant obtains information whether and how they should modify the applied measurement procedure to increase the reliability of obtained results. and not those that may occur. while interpreting the results of the interlaboratory studies.© 2009 by Taylor & Francis Group. Excel file: exampl_PT14. both on national and international scale.5 0 Lab 1 Lab 2 Lab 3 Lab 4 Lab 5 Lab 6 Lab 7 Lab 8 129 Conclusion: The greatest repeatability for results obtained is achieved by “lab 8.6 Conclusions The ultimate and most reliable manner of estimating the quality of measurement results obtained by a given laboratory is the comparison of their results with those obtained in other laboratories. However.5 1 0.Interlaboratory Comparisons Graph: 2. and lab 6). the obtained values of repeatability exceed the critical value for the 5% level of significance.5 2 1. one should remember that: • Participation in interlaboratory studies must not serve as a substitute for routine intralaboratory control of the results’ quality. • Results of interlaboratory studies enable the detection and definition of current problems in a given laboratory.xls 6. Bearing this in mind. The test of interlaboratory proficiency is used to estimate the reliability of determination results and is the basis for the validation of analytical procedures according to EN 17025. LLC . . and enables issuance of opinions on organizational procedures. A major task in interlaboratory comparisons is the help offered to a laboratory in detecting all types of irregularities during a given analytical procedure that may affect the reliability of the obtained results. lab 5. It is hence obvious that laboratories that do not participate in these comparisons should be deemed unreliable. laboratories for many years have participated in various interlaboratory comparisons.” In the case of individual results (lab 1.

and Interpretation of PT Schemes. Krska. Qual. Linsinger. R.0.130 Quality Assurance and Quality Control • A successful outcome in interlaboratory studies obtained during the determination of a given analyte or a group of analytes may not be automatically related to another analyte or group of analytes.. 1992. 5. 2007. “Statistical treatment of proficiency testing data. and Smeyers-Verbeke. “Fitness for purpose — the integrating theme of the revised harmonized protocol for proficiency testing in analytical chemistry laboratories. 3..L.” Fresenius Z. “The role of and place of method validation in the quality assurance and quality control (QA/QC) system. Chem. J. Tholen. P.” Accred. Vander Heyden. Juniper.” J. 331... 6. Anal. Use. Y.com/webshared/administration/ Hows%20And%20Whys%20of%20of%20.” Accred. 3. D. References 1. 12. 2000. 1158.l‑a‑b. Proficiency testing by interlaboratory comparisons: Part 2. “The influence of different evaluation techniques on the results of interlaboratory comparisons. 1997.R.pdf. “Proficiency Testing of Analytical Laboratories: Organization and statistical assessment. Qual. Eurachem Guide on Selection. “Set-up and evaluation of interlaboratory studies. 11.. 97–104. 1999. Assur. ISO/IEC Guide 43-1. To sum up.W. T.. 362–366. Konieczka. 173–190. LLC . ISO/IEC Guide 43-1. 1997. 2006. Qual. 117. . and Ellison. 37..R. 322–327. and Grasserbauer. 7. Chromatogr..J. Assur.P. 2.. Proficiency testing by interlaboratory comparisons: Part 1.” Accred Qual.. S. 1998.” Crit. Rev. P. the same applies to an analytical method.” Analyst. Davies. M. 373–378.” Accred. 1988. 4. Anal. M.L. “Statistical evaluation of interlaboratory tests. the major task of interlaboratory studies is to obtain an explicit answer to the question: “Are the measurement results obtained in a given laboratory as good as we think they are?” (http://www. Development and operation of proficiency testing schemes. Kandel. 10. Assur. 11.. W. Analytical Methods Committee.HN-Proficiency. Thompson. Available at http://www. Assur... A. 9. 158–167.. 1998.. Selection and use of proficiency testing schemes by laboratory accreditation bodies.. I. “Quality issues in proficiency testing. Chem.. 336–341. Edition 1. ProficiencyTesting. 2007.. 4. 513–519.© 2009 by Taylor & Francis Group. 8.com). 3.

7 Method Validation

7.1 Introduction

Considerations concerning the determination of validation parameters should begin with an explanation and description of the nature of an analytical measurement. The key interests of analysts worldwide are the signals following and resulting from a conducted measurement. The goal of an analyst’s work is to obtain analytical information about an investigated object based on a received output signal, a result of a suitable measurement method. This signal reveals information about the investigated sample. The analyst’s role is to “decode” the obtained signal and do it in a manner such that the obtained information is as reliable as possible [1]. A tool that decodes information is an analytical process, including analytical methods applied in the process. Each signal is characterized by a particular quantity. In some measurements, a signal may also be assigned a position (location). Validation parameters are determined based on analysis of the obtained signal values, and one should be aware of this in the validation of any analytical method. Validation of an analytical method includes testing of its important characteristics. The final aim is to be certain that the analysis process is reliable and precise, remains under total control of the operator, and leads to reliable results. First of all, validation allows definition of a given analytical method. Using the determined parameters, in the validation process there exists the possibility of estimating the usefulness (range of use) for a given method and then choosing the optimal method. As previously stated, for the measurement results to be traceable and have an uncertainty value provided, they must be obtained using an analytical method that is subjected to a prior validation process. Most often, a validation study is carried out when [2, 3]: • A new analytical method is being developed. • Tests for the extension of the applicability of a known analytical method are being conducted, for example, determinations of a given analyte, but in samples characterized by a different matrix composition. • Quality control of the applied method showed variability of its parameters over time. • A given analytical method has to be used in another laboratory (different from the one in which it has already been subjected to the validation process) or using different instruments, or determinations are to be performed by another analyst. • A comparison of a new analytical method with another, known reference method is being performed.

131

.© 2009 by Taylor & Francis Group, LLC

132

Quality Assurance and Quality Control

The parameter range, the determination of which should underlie the validation process for a given analytical method, depends on the following factors [4]: • The character of an analytical study to be carried out using a given analytical method (qualitative or quantitative analysis, analysis of a single sample, or a routine analytical investigation). • Requirements for a given analytical method. • Time and costs, which need to be spent in the validation process. The parameters considered necessary for the validation of different types of analytical procedures are presented in Table 7.1 [2, 5]. TABLE 7.1 Parameters Whose Determination is Necessary for Different Types of Analytical Procedures [2, 5]

Impurity Test Parameter Precision Correctness Specificity Limit of detection Limit of quantitation Linearity Measuring range Ruggedness

a

Qualitative Analysis −a − + −a −a −a −a +

Limit Impurity Test − −a + + − − −a +

Quantitative Impurity Test + + + – + + + +

Assay Test + + + – + + +

It might be determined.

The more parameters included in the validation process, the more time one should spend on the process. In addition, the more restrictive the assumptions for the limit values (expected) of the respective parameters, the more often one should test, calibrate, or “revalidate” a given analytical method. It is not always necessary to conduct a full analytical method validation. Therefore, one should determine which parameters should be included in the process. Table 7.2 contains the parameters which, according to the recommendations of the International Conference on Harmonization (ICH) [6, 7] and United States Pharmacopeia (USP) [8], should be included in the validation process.

.© 2009 by Taylor & Francis Group, LLC

Method Validation

133

**TABLE 7.2 List of Analytical Procedure Parameters That Should Be Validated According to Recommendations of ICH [6, 7] and USP [8]
**

Parameter Precision Repeatability Intermediate precision Reproducibility Accuracy Limit of detection Limit of quantification Specificity/selectivity Linearity Measuring range Robustness Ruggedness ICH + + + + + + + + + USP +

+ + + + + + + +

Apart from determining validation parameters, before commencing validation one should determine the basic features of an analytical method, namely [2]: • • • • • • • • • • • Type of the determined component (analyte) Analyte concentration Concentration range Type of matrix and its composition Presence of interferents Existence of top-down regulations and requirements for the examined analytical method Type of the expected information (quantitative or qualitative analysis) Required limits of detection and quantitation Expected and required precision and accuracy of the entire method Required robustness of the method Required instruments; whether the determinations using a given method have to be carried out using a strictly defined measuring instrument or instruments of a similar type Possibility of using a method already validated in another laboratory(ies)

•

.© 2009 by Taylor & Francis Group, LLC

134

Quality Assurance and Quality Control

A validation process may be conducted in any order; however, it seems most logical to proceed in the following manner [2, 4]: • Determine the selectivity in the analysis of standard solution samples (optimization of the separation conditions and determination of analytes present in the standard solution samples). • Determine the linearity, limits of detection and quantitation, and the measuring range. • Determine the repeatability (short-term precision), for example, based on deviations of the obtained retention times and/or chromatographic peak areas. • Determine the intermediate precision. • Determine the selectivity based on results obtained in the analyses of real samples. • Determine the accuracy/trueness based on the analysis of reference material samples containing an analyte at different concentration levels. • Determine the tolerance of a method, for example, based on the results obtained in interlaboratory comparisons. The validation process requires the use of various tools such as [9]: • • • • • • Blank samples (including so-called reagent blanks) Standard solutions (calibration solutions, test samples) Samples with a known quantity of added analyte (spiked with the analyte) (Certified) reference materials Repetitions Statistical processing of the results

In this work, we need to stress that the method can be subjected to the validation process only when a suitable optimization study has been conducted. The process of analytical method validation should be completed with the final report, which includes all information concerning the analytical method. Validation parameter definitions and the manner of their determination are described below.

**7.2 Characterization of Validation Parameters 7.2.1 Selectivity
**

Usually, the first determined validation parameter is selectivity. Using basic logic, before one commences determination of the properties of an analyte based on measurement of the obtained analytical signal, one should make sure that a given signal is due only to the occurrence of an analyte in an investigated sample. A very frequent problem is the interchangeable use of the terms selectivity and specificity, although they differ in their essential meaning. According to the International Union of Pure and Applied Chemistry (IUPAC) nomenclature [10], selectivity is defined as “the extent to which it can determine particular analyte(s) in a complex mixture without interference from other components

.© 2009 by Taylor & Francis Group, LLC

Method Validation

135

in the mixture.” Specificity is described by the IUPAC as the “highest selectivity” and recommends not using the term specificity. Selectivity is thus the ability of a method to differentiate the examined analyte from other substances. This characteristic is mostly a function of the described measurement technique, but can fluctuate depending on the class or group of compounds to which the analyte belongs, or the sample matrix. A specific method is one which shows the highest selectivity. Selectivity can be defined as [11] “the ability of an analytical process to receive signals whose size depends almost entirely on the concentration of the examined analyte present in the sample.” One can also propose a practical definition [9]: “selectivity is the potential for an accurate and precise determination of the occurrence and/or concentrations of an analyte or groups of analytes in the presence of other components in a real sample under given measurement conditions.” Selectivity is therefore one of the main parameters characterizing and describing an analytical method, especially a trace analysis [12]. From a practical point of view, an analytical measurement is selective when it is possible to differentiate measurement signals and assign to them respective properties for a given analyte. This undoubtedly depends on the parameters of the obtained signal. If the signal is characterized only by its intensity, one should prove that its size depends only on the investigated properties of a given object. For example if the mass of a sample is being determined using an analytical balance, then an analyst must be certain that the measured value is due to the real mass of a sample and not, for example, refuse on the balance’s tray. This example shows that problems related to selectivity are also linked with direct measurements. A different situation is observed concerning selectivity when signals are characterized by an additional parameter — position (place). Such a situation takes place in chromatography for example, where retention time additionally characterizes the output signal and assigns it to a specific analyte. In such a case, it becomes necessary to determine the smallest differences between the positions for each analyte, for which the distinction between the obtained signals is possible. The requirement of selectivity for a measurement process depends first of all on the composition of an analyzed sample [11]. Selectivity is more difficult to obtain: • • • • • • The more unknown the sample composition is The more complex the sample’s matrix composition is The more similar the properties of the matrix components The greater the number of analytes The smaller the analyte concentration The greater the resemblance between analytes

An increase in the selectivity of an analysis may be obtained by: • Use of selective analytical methods • Elimination of the influence of interferents by removing or concealing them • Isolation of the analyte from the matrix

.© 2009 by Taylor & Francis Group, LLC

136

Quality Assurance and Quality Control

Depending on the type of analytical technique, the various ways of expressing selectivity are different.

7.2.2 Linearity

When an investigated property is certain to be associated with a given signal, one should determine the dependence between these quantities. A linear dependence is the most frequently occurring in analytical chemistry. The vast majority of analytical measurements use the calibration step, when the output signals are assigned to corresponding analyte concentrations [13]. To determine the functional dependency associating the output signal with analyte concentration, the linear regression method is commonly used. It is also applied in the determination of some validation parameters, such as: • Linearity • Trueness (based on the value of biases) • Limits of detection and quantitation It is also widely used in the calibration of measuring instruments. Linearity is defined as an interval in the measurement range of an analytical method in which an output signal correlates linearly with the determined analyte concentration. The most frequently used method of determining linearity is by using a graph of measuring instrument calibration. To this end, measurements of standard solution samples are conducted on at least six levels of concentrations (most often three parallel measurements for each level). Naturally, the selection of analyte concentrations in standard solution samples should be such that their range should include the expected analyte concentration in an investigated sample (the concentration range usually covers values from 50% to 150% in relation with the expected results of an analysis) [14]. Then, using the linear regression method, one determines the regression parameters. According to some recommendations [15], it is sufficient to calculate the coefficient of regression. Then, if this value is at levels equal to at least 0.999, we may talk about the linearity of the method within the range of concentrations for which standard solutions were prepared to determine the calibration graph. Unfortunately, this manner of documenting linearity does not always lead to correct conclusions. It can happen that the high value obtained for the coefficient of regression r (or the coefficient of determination r 2) does not necessarily prove the linearity of a method. The coefficient of regression may be used to infer the linearity of an analytical method only when standard solutions, based on which the calibration curve is determined, fulfill the following requirements [14, 16, 17]: • They include the expected analyte concentration in the investigated sample(s) within their own range of concentrations. • They include no more than three orders of magnitude of analyte concentrations within their own range. • They evenly “cover” the whole range of concentrations.

.© 2009 by Taylor & Francis Group, LLC

Method Validation

137

In addition, it is very important to determine a suitable dependence and the “visual” analysis of the obtained graph. Because of the ambiguity in usage of the coefficient r as a measure of linearity, additional methods for proving linearity have been proposed. In addition, the significance of the calibration graph coefficients needs to be determined. The coefficient of direction should differ statistically and significantly from 0, and in the case of an absolute term, its value should not differ in a statistically significant way from 0. To ascertain this, one should calculate the values of Student’s t (Section 1.8.9). Another approach is to draw a so-called graph of constant response described by the following dependence [2]: y = f (x) x (7.1)

where y = signal of a measuring instrument x = analyte concentration in a standard sample corresponding to a given signal When the range of concentrations is sufficiently large (including three or more orders of magnitude), the concentrations may be marked on the graph in a logarithmical scale. On such a graph, the sustained response is marked (usually calculated as an arithmetical mean of individual values y/x) in the form of a line parallel to the X axis, along with the admissible deviations from this value (most often ±5%). Values (points) lying outside the determined range correspond to analyte concentrations that lie outside the linear range of the measuring instrument. Naturally, this process can only be used when an absolute term of the determined simple dependence y = f(x) does not differ in a statistically significant manner from zero, which is not always the case. In some studies, one can find unambiguous and categorical statements that the value of coefficient r cannot serve to determine the degree of dependence between variables, and should be replaced by another statistical tool or specific tests for proving linearity [18]. One of the recommended tools is variance analysis. One can also use other methods and statistical tools such as [19–22]: • • • • Test of adequacy Mandel’s test Quality factor Student’s t test (Section 1.8.9)

When proving linearity is based on analysis results of the standard solution series with the simultaneous drawing of a calibration graph, it is logical to prove to what extent the calibration curve reflects the signals for standard solution samples. One can ascertain this through the calculation of relative errors for each concentration, with the reference value being the analyte concentration in the standard sample,

.© 2009 by Taylor & Francis Group, LLC

138

Quality Assurance and Quality Control

and the experimental value being that calculated from the equation of a straight calibration line [23]. Linearity by no means signifies that, within the entire range of concentrations, the function describing the dependence of the output signal on the analyte concentration assumes one form (the same calibration curve coefficients). Linearity is a characteristic showing the proportional dependence of a signal on the determined quantity, and can be described, for a given range, by several equations depending on the level of analyte concentrations [24, 25]. It is also necessary to explain the difference between correlation and regression. Correlation describes the degree of connection between two variables, and regression describes the manner of their dependence [18]. Example 7.1

Problem: Draw the calibration curve based on the results of the analyte concentration determination results in six standard solution samples (three independent measurements per each of the solutions). Calculate the regression parameters of the calibration curve. Make an appropriate graph. Data: results: Data x 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 2 2 2 4 4 4 6 6 6 8 8 8 10 10 10 12 12 12 y 1.12 1.20 1.08 2.11 2.32 2.23 3.33 3.54 3.41 4.12 4.32 4.44 5.67 5.76 5.51 6.97 6.78 6.66

.© 2009 by Taylor & Francis Group, LLC

5642 −0.20 1.00989 0.xls Example 7.12 1.5642x – 0. SDxy Standard deviation of the slope. examine the significance of the differences in the slope and the intercept of a calibration line and the value 0. SDb Standard deviation of the intercept. r Graph: 8 7 6 Signal 5 4 3 2 1 0 0 2 4 6 8 10 12 14 y = 0. b Intercept.9976 Content Excel file: exampl_valid01.9951 139 18 0.07702 0. SDa Regression coefficient. Apply Student’s t test.Method Validation Solution: n Slope. Calculations should be performed for the significance level α = 0.05.1.32 .2 Problem: Using the data from Example 7.08 2.0291 R2 = 0.11 2. Data: results: Data x 1 2 3 4 5 2 2 2 4 4 y 1. a Residual standard deviation.© 2009 by Taylor & Francis Group.1433 0.0291 0. LLC .

9976 57.23 3.12 4.1.67 5.12 1.xls Example 7.32 4. SDa Regression coefficient.20 .54 3.1433 0.97 6. Data: results: Data x 1 2 2 2 y 1.0291 0. draw a graph of sustained response.378 2.© 2009 by Taylor & Francis Group. SDxy Standard deviation of the slope.51 6. SDb Standard deviation of the intercept.78 6. Excel file: exampl_valid02. No statistically significant difference between the intercept and 0.3 Problem: Using the data from Example 7.120 Conclusions: Statistically significant difference between the slope and 0.76 5. LLC .062 0. r tb ta tcrit 18 0.5642 −0.33 3.41 4.07702 0.00989 0.66 n Slope.140 6 7 8 9 10 11 12 13 14 15 16 17 18 Solution: 4 6 6 6 8 8 8 10 10 10 12 12 12 Quality Assurance and Quality Control 2. a Residual standard deviation. b Intercept. marking the lines of the interval for the values deviating ±5% from the mean.44 5.

56 0.60 0.57 0.58 0.32 2.53 0. LLC .78 6.66 141 Solution: y/x 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 0.51 6.23 3.57 0.58 0.44 5.56 0.12 4.56 xm 0.54 3.Method Validation 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 2 4 4 4 6 6 6 8 8 8 10 10 10 12 12 12 1.53 xm + Interval % 0.33 3.59 .97 6.58 0.56 0.55 0.32 4.76 5.52 0.54 0.67 5.41 4.57 0.11 2.59 0.56 xm − Interval % 0.56 0.54 0.© 2009 by Taylor & Francis Group.08 2.

45 0.4 Problem: Using the data from Example 7.33 3.55 0.40 0 2 4 6 Quality Assurance and Quality Control 8 10 12 14 16 Excel file: exampl_valid03.32 4. and the experimental value to be the value calculated from the calibration curve equation.32 2.54 3.xls Example 7.70 0.1.65 0.50 0. assuming the reference value to be x.51 .142 Graph: 0.75 0.12 4.20 1.44 5.12 1. calculate the values of the relative errors for individual values x.67 5.© 2009 by Taylor & Francis Group. LLC .11 2. Data: results: Data x 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 2 2 2 4 4 4 6 6 6 8 8 8 10 10 10 y 1.76 5.23 3.08 2.41 4. Assume an appropriate limit for the relative error and draw conclusions.60 0.

92 −1.83 8.43 1.97 6.Method Validation 16 17 18 12 12 12 6.83 3.56 −1.xls 1.01 2.3 Limit of Detection and Limit of Quantitation The next validation parameters that need to be determined are the LOD and the LOQ.© 2009 by Taylor & Francis Group. The values of these parameters are closely related to the magnitude of noises in the measurement system.66 5.00 143 Relative error — ε.78 6.99 1.78 5.22 4.2.21 18 0.10 −0.59 −8.72 −5.0291 Conclusion OK !!! OK !!! OK OK OK !!! OK !!! OK OK OK OK OK OK OK OK 7. The value of this parameter can serve to determine the influence of noise level on the .5642 −0.08 −3. a ε.60 −1. n Slope.65 −0.08 0. % Solution: Number of results. LLC .37 0. b Intercept. Signal-to-noise ratio (S/N) is an undimensional quantity that describes the relationship of an analytical signal to the mean noise levels for a specific sample. % 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Excel file: exampl_valid04.

© 2009 by Taylor & Francis Group. LOD and LOQ are parameters that play an unusually significant role in the validation of analytical procedures. .144 Quality Assurance and Quality Control relative measurement deviation. This can be attributed to several reasons: • A large number of definitions describing the notions of both the LOD and the LOQ. It can be calculated in different ways. Method detection limit (MDL) is the lowest concentration (smallest quantity) of an analyte that can be detected using a given analytical procedure. there exist several ways of determining (estimating) the LOD. one estimates the LOD based on one’s own experiment. this value is n times the noise level — it is most often three times as high. Limit of quantitation (LOQ) is the quantity or the smallest concentration of a substance that can be determined using a given analytical procedure with an assumed accuracy. Although the meaning of these parameters and their understanding do not raise questions. Based on the results of sample analysis with the known analyte concentration (standard solutions).2. the magnitude of the noise level in a given measuring instrument.g.. and uncertainty. Limit of detection (LOD) is the lowest concentration (smallest quantity) of an analyte that can be detected with statistically significant certainty [26]. Depending on these parameters. the determination of their values itself is sometimes problematic. • Possibilities of obtaining (producing) so-called blind samples. This value should be estimated using a suitable standard sample and should not be determined through extrapolation [27]. This method can also be used for instrumental techniques. for which it is not possible to determine the noise level of the applied measuring instrument.3. but the most common method is the relationship of the arithmetical mean of the results in a measurement series for blind samples (or samples containing analyte in a very low level) to the standard deviation obtained for this series. • Characteristics of the applied instrumental technique. • Practical difficulties in univocally determining the basic parameter deciding the LOD — namely. precision. The manner of determining an LOD depends on the following factors: • Nature of the analytical method (the manual method and the method based on utilization of a suitable gauge as well). Instrumental detection limit (IDL) (e. detector) is the lowest concentration (smallest quantity) of an analyte that can be detected (without quantitative determination) using a given measuring instrument. LLC . 7. one estimates this concentration level at which detection is possible.1 Visual Estimation For a classical method (noninstrumental).

5 min). Of course. LOD is equal to the mean value magnified by three times the standard deviation in this instance. the so-called background level is above the LOD for the applied detector (that is to say.2) The modification is the preparation of n samples with analyte concentrations on a level close to the expected LOD.3) LOD = x m + 3 ⋅ SD (7. it would be most convenient to prepare .3 Calculation of LOD Based on Determinations for Blank Samples A more labor-consuming method. where xm = mean value SD = standard deviation In practice. obtained when a blank sample is subjected to final determination. In the case of chromatography.3. one describes the noise level — measuring range signal changes close to the retention time for an analyte on a chromatogram (one can assume the retention time range as t Ran ± 0. is using a measurement for a series of blank samples. however. with the one difference being that LOD is calculated according to the formula: LOD = 0 + 3 ⋅ SD (7. 7. the simplest and most commonly applied way of calculating the LOD is to determine the S/N ratio for a blank sample (if it is possible) or for a sample with a very low analyte concentration. The method would only have some application when the analyte concentration is measurable for a blank sample. For the thusly obtained 10 results. 10 independent determinations are performed for samples in which the analyte concentration is close to the expected LOD. It involves 10 independent measurements for 10 independently prepared blank samples [28]. LLC . This method can be applied only when it is possible to obtain the baseline of noises.3.Method Validation 145 7.2.2 Calculation of LOD Based on the Numerical Value of the S/N Ratio When calculating the LOD. it is possible to use the described method with a certain modification [29. To this end. one calculates the mean value and the standard deviation. The manner of conduct is then similar to the previously described one. In this instance. the analyte concentration in a blank sample is at least equal to the LOQ for the applied detector). such samples are prepared through spike in the blank samples with quantifiable amounts of the analyte. it seems paradoxical to obtain a result for a value that by definition should be a submarginal quantitation.© 2009 by Taylor & Francis Group.2. one can determine the LOD value by using the obtained chromatogram for a blank sample. and then to directly apply the principle that LOD is three times the noise level for an applied analytical method. it is seldom possible to obtain a numerical value for the mean. one uses the determined S/N ratio for the investigated analytical procedure [2]. that is. of course. but one that is also metrologically more correct. This quantity is then multiplied by 3 and the obtained signal value is converted into a concentration. 30] — namely. Otherwise.

LOD is calculated using the following dependence: LOD = 3.146 Quality Assurance and Quality Control standard solutions in which matrix compositions correspond to the matrix composition of real samples.4 Graphical Method This method involves analyses of measurement series for three standard solution samples containing an analyte at three levels of concentration (close to the expected LOD for the samples). In this case.2.5 Calculating LOD Based on the Standard Deviation of Signals and the Slope of the Calibration Curve One most often applies analytical methods in which the final determination is based on the indirect measurement principle. one should perform at least six parallel determinations. calculate the standard deviations.© 2009 by Taylor & Francis Group. For each level of analyte concentration. One then performs an analysis on such prepared samples. LLC .3.6) 7.3. where n is the number of independent samples and the accepted level of significance α.4) where t = parameter of Student’s t test SD = standard deviation If the prepared standard solution samples are subjected to analysis using a given analytical procedure. then IDL is determined in this manner. 7].2. 6. 7. In this case. LOD is calculated using a dependence described by an equation for the number of degrees of freedom f = n − 1.3 ⋅ SD b (7. If determinations are instead performed directly on the prepared standard solution samples. . after which one determines the LOD according to the following dependence: LOD = 3 ⋅ SDo (7. LOD = t ⋅ SD (7. A linear dependence is determined that associates the calculated standard deviations with the respective concentrations: SD = f (c) (7. and then for each series of measurements obtained in this way. receiving a series of n results for which one calculates the mean value and standard deviation.7) where b is the slope of calibration curve. one determines the absolute term SDo.5) Next. then the determined LOD is also the MDL. it is indispensable to perform calibration that will influence the LOD [2.

Figure 7. the MDL is the determined quantity.2.. • As a residual standard deviation of the calibration curve — SDxy.1 presents the construction of the graph and the calculation of the LOQ [28]. Hence. described by the dependence (1. % LOQ 0 1 2 3 4 5 6 Analyte Content 7 8 9 FIGURE 7.68). if measurements are conducted based on analyses of blank samples subjected to the whole analytical procedure. one performs six parallel measurements. The LOD is calculated as: LOD = LOQ/3. It is also important to appropriately select concentrations of standard solutions to draw the calibration graph (it is known that the calibration graph has a straight-line range in a strictly specific interval of concentrations and that its plot most likely has different concentration level characteristics close to the LOD).g.© 2009 by Taylor & Francis Group.6 Calculation of LOD Based on a Given LOQ LOQ is the lowest analyte concentration that can be determined with a suitable precision and accuracy. One performs measurements for standard solutions (matrix standards) on at least five levels of concentrations [2. The required precision for the LOQ is determined (usually = 10%). LLC .Method Validation 147 Standard deviation can be determined in three different ways: • As a standard deviation of results obtained for the series of blank samples — SDbl.1 Construction of the graph and calculation of the limit of quantitation [28]. Of course. the calculated value is the LOD for the measuring instrument. . 20 18 16 14 12 10 8 6 4 2 0 Required precision. For each solution. • As a standard deviation of the intercept of the obtained calibration curve — SDa. When the LOD is calculated based on parameters of the determined calibration graph (residual standard deviation or standard deviation of the intercept). 28]. For each level of concentrations. 10% CV.3. the coefficient of variation (CV) is calculated and the graph of the f(c) dependence is drawn. e. 7. the LOD (for the analytical method or the applied detector) will be calculated depending on which parameters were used to calculate the standard deviation. and for this value the concentration equal to the LOQ is read on the graph.

3. and Advantages [27] Methods for Calculating LOD Visual check Requirements Sample with known analyte content (standard solution or matrix standard) Disadvantages/Advantages Quick method Estimation Mostly used in case of classical analysis (noninstrumental) Requires vast analytical experience Quick method Used only for measuring equipment It is possible to determine the S/N ratio Labor.7 Testing the Correctness of the Determined LOD Many of the aforementioned ways of calculating the LOD are based on the determination of analyte concentration in the prepared standard solution samples. 7. at least six measurements for each standard sample Series of blanks or samples with known analyte content (standard solution or matrix standard) Standard solutions for calibration curve preparation Series of standard solutions Assumed relative standard deviation for LOQ Calculations based on limit of quantification. LOQ Table 7.3 compares all the described methods of calculating the LOD.and time-consuming method It includes the influence of calibration procedure on LOD value Method “motivated” by metrology Indirect method LOD calculated based on the determined LOQ LOD value (LOQ) depends on the assumed measurement precision Calculations based on the S/N ratio Sample with known analyte content (standard solution or matrix standard) Calculations based on the measurements for sample blanks Series of blanks or samples with known analyte content (standard solution or matrix standard) Calculations based on graphical method Calculations based on standard deviations of signals and slope of calibration curve Series of standard samples at three concentration levels. Disadvantages.© 2009 by Taylor & Francis Group. LLC .2. together with their short characterizations [27].148 Quality Assurance and Quality Control TABLE 7.and time-consuming method that does not consider the influence of calibration on LOD Probability is used for estimating LOD Relatively quick method It includes the influence of calibration procedure on LOD value Labor.3 Methods for Determining Detection Limits: Requirements. The .

it will signify that the concentration in the prepared standard samples is too high.Method Validation 149 solutions should be characterized. In this case. If condition (7. LLC . Recovery can be calculated using the dependence [29]: %R = xm ⋅ 100% c (7. To test the trueness of the calculated LOD. One should also pay attention to the recovery of the analytical method in measurements conducted for standard solutions.10) According to the definition of LOD. the numerical value of this ratio should be between 3 and 10.11) where %R denotes the recovery of an analyte for a given analytical procedure. with two basic features: • Matrix composition should be as close to the matrix composition of real samples as possible. one can also estimate the S/N ratio based on the following dependence [29]: S/N= xm SD (7. A recovery being too low results in an undervaluation of the calculated LOD. It can happen that the concentrations in standard samples are considerably higher than the calculated LOD. .8) is not fulfilled. one should remeasure and recalculate using standard solutions in which the analyte occurs in higher concentration levels.9) where cmin is the analyte concentration in a standard solution sample with the lowest concentration. Inversely. the analyte concentration in the prepared standard samples is too low. one should fulfill the following conditions [29]: 10 ⋅ LOD > cmin LOD < cmin (7. when the condition is not fulfilled (7. It is known that the standard deviation for the set of measurement results determining the analyte concentrations in standard solution samples strictly depends on the concentration levels of a determined component. while calculating the LOD of an analytical procedure.8) (7.9). To check the calculated LOD. One should then calculate the limits of detection for newly prepared standard solutions with a lower analyte concentration. the determined LOD is greater than the numerical value and one should conduct remeasurement for smaller concentrations of the analyte in standard solution samples. • Analyte concentration should be on a level close to the expected LOD.© 2009 by Taylor & Francis Group. When it is higher.

150 Quality Assurance and Quality Control As previously stated.© 2009 by Taylor & Francis Group. It must be stated that the determined LOD should always be given the description and parameters of the method applied in its calculation.4. The determined limits of detection and quantitation also show the quality of measurements conducted using a given analytical method [31. the described methods of testing the correctness of the calculated LOD can only be applied when the measurements are performed using prepared standard solutions. Using the calculated S/N ratio. LLC . the value of the determined LOD is associated with statistical parameters such as: • Level of probability • Number of degrees of freedom For individual measurements. ng/g: Data 1 2 0. TABLE 7. Determining limits of detection and quantitation allows the unequivocal determination and presentation of results in the proximity of these values. 32]. The described ways of determining the LOD and/or quantitation permit the determination of both the MDL and the measuring instrument detection limit. estimate LOD and LOQ for the validated analytical method. Data: results. For validation of an analytical method. it is recommended to apply a less time-consuming method. The choice of a suitable means for determining the LOD depends on the purpose of the limit and the requirements of a given analytical method. examine the correctness of the determined LOD.5 Problem: Using the given analyte concentration determinations for blank samples.132 . A correct method for recording a determination result depending on the quantity of an analytical signal is presented in Table 7.155 0. it is recommended to use a way the assumptions of which are based on chemical metrology. x x < LOD LOD ≤ x < LOQ x ≥ LOQ Recording of Result Not determined Not quantified Value of concentration Example 7.4 Correct Method for Recording a Determination Result Result.

LLC .250 .xls Example 7.113 0. Data: results.18 ng/g 0.253 0.© 2009 by Taylor & Francis Group. ng/g: Data 1 2 3 4 5 6 c 0. Hence. the standard solutions were made with concentrations near the expected LOD.135 ng/g 0.258 0.54 ng/g 0. Excel file: exampl_valid05.6 Problem: During the measurements performed on blank samples.Method Validation 3 4 5 6 7 Solution: xm SD LOD LOQ 0. it was noticed that the obtained values of signals cannot be measured. calculated LOD is correct.014 ng/g 0.235 0.254 0.137 151 LOD = xm + 3 ⋅ SD S/N= xm SD S/N 9 Conclusion: S/N ratio is in the range 3–10. and based on measurements for these solutions the estimation was made for LOD and LOQ.145 0.143 0. Check the trueness of the LOD determination through the comparison with the standard solution concentration.244 0.258 0.121 0.

0091 ng/g 0.6 0. estimate the LOD and LOQ of the validated analytical method.4 9.3 mg/dm3 8. check correctness of the determined LOD.7 Problem: Using the data given in determinations of the analyte concentrations for blind samples.6 9. using Student’s t test.8 7. mg/dm3: Data 1 2 3 4 5 6 7 α Solution: xm SD t LOD LOQ 8.41 mg/dm3 1.8 7.027 ng/g 0.05 .13 mg/dm3 2.5 6. LLC .082 ng/g LOD = 0 + 3 ⋅ SD 10 ⋅ LOD > cmin LOD < cmin Conclusion: Calculated LOD is lower than the standard solution concentration used for its determination and 10 times LOD is higher than standard solution concentration.152 Solution: SD LOD LOQ Quality Assurance and Quality Control 0.xls Example 7. Excel file: exampl_valid06.© 2009 by Taylor & Francis Group. Using the data calculated S/N ratio. Data: results.8 mg/dm3 8.447 mg/dm3 2.2 9. calculated LOD is correct.

calculated LOD is correct.2 0.15 Signals 198 177 132 156 205 193 135 298 237 222 257 243 313 235 0.9 19.040 signal ppm ppm SD (Signal) 26.Method Validation LOD = t ⋅ SD S/N= S/N xm SD 7 153 Conclusion: S/N ratio is in the range 3–10.11 1 2 3 4 5 6 7 Solution: Concentration 0.4 101 144 124 174 102 111 121 0.3 170.11 0.15 0.© 2009 by Taylor & Francis Group. Draw an appropriate graph. Data: results: Concentration. Present LOD in units of the analyte concentration in standard solutions applied for LOD estimation.013 0. Excel file: exampl_valid07. check correctness of the LOD determination through a comparison with the standard solution with the lowest concentration. In addition.23 SDo LOD LOQ Signal 125.8 Problem: Using the given analyte concentration determinations for standard solution samples.9 257.23 . LLC . estimate the LOD and LOQ using a graphical method.xls Example 7.1 34.1 30. ppm 0.

0 15.2 0. Also check the correctness of LOD determination. ppm 1 2 3 4 5 6 7 8 9 0.11 0. calculated LOD is correct.11 0.0 SD (signal) 25.11 0.0 0.154 Graph: 40.11 0.© 2009 by Taylor & Francis Group.11 0.9 Problem: Using the data from Example 7.0 0 0. Data: results: Concentration. LLC .2 0.11 0.05 Quality Assurance and Quality Control y = 67. comparing the calculated value with the value of the analyte concentration in the standard solution with the lowest concentration.11 0.0 35.15 Signal 101 144 124 174 102 111 121 198 177 .0 10. Present the value of LOD in units of standard solution concentration.0 5.15 Concentration 0.1 0.5x + 19.0 20.0 30. applied in LOD estimation.15 0. Excel file: exampl_valid08.8.25 10 ⋅ LOD > cmin LOD < cmin Conclusion: Calculated LOD is lower than the lower concentrated standard solution used for its determination and 10 times LOD is higher than the lower concentrated standard solution. estimate the LOD and LOQ via the method using parameters of the calibration curve.xls Example 7.

23 0. SDb Standard deviation.15 Concentration.15 0.Method Validation 10 11 12 13 14 15 16 17 18 19 20 21 Solution: Number of results. ppm 0.15 0.23 0. a Residual standard deviation.05 y = 1102x + 4. r LOD (SDx.© 2009 by Taylor & Francis Group.63 29.1 0.15 0.15 0.066 ppm 0.23 0.6 129 22. b Intercept.23 0.2 0.077 ppm 3.6 0. n Slope.y) LOD (SDa) LOD (mean) LOD = 0.089 ppm 0.23 0. LLC .23 0. SDa Regression coefficient.3 ⋅ SD b 21 1102 4.8901 0.1 0.15 0.25 .23 132 156 205 193 135 298 237 222 257 243 313 235 155 Graph: 350 300 250 Signal 200 150 100 50 0 0 0. SDxy Standard deviation.

by a method using the parameters of the calibration curve.5 3. Excel file: exampl_valid09. ppm 1.3 3.10 Problem: Using the analyte concentration determinations for standard solution samples.5 2.3 3.156 Quality Assurance and Quality Control 10 ⋅ LOD > cmin LOD < cmin Conclusion: Calculated LOD is lower than the lower concentrated standard solution used for its determination and 10 times LOD is higher than the lower concentrated standard solution.3 3. Data: results: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Concentration.5 2.2 1. calculated LOD is correct.3 3. estimate the LOD and LOQ. LLC .2 1.2 1. Present the values of LOD in units of standard solution concentrations applied for LOD determination. Also check the correctness of LOD determination comparing the calculated value with the analyte concentration in a standard solution with the lowest concentration.2 1.5 2.xls Example 7.© 2009 by Taylor & Francis Group.3 Signal 1460 1725 1150 1025 1825 1310 1950 1630 2200 1650 2000 1980 2900 3200 3245 2850 3500 3890 .2 2.5 2.3 3.5 2.2 1.

5 Concentration.5 ppm 3. b Intercept.Method Validation Solution: Number of results.5 2 2. SDa Regression coefficient.8 ppm 1. . SDb Standard deviation.© 2009 by Taylor & Francis Group.5 10 ⋅ LOD > cmin LOD < cmin Conclusion: Because the concentration of a solution with the lowest concentration is lower than the calculated LOD. ppm 3 3. SDxy Standard deviation. a Residual standard deviation. standard solutions with a higher concentration were made and new calculations were made for the new series of data (without measurements for the solution with the lowest concentration).5 1 y = 831x + 254 1. n Slope.8627 157 Graph: 4500 4000 3500 3000 Signal 2500 2000 1500 1000 500 0 0 0.2 ppm 1. r LOD (SDxy) LOD (SDa) LOD (mean) LOD = 1.3 ⋅ SD b 18 831 254 447 122 303 0. LLC .

a Residual standard deviation. LLC .7 Signal 1950 1630 2200 1650 2000 1980 2900 3200 3245 2850 3500 3890 3640 4650 3860 4750 4450 4025 18 1016 −425 437 113 410 0.5 2. b Intercept.© 2009 by Taylor & Francis Group. n Slope.5 2. ppm 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Solution (2): Number of results.4 ppm 2.3 3.3 4.158 Data (2): results: Quality Assurance and Quality Control Concentration. SDa Regression coefficient.7 4.3 ppm 1.5 2.7 4.7 4. r LOD (SDxy) LOD (SDa) LOD (mean) 1.3 3.4 ppm 1.9132 .7 4.5 2. SDxy Standard deviation.3 3.5 2.7 4.3 3.5 3. SDb Standard deviation.3 3.

0 1000 990 995 1010 1005 1015 995 Signals . LLC .5 1 1. Present LOD in units of the standard solution concentration applied for LOD determinations.5 2 2. estimate the LOQ and then the LOD using an LOQ determination method based on the assumed value of determination precision.0 635 650 660 620 610 625 615 40. calculated LOD is correct. Assume the maximum value of the coefficient of variation to be CV = 5%. Data: results: Concentration.0 800 810 805 825 820 840 830 50.xls Example 7. ppm 5. ppm 4 4.0 444 450 470 400 445 450 470 30.0 198 177 232 200 205 193 235 20.0 1 2 3 4 5 6 7 104 144 124 124 102 111 121 10.5 3 3. Excel file: exampl_valid10.5 5 y = 1016x – 425 159 Conclusion (2): Calculated LOD is lower than the lower concentrated standard solution used for its determination and 10 times LOD is higher than lower concentrated standard solution. Draw an appropriate graph.© 2009 by Taylor & Francis Group.5 Concentration.Method Validation Graph (2): 5000 4500 4000 3500 Signal 3000 2500 2000 1500 1000 500 0 0 0.11 Problem: Using the values of the analyte concentration determinations for standard solution samples.

.© 2009 by Taylor & Francis Group.0% 5% 4.3 ppm 20 22 30 40 Concentration 50 60 Excel file: exampl_valid11.2 2.12 Problem: Determine the calibration curve based on analyte concentration determinations in eight standard solutions samples (five independent measurements for each solution).0% CV (signal) 8.2 5.0 40. In practice.0% 10.0% 12. Example 7. ppm 5. LLC .0% 2. A measuring range is a range of values (analyte concentrations) in which the error of a measuring instrument is below the assumed value.0 30.0% 6.0 LOQ LOD Graph: 14.4 Range Determination of linearity and the LOQ enables the determination of a measuring range for an analytical method.0% 0.2 10.0 50. Calculate the regression parameters of the calibration curve. % 12. Prepare an appropriate graph. it is described as an interval between the LOQ and the highest analyte concentration for which a measuring system shows an increase in the output signal.0 20.xls 7.9 1.8 0.160 Solution: Quality Assurance and Quality Control Concentration.0% 0 10 CV.0 10.9 22 ppm 7.2.

comparing the calculated value with the analyte concentration in the standard solution with the lowest concentration.75 3.75 5. Present the LOD in units of standard solution concentration applied in LOD estimation. ppb 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 0.4 Signal 780 745 756 770 735 1420 1450 1425 1350 1411 3100 3005 3000 3100 3105 4700 4650 4850 4760 4690 6750 6800 7100 6690 6990 10100 10000 9900 10350 10150 13400 13200 .12 1.75 3. Present the measuring range of the analytical method.44 2.© 2009 by Taylor & Francis Group. Also check the correctness of LOD determination.65 0.75 3.44 3.8 7.12 1.8 10.75 3.44 2.65 0. Data: results: Concentration.44 2.8 7.44 2.65 1. estimate the LOD and LOQ using a technique based on using parameters of the calibration curve.25 5.25 5.8 7.8 7.25 5.25 5. LLC .65 0.12 1.65 0.25 7.4 10.12 2.12 1.Method Validation 161 Using the determinations for standard solution samples for three lowest concentration levels.

4 10. a Residual standard deviation.3 0. SDxy Standard deviation.9991 0.3 Quality Assurance and Quality Control 13300 13000 12950 16600 16745 16600 16200 16500 Number of results.8 15 24.2 44.3 13. SDb Standard deviation.115 ppb 0.4 13. b Intercept.162 33 34 35 36 37 38 39 40 Solution (calibration): 10.089 ppb 0.27–13.3 13.3 ppb 3. b Intercept.1 0. n Slope. SDxy Standard deviation.3 200 7 52.063 ppb 0. r Solution (LOD): Number of results. LLC . SDb Standard deviation.9993 15 1280 −52. SDa Regression coefficient.4 10.27 ppb 0. SDa Regression coefficient.3 ⋅ SD b LOD = . r LOD (SDxy) LOD (SDa) LOD (mean) LOQ Range 40 1256 59. a Residual standard deviation.3 13. n Slope.© 2009 by Taylor & Francis Group.3 13.

**Method Validation Graph (calibration):
**

18000 16000 14000 12000 Signal 10000 8000 6000 4000 2000 0 0 2 4 6 8 10 12 14 y = 1256x + 59.3

163

Concentration, ppb

Graph (LOD):

3500 3000 2500 Signal 2000 1500 1000 500 0 0 0.5 1 1.5 Concentration, ppb 2 2.5 3 y = 1280x – 52.2

10 ⋅ LOD > cmin LOD < cmin

Conclusion: Calculated LOD is lower than the lower concentrated standard solution used for its determination and 10 times LOD is higher than the lower concentrated standard solution; calculated LOD is correct. Excel file: exampl_valid12.xls

.© 2009 by Taylor & Francis Group, LLC

164

Quality Assurance and Quality Control

7.2.5 Sensitivity

Sensitivity is a parameter that is not a necessary parameter in the validation of an analytical method. One can determine its value based simply on the parameters of the calibration curve. Sensitivity is the relationship of change in the output signal of a measuring instrument to the change in the analyte concentration that induces it. Thus, sensitivity shows the smallest difference in the analyte concentration that can be ascertained using a specific method (it is a slope of a calibration graph: signal in the concentration function). As a recapitulation, Figure 7.2 presents the interpretation of linearity, measuring range, LOD, LOQ, and sensitivity [28].

7.2.6 Precision

Each of the parameters below is determined based on the calculated standard deviation for the series of measurements, and therefore the manner of conduct in their determination will be described together. Repeatability, intermediate precision, and reproducibility can be determined based on the determined standard deviation, relative standard deviation, or the socalled coefficient of variation. Precision is the closeness of agreement between indications or measured quantity values obtained by replicate measurements on the same or similar objects under specified conditions [26]. It is associated with random errors and is a measure of dispersion or scattering around the mean value, usually expressed by a standard deviation. Repeatability is the measurement precision under a set of repeatability conditions of measurement [26]. The precision of results obtained under the same measurement conditions (a given laboratory, analyst, measuring instrument, reagents, etc.). It is usually expressed by a repeatability standard deviation, variance, relative standard deviation, or coefficient of variation.

Range Linearity

Signal

Slope sensitivity

Intercept LOD LOQ Analyte content

FIGURE 7.2 Interpretation of linearity, measuring range, limit of detection, limit of quantitation, and sensitivity [28].

.© 2009 by Taylor & Francis Group, LLC

Method Validation

165

Intermediate precision is the precision of results obtained in a given laboratory over a long-term process of measuring. Intermediate precision is a more general notion (due to the possibility of changes in the greater number of determination parameters) compared to repeatability. Reproducibility is the precision of results obtained by different analysts in different laboratories using a given measurement method. In determining repeatability, it is recommended for an analysis to be conducted on samples characterized with different analyte concentrations and differing in matrix composition. According to recommendations by the ICH [6, 7], standard deviation can be calculated in one of the following ways: • At least nine independent determinations in the whole measuring range (e.g., three independent determinations for three concentration levels). • Six independent determinations of an analyte in standard samples for the concentration level corresponding to the concentration of a real sample. • Six independent determinations of analytes occurring in three different matrices and for two or three concentration levels. According to EURACHEM recommendations [28], one should perform 10 independent determinations and calculate the standard deviation based on these. The determined method’s repeatability can refer both to (1) a very specific analytical method in which matrix composition is specific and defined (e.g., the method of determining analyte X concentration in matrix Y) and (2) determination methods for a given analyte without specifying matrix composition. In the former case, the standard deviation is calculated based on measurements performed for samples characterized by the same matrix composition. In the latter case, one needs to calculate the standard deviation using the measurements conducted for samples differing in matrix composition. Intermediate precision is a notion with a wider scope than repeatability because its value is influenced by additional parameters such as [2, 3]: • Personal factors — different analysts conducting determinations and instability in the work of a given analyst over a specified period. • Instrumental factors — due to the fact that measurements can be carried out using: • Different measuring instruments from a given laboratory • Standard solutions and reagents coming from different producers, or from different batches • Different accessories, for example, different GC columns, with the same characteristics but from different producers, or from different batches If determining precision uses samples in which analyte concentration is stable, the standard deviation is a sufficient parameter that one may determine precision with. However, in the analysis of samples characterized by different levels of analyte concentration, one should use the relative standard deviation or coefficient of variation.

.© 2009 by Taylor & Francis Group, LLC

166

Quality Assurance and Quality Control

Each of these of two quantities is used to compare repeatability, intermediate precision, or reproducibility. 7.2.6.1 Manners of Estimating the Standard Deviation Determining intermediate precision, repeatability, and reproducibility is based on calculating the standard deviation for the series of obtained measurement results [33–26]. The simplest means of estimating this parameter is by calculating the relative standard deviation or coefficient of variation and comparing (assessment) the obtained values. Frequently, one can find the statement that if a relative standard deviation (RSD) is smaller than a certain determined limit, then using a given method can yield precise results. An estimation of standard deviation can be performed using suitable statistical tests: • With a set point of this parameter — chi square (χ2) test (Section 1.8.4) • With the value obtained from a statistical assessment of the set of results obtained using a reference method — Snedecor’s F test (Section 1.8.5) Sometimes it is necessary to compare the standard deviation for sets of measurement results obtained using more than two methods. If the number of measurements on which the calculation of standard deviations is based is similar for all methods (equinumerous series of measuring), then one can apply the Hartley Fmax test (Section 1.8.6). When the number of results obtained using the compared methods are different, one should compare the calculated standard deviations using Bartlett’s test (Section 1.8.7). If the standard deviations are to be compared for two sets of correlated results, one should use Morgan’s test (Section 1.8.8). Example 7.13

Problem: For the given measurement result series, check (at the significance level of α = 0.05) if the calculated standard deviation differs statistically significantly from the set value of the standard deviation. Apply the χ2 test. Data: results: 11.0 12.0 12.9 12.0 12.5 12.1 14.2 12.1 17.1 12.1 12.4 15.1 12.3 12.0 10.2 Solution: Number of results, n Standard deviation, SD χ2 χ2 crit (f = 14, α = 0.05) 15 1.677 27.88 23.68 SDo = 1.23

.© 2009 by Taylor & Francis Group, LLC

© 2009 by Taylor & Francis Group. there is a statistically significant difference in variance value.983 1. Excel file: exampl_valid14.xls Example 7. SD n/(n − 1) · SD2 F Fcrit (f1 = 6. Equinumerous series — apply Hartley’s Fmax test.05) if the values of the standard deviation for the given series of results are statistically significantly different.Method Validation 167 Conclusion: Because χ2 > χ2 crit .795 9. n Standard deviation. LLC . there is a statistically significant difference in variance values for the compared series.xls Example 7.14 Problem: For the given series of measurement results. . check (at the significance level of α = 0. Data: result series: Series 1 1 2 3 4 5 6 7 Solution: Series 1 Number of results. f2 = 5.15 Problem: For the given series of measurement results.111 7. α = 0.85 4. check (at the significance level of α = 0.95 Series 2 6 0. the series differ in precision.160 10 12 13 14 18 15 17 Series 2 11 11 13 11 13 12 Conclusion: Because F > Fcrit .05) 7 2. Apply Snedecor’s F test. Excel file: exampl_valid13.05) if the standard deviation values for both series are statistically significantly different.

Excel file: exampl_valid15. check (at significance level of α = 0.xls Example 7. SD Fmax Fmaxo (k = 5. LLC .017 3. α = 0.05) if the values of the standard deviation for a given series of results are statistically significantly different. f = 14.168 Data: result series: Series 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Solution: 11 12 13 12 13 12 14 12 15 12 12 15 12 12 10 Series 2 13 12 12 15 11 10 13 11 12 14 15 12 14 12 11 Quality Assurance and Quality Control Series 3 10 13 14 12 13 14 11 12 17 14 17 12 11 12 14 Series 4 10 12 16 18 13 14 14 12 17 14 10 12 11 13 15 Series 5 17 11 13 14 13 12 13 11 13 14 15 11 11 12 12 Series 1 Number of results. .356 2 15 1.699 Conclusion: Because Fmax < Fmaxo. there is no statistically significant difference in variance values for the compared series.76 4 15 2.506 3 15 2. Not equinumerous — apply the Bartlett test.16 Problem: For the given series of measurement results.© 2009 by Taylor & Francis Group.384 5 15 1.09 4.05) 15 1. n Standard deviation.

083 0. LLC .701 4.769 26.270 8.07 Conclusion: Because Q > χcrit 2.845 51.22 11.245 9. n Standard deviation − SD 1/(n − 1) (n − 1) · log(SD2) (n − 1) · SD2 c SDo2 Q χ2 crit (f = k − 1 = 5.xls .000 76.529 1.672 4.Method Validation Data: result series: Series 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 11 12 13 12 13 12 14 12 15 12 12 15 12 12 10 Series 2 13 12 12 15 11 10 13 11 12 14 15 Series 3 10 13 14 12 13 14 11 12 17 14 17 12 11 12 Series 4 10 12 16 18 13 14 14 12 17 14 10 12 11 Series 5 17 11 13 14 13 12 13 11 13 Series 6 10 13 14 12 13 14 11 12 17 14 17 12 169 Solution: Series 1 Number of results.803 2. there is a statistically significant difference in variance values for the compared series.077 0.635 2.000 50. α = 0.356 1.075 2.095 7.04 3.071 0.733 26. Excel file: exampl_valid16.137 0.257 25.© 2009 by Taylor & Francis Group.05) 2 3 4 5 6 15 11 14 13 9 12 1.100 0.091 3.250 1.727 56.125 0.

8 9. Data: result series: Series 1 1 2 3 4 5 6 7 8 9 10 11 12 13 Solution: r SD1 SD2 L t tcrit 0.1 8. six independent series of measurements were performed for six standard solution samples.6 Conclusion: Because t < tcrit.1 9.1 9.1 Series 2 9. calculate value repeatability for the analytical method.440 0.170 Quality Assurance and Quality Control Example 7.© 2009 by Taylor & Francis Group.3 8. LLC .1 10.7 8.xls Example 7.2 9. Apply the Morgan test.05) if the values of the standard deviation for the given series of results are statistically significantly different.9 9.2 9.2 9.17 Problem: For the given series of measurement results–dependent variables.4 9.3 9.8090 0.7 8.580 0.1 8.576 2. In each series. .816 1. there is no statistically significant difference in variance values for the compared series.2 9. Excel file: exampl_valid17. five repetitions were made.9 9.6 10.1 9.9 8. Using the obtained measurement results.6 8.9 9. check (at the significance level of α = 0.18 Problem: To determine the values of repeatability.201 8.7 9.8 9.

5 171 Solution: Because the levels of analyte concentrations in the investigated standard solutions samples are different. six independent series of measurements for the samples were performed for one standard solution. CV (%) Fmax Fmaxo (k = 6.52 29. LLC .28 6 5 0.532 5. repeatability should be calculated as a mean value CV for the given series.121 2. It is possible to calculate repeatability as a mean value CV for the given series.65 4 5 0.4 Series 6 17. CV repeatability Excel file: exampl_valid18.2 10.305 1. there is no statistically significant difference in variance values for the compared series. calculate the values of repeatability and intermediate precision for the analytical method. Series 1 Number of results.50 Conclusion: Because Fmax < Fmaxo.8 17.2 17. In each series.24 5.Method Validation Data: result series: Series 1 1 2 3 4 5 2.67 2.34 3 5 0.05 5 5 0. SD Coefficient of variation.3 17. f = 4.9 14. six repetitions were performed.19 Problem: To determine the values of repeatability and the intermediate precision of the analytical method.0 17.© 2009 by Taylor & Francis Group. .43 2.142 5. α = 0.14 7.2 14.327 2.54 2.8 13.xls 3. If variances are not homogeneous.05) 5 0. one should reject the deviating value (series) and perform the calculations again.9 11.1 Series 5 14. Because series are equinumerous.119 1.12 5.34 5. the calculations should use the values of CV and not SD. If variances are homogeneous.60 2 5 0.11% Example 7.34 Series 4 10.02 Series 3 7.15 7.16 5. one should apply the Hartley Fmax test. The first step is to check the homogeneity of variances for individual series of results.2 10.76 11. Using the obtained measurement results.09 7. n Standard deviation.34 7.65 2.3 14.34 Series 2 5.3 10.

05) 6 1.422 6 6 3.507 7.472 2 6 2. n Standard deviation.52 18. If variances are not homogeneous.581 26.xls Data: result series: Series 1 1 2 3 4 5 6 101 104 103 101 100 102 Series 2 103 106 102 105 109 104 Series 3 111 107 104 102 110 105 Series 4 – – – – – – Series 5 103 102 106 103 107 104 Series 6 103 108 102 107 105 103 . repeatability should be calculated as a mean value CV for the given series. Excel file: exampl_valid19a. there is a statistically significant difference in variance values for the compared series.941 6 6 2.172 Data: result series: Series 1 1 2 3 4 5 6 101 104 103 101 100 102 Series 2 103 106 102 105 109 104 Series 3 111 107 104 102 110 105 Quality Assurance and Quality Control Series 4 100 102 101 117 115 103 Series 5 103 102 106 103 107 104 Series 6 103 108 102 107 105 103 Solution: The first step is to check the homogeneity of the variances for individual series of results.© 2009 by Taylor & Francis Group. Series 1 Number of results. one should apply the Hartley Fmax test. If variances are homogeneous. f = 5. Results from series 4 should be rejected due to lack of homogeneity of variances and calculations should be performed again. Because series are equinumerous. LLC .70 Conclusion: Because Fmax > Fmaxo. α = 0. one should reject the deviating value (series) and perform the calculations again.483 3 4 5 6 1. SD Fmax Fmaxo (k = 6.

there is no statistically significant difference in variance values for the compared series. 37–39]: • Sample analysis of suitable certified reference materials • Comparison of the obtained result with a result obtained using a reference (original. Trueness is the closeness of agreement between the average of an infinite number of replicate measured quantity values and a reference quantity value [26]. The truer and more precise the results obtained using a given method. the more accurate the result of a single measurement is.© 2009 by Taylor & Francis Group. It is influenced mostly by the bias of the analytical method. n Standard deviation.507 – 5.472 2 6 2.483 3 4 5 6 1. SD Fmax Fmaxo (k = 5. Relationships between trueness.68 16. Repeatability was calculated as a mean of SD values for individual series.7 Accuracy and Trueness Accuracy is defined as closeness of agreement between a measured quantity value and a true quantity value of a measurand [26]. Analysis of these definitions shows that the hitherto existing notion of “accuracy” was replaced by the term “trueness. LLC . f = 5. Intermediate precision is SD. precision.05) 6 1. Trueness and accuracy can be determined using different approaches [33.2. final) method [40–42] • Standard addition method .941 6 6 2.75 7. SD repeatability SD intermediate precision Excel file: exampl_valid19b. other parameters such as linearity and sensitivity also influence the accuracy of an analytical method.” It is trueness that describes the conformity of results obtained using a given analytical method to real (expected) results. Accuracy is a combination of trueness and precision. 9]. and accuracy are presented schematically in Figure 7. Of course.xls 2.37 2.30 173 Conclusion: Because Fmax < Fmaxo. calculated using all the 30 results. α = 0.” and the previously applied notion of “accuracy of a single measurement” is now simply “accuracy.3 [4.422 6 0 3.Method Validation Series 1 Number of results.

With regard to the manner of presenting a determination result.12) ε xi = d xi µx (7. their influence on measurements varies. 7. precision.© 2009 by Taylor & Francis Group. one can distinguish: • Absolute error dx. and accuracy [4.1 Measurement Errors The notion of accuracy is closely connected with the notion of errors [43]. which can be described by the dependence: d xi = x i − µ x • Relative error εx.3 Relationships between trueness.13) . There are three basic types of errors: • Gross errors • Biases • Random errors The influence of individual types of errors on a measurement result is presented schematically in Figure 7. The value of a single measurement result may differ (and actually always differs) from the expected (real) value.7. 9]. described by the equation: (7.2.4 [9].174 Quality Assurance and Quality Control INCREASING TRUENESS µ µ INCREASING ACCURACY µ µ INCREASING PRECISION FIGURE 7. Depending on the type of errors. The difference is due to the occurrence of different errors [44]. LLC .

4 Influence of individual types of errors on a measurement result [9]. one can distinguish: • Methodological errors • Instrumental errors • Human errors The total error of a single measurement result may be divided into three components. . • It appears only in some measurements. one with unknown distribution and an unknown expected value.14) where dxi = total error of a measurement result xi = value of a measurement result µx = expected value ∆ xsys = bias ∆ xi = random error δxi = gross error For measurement series (at least three parallel analyte determinations in the same sample). Gross error is characterized by the following properties: • It is the result of a single influence of a cause acting temporarily. LLC . there is a high probability of detecting a result(s) with a gross error. • It is the easiest to detect.© 2009 by Taylor & Francis Group.Method Validation ∆xsys δxj 175 x2 x1 x3 x4 x5 x6 µx xm xj ∆x1 ∆xm FIGURE 7. as described by the following equation [45]: d xi = xi − µ x = ∆x sys + ∆xi + δxi (7. • It is a random variable — however. and therefore to eliminate. With regard to the source of errors.

• The cause of its occurrence can be. Methods of gross error determination are described in Chapter 1.5 presents specific methods of bias determination [9]. LLC .5 Basic Information Concerning Methods of Bias Determination [9] Bias Type Constant Requirements Samples of two standards (reference materials) with different analyte content Course of Action Series determinations for two standard samples (reference material samples) with different analyte content.176 Quality Assurance and Quality Control • It assumes both positive and negative values (unlike bias). using the developed method. Each of them is applied in specific conditions. the trueness of the obtained final determination (most often the mean value of the measurement series) is influenced by biases and/or random errors. μ2x are the expected values for two standard samples. Constant bias asys is determined according to the formula: asys = µ1x x1m − µ 2 x x 2 m µ1 x − µ 2 x (7. TABLE 7.5 Selection criteria for a suitable manner of action in detecting and rejecting results with gross errors. There are many known ways of detecting results with gross errors. Figure 7. SERIES OF RESULTS OF INDEPENDENT DETERMINATIONS Known SDg value Unknown SDg value Known Rm value Rcrit Not numerous series Rcrit Numerous series kα Not numerous series Numerous series kα Unbiased series t Biased series wα Q-Dixon FIGURE 7. x2m are the mean values determined for standard samples. for example. After eliminating results with gross errors. The determination of biases is one way to determine the trueness of an analytical method. a mistake in instrument reading or a mistake in calculations.15) where μ1x. . and x1m.© 2009 by Taylor & Francis Group.5 schematically presents the selection criteria for a suitable manner of action in detecting and rejecting results with gross errors. often described as “outliers” [9]. often described as “outliers” [9]. Table 7.

63) and (1.64). The values of constant bias and variable bias are determined according to the formulas: (a) constant bias a = − asys b (7. The value of variable bias is determined according to Equation (7. x mCst are the mean values determined for sample and sample with standard addition.16) Variable where Ct is the expected value increase of analyte concentration due to standard addition. The relationship between results obtained by the reference method (0Y axis) and results obtained by the developed method (0X axis) is determined. x2m(ref) are the mean values determined for the first and second standard when using the reference method.17).18) Constant and variable Series samples with different analyte content Reference method where x1m(ref)1. The value of variable bias is determined according to the equation: bsys = 1− B B (7. LLC . and xm. Regression parameters of the regression line Y = b · X + a are determined according to Equations (1.Method Validation Bias Type Requirements Sample and sample with standard addition Course of Action 177 Series determination with the use of the developed method for sample and sample with standard addition.17) Variable Samples of two standards (reference materials) Reference method Two series of determination for two standard samples with the use of the reference method and the developed method.19) (continued) . The correction multiplier value is determined according to the formula: B= Cst x mCst − x m (7. Series determination for samples with different analyte content with the use of the reference method and the developed method. The correction multiplier value is determined according to the formula: B= x 2 m (ref ) − x1m (ref ) x 2 m − x1m (7. and x1m. x2m are the mean values determined for the first and second standard with using the developed method.© 2009 by Taylor & Francis Group.

20) A determination result (arithmetical mean of a series of parallel measurements) can only have a bias and random error according to the following dependence [45]: d xm = x m − µ x = ∆x sys + ∆x m (7.23) where dxm = total error of a determination result (arithmetical mean of the series of measurements) xm = mean value of the series of measurement results µx = expected value Δxsys = bias Δxm = random error If the determined bias refers to an analytical method. than s → 0. In this case. LLC . the random error is negligibly small with relation to the bias when n → ∞.178 Quality Assurance and Quality Control TABLE 7. the following dependence is true [45]: d xmet = E ( x met ) − µ x = ∆x sys (7.21) asys = − a b (7.22) b = B (7. then with a large number of conducted measurements.5 Basic Information Concerning Methods of Bias Determination [9] (continued) Bias Type Requirements Course of Action therefore (b) variable bias therefore bsys = 1 −1 b (7.24) where dxmet = total error of a determination result for the applied analytical method E(xmet) = value of a determination obtained as a result of a given analytical method used (expected value for a given analytical method) µx = expected value (real) Δxsys = bias .© 2009 by Taylor & Francis Group.

whose value is not relative to analyte concentration levels — asys • A variable bias. Of course. Its value influences the precision of the obtained results. one may use for “poor” (small) result series the “approximate test” of Cochran’s C and Cox test (Section 1. can a result have a random error.9) for the significance of differences between two results.26) Only after rejecting results with a gross error and determining biases (regarding their values and correcting the determination result). Of course.10) or Aspin and Welch test (Section 1. LLC .11). Trueness or accuracy can be determined using different techniques [37–39]. In case of its inaccessibility. one can present the following dependence: x m = µ x + ∆x sys = µ x + asys + bsys µ x = asys + (1 + bsys )µ x (7. the bias of an analytical method is determined. it is not always possible to use reference material samples precisely satisfying given needs. Another manner (most often applied) to determine the trueness or accuracy is the analysis of a reference material sample (or better still.8. In this case.5). One may differentiate between two types of bias: • A constant bias. reference material is characterized by a constant and strictly defined analyte concentration and with a known concentration determination uncertainty [26]. In each case. one can compare both results visually. however. one should prepare a standard solution by adding a strictly specific quantity of analyte into the investigated sample and subject it to determination. One of them is comparing the obtained measurement value with the value obtained resulting from a method of reference for which the obtained results are treated as accurate.8. whose value depends (most often linearly) on analyte concentration levels — bsysµx Bias is described by the dependence: ∆x sys = asys + bsys µ x (7.8. Section 1.© 2009 by Taylor & Francis Group. The occurrence of bias makes a given series of measurement (analytical method) results differ from the expected value by a constant value — hence they are either overstated or understated.8. one should perform independent determinations for a blind sample and correct the . samples of the certified reference material) using the investigated analytical method. but it is more metrologically correct to use Student’s t test (Section 1. this test can only be applied when the compared methods do not differ in a statistically significant manner with respect to precision (Snedecor’s F test. when the result of the Snedecor F test application is negative (standard deviations for the series of measurements obtained by the compared analytical methods differ statistically and significantly). According to the general definition.25) Assuming that the value of a random error is negligibly small compared to the bias value. However.Method Validation 179 In this manner.

To test if the obtained measurement value does not differ in a statistically significant manner from the certified value (expected value). one should calculate the value of the R relation according to the formula: R= x1m x2m (7. one should infer that the compared mean values do not differ in a statistically significant manner. Using obtained values. using a dependence described by the equation: U=k x1m + x 2 m 2 ( SD 2 1 2 + SD2 ) (7.28) where U = expanded uncertainty for determined relation k = coverage factor whose value depends on the accepted level of probability (most often 95% for which k = 2) There is also another approach based on the comparison of values calculated from the dependence that can be presented using the following expressions: xi − xref (7. The inference is as follows: if the interval of a determined ratio ± the uncertainty of its determination (R ± U ) includes 1.27) and then the uncertainty U.30) where xi = value of a determination result xref = reference value u( xi ) = uncertainty of a determination result u( xref ) = uncertainty of a reference value .© 2009 by Taylor & Francis Group. one should apply Student’s t test (Section 1. An insignificant difference between two obtained results may also be tested by using the method of calculating the ratio between the obtained results and uncertainties of their determination.180 Quality Assurance and Quality Control result for the sample with the known analyte concentration by the obtained measurement result.8. the ratio should be 1) and values of uncertainty for such a determined quantity. LLC . One determines the ratio of the obtained means (if the values did not differ between themselves.29) 2 u(2xi ) + u(2xref ) (7.9).

EURACHEM [28] recommends 10 parallel determinations for a blank sample and the same number of determinations for reference material samples.Method Validation 181 Inference. • When.5 6. In this case. Apply the confidence interval method. in this instance.© 2009 by Taylor & Francis Group. the following dependence is true: xi − xref ≥ 2 u(2xi ) + u(2xref ) then the result is acknowledged to not be in conformity with the reference value. is as follows: • If the inequality occurs: xi − xref < 2 u(2xi ) + u(2xref ) then the result is deemed to be in conformity with the reference value. determining trueness should be carried out using at least nine parallel determinations at three different analyte concentration levels (at least three determinations per each level of concentration). LLC . the corrected mean obtained for the investigated method is compared with the one obtained by the primary method. It is also recommended to perform a series of measurements for the reference material using a so-called primary method. after the initial outlier rejection. characterized by a null value of bias. Assume the value α = 0. This manner of inference is based on comparing differences between two results with the expanded uncertainty (for k = 2) calculated using the uncertainty for the compared values. check if there is a result with a gross error.2 9.20 Problem: In the given series of measurement results.05. however. The calculated trueness should be presented as the percentage of recovery of the expected value or as a difference between the mean and the expected value together with the given confidence interval. According to recommendations by ICH [6. Data: result series.8 9. 7]. The mean obtained for blank samples is then deduced from the mean obtained for the reference material. and so the corrected value is compared against the certified value.3 .8 7. Example 7. mg/dm3: Data 1 2 3 4 5 8.

182 6 7 8 α Solution: xmin xmin + 1 xmax xmax − 1 tcrit Initially.xls Example 7.20. mg/dm3: Data 1 2 3 4 5 6 8.8 7. Assume the value α = 0.21 Problem: Using the data given in Example 7. Excel file: exampl_valid20. apply the confidence interval method.59 mg/dm3 n SD n− 2 g = xm ± tcrit g 8.77 mg/dm3 0.10 ÷ 10.2 9.67 mg/dm3 (7.05.447 8. without the initial outlier rejection.05 6.3 7. LLC .5 6.2 .8 9.© 2009 by Taylor & Francis Group. the result xmin was rejected.2 9.5 9.1 8.3 8.8 9.77 ± 1.8 0.44) mg/dm3 Conclusion: The value xmin lies outside the determined confidence interval — hence it has a gross error. xm SD Quality Assurance and Quality Control 8. Data: result series.2 2.

46 mg/dm3 1. mg/dm3: Data 1 2 3 4 5 6 7 8 α 8.xls 8.20.3 9.05.2 9.1 8. Assume the value α = 0.1 8.8 7.03 mg/dm3 g = xm ± w α ⋅ SD g 8.87 9. Data: result series.8 0.5 1.77 mg/dm3 0.39) mg/dm3 Conclusion: The value xmin lies outside the determined confidence interval — hence it has a gross error.Method Validation 7 8 α Solution: xmin xmax wα xm SD 6. It should be rejected and the values of xm and SD should be calculated for the new series of data.05 183 8.46 ± 1.8 0.22 Problem: Using the data given in Example 7.© 2009 by Taylor & Francis Group.3 8.5 6. LLC .8 9.59 mg/dm3 Example 7.05 . apply the Dixon Q test.93 mg/dm3 (6.53 ÷ 10.2 9. xm SD Excel file: exampl_valid21.

check if there are any results with a gross error.© 2009 by Taylor & Francis Group.xls 8.9 14.2 13.2 11. R Q1 Qn Qcrit R = xn − x1 Q1 = Qn = x2 − x1 R xn − xn−1 R 8 3.8 .05. Apply the confidence interval method.20 0. the value xmin has a gross error.469 0.7 13.2 13.7 14. xm SD Excel file: exampl_valid22.184 Solution: Quality Assurance and Quality Control Number of results Range.3 13.2 13.1 13. Data: result series.4 13.4 13.23 Problem: In a given series of measurement results. ppm: Data 1 2 3 4 5 6 7 8 9 10 11 12 13 13. LLC .094 0.468 Conclusion: Because Q1 > Qcrit.4 13. It should be rejected and the values of xm and SD should be calculated for the new series of data.59 mg/dm3 Example 7. Assume the value α = 0.77 mg/dm3 0.

2 14.2 13.Method Validation 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 α Solution: xm SD kα 13.0 13.3 13.8 0.2 14.8 15.1 13.4 13.8 13. LLC .92) ppm Data 1 2 3 4 5 6 7 13.05 185 g = xm ± kα ⋅ SD g 13.2 13.2 13.1 14.2 13.19 ppm (12.7 13.© 2009 by Taylor & Francis Group.9 14.7 13.2 13.6 13.73 ± 1.9 13.4 .4 13.4 13.53 ÷ 14.1 14.2 15.65 14.72 ppm 1.7 13.73 ppm 0.7 14.

0 13.8 Conclusion: Results 10. Apply the critical range method.2 13.4 13.186 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 Quality Assurance and Quality Control 13. Assume the value α = 0.05.6 13.68 ppm 0. After their rejection the values of xm and SD were calculated again.7 14.2 14.2 Outlier 13.1 14. LLC .2 13.2 Outlier Outlier 13.2 13.36 ppm Example 7.24 Problem: Check if there are results with a gross error in a given series of measurement results.2 13.xls 13. Results of measurements were obtained using a method for which the standard deviation method had been determined. and 17 lie outside the determined confidence interval — hence they have a gross error.© 2009 by Taylor & Francis Group. 16.8 14. xm SD Excel file: exampl_valid23.7 13.4 13.9 13.2 14.8 13.3 13.7 13.7 14.1 14. .

0 ppb 19.05 4. LLC . new calculations for the new series should be done. ppb: Data 1 2 3 4 5 6 7 8 9 113 125 120 127 115 118 117 – 124 .39 21. Data (2): result series.© 2009 by Taylor & Francis Group. ppb: Data 1 2 3 4 5 6 7 8 9 α SDg Solution: xmin xmin + 1 xmax xmax − 1 z R Rcrit 113 115 134 127 4.5 187 Rcrit = z ⋅ SDg Conclusion: Because R > Rcrit.8 ppb 113 125 120 127 115 118 117 134 124 0.Method Validation Data: result series. a result xmax is considered to be an outlier.

1 51.1 57.7 53.8 53.2 54.3 ppb Conclusion: Because R < Rcrit.9 52.xls 121.3 51. Data: result series.1 54.5 57.05.0 ppb 19.65 ppb Example 7. Results were obtained using a method for which a standard deviation had been determined before. Apply the confidence interval method.188 Solution (2): xmin xmin + 1 xmax xmax – 1 z R Rcrit Quality Assurance and Quality Control 113 115 127 125 4. Assume the value α = 0.00 ppb 6. xm SD Excel file: exampl_valid24.0 56.29 14. there are no more outliers in the series.25 Problem: Check if there is a result with a gross error in a given series of measurement results.© 2009 by Taylor & Francis Group. the values of xm and SD could be calculated.2 55.7 . LLC . ng/g: Data 1 2 3 4 5 6 7 8 9 10 11 12 13 14 55.1 56.8 56.

05 1. Assume the value α = 0.1 57.9 ng/g n n −1 g = xm ± kα ⋅ SDg g 54.65 54. .8 ng/g Example 7.6 ÷ 58.7 ng/g 1. check them for the occurrence of outliers.0 1. It has been included in the series.26 Problem: Determinations were made for 25 samples.2 54.05.© 2009 by Taylor & Francis Group. The confidence interval value was calculated for the new series. and the values of xm i SD were calculated again.5 0. LLC .2 ng/g (51.9 189 Result xmin was initially rejected.xls 54.1) ng/g Conclusion: An initially rejected result xmin lies in the determined confidence interval. Using the data obtained measurement results.3 55.7 51. performing three parallel determinations per each sample. xm SD Excel file: exampl_valid25. xm 54.9 57. Apply the critical range method.Method Validation 15 16 17 α SDg Solution: xmin xmin + 1 xmax xmax – 1 ka 51.9 ± 3.

23 3.37 3.96 Result 3 3.14 3.23 3.49 3.62 3.21 3.07 3.09 0.71 3.82 3.98 3.99 3.82 3.28 3.44 3.05 0.45 3.49 1.33 3.56 3.88 3.33 3.01 3.11 3.23 3.67 3. LLC .33 3.11 3.45 3.65 3.12 3.41 3.33 0.62 Conclusion OK OK OK OK OK OK OK OK .51 3.65 3.41 3.07 3.65 3.41 3.08 0.34 0.08 3.58 Quality Assurance and Quality Control Result 2 3.20 3.62 α Rm zα Solution: Sample 1 2 3 4 5 6 7 8 Ri 0.74 3.01 3.22 3.23 3.72 3.190 Data: result series.32 3.45 3.49 3.01 3.34 0.12 3.04 3.04 3.56 3.13 3.33 3.60 3.13 3.67 3.12 3.11 3.24 0.© 2009 by Taylor & Francis Group.62 3.20 0.45 3.22 3.98 3.41 0.35 3.41 3.11 3. ppm: Sample 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Result 1 3.04 3.52 3.01 3.48 3.

41 5.11 10.59 0. LLC .28 0.23 10.67 0.19 0. determine the value of the constant bias asys.66 0.11 5.04 5. with seven parallel determinations performed per sample. Using the obtained result series. Excel file: exampl_valid26. ppm: Results Series 1 1 2 3 4 5 6 7 10.74 0.47 0.01 10.60 0.54 Rcrit Outlier OK OK OK OK OK OK OK OK OK OK OK Outlier OK OK OK 0.49 0.61 0.12 .© 2009 by Taylor & Francis Group.45 5.28 10. Data: result series.98 0.07 10. Ri > Rcrit results should be rejected as an outliers.15 0.xls Example 7.Method Validation 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 0.27 Problem: Analyte concentrations were determined in two standard solution samples.22 10.96 191 Ri = xni − x1i Rcrit = zα ⋅ Rm Conclusion: For series 9 and 21.87 0.97 0.23 Series 2 5.33 5.29 0. A second standard solution was obtained by double dilution of the first standard solution.13 5.

determine the value of the variable bias bsys.0 10.28 Problem: Analyte concentrations were determined in a real sample and in a real sample with the addition of the standard.5 58.2 57.23 2 x1st x2st kx1m − x2m k −1 0.192 x1st x2st Solution: x1m x 2m k k= asys = asys Excel file: exampl_valid27.85 25.2 56. Using the data obtained result series.290 ppm Example 7.© 2009 by Taylor & Francis Group.9 58.4 33.8 34. correct the values obtained for the real sample.16 5.xls Quality Assurance and Quality Control 10. For each of the samples. ppm: Results Series 1 1 2 3 4 5 6 33.5 . six parallel measurements were made.0 5.72 57.9 33. LLC .9 Cst Solution: xm xmCst 33.1 33.2 33.0 Series 2 57. Using the calculated value of the correction multiplier.8 58. Data: result series.

Using the obtained result series. using an investigated method and the reference method. using both methods. LLC .63 978. ppb: Reference Method Sample 1 x1ref 1 2 3 4 5 6 7 8 Solution: x1m(ref) x2m(ref) x1m x 2m 748.xls 1.62 767.88 954.29 Problem: Analyte concentrations were determined in two real samples.75 746 740 753 758 743 750 746 755 Sample 2 x2ref 945 947 956 960 948 955 960 966 Validated Method Sample 1 x1 765 772 758 768 783 749 777 769 Sample 2 x2 967 980 978 984 974 984 975 988 .035 34.© 2009 by Taylor & Francis Group. Using the calculated value of the correction multiplier.Method Validation Cst xmCst − xm 1− B B 193 B= bsys = xm( corr ) = B ⋅ x B bsys xm(corr) Excel file: exampl_valid28.93 Example 7. For each of the samples. correct the values obtained using the validated method.036 −0. determine the value of the variable bias bsys. eight parallel measurements were made. Data: result series.

2 111 Reference Method xref 45. ppb: Validated Method x 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 46.3 57.2 39. determine the variable bias bsys and the constant bias asys.2 12.xls Example 7.194 Quality Assurance and Quality Control x2m( ref ) − x1m( ref ) x2m − x1m bsys = 1− B B B= xm( corr ) = B ⋅ x B bsys x1m(corr) x2m(corr) 0.30 Problem: Analyte concentrations were determined in 15 real samples using the validated method and the reference method.83 Excel file: exampl_valid29.8 89.8 77. Apply the linear regression method.9 103 56.975 0.2 44. For each of the samples three parallel measurements were made using each of the methods.3 47.2 37.026 748.3 109 59.3 106 .7 86.3 90.2 35.2 19.3 38.9 88.8 56.1 27.08 953.9 97. Using the obtained data.4 21. Data: result series.5 101 79. and the mean values were presented.© 2009 by Taylor & Francis Group.2 26. LLC .6 10.

ruggedness (flexibility) is a parameter describing the usefulness of a given analytical method in different conditions. 47]. the greater the attention one should pay to maintaining these parameters at a stable level. The greater the influence of slight changes in parameters of the measurement process on final determination results.2.972 0.8 Robustness and Ruggedness The robustness of a method is determined to find the influence of slight fluctuations of conditions in a given analytical method on the result of final determination.Method Validation Solution: xref = b ⋅ x + a asys = − bsys = a b (B) asys bsys Graph: 120 100 80 60 40 20 0 0 20 40 60 x 80 100 120 xref xref = 0.972x – 0. It is a parameter concerning changes in internal conditions [46.589 195 a b 1 −1 b –0.589 0.xls 7.© 2009 by Taylor & Francis Group. LLC . 47]. and can be estimated based on reproducibility [46.0292 Excel file: exampl_valid30. However. Robustness influences the manner of conducting measurements using a given analytical method. .607 0.

indicating the total mercury content in samples of muscle tissue of great cormorant (Phalacroxorac carbo) with the use of atomic absorption spectroscopy (cold vapor technique). The amalgamation reaction is a selectivity reaction for mercury. After this step.g. changes in purity and types of reagents. its robustness and ruggedness are also determined in interlaboratory studies. 7. although the influence of fluctuations from some measurement conditions (in a method subjected to validation) may be conducted in one laboratory (e. Solution: In the case of the cold vapor technique. Determination of a combined uncertainty for an investigated analytical method (most often expressed as a percentage of the determined value) makes it possible to know the quality of results obtained with a given method. The validation process method was conducted.31 General problem: An analytical procedure was developed. and slightly fluctuating the parameters of the applied analytical method. with a wavelength of 253. and then (after an eventual reduction to atomic mercury). pH fluctuations. the influence of fluctuations in temperature. Conclusion: Such a measurement method guarantees high selectivity for indicating mercury for two reasons: 1. the amalgam is heated to 600°C and the released atomic mercury is directed through the air stream to the absorption cell. LLC . conditions of chromatographic isolations) [46. determining the appropriate validation parameters. but it should be presented in the final method validation report. The absorption measurement is realized using a characteristic wavelength for mercury. sent by hollow mercury cathode lamp. 2.. . Based on the estimated uncertainty value.196 Quality Assurance and Quality Control Similarly to the reproducibility of an analytical method.7 nm. 47]. mercury is released from the analyzed sample.© 2009 by Taylor & Francis Group. in which an absorption measurement is conducted.2. it is trapped on the gold bed as an amalgam. one can determine the usefulness of a given analytical method for a given determination. Problem 2: Based on measurement results for the series of standard solutions. Problem 1: Determine the selectivity of the CV-AAS method. The exact characterization of this parameter. together with a description of its determination.9 Uncertainty Uncertainty is not considered a basic validation parameter. These parameters can be calculated based on a study of changes in the standard deviation of the measurement series using a given analytical method. Example 7. determine the linearity of the method. is presented in Chapter 4.

05. SDxy Standard deviation.3 99. n Signal.8 140.2 32.2 170.5 34.6 Hg.© 2009 by Taylor & Francis Group.1 Solution: Before constructing the calibration curve. a calibration curve was constructed and their regression parameters were determined. r 25 1.6 175. ng 197 60 99.1 35. n Slope.730 −2.20 80 5 129.4 63. LLC .79% Conclusion: There are no statistically significant differences in variation values.58 0.2 169.12 1. Hartley’s Fmax test was applied. b Intercept.019 1. SDa Regression coefficient.880 2.2 95.1 100.77% 100 5 158.90 2. a Residual standard deviation.3 0.3 171.40 25.290 1.6 80 142. For this.781 1.03 2.5 98. mean Standard deviation.93% 10. the homogeneity of variation for the results of the series being analyzed should be checked.7 0. % Fmax Fmaxo 20 5 31.3 66. Content of Hg No results.838 1.79% 40 5 62. SDb Standard deviation.9 40 67.1 66.620 2.8 33.1 137.1 136.03 1.8 68.2 138 100 167.9986 . SD CV.61% 60 5 92.11 2. Excel file: exampl_valid31_1. with a significance level of α = 0.xls Due to no statistically significant differences in variation for the compared series.Method Validation Data: results: Unit Content of Hg Signal 20 33.

check the correctness of the LOD determination.© 2009 by Taylor & Francis Group.9987 .73x – 2. SDa Regression coefficient. b Intercept. r The LOD value was determined using the equation: LOD = LOD (SDxy) LOD (SDa) LOD (mean) 3.4 0. and the range. SDxy Standard deviation.11 r = 0.3SD b 2. the LOQ value. requires a high linearity procedure. 40.xls Conclusion: A high value of the regression coefficient. with the fulfillment of the equal distribution of the standard in the range of the calibration line. LLC .198 Graph: 200 180 160 140 Signal 120 100 80 60 40 20 0 0 20 40 Quality Assurance and Quality Control y = 1.974 0. a Residual standard deviation.91 ng 1. determine the LOD values. Solution: n Slope. and 60 ng). r.9986 60 80 Hg Content.45 ng 15 1.62 1. SDb Standard deviation. Problem 3: Based on the series of measurement results for the standard solutions with the three lowest mercury content levels (20.65 1. ng 100 120 Excel file: exampl_valid31_2.023 0.99 ng 2. In addition.

xls Problem 4: Based on the series of results for the three real samples (lyophilized muscle tissue of great cormorant). Based on the relationship: LOQ = 3 · LOD The LOQ value was calculated to be: LOQ = 7. LLC . .65 199 The correctness of LOD determination was made according to the equations: 10 ⋅ LOD > cmin where cmin = 20 ng.© 2009 by Taylor & Francis Group. calculate the repeatability.4 ÷ 100 ng Excel file: exampl_valid31_2.Method Validation Graph: 120 100 80 Signal 60 40 20 0 0 10 20 30 40 Hg Content.4 ng Whereas the range was presented as: 7. LOD < cmin Conclusion: The determined LOD value is correct. ng 50 60 70 y = 1.62x + 1.

mg 1 2 3 4 5 6 7 21.9 24.00 Mean Hg Concentration.41 3.5 Hg Content.1 Hg Content. one should check whether there are no outliers in the measurement results series.25 2.21 2. ng 64.11 3.68 Mean Sample 2 Sample Mass.94 92.69 74.14 71.93 84.26 3. mg 1 2 3 4 5 6 7 25.69 3.61 3.8 21.82 78.8 28.© 2009 by Taylor & Francis Group. ppm 2.87 3. in order to indicate precision. ng 83.37 85.44 2.9 25.42 66.5 33. ng 78.01 79.48 81.93 72.77 80.8 30.25 Solution: Before performing the calculation.84 71.15 3. For this.3 22.2 37.09 3. mg 1 2 3 4 5 6 7 30.22 Hg Concentration.11 78.91 81. ppm 3.21 3.54 3.20 91.32 2. .1 20.3 24.7 31.05).3 35.11 2. the Dixon Q test was applied (with a significance level α = 0.17 2.79 3.77 Hg Concentration.7 20.4 32. ppm 3.82 72.7 22.27 2.90 90. LLC .50 Mean Sample 3 Sample Mass.9 19.200 Quality Assurance and Quality Control Data: Measurement results for individual samples: Sample 1 Sample Mass.33 3.92 3.2 27.0 Hg Content.97 3.62 70.4 20.

76% Sample 2 7 0.678 2. however. can be calculated as a mean value from the coefficient of variation counted for three series: CVrepeatability = 4. % Fmax Fmaxo Conclusion: There are no statistically significant differences in variation values. before calculating the repeatability value (as the mean of the coefficient variation for the results of the three series results).24% Excel file: exampl_valid31_4. of results.118 3.05 was chosen). Sample 1 7 0.116 201 Conclusion: In the series of measurement results.753 2.xls exampl_valid31_3b.Method Validation Sample 1 No.32 0. R Q1 Qn Qcrit 7 0.162 4.33 0. the homogeneity of the variation should be checked for the series of results to be analyzed.43 0. determine the trueness value (as a recovery value).516 2. n Standard deviation.182 0.250 0.xls exampl_valid31_3c. therefore.xls Determinations were conducted for three different real samples. n Range. there are no outliers.063 0.67% 1.© 2009 by Taylor & Francis Group. The calculated repeatability value.364 Sample 2 7 0.163 0.38 Sample 3 7 0.507 Sample 3 7 0.970 2.xls Problem 5: Based on the results determined for certified reference material samples (BCR-463 — Tuna fish: total Hg and methylmercury). LLC . Data: results are given as (ng/mg): Data 1 2 3 4 5 2.918 . Excel files: exampl_valid31_3a.30% No results.107 4. SD CV.68 8. The Hartley Fmax test was applied with this aim (a significance level of α = 0.

5 0 CRM Trueness = 97.767 0. the following were recognized: the uncertainty value resulting from the calibration curve.184 0.2% Determined Conclusion: Results obtained with the use of the developed method are correct. . obtained with the use of the elaborated method.5 2 1.5 1 0.164 97.2% where the expanded uncertainty of the recovery value is calculated in accordance with the equation: U=k (u 2 CRM 2 + udet ) xCRM + xdet 2 Graph: 3. Solution: As the main components of the uncertainty budget.5 3 2.1 ± 8.© 2009 by Taylor & Francis Group.202 Value CRM Solution: Mean SD U R U (k = 2) 2.1% 8.xls Problem 6: Estimate an uncertainty value for the determination results of the total mercury content in real samples.16 k 2 2. the uncertainty value related to the unrepeatability of the measurement results. Excel file: exampl_valid31_5.85 Quality Assurance and Quality Control U 0. LLC . as well as the uncertainty value from the indication of trueness.

conducting measurements for the series of standard solutions. % Graph: 200 180 160 140 Signal 120 100 80 60 40 20 0 0 20 40 60 Content. Sample 1 No results.11 1.22 0.0 7 61. LLC . % urep.69 3.51 0. ppm Usmpl (k = 2).10 4.61 0.© 2009 by Taylor & Francis Group. % usmpl.73x – 2.11 r = 0.29 8.63 4.Method Validation 203 The estimation of the combined uncertainty value was conducted using the relationship: 2 2 2 usmpl = ucal + urep + utrue where usmpl = combined relative standard uncertainty for determined results for the real sample ucal = relative standard uncertainty related to the calibration step urep = relative standard uncertainty related to repeatability of measurement results utrue = relative standard uncertainty related to indicating trueness The determination of the standard uncertainty value related to the calibration step (preparation of the series of standard solutions.10 0.43 0.14 2.77 0.21 9.80 4.9 Sample 3 7 72. Calculations were conducted for minimal weighted masses for each of the analyzed real samples.34 9.39 4. ppm Usmpl (k = 2).14 0.82 3. ng 80 100 120 y = 1. concentration.17 0. % utrue. % usmpl.96 1. ng Hg. ppm ucal.2 . an approximation of measurement points of the calibration line using line regression) was conducted on the basis of the calibration parameters. n Minimum Hg content.25 1.96 1.9986 Sample 2 7 71.

together with precise specification (purity.29 ppm sample 3: 3. producer. and.204 Quality Assurance and Quality Control Conclusions: The estimated expanded uncertainty value for measurement results for real samples does not exceed 10% and allows for the notation of measurement results as follows: sample 1: 2. a detailed description of this synthesis) Description of the methods used for testing the purity of the substances used and the quality of standards Safety requirements A plan describing the means of transferring the method from laboratory conditions to routine measurements Parameters of the method A list of critical parameters whose slight fluctuations can significantly influence a final determination result — parameters resulting from determination of the analytical method’s ruggedness List of all types of laboratory instrumentation together with their characteristic features (dimensions.). 9]: • • • • • • • • • • • • • • • • • • • Subject matter and the purpose of the analytical method (applicability range) Metrological principles Type of the applied analyte(s) and matrix composition List of all reagents. precision class.21 ppm sample 2: 3. LLC . etc.25 ± 0.4 Conclusions Validation of an analytical method should be finished with a final report containing [2.xls 7. for example.22 ± 0.© 2009 by Taylor & Francis Group. in case of laboratory synthesis. quality.xls exampl_valid31_6c. standards. and reference materials used.xls exampl_valid31_6b.34 ppm Excel files: exampl_valid31_6a.xls exampl_valid31_7.77 ± 0. block schemes in case of complicated instrument kits Detailed description of the conditions for conducting the analytical method Description of statistical conduct together with the enclosed suitable equations and calculations Description of the method in order to inspect its quality in routine analyses Suitable figures and graphs. chromatograms and calibration curves Conformity of the determined validation parameters with the assumed limits The uncertainty of a measurement result Criteria that one should fulfill in revalidation Full name of the person who conducted the validation process List of literature used .

16 μg/g.48 ± 0. Poland) • Nitric acid — suprapure (Merck.. and long life span. mercury is further atomized. Measurements of the content of total mercury will be performed using the cold vapor AAS technique. Solution: Seabirds are useful bioindicators of coastal and marine pollution. create a validation report. Japan) • Additive M (POCh.© 2009 by Taylor & Francis Group. 98% (Nacalai Tesque. However. and free mercury vapor in the generated gas is collected by a mercury collection agent (gold-coated diatomite particle support) in the form of a gold amalgam. The analytical procedure is intended for determining whole mercury content in muscle tissue samples from great cormorants.7 nm in the detector’s absorption cell.85 ± 0.Method Validation 205 • Recapitulation and conclusions • Confirmation and signature of the person responsible for the test and confirmation of the validation.31. 2. concentration 100. due to their specific feeding habits. Inc. standard solutions should be kept in a cool. Mercury content is determined in lyophilized muscle tissue of great cormorants. The released mercury is detected using the cold atomic absorption method at a wavelength of 253. The mercury collection agent is then heated up to 600°C to release atomic mercury. Great cormorants (Phalacrocorax carbo) were used as bioindicators for mercury contamination.05 (POCh. Inc. IRMM (Geel. Belgium) • Deionized water Preparation of Standard Solutions There are various methods available for preparing standard solutions. because most occupy higher trophic levels. dark place. the following reagents are used: • Mercury standard — MSHG. Therefore. 100-ppm.. Ltd. Poland) • CRM: BCR-463: Total and methyl mercury in tuna fish. Example 7. Kyoto. Germany) • Buffer solution. USA) • l-Cysteine.. pH 7.3% HCl (Inorganic Ventures. LLC . making them susceptible to bioaccumulation of pollutants. A sample is thermally decomposed. During the analytical procedure. wide geographical ranges.32 Problem: Based on the validation parameters indicated for the analytical procedure in Example 7.22 μg/ml in 3. Marine birds spend a significant portion of their lives in coastal or marine environments and are exposed to a wide range of chemicals. Japan) • Additive B (Wako Pure Chemical Industries.00 ± 0. The analytical procedure pertains to the indication of total mercury content (after converting the total mercury content into an atomic form). in this case. solution stability degrades with age or due to long storage in a warm place. . Nippon Instrument Corporation obtained good results using l-cysteine.

during the preparation of standard solutions. It is acceptable to use commercially available undiluted standard stock solutions (100-ppm or 1000-ppm) of mercury intended for atomic absorptiometry as HgCl2. because of the high temperatures of some of its components.000 ml by adding deionized water. Standard Solution Preparation Take 1 ml of 100-ppm solution and dilute it to 10 ml with 0. a standard solution of 10-ppm has been prepared. .001% l-cysteine solution. For storage. and 10-ppm or less standard solution should be reprepared after 1 year or 6 months have elapsed. wash it with acid. solid. While ensuring uniformity of the contents in the flask by shaking it well. Because Hg(NO3)2 may react with l-cysteine and lose its function as a fixing agent. The work should be conducted under a fume hood. dark place. By diluting in a similar manner. an automatic mercury analyzer is used. Mercury has toxic properties. carefully wash the flask with acid and ensure that its tap is thoroughly washed. when any solution of 1-ppm or less is prepared. MA-2000 from NIC (Japan). Protective attire should be worn: safety glasses. therefore. LLC . the system consists of the mercury analyzer (MA-2). Now. It should be noted that any mercury present in reagents or redistilled water should also be taken into consideration when a very dilute solution is prepared. ensure that any mercury contained is in the form of HgCl2. As shown in Figure 7. and gas (optional parts required) samples. For determining total mercury content in analyzed samples.32-1. Any diluted solution. respectively. and a personal computer (PC). However. The Mercury/MA-2000 is a mercury analysis system that can measure mercury in liquid. do not use standard undiluted Hg(NO3)2 solutions. keep in a cool.001% l-Cysteine Solution Measure 10 mg of l-cysteine and place it in a 1000-ml flask. such as ovens heated up to 850°C. rubber gloves. laboratory coat. 100-ppm standard solution. Once samples are in position in BC-1. In particular. each of them in turn is automatically transferred to the analyzer FIGURE 7. Some products contain Hg(NO3)2 as a mercury component. Care should also be taken while working with the atomic absorption analyzer.32-1 Mercury MA-2000 analysis system. using pipettes during the preparation of standard solutions.© 2009 by Taylor & Francis Group. the sample changer (BC-1). Before using a new volumetric flask. it is advisable to adhere to procedure guidelines for these types of substances. then add water and 2 ml of guaranteed reagent-grade concentrated nitric acid. a standard solution of any concentration may be prepared. bring the total volume to 1.206 Quality Assurance and Quality Control Preparation of 0.

32-2 Schematic diagram of MA-2000.1 mg) into precleaned combustion boats and automatically inserted into the Mercury/MA-2000 system (NIC. Japan). if not done so. To remove any interfering substances that are generated when thermally decomposing a sample. can be performed. preheating the gold-coated diatomite particle support collection agent allows for the measurement to be done without the influence of any organic components. which would adversely affect measurements. which would be physically absorbed to a certain extent. As a method of removing any substances that could interfere with the measurement. to be measured. LLC . . it is recommended that two types of additives be used: additive B (activated alumina) and additive M (sodium carbonate and calcium hydroxide). The PC reads the resulting measurements in the order that the various analyses. Homogenized samples should be stored in a refrigerator with a temperature of 0–6°C.Method Validation Jacket heater Sensor S2 Sensor S1 207 H2 Sample inlet Fan F1 H3 Sensor S3 VS Activated charcoal ﬁlter Absorption cell Fan F2 Fan F3 Sensor S4 Dehumidifying bottle COMMON Valve NO NC Gas washing bottle Hg Lump Pump Flow controller Activated charcoal ﬁlter FIGURE 7. Before use. A block diagram of the apparatus is presented in Figure 7. freeze-dried (lyophilized). Analytical Procedure Carefully separated bird tissues should be immediately deeply frozen.© 2009 by Taylor & Francis Group.32-2. Homogenized samples should be directly weighed (10–50 ± 0. the additives should be subjected to a heat treatment in a heat treatment furnace at 750°C for at least 3 hours. In addition. and homogenized. including statistical calculations. gas washing is performed.

cover with additive B. Using an automatic pipette. as well as the level of its homogeneity. Additive B en.208 Sample Quality Assurance and Quality Control Additive M Put the dispensed sample onto additive M. repeat at least three times. Additive Finally. which corresponds to 20–100 ng Hg. Additive M Recover the sample with additive M. the maximum sample mass is restricted by the maximum .© 2009 by Taylor & Francis Group. LLC . The sample boats that will be used should also be subjected to the same heat treatment. The method for using the additives is presented schematically in Figure 7.32-3. this value should not be less than 20 mg.to 100μL section.32-3 Method for using the additives. dose at least five different volumes of the standard solution with a concentration of 1-ppm from the 20. Sample M B M FIGURE 7. Taking this into account. once more cover with additive M. The minimal mass of the lyophilized tissue samples undergoing determination is limited on the one hand by the accuracy of the weight measurement. Calibration Determine the calibration curve as a function of the peak surface area and the mercury content (Hg). However. For each mercury mass.

which can be introduced into the ceramic boat and consequently into the furnace.32-4. During the analytical validation procedure. Linearity A series of standard solutions was prepared with a mercury content of 20–100 ng.© 2009 by Taylor & Francis Group. Compare these values with the determined values that are contained in the report. This value should not exceed 200 mg. regression parameters were indicated and . substance mass. 2. LLC . the values for the following parameters were indicated. three independent measurements were conducted. ASA ANALYSIS FINAL DETERMINATION Calculation of Hg content on the basis of calibration curve parameters FIGURE 7. The amalgamation reaction is a selective reaction for mercury. and based on the obtained results. The next steps of the analytical procedure are schematically presented in Figure 7.Method Validation 209 Lyophilisation of muscle tissue of great cormorant SAMPLE PREPARATION Weighing of sample directly in ceramic boat Addition of additives M and B Introduction of ceramic boat into MA-2000 instrument and starting of the analysis Analysis parameters: • Concentration level – mode HIGH. the calibration curve corresponds to the range of Hg values in lyophilized tissue 0. or the values corresponding to the section of values that most often appear in muscle tissue of great cormorants. • Temperature program – MODE2.32-4 A schematic presentation of the analytical procedure for the determination of total mercury content in muscle tissue of great cormorant samples. The absorption radiation measurement is realized for mercury’s characteristic wavelength. Selectivity Applying the measurement technique ensures high selectivity for indicating mercury for two reasons: 1. Taking this into account. For each of the solutions. Draw the calibration curve and indicate the value of the regression parameters.1–5.

32-1 Calculated Regression Parameters for Linearity Determination Number of results.9986 FIGURE 7.730 −2. SDa Regression coefficient. parameters that determined LOD values.11 2.32-5.32-6. LLC . and the relationship: LOD = 3. r 25 1. The obtained values are presented in Table 7.© 2009 by Taylor & Francis Group.9986 200 180 160 140 Signal 120 100 80 60 40 20 0 0 20 40 60 80 Hg Content. and the calibration curve is presented in Figure 7.3 0. 40. n Slope. commands a high linear procedure.32-5 Calibration curve for linearity determination. Limit of Detection and Quantitation The LOD value is determined based on a series of measurement results for standard solution samples with the three lowest levels of mercury content (20. and 60 ng).73x – 2. r after fulfilling conditions for a “uniform” concentration distribution in terms of the calibration curve. a Residual standard deviation. SDxy Standard deviation of the slope. A calibration curve was outlined based on the obtained measurement results.019 1.210 Quality Assurance and Quality Control the calibration curve was determined. TABLE 7. . b Intercept. A high regression coefficient.32-1.11 r = 0.3SD b A calibration plot is presented in Figure 7.7 0. SDb Standard deviation of the intercept. ng 100 120 y = 1.

The determined repeatability value is equal to: CVrepeatability — 4. . This value is determined as an average CV value for three series. However.4 ÷ 100 ng which.45 ng. assuming the sample mass that underwent indication of an even 20 mg.0 ppm Repeatability Repeatability is determined based on a series of measurement results for three real samples (muscle tissue of great cormorant after lyophilization).24%.37).65 211 FIGURE 7.2%. which. to a maximum standard solution concentration used for calibration. corresponds to the mercury concentration in tissue samples of an even 0. The determined trueness value is equal to: 97. corresponds to a mercury concentration of: 0.37 ÷ 5.Method Validation 120 100 80 Signal 60 40 20 0 0 10 20 30 40 Hg Content.1 ± 8.32-6 Calibration curve for LOD determination. assuming the mass of the sample that underwent indication is an even 20 mg. A series of five independent determinations are conducted. LLC . equaling 7. ng 50 60 70 y = 1.© 2009 by Taylor & Francis Group. Range The measurement range is a concentration range from the LOQ section. it is equal to: 7.32-7. Trueness The trueness value is determined based on determination results for certified reference material samples (BCR-463 — Tuna fish: total Hg and methylmercury) and is presented as a recovery value. The LOD value was deemed to be 2.12. Therefore. the LOQ value was determined to be LOQ = 3 · LOD. The determined trueness value is graphically presented in Figure 7.4 ng (assuming the mass of the 20 mg sample corresponds to a concentration of 0.62x + 1.

attention should be paid to the stability of the calibration curve.32-7 Comparison of the determined value with a certified Hg content value — trueness determination.212 3. Determination of standard uncertainty related to the calibration step (preparation of a series of standard solutions. whose value should not exceed CV = 5%.5 3 2. related to calibration urep = the standard uncertainty for determination results for real samples.5 2 1. LLC .1% (as an average of the three samples).© 2009 by Taylor & Francis Group. The calculated uncertainty value for k = 2 equals 9. During the revalidation process.32-1). The consecutive parameter is trueness. as well as repeatability. the uncertainty value related to the unrepeatability of measurement results. in relation to the repeatability of measurement results utrue = the standard uncertainty of results related to the determination of trueness.5 0 CRM Quality Assurance and Quality Control Determined FIGURE 7.5 1 0. The determined value parameters for the calibration curve should not differ by more than ±5% in relation to values determined during the validation process (Table 7. . Uncertainty The main components of the uncertainty budget were the uncertainty value resulting from the determination of the calibration curve. an approximation of measurement points of the calibration line with the use of linear regression) is conducted based on calibration parameters. realization of measurements for the series of standard solutions. indicated based on CRM determinations. Calculations are conducted for minimal masses for each of the analyzed real samples. An estimation of the combined uncertainty value is conducted using the calculation: 2 2 2 usmpl = ucal + urep + utrue where usmpl = the combined standard uncertainty from the determination results of real samples ucal = the standard uncertainty from results of determination results from real samples. as well as the uncertainty value indicating trueness.

United States Pharmacopeia 23. Pollut. K.” Pure Appl. Sitko. Downs. Ellison. S.. Y.© 2009 by Taylor & Francis Group. C.. Geneva. Anan.. EURACHEM Guide: The Fitness for Purpose of Analytical Methods. S. Okabe. Ambrus. intestines. S. “Ecological effects. 3rd edn... M.labcompliance. Saeki.. Huber. “Determination of total mercury in muscle. J.. S.. Nam. 50(2). and Eurasian buzzard (Buteo buteo). Kim. ICH-Q2A.” Environ.G.” Chemosphere.pdf Thompson. and Tatsukawa. 503–514.L. Kubán. Tanaka. International Conference on Harmonization (ICH) of Technical Requirements for the Registration of Pharmaceuticals for Human Use: Validation of Analytical Procedures: Metrology. 2005. International Conference on Harmonization (ICH) of Technical Requirements for the Registration of Pharmaceuticals for Human Use: Text on Validation of Analytical Procedures. 1998. E. T. Subramanian.. 94.at/programmes/nafa/d5/trcfpc/d5-trcfpc. and kidney tissues of cormorant (Phalacrocorax carbo). ICH-Q2B.N.. .. P.. A. and fate of Mercury: a general review.. Validation and Qualification in Analytical Laboratories.. 249–255.. R. Houserová. 134. J. 1335–1351. E... R... Pollut. 2005. J.. and Tatsukawa. 1996. H. 108. Komar..H.. transport.. K. “Specific accumulation of 20 trace elements in great cormorants (Phalacrocorax carbo) from Japan. R. D.. Practical Approach to Validation of Methods for Analysis of Residues.. M.com.... 61–68.. S. 40. E. United States Pharmacopeial Convention. Pollut. 1994. Macleod.... Med. “Harmonized guidelines for single-laboratory validation of methods of analysis.. LLC . 74.-Y. K. and Wood.. Kim.. “Specific accumulation of mercury and selenium in seabirds. http://www.. 145. Tanabe.Y. “Mercury and cadmium in common cormorants (Phalacrocorax carbo). 1996. Saeki. Y. “Total mercury and mercury species in birds and fish in an aquatic ecosystem in the Czech Republic. 835–855. 2000. Chem. 185–194. D. liver. Saeki. Kim. and Sitko. US Rockville. V. 1999. Geneva. 2007. 1995. FAO/IAEA Training and Reference Centre for Food and Pesticide Control.L. Ikemoto. First Internet version. great crested grebe (Podiceps cristatus). Pollut. L. Tanabe. 1998.. Kracmar.” Vet. Draft April 2004. and Tanabe. 2000. http://www. and Lester. and Kuban. – Czech. 2002.. International Vocabulary of Basic General Terms in Metrology.. D.” Environ.” Environ. Y.or. S. 149–187. 1998. Fukuda. 108.iaea.. 261–265.html... Houserová.org/vim/VIM_final_fd_13april041. S.R.” Water Air Soil Pollut. J. Matejcek.W. “Mercury in precipitation and its relation to bioaccumulation in fish: a literature review. P.-Y. A. Hedbavny..” Environ.ncsli.Method Validation Bibliography 213 Boening.. Draft 1. www. V. Okabe.

1996. 256–259. International Conference on Harmonization (ICH) of Technical Requirements for the Registration of Pharmaceuticals for Human Use: Text on Validation of Analytical Procedures. Nippon Instruments Corporation.1 ± 8. Chem. 1996. Specifying and evaluating analytical chemistry quality requirements for ecological risk assessment. ICH-Q2B.. M. 2001. Wisconsin Department of Natural Resources. 4. Qual.M.12. “Mercury/MA-2000. www. 2004. and allows for the discovery of trace amounts of mercury in analyzed samples. ICH-Q2A. “Measurement of near zero concentration: recording and reporting results that fall close to or below the detection limit. P. The procedure is characterized by high selectivity. Analytical Detection Limit Guidance. A. assuming the minimal mass is an even 20 mg.. 126. trueness (recovery = 97. 173–190. “Limits of detection.” Trends Anal. Vogelgesang. Piotr Konieczka. Johnston. J. identification. Results obtained while using this method are characterized by low uncertainty (about 10%). 6. Rev. J. 535–552. Gdan ´ sk. K. I. Bioanal. 2007. 376–382. 5.. and therefore.5 ng of total mercury) in the sample. repeatability (CV = 4. 1999. 1994. L. 2000.” Instruction Manual. and Hädrich. and determination: a statistical approach for practitioners. Jacek Namies ´nik. The estimated LOD value (LOD = 2. 20 June 2008. References 1.com. The validation process was conducted by Dr. NIC-600-2009-04. R..or. San Diego. 380. 3. Danzer. Chem. Huber. Geneva. 7.labcompliance. and Van Bockstaele.. Marine Environmental Support Office.. Traverniers.. 242–255. International Conference on Harmonization (ICH) of Technical Requirements for the Registration of Pharmaceuticals for Human Use: Validation of Analytical Procedures: Metrology. Draft 1. No.” Crit.” Accred.at/programmes/nafa/d5/trcfpc/d5-trcfpc. “The role of and place of method validation in the quality assurance and quality control (QA/QC) system. Geneva. “A closer look at analytical signals.© 2009 by Taylor & Francis Group. De Loose. Conclusions This analytical procedure fulfils requirements for a procedure serving to determine whole mercury content in lyophilized tissue samples from muscle tissue of the great cormorant. Anal. Mercury Analysis System. 2. 6..214 Quality Assurance and Quality Control Analytical Methods Committee. Assur. R.. Validation and Qualification in Analytical Laboratories. http://www. 1998. Konieczka... high precision. Ambrus.iaea..” Analyst. E. “Trends in quality in the analytical laboratory: II. 2004. 37. 23.K. Analytical method validation and quality assurance. . Chem.2%).html... The validation report was checked and confirmed by Prof. 1998. LLC .” Anal. Technical Memorandum 99-01. FAO/IAEA Training and Reference Centre for Food and Pesticide Control. corresponds to a concentration of 0.24%). and Valente. Practical Approach to Validation of Methods for Analysis of Residues.

. Instytut Medycyny Pracy im. J. 2004. 386–393.” Anal.” Pure Appl. D. Assur. and Wood..... 73–82. Warszawa. Asuero. S... Valcárcel. 27. M. A. “Quantifying selectivity: a statistical approach for chromatography. Vesseman. M. 23. “The application of single drop extraction technique for chromatographic determination of solvent residues in edible oils and pharmaceutical products.. J.. Chem... 2001. R. United States Pharmacopeial Convention. 762. Chim. 70.. 14.....” Fresenius J. and González.. 2008. “In defense of the correlation coefficient. “Harmonized guidelines for single-laboratory validation of methods of analysis. 12.. A. J. “Further comments on the (mis-)use of r for testing the linearity of calibration functions... Danzer. and Górecki. 835–855. Stefan. 11. Roum.L. 21.G. Namieśnik. A.” Accred. Mulholland. and Currie. M... International vocabulary of metrology — Basic and general concepts and associated terms (VIM).. 2006. C. 25–35. Fajgelj. and Müller. 1998. Acta.” Accred.. 73. P. 41–59. M.. and Einax. 10. Konieczka. WNT.” Pure Appl.” Chem. H.. M.. 1995.” Accred. M.. T. Chem.” Rev.. 2001. Elskens. Ellison. 10. 2001. Qual. Rev. Chem.. Konieczka.R. Kapeller.. Analytical Detection Limit Guidance. Chem.” Pure Appl. “The correlation coefficient attacks again. “A procedure to assess linearity by ordinary least squares method. and Hibbert. “Linearity of calibration curves: use and misuse of the correlation coefficient. 20. 17. Anal.. (red). Asuero. 15. First Internet version. 31. 74.. 552. J.. Wisconsin Department of Natural Resources. 36.. 20.C. 2006.G. “Guidelines for calibration in analytical chemistry. 26. 256–258. 9... H.I. A. 639–654. 1071. 28. 10.. J. Thompson. Assur. 16. 18. Chim. “Comparison of detection limits in environmental analysis — is it possible? An approach on quality assurance in the lower working range by verification. Croux. M.. 2001.. 22. L. Assur. D. De Souza. eds.. 1060–1070. 13. Chem. P. Chromatogr.” Chromatographia. Zapewnienie jakości analiz chemicznych. 19.. Van Staden. 2004. Michulec. US Rockville. “Development of headspace solid-phase microextraction–gas chromatography method for the determination of solvent residues in edible oils and pharmaceuticals. S. and Beernaert. A. 119–124.. W. Qual. Danzer. Nofera.. 29. 2003. A. “The correlation coefficient: an overview. Assur. Dobecki. and Namieśnik. 726.. Hibbert. Joint Committee for Guides in Metrology. 9.. “Selectivity in analytical chemistry revisited. 2002. 1381–1386. Chem. 25.. 2005.A. 281–285.R..” Accred... Lindner. Qual. and Junqueira. LLC . S. Kontrola i zapewnienie jakości wyników pomiarów analitycznych. 673–678. 1998. 11. 2003 (in Polish). M. 46. 2006.” J. González. Gómez-Hens. Huber..” Accred.F. and Wardencki.G.. 146–152.B.. Anal. Qual. Inż.© 2009 by Taylor & Francis Group. “Quality of analytical results. . A.. JCGM 200. K. Bioanal. Assur. 1996.V. W.T. 2002. Van Loco. “Linearity and the limitations of least squares calibration. Burns. Sayago.L. J.” Anal. and Sayago. A. Michulec.. EURACHEM Guide: The Fitness for Purpose of Analytical Methods. 993–1014. Qual. “Selectivity in analytical chemistry (IUPAC Recommendations 2001). Ekol.. and Wardencki. K. 300–301. Prof. 11.” Crit.B. Chromatogr. J.. 64. United States Pharmacopeia 23. A.” Trends Anal. S. W. 2007 (in Polish).. 1997. Geiß. W.G. Herrador. and Rubio S. A.Method Validation 215 8.. R. 2005. 953–962. 191–197. “Sposoby wyznaczania granicy wykrywalności i oznaczalności.” J.. 24. 7. 2006. Ellison.W. 370. Chem. R. 2004 (in Polish). “On the use of the correlation coefficient r for testing the linearity of calibration functions.. R.G. 30.Á. D. 377. Łódź.

A.. 33. and Vander Heyden. Współczesna chemia analityczna.” J. 38.” Accred. A. 38.” Talanta. Accuracy (trueness and precision) of measurement methods and results — Part 5: Alternative methods for the determination of the precision of a standard measurement method. Cuadros-Rodríguez. 1994.. Danko. P. Przyk. Y. Dejaegher. 37.M.. “Absolute methods in analytical chemistry. 1994. W. 57–69. 35. 25–32.. L. Konieczka. 1994.. ISO 5725-6.. De Castro. 1994. Richter. ISO 5725–4. 71. 138–157. 47. 45. Dybczyński.. 43. and Namieśnik. ISO 5725-2. Accuracy (trueness and precision) of measurement methods and results — Part 2: Basic method for the determination of repeatability and reproducibility of a standard measurement method. Romero.. 44. “Systematic errors in analytical chemistry. 2007. Hulanicki.. H. Assur. Chem. “Statystyczne kryteria oceny wyników i metod analitycznych. Świtaj-Zawadka. R. Kozłowski. 40. 2. “An exact test for analytical bias detection...” Crit. M. 36. and Samczyński. . 1994. Hibbert. 1997. 2005. Qual. “Calibration in metrological approach.. ISO 5725-1. 41. Accuracy (trueness and precision) of measurement methods and results — Part 6: Use in practice accuracy values.. M.. ISO 5725-3. and Bosque-Sendra..V. Anal. Bolfarine.. Acta. 2001.B. Lett. R. 538. Chim. “Ruggedness and robustness testing.... PWN. 2001 (in Polish). A.” Pure Appl. Warszawa. 2005. E. 1158..” J. “Primary methods of measurement in chemical analysis. Accuracy (trueness and precision) of measurement methods and results — Part 3: Intermediate measures of the precision of standard measurement method. 1905–1911. 1979 (in Polish).© 2009 by Taylor & Francis Group. D. 35. E. Chromatogr.. LLC .. 375–381.: Analiza ilościowa związków organicznych. 1995. 2007. H. Anal. 67(11). Accuracy (trueness and precision) of measurement methods and results — Part 1: General principles and definitions.. J. 2005.. PWN. “The role of the robustness/ruggedness and inertia studies in research and development of analytical processes. ISO 5725-5. Hulanicki. B.. Rev. B. 1994. Galea-Rojas. and De Castilho. 1158. 529–536.. 39. Warszawa. Chromatogr.” in Bobrański B.” Anal. Chem. 42. A. “RNAA in metrology: a highly accurate (definitive) method. Accuracy (trueness and precision) of measurement methods and results — Part 4: Basic method for the determination of the trueness of a standard measurement method. A. 46. Z. 354–359. M. J.216 Quality Assurance and Quality Control 32. 34. Polkowska-Motrenko. 353–376.

101 2.750 2.576 217 .499 3.149 2.093 2.648 2.763 2.447 2.201 2.179 2.086 2.984 1.678 2.000 1.042 2.355 3.716 2.841 4.898 2.009 2.925 5.567 9.707 3.303 3.604 4.779 2.030 2.878 2.626 2. Student’s t Test f 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 22 24 26 28 30 35 40 45 50 60 70 80 100 ∞ α = 0.262 2.032 3.690 2.160 2.921 2.01 63.110 2.977 2.064 2.056 2.048 2.228 2.365 2.706 4.706 2.012 2.169 3.776 2.014 2.845 2.106 3.861 2.074 2.Appendix Table A.055 3.660 2.639 2.960 α = 0.05 12.021 2.819 2.990 1.994 1.947 2.306 2.182 2.131 2.250 3. LLC .© 2009 by Taylor & Francis Group.1 Critical Values.571 2.120 2.797 2.

848 1.931 1.954 1.936 1.05 1.509 2.© 2009 by Taylor & Francis Group.916 1.903 1.814 1.399 2.928 1.447 2.943 1.910 1.953 1.470 2.498 2.918 2.941 1.960 α = 0.949 1.487 2.542 2.460 2.933 1.409 1.920 1.440 2.414 1.757 1.547 2.208 2.256 2.432 2. LLC .142 2.2 Critical Values of Parameter wα f 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 22 24 26 28 30 35 40 45 50 60 70 80 100 ∞ α = 0.479 2.948 1.956 1.945 1.885 1.524 2.951 1.412 2.537 2.368 2.492 2.923 1.454 2.051 2.518 2.385 2.935 1.324 2.944 1.576 .926 1.950 1.895 1.218 Appendix Table A.715 1.937 1.01 1.348 2.529 2.955 1.423 2.553 2.870 1.645 1.294 2.940 1.

941 0.889 0.31 5.10 2.48 4.96 1.370 0.08 4.0 7.1 6.00 4.67 3.03 7 43.05 n f 1 5 10 15 20 30 40 60 120 ∞ 2 18.01 2.08 3.23 4.89 2.0 4.82 4.39 4.78 4.80 2.86 2.64 4.Appendix 219 Table A.77 3 27.434 0.23 4.63 4.81 4.83 4.1 5.46 4.90 4.3 Critical Values of z Parameter for Significance Level α = 0.74 3.62 Table A.55 12 53.11 4.80 5.4 6.23 2.43 2.91 4.6 7.39 10 49.32 5.84 3.29 9 47.8 5.72 4.58 3.679 0.557 0.44 4.05 0.05 2.96 3.33 4.12 4.36 3.4 Critical Values of Parameter zα n 2 3 4 5 α = 0.88 3.44 3.60 4.72 4.65 4.64 3.72 5.17 8 45.55 4.5 Critical Values (Qcrit) of Dixon’s Q Test f 3 4 5 6 7 8 9 10 α = 0.31 4 32.468 0.4 6.560 0.780 0.527 .20 5.0 3.50 α = 0.590 0.4 6.437 0.412 α = 0.30 4.698 0. LLC .36 4.79 3.92 3.24 4.98 Table A.10 0.76 1.47 11 50.60 3.94 4.01 3.31 4.20 5.15 3.40 3.765 0.57 1.33 5.10 4.91 4.73 4.71 1.95 2.10 4.46 5.40 5.83 2.17 5.886 0.92 4.1 6.60 4.01 4.22 4.06 1.86 6 40.49 3.14 1.642 0.69 3.45 4.60 5.63 5 37.52 4.67 4.58 5.74 4.16 4.46 1.03 4.04 3.01 0.66 α = 0.988 0.99 5.77 4.56 4.62 4.482 0.30 4.507 0.83 5.65 4.399 0.98 3.349 α = 0.© 2009 by Taylor & Francis Group.555 0.37 4.637 0.

446 0.478 0.579 0.467 0.514 0.05 0.489 0.220 Appendix Table A.451 0.454 0.580 0.417 0.468 0.605 0.388 0.555 0.926 0.443 0.458 0.608 0.477 0.6 Critical Values (Qcrit) of Dixon’s Q Test (Modification for n ≤ 40) f 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 α = 0.377 0.501 0.594 0.436 0.495 0.647 0.371 α = 0.429 0.384 0.680 0.381 0.502 0.407 0.402 0.530 0.472 0.635 0.672 0.586 0.462 0.393 0.© 2009 by Taylor & Francis Group. LLC .526 0.438 .412 0.502 0.970 0.489 0.994 0.710 0.717 0.821 0.610 0.483 0.479 0.535 0.529 0.567 0.459 0.670 0.517 0.565 0.697 0.397 0.569 0.374 0.423 0.01 0.564 0.628 0.829 0.611 0.544 0.510 0.546 0.627 0.450 0.740 0.442 0.

67 33.09 21.7 Critical Values χ2 Test f 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 α = 0.58 32.03 22.00 33.99 7.80 36.92 18.65 α = 0.31 .72 26.49 11.05 3.28 15.92 35.36 23.51 16.84 5.31 19.01 6.07 15.00 26.21 11.69 29. LLC .81 18.87 30.59 28.41 37.17 36.59 14.Appendix 221 Table A.64 42.57 38.34 13.68 25.81 9.09 16.22 27.21 24.14 30.48 20.64 9.68 21.30 27.29 41.19 37.41 34.14 31.07 12.41 32.98 44.93 40.67 23.© 2009 by Taylor & Francis Group.

63 10 19.88 10.40 99.39 8.67 6.02 4.97 7.59 3.12 7.28 8.78 2.41 12.95 2.74 9.50 6.05 10.10 7.09 14.63 6.64 3.00 14.26 2.39 5.26 3.33 5.67 5 19.78 10.55 3.94 4.34 8.25 99.85 3.27 4.15 4.54 11 19.8 Critical Values.34 6.14 10.67 4.37 99.45 4.55 4.84 3.81 27.34 5.16 99.© 2009 by Taylor & Francis Group.04 14.54 4.68 6.91 6.00 3.03 3.88 27.46 6.95 4.79 3.63 6.45 4.93 14.13 5.47 3.26 15.39 15.26 8.71 3.69 5.97 4.74 9 19.25 9.46 3.62 3.84 27.84 7.56 3.07 7 19.12 28.21 8.98 3.99 3.07 5.94 27.28 29.00 99.71 6.01 (Bottom Row) f1 f2 2 3 4 5 6 7 8 9 10 11 2 19.39 99.09 5.19 3.54 3.82 4.06 4.59 6.46 .18 5.58 6.97 4.48 6.29 5.76 27.53 9.36 8.03 7.01 3.35 8.19 3.05 (Top Row) and α = 0.47 3.62 3.37 3.30 9.24 6.82 3.80 4.79 13.02 4.79 7.71 6.99 3.63 3.78 27.32 6 19.52 5.20 5.17 9.94 18.13 5.01 28.41 8.10 5.60 6.30 99.98 7.91 3.16 15.36 5.23 5.21 4.82 10.10 7.38 8.59 16. LLC .88 8 19.21 3.95 10.86 4.27 5.78 4.06 3.20 3 19.73 6.80 3.46 8.49 6.81 6.74 10.23 5.37 5.57 3.70 9.33 99.38 99.39 3.15 4.18 2.15 8.98 4.14 5.31 5.90 4.92 4.07 7.66 4.65 4.36 99.44 6.22 4 19.69 6.98 5.01 4.40 8.01 9.85 2.55 30.96 14.48 5.96 4.35 3.00 5.87 7.33 8.76 9.86 6. Snedecor’s F Test for Significance Level α = 0.222 Appendix Table A.22 5.87 3.19 11.42 3.39 4.05 4.74 3.45 4.06 7.10 3.06 2.

34 4.00 11 626 114 48.7 9.5 13.85 1.95 7.76 2.6 20.67 1.5 10.3 12.1 24.21 2.29 2.00 5 202 50.8 15.19 4.60 7.00 5.01 3.11 1.05 k f 2 3 4 5 6 7 8 9 10 15 20 30 60 ∞ 2 39.3 12.00 9 475 93.40 1.7 10.86 2.91 8.© 2009 by Taylor & Francis Group.36 2.2 20.8 8.29 2.94 6.00 .34 4.2 19.49 3.7 25.17 1.04 1.9 41.1 9.4 8.5 22.33 1.6 26.40 4.7 13.66 5.9 Critical Values.85 3.8 9.82 4.3 11.7 15.95 2.5 8.00 6 266 62.37 3.24 3.03 7.7 10.2 10.5 18.30 1.59 4.91 2.02 2.45 8.8 9.94 3.00 3 87.87 5.78 2.6 14.01 5.9 16.99 4.77 4.31 5.70 8.4 9.78 8.96 1.43 4.38 6.00 10 550 104 44.8 15.5 37.80 6.0 11.2 16.00 8 403 83.54 2.26 1.18 6.10 3.00 7 333 72.42 4.5 11.1 9.0 28.67 4.07 1.9 33.00 4 142 39.0 15.Appendix 223 TABLE A.15 5. LLC .95 3.46 2.03 3.61 1.22 1.68 3.54 2.7 17.3 9.1 12.12 2.6 13.0 29.72 2.44 7.5 27.37 3. Hartley’s Fmax Test for Significance Level α = 0.7 10.12 7.92 4.11 6.41 7.5 18.29 5.

70 1.69 1.65 1.3 1.70 1.65 1.0 1.71 1.72 1.72 1.71 1.82 1.69 1.85 1.78 1.70 1.71 1.90 1.76 1.66 1.78 1.73 1.74 1.85 1.90 1.90 1.64 1.76 1.76 1.70 1.75 1.65 1.73 1.65 1.71 1.73 1.75 1.73 1.75 1.65 1.65 1.81 1.05 c f1 6 f2 6 8 10 15 20 ∞ 6 8 10 15 20 ∞ 6 8 10 15 20 ∞ 6 8 10 15 20 ∞ 6 8 10 15 20 ∞ 6 8 10 15 20 ∞ 0.85 1.72 1.78 1.73 1.75 1.75 1.66 1.8 1.74 1.72 1.64 0.65 1.72 1.67 1.76 1.78 1.82 1.66 1.72 1.66 1.64 1.72 1.75 1.69 1.69 1.74 1.80 1.69 1.94 1.81 1.76 1.70 1.73 1.82 1.72 1.72 1.71 1.69 1.65 1.72 1.70 1.79 1.80 1.70 1.64 0.68 1.67 1.70 1.76 1.86 1.76 1.74 1.65 1.71 1.72 1.75 1.94 1.69 1.69 1.72 1.73 1.72 1.64 0.72 1.70 1.65 1.64 1.72 1.71 1.64 0.73 1.73 1.73 1.71 1.73 1.81 1.81 1.90 1.81 1.64 0.76 1.86 1.74 1.76 1.70 1.78 1.70 1.90 1.81 1.76 1.73 1.68 1.70 1.71 1.90 1.75 1.76 1.76 1.1 1.73 1.70 1.73 1.79 1.82 1.81 1.67 1.94 1.65 1.80 1.78 1.90 1.64 1.86 1.94 1.69 1.80 1.73 1.68 1.0 1.68 1.64 1.75 1.81 1.73 1.73 1.69 1.90 1.85 1.70 1.76 1.65 1.70 1.71 1.68 1.67 1.72 1.70 1.73 1.70 1.73 1.79 1.71 1.70 1.71 1.68 1.9 1.69 1.73 1.78 1.7 1.4 1.72 1.70 1.65 1.90 1.79 1.70 1.79 1.64 1.76 1.90 1.72 1.66 1.66 1.64 1.73 1.76 1.70 1.76 1.71 1.76 1.76 1.68 1.85 1.79 1.70 1.80 1.65 1.71 1.65 1.73 1.81 1.70 1.76 1.72 1.64 0.82 1.94 1.80 1.72 1.94 1.69 1.71 1.70 1.71 1.94 1.70 1.86 1.86 1.73 1.65 1.75 1.65 1.86 1.73 1.73 1.70 1.72 1.72 1.65 1.69 1.72 1.65 1.72 1.81 1.80 1.82 1.76 1.73 1.65 1.64 1.68 1.82 1.90 1.72 1.72 1.66 1.64 0.82 1.6 1.72 1.81 1.66 1.85 1.80 1.82 1.71 1.86 1.71 1.85 1.71 1.79 1.85 1.73 1.224 Appendix TABLE A.66 1.86 1.74 1.72 1.69 1.82 1.85 1.76 1.67 1.72 1.64 1.79 1.73 1.71 1.78 1.72 1.70 1.73 1.80 1.70 1.72 1.80 1.71 1.76 1.79 1.65 1.73 1.86 1.73 1.78 1.76 1.10 Critical Values vo of Aspin-Welch Test for Significance Level α = 0.73 1.70 1.72 1.70 1.71 1.71 1.71 1.69 1.76 1.66 1.73 1.78 1.64 1.© 2009 by Taylor & Francis Group.71 1.71 1.80 1.64 0.73 1.64 8 10 15 20 ∞ .64 1.73 1.94 1.76 1.90 1.71 1.94 1.64 0.73 1.71 1.71 1.73 1.74 1.69 1.75 1.76 1.85 1.5 1.71 1. LLC .94 1.82 1.76 1.76 1.86 1.73 1.68 1.82 1.76 1.85 1.94 1.71 1.71 1.72 1.71 1.71 1.79 1.66 1.70 1.79 1.86 1.94 1.80 1.76 1.75 1.72 1.76 1.85 1.78 1.72 1.75 1.76 1.66 1.70 1.69 1.76 1.70 1.69 1.81 1.67 1.86 1.73 1.72 1.69 1.67 1.67 1.76 1.2 1.65 1.78 1.75 1.79 1.

553 0.278 0.602 0.235 0.270 0.598 0.255 0.332 0.111 0.615 0.332 0.127 0.101 0.626 0.161 0.134 0.402 0. LLC .575 0.172 0.159 0.154 0.01 0.114 0.664 0.184 0.335 0.179 0.877 0.243 0.365 0.995 0.158 n=4 α= 0.124 0.159 0.117 0.475 0.306 0.164 0.261 0.172 0.240 0.131 0.215 0.288 0.273 0.676 0.838 0.397 0.116 0.979 0.151 0. n = number of results for one level.230 0.176 0.653 0.262 0.262 0.251 0.684 0.099 0.141 0.140 0.746 0.186 0.369 0.234 0.445 0.151 α= 0.431 0.541 0.121 0.466 0.147 0.237 n=3 α= 0.294 α= 0.05 – 0.189 0.492 0.281 0.307 0.352 0.120 0.722 0.173 0.288 0.179 0.192 α= 0.142 0.103 0.145 0.727 0.203 0.304 0.942 0.425 0.968 0.339 0.238 0.111 0.391 0.349 0.155 0.170 0.155 0.325 0.256 0.161 0.149 0.425 0.146 0.© 2009 by Taylor & Francis Group.232 0.937 0.358 0.330 0.164 0.160 0.097 p = number of laboratories.118 0.05 0.150 0.137 0.326 0.564 0.794 0.181 0.478 0.197 0.250 0.325 0.138 0.108 0.218 0.303 0.310 0.354 0.480 0.221 0.680 0.841 0.196 0.172 0.372 0.754 0.252 0.568 0.413 0.131 0.121 0.366 0.168 0.883 0.480 0.291 0.01 – 0.291 0.536 0.255 0.270 0.418 0.928 0.197 0.471 0.230 0.166 0.127 0.308 0.450 0.506 0.242 0.179 0.967 0.403 0.357 0.Appendix 225 Table A.629 0.570 0.445 0.214 0.262 0.246 0.116 0.157 0.718 0.05 0.329 0.212 0.516 0.906 0.427 0.140 0.204 0.151 0.481 0.249 0.696 0.167 0.387 0.393 0.131 0.228 0.684 0.347 0.165 0.312 0.684 0.389 0.213 0.293 0.119 0.168 0.05 0.182 0.332 0.238 0.480 0.975 0.193 0.224 0.316 0.191 0.360 0.198 0.220 0.175 0.768 0.939 0.01 0.215 0.229 0.318 0.532 0.544 0.959 0.135 0.633 0.267 0.220 0.212 0.407 0.707 0.128 α= 0.343 0.271 0.01 0.168 0.144 0. .189 0.280 0.418 0.147 0.281 0.834 0.265 0.307 0.185 0.262 0.204 0.246 0.521 0.318 0.452 0.288 0.126 n=5 α= 0.205 0.154 0.202 0.261 0.906 0.137 0.276 0.883 0.190 0.200 0.343 0.241 0.392 0.198 0.138 0.113 0.721 0.274 0.144 0.373 0.208 0.150 0.781 0.871 0.391 0.242 0.106 0.220 0.185 0.184 0.235 0.155 0.155 0.316 0.246 0.624 0.514 0.343 0.259 0.434 0.508 0.191 0.124 0.504 0.204 0.229 0.297 0.164 0.192 0.322 0.781 0.188 0.134 0.382 0.208 0.248 0.561 0.255 0.168 0.463 0.05 0.181 0.447 0.108 n=6 α= 0.356 0.200 0.127 0.164 0.01 0.638 0.196 0.588 0.209 0.300 0.788 0.798 0.129 0.532 0.305 0.496 0.159 0.308 0.377 0.209 0.319 0.331 0.388 0.403 0.372 0.243 0.219 0.437 0.363 0.222 0.230 0.348 0.223 0.864 0.465 0.392 0.423 0.371 0.209 0.450 0.793 0.274 0.417 0.114 α= 0.178 0.287 0.140 0.124 0.174 0.177 0.131 0.293 0.993 0.160 0.301 0.197 0.134 0.286 0.300 0.11 Critical Values of Cochran’s Test n=2 p 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 α= 0.515 0.144 0.134 0.590 0.334 0.355 0.438 0.599 0.276 0.173 0.573 0.520 0.131 0.616 0.

157 3.1864 0.226 Appendix Table A.2537 0.549 2.758 2.155 1.462 2.155 1.973 2.253 3.4759 0.3761 0.381 Lower α = 0.876 2.585 2.4510 0.05 – 0.952 2.636 2.1101 0.036 Two Greatest and Two Smallest Upper α = 0.178 3.5574 0.938 2.859 2.0708 0.2213 0.135 3.4376 0.112 3.781 2.709 2.020 2.5245 0.412 2.286 3.© 2009 by Taylor & Francis Group.139 2.6023 0.5554 0.290 2.1738 0.0002 0.5192 0.715 1.301 3. LLC .5789 0.5766 0.5360 0.4556 0.5856 0.031 3.3585 0.507 2.482 2.5381 0.564 2.0563 0.01 – 0.6382 0.681 2.4857 0.087 3.014 3.3822 0.651 2.0349 0.991 3.5123 0.330 3.025 3.5091 0.236 3.4234 0.5714 0.4085 0.2836 0.274 2.932 2.5470 0.218 3.979 2.215 2.4391 0.3112 0.4214 0.0116 0.6175 0.126 2.968 3.4994 0.620 2.4875 0.965 2.924 2.6247 0.822 2.003 3.387 2.05 1.369 3.01 1.887 2.5636 0.733 2.1448 0.3367 0.060 3.4985 0.755 2.2767 0.1492 0.001 3.0018 0.4711 0.2530 0.841 2.12 Critical Values of Grubbs’ Test One Greatest and One Smallest p 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 Upper α = 0.2016 0.5672 0.3927 0.5469 0.0308 0.908 2.2990 0.806 2.894 2.893 2.3603 0.496 1.802 2.764 1.481 1.316 3.356 3.199 3.3398 0.5862 Lower α = 0.0090 0.4025 0.335 2.6101 0.2280 0.0000 0.852 2.343 3.3200 0.6445 p = number of laboratories .0851 0.5941 0.6316 0.4638 0.5288 0.1150 0.699 2.270 3.

53 1.53 1.55 1.34 2.02 2.41 2.60 1.01 k n p 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 h 1.64 1.08 2.87 1.09 2.65 1.59 1.60 1.52 1.57 1.55 1.52 1.30 2.05 2.65 8 1.74 1.69 1.22 2.71 1.52 1.65 1.90 1.43 1.60 1.73 1.07 2.06 2.44 2.09 2.63 1.60 1.33 2.56 1.09 2.40 2.54 1.66 1.77 1.43 2.87 1.48 1.56 1.82 1. n = number of results for one level.53 1.55 1.51 1.08 2.13 2.59 1.51 1.81 1.57 1.13a Parameters h and k of Mandel’s Test for Significance Level α = 0.50 1.62 1.05 2.53 p = number of laboratories.10 4 1.67 1.78 1.90 1.64 1.68 1.57 1.49 2.49 1.71 1.53 1.86 1.44 2.55 1.79 1.61 1.99 2.45 2 1.65 1.76 1.52 1.89 1.65 1.55 1.Appendix 227 TABLE A.64 1.71 1.77 1.46 1.60 1.85 1.09 2.59 1.39 2.01 2.71 7 1.00 2.15 1.79 1.41 1.79 1.56 1.89 1.53 1.49 2.55 1.71 1.53 1.66 1.90 1.18 2.45 1.43 1.50 1.58 1.62 1.61 9 1.60 1.© 2009 by Taylor & Francis Group.65 1.58 1.56 1.54 1.53 1.70 1.60 1.56 1.63 1.77 1.44 2.91 1.69 1.71 1.79 6 1.59 1.39 1. LLC .64 1.49 3 1.60 1.06 2.74 1.65 1.51 1.79 1.60 1.69 1.55 1.53 1.52 1.56 1.49 1.41 2.56 1.36 2.64 1.62 1.29 2.90 1.63 1.71 1.20 2.42 2.90 1.70 1.70 1.38 2.47 2.70 1.71 1.25 2.91 1.67 1.56 1.53 1.60 1.53 1.08 2.56 1.65 1.77 1.64 1.53 1.04 2.39 2.53 1.48 2.65 1.85 1.78 1.97 1. .49 1.14 2.53 1.75 1.53 1.90 1.39 2.07 2.88 1.44 2.54 1.68 1.88 1.88 1.73 1.36 2.47 1.94 1.70 1.48 1.35 2.59 1.84 1.60 1.89 1.58 1.27 2.57 1.32 2.69 1.55 1.70 1.47 2.78 1.76 1.71 1.44 2.91 2.06 2.87 1.51 1.57 10 1.32 2.05 2.51 1.65 1.58 1.65 1.91 5 1.79 1.78 1.60 1.58 1.46 2.79 1.77 1.79 1.45 2.25 2.57 1.48 1.56 1.68 1.45 2.46 2.47 2.03 2.85 1.59 1.78 1.63 1.42 2.50 1.07 2.76 1.08 2.42 2.71 1.59 1.98 2.53 1.37 2.56 1.46 1.63 1.52 1.52 1.72 1.48 2.90 1.

94 1.37 1.36 1.44 1.94 1.93 1.40 1.90 1.71 1.92 1.94 1.41 1.36 1.44 8 1.38 10 1.85 1.43 1.71 1.40 1.15 1.36 1.36 1.35 1.93 1.45 1.33 1.36 1.62 1.47 1.43 1.67 1.58 1.94 1.48 1.91 1.71 1.94 1.43 1.64 1.40 1.53 1.43 1.46 1.42 1. .38 1.68 1.36 1.71 1.57 1.42 1.40 1.35 1.48 1.51 1.75 1.37 1.38 1.36 1.51 1.50 1.36 1.94 1.69 1.39 1.58 1.35 1.36 1.71 1.47 1.71 1.31 1.40 1.44 1.50 1.69 1.59 1.90 1.41 1.39 1.89 1.38 1.94 3 1.60 1.39 1.71 1.50 1.53 1.85 1.38 1.90 1.36 1.47 1.41 1.70 1.76 1.88 1.53 6 1.© 2009 by Taylor & Francis Group.59 1.38 1.05 k n p 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 h 1.47 1.38 1.36 1. LLC .39 1.41 9 1.72 1.228 Appendix Table A.40 1.70 1.38 1.89 1.91 1.40 1.60 5 1.36 p = number of laboratories.41 1.92 1.38 1.50 1.47 1.41 1.40 1.35 1.43 1.38 1.56 1.48 7 1.41 1.36 1.35 1.36 1.52 1.52 1.38 1.71 1.93 1.45 1. n = number of results for one level.42 1.51 1.57 1.37 1.90 1.81 1.45 1.29 1.42 1.60 1.59 1.34 1.91 1.86 1.43 1.41 1.88 1.33 1.48 1.37 1.54 1.49 1.38 1.70 1.90 1.59 1.60 1.40 1.46 1.35 1.40 1.78 1.65 1.52 1.44 1.35 1.53 1.43 1.90 1.87 1.32 1.36 1.38 1.94 1.52 1.36 1.71 1.34 1.44 1.53 1.43 1.47 1.53 1.53 1.37 1.88 1.91 2 1.46 1.30 1.41 1.83 1.68 1.69 1.47 1.38 1.89 1.59 1.44 1.60 1.60 1.52 1.36 1.38 1.40 1.44 1.37 1.60 1.66 1.71 1.53 1.93 1.58 1.34 1.94 1.91 1.34 1.57 1.92 1.44 1.94 1.38 1.48 1.44 1.42 1.59 1.52 1.60 1.52 1.41 1.36 1.80 1.36 1.46 1.60 1.72 4 1.38 1.41 1.52 1.87 1.47 1.52 1.37 1.42 1.47 1.38 1.40 1.47 1.93 1.60 1.44 1.48 1.86 1.37 1.44 1.36 1.48 1.59 1.82 1.66 1.35 1.53 1.44 1.43 1.32 1.55 1.53 1.13b Parameters h and k of Mandel’s Test for Significance Level α = 0.71 1.71 1.41 1.70 1.84 1.46 1.48 1.59 1.94 1.

20 α = 0.66 0.63 0.15 0.25 .© 2009 by Taylor & Francis Group.20 0.90 0.44 0.42 0.77 0.59 0.02 0.57 0.71 0.05 0.28 0.30 0.77 0.35 0.22 1.58 0. Kolmogorov-Smirnov Test α 0.83 0.60 0.45 0.80 0.14 Critical Values (λ α ).33 0.Appendix 229 Table A.64 0.74 0.99 λα 1.83 0.25 0.44 Table A.05 0.49 0.36 1.52 1.70 0. LLC .22 0.56 0.53 0.27 0.30 0.01 0.87 0.54 0.02 0.80 0.97 0.60 0.89 0.71 0.50 0.14 1.67 0.10 0.15 Critical Values of Regression Coefficient rcrit f 5 6 7 8 9 10 12 14 16 18 20 25 30 40 50 60 80 100 α = 0.47 0.07 1.75 0.25 0.35 0.01 0.50 0.62 0.39 0.63 1.71 0.40 0.38 0.

- Desde-La-Cruz.pdf
- 19 Nuevos Evangelizadores para la Nueva Evangelizacion - Jose H Prado Flores.pdf
- 9 Salvar Lo Que Estaba Perdido.pdf
- 15 El Silencio Del Musico (Spanish Edition) - Martin Valverde
- 18 Una Primavera Espiritual para la Música Católica - Marco Lopez.pdf
- 17 Una Nueva Cancion_ El Poder de la Música - Marco Lopez.pdf
- 14 El Ministerio de Musica - P Diego Jaramillo
- La Cara Oculta de La ONU - Michel Chooyans
- Santidad Ahora - P Jose Kentenich
- Eurachem Incertidumbre Español
- Bautismo en El Espiritu Santo
- Dormir permite limpieza del cerebro.docx
- Alimentos-antioxidantes.pdf
- Decodificando el significado de las enfermedades.docx
- Naturaleza y Fin de La RCCE
- ECCLA_2008
- 6 La Alabanza - Ivan Herrera
- SVE - Brasil
- La Interpretación de La Biblia en La Iglesia
- Maria Corredentora - MIRAVALLE
- Virgen Maria -Mensajera Del Amor de Dios
- Por Qué Pierden La Fe Los Jóvenes
- EL BAÑO DE LUZ
- Cómo Fomentar Una Vida Digital Saludable
- Uso o Pierdo Mi Tiempo Libre

Sign up to vote on this title

UsefulNot useful- Validación de Métodos Analíticos (Asociación Española de Farmaceúticos de la Industria)by manuelsnic2820
- Statistics and Chemo Metrics for Analytical Chemistry 6th Ed. - J. Miller, J. Miller (Pearson, 2010) BBSby Cristina Stoica
- Essentials of Medical Laboratory Practice - Lieseke, Constance L. [SRG]by Kaan Halici
- Separation Chemistryby Vladyi

- 0645.Trace Environmental Quantitative Analysis. Principles, Techniques and Applications, Second Edition by Paul R. Loconto
- Valid Analytical Methods
- Laboratory
- 5-Notes on Statistics and Data Quality for Analytical Chemists
- Chromatography
- Principles of Environmental Chemistry
- Quality Assurance Management i to 12
- Glp Handbook
- ASTM Data and Control
- Principles and Practices of Method Validation. RSC-AOAC-IUPAC
- Laboratory protocols
- Handbook of Water Analysis
- Statistical Methods in Engineering and Quality Assurance
- Chroma to Gr
- Laboratory Quality Control. Ppt
- Molecular Driving Forces Statistical Thermodynamics in Chemistry
- Validación de Métodos Analíticos (Asociación Española de Farmaceúticos de la Industria)
- Statistics and Chemo Metrics for Analytical Chemistry 6th Ed. - J. Miller, J. Miller (Pearson, 2010) BBS
- Essentials of Medical Laboratory Practice - Lieseke, Constance L. [SRG]
- Separation Chemistry
- Quality Assurance and Quality Control in the Analytical Chemical Laboratory a Practical Approach Analytical Chemist - Piotr Konieczka, Jacek Namiesnik
- QC
- Standard Deviation
- Standar Deviasi
- relat_sd
- <HTML><HEAD><TITLE>Access Denied</TITLE></HEAD> <BODY>Your page is blocked due to a KIET IT security policy that prohibits access to Category default <BR> </BODY></HTML>
- Measures of Dispersion
- Dispersion
- B.com Question Bank and Semester End Paper for 2 Nd Bocme
- f4 c7 Statistics New (1)
- Quality Assurance and Quality Control in the Analytical Chemical Laboratory

Are you sure?

This action might not be possible to undo. Are you sure you want to continue?

We've moved you to where you read on your other device.

Get the full title to continue

Get the full title to continue reading from where you left off, or restart the preview.

scribd