ME 120 Experimental Methods

Accuracy, Precision, and

Error in Measurement

BJ Furman
17AUG05

BJ Furman SJSU MAE

Error in Measurement
Error = xmeas - xtrue
Error is present in every measurement
Best we can do is estimate a bound on with some
level of certainty
-u u (n:1)
where u is the uncertainty estimated at odds of n:1,
or equivalently,
xmeas- u xtrue xmeas+ u (n:1)
Wider interval at higher odds
Narrower interval at lower odds

BJ Furman SJSU MAE

1
The Goal
Statements of uncertainty associated with
measurement results
A measurement result is complete only when
accompanied by a quantitative statement of its
uncertainty.
Guidelines for Evalutating and Expressing the Uncertainty of NIST Measurement
Results, NIST Tech. Note 1297 1994 Edition

Example
Y= y uc(y) 95% confidence or (n:1) odds

BJ Furman SJSU MAE

Probability and Odds

Probability the likelihood of a particular event taking
place measured with reference to all possible events.
The probability of rolling snake eyes [] with a pair of dice is
1/36

Odds the ratio of the probability of an event to the

probability that it does not happen:
odds = p/(1-p)
The odds of rolling snake eyes with a pair of dice is
(1/36)(35/36) 1 in 35
Helpful in magnifying small or large probabilities by expressing
them as a ratio of whole numbers.
What probability does odds of 19:1 correspond to?

BJ Furman SJSU MAE

2
Important Definitions
Calibration=the process of applying known values of
a measurand to determine the response of a
measurement system
Static Calibration=calibration using a constant measurand
Ex. Weights applied to a scale
Dynamic Calibration=calibration using a time-dependent
measurand
Ex. Sinusoidal, step, impact
Sensitivity=the change of output (measured value)
per unit of input (measurand). Sensitivity is the slope of
the static calibration curve at a given value of the input.

BJ Furman SJSU MAE

Calibration, Sensitivity, and Linearity

Sensor Calibration

40

35

30
Output, y units

25
K=sensitivity
20

15

10

0
0 5 10 15 20 25
Measurand input, x units

BJ Furman SJSU MAE

3
Important Definitions , cont.
Accuracy=the closeness of a measured value
to the actual value being measured
Repeatability (precision)=the ability of an
instrument to repeat an output when
measuring a given quantity under identical
conditions
Resolution=the smallest increment of change
in the measured value that can be determined
from the readout or recording instrument

BJ Furman SJSU MAE

Accuracy, Repeatability, and Systematic Error

Accuracy

Repeatability

BJ Furman SJSU MAE

4
Calibration and Repeatability
Sensor Calibration Repeated Several Times

40

35

30
Output, y units

meas. 1
25
meas. 2
20 meas. 3
meas. 4
15
meas. 5
10

0
0 5 10 15 20 25
Measurand input, x units

BJ Furman SJSU MAE

Components of Uncertainty
Random effects (random or precision errors)
Occur differently for each measurement
Creates a distribution of values
Arise from uncontrolled variables, e.g., _________________
Can use statistical methods to estimate the likely range that
the true value lies in
Systematic effects (systematic or bias errors)
Occur the same way for each measurement
Ex: 1st down measurement chain too many links
Ex: Bubble level - vial misaligned
Arise from:
Calibration error
Loading error
Measurement disturbance
Aging of components in measurement equipment
Uncontrolled variables
BJ Furman SJSU MAE

5
Components of Uncertainty, cont.
Systematic effects, cont.
In general, need more than statistical methods to
determine
Can estimate using:
{ Comparison with more accurate standards
{ Compare with a different method of measuring the same
variable
{ Self-calibration (reversal) sometimes
{ Inter-laboratory comparison
{ Experience

BJ Furman SJSU MAE

Calibration and Hysteresis

Sensor Calibration with Hysteresis

35

30

25
ng
as i
Output, y units

r e
20
inc
15
g
e a sin
ecr
10
d
5

0
0 5 10 15 20 25
Measurand input, x units

BJ Furman SJSU MAE

6
References
Beckwith, T. G., Marangoni, R. D., Lienhard, J. H.,
Mechanical Measurements, Addison-Wesley, Reading, MA,
1995.
Figliola, R. S., Beasley, D. E., Theory and Design for
Mechanical Measurements, 3rd ed., J. Wiley & Sons, New
York, 2000.
Accuracy Specifications for Mensor Products, Technical
Note 6, Mensor Corp., www.mensor.com, September, 2002.
NIST/SEMATECH e-Handbook of Statistical Methods,
http://www.itl.nist.gov/div898/handbook/, September, 2002.
Taylor, B. N., Kuyatt, C. E., Guidelines for Evaluating and
Expressing the Uncertainty of NIST Measurement Results,
NIST Technical Note 1297, 1994 edition.

BJ Furman SJSU MAE