Professional Documents
Culture Documents
If you can measure a phenomenon, you can analyze the phenomenon. But if you don’t measure
the phenomenon accurately and precisely, you won’t be able to analyze the phenomenon
accurately and precisely. So in planning a statistical analysis, once you have specific concepts
you want to explore you’ll need to identify ways the concepts could be measured.
Start with conventional measures, the ones
everyone would recognize and know what you
did to determine. Then, consider whether there
are any other ways to measure the concept
directly. From there, establish whether there are
any indirect measures or surrogates that could
be used in lieu of a direct measurement. Finally,
if there are no other options, explore whether it
would be feasible to develop a new measure
based on theory. Keep in mind that developing a
new measure or a new scale of measurement is
more difficult for the experimenter and less
All cats are drawn to scale. understandable for reviewers than using an
established measure. Say, for example, that you
wanted to assess the taste of various sources of
drinking water. You might use standard laboratory analysis procedures to test water samples for
specific ions known to affect taste, like iron and sulfate. These would be direct measures of water
quality. An example of an indirect measure would be total dissolved solids, a general measure of
water quality that responds to many dissolved ions besides iron and sulfate. An example of a
surrogate measure would be the water’s electrical conductivity, which is positively correlated to
the quantity of dissolved ions in the water. Electrical conductivity is easier and less expensive to
measure than dissolved solids, which is easier and less expensive to measure than specific
analytes like iron and sulfate. Developing a new measure based on theory might also be useful.
Sometimes it’s beneficial to think out of the box. That’s how sabermetrics got started. So for
example, you might use professional taste testers to judge the tastes of the waters. Or, more
simply, you might conduct comparison surveys of untrained individuals. Clearly, what you
measure and how you measure it will have a great influence on your findings.
Of the possible measures you identify, select scales of measurement and consider how difficult it
would be to generate accurate and precise data. Measurement bias and variability are introduced
into a data value by the very process of generating the data value. It’s like tuning an analog radio.
Turn the tuning dial a bit off the station and you hear more static. That’s more variance in the
station’s signal. Every measurement can be thought of consisting of three elements:
Benchmark – The accepted standard against which a data value is made. Scientific
instruments, meters, rulers, scales, comparison charts, and survey question response
options are all examples of measurement benchmarks.
Processes – Repetitive activities that are conducted as part of generating a data value.
Equipment calibration, measurement procedures, and survey interview scripts are all
examples of measurement processes.
Judgments – Decisions made by the individual to create the data value. Examples of
measurement judgments include reading instrument scales, making comparisons to visual
scales, and recording survey responses.
Consider the examples of data types shown in the following table. For any particular data type,
all three of these elements change over time. Benchmarks change when new measurement
technologies are developed or existing meters, gauges and other devices become more accurate
and precise. Standardized tests change to safeguard the secrecy of questions. Likewise, processes
change over time to improve consistency and to accommodate new benchmarks. Judgments
improve when data collectors are trained and gain work experience. Such changes can create
problems when historical and current data are combined because variance differences
attributable to evolving measurement systems can produce misleading statistics.
Examples of Components of Data Measurements.
Measurement Components of Data Measurement
Data Type Examples Devices Benchmark Process Judgment
Personal Business definitions and Value of money varies Recognition of denominations,
Money Income, Expenses
Business
stopwatch
Measuring tape Reading and recording increments on
Rock unit Descriptions of rock formations Making observations for
geologic compass, measurement devices, comparison of
Geology description, soil and and lithologic and soil classification procedure,
references for observations to classification
rock classification classification procedures calibration and use of devices
classification parameters
Wind speed, Anemometer,
Correct placement, usage and Reading and recording increments on
Meteorology temperature, thermometer, Instrumentation standards
calibration of instruments measurement devices
barometric pressure, barometer,
Species Counts, Observation of Technical descriptions of Process of comparing Identification of specific species and
Biology
Habitat Maps species/habitats species/habitats observation to description habitats
Life Sciences
http://statswithcats.wordpress.com/2010/09/12/the-measure-of-a-measure/