Professional Documents
Culture Documents
specific instructions of the manufacturer. ... [I]n most meter we analyzed is readily available at major pharma-
cases errors resulted from a general lack of care on the cies and is representative of commonly used systems. It
part of the patient in complying with the manufactur- requires three calibration procedures. First, each time a
er's instructions" (p. 803). new box of test strips is used, a code on the meter must
However, we would be wise to heed the counsel of be set to match a code provided on the test strip vial.
experts in the field of human error: Second, the meter must be calibrated periodically by
using a special check strip. Third, to ensure that the
To assign blame to an individual who makes an meter is providing correct glucose readings, the patient
error is no assurance that the same error will not be is instructed to perform regular tests using a glucose
made again by a different person. (Van Cott, 1994, control solution.
p.61) Each task was defined in terms of the information
People of good intention, skilled and experi- required by a user to complete each task (task/knowl-
enced, may nonetheless be forced to commit errors edge requirements), the feedback provided by the sys-
by the way in which the design of their environment tem, and the potential problems that might arise if the
calls forth their behavior. (Moray, 1994, p. 67) task were not carried out properly (see the table). Test-
ing blood glucose levels using a meter requires sub-
In other words, it is not appropriate to blame the user stantial procedural, step-by-step knowledge. The task
for making an error when the root cause of the error analysis demonstrated that many of the tasks require
may really be the design of the system itself or the type knowledge of the correct procedure and location and
of instructions provided to users. function of the control buttons: to successfully com-
plete each step. This particular meter has two control
Uncovering Sources of Errors buttons, whereas other meters we examined had three
How do we determine the actual sources of errors
in a particular system? The field of human factors/
ergonomics has much to offer in this regard. The
strength of an HF/E approach is that it can be predictive
in helping to anticipate errors, as well as prescriptive in
motivating design and instructional development. Proper
HF/E analysis can reveal when the fault might lie with the
design of the system or instruction rather than with the
user. Moreover, human factors analysis can reveal ways
to improve design and instructions to minimize error.
Task analysis. The path to understanding the
source of errors in a task begins with an in-depth
understanding of what a person has to do when per-
forming that task (see Figure 1, page 10). We conducted
a task analysis of a sample blood glucose meter to help
us understand the errors that may be made when using
a typical meter (see the table on the following pages). The Illustration of blood glucose meter and associated components.
<U Il)
c: c:
o o
Z Z
•..<U
..c
8::l
c: c: •...
<U
o c:
t:::l "'0
Il)
9
"0
'"
o c::
::: ..c '5 <U
o
o ~ •...
U
..c g: '0 ~
•...
t:
.E
0
'I:l o
U
<U
t:
U
.£
<U
c:
o 'a
><
'"•.. "'0
•..;:l
Il)
~-
u
~ .~
0..
u
•.•...
0
•.•...
u
•.•... •.•...
'0
;:l •.•...
Il)
<U
U
0.."'0
..•.....•...
o o
•.. o 0
o 0 o o "0 0..
c: c: c: c: '"
•... c: •... c: c:
o 0 o o U o U o 0
'0 '0 '0 '0 '0
'0 '0
•..•..
<U
•..•..
<U
'" '"
'"o
u '"0
u u '"
o
u
o'" o '"uo o
u u
o 0
H H H H U H U HH
.-l.-l
o
~ <l)
•... .~ '"
u ~ •...
OJ
•... o ~ ..8 •... o
o ~ '"<l)
•... •... o ~
~ o o ~ o
•... •...
Cl
'"<l)o
o
~
I>ll
•...
~
~
'"
u Cl
'"<l)o
-
.;;
~
~
'"~ u
•...
<l) •... '"~
o
'jj <l) "3 'jj
o
u "'0
u
g '"
.;::
<l)
•...
•... g
'"
.6 '"
•...
<l) '"
.5
>. '">- '">-
'"
-a '"<l)o..<l)•••• '"
-a '"
0..
:a'"•... a :a'" :a'"
•...
<l)
.0",
ti
<l)
•....0
<l)
-S •...
•...
<l) OJ
~
<l)
~
OJ
l:: ~
<l)
~ ~
<l) OJ
l:: !::
<l) <l) o o o 0 o OJ o 0
::E ::E ::E Z Z ZZ Z::E ZZ
~
o
t:
:::s
.0
l:t:
o
';:: ~-
•... >-
OJ '"
u 0..
o C':l .~
'"
u
o
'" u
u
o 0'"
....4 ....4....4
0.
'S H
- S
OJ
'"Vl
•... -0
o
o
•... o J::
...c:
o
•... 0..
~
l:: 'S o
o
'jj '"
•...
"'0
•...
:::s '"
•...
OJ §
'0 OJ o
'" u
'0 ..J3 o
•...
b o
•... •...
~ .6 ~
o
u OJ
0..
OJ
'S S
'"ou
:::s '"
•...
"'So '"<l)
•...
...b •...
H
0.. OJ
<' ,S
.-I"'!I't)'lt
0-:0:0-:0-:0:
rt'Irt'Irt'Irt'Irt'I - .-I- -
o N
Sure. there are three general steps inuolued in using the s~stem.
hut implementation of those steps requlres the user to do 52 suhsteps!
Instruction Analysis
Another mechanism for understanding the potential
sources of errors is to review the type(s) of instruction
that the user receives. Perhaps the instructions are too Figure 2. Top: Obtaining a blood sample; bottom: applying
complex for the user to understand, or the instructions sample to a test strip. The strip is then inserted into the meter.
It is not appropriate to blame the user for making an error when the root
cause of the error may really be the design of the system itself.
lations of text complexity based on a transcription of the Only two of the participants (one younger, one
video instructions yielded a rating of about the seventh- older) were able to set the code on the meter. The
grade level, comprehensible by 72% of the population. remaining four skipped the first calibration altogether
This indicates that the vocabulary may be more ad- and tried to use a check strip test. One of these partic-
vanced than desired to ensure comprehension by the ipants (a younger adult) realized that he had not set the
general population. code and later performed this calibration. The other
Analysis of the video is instructive. It begins with an three (all older) never checked or changed the code,
introduction and advertisement recommending the which is important in ensuring that the reading is accu-
product. This is followed by a testimonial from a phar- rate for the particular set of test strips.
macist who recommends the meter and then a brief The second task was to perform a check strip test.
overview of the major steps required to perform a blood Four people (two younger, two older) successfully com-
glucose test. Following the overview, each of the main pleted this test. One older adult was unable to perform
steps (procedures for calibration, testing blood glucose the task initially, but when prompted to start over, she
levels, and cleaning/maintaining the meter) is described was able to complete it successfully. The remaining
by a different actor. The pharmacist concludes the older adult performed the test by happenstance when
video by instructing users to refer to the user's manual trying to do something else.
for further instructions. The manufacturer's toll-free The third task was to perform a glucose control solu-
customer support number is then provided. tion test. Four participants (two younger, two older)
On the surface, the video may seem useful for train- were able to obtain a control solution reading. One older
ing; it provides demonstrations of each component, and adult received an error on her first try and was not able
every critical step is described and shown, with a close- to complete it a second time. The remaining older adult
up view of the meter and other equipment as someone was not able to get a reading because he failed to use a
performs the step. In some instances, editing tech- test strip on his first try, and, even when prompted, he
niques, such as a grayed-out screen with the item of could not complete the test. It is important to note that
interest highlighted, are used to focus attention on the no one remembered to check the type of control solution
pertinent element in the scene. However, our instruc- or to check the expiration date on the solution, even
tional analysis revealed some potential problems. though these activities were described on the videotape.
First, the main steps are never reiterated or reviewed Participants had some difficulties performing the
in the video. Only when the pharmacist provided an three calibration tests that represent only a small subset
overview of the basic steps to test blood glucose levels of the tasks required to use a blood glucose meter suc-
were the instructions previewed or summarized. The cessfully (see the table on pages 8-9). If they had watched
Participants' Self-Reports least in part, from the user's manual. Most users learned
Another valuable tool in the HF/E arsenal is to to use these systems on their own and likely believe that
interview the users of a particular system. We conduct- they are performing the task adequately. However, self-
ed a survey of people who have experience using blood instruction based on manufacturer manuals may be insuf-
glucose meters. The survey included questions con- ficient for accurate performance with a blood glucose
cerning demographic information (e.g., age, education, meter. Ward, Haas, and Beard (1985) found that after
sex, race), blood glucose meter usage patterns (e.g., fre- 30 minutes of self-instruction and practice, participants
quency, assistance, length of experience), difficulties made errors 20% to 40% of the time.
using the system (e.g., remembering steps, reading the The next most common way for respondents to
display), and open-ended questions about likes, dislikes, learn to use a blood glucose meter was from a nurse,
and suggestions for improvements. doctor, or health professional (30%). However, these
Surveys were completed by 26 individuals with a individuals may not have the time to devote to training
mean age of 59 years (11 women, 15 men; 4 Mrican- users; for some meters, participants in another study
American, 21 Caucasian, 1 mixed Anglo-Hispanic). needed an average of 23.9 (±4.5) minutes to learn to use
The average number of years of formal education was the system, and they continued to make errors even
15 or more years, and all respondents reported having after this training (Tomky & Clarke, 1990).
at least some college education. All were diabetics who The remaining respondents in our survey learned to
used a blood glucose meter, typically at least once per use their meter from other materials provided by the
day, and had been using a meter for an average of seven manufacturer (8%), trial and error or past experience
years. Although this sample is relatively small, the data (8%), or a friend or family member (8%). (Note that
are suggestive of the range of problems potentially several people provided more than one answer to this
encountered, and the anecdotal comments are of in- question, and the percentages represent the percentage
terest. of the total number of responses.)
Respondents were asked how many times they had
to use their blood glucose meter before they felt com- Toward Solutions for Reducing Error
pletely comfortable with it; 32% said 1-2 times, 40% Based on prior studies, our task analysis, reponed
said 3-4 times, 20% said 5-10 times, and 8% said they problems from current users, and observed difficulties
had to use the meter more than 10 times in order to feel calibrating a blood glucose meter, users clearly have dif-
comfortable. This pattern shows that the blood glucose ficulties using these devices, and there are many sources
most users learned to use these systems on their own and likely helieue
that they are performing the task adequately.
2. ModifY the meter: reduce the amount of program- meter that is small enough to carry around, but when
ming required; make it simple and easy to use; make the system gets too small, it becomes difficult to work
steps more accessible; make it smaller. with, and the display cannot be easily read, among
3. ModifY the features: add memory, date, and time; other things. The critical point is that design ideas must
shorten processing time; increase memory; include be tested with the target user population.
attachable clamp so it can be worn like a beeper.
4. ModifY the blood-sampling procedure: require a small- Instructional Design
er amount of blood; develop better ways to get a Nearly 50% of the respondents in our survey said
drop of blood. the user's manual was a primary source of instructions.
5. ModifY major systems: eliminate the need for calibra- Given this reliance on training materials, it is critically
tion; make it self-contained; design a blood glucose important that such materials be well designed. Ideally,
meter that can communicate directly with an insulin the development of training programs and instructional
pump; make it lighter; build a lancet device within materials should follow Instructional System Design
the system; develop a noninvasive unit. models (for a review, see Wickens, Gordon, & Liu, 1998).
Such models include an analysis to determine the spe-
Recent design improvements on blood glucose meters cific training needs for the system. A task analysis such
could address some of the aforementioned broad cate- as we conducted would be included, as well as an analy-
gories. For example, the category "modify the blood- sis of the characteristics of the trainees (e.g., education,
sampling procedure" may have been addressed with perceptual and cognitive abilities) and of the resources
recent blood glucose sampling advances. However, available (e.g., access to a videocassette recorder for
other design issues remain, and the new systems may video-based training).
themselves have unforeseen problems that require Design and development of the training materials
human factors/ergonomics analysis. involves selecting the method of training (e.g., step-by-
One design improvement evident from our task step instructions, modeling) and the media in which the
analysis (see the table on pages 8-9) is the need for training will be administered (e.g., text, video). For
appropriate, task-specific feedback. For example, the both written and spoken instructions, particular care
meter should be able to recognize a check strip used for should be taken in the following areas:
calibration versus a test strip used for glucose testing.
Mter recognizing the test strip, the meter should pro- • Ensure that readability levels are appropriate for the
vide the feedback that is appropriate to the task the user intended user population.
is performing. In addition, given the sequential nature • Keep the vocabulary simple and explicit; avoid jargon.