You are on page 1of 13

Now You Feel It, Now You Don’t: The Effect of

Movement, Cue Complexity, and Body Location


on Tactile Change Detection
Kylie Gomes, Clemson University, South Carolina, USA, Scott Betza,
Naval Information Warfare Center (NIWC) Atlantic, Charleston, South Carolina,
USA and Sara Lu Riggs, Clemson University, South Carolina, USA

Objective: To evaluate the effects that movement, cue IntroductIon


complexity, and the location of tactile displays on the body
have on tactile change detection. One promising means of addressing chal-
Background: Tactile displays have been demonstrated as lenges associated with visual data overload,
a means to address data overload by offloading the visual and which requires operators to make sense of
auditory modalities. However, change blindness—the failure very large fields of data in complex domains
to detect changes in a stimulus when changes coincide with
another event or disruption in stimulus continuity—has been
(Woods, Patterson, & Roth, 2002), is through
demonstrated to affect the tactile modality and may be exac- the introduction of multimodal displays that
erbated during movement. The complexity of tactile cues and distribute information across vision, audition,
locations of tactile displays on the body may also affect the and touch (Jones & Sarter, 2008; Wickens,
detection of changes in tactile patterns. Limitations to tactile 1980). Specifically, incorporating the tactile
perception need to be examined.
Method: Twenty-four participants performed a tactile
modality can offload the often overburdened
change detection task while sitting, standing, and walking. Tac- visual and auditory modalities while supporting
tile cues varied in complexity and included low, medium, and attention and interruption management (Ferris
high complexity cues presented to the arm or back. & Sarter, 2011; Hameed, Ferris, Jayaraman,
Results: Movement adversely affects tactile change detec- & Sarter, 2009). Although tactile displays can
tion as hit rates were the highest while sitting, followed by
standing and walking. Cue complexity affected tactile change
support operators, their effectiveness may be
detection: Low complexity cues resulted in higher detection compromised if their design does not consider
rates compared with medium and high complexity cues. The the limitations of human perception and cogni-
arms exhibited better change detection performance than the tion. One documented limitation is the phenom-
back. enon called change blindness, that is, the failure
Conclusion: The design of tactile displays should con-
sider the effect of movement. Cue complexity should be
to detect changes in a stimulus when changes
minimized and decisions about the location of a tactile display coincide with an event or disruption (Simons,
should take into account body movements to support tactile 2000). There is limited empirical evidence that
perception. the tactile modality may also be subject to
Application: The findings can provide design guidelines change blindness, especially in the presence of
to inform tactile display design for data-rich, complex domains.
movement (Gallace, Zeeden, Röder, & Spence,
Keywords: tactile/haptic displays, change detection, sensory
2010)—the focus of this work. If true, this raises
suppression, signal detection theory concerns about the robustness of tactile displays
and their use.
Change blindness has been primarily docu-
mented in vision using visual transients (i.e., a
Address correspondence to Sara Lu Riggs, Department of
Industrial Engineering, Clemson University, 100 Freeman
disruption to stimulus continuity). This includes
Hall, Clemson, SC 29634, USA; e-mail: sriggs@clemson. complete (e.g., flickers; Rensink, O’Regan, &
edu. Clark, 1997) and partial (e.g., mudsplashes;
O’Regan, Rensink, & Clark, 1999) occlusions to
HUMAN FACTORS
Vol. 62, No. 4, June 2020, pp. 643–655
the visual scene during the period in which a
DOI: 10.1177/0018720819850278 change occurs, as well as in the absence of any
Article reuse guidelines: sagepub.com/journals-permissions transient (e.g., gradual changes; Simons, Fran-
Copyright © 2019, Human Factors and Ergonomics Society. coneri, & Reimer, 2000). The auditory analog to
644 June 2020 - Human Factors

change blindness—change deafness (the failure resulted in decreased perceptual sensitivity (d′)
to detect auditory changes)—has also been doc- to changes in tactile stimuli and increased
umented (Dickerson & Gaston, 2014). There has response bias (c, that is, more likely to indicate
been limited work demonstrating change blind- the tactile stimulus changed; Gallace et al.,
ness in the tactile modality (Hayward, 2008). 2010).
Tactile change blindness has typically been The effects of tactile change blindness during
demonstrated using a tactile change detection movement may be attributed to sensory suppres-
task where participants are tasked to determine sion, that is, decreased tactile sensitivity in the
whether they felt a change in tactile stimuli moving body part during the movement (Chap-
under multiple trials (Gallace, Tan, & Spence, man, Bushnell, Miron, Duncan, & Lund, 1987;
2006). Detecting changes in tactile intensity is Juravle, Binsted, & Spence, 2017). This phe-
adversely affected when the change coincides nomenon has been demonstrated using tactile
with tactile transients that include tactile flick- detection tasks in the presence and absence of
ers and mudsplashes (i.e., the activation of all or movement (Juravle & Spence, 2011; Williams &
a few vibrating devices in a tactile display; Riggs Chapman, 2000, 2002). These studies have
& Sarter, 2016), as well as in the absence of tran- shown that absolute detection thresholds for tac-
sients (e.g., gradual changes; Ferris, Stringfield, tile stimuli increase during movement, resulting
& Sarter, 2010). in a reduction in perceptual sensitivity to tactile
Cue complexity also appears to affect tactile stimuli. The majority of the work on tactile sup-
perception. Increasing complexity can result in pression during movement has focused on dis-
decrements to tactile cue identification, espe- crete upper body movements such as reaching
cially when the number of alternatives a stimu- and grasping (Colino & Binsted, 2014, 2016;
lus takes increases (Brown, Brewster, & Pur- Juravle, Deubel, Tan, & Spence, 2010), finger
chase, 2006). The findings support those of a movements (Voss, Ingram, Haggard, & Wolpert,
meta-analysis which concluded that tactile iden- 2006; Williams & Chapman, 2000, 2002), or
tification accuracy is lower with higher com- back-bending movements (Van Hulle, Juravle,
plexity tactile cues (Lu et al., 2013). For tactile Spence, Crombez, & Van Damme, 2013). How-
cue identification tasks, identification accuracy ever, there is limited work looking at the extent
was worse when complexity increased (Brown to which tactile suppression occurs for lower
et al., 2006). Alternatively, other studies have body goal-directed movements, such as walk-
shown high identification accuracy with com- ing. Evidence of sensory suppression has been
plex tactile icons that incorporate multiple tac- demonstrated when participants are tasked to
tile parameters (Dosani et al., 2012; Jones, Kun- identify tactile cues while maneuvering through
kel, & Piateski, 2009). Therefore, it is important an obstacle course (White & Krausman, 2015),
to determine the level of complexity that is whereas another study showed it had limited
appropriate for various domains and contexts to effects while walking and jogging (Jones et al.,
reliably communicate information using the tac- 2009).
tile channel. Several studies have shown that sensory sup-
To date, the majority of tactile change blind- pression can occur before, during, and after
ness studies have required participants to remain movement (Colino & Binsted, 2016; Juravle
stationary by having them stand or sit. However, et al., 2010). Evidence has shown that tactile
this is not representative of the tasks found in suppression begins in the time immediately pre-
most real-world domains. Little is known about ceding movement and becomes more pro-
the effects of movement on tactile change detec- nounced over the time course of the execution of
tion. Gallace et al. (2010) found evidence of tac- a movement (Williams & Chapman, 2000,
tile change blindness when participants com- 2002). There has been limited work examining
pleted a tactile change detection task while the effects of sensory suppression with continu-
engaging in a secondary task that elicited move- ous movements aside from juggling (e.g.,
ments (i.e., pressing a button, turning a steering Juravle & Spence, 2011). Voss et al. (2006)
wheel). They also found that arm movements showed that stimulus intensity presented to a
Effect of Movement on Change Detection 645

hand while moving needs to be 2.6 times greater & Chapman, 1998), and (3) low complexity tac-
than the intensity when the hand is at rest for it tile cues will have a higher tactile change detec-
to be perceived as equivalent in magnitude. tion accuracy compared with high complexity
Therefore, it is critical to understand the effects cues as increasing cue complexity adversely
of sensory suppression to ensure tactile changes affects tactile identification (Lu et al., 2013).
are detected during movement. The goal here is to provide insight on how to
The majority of studies investigating tactile effectively present information under different
change detection and sensory suppression dur- postural/movement demands typical of many
ing movement have focused on the highly sensi- complex domains. This work is an extension of
tive fingertip area (Juravle et al., 2010; Williams the work reported in Betza, Reeves, Abernathy,
& Chapman, 2000, 2002); however, sensitivity and Riggs (2017).
to tactile stimuli varies across different body
locations (Morioka, Whitehouse, & Griffin, Method
2008; Wilska, 1954). For instance, identification Participants
accuracy was found to be higher with tactile
cues presented to the back compared with the Twenty-four Clemson University undergrad-
forearm (Piateski & Jones, 2005). Sensory sup- uate/graduate students participated in this study
pression was shown to be less pronounced at (13 males, 11 females; M = 21.9 years, SD =
body locations relevant to the goal-directed task 2.5). A power analysis using G*Power (Ver-
being performed (e.g., fingertips for reach-to- sion 3.1.9.3; Faul, Erdfelder, Lang, & Buchner,
grasp tasks; Colino, Buckingham, Cheng, van 2007) revealed that at least 18 participants are
Donkelaar, & Binsted, 2014), whereas another needed to detect a medium effect size (assum-
study demonstrated it is more pronounced at ing a power = .95, α = .05, medium effect size
locations near the moving body part (e.g., worse [Cohen’s f = .25]). Participants were required to
tactile detection accuracy for lower body vs. self-report that they had no known impairments
upper body sites while walking; Karuei et al., to their sense of touch.
2011). Therefore, it is important to understand
the extent to which movement-related sensory experimental Setup
suppression affects sensitivity at different body The participants’ task was to verbally indi-
locations. cate whether there was a change in intensity
Given there has been limited work investigat- of a presented vibration and the type of change
ing the effects of body movement on tactile while sitting, standing, or walking. Participants
change detection, this work aims to understand wore a vest around their waist or an arm band
the effects of the following variables on tactile (Figure 1a and 1b) over clothing. Each garment
change detection: (a) movement (i.e., comparing had three C-2 tactors (electromagnetic devices;
sitting, standing, and walking), (b) tactile dis- Engineering Acoustics, Inc) attached using Vel-
play location (i.e., back vs. arm), and (c) tactile cro. The tactors on the vest were located on
cue complexity (i.e., comparing low, medium, the right side of the participant’s spine and the
and high complexity cues). The expected results tactors on the arm band were located on the
were that (a) sitting will have a higher tactile outside of the upper arm. The spacing between
change detection accuracy compared with stand- each tactor’s center point was 51 mm for both
ing and walking as movement execution is body locations, which is above the threshold for
shown to adversely affect change detection for localizing stimuli on the upper arm (Cholewiak
changes in the location of tactile stimulation & Collins, 2003) and back (Eskildsen, Morris,
(Gallace et al., 2010), (b) the back will have a Collins, & Bach-Y-Rita, 1969). A Dell Precision
higher tactile change detection accuracy com- T3610 workstation sent commands via Blue-
pared with the arm when walking as the arm tooth to a universal control box, which provided
engages in movement during walking and sen- the output signal to each tactor, and was placed
sory suppression is more pronounced with prox- in a zippered pack worn around the participant’s
imity to moving body parts (Williams, Shenasa, waist. The experimenter used a Dell UltraSharp
646 June 2020 - Human Factors

Figure 1. (a) Vest and (b) arm band with tactors.

tactile cue types


For each trial, the starting tactor was ran-
domly selected from the three tactors on the
garment, and only one tactor emitted vibrations
at any given time. The intensity of the presented
vibrations was changed by varying the displace-
ment (i.e., gain) of the C-2 tactors with frequency
held constant at 250 Hz. The low intensity was
set at 4.9 dB (0.9 Vrms, 0.096 Arms), medium
intensity at 9.3 dB (1.7 Vrms, 0.183 Arms), and
high intensity at 12.5 dB (2.3 Vrms, 0.247 Arms).
The intensity always started at the medium level.
Tactile cue complexity was determined based
on detection difficulty (e.g., smaller changes in
intensity are harder to detect; Brewster & Brown,
2004) and the amount of information embedded
in the cue (i.e., number of change alternatives
that could be presented; Lu et al., 2013). The
four tactile cue conditions used in this study are
Figure 2. Experimental setup for the walking shown in Table 1.
condition. The vest/arm band, zippered pack, For intensity changes, the intensity could
and headphones were used across all movement increase from medium to high or decrease from
conditions; the treadmill was used only for the medium to low. For single-step changes, the
walking condition. intensity change occurred in one step (Figure
3a). For graded and gradual changes, the inten-
sity change occurred over the course of four
U2717Dt 27″ monitor, keyboard, and mouse to (Figure 3b) and eight steps (Figure 3c), respec-
advance through each trial. Participants sat in a tively. In the intensity-location cue condition
standard desk chair for the sitting condition and (high complexity), any of the aforementioned
walked on a ProForm Premier 1300 treadmill changes in tactile intensity (Figure 3a-3c) or a
(model: PFTL13115.0; Figure 2) for the walk- change in the location of the vibrating tactor
ing condition. For the entire study, participants (Figure 3d) could occur.
wore Bose QuietComfort 15 noise canceling
headphones, which played pink noise to mask Movement type
noise emitted from the tactors. Figure 2 shows For the sitting and standing conditions, par-
the experimental setup used in the walking ticipants sat in a chair or stood facing a wall.
condition. For the walking condition, participants walked
Effect of Movement on Change Detection 647

Figure 3. Tactile cue types: (a) single-step, (b) graded, (c) gradual, and (d) location change.

TaBLE 1: Tactile Cue Conditions Showing the Cue Complexity, Change Description(s), and Number
of Change Alternatives for Each Cue Condition

Number of Change
Tactile Cue Condition Cue Complexity Change Description Alternatives

Single-step intensity Low Single-step increase or decrease in 2


intensity
Graded intensity Medium Graded increase or decrease in 2
intensity
Gradual intensity Medium Gradual increase or decrease in 2
intensity
Intensity-location High Single-step, graded, or gradual 7
increase or decrease in intensity
Change in location

at 2 mph on the treadmill with no incline. These when a change occurred to when no-change
movements were selected because they are typi- occurred across all conditions. Each trial con-
cal movements expected of operators in various sisted of a tactile stimulus that pulsed con-
data-rich environments. tinuously for 12 s (16 pulses, each was 650 ms
duration with an interstimulus interval of 100
task ms). A change in intensity or location could
The participants’ task was to verbally indi- randomly occur any time between the 4th and
cate whether a change occurred and the type 14th pulse. Figure 4 provides an overview of
of change in vibration intensity or location for a hypothetical trial where a change occurred.
each trial. There was a 2-to-1 ratio of trials After each trial, participants verbally indicated
648 June 2020 - Human Factors

Figure 4. Overview for a single-step decrease change trial.

to the experimenter the change details, and were an equal number of intensity increases
the experimenter recorded the response. For and decreases that occurred during each sub-
the low and medium complexity cues, partici- block. For the intensity-location subblock, an
pants were instructed to respond: “no-change,” equal number of location and intensity changes
“change-increase,” or “change-decrease.” For occurred, and within the intensity changes, an
the high complexity cues, participants were equal number of each intensity change occurred
required to also indicate what type of intensity (i.e., single-step, graded, and gradual).
change occurred (i.e., “single,” “graded,” or
“gradual”) and/or the end location (i.e., tactor Procedure
“1,” “2,” or “3”). Prior to the start of each sub- This research complied with the American
block, participants were informed of the cue Psychological Association Code of Ethics and
type they would experience. was approved by Clemson University’s Institu-
tional Review Board. Prior to arrival, participants
experimental design were instructed to wear walking shoes and a thin
This study employed a 4 (tactile cue: T-shirt. Upon arrival, the participant read and
single-step, graded, gradual, intensity-location) signed an informed consent form. The experi-
× 3 (movement: sitting, standing, walking) × menter then explained the details of the study
2 (body location: arm, back) mixed factorial including the equipment and tasks required. For
design. The within-subjects factors included the required responses, a placard displaying the
tactile cue and movement with body location response options for each tactile cue type was
as the between-subjects factor. Each tactile cue overviewed and was viewable by the participant
subblock was completed during each move- during the experiment. The participant then
ment block and the order of blocks and sub- performed a training session to become familiar
blocks was randomized and counterbalanced. with the expectations of the study where four
The intensity-location subblock had 36 trials, single-step change trials were demonstrated.
whereas the other tactile cue subblocks each had Upon successfully completing a 20-trial pretest
30 trials. The difference in the number of trials for single-step intensity changes (i.e., 80% accu-
for the intensity-location subblock was to ensure racy) while sitting, participants then completed
that it had an equal number of each intensity three blocks: (a) sitting, (b) standing, and (c)
change. Each movement block had 126 trials walking. All participants achieved at least 80%
for a total of 378 trials across all blocks. There accuracy on the pretest. A demonstration of the
Effect of Movement on Change Detection 649

among conditions. We report partial eta squared


( η2p ) as a measure of effect size with the values
.01, .06, and .14 representing small, medium,
and large effect sizes, respectively (Cohen,
1988). Error bars represent standard errors,
and asterisks represent significant differences
among conditions.

Sensitivity (d′)
Mauchly’s sphericity test indicated that the
Figure 5. Mean sensitivity (d′) for each movement assumption of sphericity was violated for cue
type. type, χ2(5) = 13.03, p = .023, and a Greenhouse–
Geisser correction factor was applied (ε = .744).
There was a main effect of movement type,
F(2, 44) = 13.65, p < .001, ηp =.383 ; cue type,
2

F(2.23, 49.09) = 88.72, p < .001, ηp =.801 ;


2

and body location, F(1, 22) = 9.15, p < .001,


η2p =.294 , on sensitivity. There were no signifi-
cant interaction effects (all p > .07).
Post hoc tests showed that sensitivity was
significantly lower when walking compared
with sitting (p < .001) and standing (p = .019;
Figure 5).
Figure 6. Mean sensitivity (d′) for each tactile cue Mean sensitivity for each cue type were all
type. significantly different from each other, with
single-step cues having the highest sensitivity,
followed by graded, gradual, and intensity-
graded, gradual, and location changes was given location cues having the lowest sensitivity (all
at the beginning of the first block. At the conclu- p < .05; Figure 6).
sion of the study, each participant completed For body location, post hoc tests showed that
a debriefing questionnaire. The study lasted the mean sensitivity was significantly higher for
approximately 3 hr and participants were com- tactile cues presented on the arm (d′ = 2.09)
pensated US$10/hr in gift cards. compared with the back (d′ = 1.58, p = .006).

reSultS response Bias (c)


The dependent measure was response accu- There was a main effect of cue type,
racy (either detection of a change or correct F(3, 66) = 17.58, p < .001, η2p =.444 , and body
rejection when there was no change). These location, F(1, 22) = 15.50, p = .045, η2p =.170 ,
dependent measures were used to calculate the on response bias, but not movement type.
signal detection measures of sensitivity (d′) and Post hoc tests showed that response bias was
response bias (c; Stanislaw & Todorov, 1999; significantly higher for intensity-location cues
Tanner & Swets, 1954). The results were ana- compared with all other cue types (all p < .001;
lyzed using 4 × 3 × 2 repeated-measures mixed Figure 7).
analyses of variance (ANOVAs; General Linear With body location, response bias was sig-
Models formulation in SPSS 24.0) to iden- nificantly higher with tactile cues presented on
tify main effects on sensitivity, response bias, the arm (c = −0.09) compared with the back
and hit rate. Post hoc tests using Bonferroni (c = −0.29, p = .045).
adjustments were applied to determine differ- There was a two-way interaction of move-
ences among means when the omnibus ANOVA ment type × body location on response bias,
indicated statistically significant differences F(2, 44) = 5.98, p = .005, η2p =.214 (Figure 8).
650 June 2020 - Human Factors

debriefing Questionnaire responses


Participants were asked to “rate how difficult
it was to monitor the tactile displays while per-
forming the following movements and tasks”
on a scale of 1 to 7 (1 = very easy; 7 = very
difficult). Walking was rated the most difficult
(mode = 6), followed by standing (mode = 3)
and then sitting (mode = 2). One third of the
participants who wore the tactor belt stated that
it conformed to their body best when sitting.
Figure 7. Mean response bias (c) by cue type. When looking at movement condition indepen-
Negative c values signify a bias toward responding dent of the location of the tactors, one third of
“yes,” whereas positive c values a bias toward the participants indicated it was easier to focus
responding “no.” while sitting and found maintaining their bal-
ance in the standing condition distracted them
from the change detection task. With walking,
Post hoc tests showed that with walking, response 58% of the participants felt that movement
bias was significantly higher on the arm com- distracted them from the change detection task.
pared with the back (p = .006).

change trial Accuracy (hit rate) dIScuSSIon


Mauchly’s test indicated that the assump- The goal of this work was to determine
tion of sphericity was violated for cue type, the extent to which tactile change detection is
χ2(5) = 18.26, p = .003, and a Greenhouse– affected by movement, tactile cue complexity,
Geisser correction factor was applied (ε = .617). and the location of tactile displays on the body.
There was a significant effect of movement
type, F(2, 44) = 7.40, p = .002, ηp =.252 ,
2 effect of Movement
and tactile cue type, F(1.85, 40.72) = 88.20, This study confirmed that movement
p < .001, ηp =.800 , on the hit rate, but not body
2
adversely affects tactile change detection and
location. Post hoc tests showed that the mean supports our first hypothesis: Sitting will have
hit rates were the worst when participants were a higher tactile change detection accuracy com-
walking (hit rate = 79%) compared with sitting pared with standing and walking. This contrib-
and standing (both hit rates = 84%; both p < .05). utes to the growing body of work which shows
For cue type, hit rate was significantly worse for the likelihood of detecting vibrations decreases
the intensity-location (hit rate = 66%) cues com- in the presence of movement (Chapman et al.,
pared with all other cue types (all p < .001). The 1987; Karuei et al., 2011).
hit rate for gradual changes (hit rate = 86%) was The findings support and add to the body of
also significantly worse than with the single-step work on sensory suppression—that is, decreased
(hit rate = 91%) and graded cues (hit rate = 90%; sensitivity to tactile stimuli during goal-directed
both p < .05). movements (Juravle et al., 2017; Juravle &
There was a two-way interaction between Spence, 2011). First, this study demonstrates
movement type × cue type, F(6, 132) = 2.25, that lower body goal-directed movement, that is,
p = .042, η2p =.093 . For all movement types, hit walking, is also subject to tactile suppression.
rates were the worst for the intensity-location Second, this study adds to the limited work on
cues compared with all other cue types (all sensory suppression using a continuous task and
p < .01; Figure 9). When participants were sitting, shows that tactile suppression is observed while
the hit rate was significantly lower for gradual participants were continuously engaged in exe-
cues compared with single-step (p = .017) and cuting a movement.
graded cues (p = .012). When participants were The findings show that tactile change detec-
standing, hit rate was significantly lower for grad- tion may be affected by micromovements. Given
ual cues compared with single-step cues (p = .01). that participants were tasked to stand still for 30
Effect of Movement on Change Detection 651

Figure 8. Mean response bias (c) between body locations for each movement type.

Figure 9. Hit rates for each tactile cue type by movement type.

min during the standing condition, it is likely one third of participants who wore the tactor
that shifts in the center of gravity resulted in vest cited that it fit best when sitting compared
unintentional micromovements (i.e., swaying; with standing or walking.
Winter, 1995). The debriefing questionnaire The findings also support previous work
confirmed this notion as one third of participants which has shown that goal-directed movements
mentioned that standing was more difficult decrease sensitivity (i.e., d′; Juravle & Spence,
because they had to shift their weight because of 2011; Van Hulle et al., 2013). Changes to sensi-
fatigue over time and/or to keep their balance. tivity may be due to the fact that tactile percep-
The debriefing questionnaire also revealed that tion is affected by the following:
652 June 2020 - Human Factors

• Absolute detection thresholds. This refers to the alternatives exceeds the channel capacity, this
intensity level that the stimulus needs to be for the will increase the likelihood of confusing alterna-
observer to just notice it (Ehrenstein & Ehrenstein, tives. It is important to consider the amount of
1999). Absolute detection thresholds for tactile information that needs to be encoded and how
stimuli increase for body parts engaged in move- this may affect the ability of operators to detect
ment compared with when at rest (Juravle et al., changes and properly interpret the information.
2010). It is recommended that the intensity of It is recommended that the tactile channel be
tactile stimuli be increased during movements to used for low complexity cues and vision and
ensure the likelihood of detection compared with audition for more complex cues (Lu et al., 2013;
when the participant is at rest. Riggs et al., 2017). Of note, tactor spacing may
• Just noticeable difference (JND) threshold. have adversely affected change detection perfor-
This refers to the difference between the intensity mance for intensity-location cues that involved a
of a reference stimulus that is held constant and location change (approximately 33%). Although
the intensity of a comparison stimulus for there to the intertactor spacing was above the threshold
be a perceptible difference. The findings support to localize stimuli for both locations, this may
previous work showing that people have a dif- not be adequate when movements are involved.
ficult time detecting gradual changes that occur The role of attention may be another reason
over time (Ferris et al., 2010), and this effect is that change detection rates were the lowest with
exacerbated when moving. It is recommended that the intensity-location cues. There is evidence
to maximize change detection rates, the minimum that attention is necessary to detect not only
intensity change may need to be greater than 45% visual changes (O’Regan et al., 1999) but also
during movement based on our findings. tactile changes, especially during movement
(Van Hulle et al., 2013). The findings support
It is important to note that unlike previous the need to direct attention to the tactile modal-
work, movement did not affect response bias ity to ensure change detection. Although partici-
(Gallace et al., 2010); however, this may be pants were prepared for the possibility of a
attributed to differences in the location and change that could occur before each trial, this
movements used here (i.e., upper body vs. lower may have been easier for lower complexity cues
body; discrete vs. continuous movements). as participants could focus their attention to
detect a certain type of change (e.g., only inten-
effect of cue complexity sity) compared with higher complexity cues
As tactile cue complexity increased, change (e.g., intensity or location) where more than one
detection accuracy and sensitivity decreased. type of change could occur. This supports previ-
The best performance and highest sensitivity ous work showing that it is more challenging to
was observed for the low complexity cue (single- attend to two aspects of a tactile signal compared
step), followed by the medium complexity cues with one (Brown et al., 2006).
(gradual/graded) and then the high complexity For the medium complexity cues (gradual
cue (intensity-location). This supports our second and graded), performance may have been sub-
hypothesis: Lower complexity cues will have ject to the effects of change blindness. The find-
a higher change detection accuracy than higher ings show that the absence of transients can
complexity cues. adversely affect tactile change detection, sup-
The results can be explained in part by limita- porting previous work (Ferris et al., 2010), and
tions in information transmission, that is, the the effects may be more pronounced with move-
amount of information received by a participant ment. Although hit rate was highest with single-
that can be attributed to the information pre- step changes, change detection accuracy for
sented in the stimulus (Miller, 1994). There is a gradual and graded changes was still high across
limit to the amount of information that can be all movement conditions (>85%). This demon-
transmitted (i.e., channel capacity), which strates the positive implications of these types of
depends in part on the number of alternatives the cues for operational use; however, it is advised
stimulus can take. When the number of stimulus that they be used with caution.
Effect of Movement on Change Detection 653

It is important to note that between graded/ and task performance (Ferris & Sarter, 2011;
gradual cues, gradual cues had lower sensitivity Ford et al., 2008). The design of tactile dis-
and hit rates compared with graded ones. Both plays should consider the various postures and
cue types were classified as medium complex- movements that anesthesia providers engage in,
ity according to the meta-analysis conducted by which range from sitting to walking. Ideally,
Lu et al. (2013), whereas both would be low adaptive display mechanisms should adjust the
complexity according to information theory tactile intensity based on movements in real
(i.e., 1 bit of information). However, the perfor- time (e.g., increase the stimulus intensity when
mance difference between these two cue types moving). Although low and medium complex-
highlight that cue complexity should consider ity cues can reliably be detected while moving,
task difficulty—the nature of the discrimination the former is recommended in safety-critical
task matters—as this can also influence tactile domains such as anesthesia to maximize the
change detection. likelihood that all care providers successfully
detect/interpret tactile notifications and alerts.
effect of Body location Finally, the location of a tactile display on the
Sensitivity and response bias were higher body should consider parts of the body that may
when the tactile cues were presented on the arm be engaged in movement and the contexts in
compared with the back across all movement which it will be used. To this end, both the arm
conditions which contradicts our third hypoth- and back are viable locations to present tactile
esis: The back will have better change detection information as both locations do not interfere
accuracy compared with the arm. with the tasks and responsibilities of anesthesia
Differences in sensitivity and response bias providers; however, the arm appears to be a
may be due to the fact that tactile sensitivity is a better location as it resulted in higher change
function of body location (Choi & Kuchen- detection rates.
becker, 2013) and proximity to the moving body
part (Williams et al., 1998). Although both the limitations and Future Work
arms and legs were engaged while walking, the There are some limitations of this work that
findings show that change detection was worse should be considered. First, this study only
for the back than the arm. One possible explana- evaluated the arm and back locations, whereas
tion is that whole-body movements can poten- other viable body locations should be consid-
tially be further divided into “active” move- ered, especially with the increased adoption
ments (i.e., legs when walking) and “passive” of wearable devices (e.g., smart watches) to
movements (i.e., arms when walking). Also, half present tactile information. Second, it is impor-
of the participants mentioned during the debrief- tant to consider perceptual differences across
ing questionnaire that the tactors moved slightly individuals. For instance, it has been shown
on the back when walking, even though the that tactile sensitivity varies with age (Verrillo,
experimenter took proactive measures to ensure Bolanowski, & Gescheider, 2002). Third, the
a consistent fit of the tactile garments across par- context and environment should be taken into
ticipants. The findings show that body location account in the design of tactile displays for real-
should be considered in light of how movement world domains. It is critical to ensure future
affects tactile change detection. work considers the tasks that could interfere
with perception. It is recommended that tactile
Implications for tactile display design display design adopts a “systems approach” to
The findings here can inform the design identify whether the tactile channel is an appro-
of tactile displays, namely, to account for priate means of presenting information and if
the effects of movement, cue complexity, and so, identify the limitations in tactile perception
where tactile cues are presented on the body. to ensure that information is conveyed in the
For example, in anesthesiology, tactile displays manner intended to support operators in com-
relaying information about patient vitals have plex domains that include aviation, health care,
been shown to support continuous monitoring and military operations.
654 June 2020 - Human Factors

AcknoWledgMentS Cholewiak, R. W., & Collins, A. A. (2003). Vibrotactile localiza-


tion on the arm: Effects of place, space, and age. Perception &
This study was supported in part by the National Psychophysics, 65, 1058–1077.
Science Foundation (grant: 1566346; Program Man- Cohen, J. (1988). Statistical power analysis for the behavioral sci-
ager: Ephraim Glinert). This material is based upon ences. Hillsdale, NJ: Lawrence Erlbaum.
Colino, F. L., & Binsted, G. (2014). Pantomime grasping attenu-
work supported by the National Science Founda- ates tactile sensitivity of the moving limb. In The Society for
tion Graduate Research Fellowship Program (NSF Neuroscience Annual Meeting, Washington, DC.
GRFP). The authors would like to thank Alexei Colino, F. L., & Binsted, G. (2016). Time course of tactile gating in
a reach-to-grasp and lift task. Journal of Motor Behavior, 48,
Yankovsky for his help in developing the computer
390–400. doi:10.1080/00222895.2015.1113917
program used for this study. Colino, F. L., Buckingham, G., Cheng, D. T., van Donkelaar, P., &
Binsted, G. (2014). Tactile gating in a reaching and grasping
key PoIntS task. Physiological Reports, 2(3), 1–11. doi:10.1002/phy2.267
Dickerson, K., & Gaston, J. R. (2014). Did you hear that? The role
• Tactile change detection rates and sensitivity were of stimulus similarity and uncertainty in auditory change deaf-
the lowest when walking, supporting previous ness. Frontiers in Psychology, 5, Article 1125. doi:10.3389/
work showing that movement can result in tactile fpsyg.2014.01125
Dosani, M., Hunc, K., Dumont, G. A., Dunsmuir, D., Barralon,
change blindness and sensory suppression. P., Schwarz, S. K. W., & Ansermino, J. M. (2012). A vibro-
• Low complexity tactile cues resulted in the highest tactile display for clinical monitoring: Real-time evalua-
change detection rates and sensitivity, followed by tion. Anesthesia & Analgesia, 115, 588–594. doi:10.1213/
medium complexity cues and then high complex- ANE.0b013e31825d638c
Ehrenstein, W. H., & Ehrenstein, A. (1999). Psychophysical
ity cues. This suggests that tactile cue complexity methods. In U. Windhorst & H. Johansson (Eds.), Modern
should be minimized to ensure tactile cues are per- techniques in neuroscience research (pp. 1211–1241). Berlin,
ceived and interpreted as intended. Germany: Springer. doi:10.1007/978-3-642-58552-4_43
• Change detection rates, sensitivity, and response Eskildsen, P., Morris, A., Collins, C. C., & Bach-Y-Rita, P. (1969).
Simultaneous and successive cutaneous two-point thresholds
bias were higher when tactile changes were pre- for vibration. Psychonomic Science, 14(4), 146–147.
sented on the arm compared with the back. Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007).
• Movement, cue complexity, and body location are G*Power 3: A flexible statistical power analysis program for
the social, behavioral, and biomedical sciences. Behavior
important factors that need to be considered in the
Research Methods, 39, 175–191.
design of effective tactile displays. Ferris, T. K., & Sarter, N. (2011). Continuously informing vibro-
tactile displays in support of attention management and mul-
orcId Id
iD titasking in anesthesiology. Human Factors, 53, 600–611.
doi:10.1177/0018720811425043
Sara Lu Riggs https://orcid.org/0000-0002- Ferris, T. K., Stringfield, K., & Sarter, N. (2010). Tactile “change
0112-9469 blindness” in the detection of vibration intensity. In Proceed-
ings of the Human Factors and Ergonomics Society 54th Annual
Meeting (pp. 1316–1320). doi:10.1177/154193120104500402
reFerenceS Ford, S., Daniels, J., Lim, J., Koval, V., Dumont, G., Schwarz, S.
Betza, S. M., Reeves, S. T., Abernathy, J. H., & Riggs, S. L. (2017). K. W., & Ansermino, J. M. (2008). A novel vibrotactile display
The effect of movement and cue complexity on tactile change to improve the performance of anesthesiologists in a simulated
detection. In Proceedings of the 61st Human Factors and critical incident. Anesthesia & Analgesia, 106, 1182–1188.
Ergonomics Society Annual Meeting (pp. 1541–1545). Los doi:10.1213/ane.0b013e318163f7c2
Angeles, CA: SAGE. doi:10.1177/1541931213601749 Gallace, A., Tan, H. Z., & Spence, C. (2006). The failure to detect
Brewster, S. A., & Brown, L. M. (2004). Tactons: Structured tactile tactile change: A tactile analogue of visual change blindness.
messages for non-visual information display. In Proceedings Psychonomic Bulletin & Review, 13, 300–303. doi:10.3758/
of the Fifth Australasian User Interface Conference (Vol. 28, BF03193847
pp. 15–23). Kent Town, Australia: Australian Computer Society. Gallace, A., Zeeden, S., Röder, B., & Spence, C. (2010). Lost in
Brown, L. M., Brewster, S. A., & Purchase, H. C. (2006). Mul- the move? Secondary task performance impairs tactile change
tidimensional tactons for non-visual information presentation detection on the body. Consciousness and Cognition, 19, 215–
in mobile devices. In Proceedings of the 8th Conference on 229. doi:10.1016/j.concog.2009.07.003
Human-computer Interaction with Mobile Devices and Ser- Hameed, S., Ferris, T., Jayaraman, S., & Sarter, N. (2009). Using
vices (Vol. 159, pp. 231–238). doi:10.1145/1152215.1152265 informative peripheral visual and tactile cues to support task
Chapman, C. E., Bushnell, M. C., Miron, D., Duncan, G. H., & and interruption management. Human Factors, 51, 126–135.
Lund, J. P. (1987). Sensory perception during movement in doi:10.1177/0018720809336434
man. Experimental Brain Research, 68, 516–524. Hayward, V. (2008). A brief taxonomy of tactile illusions and
Choi, S., & Kuchenbecker, K. J. (2013). Vibrotactile display: Per- demonstrations that can be done in a hardware store. Brain
ception, technology, and applications. In Proceedings of the Research Bulletin, 75, 742–752. doi:10.1016/j.brainres-
IEEE (Vol. 101, pp. 2093–2104). Piscataway, NJ: IEEE. bull.2008.01.008
Effect of Movement on Change Detection 655

Jones, L. A., Kunkel, J., & Piateski, E. (2009). Vibrotactile pat- Van Hulle, L., Juravle, G., Spence, C., Crombez, G., & Van
tern recognition on the arm and back. Perception, 38, 52–68. Damme, S. (2013). Attention modulates sensory suppression
doi:10.1068/p5914 during back movements. Consciousness and Cognition, 22,
Jones, L. A., & Sarter, N. B. (2008). Tactile displays: Guidance for 420–429. doi:10.1016/j.concog.2013.01.011
their design and application. Human Factors, 50, 90–111. doi: Verrillo, R. T., Bolanowski, S. J., & Gescheider, G. A. (2002).
10.1518/001872008X250638 Effect of aging on the subjective magnitude of vibration.
Juravle, G., Binsted, G., & Spence, C. (2017). Tactile suppression Somatosensory & Motor Research, 19, 238–244. doi:10.1080/
in goal-directed movement. Psychonomic Bulletin & Review, 0899022021000009161
24, 1060–1076. doi:10.3758/s13423-016-1203-6 Voss, M., Ingram, J. N., Haggard, P., & Wolpert, D. M. (2006).
Juravle, G., Deubel, H., Tan, H. Z., & Spence, C. (2010). Changes Sensorimotor attenuation by central motor command signals
in tactile sensitivity over the time-course of a goal-directed in the absence of movement. Nature Neuroscience, 9, 26–27.
movement. Behavioural Brain Research, 208, 391–401. doi:10.1038/nn1592
doi:10.1016/j.bbr.2009.12.009 White, T. L., & Krausman, A. S. (2015). Effects of inter-stimu-
Juravle, G., & Spence, C. (2011). Juggling reveals a decisional lus interval and intensity on the perceived urgency of tactile
component to tactile suppression. Experimental Brain patterns. Applied Ergonomics, 48, 121–129. doi:10.1016/j
Research, 213, 87–97. doi:10.1007/s00221-011-2780-2 .apergo.2014.11.010
Karuei, I., MacLean, K. E., Foley-Fisher, Z., MacKenzie, Wickens, C. D. (1980). The structure of attentional resources. In
R., Koch, S., & El-Zohairy, M. (2011). Detecting vibra- R. S. Nickerson (Ed.), Attention and performance VIII (pp.
tions across the body in mobile contexts. In Proceedings 239-257). London, UK: Psychology Press.
of the SIGCHI Conference on Human Factors in Comput- Williams, S. R., & Chapman, C. E. (2000). Time course and magni-
ing Systems (pp. 3267–3276). Vancouver, BC, Canada. tude of movement-related gating of tactile detection in humans.
doi:10.1145/1978942.1979426 I. Effects of stimulus intensity. Journal of Neurophysiology,
Lu, S. A., Wickens, C. D., Prinet, J. C., Hutchins, S. D., Sarter, N., 79, 863–875. doi:10.1152/jn.00527.2001
& Sebok, A. (2013). Supporting interruption management and Williams, S. R., & Chapman, C. E. (2002). Time course and
multimodal interface design: Three meta-analyses of task per- magnitude of movement-related gating of tactile detection in
formance as a function of interrupting task modality. Human humans. I. Effect of motor tasks. Journal of Neurophysiology,
Factors, 55, 697–724. doi:10.1177/0018720813476298 88, 1968–1979. doi:10.1152/jn.00527.2001
Miller, G. A. (1994). The magical number seven, plus or minus Williams, S. R., Shenasa, J., & Chapman, C. E. (1998). Time course
two: Some limits on our capacity for processing information. and magnitude of movement-related gating of tactile detection
Psychological Review, 101, 343–352. in humans. I. Importance of stimulus location. Journal of Neu-
Morioka, M., Whitehouse, D. J., & Griffin, M. J. (2008). Vibro- rophysiology, 79, 947–963. doi:10.1152/jn.00527.2001
tactile thresholds at the fingertip, volar forearm, large toe and Wilska, A. (1954). On the vibrational sensitivity in different
heel. Somatosensory & Motor Research, 25, 101–112. regions of the body surface. Acta Physiologica Scandinavica,
O’Regan, J. K., Rensink, R. A., & Clark, J. J. (1999). Change- 31, 285–289. doi:10.1111/j.1748-1716.1954.tb01139.x
blindness as a result of “mudsplashes.” Nature, 398(6722), Winter, D. A. (1995). Human balance and posture control during
Article 34. doi:10.1038/17953 standing and walking. Gait & Posture, 3, 193–214. doi:10.1016/
Piateski, E., & Jones, L. (2005). Vibrotactile pattern recognition on 0966-6362(96)82849-9
the arm and torso. In First Joint Eurohaptics Conference and Woods, D. D., Patterson, E. S., & Roth, E. M. (2002). Can we
Symposium on Haptic Interfaces for Virtual Environment and ever escape from data overload? A cognitive systems diag-
Teleoperator Systems (pp. 90–95). Los Alamitos, CA: IEEE nosis. Cognition, Technology & Work, 4, 22–36. doi:10.1007/
Computer Society. doi:10.1068/p5914 s101110200002
Rensink, R. A., O’Regan, J. K., & Clark, J. J. (1997). The need for
attention to perceive changes in scenes. Psychological Science,
8, 368–373.
Kylie Gomes is a PhD candidate at Clemson Univer-
Riggs, S. L., & Sarter, N. (2016). The development and evaluation sity. She obtained her MS in industrial engineering
of countermeasures to tactile change blindness. Human Fac- from Clemson University in 2017.
tors, 58, 482–495. doi:10.1177/0018720815625739
Riggs, S. L., Wickens, C. D., Sarter, N., Thomas, L. C., Nikolic, M.
I., & Sebok, A. (2017). Multimodal information presentation
Scott Betza is a systems engineer and program man-
in support of NextGen operations. The International Journal ager at Naval Information Warfare Center (NIWC)
of Aviation Psychology, 27, 29–43. doi:10.1080/10508414.20 Atlantic. He obtained his MS in industrial engineer-
17.1365608 ing from Clemson University in 2017.
Simons, D. J. (2000). Current approaches to change blindness. Visual
Cognition, 7(1–3), 1–15. doi:10.1080/135062800394658
Simons, D. J., Franconeri, S. L., & Reimer, R. L. (2000). Change Sara Lu Riggs is an assistant professor at Clemson
blindness in the absence of a visual disruption. Perception, 29, University. She obtained her PhD in industrial and
1143–1154. doi:10.1068/p3104
operations engineering from the University of Mich-
Stanislaw, H., & Todorov, N. (1999). Calculation of signal detec-
tion theory measures. Behavior Research Methods, Instru- igan, Ann Arbor in 2014.
ments, & Computers, 31, 137–149. doi:10.3758/BF03207704
Tanner, W. P., Jr., & Swets, J. A. (1954). A decision-making the-
ory of visual detection. Psychological Review, 61, 401–409. Date received: June 14, 2018
doi:10.1037/h0058700 Date accepted: April 18, 2019

You might also like