You are on page 1of 15

Journal of Experimental Psychology: Copyright 1999 by the American Psychological Association, Inc.

Human Perception and Performance 0096-1523/99/S3.00


1999, Vol. 25, No. 6,1867-1881

Children's Haptic and Cross-Modal Recognition


With Familiar and Unfamiliar Objects
Emily W. Bushnell and Chiara Baxt
Tufts University

Five-year-old children explored multidimensional objects either haptically or visually and


then were tested for recognition with target and distractor items in either the same or the
alternative modality. In Experiments 1 and 2, haptic, visual, and cross-modal recognition were
all nearly perfect with familiar objects; haptic and visual recognition were also excellent with
unfamiliar objects, but cross-modal recognition was less accurate. In Experiment 3,
cross-modal recognition was also less accurate than within-mode recognition with familiar
objects that were members of the same basic-level category. The results indicate that
children's haptic recognition is remarkably good, that cross-modal recognition is otherwise
constrained, and that cross-modal recognition may be accomplished differently for familiar
and unfamiliar objects.

Mature human perceivers are able to determine just from ample, observations of cross-modal recognition on the part
feeling an object what it will look like when it is brought into of preverbal infants (see Bryant, Jones, Claxton, & Perkins,
view, and conversely they are able to determine just from 1972; Bushnell, 1982; Bushnell & Weinberger, 1987; Rose,
looking at an object what it will feel like when it is Gottfried, & Bridger, 1981; Ruff & Kohler, 1978) have
eventually grasped. This ability is known as cross-modal effectively laid to rest an early idea that cross-modal
transfer or cross-modal recognition, and it has been a topic recognition was dependent on verbal mediation. Similarly,
of interest to psychologists from the earliest days of the in studies with young children, a consistent finding has been
discipline (cf. Berkeley, 1709/1948; Locke, 1690/1959). that cross-modal recognition is significantly poorer than
Cross-modal recognition is an important aspect of percep- visual recognition with the same stimuli but either equiva-
tion because the intersensory predictions it permits mean lent to or better than haptic recognition (cf. Abravanel, 1972;
that interactions with objects can be adaptive, safe, and Bryant & Raz, 1975; Jones & Robinson, 1973; Milner &
economical. Cross-modal recognition is also important Bryant, 1968; Rose, Blank, & Bridger, 1972; Rudel &
because it seems to be a sort of marker for cognitive Teuber, 1964; Stoltz-Loike & Bomstein, 1987). This pattern
prowess. Compromised populations, such as prematurely of results has led to the conclusion that children's cross-
born infants and mentally retarded individuals, show deficits modal perception is essentially constrained only by their
in cross-modal recognition (Jones & Robinson, 1973; Rose, relatively poor haptic abilities. The remaining dispute in this
Gottfried, & Bridger, 1978; Zung, 1971), and assessments of matter concerns whether children's difficulty in haptic
cross-modal recognition in infancy correlate with measures perception is with encoding haptic information in the first
of IQ at later ages (Rose & Wallace, 1985). place or with retaining it over time. Some researchers report
To identify and more fully understand the mechanisms deficits in children's haptic and cross-modal performance
that underlie cross-modal recognition, researchers have relative to visual performance only in successive matching
turned to investigating this perceptual ability in infants and tasks, which require memory for the haptically perceived
young children, where its development can be linked to or information (Rose et al., 1972), whereas other researchers
dissociated from developments in other domains. For ex- report deficits also in simultaneous tasks, which are not
dependent on memory (Bryant & Raz, 1975; Jones &
Emily W. Bushnell and Chiara Baxt, Department of Psychology, Robinson, 1973; Milner & Bryant, 1968).
Tufts University. The emphasis on inadequacies in children's haptic percep-
Chiara Baxt is now at the Department of Psychology, Fordham tion as the reason for deficits in cross-modal recognition is
University. inconsistent, however, with observations that young children
Portions of this research were presented at the 1991 and the 1995 are very good at identifying common objects by touch.
annual meetings of the Psychonomic Society, which took place in Bigelow (1981) found that children as young as 2.5 years old
San Francisco and Los Angeles, respectively. were able to correctly label an average of 5.6 out of 7
We thank Abigail Altaian, Laura Poleshuck, and J. Paul Bou- common objects (a spoon, keys, a ball, etc.) that they felt
dreau for their help in collecting and scoring the data. We also
thank the children for participating and their parents for making it
under a cloth, and 5-year-olds were nearly perfect at the task.
possible for them to do so. Similarly, Morrongiello, Humphrey, Timney, Choi, and
Correspondence concerning this article should be addressed to Rocca (1994) found that children ranging from 3 to 8 years
Emily W. Bushnell, Department of Psychology, Tufts University, old were able to correctly label about 75% of the common
Medford, Massachusetts 02155. Electronic mail may be sent to objects they felt behind a curtain. Such accurate identifica-
ebushnel@emerald.tufts.edu. tion of objects by touch alone obviously requires both

1867
1868 BUSHNELL AND BAXT

adequate haptic intake of the concurrent stimulus informa- at a distinct disadvantage. The stimuli have been meaning-
tion and also long-term memory representations of the less, novel objects that differed from one another in just a
objects that are vivid enough to be uniquely evoked by the single dimension, typically one (shape) that haptic percep-
information taken in. tion is relatively poorly adapted to perceive, and furthermore
There are several factors that might account for the children have usually been asked to explore these stimuli
discrepancy between the excellent haptic abilities demon- with just one hand. Under these circumstances, it is not
strated in these object identification studies and the rela- surprising that cross-modal recognition is simply limited by
tively poor haptic abilities observed in the studies cited haptic perception and that no other constraints on children's
earlier of children's cross-modal recognition. First, of course, cross-modal abilities have been identified. In the research
the stimuli in the identification studies were familiar house- reported below, our goal was to examine children's cross-
hold objects, whereas the stimuli in the cross-modal studies modal recognition under conditions more favorable to haptic
were abstract forms or contrived, novel objects. Perhaps perception. Children explored familiar and unfamiliar multi-
children require lengthy or repeated exposures to haptic dimensional objects with both hands, and their ability to
information to form memory representations that are ad- subsequently recognize these stimuli visually was assessed.
equate to support later recognition; the relatively brief Children's ability to recognize the stimuli haptically was
exposures to the novel stimuli in the cross-modal studies also assessed so that we could more fully understand the
may not have met this criterion. Second, in the identification relationship between cross-modal perception and haptic
studies, children explored the stimuli with both hands, perception during development.
whereas in at least four of the cross-modal studies (Abra-
vanel, 1972; Bryant & Raz, 1975; Rose et al., 1972; Rudel & Experiment 1
Teuber, 1964), children were restricted to exploring the
stimuli with just one hand. This variation is important Method
because haptic perception may be more precise and efficient Participants. The final sample included 8 boys and 7 girls,1
when two hands are used rather than one. Lederman and each between 5 and 5.5 years old (M = 5 years, 114 days). Two
Klatzky (1987) have identified the hand movement patterns other children were tested but not included in the final sample; 1
that are optimal for extracting various types of information was excluded because she chose not to complete all four condi-
about objects during haptic exploration; in most of these tions, and the other was excluded because of irregularities in the
"exploratory procedures," one hand stabilizes and orients procedure. Children were recruited from a participant file devel-
the object while the other hand executes a particular oped by mail solicitation of parents in several towns near Tufts
University. Respondents to the solicitation were predominantly
information-gathering motion (e.g., poking the object to white, middle or upper-middle class, two-parent families.
assess its compliance or tracing the object's contours to Stimuli. The stimuli were real, three-dimensional objects.
extract information about shape). Thus exploration with just There were four sets of 16 objects each. Two sets consisted of
one hand may yield ambiguous information because the familiar objects; these included toys, food items, articles of
sensations experienced by the hand cannot be easily corre- clothing, household artifacts, and so forth—that is, things that the
lated with the object's position in space, its resistance, and so children had presumably held in their hands on many prior
forth, which are usually determined by the second hand. occasions, that probably had meaning for them, and for which they
Finally, the common objects in the identification studies probably had conventional verbal labels. The other two sets
varied from one another in all the ways natural objects can consisted of unfamiliar objects; these included odd pieces of scrap,
vary—in size, shape, weight, texture, temperature, compli- segments of larger objects, specialized machine parts or tools, and
so forth—that is, things that the children had presumably not
ance, and so forth—whereas the stimuli in the cross-modal handled frequently, that probably had little meaning for them, and
studies differed from one another only in one dimension, for which they probably did not have conventional verbal labels.
usually just in shape but in some instances just in texture. The items within each set differed from one another in multiple
This contrast is important because multidimensional objects ways, including in size, shape, color, surface texture, compliance
may be easier to haptically perceive and discriminate than and rigidity, weight, the number of distinct parts, and whether there
objects differing along just one dimension, especially if that were movable parts. The objects in each of the four sets are listed in
one dimension is shape. Klatzky, Lederman, and Reed Appendix A.
(1989) found that objects defined redundantly by values on
two or three dimensions were classified by touch more
1
readily than objects defined by their value on just a single Initially, data from 8 girls were collected and analyzed, as
dimension, and the results of several other studies by these called for by the planned experimental design. However, it was
researchers have indicated that the property of shape is less subsequently discovered that the birth year for 1 girl had been
salient to the hands and less efficiently perceived by the misrecorded, and she was actually outside of the age range for the
hands than are material properties such as texture, tempera- experiment. At that point in time, it was no longer possible to run
another participant with the identical stimuli and procedure; hence,
ture, and compliance (Klatzky, Lederman, & Metzger, 1985; the data from the girl in question were eliminated and the analyses
Klatzky, Lederman, & Reed, 1987; Lederman & Klatzky, reported here were conducted on the data for the remaining 15
1987). participants. The patterns of results for the analyses reported here
Thus it seems that young children's cross-modal percep- are essentially identical to those for analyses including the data of
tual abilities have heretofore been investigated only in the girl in question; she was older than all the others and had
formats that place the haptic perception side of the equation accurately recognized all the test items on every type of sequence.
CHILDREN'S HAPTIC AND CROSS-MODAL RECOGNITION 1869
Apparatus. The apparatus consisted of a 2 ft long X 1 ft the box and encouraged the child to feel each one carefully before
wide X 1 ft deep (60 cm long X 30 cm wide X 30 cm deep) putting it in the bucket. The practice objects always included at
cardboard box, which was set on a table between the participant least one familiar and one unfamiliar object, and the assurance that
and the experimenter. There was an opening cut into the front of the the child didn't have to name the object was repeated as the
box facing the child; this opening was covered with a cloth panel unfamiliar one was presented. After the child had haptically
with two slits through which the child could reach. There was also explored each practice item, the experimenter took the bucket and
an opening in the back of the box facing the experimenter. This audibly (but not visibly) poured its contents into the basket on her
arrangement permitted the experimenter to hand the child objects lap and dramatically mixed up the objects. The experimenter then
inside of the box, so that the child could explore the objects explained that she was going to give the child some objects again
haptically without being able to see them. To further ensure that the and that this time the child was to tell her whether each object was
child did not see the objects, we attached a cloth cape to the top of an "old" one that the child had felt before and put in the bucket or a
the box and extended it over the child's shoulders and fastened it "new" one that must have come from the experimenter's basket.
behind the neck. A plastic bucket was placed to one side inside of The experimenter then proceeded to test the child with a few
the box, and a rectangular basket was positioned on the experiment- practice objects; these always included at least one object the child
er's lap below the table top. had explored moments before and one that the child had not
Procedure and design. The general procedure was an adapta- explored, and the experimenter reinforced or corrected the child's
tion of the study-test paradigm commonly used to study visual "old" or "new" responses as necessary. If the first study-test
recognition memory (cf. Perlmutter & Myers, 1974). There were sequence to be administered involved a haptic-visual test, the
two types of study-test sequences, within-mode (haptic-haptic) practice test instructions and procedure were adapted accordingly.
sequences and across-mode (haptic-visual) sequences. During the If the child did not respond correctly to the practice items or
study phase in both types of sequences, participants were given a seemed unsure about how the game worked, the instructional
series of 8 objects one at a time to explore haptically inside the box procedure was repeated with additional practice objects. Once the
apparatus. These target objects were then intermixed with 8 child seemed to understand the task, the experimenter proceeded to
distractor objects for the test phase. During the test phase in administer the first formal (nonpractice) study-test sequence.
haptic-haptic sequences, the 16 target and distractor objects were For each study-test sequence, the 8 objects that were to serve as
given to participants one at a time inside of the box, as during the targets during the study phase had been randomly selected before-
study phase, and the children were asked to indicate for each item hand from the designated set of 16 and were listed on a data sheet
whether it was one they had felt during the study phase or not. for the experimenter to follow. During the study phase, these
During the test phase in haptic-visual sequences, the target and objects were placed one at a time into the child's hands inside of the
distractor items were held up above the box one at a time for the box, and the child was reminded to learn each object by feeling it
children to visually inspect, and again they were asked to indicate carefully and then to put it in the bucket. The study phase was
whether each item was one they had felt during the study phase or self-paced and generally moved along briskly; children typically
not. manipulated each object actively with both hands for somewhere
Each child participated in four different study-test sequences. between 3 and 10s before placing it in the bucket. If a child seemed
These were administered in two blocks of two sequences each, with to be going too quickly or too slowly, the experimenter attempted to
a short break between blocks. Within each block, one study-test reset the pace with appropriate comments and reminders. If a child
sequence was haptic-haptic and the other was haptic-visual; the named an object or guessed at its identity, the experimenter neither
order of these sequence types in the first block was counterbalanced confirmed nor disconfirmed the child's label, and if a child
across participants, and the order in the second block was the same expressed uncertainty about what a particular object was, the
as in the first. For 7 of the children, the two sequences in the first experimenter encouraged the child to just try to learn the object by
block involved familiar objects and those in the second block feeling it with his or her hands.
involved unfamiliar objects; for the remaining 8 children, the types The test phase commenced immediately after the study phase
of objects were presented in the reverse order. In each block, which was completed. The experimenter took the bucket full of target
set of familiar or unfamiliar objects (see Appendix A) was used in items and audibly poured them together with the remaining eight
the haptic-haptic sequence and which in the haptic-visual se- objects from the designated set. She announced that she was now
quence was counterbalanced across participants. Each object going to "give" (haptic-haptic tests) or "show" (haptic-visual
within each set served as a target item for 7 or 8 children and as a tests) "all" of the objects to the child one at a time, and reminded
distractor item for the remaining children. the child to tell her whether each one was an "old" one that had
A parent accompanied each child to the laboratory and com- been felt just before or whether it was a "new" one. The eight
pleted an informed consent form while the experimenter conversed target and eight distractor items were presented in an ABBAABAB-
casually with the child. The experimenter then invited the child to BAABABBA order during the test phase; the positions of particu-
play a game that the child was told was about how children learn lar items within this constrained old-new order had been randomly
and remember things. After the child assented, the experimenter led established and listed on the data sheet beforehand. The experi-
the child into a room with the table and the box apparatus. Parents menter either placed each test item in the child's hands as during
sat in a connecting room where they could observe the proceedings the study phase (haptic-haptic tests) or held it up above the box
through a one-way mirror. (haptic-visual tests) and prompted the child's response with a
The child was helped onto a stool positioned at the table and comment such as, "OK, how about this one?" Children were not
shown how to reach through the cloth panel into the box to feel permitted to touch the test objects held up for visual inspection;
something without seeing it. The experimenter then explained that however, the experimenter slowly rotated, wiggled, and squeezed
she was going to give the child some things inside the box and that the objects to display the full range of their properties. Like the
she wanted the child to feel each object carefully. The child was study phase, the test phase was self-paced, and children typically
told, "You don't have to tell me what each thing is; you just need to gave their "old" or "new" responses within 2 to 3 s following the
feel each thing and try to learn it with your hands, so that you will presentation of each object. The experimenter did not give the child
know it later if I give it to you again." The experimenter then feedback as to the accuracy of individual responses, but she made
handed the child two or three practice objects one at a time inside of generally encouraging remarks throughout, such as, "You're doing
1870 BUSHNELL AND BAXT

a good job." If a child hesitated over an item or expressed quences) analysis of variance (ANOVA) on the numbers of
uncertainty about whether it was old or new, the experimenter correct responses yielded significant main effects of both
agreed that "some of these are hard" and encouraged the child to familiarity and modality. Overall, children made more
feel it (or look at it) carefully and make a guess. The experimenter correct responses with familiar objects (M = 15.0, SD = 0.8)
recorded the child's "old" or "new" responses on the data sheet as
the test phase proceeded.
than with unfamiliar objects (M = 13.5, SD = 1.1), F(l,
After the completion of the first study-test sequence, the 14) = 18.5, MSB = 2.0, p < .001, and they made more
experimenter asked the child to take his or her hands out of the box correct responses on the haptic-haptic sequences (M = 14.9,
and shake them "to give them a rest." She then invited the child to SD = 1.1) than on the haptic-visual sequences (M = 13.6,
play the game again but with some different things and in a slightly SD = 0.9), F(l, 14) = 12.1, MSB = 2.l,p< .005. However,
different way. The alternative type of study-test sequence (haptic- these main effects were qualified by a significant familiarity
visual if the first sequence had been haptic-haptic and vice versa) by modality interaction, F(l, 14) = 6.5,MSB =l.6,p< .05.
was introduced to the child with several practice objects, and then As Figure 1 suggests, the familiarity effect occurred mostly
the second study-test sequence was administered in the same on the haptic-visual sequences, and the modality effect
manner as the first, except with the alternative type of test phase. occurred mostly with the unfamiliar objects. Planned paired
After the completion of the second sequence, the experimenter and
child took a short break to visit the parent, go to the bathroom, and
comparisons indicated that the number of correct responses
so on. When they returned to the experimental room, the second on the haptic-visual sequence with unfamiliar objects
two study-test sequences were administered in the same manner as (M = 12.4, SD =1.6) was lower than on the haptic-visual
the first two, except with the alternative type of objects (familiar if sequence with familiar objects (M = 14.8, SD = 1.3), two-
the first sequences had been with unfamiliar and vice versa). tailed f(14) = 4.2, p < .005, than on the haptic-haptic
sequence with unfamiliar objects (M = 14.5, SD = 1.6),
Results two-tailed r(14) = 3.7, p < .005, and than on the haptic-
haptic sequence with familiar objects (M = 15.3, SD = 1.0),
Preliminary analyses on the numbers of correct responses two-tailed t(\4) = 6.3, p < .001. Among the scores on the
on each study-test sequence revealed no consistent or latter three types of sequences, no one type differed signifi-
meaningful effects of order or sex, so the data were cantly from any other; however, because the scores on each
collapsed across these factors in all further analyses. The of these sequences were close to the maximum possible,
mean number of correct responses on each type of study-test genuine differences among them may have been obscured.
sequence is shown in Figure 1. The first thing to note is that Nevertheless, it is clear in any event that although it was
performance was well above chance for every type of better than chance, performance on the haptic-visual se-
sequence. In fact, across all participants and all types of quence with unfamiliar objects was less accurate than
sequences, there were no individual scores at or below the performance on each of the other types of sequences.
chance value of 8 correct responses; the lowest individual The pattern of results for individual children was gener-
score was 10 correct responses, made by two different ally consistent with that described for the group means.
children on the haptic-visual sequence with unfamiliar Considering all four types of sequences together, 9 of the 15
objects. participants made fewer correct responses on the haptic-
A repeated measures familiarity (familiar vs. unfamiliar visual sequence with unfamiliar objects than they made on
objects) by modality (haptic-haptic vs. haptic-visual se- any other sequence, and 2 further participants tied their
worst performance on the haptic-visual sequence with
unfamiliar objects. Conversely, no participant scored per-
(maximum) 15 -, fectly (i.e., responded correctly to all 16 test items) on the
15 haptic-visual sequence with unfamiliar objects, whereas 6
did so on the haptic-visual sequence with familiar objects, 5
14
did so on the haptic-haptic sequence with unfamiliar
S 13 objects, and 8 did so on the haptic-haptic sequence with
familiar objects.
o
1_
Q> 11

| 10
Discussion
The results first indicate that young children's haptic
abilities with real, multidimensional objects are remarkably
good. On the haptic-haptic study-test sequences, children
responded accurately to an average of about 15 of the 16 test
H-H H-V H-H H-V items, a result that was true with familiar objects and also
Familiar Objects Unfamiliar Objects with unfamiliar objects. The excellent haptic recognition
with familiar objects is consistent with the results of earlier
Figure 1. A bar graph showing the mean number of correct studies showing that young children are very good at
responses for each type of study-test sequence with each kind of identifying common objects by touch (Bigelow, 1981;
object in Experiment 1. Error bars indicate standard errors. H-H = Morrongiello et al., 1994). The results with unfamiliar
haptic-haptic; H-V = haptic-visual. objects make it clear that such excellent haptic recognition is
CHILDREN'S HAPTIC AND CROSS-MODAL RECOGNITION 1871

not dependent on having conventional verbal labels for the This pattern of results has two important implications. First,
objects in question or on having had lengthy or repeated although it may not be critical for within-mode haptic
exposures to them. Although children presumably had no recognition, familiarity with the stimulus objects seems to
names for the unfamiliar objects, had not handled them enhance haptic-visual recognition. Indeed, several research-
extensively before the experiment, and handled a subset of ers have suggested that cross-modal recognition with famil-
them for just 5 to 10s each during the study phase, they were iar objects is accomplished through a different strategy or
nevertheless able to easily distinguish these previously felt mental process in comparison to cross-modal recognition
items from distractor items on the test phase. with unfamiliar objects (cf. Bushnell, 1986; Bushnell, 1994;
The finding that children's haptic recognition is excellent Johnson, Paivio, & Clark, 1989). Second, with unfamiliar
even with unfamiliar objects contrasts with the conclusions objects in particular, the memory representations formed of
of prior researchers that children do not encode haptically them from haptic exploration may not be sufficient to
perceived information very precisely or do not retain it very support visual recognition. This insufficiency cannot be
well (cf. Abravanel, 1972; Bryant & Raz, 1975; Milner & attributed to the stimulus objects being difficult to distin-
Bryant, 1968; Rose et al., 1972). We think that certain guish haptically, because haptic recognition with the same
aspects of our procedure promoted good rather than poor unfamiliar objects was very good. Although it seems un-
haptic recognition; unlike in previous studies, in Experiment likely, it is possible that haptic-visual recognition with the
1 children explored the objects with both hands and, most unfamiliar objects was compromised because these objects
importantly, the objects were multidimensional and offered a are difficult to distinguish visually. To investigate this
full range of properties to distinguish them from one another. possibility, we conducted a second experiment in which
It seems that when an object is handled, as when one is seen, children's visual recognition abilities with the stimulus
a vivid memory representation of the sensory experience is objects were assessed. Their cross-modal recognition abili-
formed. However, in accordance with Klatzky and Leder- ties were also assessed again in the second experiment.
man's arguments (cf. Klatzky et al., 1985, 1987; Lederman
& Klatzky, 1987), a representation based on haptic experi- Experiment 2
ence is likely to be couched predominantly in terms of the
object's material properties, such as its weight, texture, Method
compliance, and so forth. The spontaneous verbalizations Participants. The final sample included 8 boys and 8 girls,
made by some children while haptically exploring the each between 5 and 5.5 years old (M = 5 years, 66 days). Two
unfamiliar objects support this idea—children made remarks other children were tested but not included in the final sample
such as, "It's heavy," "It's hairy," or "It's squishy," and because they did not seem to adequately understand the task, as
they sometimes even identified the material the object was evidenced by a preponderance of "old" responses (i.e., to seven or
made of, saying, "It's rubber," "It's plastic," or "It's more of the eight distractor items) on one or more of the study-test
metal." Once formed through exploration, memory represen- sequences. Children were recruited in the same manner and from
the same population as in Experiment 1, but none of them had
tations of haptic experience are presumably available for participated in the first experiment.
implicit comparison with subsequent haptic input, thus Stimuli, apparatus, procedure, and design. The stimuli and
enabling quick and accurate haptic recognition such as we apparatus were the same as those in Experiment 1. The procedure
observed, in the same way that stored visual images are and design were also the same as in Experiment 1 in most respects.
supposed to be involved in the recognition of visual stimuli.2 The only difference was that in Experiment 2, the eight objects
In earlier studies that led to the conclusion that children's presented during each study phase were shown to the child one at a
haptic abilities are poor, memory representations of the time for visual inspection, rather than given to the child one at a
haptic stimuli may not have been able to support accurate time for haptic exploration as in Experiment 1. The nature of the
recognition because the material properties featured in such practice phases and the instructions and reminders throughout the
representations did not distinguish the target and distractor procedure were adapted accordingly.
To show the designated items during each study phase, the
objects; these differed from one another only in shape. In experimenter took each one from her basket positioned out of the
contrast to the conclusions from these studies, we conclude child's sight and held it up above the box. While making sure the
from our results that haptic perception may already be an child was watching, the experimenter slowly rotated, wiggled, and
"expert system" (cf. Klatzky et al., 1985) even early in squeezed the object for 5 to 10 s to display its properties. When the
development, provided the system is permitted to act on the child indicated that he or she had had a "good look" at the object
variety of object properties for which it is adapted. and would be able to remember it, the experimenter put it in the
The results for the haptic-visual study-test sequences child's bucket inside the box and then took the next study item from
were notably different from the results for the haptic-haptic her basket. After all eight study items for a given sequence had
sequences. With familiar objects, haptic-visual recognition
was very good; in fact, performance did not differ from 2
It is important to keep in mind, though, that although they may
haptic recognition with the same objects, although this function similarly to support recognition, memory representations
apparent equivalence could be due to a ceiling effect. With of haptic experience contain very different sorts of information
unfamiliar objects, however, haptic-visual recognition was (viz., mostly about material properties) in comparison to represen-
clearly poorer than haptic recognition with the same objects. tations of visual experience. For this reason, we are tempted to refer
Haptic-visual recognition with unfamiliar objects was also to haptically based representations as "hand-mages" to distinguish
poorer than haptic-visual recognition with familiar objects. them from visual images ("eye-mages").
1872 BUSHNELL AND BAXT

been shown, the experimenter audibly poured them from the child's A repeated measures familiarity (familiar vs. unfamiliar
bucket back together with the remaining eight objects the child had objects) by modality (visual-visual vs. visual-haptic se-
not been shown and proceeded immediately with the test phase. quences) ANOVA on the numbers of correct responses
During the test phase, as in Experiment 1, the target and yielded significant main effects of both familiarity and
distractor items were presented visually for two of the sequences
and haptically for the other two, one sequence with familiar objects modality. Overall, children made more correct responses
and one with unfamiliar objects in each modality. Thus in with familiar objects (M = 15.6, SD = 0.3) than with unfa-
Experiment 2, the within-mode study-test sequences were visual- miliar objects (M = 15.1, SD = 0.7), F(l, 15) = 5.4,
visual rather than haptic-haptic, and the across-mode sequences MSE — 0.6, p < .05, and they made more correct responses
were visual-haptic rather than haptic-visual. As in Experiment 1, on the visual-visual sequences (M = 15.9, SD = 0.2) than
each child participated in all four types of study-test sequences, in on the visual-haptic sequences (M = 14.8, SD = 0.9),
two blocks of two sequences each with a short break between F(l, 15) = 25.0, MSE = 0.9, p < .001. However, as in
blocks. Whether the sequences in the first block involved familiar
or unfamiliar objects, whether the first sequence in each block was Experiment 1, these main effects were qualified by a
visual-visual or visual-haptic, and which set of familiar or significant familiarity by modality interaction, F(l, 15) =
unfamiliar objects (see Appendix A) was used in each sequence 5.4, MSE = 0.6, p < .05. As Figure 2 indicates, children
within each block were all counterbalanced across participants. made more correct responses with familiar than with unfamil-
Each object within each set served as a target item for 8 children iar objects only on the visual-haptic sequences; performance
and as a distractor object for the remaining 8 children. on the visual-visual sequences was equally and extremely
good with both types of objects. Planned paired comparisons
Results indicated that the number of correct responses on the
visual-haptic sequence with unfamiliar objects (M = 14.3,
Preliminary analyses on the numbers of correct responses
SD = 1.5) was lower than on the visual-haptic sequence
on each study-test sequence revealed no consistent or
with familiar objects (M= 15.3, SD = .7), two-tailed f(15) =
meaningful effects of order or sex, so the data were
2.4, p < .05, than on the visual-visual sequence with
collapsed across these factors in all further analyses. The
unfamiliar objects (M = 15.9, SD = 0.3), two-tailed t(15) =
mean number of correct responses on each type of sequence
is shown in Figure 2, from which it is apparent that the 4.2, p < .005, and than on the visual-visual sequence with
overall pattern of results for Experiment 2 is quite similar to familiar objects (M = 15.9, SD = 0.3), two-tailed ?(15) =
that for Experiment 1 (compare Figures 1 and 2). Perfor- 4.1, p < .005. The number of correct responses on the
mance again was well above chance for every type of visual-haptic sequence with familiar objects was likewise
sequence; indeed, performance was slightly better across all lower than on the visual-visual sequence with familiar
sequence types than in Experiment 1. As in Experiment 1, objects, two-tailed r(15) = 3.5, p < .005, and than on the
there were no individual scores for any type of sequence that visual-visual sequence with unfamiliar objects, two-tailed
were at or below the chance value of 8 correct responses; the ?(15) = 3.9, p < .005. The numbers of correct responses on
lowest score in Experiment 2 was 11 correct responses, the two visual-visual sequences obviously were not signifi-
made by one child on the visual-haptic sequence with cantly different, although because the scores on both of these
unfamiliar objects. sequences were essentially at ceiling, any genuine difference
between them could not be revealed. As in Experiment 1, the
key unambiguous finding of Experiment 2 is that perfor-
mance on the across-mode sequence with unfamiliar objects
(maximum) 16 -
was less accurate than performance on each of the other
15 - types of sequences. In Experiment 2, performance on the
14
across-mode sequence with familiar objects was also less
accurate than performance on either of the within-mode
8 13 i sequences.
o 12 - The pattern of results for individual children was gener-
<D 11
ally consistent with that described for the group means.
.a Considering all four types of sequences together, 2 partici-
pants scored perfectly throughout, responding correctly to
all 16 test items on every one of the four test sequences. Of
(chance) g
the remaining 14 participants, 7 made fewer correct re-
sponses on the visual-haptic sequence with unfamiliar
objects than they made on any other sequence, and 4 others
V-V V-H V-V V-H tied their worst performance on the visual-haptic sequence
with unfamiliar objects. Conversely, 13 of the 14 partici-
Familiar Objects Unfamiliar Objects
pants who didn't score perfectly altogether scored perfectly
Figure 2. A bar graph showing the mean number of correct on each type of visual-visual sequence, and 4 of them scored
responses for each type of study-test sequence with each kind of perfectly on the visual-haptic sequence with familiar ob-
object in Experiment 2. Error bars indicate standard errors. V-V = jects, whereas just 2 scored perfectly on the visual-haptic
visual-visual; V-H = visual-haptic. sequence with unfamiliar objects.
CHILDREN'S HAPTIC AND CROSS-MODAL RECOGNITION 1873

Discussion Stoltz-Loike & Bornstein, 1987). However, we have argued


that haptic recognition was unusually depressed in these
The results for Experiment 2 parallel those for Experi- earlier studies because the stimuli varied from one another
ment 1 in several important respects. Within-mode recogni- only in shape. Our results with stimuli varying on multiple
tion, in this case visual recognition, was highly accurate with dimensions suggest that children's haptic recognition is
familiar and also with unfamiliar objects. Indeed, visual actually very good, and that cross-modal recognition is
recognition with both types of objects was effectively therefore not constrained by haptic abilities, nor by visual
perfect, so that any potential effect of familiarity on visual abilities either. Instead, cross-modal recognition with unfa-
recognition may have been obscured in this experimental miliar objects evidently operates under some processing
task. Visual-haptic recognition, however, was not as accu- burden peculiar to itself.
rate as visual recognition with either type of object. Visual- We suggest that the processing burden implicated for
haptic recognition was also less accurate with unfamiliar cross-modal recognition has to do with the differential
objects than with familiar ones; although smaller in magni- saliencies of various properties to the two modalities in
tude, this difference is analogous to the familiarity effect question. Recall that representations formed from haptic
observed for haptic-visual recognition in Experiment 1. experience contain information especially about an object's
The near-perfect visual recognition evidenced by children material properties such as its weight, temperature, compli-
in Experiment 2 is consistent with the results of prior studies ance, and texture (Klatzky et al., 1985, 1987; Lederman &
indicating that 4- to 5-year-old children have excellent, Klatzky, 1987). In contrast, representations formed from
virtually adult-level visual recognition memory for pictures visual experience primarily contain information about an
of common objects (cf. Brown & Campione, 1972; Brown & object's structural properties such as its size, shape, symme-
Scott, 1971) and for common objects themselves (cf. try, and so forth, and also about its color and surface
Perlmutter & Myers, 1974). Excellent visual recognition has patterns. Given these different profiles, implicit comparisons
also been observed in the visual-visual control conditions of between a representation of one sort and an instance of the
most earlier studies on young children's cross-modal abili- other might often be ambiguous or incomplete. The represen-
ties (cf. Abravanel, 1972; Bryant & Raz, 1975; Jones & tations could make contact with respect to certain properties
Robinson, 1973; Milner & Bryant, 1968; Rose et al., 1972); encoded in both cases, such as the object's global dimen-
in all of these studies, abstract forms or novel objects were sions or its texture perhaps, but there would also be a number
used as stimuli. Such accurate visual recognition for even of loose ends or properties encoded in one representation
unfamiliar material is presumably mediated by an ability to with little or no corresponding information in die other. In
form and retain vivid images or representations of visual other words, the burden for cross-modal recognition can be
stimuli from just brief exposures to them. characterized as a sort of conflict of interest or sampling
The results of the visual-visual sequence with unfamiliar problem (see Goodnow, 1971).
objects make it clear that these objects are not difficult for The sort of incomplete comparisons described above
children to visually discriminate and remember. These could lead to recognition errors such as those observed on
results effectively rule out the possibility raised earlier that the cross-modal sequences with unfamiliar objects in Experi-
the relatively poor cross-modal recognition with unfamiliar ments 1 and 2. For example, when feeling the turkey baster
objects in Experiment 1 might be due to an inability to top (see Appendix A), a child might especially note its
visually distinguish these stimuli. However, the distinct ridged texture and its compliance. The ridged quality would
visual representations children were obviously able to form be salient visually with the baster top, too, but it is also a
from looking at the stimuli were evidently not sufficient to salient visual feature of the threaded wooden cylinder and
support haptic recognition; in Experiment 2, children's the machine gear. Thus when seeing one of these latter
visual-haptic recognition with unfamiliar objects was poorer objects presented as a distractor, the child might mistakenly
than visual recognition with the same objects. Children's match it with the memory of the baster top and indicate that
haptic-visual recognition with the same unfamiliar objects it had been felt before. Such confusions or false recognitions
was likewise poorer than haptic recognition in Experiment would not occur when feeling the cylinder or gear, though,
1, and the within-mode results there also show that these because other haptic qualities such as their hardness or
objects are not difficult for children to haptically discrimi- coolness would distinguish them from the flexible rubber
nate and remember. Thus from the results of both studies baster top; these qualities are not salient for vision, however,
considered together, it seems that neither inferior visual and hence would not distinguish the objects in the across-
perception and retention nor inferior haptic perception and mode condition.
retention can account for the deficiency observed in both The limitations posed by the differential saliencies of
studies in cross-modal recognition with unfamiliar objects. various properties for touch and vision are apparently less of
Our finding that cross-modal recognition with unfamiliar an issue with familiar objects, however. Children's cross-
objects is less accurate than both visual recognition and modal recognition with familiar objects was more accurate
haptic recognition with the same objects contrasts with than with unfamiliar objects in both Experiments 1 and 2. A
earlier findings that cross-modal recognition is either more similar advantage of familiar over unfamiliar objects was
accurate or as accurate as haptic recognition (cf. Abravanel, not observed for either within-mode haptic or within-mode
1972; Bryant & Raz, 1975; Jones & Robinson, 1973; Milner visual recognition, although these comparisons may have
& Bryant, 1968; Rose et al., 1972; Rudel & Teuber, 1964; been compromised by ceiling effects. We think that at least
1874 BUSHNELL AND BAXT

in the across-mode sequences, recognition with familiar members of a second basic-level category, and two items that were
objects may have been achieved through a different process not members of either category. Thus one set of familiar objects
than with unfamiliar objects, so that the matter of representa- included an assortment of balls and an assortment of shoes; the
tions without corresponding information was effectively other included an assortment of spoons and an assortment of toy
circumvented. Although they were not asked to do so, cars. The items within each category were perceptually distinct—
they differed from one another in size, weight, surface texture,
children often identified the stimuli by name in the study compliance, color, presence or absence of certain components, and
phases with familiar objects, suggesting that their subse- so on, but they were nevertheless all members of the same
quent recognition could have been mediated by verbal basic-level category. The purpose of this manipulation was that if
labeling or conceptual categorizing. That is, during haptic or the items were identified, they would all activate the same verbal
visual exploration, a child might identify a familiar study label or conceptual representation. Thus the familiar objects would
item (whether overtly or covertly) as an instance of a not be distinct from one another at the conceptual level, and
particular basic-level category—identifying it as an "apple" therefore the presumed advantage of familiar objects over unfamil-
or as a "shoe," for example (see Appendix A; also cf. iar ones would be eliminated. The two out-of-category items in
Bigelow, 1981; Morrongiello et al., 1994)—thus activating each familiar set were included as a means of assessing whether the
some sort of generalized representation or prototype in children understood the task. On the basis of the results of
long-term semantic memory. This more conceptual memory Experiment 1, we expected children to be highly accurate at
recognizing the out-of-category familiar items, if not the poten-
representation might then be retained in addition to or in tially more confusable ones that were members of the same
place of the particular perceptual experience that evoked it, categories.
and it would permit the child to later recognize the target For the unfamiliar objects in Experiment 3, an attempt was made
item equally well in either the same or the alternative to organize them into groups roughly analogous to the categories
modality. used for the.familiar objects. The groupings for the unfamiliar
To investigate the possibility that a distinct, conceptually objects were obviously contrived and had no conventional labels;
based process might be involved in children's cross-modal they were generated to match the degree of perceptual variation
recognition with familiar as compared with unfamiliar that existed within the familiar sets. Thus one set of unfamiliar
objects, we conducted a third experiment. In this experi- objects included an assortment of seven disk-shaped objects and an
assortment of seven objects that each had an opening or cavity of
ment, children's recognition abilities were assessed with
some sort. These were meant to be analogous to the balls and the
familiar objects specifically selected to eliminate the pre- shoes, respectively. The other set of unfamiliar objects included an
sumed advantage of conceptually identifying the objects. assortment of seven rods or cylinders, some of which had
Children's recognition abilities were also assessed with distinctive ends, and an assortment of seven objects that each had a
analogous unfamiliar objects. It was predicted that without part or parts that rotated or swiveled. These were meant to be
being able to rely on conceptual representations to distin- analogous to the spoons and the toy cars, respectively. Except for
guish the familiar objects, children's cross-modal recogni- sharing the one feature that defined them as members of a group,
tion with them would be subject to the same perceptual the unfamiliar objects within each group differed from one another
conflict-of-interest problem as with unfamiliar objects, and in size, weight, texture, compliance, color, and so forth, as did the
thus no advantage of familiarity would be observed. familiar items. Each set of unfamiliar objects also included two
out-of-category items that did not possess the critical feature
defining either of the set's two groups.
Experiment 3 Procedure and design. The procedure and design for Experi-
ment 3 were the same as for Experiment 1 in most respects. Each
Method child participated in two haptic-haptic study-test sequences and in
two haptic-visual study-test sequences, one of each type with
Participants. The final sample included 7 boys and 9 girls, familiar and one with unfamiliar objects. As before, the four
each between 5 and 5.5 years old (M = 5 years, 62 days). Nine study-test sequences were administered in two blocks with a short
other children were tested but not included in the final sample. One break between blocks. Whether the sequences in the first block
child was excluded because he chose not to complete all four involved familiar or unfamiliar objects, whether the first sequence
conditions, and another was excluded because of a procedural in each block was haptic-haptic or haptic-visual, and which set of
irregularity. Seven children were excluded because they did not familiar or unfamiliar objects (see Appendix B) was used in which
seem to adequately understand the task, as evidenced by an sequence within each block were all counterbalanced across
unusually high number of errors on the out-of-category items participants. Each object served as a target item for 8 children and
(« = 2; see below) or by a preponderance of "old" or "new" as a distractor object for the remaining 8 children.
responses (i.e., to seven or more of the eight distractor or target One important difference in the procedure involved the practice
items, respectively) on one or more of the study-test sequences phase, which was modified to take into account the categories used
(n = 5). Children were recruited in the same manner and from the in Experiment 3. After the procedure had been introduced with two
same population as in Experiments 1 and 2, but none of them had or three very distinct practice items, as in the prior experiments, the
participated in either of those studies. experimenter then brought out a set of five drinking cups and put
Apparatus and stimuli. The apparatus was the same as in them on top of the box. The cups differed dramatically from one
Experiments 1 and 2. The stimuli were four new sets of 16 objects another perceptually—one was a white paper cup, another was a
each; these are listed in Appendix B. As in the prior experiments, short, orange cup made of flexible plastic, a third was tall and made
two of the sets consisted of familiar objects and two consisted of of "bumpy" or textured glass, and so forth. The experimenter said
unfamiliar objects. However, in Experiment 3, each set of familiar to the child, "Now here's something to be careful about. See these
objects included seven different items that were all members of a things here? They are all kind of the same thing; they are all cups,
single basic-level category, seven different items that were all that you could drink juice or milk out of, right? But look how
CHILDREN'S HAPTIC AND CROSS-MODAL RECOGNITION 1875

different they are. And they feel really different in your hands, too." in particular was clearly lower than in the earlier studies.
The child was then encouraged to look at and to pick up the various There were no individual scores for any type of sequence
cups, and the experimenter instructed the child, "In our game, for that were below the chance value of 8 correct responses; the
something to be called an 'old' thing, it has to be the very same one lowest individual score was exactly the chance value of 8
that I gave you and you put in your bucket; if it is the same kind of
thing, but not the exact same one I gave you before, then you
correct responses, made by one child on the haptic-visual
should tell me it is a 'new' one." The experimenter then went sequence with familiar objects.
through another practice study-test sequence with the child, using A repeated measures familiarity (familiar vs. unfamiliar
three or four of the cups, to ensure that the child understood this objects) by modality (haptic-haptic vs. haptic-visual se-
point.3 quences) ANOVA on the numbers of correct responses
Two other differences in procedure also involved the categories yielded significant main effects of both familiarity and
used in Experiment 3. First, for each sequence, the 8 target objects modality in Experiment 3. As in Experiment 1, children
for the study phase were randomly selected from the designated set made more correct responses on the haptic-haptic sequences
of 16 objects as in Experiments 1 and 2 but with the added (M = 13.8, SD = 1.0) than on the haptic-visual sequences
constraint that there were always either 3 or 4 (depending on (M = 11.9, SD = 1.6), F(l, 15) = 15.1, MSB = 3.7, p <
whether the out-of-category items were selected as targets) mem-
bers of each of the set's two categories included among the target
.005. They also made more correct responses with unfamil-
items. Second, during the test phase, the target and distractor items iar objects (M = 13.4, SD = 1.1) than with familiar objects
were presented in an ABBAABABBAABABBA order as in the (M = 12.2, SD = 1.2), F(l, 15) = 13.8, MSB = 1.6, p <
prior experiments but with the added constraint that no more than 3 .005; note that this effect is the converse of the familiarity
items from any one category (balls, shoes, etc.) were presented effects observed in Experiments 1 and 2. Also in contrast to
consecutively. Finally, the experimental sessions in Experiment 3 the earlier studies, there was no familiarity by modality
were all videotaped, with a camera positioned on the experiment- interaction in Experiment 3; children made more correct
er's side of the table and aimed into the box. The children's responses with unfamiliar than with familiar objects on both
spontaneous verbalizations as they performed the task and their types of sequences, and they made more correct responses
"old" or "new" responses were later scored from the video on the haptic-haptic than on the haptic-visual sequence with
records. both kinds of objects. Planned paired comparisons indicated
that on the haptic-haptic sequences, the number of correct
Results responses with unfamiliar objects (M = 14.4, SD = 1.3)
Preliminary analyses on the numbers of correct responses was higher than with familiar objects (M = 13.1, SD = 1.5),
on each study-test sequence revealed no consistent or two-tailed t(\5) = 2.4, p < .05. Likewise on the haptic-
meaningful effects of order or sex, so the data were visual sequences, the number of correct responses with
collapsed across these factors in all further analyses. The unfamiliar objects (M = 12.4, SD = 1.8) was higher than
mean number of correct responses on each type of study-test with familiar objects (M=11.3, SD = 2.0), two-tailed
sequence is shown in Figure 3. As in Experiments 1 and 2, ?(15) = 2.3, p < .05. Similar paired comparisons also
performance was well above chance for every type of indicated that with familiar objects, the number of correct
sequence, although performance on the familiar sequences responses on the haptic-haptic sequence was higher than on
the haptic-visual sequence, two-tailed f(15) = 2.8, p < .05,
and the same was true with unfamiliar objects, two-tailed
(maximum) 1§ -,
The pattern of results for individual children was gener-
15 -
ally consistent with that described for the group means.
14 - Considering all four types of sequences together, 8 of the 16
participants made more correct responses on the haptic-
1 "1
J_
haptic sequence with unfamiliar objects than they made on
O 12 -
any other sequence, and 3 others tied their best performance
on the haptic-haptic sequence with unfamiliar objects.
Conversely, 7 participants made fewer correct responses on
the haptic-visual sequence with familiar objects than on any
3
Despite this additional instructional procedure, it was clearly
more difficult for children to understand the task in Experiment 3
than in Experiments 1 and 2. This fact was evident from the larger
H-H H-V H-H H-V number of children who exhibited extreme response biases, such as
calling 15 or 16 of the 16 test items "old" (see the separate
Familiar Objects Unfamiliar Objects Participant sections for the three experiments). Children who
(within categories) (within categories) exhibited these extreme response biases were not included in the
final sample in any of the studies, and children who responded
Figure 3. A bar graph showing the mean number of correct randomly to the straightforward out-of-category items in Experi-
responses for each type of study-test sequence with each kind of ment 3 were also not included to ensure that the data analyzed and
object in Experiment 3. Error bars indicate standard errors. H-H = discussed came only from children who evidently understood the
haptic-haptic; H-V = haptic-visual. task.
1876 BUSHNELL AND BAXT

other sequence, and 4 others tied their worst performance on interest between vision and touch, in which the properties of
the haptic-visual sequence with familiar objects. an object that are salient and therefore encoded during haptic
Finally, the spontaneous verbalizations children made as exploration are not necessarily the same as the properties
they explored objects during the study phase were exam- that are salient during visual exploration.
ined. These verbalizations were transcribed from the video In contrast to the very similar results with unfamiliar
records, and each child's comments for each study item were objects, the results for Experiment 3 with familiar objects
first categorized as either containing identifying information are strikingly different from those for Experiment 1 (again
(e.g., "a shoe" or "this one's heavy") or not containing any compare Figures 1 and 3). Whereas in Experiment 1 both
such information (e.g., the child said nothing or said haptic and cross-modal recognition with familiar objects
something vacuous such as, "I think I know this one now"). were almost at ceiling, in Experiment 3 neither was near
The children, of course, had been told that they did not need ceiling and cross-modal recognition was clearly worse than
to identify or say anything at all about the objects, and haptic recognition. Furthermore, whereas in Experiment 1
accordingly, 6 of them almost never did so; each of these cross-modal recognition was better with familiar than with
silent participants provided identifying information for a unfamiliar objects, in Experiment 3 cross-modal recognition
study item on fewer than 10% of the 32 opportunities across was worse with familiar than with unfamiliar objects. Haptic
the four sequences. The remaining 10 participants were recognition was also worse with familiar than with unfamil-
more verbose, providing identifying information for at least iar objects in Experiment 3, whereas in Experiment 1 haptic
25% of the study items and in most cases doing so for
recognition was near ceiling with both types of objects.
virtually every one. The comments of these 10 participants
It is possible that performance was relatively poor with
who seemed to think out loud were taken as a reflection of
how children might tend to encode the stimulus objects, and the familiar objects in Experiment 3 because of the physical
their verbalizations were further analyzed. Comments con- nature of the stimuli. Because the items in each set were
taining identifying information were further categorized as members of just two basic-level categories, they were
including only a basic-level label (e.g., "it's a shoe" or "it undoubtedly more similar to one another than were the
feels like a stick") or as including additional qualification familiar objects in Experiment 1, and they may also have
either perceptually (e.g., "a squishy ball" or "a long piece of been more similar to one another than were the unfamiliar
glass") or with labeling at the subcategory level (e.g., "a objects in Experiment 3. Thus children may have been
tennis ball" or "a drum stick"). The verbose participants unable to perceptually discriminate the familiar objects in
qualified an average of 3.4 study items out of the 8 presented Experiment 3 and hence made more recognition errors with
in each sequence for both familiar and unfamiliar objects; them than with the objects in the unfamiliar condition or the
however, they provided more perceptual qualifications with objects in Experiment 1. This possibility seems unlikely,
unfamiliar objects (M = 2.9, SD = 1.8) than with familiar however. Although the familiar objects within each set in
objects (M = 2.1, S£> = 1.3), one-tailed r(9) = 1.9,/> < .05, Experiment 3 did share category membership, they were
and they provided more labeling at the subcategory level nevertheless grossly different in size, weight, texture, com-
with familiar objects (M = 1.3, SD = 0.8) than with unfamil- pliance, and so forth (see Appendix B). Furthermore, the
iar objects (M = 0.4, SD = 0.7), one-tailed t(9) = 2.5, p < unfamiliar objects in Experiment 3 were also relatively more
.05. Furthermore, they identified more study items with only similar to one another than in Experiment 1, and yet
a basic-level label on sequences with familiar objects performance with them was not compromised.
(M = 3.6, SD = 2.0) than on sequences with unfamiliar We think it is more likely that conceptual confusions
objects (M = 2.3, SD = 1.8), two-tailed t(9) = 2.9, p < .05. rather than perceptual ones ensued with the familiar objects
in Experiment 3. When children revealed the nature of their
encoding by verbalizing during the study phase, they
Discussion identified nearly half of the familiar objects with just a
The results for Experiment 3 with unfamiliar objects are basic-level label, with no further qualification (e.g., "a
nearly identical to those for Experiment 1 (compare Figures ball"). Such encoding would not reliably distinguish target
1 and 3). First, performance on the haptic-haptic sequence items from distractors during the test phase because the
with unfamiliar objects was excellent. This result reinforces distractors included other members of the same categories
the conclusion from Experiment 1 that children's haptic (i.e., other balls), and the resultant false recognitions caused
abilities with multidimensional objects are very good. The by overlapping conceptual identifications could account for
haptic expertise demonstrated in Experiment 3 is perhaps all the relatively poor performance with familiar objects in
the more impressive because the objects were somewhat Experiment 3. There was less potential for this same kind of
more perceptually similar than in Experiment 1 because they error with the unfamiliar objects because children less
were grouped on the basis of a shared feature. Second, frequently identified them with just a basic-level label and
performance on the haptic-visual sequence with unfamiliar no further qualification; this may be why performance with
objects was significantly less accurate than on the haptic- unfamiliar objects was superior to that with familiar objects.
haptic sequence. This result reinforces the earlier conclusion In addition, it is possible that precisely because the unfamil-
that cross-modal recognition is not merely constrained by iar objects could not be readily identified as instances of
imprecise haptic abilities. We have argued that this drop-off conventional categories, children explored them more thor-
in performance across modes may be due to a conflict of oughly in the study phase than they explored familiar objects
CHILDREN'S HAPTIC AND CROSS-MODAL RECOGNITION 1877

and thus had more elaborate perceptual representations of for the even poorer cross-modal performance in these
them in memory to support later recognition. instances. Instead, the deficit in cross-modal processing may
The verbalizations during the study phase also showed occur precisely because the representations formed from
that children sometimes did go beyond identifying familiar handling objects highlight different properties from those
objects at just the basic level, to identify them either at the that are salient to vision. As illustrated in the discussion
subcategory level (e.g., as a "tennis ball") or with reference regarding Experiment 2, if one representation encodes a
to their perceptual properties (e.g., a "squishy ball"). Each property about which there is little or no information
of these types of encoding could distinguish target items available in another, then there is the potential for error or
from distractors even if they were members of the same false recognition to occur. The failure is not to be attributed
basic-level categories. The fact that children at least some- to one modality or the other, but rather to how they fail to
times used these more precise encodings may be why their interact.
recognition with familiar objects was at least partially A third conclusion from the work reported here is that
successful (i.e., above chance), whereas the fact that they did cross-modal recognition may be accomplished in a different
not use them more often may be why it was not as successful way with familiar as compared with unfamiliar objects. This
as with unfamiliar objects. However, identifying the familiar interpretation is suggested by the fact that performance on
objects with reference to their perceptual properties would the cross-modal sequences with familiar objects differed
be subject to the same conflict-of-interest problem across from that with unfamiliar objects in all three studies and by
modes that has been discussed for the case of unfamiliar the fact that the manipulation involving categories in
objects. Thus the fact that children sometimes relied on Experiment 3 seemed to impair cross-modal recognition
perceptual characteristics to distinguish items from the same with familiar but not with unfamiliar objects. We have
conceptual category might account for why cross-modal surmised that cross-modal recognition with unfamiliar ob-
recognition was less accurate than within-mode recognition jects involves an implicit comparison of haptic and visual
with familiar as well as with unfamiliar objects in Experi- perceptual representations; this process is subject to the
ment 3. conflict-of-interest problem outlined earlier. In contrast,
cross-modal recognition with familiar objects seems to
General Discussion frequently involve the activation of a prototype or concept in
long-term memory; this generalized representation, rather
The research reported here supports several new conclu- than the specific perceptual experience that evoked it, may
sions about children's haptic and cross-modal abilities. First, then serve as the basis for later recognition. These proposed
as has already been emphasized, young children's haptic processes are consistent with the distinct patterns of results
abilities with multidimensional objects are excellent. In across Experiments 1 and 3, and they are also supported by
Experiments 1 and 3, from brief exposures handling even the analysis of children's spontaneous verbalizations in
unfamiliar objects, 5-year-olds were able to form perceptual Experiment 3; as they explored familiar objects, children
representations that were sufficiently vivid, distinct, and were most likely to identify them with a basic-level category
long-lasting to permit highly accurate subsequent recogni- label, whereas with unfamiliar objects, they were most likely
tion of the objects and discrimination of them from distrac- to comment on their perceptual characteristics.
tors. Thus, previous conclusions that children cannot ad- Other researchers have also suggested the existence of
equately encode or retain information acquired through different processes for cross-modal recognition with familiar
touch must be qualified and understood to pertain only to and unfamiliar objects. Streicher and Ettlinger (1987) found
performance with somewhat unnatural objects that vary that cross-modal recognition with unfamiliar objects was
exclusively in shape or three-dimensional structure. Chil- impaired after ablations of polysensory neocortex in the
dren's superior performance here with objects varying monkey, whereas cross-modal recognition with familiar
multidimensionally furthermore establishes that perceptual objects was not affected. They concluded that the ablated
representations formed from handling objects are not simply areas may be essential for "forming" new representations as
derived visual images but instead are rich complexes that is required with unfamiliar objects but not for "refreshing"
contain information uniquely salient to haptics, such as (accessing) previously formed representations that might be
information regarding an object's texture, compliance, used with familiar ones. Johnson et al. (1989) found that
weight, and temperature. measures of visuospatial ability predicted cross-modal per-
The nature of representations formed through touch also formance best for children instructed to "picture" (image)
relates to a second conclusion that is clear from our findings, stimulus shapes while they felt them, whereas measures of
namely that children's cross-modal abilities are not simply verbal ability predicted performance best for children in-
constrained by haptic abilities that are poor relative to visual structed to "give the shapes a name." They interpreted these
abilities, as has sometimes been suggested. In Experiments 1 results as support for a "dual coding" approach to cross-
and 2, both haptic and visual recognition were more accurate modal recognition, suggesting that recognition can be based
than cross-modal recognition with the same unfamiliar either on a visual imagery strategy usually elicited by
objects; in Experiment 3, haptic recognition was more amorphous unfamiliar shapes or on a verbal naming strategy
accurate than cross-modal recognition with familiar as well usually elicited by familiar ones. These dual strategies are
as with unfamiliar objects. Obviously, poor haptic abilities similar to the two processes described here; however, we
cannot be held responsible (neither can poor visual abilities) construe each of the processes somewhat more broadly. We
1878 BUSHNELL AND BAXT

maintain that the perceptually based process involves repre- Bushnell, E. W. (1982). Visual-tactual knowledge in 8-, 9'/2-, and
sentations that are truly haptic and not just derived from 11-month-old infants. Infant Behavior and Development, 5,
visual imagery; such haptic representations are called for by 63-75.
our observation that haptic recognition is superior to cross- Bushnell, E. W. (1986). The basis of infant visual-tactual function-
modal recognition. We also maintain that the conceptually ing—Amodal dimensions or multimodal compounds? In L. P.
Lipsitt & C. K. Rovee-Collier (Eds.), Advances in infancy
based process involves a generalized representation from research (Vol. 4, pp. 182-194). Norwood, NJ: Ablex.
memory that may or may not include a specific verbal label; Bushnell, E. W. (1994). A dual-processing approach to cross-modal
this caveat is important because the conceptually based matching: Implications for development. In D. J. Lewkowicz &
process may very well function in preverbal infants (cf. R. Lickliter (Eds.), The development of intersensory perception:
Bushnell, 1986) and in infrahuman species (cf. Streicher & Comparative perspectives (pp. 19-38). Hillsdale, NJ: Erlbaum.
Ettlinger, 1987) as well as in individuals with language. The Bushnell, E. W., & Weinberger, N. (1987). Infants' detection of
two processes as we conceive them are outlined and visual-tactual discrepancies: Asymmetries that indicate a direc-
compared in detail in a recent theoretically motivated paper tive role of visual information. Journal of Experimental Psychol-
(Bushnell, 1994). ogy: Human Perception and Performance, 13, 601-608.
Regardless of the exact forms of the two processes for Cooper, L. A. (1976). Individual differences in visual comparison
processes. Perception & Psychophysics, 19, 433^144.
cross-modal recognition, a key point is that they are distinct
Cooper, L. A. (1980). Recent themes in visual information process-
alternatives that are nevertheless both available to the ing: A selected overview. In R. Nickerson (Ed.), Attention and
perceiving individual. Such dual processes have been identi- performance V7//(pp. 319-345). Hillsdale, NJ: Erlbaum.
fied for other perceptual and cognitive abilities as well (cf. Goodnow, J. J. (1971). The role of modalities in perceptual and
Bamber, 1969; Cooper, 1976, 1980; Logan, 1988; Smith, cognitive development. In J. Hill (Ed.), Minnesota Symposium in
1981). In these cases, and likewise in the case of the two Child Psychology (Vol. 5, pp. 3-28). Minneapolis: University of
processes for cross-modal recognition, the two alternatives Minnesota Press.
have distinct advantages and disadvantages with respect to Johnson, C. J., Paivio, A. U., & Clark, J. M. (1989). Spatial and
one another. They may be affected by different variables and verbal abilities in children's crossmodal recognition: A dual
susceptible to different kinds of error, as we have observed coding approach. Canadian Journal of Psychology, 43, 397-
here with respect to cross-modal recognition with familiar 412.
Jones, B., & Robinson, T. (1973). Sensory integration in normal
and unfamiliar objects. Finally, where alternative strategies
and retarded children. Developmental Psychology, 9, 178-182.
are available for an ability, the two processes may follow Klatzky, R. L., Lederman, S. J., & Metzger, V. A. (1985).
different courses of development; in addition, development Identifying objects by touch: An "expert system." Perception &
may involve an element of learning when (in what contexts) Psychophysics, 37, 299-302.
to rely on which process (cf. Siegler, 1996). It might be Klatzky, R. L., Lederman, S. J., & Reed, C. (1987). There's more to
useful to consider these complexities in future research on touch than meets the eye: The salience of object attributes for
children's cross-modal abilities. haptics with and without vision. Journal of Experimental
Psychology: General, 116, 356-369.
Klatzky, R. L., Lederman, S. J., & Reed, C. (1989). Haptic
References integration of object properties: Texture, hardness, and planar
contour. Journal of Experimental Psychology: Human Percep-
Abravanel, E. (1972). Short-term memory for shape information tion and Performance, 15, 45-57.
processed intra- and intermodally at three ages. Perceptual and Lederman, S. J., & Klatzky, R. L. (1987). Hand movements: A
Motor Skills, 35, 419-425. window into haptic object recognition. Cognitive Psychology,
Bamber, D. (1969). Reaction times and error rates for "same- 19, 342-368.
different" judgments of multidimensional stimuli. Perception & Locke, J. (1959). An essay concerning human understanding. New
Psychophysics, 6, 169-174. York: Dover. (Original work published 1690)
Berkeley, G. (1948). An essay towards a new theory of vision. In Logan, G. D. (1988). Toward an instance theory of automatization.
A. A. Luce & T. E. Jessup (Eds.), The works of George Berkeley, Psychological Review, 95, 492-527.
Bishop of Cloyne (Vol. 1, pp. 159-239). New York: Nelson. Milner, A. D., & Bryant, P. E. (1968). Cross-modal matching by
(Original work published 1709) young children. Journal of Comparative and Physiological
Bigelow, A. E. (1981). Children's tactile identification of miniatur- Psychology, 71, 453^58.
ized common objects. Developmental Psychology, 17, 111-114. Morrongiello, B. A., Humphrey, G. K., Timney, B., Choi, J., &
Brown, A. L., & Campione, J. C. (1972). Recognition memory for Rocca, P. T. (1994). Tactual object exploration and recognition in
perceptually similar pictures in preschool children. Journal of blind and sighted children. Perception, 23, 833-848.
Experimental Psychology, 95, 55-62. Perlmutter, M., & Myers, N. A. (1974). Recognition memory
Brown, A. L., & Scott, M. S. (1971). Recognition memory for development in two- to four-year-olds. Developmental Psychol-
pictures in preschool children. Journal of Experimental Child ogy, 10, 447-450.
Psychology, 11, 401-412. Rose, S. A., Blank, M. S., & Bridger, W. H. (1972). Intermodal and
Bryant, P. E., Jones, P., Claxton, V., & Perkins, G. M. (1972). intramodal retention of visual and tactual information in young
Recognition of shapes across modalities by infants. Nature, 240, children. Developmental Psychology, 6, 482^-86.
303-304. Rose, S. A., Gottfried, A. W., & Bridger, W. H. (1978). Cross-
Bryant, P. E., & Raz, I. (1975). Visual and tactual perception of modal transfer in infants: Relationship to prematurity and
shape by young children. Developmental Psychology, 11, 525- socioeconomic background. Developmental Psychology, 14,
526. 643-652.
CHILDREN'S HAPTIC AND CROSS-MODAL RECOGNITION 1879

Rose, S. A., Gottfried, A. W., & Bridger, W. H. (1981). Cross- Smith, L. B. (1981). Importance of the overall similarity of objects
modal transfer in 6-month-old infants. Developmental Psychol- for adults' and children's classifications. Journal of Experimen-
ogy, 17, 661-669. tal Psychology: Human Perception and Performance, 7, 811-
Rose, S. A., & Wallace, I. F. (1985). Cross-modal and intramodal 824.
transfer as predictors of mental development in full-term and Stoltz-Loike, M., & Bornstein, M. H. (1987). The roles of imagery,
preterm infants. Developmental Psychology, 21, 949-962. language, and metamemory in cross-modal transfer in children.
Rudel, R. G., & Teuber, H. L. (1964). Cross-modal transfer of Psychological Research, 49, 63-68.
shape discrimination by children. Neuropsychologia, 2, 1-18. Streicher, M., & Ettlinger, G. (1987). Cross-modal recognition of
Ruff, H. A., & Kohler, C. J. (1978). Tactual-visual transfer in familiar and unfamiliar objects by the monkey: The effects of
6-month-old infants. Infant Behavior and Development, 1, ablation of polysensory neocortex or of the amygdaloid com-
259-264. plex. Behavioural Brain Research, 23, 95-107.
Siegler, R. S. (1996). Emerging minds: The process of change in Zung, B. J. (1971). Cross-modal matching among normal and
children's thinking. New York: Oxford University Press. retarded children. Child Development, 42, 1614-1618.

Appendix A

Items Included in Each of the Four Sets of Objects Used in Experiments 1 and 2

Set A—Familiar Objects Set C—Unfamiliar Objects


terrycloth washcloth—wet bicycle rear reflector and bracket
She-ra action figure—6 in. (15 cm) tall, hard plastic plastic teether—sphere with 10 knobs
comb—6 in. (15 cm) long "lidded" spool (for wire)—4 in. (10 cm) diameter, metal
roll of toilet paper threaded wooden cylinder and nut—3 in. (8 cm) long
paper cup—medium size flexible plastic scrubber—oblong, with bristles
Little Golden Book plexiglass cylinder—1 in. diameter X 8 in. (3 cm X 20 cm) long
rock—approx. 1.5 in. (4 cm) diameter machine gear—1.5 in. (4 cm) diameter, metal
set of 2 car keys on oval plastic key chain embroidery ring—6 in. (15 cm) diameter, wooden
child's scissors wax candle—3 in. (8 cm) tall with drips down one edge
quarter (25c coin) file folder tab—1.5 in. (4 cm) long, flexible plastic
rubber ball—2 in. (5 cm) diameter paper/cloth cleaning rag—20 in. X 13 in. (51 cm X 33 cm), dry
cereal bowl—6 in. (15 cm) diameter, china rubber knob—from kitchen chair leg
child's running shoe plastic novelty soda straw—with disk near top
apple top of turkey baster—rubber, accordioned bulb
toothbrush—6 in. (15 cm) long serrated plastic strip fastener—5 in. (13 cm) long
squeeze bottle of Elmer's glue—6 in. (15 cm) tall plastic disk with holes—flat, flexible

Set B—Familiar Objects Set D—Unfamiliar Objects

shoelace—40 in. (102 cm) long feather boa—18 in. (46 cm) long
sunglasses wooden disk with hole—4 in. (10 cm) diameter
toy car—3 in. (8 cm) long, metal small magnet with holes—flat, flexible
child's mitten—nylon metal pipe with threaded ends—4 in (10 cm) long
tennis ball "slitted" change purse—flexible plastic
He-man action figure—5 in. (13 cm) tall, hard plastic plastic water-filled stirrer—bulbous end
tablespoon—5 in. (13 cm) long, metal watch display box—triangular, hard plastic
pencil—elementary school size metal caster—2.5 in. (6 cm) tall, moving wheel
bar of soap—bath size small perfume bottle—odd-shaped, plastic
hairbrush—8 in. (20 cm) long leather case (for flash shoe)—3 in. (8 cm) square
nail—2.5 in. (6 cm) long, metal snap-on leg of toy bear—2 in. (5 cm) long, corduroy
piece of bread—toasted round plastic scrubber—3 in. (8 cm) diameter, with bristles
videotape cassette—VMS size rough-textured brillo pad
jar of poster paint—1.5 in. (4 cm) tall, plastic large piece of Plexiglas—flat, irregular-shaped
banana large piece of foam rubber—curlicue-shaped
rubber band computer IO (input-output) connector—2.5 in. X 1.5 in. (6 cm X 4
cm), metal

(Appendixes continue)
1880 BUSHNELL AND BAXT

Appendix B

Items Included in Each of the Four Sets of Objects Used in Experiment 3

Set A—Familiar Objects


Balls
regulation golf ball
regulation tennis ball
regulation baseball
wiffle ball—hard plastic, 3.5 in. (9 cm) diameter
inflated beach ball—6 in. (15 cm) diameter, very light
toy basketball—2 in. (5 cm) diameter, nubbled, squishy
toy football—5 in. (13 cm) long, smooth with spiral grooves

Shoes
little girl's "Mary Jane"—patent leather
woman's dress shoe—leather, 1 in. (3 cm) heel, tassel
boy's school shoe—leather, rubber sole, laces
toy high heel—hard plastic, 3 in. (8 cm) long
child's Nike running shoe—textured nylon
infant's soft cloth shoe—4 in. (10 cm) long, laces
child's Weebok hiking boot—lugged sole, laces

Out-of-Category Items
child's mitten—nylon
squeeze bottle of Elmer's glue—3 in. (8 cm) tall

Set B—Familiar Objects


Spoons
mixing spoon—11.5 in. (29 cm) long, wooden
l
/i tsp. measuring spoon—3 in. (8 cm) long, plastic
baby spoon—5 in. (13 cm) long, metal, rubber-coated bowl
Chinese soup spoon—ceramic, wide shallow bowl
serving spoon—8 in. (20 cm) long, heavy metal, fluted handle
picnic dinner spoon—6 in. (15 cm) long, plastic
draining spoon—11 in. (28 cm) long, textured grip, slotted bowl

Toy Cars
"50s" car—wide, 8 in. (20 cm) long, plastic, with fins
convertible roadster—thin, 5 in. (13 cm) long, wooden
rounded racing buggy—2.5 in. (6 cm) long, molded plastic
crayon car—2 in. (5 cm) long, wax, no moving parts
van or caboose—3 in. (8 cm) long, wooden, square-cut
Matchbox sports car—3 in. (8 cm) long, heavy metal
hatchback sedan—4 in. (10 cm) long, molded plastic

Out-of-Category Items
hairbrush—8.5 in. (22 cm) long, plastic handle
He-man action figure—5 in. (13 cm) tall, hard plastic
CHILDREN'S HAPTIC AND CROSS-MODAL RECOGNITION 1881
Set C—Unfamiliar Objects
Disk-Shaped Objects
"lidded" spool (for wire)—4 in. (10 cm) diameter, metal
circle of corrugated wax paper—6 in. (15 cm) diameter
cat food can (full)—3 in. (8 cm) diameter, metal, heavy
wooden donut—4 in. (10 cm) diameter, 0.75 in. (2 cm) thick
"slitted" change purse—flexible plastic, flat
rubber sink strainer—5 in. (13 cm) diameter, flexible
dish scrubber—spherical, "chain mail" plastic

Objects With an Opening or Cavity


top of turkey baster—rubber, accordioned bulb
plasterer's face mask—stiff paper with elastic strap
ceramic pear—hollowed out to hold soap, 5 in. (13 cm) long
cardboard tubing—3 in. (8 cm) long, triangle cross-section
rubber knob—from kitchen chair leg, 2 in. (5 cm) long
Dr. Scholl's toe protector—soft foam, 1.5 in. (4 cm) long
Y-shaped hose connector—plastic, threaded ends

Out-of-Category Items
computer IO (input-output) connector—2.5 in. X 1.5 in. (6 cm X 4 cm), metal
snap-on leg of toy bear—2 in. (5 cm) long, corduroy

Set D—Unfamiliar Objects


Rods or Cylinders With a Distinctive End
water-filled stirrer—soft plastic, bulbous end
Plexiglas rod—7 in. long X 0.5 in. (18 cm X 1 cm) diameter
wooden block—cylindrical, 5 in. long X 1.5 in. (13 cm X 4 cm) diameter
plastic novelty soda straw—with disk near top
stiff spring—12 in. (30 cm) long, heavy metal, fluted end
"loofah" body scrubber—5 in. long X 3 in. (13 cm X 8 cm) diameter
yard light stake—11 in. (28 cm) long, plastic, threaded end

Objects With Movable Parts


bicycle rear reflector and bracket (swivels)
plastic school protractor with pivoting arm
6 in. (15 cm) size C-clamp—metal, very heavy
threaded dowel and square nut—wooden, 3 in. (8 cm) long
novelty necklace—plastic sections twist and swivel
brass hinge—.75 in. X 1.5 in. (2 cm X 4 cm) "arms"
wire-and-spring device for hanging decorative plates

Out-of-Category Items
large piece of foam rubber—curlicue-shaped
plastic teether—sphere with 10 knobs

Received August 25, 1997


Revision received August 17, 1998
Accepted December 28,1998

You might also like