Professional Documents
Culture Documents
1. BACKGROUND
2. O UR PERSPECTIVE ON INTERVIEWS
What beliefs and understandings influence secondary school mathematics teachers as they
learn to develop and interpret task-based interviews as tools for assessing student under-
standings and acts of understandings of mathematics within an innovative technology-
intensive algebra course?
3. M ETHODOLOGY
TABLE I
Teaching and mathematics backgrounds of Sara, LeAnne, and Bill
TABLE IIa
Interviewing experiences and nature of data for Summer I experiences
CIME staff conducted individual task-based Tapes1 & tran- Sara, LeAnne,
and/or scenario interviews with cohort mem- scripts Bill
bers.
CIME senior staff conducted class session on Videotapes1 & Sara, LeAnne,
interviews. transcripts Bill
Cohort members read interview schedule,
viewed and discussed CIA student inter-
views conducted by CIME senior staff.
Cohort member groups conducted practice task- Tapes2 & tran- Sara, LeAnne,
based interviews with each other. CIME senior scripts Bill
staff provided the tasks.
Interviewer, interviewee, and observers
analyzed and discussed the practice inter-
views.
CIME senior staff conducted second class ses- Tapes1 & tran- Sara, LeAnne,
sion on interviews. scripts Bill
Cohort members discussed their experi-
ence in conducting and participating in
interviews.
Cohort member groups planned, conducted, Tapes2 & tran- Sara, LeAnne,
analyzed, and discussed task-based interviews scripts, Bill
they conducted with CIA students. summaries,
interview
schedules
Cohort member groups discussed with CIME Tapes1 & tran- Sara, LeAnne,
senior staff member their conduct and analysis scripts, Bill
of task-based interviews they conducted with newsprint
CIA students. summaries
of discussion
points
CIME staff conducted individual task-based Tapes1 & tran- Sara, LeAnne
and scenario interviews with targeted parti- scripts
cipants.
CIME staff visited the classrooms of three Tapes1 & tran- Sara, LeAnne
participants on four to five multi-day visita- scripts
tions. CIME staff conducted pre-observation
and post-observation interviews.
CIME staff conducted individual task-based Tapes1 & tran- Sara, LeAnne
and scenario interviews with targeted parti- scripts
cipants.
TABLE IIc
Interviewing experiences and nature of data for Summer II experiences
Cohort member groups listened to and reana- Tapes2 & tran- Sara, LeAnne,
lyzed Summer I CIA interviews conducted by scripts Bill
members of their group.
Cohort member groups planned, conducted, Tapes2 & tran- Sara, LeAnne,
analyzed, and discussed new CIA task-based scripts Bill
interviews.
CIME staff conducted individual task-based, Tapes1 & tran- Sara, LeAnne
scenario, and documentation interviews with scripts
targeted participants.
4. A NALYSIS
Figure 1. Statements of problem situations used by Sara’s and LeAnne’s group in their
interviews with CIA students during Summer I.
the words students were using without attending to the mathematical ideas
embodied either in the talk around those words or in talk that did not
include the key phrases. LeAnne’s perception of mathematical ideas that
were important for students also included a distinction between justific-
ation and formal proof. To LeAnne, justifying meant supplying standard
reasons why mathematical claims were true. For example, while analyzing
interviews assessing a different topic, LeAnne consistently noted whether
students correctly identified a function as non-linear specifically because
of its non-constant rate of change.
What teachers believed was important about the CIA curriculum also
influenced the content of their interviews. LeAnne’s view of CIA mathem-
atics stressed alternative strategies and multiple representations. Her own
work and the lessons she conducted for her students included functions ex-
pressed through tables, graphs, and situations as well as in symbolic forms.
Her students studied patterns in graphs and tables. She interviewed stu-
dents to determine whether they could use these different representations
to answer real-world questions and to discuss families of functions.
LeAnne regularly encouraged students in all of her classes to use appro-
priate terminology, to solve problems with various strategies and multiple
representations, and to justify their responses with common explanations.
These clear priorities dictated her choice of interview tasks, her analysis of
interview transcripts, and her decisions about when and what to probe.
minimal set of CIA computer skills. Although there were plenty of untaken
opportunities for the student interviewees to explore families of functions
using computer tools, Sara did not note or wonder aloud about this lack of
computer use.
Having taught for a long time in a small school in a very stable community,
Sara knew her students well. She had taught many of them several times,
and even for those students she was teaching for the first time, she had
Her interviews, like her exams and quizzes, consisted of items that closely
paralleled those in the CIA textbook. Her probing encouraged students to
remember what they had been taught.
Sara believed (and acted on the belief) that one can know mathematics
in a variety of different well-defined ways, and Sara’s summer interviews
with CIA students focused on bringing to the fore these predetermined
facets of a student’s mathematical knowledge. During these interviews,
she seemed to be trying to determine whether her interviewees’ concept
images had all of the features of her own. Sara’s picture of understanding
included seeing patterns, using notation, finding answers, verifying an-
swers, and relating concepts. Sara made fine distinctions in describing the
ways in which interviewees performed assigned tasks. She differentiated
the seemingly procedural and conceptual approaches she saw in two inter-
viewees working on the same problem. In light of Sara’s fairly robust view
of what it meant to know something, the way that she assessed that under-
standing was somewhat surprising. Frequently, she acted on the apparent
belief that knowing something meant being able to remember it, and so her
leading questions were acceptable. When she was communicating with a
student, especially an interviewee, Sara was more likely to urge the student
to try to remember an answer than to urge him or her to figure it out. In her
discussion with the other teachers in her group about what Wanda was not
able to do during the interview, Sara suggested that she would have liked
to have given Wanda the function rule (see Figure 1, Situation 3.), saying:
I’m also thinking about what I might have been able to do . . . I’m thinking maybe there’s
some things here that I could have done that would have helped her. . . . [I would have liked
to have given her the function rule] because I think she would have recognized that.
What seemed to matter to Sara was that Wanda would, after prompting,
recognize a particular relationship, not that she would be able to recon-
struct that relationship on her own. Like many other times in class and in
interviews, Sara seemed to operate from the assumption that if she could
give the student enough clues, the student would remember things she had
learned in the past but had forgotten. Sometimes this took the form of
seeming to want to ‘resituate’ the student in the environment in which the
past learning had occurred. Often, she urged students to remember what
they had learned by first recalling when they had learned it. Consistent
with her view of knowing as remembering, Sara referred to forgetting
when a student did not seem able to give an answer–even when she had
no evidence that the student ever knew the information.
4.4.2. Teachers expected that students would not know mathematics which
they were not explicitly taught. A dominant feature of learning, from all
three teachers’ perspectives, was that students could not generally have
been expected to know something unless they were explicitly taught it.
From LeAnne’s perspective, learning mathematics required explicit ex-
posure to the mathematics. However, a student may have awareness but
not know an idea from just one exposure. LeAnne countered this problem
with ‘re-teaching’: ‘when I re-teach, they say, ‘Oh, I’ve had that,’ and it
takes a little refresher’ (Documentation, LeAnne, Summer II, lines 525–
526). As the teacher, LeAnne saw her responsibility clearly: ‘I have to
supply them with . . . knowledge to be able to do [mathematics]’ (Docu-
mentation, LeAnne, Summer II, lines 515–516). Classroom activities often
combined explorations from the CIA materials with LeAnne’s carefully
prepared directions about what keys or commands to use. In this way, she
was ‘supplying’ the exposure students needed. When this simple exposure
was not enough, LeAnne would question students until they arrived at her
correct answers.
To Bill, both exposure and repetition were essential. In the following
quote Bill emphasizes the importance of frequent repetition, either of the
vocabulary or of the underlying idea, in class.
I knew that that was an important concept. So even right at the beginning of the year, I was
saying rate of change, rate of change, rate of, just repeating the idea, over and over, every
time we were talking about something and that was so that they would just be familiar with
Sara thought that the way to show knowledge was to remember it and
that knowing something required that it be taught explicitly. Sara’s inter-
views did not focus on a narrow set of skills, however, since Sara believed
that one could understand mathematics in a variety of different ways and
that someone could perform a skill without understanding related concepts.
Sara’s interviews contained a modicum of focusing questions (some aimed
at ‘resituating’ the student) since Sara assumed that knowing something
meant being able to produce it under probing conditions.
LeAnne valued interviews as an assessment tool that yielded inform-
ation about what students know that was different from that which her
exams and quizzes provided. Interviews allowed her to ‘draw out’ what
students knew when they did not offer it immediately. In LeAnne’s opin-
ion, there was a danger, however, that one could be too leading in trying
to see what students knew. In her interviews as in her classroom, good
questions did not tell students the answers but did help students remem-
ber mathematics to which they had been exposed. For example, when an
interviewee answered a real-world-situation question using computations
without first constructing a function model (as LeAnne’s group intended),
LeAnne redirected the student by asking, ‘Could you set up a rule?’ When
the student did not produce a rule, LeAnne focused the student further by
pointing to his series of similar computations which could be generalized
to a rule and asking, ‘What are you doing every time?’ (Student Interview,
LeAnne with Chuck, Summer I, lines 226–234). LeAnne’s curriculum in-
cluded a strategy of setting up function rules before answering questions
about the situation. In this interview, she was testing whether the student
could do this. When the student did not set up the rule, she redirected his
efforts by asking whether he could set up the rule. When the student did
not write the rule, LeAnne focused his attention on the common operation
(multiplication). In this way, she redirected and then focused the student’s
work, rather than eliciting and following the student’s thinking about the
task.
For Bill, the interviews, for the most part, seemed to be ‘check lists’ of
things the interviewees could perform without much probing into what
prompted them. They were checklists of things the interviewer wished
to see the interviewee perform, rather than an attempt to find out what
the interviewee understood. He noted that in two interviews ‘we were
able to get all the information we wanted. Not necessarily in the order
that we wanted...’ (Group Analysis of Student Interviews, Alex/Bill/Jayne,
Summer I, lines 525–529).
When he interviewed a CIA student with his ‘check list’ in mind, Bill
often did not focus on understanding. The first task of the interview sched-
ule designed by his group in Summer I asked the student to graph a quad-
ratic function on the computer and discuss the graph’s characteristics. The
interview schedule indicated that the student should be questioned about
the characteristics of a quadratic at this juncture, but Bill’s ‘check-list’
approach did not lend itself to checking the depth or breadth of student un-
derstanding. The student eventually got the graph of a quadratic function to
appear (without an on-screen vertex) and she concluded that the graph was
that of a quadratic. As scripted, he followed her statement that the graph
was quadratic by asking the interviewee how she would know ‘for sure’
that it was a quadratic, and the student then began to work on changing the
graphing window so the vertex was visible. Although Bill could have asked
the student to explain what her action told her about knowing whether the
graph was that of a quadratic, he did not do so. He probed no further.
Bill’s ‘check-list’ view of interviews suggested observable, but connec-
ted, tasks to be done in some (perhaps variable) order by the interviewee.
Since students needed to complete each of the subtasks, if a student did
not do so, Bill was puzzled about how to proceed. Since Bill’s interviews
focused more on knowing how to do than on understanding, if the student
could not do something the interview took longer because the interviewer
had to ensure that the student progressed through each of the subtasks to
facilitate completion of the subsequent subtasks of the ‘check list.’ How-
ever, for students who knew how to complete the subtasks, the interview
ended early.
Bill: . . . you need to ask questions so that the um, no, lengthy amount of time, and I would
say probably fifteen seconds or something like that. You’d probably be asking a
question every fifteen seconds or somewhere in that time period. Just because . . .
Jayne: Whether or not it’s necessary?
Bill: Right. Right. And, but most of the time it would be. Just because, if I’m talking I’m
going to say things, and it’s, the point is not that you understood what I was doing,
that has nothing to do with it either. The point is, why did I say that? That’s really
what’s at issue.
(Analysis of Practice Interview, Alex with Bill, Summer I, lines 201–210)
Bill’s emphasis here was not on what he thought made sense but rather on
guessing the correct procedure for conducting an interview.
It is not surprising that her interview probing follows the funneling pattern
of her classroom questioning. Her actions seemed to be based on her oblig-
ation to teach and her tendency to algorithmitize instruction, as described
by Steinbring (1989). She wanted to hear and reinforced these anticipated
responses and ideas with an enthusiastic ‘good’ or ‘okay.’ As a result, she
seemingly missed probing opportunities, as in the jumbled exchange with
Chuck in the section on interview as a way to measure against a standard.
In short, not only did LeAnne describe and use interviews as an opportun-
ity to determine how well students really knew the curriculum content, but
she also used them to ‘reteach’ students who could not remember and to
help students ‘discover’ what they did not clearly know.
5. S UMMARY
The stories of these three teachers reveal the ways in which a teacher’s
relationship to mathematics, curriculum, technology, students, teaching,
and especially learning and knowing mathematics influence her or his use
of interviews as tools to understand student understanding. Each of these
three teachers looked through a different lens as she or he learned to use
interviews as a tool for understanding student understanding. Their lenses
defined what they saw as the mathematical knowledge they could and
should access through interviews. Sara’s lens was her set of concept images
for the mathematical understandings she was assessing. LeAnne’s lens was
the mathematics curriculum that was the goal of her instruction. Bill’s
lens was the set of skills students should be able to perform. The lenses
defined how they saw interviews and how they viewed the understandings
that emerged through those interviews.
These teachers’ views of learning and knowing mathematics seemed to
have had an important impact on their approaches to interviewing. None
of the teachers spoke or acted as if they believed that an individual’s know-
ledge was the unique product of his or her personal interactions with ex-
periences and ideas. Each teacher seemed to believe that exposure to math-
ematics was a prerequisite to learning it and that the resulting knowledge
remained in student memory. There was a difference however in terms of
what the teachers expected students to remember. Sara valued process; she
‘resituated’ students to get them to remember how to solve the problem or
how to relate the ideas. LeAnne valued outcome; she used questioning to
draw those outcomes from students’ memories. Bill valued students having
the right way to do something; he did not need to draw out information
from students or resituate students since he believed that they either knew
or did not know the targeted skill. Each teacher planned and used inter-
views to test whether students knew what they had been taught. What was
important to each teacher was not the uniqueness of the individual’s un-
derstanding, but the match between the student’s understanding and some
standard. Once the extent of the match was determined, it made no sense
to dig more deeply into what the student was thinking.
The issue of the use of probing questions in interviews permeated not
only CIME class discussions but also the teachers’ group analyses of their
interviews. Each of the three subjects had participated in classes in which
probing questions were discussed; each had witnessed the use of probing
questions by CIME instructors in sample interviews with CIA students;
and each talked about his or her own and each other’s probing. It seemed
that they not only believed they understood probing but that they care-
fully monitored their own probing and that of their partners. Given that
they were not addressing understanding as the researchers characterized it,
however, the nature of their follow-up questions veered away from prob-
ing for deeper conceptual understanding. Sara asked follow-up questions
when she wanted students to consider a particular feature of a concept.
LeAnne used follow-up questions to draw out particulars when a student’s
response did not include the correct answer. Bill asked follow-up ques-
tions to keep the interview moving along and going smoothly. There was
no evidence that any of the teachers experienced conflict between their
‘probing’ questions and what they thought we expected.
The particular role of technology in a teacher’s interviews seemed in-
fluenced by the relative depths of the teacher’s understandings of math-
ematics and technology as well as by the teacher’s goals for interviews.
For each of the three subjects, understanding was a function of the match
between what a student could do and some fixed set of items. Although
each of the three subjects was knowledgeable about the items required by
her or his individual view of understanding (concept images, curriculum
content, and checklists), using interviews to understand student under-
standing depends on the interviewer having facility with the computing
tools and much richer mathematical understandings than would arise from
knowing only the mathematical skills explicitly taught in the CIA cur-
riculum. Neither LeAnne nor Sara entered the CIME program with an
extensive understanding of the mathematical concepts central to the CIA
curriculum. Developing a deep mathematical understanding was not an
issue for LeAnne since she viewed the only relevant mathematics as the
mathematics in the curriculum she was to teach her students. Her com-
puting skills were adequate for the interviews in that she had been fairly
diligent about practicing CIA computing tasks on her home computer.
Sara entered CIME with almost no computer experience, she did not have
access to the CIA software at home, and she could seldom find time to
work on her computer skills at school. She failed to learn the mathematical
ideas which could have been enhanced through CAS use since she did not
actively seek an understanding of computer results. Sara’s inability to call
up at appropriate times the mathematics she knew and her reluctance to
explore the technology inhibited her development of a rich understanding
of the mathematics that characterized the CIA curriculum. Hers was not
a rich mathematical understanding because it was not always a connected
mathematical understanding.
6. C ONCLUSIONS
expressed by the students. Sara listened for a match with some feature of
her concept image; LeAnne and Bill listened for vocabulary and their pre-
determined lists of reasons or skills, respectively. Bill inventoried students’
use of technology along with their mathematics skills; LeAnne viewed
technology syntax separate from mathematics knowledge. While LeAnne
and Sara seemed to have made progress in using interviews as tools for un-
derstanding student understanding, Bill made the least progress, seeming
to treat the process as a well-defined routine. Perhaps because he viewed
understanding as the ability to perform a fixed set of procedures, he seemed
to view the interview as an oral quiz.
Our work in helping mathematics teachers use interviews to understand
student understanding reveals the importance of learning more about help-
ing teachers to develop more robust and useful understandings of math-
ematics as well as views of mathematical learning and knowing. In the
cases of Sara, LeAnne, and Bill, these understandings and views detracted
from our efforts to help them to understand their students’ understand-
ings through task-based interviews. The CIME project was about helping
teachers to learn about their students’ understandings as well as to un-
derstand CIA mathematics and technology. It was no surprise therefore
that teachers’ emerging views of mathematical knowledge and learning
dominated their use of interviews to understand student understanding.
The unpredicted but understandable stories of teachers learning to do and
use interviews yielded a picture of the complexity of the interaction among
factors that influenced teachers’ understanding of and use of interviews as
tools for understanding student understanding.
N OTES
1 We will refer to the first summer of a cohort’s involvement as Summer I and the
second summer of a cohort’s involvement as Summer II.
ACKNOWLEDGEMENTS
R EFERENCES
Bloedy-Vinner, H.: 1994, ‘The analgebraic mode of thinking–the case of the para-
meter’, Proceedings of the Eighteenth Annual Meeting of the International Group for
the Psychology of Mathematics Education, University of Lisbon, Lisbon, Portugal,
pp. 88–95.
Bowman, A.H., Bright, G.W. and Vacc, N.N.: 1996, ‘Teachers’ assessment of students’
levels of thinking and mathematical understanding’, in E. Jakubowski, D. Watkins and
H. Biske (eds.), Proceedings of the Eighteenth Annual Meeting of the North American
Chapter of the International Group for the Psychology of Mathematics Education, ERIC,
Columbus, OH, pp. 521–526.
Child, J.D.: 1993, Calculus T/L II [computer software], Brooks/Cole, Pacific Grove, CA.
D’Ambrosio, B.S. and Campos, T.M.M.: 1992, ‘Pre-service teachers’ representations of
children’s understanding of mathematical concepts: Conflicts and conflict resolution’,
Educational Studies in Mathematics 23, 213–230.
Davis, B.A.: 1994, ‘Mathematics teaching: Moving from telling to listening’, Journal of
Curriculum and Supervision 9, 267–283.
Duit, R., Treagust, D.F. and Mansfield, H.: 1996, ‘Investigating student understanding as a
prerequisite to improving teaching and learning in science and mathematics’, in D.F. Tre-
agust, R. Duit and B.J. Fraser (eds.), Improving Teaching and Learning in Science and
Mathematics, Teachers College Press, New York, pp. 17–31.
Even, R. and Tirosh, D.: 1995, ‘Subject-matter knowledge and knowledge about stu-
dents as sources of teacher presentations of the subject-matter’, Educational Studies in
Mathematics 29, 1–20.
Fennema, E., Carpenter, T.P., Franke, M.L., Levi, L., Jacobs, V.R. and Empson, S.B.: 1996,
‘A longitudinal study of learning to use children’s thinking in mathematics instruction’,
Journal for Research in Mathematics Education 27, 403–434.
Fey, J.T. and Heid, M.K., with Good, R., Sheets, C., Blume, G. and Zbiek, R.M.: 1991,
Computer-Intensive Algebra, The University of Maryland and The Pennsylvania State
University, College Park, MD.
Fey, J.T. and Heid, M.K., with Good, R., Sheets, C., Blume, G. and Zbiek, R.M.: 1995,
Concepts in Algebra: A Technological Approach, Janson Publications, Dedham, MA.
Heid, M.K.: 1996, One teacher’s understanding of mathematics and technology and its
relationship to students’ use of a computer algebra system, Paper presented at the 1996
Annual Meeting of the American Educational Research Association, New York, New
York.
Heid, M.K. and Zbiek, R.M.: 1993, ‘The nature of understanding of mathematical mod-
elling by beginning algebra students engaged in a technology-intensive conceptually
based algebra course’, in J.R. Becker and B.J. Pence (eds.), Proceedings of the Fifteenth
Annual Meeting, North American Chapter of the International Group for the Psychology
of Mathematics Education, San José State University, San José, CA, pp. 128–134.
Heid, M.K., Zbiek, R.M. and Blume, G.: 1997, ‘Empowering mathematics teachers in
computer-intensive environments’, in J.G. Harvey (ed.), Models for Mathematics Tech-
nology Teacher Education, MAA Reports #3. Mathematical Association of America,
Washington, D.C., pp. 79–94.
Hiebert, J. and Carpenter, T.P.: 1992, ‘Learning and teaching with understanding’, in
D.A. Grouws (ed.), Handbook of Research on Mathematics Teaching and Learning,
MacMillan, New York, pp. 65–97.
Miles, M.B. and Huberman, A.M.: 1994, Qualitative Data Analysis: An Expanded
Sourcebook, 2nd ed., Sage, Thousand Oaks, CA.
Sierpinska, A.: 1994, Understanding in Mathematics, Falmer Press, London.
Stake, R.E.: 1994, ‘Case studies’, in N.K. Denzin and Y.S. Lincoln (eds.), Handbook of
Qualitative Research, Sage, Thousand Oaks, pp. 236–247.
Steinbring, H.: 1989, ‘Routine and meaning in the mathematics classroom’, For the
Learning of Mathematics 9(1), 24–33.
Towers, J.: 1996, ‘False impressions: Listening for understanding in the mathematics
classroom’, in E. Jakubowski, D. Watkins and H. Biske (eds.), Proceedings of the
Eighteenth Annual Meeting of the North American Chapter of the International Group
for the Psychology of Mathematics Education, ERIC Clearinghouse Columbus, OH,
pp. 527–532.
BARBARA S. EDWARDS
Department of Mathematics,
Oregon State University,
Corvallis, OR 97331,
U.S.A.