Professional Documents
Culture Documents
Written Arguments
Author(s): Marilyn J. Chambliss
Source: Reading Research Quarterly , Oct. - Nov. - Dec., 1995, Vol. 30, No. 4 (Oct. - Nov.
- Dec., 1995), pp. 778-807
Published by: International Literacy Association and Wiley
REFERENCES
Linked references are available on JSTOR for this article:
https://www.jstor.org/stable/748198?seq=1&cid=pdf-
reference#references_tab_contents
You may need to log in to JSTOR to access the linked references.
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide
range of content in a trusted digital archive. We use information technology and tools to increase productivity and
facilitate new forms of scholarship. For more information about JSTOR, please contact support@jstor.org.
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
https://about.jstor.org/terms
Wiley and International Literacy Association are collaborating with JSTOR to digitize, preserve
and extend access to Reading Research Quarterly
Lengthy written argument is an important form of had few encounters with lengthy written argument may
communication. In newspaper editorials, maga- not know how authors cue claims and evidence in
zine articles, and books, authors offer evidence for lengthy text nor have the necessary strategies to make
claims, their arguments spanning several para- use of the cues to reconstruct a mental representation of
graphs, a number of sections, or even many chapters. the argument.
Work by Gilbert (1991) suggests that readers who suc- Although it is risky to infer possible instructional
cessfully comprehend a lengthy argument must mentally approaches based on what successful readers do, identi-
represent the author's claim and evidence as it is re- fying the text cues and strategies they use is a plausible
vealed across at least several paragraphs of text. Only first step. This work relied on Toulmin's three-part mod-
those readers who have successfully comprehended the el of argument (Toulmin, 1958), Meyer's text compre-
argument will be prepared to weigh the evidence and hension model (Meyer, 1985; Meyer, Brandt, & Bluth,
accept or reject the claim (Kuhn, 1992). 1980), and a framework of text structures (Calfee &
Unfortunately, a sizeable proportion of readers Chambliss, 1987; Chambliss, 1994a; Chambliss & Calfee,
may reach adulthood never learning how to represent 1989, in press) to suggest the text cues and strategies
the claim and evidence in a lengthy written argument. used by competent readers to construct the gist of a
Test results from the National Assessment of Educational lengthy argument. Comprehension of written argument
Progress (NAEP) suggest that the majority of adults in has not been as thoroughly examined as comprehension
the U.S. do not competently comprehend written argu- of other text types (e.g., Meyer & Freedle, 1984). Though
ments longer than a few paragraphs (Kirsch, Jungeblut, it is true that researchers have developed models for
Jenkins, & Kolstad, 1993). Part of the problem may be how people of various ages weigh evidence and accept
lack of practice. Textbook writing, the genre with which or reject claims (e.g., Kuhn, Schauble, & Garcia-Mila,
school-aged readers have the most contact, rarely incor- 1992), they have typically not used reading tasks nor fo-
porates well-written argument of any length. In a survey cused on how people comprehend an argument in the
of nine social studies textbooks (Calfee & Chambliss, first place. Furthermore, comprehension work, customar-
1988) and 12 science textbooks (Chambliss, Calfee, & ily employing texts of one or two short paragraphs (e.g.,
Wong, 1990) for Grades 4-12, Calfee and his colleagues Hare, Rabinowitz, & Schieble, 1989), has neglected to fo-
found only a handful of arguments, each of which was cus on how readers comprehend lengthy text. Neither
no more than a few paragraphs long. Readers who have comprehension research nor work on argument reason-
778
Text cues and strategies successful readers use to construct the gist of lengthy written arguments
COMPREHENSION OF written argument has been less thoroughly grade advanced placement English students read arguments varying
examined than comprehension of other text types, even though, ac- in argument structure, content familiarity, and argument signaling
cording to National Assessment of Educational Progress results, and completed either written survey or think-aloud protocol com-
many adults cannot competently comprehend lengthy written argu- prehension tasks. Both text structure and signaling in introductions
ments (Kirsch, Jungeblut, Jenkins, & Kolstad, 1993). Three experi- and conclusions consistently influenced their responses. They used
ments based on Toulmin's (1958) argument model, Meyer's (1985) these cues to (a) recognize the argument structure in a lengthy text,
comprehension model, and Calfee and Chambliss' (1987) text design (b) identify the claim and evidence, and (c) construct a gist repre-
model identified text cues and comprehension strategies used by sentation. Outcomes have both general theoretical value and practi-
competent readers comprehending lengthy arguments. Eighty 12th cal implications for designing instructional materials.
Pistas textuales y estrategias usadas por los buenos lectores para construir el tema de argumenta-
ciones escritas extensas
Texthinweise und Strategien von Lesern, die erfolgreich den Kernpunkt langatmiger Argumentationen
erfassen wollen
DAS TEXTVERSTEHEN geschriebener Erirterungen ist vergleichs-
die sich hinsichtlich ihrer Argumentationsstruktur, inhaltlicher
weise weniger untersucht als das Verstehen anderer Textsorten, Verwandtheit
ob- und Argumentmarkierung unterschieden und legten
wohl laut NAEP-Ergebnissen viele Erwachsene das kompetente entweder einen schriftlichen Bericht vor oder bekamen mondliche
Aufgaben zum Textverstehen. Sowohl die Textstruktur und Hinweise
Lesen lingerer Er6rterungen nicht beherrschen (Kirsch, Jungblut,
Jenkins, Kolstad 1993). Drei Untersuchungen, die auf Toulmins
in den Einleitungen als auch Schlugfolgerungen beeinfluSten ihre
Argumentenmodell (1958) und auf dem Textmodell von Caffee und
Antworten. Sie benutzten die Schlisselstellen, um a) die
Chambliss (1987) beruhen, sollten nun Textschlissel und
Argumentationsstruktur im Langtext zu erkennen, b) Absicht und
Selbstverstdndnis des Textes zu erfassen, und c) das Wesentliche
Verstehensstrategien aufkldren, die von kompetenten Lesem zum
wiederzugeben. Die Ergebnisse haben generellen theoretischen Wert
Verstehen lingerer Abhandlungen eingesetzt werden. 80 fort-
und praktische Implikationen, um Lehrmaterial zu konzipieren.
geschrittene Englischschiiler der 12. Klasse lasen die Er6rterungen,
779
NAEP(National Assessment
?( ?/ of
7"-? Edu-
s T-A ? N 4.%?1f -W -Dk r
cational Progress) Oa*S2 If48 0 AfiAMOA AViON )
t LG4:4
Indices textuels et stratggies des bons lecteurs pour saisir l'essentiel d'arguments dcrits d'un texte long
ON S'EST moins interesse ' la comprehension de l'argumentation structure argumentative, la familiarite du contenu, le signalement
&crite qu'a celle d'autres types de textes, meme si, suivant la argumentatif,
NAEP et ont effectue des tiches de comprehension utilisant
(Programme National d'Evaluation de l'Education), de nombreux
un questionnaire &crit ou un protocole de verbalisation de la pensee.
adultes ne comprennent pas bien les arguments ecrits d'un texte
Leurs reponses ont et? fortement influences par la structure du texte
long (Kirsch, Jungblut, Jenkins, & Kolstad, 1993). Trois experiences
et par les signalements de l'introduction ou de la conclusion. Ils ont
basees sur le modele argumentatif de Toulin (1958), le modele de
utiliseces indices pour a) reconnaitre la structure argumentative dans
la comprehension de Meyer (1985), et le module de planification un texte
de &tendu, b) identifier le propos et les preuves, et c) construi-
texte de Calfee & Chambliss (1987), ont identifie les indices textuels
re une representation de ce qui est essentiel. Les retombtes ont une
et les strategies de comprehension qu'utilisent des lecteurs experts
valeur theorique genmrale et des implications pratiques pour la fab-
pour comprendre des arguments 6tendus. Quatre vingts 6tudiants rication du material didactique.
d'anglais de 120 annie ont lu des arguments qui variaient suivant la
780
A mother skunk
battles a flooded
river to rescue her
trapped babies.
ing has demonstrated the text cues and strategies that ventional structure in written arguments as specified in
successful readers use to comprehend lengthy argument. the rhetoric and a rhetorical schema used by readers to
comprehend argument text. Indeed, at least some current
The Toulmin argument model textbooks in rhetoric and composition explain argument
The study of argument has a long, prestigious histo-structure according to the Toulmin model (e.g., Hairston,
ry. Beginning in antiquity, rhetoricians have analyzed the1992; Ramage & Bean, 1995).
features of effective spoken and written argument (e.g., Figure 1 depicts the structure in a written argument
Aristotle in Cooper, 1932; Bain, 1867; Brooks & Warren, according to the model. Based on the discipline of ju-
1972; Ramage & Bean, 1995). The rhetoric is typically en- risprudence as more representative of real-world argu-
countered today in composition books (e.g., Barnet & ments than syllogistic structures, Toulmin's model has
Stubbs, 1990; Crews, 1992; Hairston, 1992), which uni- three parts: a claim (an assertion analogous to a plea of
formly include chapters on how to craft an argument ac- guilt or innocence), evidence (facts and examples), and a
cording to these rhetorical features (Calfee & Chambliss, warrant (a law-like generalization that links the two). In
1987). Focusing on reasoning instead of writing, logicianssome respects the warrant is the most innovative feature
have developed the logical calculus to represent formalof the model, but also the most elusive and inexplicit.
relations among argument parts (Alexander, 1969; Mates,Toulmin conceived it as analogous to the major premise
1972). The philosopher, Stephen Toulmin (1958), ex- in a classical syllogism and proposed that the warrant is
plained that as logic has become more mathematical, itthe underlying reason offered for accepting or rejecting
has moved away from real-world arguments. Van Dijk the evidence as support for the claim. As such, it often
and Kintsch (1983) suggested that Toulmin's (1958) argu- makes or breaks the argument. Consider the warrant in
ment model could effectively characterize both the con- Figure 1, "Animals that attack a much larger predator
general
show amazing courage." The reader who is reluctant to background knowledge, text knowledge, a
attribute human traits, such as courage, to animals repertoire
may of comprehension strategies assuming a sta
reject this warrant and the claim that it underlies.toward a text with particular features within a social
Toulmin (1958) proposed that the claim-evidence-
text (Ruddell, 1994). This study highlighted certain fe
tures of these models and downplayed others. I hav
warrant structure characterizes an argument independent
of content. Brooks and Warren (1972), echoed by
already hypothesized that competent readers have
ground
Nickerson (1991), point to an interesting ambiguity in knowledge about argument specified by th
Toulmin
the word "argument" itself. As used by the logician or (1958) model as qualified by Pollard (1982
Becauseofthe purpose of argument is to communicat
rhetorician, argument refers to a reasoned justification
some claim. It can be used for any content, as the exam-
author's thinking, I expected readers to take an effer
stance as proposed by Rosenblatt (1978, 1994), whe
ple in Figure 1 would suggest. In common parlance,
they would search for text cues so that they could ab
however, argument is a verbal fight between disputants
(Brooks & Warren, 1972; Nickerson, 1991) where the structure, and remember the claim and its evi
stract,
dence as a mental representation of the text's gist
content is necessarily contentious. The goal for both
(Meyer,
combatants, whether face to face or linked as author and 1985; Spivey, 1987). How well and in what
the text
reader by a text, is to win the argument rather than to cued the argument would also be important.
Readers can be strongly affected by text characterist
accept or reject a claim through reasoning (Nickerson,
(Dole,on
1991). Nickerson's notions suggest that readers intent Duffy, Roehler, & Pearson, 1991), an effect tha
winning an argument have no need to represent the au-
should be particularly potent for readers who have as
thor's argument accurately-to comprehend it-in order
sumed an efferent stance. In order to highlight reade
to weigh evidence and accept or reject a claim. gument
Their knowledge, comprehension processes, and
influence of text features, the study did not focus on
goal, instead, is to build a case for their own "side,"
picking and choosing from the argument the evidence reader general knowledge or the social context f
ther
and claims that match whatever they hold to be true reading.
and
ignoring the rest. According to this second conceptual- Although it does not address written argument per
ization of argument, the text depicted in Figure 1 se,would
a comprehension model proposed and tested by
Meyer and her colleagues (Meyer et al., 1980; Meyer &
not be considered contentious enough to be character-
ized as an argument. Freedle, 1984; Meyer & Rice, 1982) suggests specific
Even reasoned arguments may have important con-
strategies that successful readers may apply when they
tent characteristics, although not of a contentiousassume an efferent stance. According to the model, com-
nature.
In a review of research on reasoning, Pollard (1982) con- know a set of rhetorical structures, or
petent readers
cluded that people typically recognize as claimsschemata
asser-(van Dijk & Kintsch, 1983; Meyer, 1985), that
tions for which they cannot readily remember eitherauthors use to organize text (Meyer & Freedle, 1984). If a
confirming or disconfirming examples or scenarios reader can identify one of these structures in a text, he or
(Tversky & Kahneman, 1973). They can comprehend an for its parts and link them together into a
she can search
text representation. Readers who have used this structure
argument when the warrants and evidence are familiar.
strategy recall the text as a gist, a summary of the impor-
Pollard explained that if the claim is familiar, people
may fail to recognize the presence of an argument. tantIf
content organized comparably to the organization in
warrants and evidence are unfamiliar, they may relythe texton (Kintsch & van Dijk, 1978; Meyer et al., 1980).
what they already know rather than construct a Teaching
repre- less competent readers to find the author's
sentation of the argument presented to them. structure improves their comprehension (Armbruster,
According to Toulmin's model and Pollard'sAnderson,
qualifi- & Meyer, 1991), lending support to the model.
cation, I hypothesized that an unfamiliar claim-familiar Figure 2 displays a three-stage model based on a
synthesis
evidence-familiar warrant pattern appears in written text of Toulmin's (1958) and Meyer's (1985) no-
as a set of argument cues. I also proposed that thetions. pat-
The model portrays the strategies used by compe-
tern characterizes an argument schema known bytent readers to construct the gist of a lengthy written
suc-
cessful readers. I avoided contentious content thatargument.
mightIn this study I hypothesized that competent
cue readers to case build rather than comprehend the
readers use strategies specified by the model.
author's claim and support. In the first stage, as soon as the reader notices an
unfamiliar claim-familiar evidence-familiar warrant in a
Reader strategies: A comprehension model text, he or she uses an argument schema to identify the
Current models of reading comprehension text (see as an argument. Meyer and Rice (1982) discovered
Ruddell, Ruddell, & Singer, 1994) depict a reader with
that readers rely heavily on structure cues, such as the
yes?
Argument recognized.
not match ?
Evaluate facts and examples.
match ?
Identify as E
present than when it has been omitted (Bridge, Belmore, Calfee and Chambliss (1987; Chambliss, 1994a;
Moskow, Cohen, & Mathews, 1984; Hare et al., 1989). Chambliss & Calfee, 1989, in press) have proposed a
Apparently, when no topic sentence is present, readers taxonomy to be used with texts of any length. The tax
often try to "add up" the subjects and predicates in the onomy has three wellsprings. The first comes from th
paragraph, and construct a superordinate that subsumesrhetoric. By surveying college composition books, C
everything (Kieras, 1980; Williams, 1984). Not surprising- and Chambliss (1987) identified several common pat
ly, their accuracy suffers. In this study I hypothesized terns, which they distinguished by the author's presu
that competent readers identify claim statements present purpose: to inform, to argue, or to explain (Chambliss
in written arguments. They infer absent claims. 1994a, 1994b; Chambliss & Calfee, 1989, in press). T
The search for evidence should be affected by second wellspring comes from Simon's (1981) sugge
whether particular facts and examples match the claim- that all human artifacts (including written text) can b
evidence-warrant relationship in the overall argument. characterized according to separate elements, linkag
Successful readers should be able to distinguish betweenamong the elements, and a theme to hold the design
evidence and nonevidence. Again, research on para- gether. Extending these notions to written text, Calfe
graphs is suggestive. Readers as young as sixth grade and Chambliss (1987; Chambliss, 1994a) characterize
can accurately distinguish between detail sentences that texts of any length to have elements (sentences, para-
either match or mismatch the rhetorical structure in a graphs, sections, chapters) linked (the text's structure
paragraph (Englert & Hiebert, 1984). I hypothesized that according to a theme (the author's purpose). The thi
competent readers identify evidence and distinguish it exploits the usefulness of graphics to represent compl
from nonevidence, justifying their answer by referring to relationships (Tufte, 1990). The taxonomy specifies
the structure of the argument. graphics such as topical nets, matrices, hierarchies, an
In the third stage, the reader constructs a mental Toulmin's model to depict the elements, linkages, a
representation of the author's argument whereby the theme in a text's design (Chambliss, 1994a, 1994b;
warrant links the claim to the evidence. One of the most Chambliss & Calfee, 1989).
consistent research findings to support the Meyer model Figure 1 demonstrates the approach. Each insta
is that successful readers asked to recall a text produce a of evidence in the figure represents an entire paragra
summary of important content organized to match the of details, which concludes with a sentence that exp
Remembering kindness is a
human behavior.
A young elephant remembers the
kindness of a human helper for a
long time.
Rewrites based on these two factors resulted in 32 text ments relating the instance of evidence to the claim (see
versions. Figure 3). For topical net versions, one of the instances
All versions were approximately three pages of sin-of evidence was included as a subtopic to provide the
gle-spaced typing. Each instance of evidence or subtopic
same amount of elaboration for the claim as paragraph
in the diagram was a paragraph long. Paragraphs in ar-
topic sentences had. Both argument and topical net ver-
gument versions concluded with explicit warrant state- sions included two superordinate statements: the claim -
Figure 4 The introductory paragraph and topical net diagram for the informational top
version about elephants
Eating
Swimming habits
Elephants
ability
Reasoning Skin
ability care
Dexterity
Rating
One-sentence summary (2-0)
Table 2 Means for Claim Position, Text Structure, and Text Replicate for three dependent mea
recognizing the argument pattern
Between-subjects facto
Claim Position
First (N= 32) 1.56 (.50) .89 (.89) 22.17 (13.39)
Last (N= 31) 1.48 (.50) 1.26 (.92) 23.34 (17.25)
Text Replicate"
Unfamiliar Claim
Elephants/geese (N= 17) 1.56 (.50) 1.00 (.89) 23.94 (14.94)
Geese/elephants (N= 18) 1.53 (.51) 1.08 (.97) 20.05 (8.92)
Familiar Claim
Nests/leopards (N= 14) 1.41 (.50) 1.04 (.94) 23.48 (18.45)
Leopards/nests (N= 14) 1.59 (.50) 1.11 (.93) 24.15 (19.14)
Within-subjects factor
Text Structure
Argument (N= 63) 1.92 (.27) 1.76 (.53) 28.29 (17.33)
Informational (N= 63) 1.11 (.32) .33 (.62) 17.05 (10.31)
Assigning survey scores cause its subject and predicate subordinated the prepon-
Higher scores for three derance
of of thecontentmeasures
in the recall. If the recall had such a
collected
from the surveys indicated claim,
that
it was diagrammed
participants as having an argument
hadstruc- recog
nized the argument pattern. ture.For
Because the
text structure
first was item,
expected to "Suppor
have a
powerful influence
ing a point" received a 2; "Giving on pattern recognition and
information" a because
1. A
one-sentence summary received
the analysis procedure
a 2 had
for
been developed
a close for this
para-
study,
phrase of the claim, a 1 for antwo analysts
imperfectcompleted diagrams for all recalls.
paraphrase th
included information from Judgments
the matched
claim's for 93% subject
of the analyses (15
and recalls),
pred
with consensus
cate, but (a) used terms that were reachedeitheron the remaining
more recall. general
specific than the terms in the claim or (b) embedded th
claim as either a dependent clause Results or as one of a ser
of equally important clauses. All other answers recei
a 0. Scoring for this second item Regardlessrequired
of task or measure,
a high
Text Structure
degre
of inference. Two raters independently strongly and consistently affected
scored readers'
allresponses.
re- N
sponses. Their judgments matched other factor had for
either strong
92% or of
consistent
the effects.
score Res
with consensus easily reached for the two on
typesthe remaining
of tasks scor
are reported separately.
Table 1 presents a sample of 12 responses and their r
ings. The third item was Written survey tasks
quantitative and needed no
scoring. Responses to the fourth Table 2 displays
item large main effect
were means for the
categorical,
and I analyzed them separately. three measures.
TheRow headings in consistent
results, Table 2 show the fa
with the other three measures, tors; column are not
headings detailed
show the measures.in this
The table
report. also indicates significance levels resulting from ANOVA
tests conducted for each measure. Consistently low to
modest correlations among measures indicated the ap
Analyzing protocols propriateness of using univariate rather than multivari
Analyses for protocol responses focused on an- analyses. The cells in the experimental design had un
swers consistent with recognizing an argument pattern. equal sizes because of a mixup in distributing the pac
The analysis of the free recalls began with a search for a ets and failure of some students to return completed
superordinate statement that could serve as a claim be packets.
The author's purpose is to give information about birds' Hugh O'Brien [sic], the author of the essay, proposes that
nests. This paragraph was an introduction with lots of elephants are similar to humans in the way in which they
Figure 5 Verbatim recalls and text diagrams of two readers after reading either the argument
about elephants
Argument text
Evidence Warrant Claim
Also, elephants care for each other the way humans Elephants care Elephants are
do. The author stated several examples in which ele- similar to hu-
for each other
phants demonstrated human traits. A mother elephant, like humans do. mans in the way
Young elephants in which they
after saving her cub from drowning, waited to see if it Elephants
protect old. behave.
was all right before she punished him. Young elephants demonstrated
have been seen protecting the old and weak elephants human traits.
of the herd. Another example was when a mother ele-
phant was mourning after her dead newborn cub. She
walked around without eating and very temperamental
and eventually buried it. Mother elephant
mourned dead cub.
Elephants not only act like humans but they can rea- Elephants
son like humans as well. The author stated an occurance reason like
humans.
in the jungle where an expedition put up electric fences
to prevent the elephants from entering. The elephants "Elephants figured out
found out that when the lights were on, the fence was that their tusks did not
not electrified and that their tusks did not conduct elec- conduct electricity.
tricity.
Informational text
Body hair
Light on
Appetite feet
Good swimmers
Conclusion
Method
Results suggest that good readers use the presence
Participants
or absence of a claim-evidence-warrant relationship to
recognize a written argument and distinguish it from Sixty
an participants completed written tasks; eight
informational topical net. Whether a text had signaling,
completed protocols.
claims were unfamiliar, or claims were placed in intro-
ductions had virtually no effect on reader performance.
Design
For texts with an argument structure, readers chose an
The design was a 2 (Order) X 2 (Signaling) x 2
"argue" purpose, expected to find argument parts in the
(Text
text, summarized it with the claim, and structured their Replicate) x 2 (Claim Presence) X 6 (Paragrap
recalls as arguments. Their answers followed quitemixed design with Order, Signaling, and Text Replic
a dif-
the between-subjects factors, Claim Presence a within-
ferent pattern for informational texts where the claim-
evidence-warrant relationship was missing. subjects factor, and Paragraphs a within-text factor.
Table 3 A sample of claim statements that readers constructed after reading arguments with explicit a
claims and the ratings assigned to the statements according to how closely they matched the a
claim
Rating
Claim statement (3-0)
Materials Procedure
Texts. Two passages from the original pool of 20 Participants completed the two types of tasks as in
texts were used for this experiment, both with unfamiliarthe first experiment with one exception. They were told
claims, familiar evidence, and familiar warrants. Repli- that both passages had been written to support a point.
cates were prepared comparably to the first experiment,
with three exceptions. All versions had an argument
Assigning survey scores
structure. According to the Paragraphs factor, one para-
The author's claim scores distinguished among dif-
graph in each text was ancillary to the relationship in the
claim, related to it topically only. A summary warrant inferent degrees of accuracy. For each claim, I identified
the concluding paragraph related the evidence to the two concepts that each instance of evidence in the argu
claim instead of individual warrants at the end of each ment exemplified ("taking advantage" and "environment"
paragraph. Figure 6 depicts the resulting structure for for the argument about coyotes; "occupations" and "lik
one of the texts. humankind's" for the argument about ants). A claim
These structures formed the basis for the four repli- statement that related both concepts received a 3. If both
cates. Because of the Claim Presence factor, introduc- concepts were present, but the meaning of one or both
tions either did or did not contain the argument's claim. was slightly different, the statement received a 2 (e.g.,
The Signaling factor required that introductions and con- "situation" for "environment"; "roles" for "occupations").
clusions either summarized the argument accurately by A statement with only one of the concepts received a 1.
including only content from the evidence paragraphs or Anything else received a 0. Because scoring of claim
summarized the entire passage by including content statements involved a high degree of inference, three
from the ancillary paragraph as well. raters scored the responses independently. On 98% of
School 1 participants, completing the tasks first, the responses, two of the three raters assigned identical
seemed consistently to misinterpret the meaning of the scores. Raters reached consensus on the remaining rat-
claim slightly for one of the passages. Consequently, I ings. Table 3 lists a sample of claim statements and their
reworded the title and rewrote several paragraph topic accompanying scores. Evidence list responses received
sentences for students from School 2.
one point for each of the six text paragraphs from which
The Identification Measure (IM). The IM asked students included at least one piece of information.
readers completing written surveys to (a) write the au-
thor's point and (b) summarize in a single sentence each
of the five pieces of support in the argument. Prompts Analyzing protocols
asked students completing protocols to explain why they Protocol analyses focused on how the presence or
thought the author had included the paragraph they had absence of the claim affected readers' identification of
just read, share any thoughts they had while reading, the author's claim throughout the text, particular text
state the author's point for the entire passage, and justify characteristics that they gave as rationale for their an-
their answer. swers, and how they handled the ancillary paragraph.
Between-subje
Signaling
Exact (N = 29) 1.93 (.87) (N = 348) .77 (.42)
Ancillary (N= 31) 1.22 (.89) (N = 372) .70 (.46)
Within-subjects factor
Claim Presence
Present (N = 60) 1.80 (.92) (N= 720) .75 (.43)
Absent (N= 60) 1.33 (.93) (N= 720) .72 (.45)
Within-text factor
Paragraphs
Evidenceb (N= 600) .79 (.41)
Ancillary (N= 120) .47 (.50)
claim while rejecting as evidence paragraphs only topi- realized how all those examples fit in. [The
cally related. When the claim was missing, some readers author] compared humans and ants."
quickly inferred it, apparently from patterns they recog-
Other participants were willing to accept that texts
nized in the evidence. Others frequently changed their
with missing claims were arguments. They readily in-
minds about the claim as they successively read the
duced claims, which changed after each paragraph. In
paragraphs in the text. They seemed particularly influ-
addition, they tended to accept ancillary content as evi-
enced by the ancillary paragraph, broadening the claim
dence. The accuracy of their answers was affected by
to incorporate it rather than realizing that it did not fit
both the absence of the claim and the presence of
the rest of the argument. Two readers seemed unable to
nonevidentiary information.
infer a missing claim.
In the first example, the reader found the claim in Introduction: "I can't tell the point yet."
Paragraph 2: "No matter what the environment, the coy-
the introduction, stated it as the author's point through-
out the text, and accurately distinguished evidence from ote tries to solve problems. It will find a
ancillary content. way to live."
Paragraph 3: "The coyote will eat no matter what the
Introduction: "The point is that ants' occupations are go- cost; it will take advantage of every oppor-
ing to be like humans. It says it right here." tunity."
Paragraph 2: "It's still the same. Ants are like humans." Paragraph 4: "The coyote is smart. He will make the best
(Note that "occupations" dropped out, a
of any situation where he can get a free
change that occurred frequently among
meal. He always thinks before he acts."
readers.)
Ancillary: "The same point. Coyotes make do with
Paragraph 3: "The same point. Ants have human-like
what they have. Also, that they are smart....
qualities."
The author could be comparing them to hu-
Paragraph 4: "Same [point]. Ants are like humans."
mans. I'm not really sure. But their children
Ancillary: "Same [point]. This paragraph is not good
are important to them-a lot like humans.
support. Humans don't do this."
They make do with what they have, just
Paragraph 6: "Same [point]. Ants are human-like. Now
like humans. Anyone will take a good deal.
he's back on track to support the point."
Humans do that too."
Paragraph 7: "Ants are human-like."
This reader's statement of the author's claim changed
Readers intent on looking for a claim in the text
throughout the passage. Note particularly her last re-
were thrown by versions that did not explicitly state it.
sponse. Upon reading the ancillary paragraph, she re-
After reading the introduction, one reader explained,
viewed what she had read about the coyote thus far and
Introduction: "This passage will just give information.
seemed to be searching for one generalization to subsume
There is no opinion in the first paragraph."
even the ancillary information about how coyotes parent.
He was unable to identify a claim until after reading the Other readers were more accurate at inducing the
warrant at the end of the passage, which specifically re- claim from the evidence, and consequently less strongly
lated the evidence to the claim. influenced by the ancillary paragraph.
Paragraph 2: "No opinion yet." Introduction: "The coyote can survive the environment. It
Paragraph 3: "Not that I can tell." is a fighter. It does a lot of adaptive stuff. I
Paragraph 4: "Just an essay on ants." can tell [that this is the point] because this
Ancillary: "It's an informative research paper on ants." introductory paragraph kept saying how
Paragraph 6: "No opinion. Just about how ants make they got food, and examples of how it
nests for larvae." adapted." (She had induced the claim from
Paragraph 7: "It's just making statements about ants." a summary of the evidence in the introduc-
tion.)
Once he had read the warrant in the concluding para- Paragraph 2: "The coyote is a survivor. [I can tell be-
graph, he explained, cause] the paragraph explains different
Conclusion: "The [concluding] paragraph stated an opin- changes and adaptations."
ion. I was thinking as I read this paragraph Paragraph 3: "The coyote is able to survive in the envi-
that the author finally stated an opinion. ronment. The paragraph continues to show
The thesis came at the end of the para- different ways."
graph. It is, 'the similarity between the soci- Paragraph 4: "The coyote is a smart animal. The para-
ety of ants and the society of humans.' I graph continues to give examples."
By the end of the introduction, the reader had induced a to identify the claim and evidence in a written argume
superordinate from the summary of the evidence. She They readily identified the claim statement in a text a
maintained this superordinate as the claim for two of themore accurately produced the claim when it was stat
next three paragraphs. Her next response follows the an-
They pointed to patterns in the text to justify both the
cillary paragraph. statements of the claim and their rejection of ancillary
Ancillary: "[The point is] still the same, but changing. content. Apparently they know the defining features o
At this point it seems to be different. I'm notclaims and evidence well. All participants produced
sure what it is yet. The paragraph is no claim statements that were generalizations at a superor
longer about how [the coyote] survived. It dinate rather than a basic level. In contrast, they all pr
just kind of gives facts." duced as evidence basic level instances or facts. The
Paragraph 6: "This paragraph is more like the whole pas-
claims and evidence tended to be related. Readers justi-
sage-how the coyote survives the environ- fied their statement of the claim by pointing to the evi-
ment. I can tell because the paragraph
dence and distinguished evidence from nonevidence by
supports the point through the breeding
referring to the claim. Their accuracy was influenced by
example."
the caliber of introductory and concluding summaries.
Finally, results suggest that good readers tend to
Conclusion use three strategies to identify an argument's claim and
evidence. They may locate the claim in the text, identify
Results suggest that good readers use claim state-
it, and use it to distinguish evidence from ancillary con-
ments, patterns in the content presented in text para-
graphs, and summaries in introductions and conclusions
tent. Failing to find the claim in the text, readers may use
Figure 8 Verbatim summary recalls, argument diagrams, and scores for two readers recalling a
argument with a complex structure and familiar warrants
They will
attack
anything.
in one day if he isn't constantly eating food. The Shrews will eat Match = 0
despite their
shrew is a very fierce creature. mammals bigger small size. (1-0)
than themselves.
Devour every
part. Shrew ate Pattern = 1
every bit of snake. (2-0)
one of of a strategies.
alternate complex claim. Two of these
two passages had may
They familiar
claim on from warrants
early
the and two had unfamiliar warrants. Figure and
introduction 7 de-
picts the and
instances of evidence structure for one of the complex arguments
subsequently
with familiarmay
guish evidence. Or they warrants. The other four passages hadall
identify sim-
ples as evidence andple structures
search similar to all arguments used in Experi-
repeatedly f
subsuming claim. ments 1 and 2, two with familiar and two with unfamiliar
warrants.
Method Procedure
Procedures were similar to the first two experi-
ments with three exceptions. Participants were told that
Participants
both texts were written to support a point with the claim
Fifty-one participants completed surveys. Six com-
present. After reading, survey participants wrote a sum-
pleted protocols.
mary recall of each passage. Protocol participants sum-
marized the evolving argument after each paragraph.
Design
The design was a 2 (Argument Summary) X 2
Assigning survey scores
(Warrant Familiarity) X 3 (Warrant Structure) x 2
To score the summary recalls, I diagramed them
(Order) X 2 (Argument Complexity) x 2 (Text
using a procedure identical to the analysis of written re-
Replicates I) X 2 (Text Replicates II) mixed design with
calls in Experiment 1. Because this procedure involved
Argument Summary, Warrant Familiarity, Warrant
high degree of inference, a colleague familiar with the
Structure, Order, and Text Replicates I and II as be-
structures diagramed a randomly selected subset of 12
tween-subjects factors and Argument Complexity as a
recalls. Her diagrams matched mine on 11 recalls for a
within-subjects factor. Text Replicates I and II were nest-
interrater agreement of 91%. We easily reached consen-
ed within both Warrant Familiarity and Argument sus on the last recall.
Complexity. Text Replicates I had simple argument struc- Figure 8 displays two recalls for the complex argu-
tures and either familiar or unfamiliar warrants. Text
ment about shrews (see Figure 7) and their accompany-
Replicates II had complex structures with either familiar ing diagrams. The recall in the first panel of Figure 8 has
or unfamiliar warrants.
a complex structure that matches the pattern in the text,
The 96-cell design exceeded the number of readers mentions all five instances of evidence in the text, but
who would be completing surveys. I fractionalized in half does not accurately restate the complete claim or include
the part of the design containing all two-level between- any warrant statements. The recall in the second panel
subjects factors and crossed it with the between-subjects has a simple structure that does not match the text pat-
three-level factor. The six combinations for the readers
tern, mentions only three of the five instances of text ev-
completing protocols came from the larger design. idence, and also does not accurately restate the complete
claim or include warrant statements.
Materials
Each resulting diagram received four scores: Claim
Except for the variations required by the text fac-
score and support score measured comprehensiveness;
tors for this experiment, replicates were prepared com-
match score and pattern score measured organization.
parably to the two earlier experiments. Warrant The claim score ranged from 2 to 0. If all major concepts
Familiarity, Argument Complexity, and Text Replicates in Ithe claim appeared in the summary, the claim score
and II required eight passages from the original pool wasof2. If only some of the concepts were present, the
20 texts. Four of these passages had complex structures
score was 1. If none of the concepts was present, the
whereby instances of evidence supported different parts
score was 0. To guard against rater bias on this high in-
Table 5 Means for Argument Summary and Argument Complexity for four dependent me
constructing the gist
Between-subjects facto
Argument signaling
No (N= 25) 1.22 (.82) 320 (1.77) .66 (.48) 1.08 (.73)
Yes (N= 26) 1.50 (.64) 4.04 (1.20) .71 (.46) 1.12 (.62)
Within-subjects factor
Argument complexity
Simple (N= 51) 1.43 (.81) 3.82 (1.63) .82 (.39) .82 (.39)
Complex (N= 51) 1.29 (.67) 3.43 (1.47) .55 (.50) 1.37 (.77)
Note. Italics denotes p<.05; boldfaced, p<.01; both italics and boldfaced, p<.001.
Protocol results The author gives background to when African egrets first
The protocols illustrated the effects of complexity got here and how they began to spread. He is giving
and signaling on readers' summaries. All participants background to support the statement that egrets have
thrived because of the environmental changes that hu-
summarized simple arguments accurately. They restated
mans have made on the environment.
the claim after each paragraph and added the new evi-
dence onto their summary. Readers varied in how accu- He rejected the second instance even more forcefully.
rately they summarized the complex structure. Although "Cattle egrets have become a nuisance in Texas. This
two summarized the complex structure accurately, theparagraph is not supporting the point."
other four readers either summarized complex argu- Upon reading the first evidence about the influ-
ments as if they had simple structures, or were unable ence of human changes, he dropped the first two evi-
to summarize the text. dence paragraphs from his summary of the evidence.
The first example chronicles a reader accurately People have made changes in the environment that give
summarizing a complex argument. The claim was, "The egrets exactly what they need to thrive. Improved irriga-
common crow is a feathered genius and full of mis- tion has increased farm production. As farm production
chief." The first three instances of evidence supported has increased, so has the insect population.
the crow's genius. The last two supported the crow's
By the end of the passage, this reader had dropped
mischievousness. Following the second paragraph, the
reader summarized the claim and first instance of evi-
"thriving" out of the claim statement as well.
dence: Humans have made changes that increased the egret pop-
ulation. Increased farm production increased the insect
The crow is intelligent and full of mischief. Crows mimic population. Increased numbers of cattle kicked up the in-
people and other animals perfectly and appropriately. sects. Increased gasoline powered machinery kicked up
more insects for the egrets. The egret food supply has in-
The fifth paragraph introduced the first evidence
creased, which allows an increase in the egret population.
for crow mischievousness. The reader added this evi-
dence to her summary of the claim and the evidence Reading a complex argument with an innocuous
for crow intelligence. conclusion first confused two of the participants so com-
Crows are intelligent and full of mischief. They mimic pletely that their summaries were incoherent. Both read-
people and other animals. They have been impossible to ers summarized the simple argument text, which they
eradicate and have thrived instead. Crows use special read second, in an orderly, coherent fashion. After read-
ing the innocuous conclusion, one reader summarized
strategies for getting the food they like. They steal nesting
materials from each other. the egret text as:
maintained or changed. As I have already noted, compo- construct a text representation that accurately reflects the
sition textbooks consistently present the defining fea- structure in the text itself. Since argument may be a text
tures of arguments (e.g., Hairston, 1992). Logicians (e.g., type where accurate comprehension is particularly im-
Mates, 1972) and rhetoricians (e.g., Ramage & Bean, portant, however, writers should be aware that requiring
1995)-the academicians who study argument-specify readers to infer the point or including content extrane-
the same features. Argument, as it is supposed to be ous to the structure can influence the accuracy with
taught in school, seems to have a formal, recognizable which readers will comprehend the text.
structure that is independent from content and that can In the introduction I suggested that adults who
lead to a reasoned response rather than case building. cannot comprehend lengthy arguments may have had
The participants in this study believed that they had little experience with the argument structure and there-
learned the argument pattern in composition class. One fore never learned either the cues or the strategies to
of their teachers believed that she had taught them to employ them because instructional materials seldom
use the simple argument structure in organizing their exhibit a claim-evidence-warrant structure (Calfee &
writing to the exclusion of complex structures. If these Chambliss, 1988; Chambliss, Calfee, & Wong, 1990).
observations are valid, participants apparently have been Most students are expected to read thousands of pages
able to transfer what they learned about their own writ- of written instructional materials during their 12 years of
ing to the comprehension of arguments written by other public schooling. Redesigning textbook writing to exhib-
authors-at least when reading noncontentious content. it this structure would offer practice comprehending ar-
However, even well-educated readers may be prone to guments that many students may need.
case building when the content is contentious. The col- In some important respects, the results from this
lege students reading texts about logging in the Pacific study are reassuring. Competent readers were able to
Northwest and Operation Desert Storm (Chambliss, recognize lengthy written arguments, to identify the
1994b; Garner & Alexander, 1991) presumably were all claim and evidence, and to put the parts together into a
competent readers. Nonetheless, they consistently re- summary that tended to match the argument. It seems
called the text as if they were building a case for their reasonable that many of these readers had learned in
own beliefs. Tversky and Kahneman (1982) have con- school what the argument cues are and what to do with
cluded that even well-educated, experienced researchers them; that instruction can make a difference. Identifying
are prone to case build when the content is contentious
the specific instructional approaches that would support
and when they are thinking "intuitively." students who have not learned either argument cues or
appropriate comprehension strategies for lengthy texts is
In conclusion an important next step.
Because of the risk in drawing practical implica-
tions from theoretical work, I have resisted suggesting
REFERENCES
AFFLERBACH, P.P., & JOHNSTON, P.H. (1986). What do expert r
instructional strategies implied by the results of this
ers do when the main idea is not explicit? In J.F. Baumann (Ed
study. It does seem possible that what these competent
Teaching main idea comprehension (pp. 49-72). Newark, DE:
readers knew about argument and what they did while International Reading Association.
reading were influenced strongly by their instruction in
ALEXANDER, P. (1969). An introduction to logic: The criticism of
composition class. Furthermore, questions asked of arguments.
pro- New York: Shocken Books.
ARMBRUSTER, B.B., ANDERSON, T.H., & MEYER, J.L. (1991).
tocol participants consistently elicited strategic behavior
from them. Both of these outcomes could suggest specif- Improving content area reading using instructional graphics.
Reading Research Quarterly, 26, 393-416.
ic instructional approaches to use with readers who have
BAIN, A. (1867). English composition and rhetoric: A manual. N
not learned the text cues and strategies employed by theYork: D. Appleton.
competent readers in this study. BARNET, S., & STUBBS, M. (1990). Practical guide to writing (6t
Drawing implications for improved textbook mate- Glenview, IL: Scott, Foresman/Little, Brown Higher Education.
rials seems to be more warranted. Readers were consis- BRIDGE, C.A., BELMORE, S.M., MOSKOW, S.P., COHEN, S.S., &
MATHEWS, P.D. (1984). Topicalization and memory for main
tently affected by the characteristics of the passages they
in prose. Journal of Reading Behavior, 16, 61-80.
read. Otherwise competent readers comprehended less BROOKS, C., & WARREN, R.P. (1972). Modern rhetoric (3rd ed.).
accurately when claims were missing and when content York: Harcourt Brace Jovanovich.
extraneous to the structure was introduced. Their accura- CALFEE, R.C., & CHAMBLISS, M.J. (1987). The structural design fe
cy seemed to be particularly affected by misleading in- tures of large texts. Educational Psychologist, 22, 357-378.
CALFEE, R.C., & CHAMBLISS, M.J. (1988, April). Structure in socia
troductions and conclusions. In a few cases, reader
studies textbooks: Where is the design? Paper presented at the a
comprehension was seriously disrupted. To be sure, it is al meeting of the American Educational Research Association,
not always either necessary or desirable for readers to Orleans, LA.
COOPER, L. (1932). The rhetoric ofAristotle. New York: Appleton- POLLARD, P. (1982). Human reasoning: Some possible effects of avail-
Century. ability. Cognition, 12, 65-96.
CORBETT, E.P.J. (1965). Classical rhetoric for the modern student. RAMAGE, J.D., & BEAN, J.C. (1995). Writing arguments: A rhetoric
New York: Oxford University Press. with readings (3rd ed.). Boston: Allyn & Bacon.
CREWS, F. (1992). The Random House handbook (6th ed.). New York: ROSENBLATT, L.M. (1978). The reader, the text, the poem: The transac-
McGraw-Hill, Inc. tional theory of the literary work. Carbondale, IL: Southern Illinois
DOLE, J.A., DUFFY, G.G., ROEHLER, L.R., & PEARSON, P.D. (1991). University Press.
Moving from the old to the new: Research on reading comprehen- ROSENBLATT, L.M. (1994). The transactional theory of reading and
sion instruction. Review of Educational Research, 61, 239-264. writing. In R. Ruddell, M.R. Ruddell, & H. Singer (Eds.), Theoretical
ENGLERT, C.S., & HIEBERT, E.H. (1984). Children's developing aware- models and processes of reading (4th ed., pp. 1057-1092). Newark,
ness of text structures in expository materials. Journal of DE: International Reading Association.
Educational Psychology, 76, 65-74. RUDDELL, M.R. (1994). Vocabulary knowledge and comprehension: A
GARNER, R., & ALEXANDER, P.A. (1991, April). Skill, will, and thrill: comprehension-process view of complex literacy relationships. In
Factors in adults' text comprehension. Paper presented at the an- R.B. Ruddell, M.R. Ruddell, & H. Singer (Eds.), Theoretical models
nual meeting of the American Educational Research Association, and processes of reading (4th ed., pp. 414-447). Newark, DE:
Chicago, IL. International Reading Association.
GILBERT, D.T. (1991). How mental systems believe. American RUDDELL, R., RUDDELL, M.R., & SINGER, H. (1994). Theoretical mod-
Psychologist, 46, 107-119. els and processes of reading (4th ed.). Newark, DE: International
HAIRSTON, M.C. (1992). Successful writing (3rd ed.). New York: W.W. Reading Association.
Norton. SHOPEN, T., & WILLIAMS, J.M. (1981). Style and variables in English.
HARE, V.C., RABINOWITZ, M., & SCHIEBLE, K.M. (1989). Text effects Cambridge, MA: Winthrop.
on main idea comprehension. Reading Research Quarterly, 24, SIMON, H.A. (1981). Sciences of the artificial(2nd ed.). Cambridge,
72-88. MA: MIT Press.
Received May 30, 1991 per based on the dissertation was presented at the 1991 IRA annual
convention in Las Vegas.
Final revision received November 9, 1994
Accepted December 14, 1994 I gratefully acknowledge the support and encouragement of
the members of my dissertation committee: Robert Calfee, principal
advisor; Richard Snow; and Stephen Witte. I also thank Janice Dole,
AUTHOR NOTES
Ruth Garner, Roger Bruning, and Robert Calfee for their helpful com-
This article is based on a dissertation submitted to the School
ments on earlier drafts of this article. Their input, as well as the feed-
of Education, Stanford University, in partial fulfillment for the degree back of four anonymous reviewers and the three editors of Reading
of Doctor of Philosophy. The dissertation was among the 10 finalistsResearch Quarterly, helped to fine-tune my thinking and clarify my
in IRA's Outstanding Dissertation Award 1990-1991 competition. A writing.
pa-
The International Reading Association has recently created a Division of International Develo
will serve to coordinate Association support for literacy activities in the developing world. A
jective of this Division is to establish and manage a volunteer consultancy service in order to of
perienced professional educators on short-term assignments to those developing countries pur
for all. This will be done in conjunction with the IRA ad hoc committee-Volunteers for
Professional Programs.
Interested applicants with strong experience in teacher education and educational assessm
send a brief Curriculum Vitae to the attention of the Director, International Development Div
particular interest will be applicants who have experience in multicultural and internati
Curricula Vitae will be used to build an active database and submission in no way represents a
on the part of the applicants.