Professional Documents
Culture Documents
National Council of Teachers of English Research in The Teaching of English
National Council of Teachers of English Research in The Teaching of English
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide
range of content in a trusted digital archive. We use information technology and tools to increase productivity and
facilitate new forms of scholarship. For more information about JSTOR, please contact support@jstor.org.
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
https://about.jstor.org/terms
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands
of Analytic Writing
Russel K. Durst, University of Cincinnati
The author would like to thank Arthur Applebee, Judith Langer, and Siusan Durst for
their help with this project.
347
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
348 Research in the Teaching of English
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 349
pausing, and revising than does narrative writing, providing further evidence
that students find analytic writing more difficult than narrative.
But these studies focus mainly on writers' rhetorical strategies, such
audience awareness and revising, largely ignoring facets of the writ
process that involve thinking about subject matter itself. They do not examin
writers' ways of thinking through content in forming, refining, and elaborat
ing ideas - that is, they ignore the critical thinking about subject matt
which many educators view as so important. Also, these studies do
examine the genre conventions writers use, at both local and global levels
text, in constructing analytic essays. Such considerations are central
studying school-sponsored analytic writing, the purpose of which is primarily
to help students master both content information and writing skills. Th
the present study focuses on the cognitive and linguistic properties of analyt
writing by examining secondary students' composing processes as they wr
and by analyzing the structure of their texts. So the specific characterist
of analytic writing can be clearly shown, the study contrasts analytic
chronological summary writing about material presented in history read
passages, as history is one of the content areas that most strongly emphasizes
analytic writing.
Method
Students
Twenty high school juniors, ten boys and ten girls, took part in the study. All
were enrolled in one of three sections of one teacher's eleventh grade
American History class at a suburban high school near San Francisco. This
teacher had been through inservice training by the Bay Area Writing Project
and used writing activities regularly in his classes. Half of the boys and half
of the girls were classified as high ability and half as average ability student
writers, based on the teacher's overall appraisal of their writing.
Each student read and wrote essays on two passages from popular eleventh
grade American History textbooks. "The Great Depression" (1580 words)
focused on the impact of the Depression on the U.S. economy, while
"Questions of Loyalty" (1713 words) discussed the impact of the McCarthy
Era on U.S. political life. Both had an llth/12th grade readability level (Fry,
1968). Passages were organized chronologically rather than analytically, so
that students would need to construct their own analyses, rather than simply
repeating analyses presented in the passages. Thus, the use of chronological
passages, while allowing us to examine how students summarize and analyze
narratives, provides no information on how students repond to analytic texts.
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
350 Research in the Teaching of English
Instruments
Each of the 40 protocols was transcribed verbatim, then broken into separate
communication units (defined as segmentable, distinct comments concerning
an idea or action, typically corresponding to T-units; Hunt, 1965). Each
contained a main clause and all the subordinate clauses attached to it.
However, because of all the false starts and pauses common in oral speech
communication units were not always grammatical sentences. Remark
directed toward the researcher, which comprised less than one percent of
total communication units, were not analyzed.
A detailed coding system was employed to analyze the protocols. This
system, based on Langer's (1986) study of the reading and writing processe
of third, sixth, and ninth grade students, was designed to capture th
particular differences in high and average eleventh grade writers' processe
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 35 1
"I'm going to write about atomic secrets next." "It talks about the
Cold War, so I'll write about the Cold War."
4. Higher Level Planning. More global or abstract plans focusing on the
writing process, written text structure, or the need for connections
between unrelated ideas and events from the reading.
"I want to show how bank failing relates to the entire topic." "I've
gotta come up with a good, solid thesis."
5. Restating Content. Repeating what is in the reading passage or writers'
own texts.
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
352 Research in the Teaching of English
2. Product. The writer discusses the piece itself, focusing on the develop-
ment and shaping of the written message.
"McCarthy was finally condemned by the entire Senate." "This is
sort of a vague beginning."
The protocols were analyzed several times, first to establish the category
system, then to refine the system, and then to validate it and check the
analyses. Interrater agreement was checked by a second trained coder, who
analyzed 120 randomly selected communication units, three from each
protocol. Percent of exact agreement for categorizing communication units
was 91 for cognitive operations, 89 for text unit, and 91 for focus.
Essay Analyses
Three separate analyses were carried out on the 40 student essays collected
during the study. They involved 1) an examination of level of abstractness;
2) a measure of the hierarchical organization of content; and 3) an analysis
of cohesive devices students used to connect pieces of text.
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 353
After the essays were coded for level of abstractness, the entire sample was
coded again by a trained rater. Percent of exact agreement was 88. Differences
between raters were resolved through discussion for final coding.
Hierarchical Content Organization. Each of the essays was examined for
hierarchical structuring of information, using a procedure based on Meyer
(1975, 1981) and Langer (1986). This procedure depicts essay content arrayed
in a tree diagram representing text organization. Interpropositional relation-
ships are depicted by rhetorical predicates specifying hierarchical relations
among propositions. The text is first divided into T-units, then each T-unit
is coded as representing a particular type of predicate. The categories are
defined below:
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
354 Research in the Teaching of English
Design
The study used a factorial design involving repeated measures and random-
ized blocks. Repeated measures contrasted the writing tasks themselves
(analysis vs. summary). Fixed factors included writing ability (high, average),
sex, reading passage (1,2), and passage-task sequence (four possibilities).
The sequence in which students were given the passages and writing tasks
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 355
Procedures
The data were collected over a two month period, with a member of th
research team meeting with each student individually for each of thre
sessions. In the first meeting, the project was explained, then students w
given training in the techniques of thinking aloud while writing. (See Dur
1985, for detailed training procedures.) In the next two sessions, stude
first read a history passage on material they had not studied in class, th
composed aloud on a topic based on their reading. Sessions took place in
quiet room and lasted 50 minutes.
The student sat at a table across from the researcher, who described t
session format and asked the student to read one of the two passages. Af
completing the passage, the student was given a writing prompt and ask
to read it carefully. If there were no questions, the tape recorder was tur
on, a microphone placed beside the student, and composing aloud began
Because students had considerable practice in the technique, they showe
little anxiety at composing aloud and being recorded. Students were tol
they could refer back to the reading if they wished. They wrote for 3
minutes while the researcher sat across the table taking notes on th
writing. Because not all composing processes are revealed in think-aloud
protocols, five minutes were spent at the close of each session in retrospectiv
interviewing, with students answering questions about their writing behavior
The retrospective discussions and the think-aloud protocols were ta
recorded and transcribed.
Data Analysis
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
356 Research in the Teaching of English
Composing-Aloud Protocols
Cognitive Operations
Assuming that analysis places greater demands upon the writer than
summary, we would expect more use of such operations as higher-
questioning and higher-level planning. Similarly, we would anticipate m
construction of new meanings and more evaluation in response to ana
writing prompts, where students should have to pay closer attention to
developing ideas than in response to summary writing prompts, where
could rely more on reading passage content. Thus, we would expect m
restating of passage content and more lower-level questioning and plan
in summary writing. Table 1 lists mean percent of communication units
cognitive operations in analytic and summary writing by task and ability.
As expected, the multivariate effect for differences between cogni
operations in response to analytic and summary writing prompts was h
significant (F[7,8] = 10.06, p < .002). These differences were expl
further in univariate analyses of variance. Restating of passage conten
occurred much more often in summary writing than in analysis (F[l,
26.87, p < .001), as did lower-level planning (F[l,14] = 19.70, p < .001
contrast, while writing analytically, students asked more higher-level questi
(F[l,14] = 20.11, p < .001), made more statements indicating higher-
planning (F[l,14] = 11.21, p < .005), did far more constructing of n
meanings from passage content (F[l,14] = 30.76, p < .001), and did m
evaluating of their writing (F[l,14] = 3.19, p < .096).
Taken together, these results strongly indicate that students writin
analytically employed a more varied and complex set of cognitive operat
than when writing summaries. These contrasting patterns are illustrat
the following excerpts from the composing-aloud transcripts of Marian
high ability student writer. The first example is from near the end of
analysis of "The Great Depression" reading, while the second is from la
her summary of the "Questions of Loyalty" passage. On the left side of
page the communication units are listed; the right side lists the cogn
operations she engaged in.
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 357
Marianna's Analysis
Marianna's Summary
communist expansion.
Uh, the McCarren-Walter Act was proposed and Restatement
passed by Truman.
Restatement
Wait, proposed and passed by Congress, not Truman
Restatement
It stated, it regulated foreign subversives out of the
U.S.
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
358 Research in the Teaching of English
|
1
J
bo
C
.2 ^
D
2 .2 -S^S P^ ^P O4Cvl ^^ ^^
5 '5 bOcuJS oovd t^^ ood c^tjh' xniri
6 g
^ I s
to
Sis o
o o o' 3* S~
^ C C SS C C
^.Q i^oo
«oo ^.Q i^oo
s,Q ^c^)
^ Q^ ^.Q
<c^
| S^ !$ £^ | i2S IS
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 359
9OC5 rt^ 00
O> <£> © CO
O4 ^ C) ~*
o<S rt^ t^ ©
00 orj ^
? ^ |
5 tOOO'^OOOOOOVO
cmo csjoi; k. 9^.9C><«^00.00.00.
^ s
*^* t/5 s«^ 00 <-^ "- ^ 00 00 00^ 00^ 00^ 00^
^ T ^ S
T oo^ ooo ^
i^
3 i^ta
w >r
a 5^
5 x
x
~ o »n oo ^ ^ >* So ^pfi" S
3 rrt -jQ £ c« ^ rrt rc« cs c«
i>- oo oqo
a^ ^ri oo *n
■I I
£r
■si -
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
360 Research in the Teaching of English
Text Unit
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 361
Table 2
Text Unit
Summary
High M (10) 90.1 6.2 3.7
Ability SD 4.0 3.2 2.1
Multivariate Ef
Effect df F P
Task 3,12 4.85 .020
Ability 3,14 3.02 .065
Sex 3,14 0.91
Passage 3,12 1.47
Block 9,83 2.22 .028
Task by Ability 3,12 1.37
Task by Sex 3,12 0.31
Passage by Ability 3,12 0.19
Passage by Sex 3,12 1.46
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
362 Research in the Teaching of English
Isaac's Analysis
Communication Units Text Unit
Intermediate
Okay, I have it, the first paragraph, down.
It just sums up what I'm going Intermediate
to write about.
And I have to go into differentIntermediate
ideas.
Intermediate
I should look over the essay, to see what stuff to
include.
Isaac's Summary
Communication Units Text Units
Trying to think what else other than stocks went up. Local
Guess I'll say money. Local
Focus
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 363
Table 3
Focus on Process
Analysis
High M (10) 20.0
Ability SD 6.9
Summary
High M (10) 14.0
Ability SD 6.4
Multivariate Ef
Effect df F P
Task 1,14 14.62 .002
Ability 1,16 7.49 .015
Sex 1,16 1.31
Passage 1,14 1.46
Block 3,36 0.96
Task by Ability 1,14 1.19
Task by Sex 1,14 1.04
Passage by Ability 1,14 0.89
Passage by Sex 1,14 0.08
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
364 Research in the Teaching of English
Kendall's Analysis
Communication Unit Focus
Kendall's Summary
Communication Unit Focus
Essay Analyses
Level of Abstractness
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 365
Table 4
Number of Essays
Summary Analysis Total
Generalized 9 4 13
Narrative
Foregrounded/
Backgrounded 11 1 12
Narrative
Unfocused 0 8 8
Interpretation
Focused 0 7 7
Interpretation
Total 20 20 40
Effect df Chi-square* P
Task 1 20.91 .001
Ability 1 1.71
Sex 1 0.00
Passage 1 0.00
Block 1 0.32
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
366 Research in the Teaching of English
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 367
Leaving aside the comparative depth in which the two students explore th
topics and the level of detail they use to support their respective theses,
see that, in the second example, Tyne provides more of a summary of
certain aspect of the reading than an analysis of it. That is, she relates p
of the passage, about politicians' mistrust of communists, rather th
thinking through the details and extracting a critical lesson from them
Clearly then, the types of analysis characterizing students' analytic ess
varied considerably.
Table 5
Number of Essays
Predicates Summary Analysis Total
Evaluation 0 14 14
Description 15 5 20
Sequence 5 16
Total 20 20 40
Effect df Chi-square* P
Task 1 18.57 .001
Ability 1 2.75
Sex 1 0.00
Passage 1 0.11
♦Because
Descrpit
predicat
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
368 Research in the Teaching of English
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 369
Table 6
Number of Predicates
Multivariate Effects* df F P
•Evaluation
summary
writing
summar
accompa
content
"Question
Deparess
occupy in
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
370 Research in the Teaching of English
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 37 1
of events from the reading. The pattern exhibited in Don's summary essay
is quite different. Here he begins with a description of time period, followed
by a description of the causes of the Depression, as discussed in the reading.
The next three statements, though chronological in nature, are coded as
part of an explanation [collection], since their primary purpose seems to be
not simply to relate events, but to discuss the causes of particular events.
In addition to the strong task differences, there was also an unexpected
significant difference for reading passage (F[4,ll] = 3.33, p < .05), due
primarily to students' greater use of explanation predicates when writing
about the passage "The Great Depression," as we in fact see in the excerpts
from Don's essays. Univariate analysis reveals that this was the only passage
difference to achieve significance (F[l,14] = 11.21, p < .005). This finding
can perhaps best be explained by examining the passages themselves. The
Depression passage largely concerned the causes of the Great Depression,
with a major section of the reading devoted to discussing its causes. The
passage "Questions of Loyalty," on the other hand, focuses more on the
events surrounding Joseph McCarthy's rise to power, rather than on a detailed
explanation of the causes of his rise. This emphasis on causes is reflected in
Don's essay on the Depression passage. Hence, the evidence suggests that,
whether analyzing or summarizing, students were often strongly influenced
in the points they made by the passages which they were writing about.
Cohesive Conjunctions
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
372 Research in the Teaching of English
Table 7
Number of Predicates
Multivariate Effects df F P
Task 4,11 0.27
Ability 4,13 1.56
Sex 4,13 1.91
Passage 4,11 3.30 .05
Block 12,88 0.71
Task by ability 4,11 1.91
Task by sex 4,11 0.58
Passage by ability 4, 11 0.86
Passage by sex 4,11 1.12
Discussion
This study began with a question: What are the particular demand
analytic writing? More specifically, what composing processes do stud
employ in analytic writing, and how can their written products be character
ized? To investigate these issues, the study contrasted students' respons
prompts asking for analytic and summary essays. We have seen that ana
clearly invoked a different set of writing behaviors than chronolo
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 373
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
374 Research in the Teaching of English
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
Cognitive and Linguistic Demands of Analytic Writing 375
well. If, as educators, we truly wish to foster in students the use of higher-
level thinking processes, then we need to encourage writing tasks in which
students do their own analyzing, rather than finding a ready-made interpre-
tation to summarize. We must not undermine the power of writing to act as
a heuristic - a tool for critical thinking.
References
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms
376 Research in the Teaching of English
This content downloaded from 37.17.142.61 on Thu, 30 Apr 2020 15:14:13 UTC
All use subject to https://about.jstor.org/terms