You are on page 1of 64

DOCUMENT RESUME

ED 266 436 CS 008 338


AUTHOR Marzano, Robert J.; Hutchins, C. L.
TITLE Thinking Skills: A Conceptual Framework. A Special
Issue of "Noteworthy."
INSTITUTION MidContinent Regional Educational Lab., Aurora,
CO.
SPONS AGENCY Office of Educational Research and Improvement (ED),
Washington, DC.
PUB DATE 85
NOTE 64p.
PUB TYPE Information Analyses (070)
EDRS PRICE MF01/PC03 Plus Postage.
DESCRIPTORS Abstract Reasoning; *Cognitive Processes; Curriculum;
Educational Change; *Educational Research; *Learning
Theories; Memory; *Models; *Psychological Studies;
Schemata (Cognition)
IDENTIFIERS *Thinking Skills

ABSTRACT
The first chapter of this publication, which focuses
on a new definition and integration of thinking skills in the
curriculum, presents a model that unifies current research and theory
with a new understanding of the traditional notion of content and
with a different approach to instruction. The model proposed in this
chapter synthesizes recent research around three interactive
elements, which make up the second through fourth chapters: (1)
content thinking, which includes declarative, procedural, and
contextual knowledge, and the integration of these elements; (2)
reasoning, which consists of transferring content (that is, storage
and retrieval of declarative, procedural, and contextural xilowledge),
matching these elements with what is already known, and restructuring
or producing new knowledge; and (3) learning to learn, which
describes attending (paying attention), setting goals, monitoring
attitudes, and selfevaluating the thinking processes. The document
concludes with a discussion of a few restructuring issues considered
necessary for the systematic teaching of thinking skills;
specifically, how each of the three thinking skill areas necessitates
fundamental changes in schools, testing, evaluation, and the
integration of instruction. (EL)

***********************************************************************
Reproductions supplied by EDRS are the best that can be made
from the original document.
***********************************************************************
A Special Issue of Noteworthy

,,i CrAl
.0
ri 16;1'4*
fr.+1 lig,

A CONCEPTUAL FRAMEWORK
U.S. DEPARTMENT OF EDUCATION
Robert J. Marzano NATIONAL INSTITUTE OF EDUCATION
EDUCATIONAL RESOURCES INFORMATION
CENTER (ERIC)
C. L. Hutchins This document has been reproduced as
received from the person or organization
originating it.
U Minor changes have been made to improve
reproduction quality.

Points of view or opinions stated in this docu


ment do not necessarily represent official NIE
position or policy

MID-CONTINENT REGIONAL EDUCATIONAL LABORATORY


1

.1 'oteworthy is a publication of the Mid-continent Regional


Educational Laboratory (McREL). McREL is a non-profit
organization, funded in part by contracts and grants from the
Office of Educational Research and Improvement (OERI) of
The United States Department of Education. This issue of
Noteworthy has been supported by a contract from OERI. The
opinions expressed do not necessarily represent official OERI
or Department of Education policy.

McREL serves a seven-state region consisting of the states of


Colorado, Kansas, Missouri, Nebraska, North Dakota, South
Dakota and Wyoming. Its mission is to help improve educa-
tional practice in this region and further the quality of edu-
cation across all groups of students.

3
A CONCEPTUAL FRAMEWORK

Robert J. Marzano
C. L. Hutchins

Copyright © 1985
by the Mid-continent Regional Educational Laboratory
Aurora, Colorado Kansas City, Missouri
MIIINIMIMME11=1111=1111=11111M1111

4
DEDICATIONS

To Dr. Daisy Arredondo for her part-


nership and support.

R. J. M.

To Miriam F. Jeffrey for many hours of


inspiration, especially those early morn-
ing classes for one.

C. L. H.

ACKNOWLEDGEMENTS

Yvonne Theisen for typesetting.

Steve Niemczura for graphics and design.


Lyn Moran Hutchins for proofreading.

5
TABLE OF CONTENTS
Page
AN OVERVIEW I

A New Learning and Teaching Model 3

Content Thinking 3

Reasoning 5

Learning -to -Learn 7

Unification 8

Advance Organizer 9

CONTENT THINKING 10

Declarative Knowledge 10

Procedural Knowledge 19

Contextual Knowledge 20

Integration of Declarative and Procedural


Knowledge 21

REASONING 23

Transferring 24

Matching 25

Restructuring 31

LEARNING-TO-LEARN 38

Attending 38

Setting Goals 39

Monitoring Attitudes 40

Self- evaluating 42

RESTRUCTURING ISSUES 45

The Teaching of Content Thinking 46

The Teaching of Reasoning Skills 47

The Teaching of Learning-to-Learn Skills 47

Evaluation 48

Instruction 48

REFERENCES 50
AN OVERVIEW
OVERVIEW

Helping students learn how to think effec- No educator would deny the importance of
tively is a high priority for every educator. trying to teach students how to think. The
We are all aware of how much the future problem is how it should be done.
demands that students be able to process
ever-increasing amounts of information, One approach is the introduction of a spe-
make complex decisions and cope with the cial,.supplementary activity to help students
uncertainties of a rapidly changing world.. master thinking skills. This add-on approach
to improving higher level thinking skills of-
If our instincts did not to tell us how impor- fers little hope for success. One difficulty is
tant thinking skills are, a variety of studies that it requires cramming yet another activ-
and reports have made the point. For exam- ity into an already tight curriculum. Too of-
ple, the presidentially commissioned report, A ten we have met the demand for change by
Nation At Risk (1983), indicates that higher adding another course to the curriculum.
levels of thinking skills should be taught in The current course of study simply can't
schools. The Educational Commission of the stand another entry unless some equally de-
Statcs, in a report entitled The Information sirable activity is displaced.
Society: Are High School Graduates Ready?
(1982) states that: Block (1985) suggests another obstacle to in-
troducing thinking skills as a separate course
Today's minimum skills are demon- in the curriculum. He points out that the
strated successfully by a majority of current "back-to-basics" movement is an ef-
students. Higher order skills, however, fort to counter the anti-egalitarian effect of
are achieved only by a minority of 17- crcating discrete programs for select groups
year -olds. If this trend continues, as
many as two million students may and select types of learning (e.g., gifted and
graduate in 1990 without the skills nec- talented, learning style programs and com-
essary for employment in tomorrow's puter literacy). He argues that because edu-
marketplace. (p. 2) cation functions as a centrist force in our so-
ciety, the continued fracturing of a core cur-
The College Board and other educational r;culum reduces the effect that common ex-
groups have also emphasized the importance periences and shared values have in holding
of curriculum change that will ensure the the society together. As a result, add-on pro-
teaching of thi iking skills in America's grams will face stiff pressure from public
schools. These calls parallel the messages policy, no matter how logical they are.
contained in such recent best-sellers as Mega-
trends (Naisbitt, 1982) and In Search Of Ex- Another reason that an add-on approach is
cellence (Peters and Waterman, 1982). not likely to succeed is provided by Bereiter
1

7
(1984). He warns that unless thinking skills formation or skills to be mastered, providing
instruction is integrated into existing instruc- students with an opportunity to learn with
tional practices it will not be reinforced and appropriate guidance and feedback, and
used. Such an approach, he argues, will go building speed and accuracy through inde-
the way of all frills. In other words, since pendent work; the outcome is then measured
thinking is what schools are supposed to be by some paper and pencil, objective test.
all about, if the approach used to teach Similar models have been suggested by many
thinking is not a part of every course, it is others.
unlikely that students or teachers will
assimilate it into their routines for learning These step-by-step approaches to teaching do
and teaching. not directly accommodate differences in how
students process information and they do not
Another difficulty with most current ap- take into account the most recent un-
proaches to teaching thinking skills is that derstanding we have from such fields as cog-
they start with the premise that basic think- nitive psychology ana psycholinguistics. For
ing skills already are taught but that "higher example, most current teaching tries to assure
level" or "hi her order" skills are not taught, "objectivity" in the teaching and testing pro-
In fact, the current research and theory on cess by asserting that there is only one "right"
information processing or "thinking" does not answer and only one "right" way to arrive at
support a distinction between a set of "lower" that answer. In the Bloom model the student
level skills and a different set of "higher" is asked to demonstrate mastery of an
skills. If there is a higher-lower distinction "objective" before he or she goes on to an-
to be made, it is in the varied levels of com- other objective. Neither life nor advanced
plexity inherent in the content we ask stu- work in any academic area is like that.
dents to master or the problems we ask them
to solve. Current research and theory on cognition
suggest that knowledge of an academic area
What is needed is a reconceptualization of is fluid and generative. As we learn more
our current curriculum and instructional we reshape or restructure what was previ-
practices. We need to integrate a systematic ously learned. Consequently, students need
approach to introducing thinking skills into to develop thinking skills that will help them
the school experience so that students can identify contexts in which alternative an-
develop the skills to cope with ever-increas- swers are possible and to identify optional
ing complexity in their studies as well as life strategies for arriving at those answers.
in general. To do that will require the de- Thinking is not likely to flourish when all
velopment of a new, unified approach to that is required of students is to figure out
defining what we mean by thinking skills the teacher's or textbook writer's conception
and the integration of those thinking skills of a given content area.
into the daily interplay among teacher, stu-
dents and curriculum. That is not to suggest that a thinking skills
program should igi.ore "content." Quite the
The development of such an approach will contrary, a comprehensive approach to im-
mean a significant change in current peda- proving thinking skills will emphasize the
gogy. Current state-of-the-art instructional mastery of content; but it will do so by help-
models arc not as learner-oriented as they ing students organize and process content in
need to be. These models represent theories a generative way. Thus, in addition to pro-
about instruction more than they do theories viding students with a framework for mas-
about how people 1,:arn. For example, Ben- tering content, lc would also help them de-
jamin Bloom's mastery learning model was velop strategies for processing information
developed within the traditional framework and help them consciously develop learning
of ensuring that students master "content." skills. Introducing such an approach into
The model emphasizes the importance of most class-ooms will require a significant
defining a concrete outcome for an instruc- shift in how teachers view curriculum and
tional activity, presenting or modeling in- what they do with it. Such an approach also
2
8
will have a dramatic impact on how teachers Sternberg's (1984) insistence that instruction
and students work together, what their goals in reasoning and thinking be based on sound
are and how we judge their achievements. theory and the best available research.
Fortunately, there is new theory and research At the core of our unitary approach is An-
to sustain such a shift in our conceptions of derson's 1983 model of cognition. His own
teaching and learning. The purpose of this words provide the best way to describe a uni-
chapter is to present a model that unifies tary approach to cognition:
current understanding of thinking and learn-
ing with a new understanding of the tradi- The most deeply rooted preconceptions
tional notion of "content." The model implies guiding my theorizing is a belief iii the
an entirely different way of approaching in- unity of human cognition, that all
struction. Those who are familiar with such higher cognitive processes, such as
memory, language, problem solving, im-
areas as cognitive psychology, artificial in- agery, deduction and induction are dif-
telligence, psycholinguistics and human moti- ferent manifestations of the same un-
vation will be. able to identify how the model derlying system." (Anderson, 1983; p.1)
is tied to those theoretical bases. For those
not familiar with recent developments in Anderson was not the first to propose a uni-
these areas, it will provide an introduction to tary conception of cognition. Several others
somc of the most significant new ideas avail- have used a unitary approach to explain such
able for improving education. constructs as problem solving (Newell and
Simon, 1972), inference (Lehnert, 1978) and
general schema systems (Bobrow and Wino-
grad, 1977). Anderson has simply taken the
idea farther than anyone else in explaining
MIPAIII thinking.
A New Learning and
Teaching Model The remainder of this chapter will introduce
our unitary approach to defining the nature
The model proposed synthesizes recent re- and interaction of the three elements of our
search around three interactive elements: model (content thinking, reasoning and learn-
ing-to-learn).
1. Content Thinking

ff----
2. Reasoning

3. Learning-to-Learn.
1. Content Thinking
These elements are interactive; none of the
elements is easily taught alone. Nor, in isola-
tion, do they closely resemble how we actu- Anderson and others (Johnson-Laird, 1983;
ally think. Any approach to defining content Winograd, 1973) distinguish between two
must take into account the way in which the types of memory:
mind processes that content and the motiva-
tion for learning the content. a. Declarative
We see these elements as so interactive that b. Procedural.
we have described our approach as a "unitary
model." We believe this approach is consis- Our model incorporates these two types of
tent with the comprehensive approach to cur- memory as two different kinds of content
riculum suggested by Tyler (1975) and Gow thinking along with a third:
and Casey (1983) and current theory on hu-
man behavior. It also ;s consistent with c. Contextual.

3
a. Declarative Knowledge primary resources in a history class or learn-
ing how to balance two sides of an equation
Declarative knowledge contains information in algebra. In general, this distinction be-
about the world; in the broadest sense, it is tween declarative and procedural knowledge
the substance of everything we know. As is not alien to how most teachers think about
Sywlester puts it, declarative memory con- the content of what they teach. In practice,
firms who/what/when/where/why facts. He however, they are not always able to define
also indicates that "mastei y of a procedure or the declarative knowledge of their subject or
skill often begins at the declarative memory the procedural knowledge of their discipline.
level" (1985; p. 71). This assertion is consis- Current practice could be improved if teach-
tent with research findings about learning ers and curriculum developers systematically
classroom contentnamely that without fac- identified and distinguished the declarative
tual knowledge students have little success in and procedural knowledge they want their
acquiring the procedures within a content students to master.
area (Heller and Rcif, 1984; Larkin, 1981;
Anderson, 1982). We can generalize, then, c. Contextual Knowledge
that one type of knowledge or thinking nec-
essary for understanding content is factual Contextual knowledge is the knowledge we
or declarative knowledge. Later we will sug- must have about the conditions under which
gest a structure for organizing declarative it is appropriate to carry out a specific pro-
content that is consistent with research on cedure. We must know the context or what
cognition. And..:rson calls the "antecedent conditions"
that establish a framework for deciding
b. Procedural Knowledge when and which procedure to execute. Thus,
given the context experienced by most first
Procedural memory contains our knowledge graders, the symbols
of how to do things. It is a second type of
knowledge or thinking necessary for under- 2+2
standing content. For example, a sailor knows
such declarative information as the names of would lead students to add the figures and
various parts of a boat and the characteris- provide the answer 4. But, if the same cues
tics of certain types of storms. But without (2 + 2) are presented in an advertising con-
procedural information about how to raise a text, a designer might see the task as devis-
sail and how to tack, sailing would still be ing a new way to graphically use the symbols
difficult. to convince someone that buying a new
product is as simple as "two plus two." The
An important characteristic of procedural context, then, for when a procedure should
knowledge is that it is integrally linked with be used is as important as the procedure it-
declarative knowledge. The operational steps self. Many times the recognition of the con-
a sailor goes through to tack or that a cook text in which it is appropriatc to carry out a
goes through to "cream" sugar and butter are specific process corresponds to what we think
inextricably tied to the content of sailing of as common sense. Context is seldom
and cooking. These operational steps usually tlught directly in most classrooms.
do not generalize to other situations.
Earlier we stressed the importance of view-
In broad terms, the distinction between de- ing declarative, procedural and contextual
clarative and procedural knowledge defines knowledge in a unified way. An illustration
two quite different domains of content. We of how the three elements arc unified when
not only want students to know the facts and we think is found in the format of an
concepts that define subjects such as history if/then statement called a "production"
or algebra, we also want them to be able to within cognitive psychology. Productions op-
carry out procedures that are inherent in ti.e erate like computer programs in the mind.
"content" of that subjectsuch as using Consider the following:

4
I0
IF: 1: it is snowing, defined. Our framework for defining rea-
2: the time is before 9:00 a.m. soning is also adapt-d from the work of An-
on a work day, derson. His model of reasoning was con-
3: the snow accumulation is six
inches; and, ceived as a set of linear micro-processes he
4: the car I need to get to work used to develop a computer simulation pro-
is in the garage, gram called ACT, Adaptive Control of
Thought. Our model should be understood as
THEN: I shovel the driveway. a metaphor for his since we assume that rea-
soning skills appropriate for classroom use
Technically the if part of the program in- are much more holistic than those designed
cludes the declarative knowledge an individ- for computer simulation. Our model consists
ual has about the nature of snow, its effect of these three elements:
on driving conditions, etc. It also includes
the contextual information about the fact a. transferring content (i.c.,...storage and
that today is a day I have to get to work; retrieval of declarative, procedural and
the action implied by the then part of the contextual knowledge),
program (shoveling the driveway) is the pro-
cedural knowledge. b. matching these elements with what is
already known, and
In summary, a student needs three kinds of
knowledge to master content: 1) declarative c. restructuring or producing new
knowledge about the content, 2) procedures knowledge.
inherent to the content and 3) the contextual
conditions under which the procedures These three elements of reasoning cannot be
should be used. In the absence of any three ordered hierarchically; that is, one is not of a
of these elements, the student will not be higher order than the other. All are neces-
successful. For example, if a person had no sary elements of reasoning. They are all es-
factual knowledge about snow or did not sential to any reasoning process.
know how to shovel a driveway, he or she
would not be able to engage in the appropri- a. Transferring
ate action. Equally important, if a person
did not recognize that it was Monday and This process is what a great deal of school
time to get to work, he or she would not learning is all aboutteaching us to "know"
know it was appropriate to apply the by memorizing and recalling different ccn-
knowledge of the concept of snow to the tent inherent in specific subjects, or problem
procedure of shoveling. If the context were areas. Using the previous example, we must
different, if it were Sunday, not Monday, the know about snow, identify its depth, know
appropriate action might be to go out the effects of different levels of snow on
sledding with friends rather than shovel the driving conditions, recognize that this is
driveway. Monday and we must be at work by nine,
know what time it is, etc.
The processes of matching up these elements
of content brings us to the second part of the According to Anderson, knowledge of this
model. type is a by-product of effectively storing

MEM--
and retrieving information in memory. This
implies that students should not simply be
presented with information; but they should
also be taught effective storage and retrieval
techniques so as to make recognition more
2. Reasoning efficient. In fact, very little instruction of
this kind goes on in most schools now. Later
we will discuss instructirnal strategies for
Reasoning is the process by which we inte- hclp:ng students improve their tranfcrring
grate the three kinds of content we have just skills.

5 11
b. Matching
number 01' discriminate stimuli in the
world, categorizing helps a person
The concept of matching is best explained by "render the unfamiliar familiar, and
Powers (1973) and Glasser (1981). Glasser, because one is able to generalize about
for example, posits that our minds have an object based on knowledge about its
"comparing stations" that control for what we
category, one is able to know more
attend to and direct our behavior, Thus, for about the object than just what can be
example, if you have your "room comfort sta- ascertained by looking at it." (Mervis,
1980; p. 279).
tion" on as you read this chapter, your body
is subconsciously monitoring the temperature
and other room conditions. So long as they (2) Reasoning AnalogicallyFew skills
are within a range you find acceptable, noth- are as pervasive or essential to one's ex-
ing happens. But, if the door is suddenly istence as the ability to reason analogi-
cally. Broadly defined, analogical rea-
opened and you feel a cold draft, you will soning occurs when unfamiliar stimuli
match these incoming signals with your
repertoire of temperature-controlling proce- are introduced with some reference to
dures and you will execute one that is appro- the more familiar. (Alexander, 1984).
priate to the situation. You might, for ex- Thinking by analogy involves solving a
ample, decide to get up and close the door or problem by applying knowledge from
ask the person who came through the door to one domain or situation to another. It
close it. On the other hand, if you arc in a is most typically presented by a prob-
lem like: "limb is to tree as leg is to
context where such actions would be inap- chair."
propriate, you might decide to move to an-
other room where it is warmer. From a cy- (3)
bernetic point of view these comparing sta- ExtrapolatingExtrapolation is the
tions are central to human behavior. We arc process of matching the patterns in one
always looking for or controlling for an- area of content with information in a
tecedent conditions. When we recognize in- totally different context. For example,
formation that does not match with what we we might extrapolate some process in
want or expect, we review our options and cooking (kneading dough) and apply it
change our behavior. to hand washing a sweater.
(4) Evaluating EvidenceEvaluation of
In the real world, of course, this matching evidence refers to the procedures for
process can be either quite simple or quite
complex. And, people possess considerably determining whether information fol-
different levels of this reasoning skill. The lows prescribed rules of logic. Com-
more sophisticated their matching skills arc, monly this translates into identifying
the more "comparing stations" they can use. whether a claim is supported by rele-
vant information. Toulmin (1958;
This sophistication, by the way, is related to Toulmin, et al., 1979) has developed a
our ability to recognize and distinguish com-
plex levels of content. model which helps us evaluate the logic
of claims. (In many thinking skills
Fortunately, we can classify and group the programs this process is called critical
different types of matching processes. It is thinking.)
this classification that produces a list of
thinking activities that are most frequently (5) Evaluating ValueThis is the pro-
identified as "higher order thinking skills." cess of matching information presented
We will describe all of these classifications in with a value system, frequently your
more detail in Chapter 3, but here is a brief own internalized value system. This
description of each matching skill: matching process is consient with
Paul's (1984) conception of "dialectic"
CategorizingGiven
thinking which he asserts is the pri-
(1) the infinite mary thinking skill of the future.
6
12
c. Restructuring A key point to remember is that restructur-
ing creates new knowledge, no matter what
The final type of reasoning skill is the build- its form. This distinction may be difficult to
ing or restructuring of information in long- understand because we usually associate the
term memory. Anderson calls this step idea of knowledge production with a prod-
"execution." The outcome of this effort is, in uct: a book, a finding, a theory, etc. Those
a sense, the production of new knowledgeat are knowledge products, but at a psychologi-
least for the individual involved. cal level, the conclusions we arrive at are
also knowledge products. Whenever we are
There are three restructuring skills: confronted with a problem, attempt to create
something or simply elaborate on what we
(1) ElaboratingElaborating is a pro- perceive, we are building new knowledge.
cess by which we infer information
which is missing. Various categories of
inference have been developed. War-
ren, et al., (1979) for example, distin-
guish among three general types of in-
ferences such as elaborations about 3. Learning-To-Learn
concept characteristics, elaborations
about causality, and elaborations about The third type of thinking we call "learning-
context. Halliday (1967) and Grimes to-learn." This type of thinking is, in a
(1972) add that one can also elaborate sense, our conscious control of the other two
about purpose or goal. Elaboration functions; it is "thinking about thinking."
adds to and greatly expands on what Specifically the process includes:
we perceive or recognize.
a. Attending
(2) Problem SolvingVan Dijk and
Kintsch (1983) state that problems oc- b. Setting goals
cur when there is an explicit goal to be
reached and there are specific opera- c. Monitoring attitudes
tions or mental steps to be performed to
reach that goal. An intrinsic character- d. Self-evaluating our thinking
istic of problems is that there is missing processes.
information and the solving of the
problem involves providing that infor- Research on cognition points out that all
mation. (For example, finding the these functions can be consciously managed.
"unknown term" in algebra.) The miss- And, within the framework of a unified
ing information may be declarative, model, they must be a part of the overall ef-
procedural or contextual in nature. fort to help students improve their thinking.
When the missing information has been Teaching these functions directly frees them
supplied the problem is usually solved. from the tyranny of learning only what oth-
ers have thought before; it is the way we can
(3) InventingInventing is the process advance productivity in our society.
of turning a very general idea into a
finished product. It is a form of cre- In Chapter 4 we will consider learning-to-
ativity. As a process, it is far less learn in depth. Below we briefly describe
structured than problem solving in ei- each component:
ther its form or outcome. The product
of inventing can be a written informa- a. Attending
tion, such as an essay or a poem, a new
machine, a painting, a musical composi- Both Glasser (1981) and Powers (1973) point
tion, etc. out that any individual has thousands of

7 13
"comparing stations." Unfortunately, our thought, "This task should be easy for me" is
working memory can cope with only a few of epistemic. It would control behavior relative
these stations at a time (Norman, 1969). This to the task.) McCombs (1984) asserts that this
means that at any given moment we must type of thinking is the driving force behind
select the comparing stations we use. In goal-seeking behavior. At a common sense
common language the selection of a compar- level most of us would agree that our belief
ing station is called focusing attention. Fo- about whether we can successfully ac:om-
cusing attention or limiting the number of plish a task has a great deal to do with our
comparing stations we have "turned on," in- motivation or willingness to undertake the
creases our efficiency at accomplishing task. Weiner (1972) and others suggest that
tasksso long as we do not exclude impor- another important epistemic thought is our
tant contextual information. Neisser (1967) attitude as to whether effort versus ability is
calls this a controlled state; Lindsay and more likely to produce success. If we believe
Norman (1977) call it a conscious state. Ev- that effort is the key ingredient in success
erything becomes more streamlined because we are more likely to be motivated and to
there are fewer options to consider. At the accept responsibility for carrying out the
same time, however, we must recognize that task. If, however, we belief that ability (or
in focusing our attention on a small set of luck or the work of others) is the key to suc-
comparing stations we have depressed or re- cess and we doubt our ability to carry the
duced our ability to use other stations or, task out, we are less likely to assume respon-
speaking more informally, considering other sibility for the work or to appear to be moti-
options. vated. In other words, a useful attitude is
that sustained effort will eventually lead to
b. Goal-Setting success.
There are two types of attention: automatic d. Self-evaluating
and voluntary (Lura, 1973). Automatic atten-
tion is the attention we involuntarily give to Once an individual actually engages in a
data or information that occurs sponta- task, i.e., sets out to accomplish a goal, the
neously in our environment. Voluntary at- process becomes cybernetic. That is, we use
tention is goal driven; we chose to respond to the goal as a means of changing and correct-
one set of stimuli over another. In other ing our behavior much as a guided missile
words, we are either consciously controlling changes direction and speed based on the in-
what we attend to or reacting unconsciously formation it receives relative to the ap-
to stimuli in our environment. When we set proaching target. In a sense, we are con-
a new goal, we activate a new set of compar- stantly learning as we monitor these signals
ing stations by focusing our attention on and redirecting our efforts. The key to how
those stimuli that are relevant to the goal. well we learn is the degree to which our
monitoring activities are conscious. If we ac-
Helping students understand that they con- tively examine the feedback data we get and
sciously make decisions about what compar- evaluate it in terms of the extent to which it
ing stations they will use and helping them suggests we are approaching our target, we
to understand how they can control attention are more likely to learn. If we don't have
through specific goal-setting behavior aids good feedback data or if we don't listen to
them in improving the efficiency of their it, we are less likely to learn.
thinking as well as their sense of satisfaction
in accomplishing what they have undertaken.
c. Monitoriug Attitudes Unification
As mentioned previously, the model vac have
Once goals are set, epistemic thinking be- described is only an analogy for the real pro-
comes an important factor in learning. Epis- cess of thinking. In the process of thinking
temic thoughts are those attitudes that form we don't break the steps down as neatly as
the basis of one's reality. (For example, the we have described them here and they do not
14
8
occur in a neat, linear fashion as suggested
by our lists; that is why we have described
the model as "unitary." But, at the same
time, by breaking the process down into ele-
ments, albeit abstract elements, we can help
students improve their thinking skills.

Advance Organizer
The pages that follow expand the model with
additional research and theory. The organ-
ization follows the order in which the model
was outlined in this chapter:
Content Thinking
Declarative Knowledge
Concepts
Relationships
Patterns
Procedural Knowledge
Contextual Knowledge
Reasoning

Transferring
Storing
Retrieving
Matching
Categorizing
Reasoning Analogically
Extrapolating
Evaluating Evidence
Evaluating Value
Restructuring
Elaborating
Problem Solving
Inventing
Learning-to-Learn
Attending
Setting Goals
Monitoring Attitudes
Self-evaluating the Thinking
Process.

15
9
iiiMMINM1111----
CONTENT THINKING

The introduction identified three types of plc, 1980; p. 78). For example, the word dog
"content thinking" or knowledge: is a label society uses to represent four-
legged animals with certain characteristics.
1. Declarative Although we will describe concepts in some
depth shortly, for now we can liken concept
2. Procedural knowledge to word or vocabulary knowledge.
We might say that vocabulary knowledge is
3. Contextual. the outward indication of an individual's
store of concepts. It is no wonder, then, that
This chapter will describe all three types and vocabulary knowledge has been cited as one
how they can be integrated into instruction. of the strongest predictors of general aca-
demic ability. For example, Anderson and
Frcebody (1981) report that the strong rela-
tionship between vocabulary and general in-
telligence is one of the most robust findings
1. DECLARATIVE KNOWLEDGE in the history of intelligence testing.
Rcccnt years have seen breakthroughs ir. our b. Propositions
understanding of declarative or factual
knowledge. We now know enough about it to The hierarchical level of information above
draw some conclusions for instruction. For the concept in complexity is the proposition.
example, we know that declarative knowl- Propositions are groups of concepts organized
edge is hierarchical in nature. Basic units in such a way as to be true or false.
are put together to form complex organiza-
tional structures. Thus . . . 'John' is a concept but is not
information that can be true or false in
a. Concepts nature . . . whereas 'John is ill' would
be a proposition because it could be
The most basic unit of declarative knowledge true or false (van Dijk, 1980; p. 207).
is the concept. Within education the term
"concept" is widely misused to represent a va- Thcrc is ample research evidence to show the
riety of constructs. Here we use it in a tech- primacy of propositions in processing infor-
nically rigorous way. A concept is the so- mation (Bransford and Franks, 1971). That
cially accepted meaning of one or more is, we naturally organize information into
words which express the idea or object sym- propositions. They are so basic to the pro-
bolized by the concept (Klausmeicr and Sip- cessing of information that we might say
10

16
they constitute a good operational definition ganized into salient patterns. For the most
of an "idea." part, then, the burdcn is on the student to
create some type of organizational pattern
for information read or heard. In fact, stud-
c. Relationships ies indicate that the most successful students
look for or create patterns as a basic com-
One level higher in the organization of prehension strategy (Goetz, Palmer and
knowledge arc relationships. Relationships Haensly, 1983); less successful learners do not
link one proposition to another. To illus- appear to have this metacognitive awareness.
trate, consider the following: Fortunately, current research indicates that
students can be taught organizational pat-
Bill is tall but ... terns and how to use them as basic tech-
he doesn't play basketball. niques for understanding content area mate-
rial (Taylor and Samuels, 1983; Leslie and
Hcrc there are two propositions: 1) "Bill is Jett- Simpson, 1983).
tall" and 2) "he does not play basketball."
These propositions are connected using a re- Knowing the declarative information within
lationship signaled by the linguistic conjunc- a content area, then, requires a knowledge of
tion "but." Note that this particular relation- the concepts, propositions, relationships and
ship indicates that two propositions have a organizational patterns for propositions.
negative or contrasting relationship to each Three of these four declarative elements rep-
other in some way. Conventional instruction resent distinct areas for instruction. That is,
in grammar does not emphasize this distinc- instruction can and should be planned for
tion and, instead, suggests that all conjunc- concept attainment, relationship identifica-
tions f unction in the same way. Research tion and pattern recognition. Proposition
indicates that if we cannot recognize these recognition has been excluded from the list
basic relationship differences between ideas because there appears to be no need to teach
(propositions), processing breaks down children this form of information organiza-
(Kintsch and van Dijk, 1978; Waters, 1978). tion. As mentioned previously, propositions
are basic to thinking. One theory of infor-
mation processing--called the semiotic exten-
d. Patterns sion theoryasserts that humans are geneti-
cally predisposed to organize information
/Above the level of relationships is a larger into propositions (McNeill, 1975). In other
organizational structure of information words, organizing information into proposi-
called the pattern of knowledge. For exam- tions is so fundamental to thinking that no
ple, when you read a chapter in a textbook formal instruction in the nature of proposi-
you look for the overall pattern of the in- tions is necessary. Research supports this
formation It might be that the chapter is point. For example, Sachs (1967) found that
actually about some major generalization or while memory for specific aspects of a sen-
it might describe a set of events that hap- tence faded quickly, the memory for the
pened in a given order. Generalization and propositional sense of a sentence was re-
sequence are both examples of organizational markably stable. Similar findings have been
patterns. If we miss the overall organization reported by Pearson (1974-75) and Bransford
of a piece of information we might be able and Franks (1971).
to understand bits and pieces of it, but we
will not understand the information as a Below, we briefly consider instruction strate-
unified whole (Meyer, 1975). gies for teaching concepts, relationships and
patterns.
Unfortunately, most textbooks are not writ-
ten in a format that makes these organiza- (1) Concept Attainment
tional patterns obvious to students (Pearson,
1981). Similarly, information presented In the previous section we likened concept
orally in content area construction is not or- knowledge to word knowledgeknowing the
11
17
label (word) society uses to represent a con- example, students should first have experi-
cept. Before discussing instructional tech- ences which create images of the concepts.
niques for teaching concepts we should go They should then be given a label for those
into a little more depth about the nature of experiences. They might then be asked to
concepts. describe what they know about the label.
Over time this description will become more
Some theorists believe that concepts are basi- and more precise until it finally evolves into
cally linguistic in nature (e.g., Klausmeier what we might call a technically accurate
and Sipple, 1980; Fodor, 1976). For example, definition.. A straight-forward instructional
Condon (1968) believes that until a label process for concept instruction might follow
(word) is established for a set of experiences these steps:
no concept exists. That is, without the label
there is no conceptonly experiences stored
in long-term memory. The label organizes Step 1. Provide primary experiences
these experiences into a unified whole. that develop images for the concept
(e.g., visual, tactile, auditory, emo-
Other theorists stress the "imagery" nature of tional).
concepts (e.g., Richardson, 1983; Paivio,
1971). Imagery means more than just Step 2. Provide students with a label
"pictures in the mind." Mental images in- or word to represent the concept.
clude the tactile, auditory, emotional and vi-
sual aspects of perception (Sheikh, 1983). Step 3. Require students to describe
For example, when you ride on a roller- the concept in their own words. Let
coaster you store in you; long-term memory them draw on the full range of their
all the sensations (sounds, feel, emotion) as- experiences. Help them link it to other,
sociated with the ride as well as mental pic- related knowledge and contrast it with
tures of the ride. Those theorists who stress other concepts that have some similari-
the imagery aspects of concept knowledge, ties with the one being learned.
then, claim that you must have a "primary Step 4. Over time
experience" in order to develop a concept. have students
This perspective is consistent with the theo- sharpen their descriptions of the con-
ries of Piaget. cept until it evolves into a technically
accurate definition.
The imagery nature of our knowledge of
concepts is usually overlooked. Instead, vo- Step 2, 3 and 4 are familiar to most subject
cabulary instruction usually focuses on lin- area teachers. The stumbling block in this
guistic development; that is, we ask students process is usually Step 1. How can you pro-
to learn dictionary-like definitions. In the vide primary experiences in all concepts you
absence of an image or experimental base for want to teach? If you wish to teach the con-
the concept, particularly abstract concepts, cept of "parachuting" to young students do
many students develop only the ability to you take then up in an airplane and give
rotely define the concept without integrating them direct experiences?of course not. Step
it into their working knowledge. 1 need not be a stumbling block because
primary experiences do not have to be direct.
Instruction will be most effective when it in- Imagery characteristics can be developed by
tegrates both the linguistic and imagery na- "guided imagery"imagining what an experi-
ture of concepts; the two perspectives are in ence is like. In effect, this is the way we ob-
no way contradictory. That is, instruction in tain primary experiences about most con-
concepts should highlight both the linguistic cepts. Few people have parachuted from an
or verbal nature and the visual, tactile, audi- airplane. However, most people have jumped
tory and emotional nature of the concept. A from a limited height, felt a strong wind
logical sequence for concept development in- rushing against them and stood at a great
struction would be to begin with those char- height. They put the memory of these expe-
acteristics which are related to imagery. For riences together to form their concept of
12

18
parachuting even though they have never di- The importance of concept development im-
rectly experienced it. plies a need for direct, systematic instruction
in vocabulary. This was Becker's (1977) rec-
Guided imagery, then, is a way of artifi- ommendation after a thorough analysis of
cially creating primary experiences for con- the research on various interventions for the
cepts within a classroom setting. The tech- educationally disadvantaged.
nique has a rich theoretical and research ba-
sis. Guided imagery has long been used in Direct instruction in all concepts is not prac-
psychotherapy under the name of.oneirother- tical, however. For example, Harris and Ja-
apy (Sheikh and Jordon, 1983). It has been cobson (1972) identify over 7,000 words
shown to be basic to most memory techniques (concepts) used in elementary school text-
(Bellezza, 1981; Paivio, 1971) and is one of books. Direct instruction in these concepts
the most powerful techniques currently in would require students to learn about 30 new
use in sports training (Suinn, 1983). For ex- words per week. However, other vocabulary
ample, athletes spend a significant amount of studies have established that a relatively
time mentally imaging the feat they are small number of words account for the ma-
about to perform. Also, many of the learn- jority of the concepts encountered by stu-
ing techniques which purport to integrate dents. For example, of the 86,741 common
left and right brain functions (e.g., Hart, English words identified by Carroll, Davies
1983; Zdenek, 1983) are basically adaptations and Richman (1971) over 40 percent ap-
of guided imagery. peared only once in all of the books, journals
and newspapers they studied. Dupuy (1974)
One important feature of these four concept has proposed a viable solution to the problem
attainment steps is that they gradually build by operationally defining a "basic"
to a structured definition of the concept. conceptone which is commonly used in the
Klausmeier and Goodwin (1971) suggest that English language and forms the basis for
a complete definition should include the many other words. That is, if you know a
following components: basic word it provides a vehicle to
understand many other words. Dupuy has
a linguistic definition of the concept estimated that there are only 12,000 basic
words in the English language and only 7,000
the defining attributes of the con- are used in K-12 classroom. If these 7,000
cepts basic words were taught systematically it
would require students to learn only 15 new
examples and non-examples of the words per week. Marzano (1984) asserts that
concept the process can be streamlined even further
if words are presented in "clusters"groups
the taxonomy of which the concept of related concepts. In a study of elementary
is a part including the superordinate- school concepts he found that over 50
coordinate-subordinate relations of percent of those concepts could be organized
the particular concept to other into 15 clusters and over 75 percent into 25
concepts clusters. All elementary school concepts
could be organized into 61 clusters.
some of the principles (or situations)
in which the concept is used The names of the 15 clusters and some exam-
ple concepts from Marzano's word list are
kinds of problems whose solution shown in Table 2.1.
will involve the use of the concept
the names of the attributes of the
concept and related vocabulary
words.

13 19
TABLE 2.1

15 Clusters Identified in Elementary Textbooks (Marzano, 1984)

Clusters: Examples of Words in Number of Cumulative


Each Cluster and Descriptions Concepts in Number of
Clusters Concepts

1. Occupations/careers: man- 364 364


ager, mayor, coach, bus-
inessperson, printer, publisher
2. Types of motion: action, 321 685
stillness, chase, plunge
3. Size/quantity: time, large, 310 995
amount, many, monstrous, two
4. Animals: pet, dog, snake, 289 1284
spider, bird
5. Feelings /emotions: feeling, 282 1566
terror, shame, anger, sad,
happy, love, excitement
6. Food/meal/types of eating: 263 1829
supper, meal, cookie, meat,
vegetables, butter, cook
7. Time/time relationships: 251 2080
lifetime, noon, season,
month, today, earlier,
now, afterward
8. Machine/engines/tools: 244 2324
equipment, engine, oven,
hammer, ax, spoon
9. Types of people: 237 2561
women, boy, neighbor,
dweller, hero, enemy, mother
10. Communications: talk, 235 2796
explain, suggest, question,
command, vow, complain
11. Transportation: car, plane 205 3001
bicycle, ship
12. Mental actions: plan, 193 3194
search, teach, select, believe
13. Human traits: lazy, 175 3369
patient, stubborn, humorous
14. Location/direction: 172 3541
here, back, inside
15. Literature/writing: 171 3712
story, word, poem, pen,
telegram

14 20
One of the reasons why instruction that The way an individual usually recognizes
teaches words in clusters is more efficient is relationships between ideas is by looking for
tied to the way our short-term and long-term various syntactic, semantic and rhetorical
memories work. Research suggests that when signals for those relationships. For example,
we are trying to learn something that will in the sample sentence used earlier the word
not extinguish easily overtime, we must move but signaled that the two propositions had a
it from our short-term memory to our long- contrastive relationship. Many theorists in
term memory. We do that by tying the con- the area of linguistic study called "discourse
cept we are learning to something we already analysis" have attempted to classify the vari-
know; hence the close tie that has been rec- ous types of relationships that can exist be-
ognized between our ability to see associa- tween ideas (e.g., Halliday and Hasan, 1976;
tions among things and our ability to learn Pitkin, 1977). Five basic relationships have
them. When we pull the cluster of concepts been identified: 1) addition, 2) contrast, 3)
like the one we are about to learn from our time, 4) causality and 5) reference. Marzano
long-term memory down into our working and Dole (1983) define these relationships in
short-term memory and hook the new concept the following way for instructional purposes:
into our working understanding of related
ideas, that is the best and most efficient time 1. addition: two ideas "go together" in
to learn other, related concepts. some way; e.g., "He is kind and he is in-
telligent."
Thus, our instructional recommendation is
that we teach concepts in clusters that are 2.. contrast: two ideas "don't go to-
semantically similar or related. The current gether" in some way; e.g., "He is tall but
practice is to have students learn a series of he isn't a good basketball player."
somewhat unrelated words each week. For
example, one week's vocabulary or spelling 3. time: one event happens before,
words are frequently drawn from a story be- during or after another event; e.g., "He
ing read. This practice increases the mental went home- Then he went to the game."
operations involved and favors those students
whose out-of-school experiences or general 4. cause: one :vent causes another;
intelligence makes it easier to perform these e.g., "He went home because Jana went
operations. home."

Going one step farther, we recommend that 5. reference: two ideas share a com-
teachers focus on word clusters that includs, mon concept e.g., "I like Yvonne: she is
words from vocabulary lists one grade level nice."
higher than the grade they teach since most
standardized tests include words from the Students can L taught to look for these rela-
next higher grade than tit student is in to tionships as a way of "linking" information.
increase the difficulty level of the item. We call this process "relationship identifica-
Practically, this is not difficult if you use a tion." It requires that students:
list such as Marzano's (1984) that organizes
all elementary vocabulary words around clus- Identify separate ideas that are related.
ters, by grade level difficulty.
Identify the type of relationship be-
Concept attainment, then, can be approached tween the ideas, (e.g., addition or con-
in a manner that is consistent with the way trast).
individuals naturally learn. We believe that
such an emphasis would increase the declara- Identify the linguistic signal for the
tive content knowledge of all students, espe- relationship (e.g., and, or, but).
cially those who traditionally have trouble
with content area concepts. Activities such as these have been shown to
increase students' comprehension and under-
(2) Relationship Identification standing of the nature of textual information
15

21
(Robertson, 1968; Marshall and Glock, 1978- ships can be further subdivided into 22 dif-
1979). At a more sophisticated level, Ander- ferent relationships each with its own mean-
son (1978) has developed a diagraming tech- ing and linguistic signals. These 22 relation-
nique for relationships which can be used as ships arc illustrated in Figure 2.2.
a study skill activity with complex content
area material. In Anderson's procedure stu-
dents are taught to identify the basic rela- Figure 2.2
tionship between ideas in textbooks and use
symbols (e.g., arrows, equality signs, inequal- Types of Relationships
ity signs) that represent how ideas are related
in an outline representation of the informa- Addition
tion.
1. Equality:
Relzitionship identification activities can also He is tall and he is h:indsome.
go far beyond the level of simply teaching 2. Restatement:
students to recognize relationships. Some I am tired. In fact, I am exhausted.
very deep levels of abstraction can be dis- 3. Example:
cussed and highlighted by considering the He does many things well. For example,
underlying meaning signaled by relationships. he is excellent at cards.
To illustrate, consider the following: 4. Summation:
He does many things well.
She was beautiful but He cooks. He sews.
she was not conceited In he is an excellent homemaker.
Here there are two propositions joined by a Contract
contrast relationship. Recall that the purpose
of a contrast relationship is to convey the I. Antithesis:
message that the joined ideas in some way I will be there, tyl I won't be happy.
"do not go together." A student's ability to 2. Alter native:
recognize this relationship would indicate Either it will rain or it will snow.
one level of awareness. Another level would 3. Comparison:
be the consideration of why these two propo- Bill is tall. In comparison his brother is
sitions "don't go together." That is, the asser- short.
tion that "being beautiful" does not go with 4. Concession:
"not being conceited" implies some basic be- I don t like violence. Nonetheless. I'll
liefs on the part of the author of these meet you at the fights.
propositions about how people who are beau-
tiful sometimes behave. Questions and dis- Time
cussion which highlight this level of meaning
are akin to what Doyle (1983) metacom- I. Subsequent action:
prehension activities. The more sophisticated They went to the game. Aiwward they
these relationships become and the more they went to the dance.
require the readers to bring some knowledge 2. Prior action:
to the text that is not explicitly contained in They went to the dance after they went
it, the more we approach the kind of inter- to the game.
pretive skills we try to teach students when 3. Concurrent action:
they arc confronted with quality literature Bill thought about Mary while Mary
and complex thought. thought about Bill.

Another way of increasing the sophistication Cause


of relationship identification is to make
finer distinctions among the different types I. Direct Cause:
of relationships. Forexample, Marzano He won the race la maintaining his
(1983) has shown that the five basic relation- concentration.

16
2. Result: usually go from 2 to 5 miles depending
Bill went home. Consequently the party on the weather. Next I ....
ended.
3. Reason: The unifying structure for this information
He went to the store be.:ause he needed is a sequence of events that happen in a set
food. order:
4. Inference:
Mary is going on a long trip. In that First I sit up on the edge of tlie bed.
case she should plan well. Then I brush my teeth.
5. Condition: Then it's time for my jog.
Unless you stop, I will leave. Next I ....
Sequence is a very basic pattern used to or-
Reference ganize many different types of information.
1. Same word reference: Six basic patterns, including sequence, have
Bill is my friend. been identified (Marzano and Dole, 1983).
I like Bill. They include:
2. Personal pronoun reference:
BjE is my friend.
I like him. 1. sequence patterns
3. Synonym reference: 2. topic patterns
Bill bought a new car. 3. generalization patterns
This automobile is one of his nicest 4. process patterns
possessions. 5. similarity patterns
4. Metaphoric: 6. dissimilarity patterns.
Bill went to Seattle.
This haven La the weary is located As examples of these other patterns we de-
Washington. scribe topic patterns and generalization pat-
5. Related concept reference: terns below:
Bill bought a new ca.
The fires alone cost $400. Topic patterns are those in which the charac-
6. Whole idea reference (this, that): teristics of a single concept or a few concepts
Mary went out with Bill. are described. Characteristics are: a) states
This bothered Mike. of being, b) habitual actions and c) unusual
actions for the concept. When you identify a
Relationship identification helps students be- concept pattern you are actually identifying
gin to see the interccanectedness of ideas and characteristics of a concept. For example,
the necessity of creating linkages in the in- here is a pattern organized around states of
formation they read or hear. being:

(3) Pattern Recognition My car is the nicest on the block.


Patterns are organizational structures which It is painted blue with white trim.
"hold together" large blocks of information.
A relationship might join two ideas, a pat- It has white-wall tires and a 409 engine.
tern might unify 50 ideas. To illustrate a
pattern consider the following: Generalization patterns are those in which a
set of propositions is an example of another
I have a regular routine I follow in the proposition; here is an example:
morning. First, I sit up on the edge of
the bed to see if I'm alive. Then, I At times life gets difficult.
brush my teeth and wash my face.
Then its time for my morning jog. I Finances become a problem.

17
23
A period of poor health may develop. One pattern students might sec in this pas-
sage is a topic pattern about the concept
Family problems can crop up. "Islamic law":
Work may become boring. Islamic law includes dietary rules:
Here the first sentence is the generalization; Food must be prepared according to
the others are the examples. In many cases a them.
generalization pattern contains a summary Restricted and non-restricted foods
statement at the end, thusly: are listed.
In short, it's easy to lose your zest for The Koran lists specific punishments.
living.
Thieves have their hands cut off.
To a degree, generalization patterns are re- Each crime has a specific punishment.
lated to topic patterns. The primary differ-
ence is that topic patterns contain character- It also explains the place of women:
istics of a concept; generalization patterns
contain examples of a statement. Women must obey their husbands.
The first step in teaching pattern recognition Wives have their place.
is to tcach students the different types of Wives are allowed to leave home only
patterns by name. Once this is done students for a brief time.
can use those patterns to organize informa-
tion they read or hear. To illustrate consider Another pattern a student might see in this
the following excerpt from a social studies information is a generalization pattern:
text:
Islamic law is very restrictive:
Islamic laws include dietary rules.
Food must be prepared according to It dictates which foods can and
these rules. Foods that may and may cannot be eaten.
not be used are listed. Muslims may
not drink alcohol. This includes wine, It prescribes specific and harsh
beer, and whiskey. They are not al- punishments for criminals.
lowed to eat pork, either. Devout Mus-
lims often say that people who drink It limits the activities of women.
alcohol or eat pork are unclean. By Is-
lamic definition, then, many [people] The point is that no single pattern exclu-
are unclean. sively fits the passage. In fact, many pas-
sages have all six patterns. This has strong
Islamic law also includes criminal law. implications for teaching declarative infor-
The Koran lists punishments for crimes mation; it suggests that a teacher should act
against property or persons. The Koran
says that thieves should have their as a guide in helping students see the many
hands chopped off. Each kind of crime ways of organizing information within the
has its own punishment. content area. Rather than being viewed as
static data to be learned as presented by the
Islamic law carefully explains the place teacher or textbook, content should be
of women in society. Islamic women viewed as fluid information which can be
must obey their husbands in all matters. arranged in many ways to best fit tilt) prior
An Islamic husband may have four knowledge of the student.
wives. Each wife has her place. Usu-
ally, Islamic wives are allowed to leave
their homes for only a brief time. Highlighting the interpretational nature of
They may not deal with men other than content is not new to curriculum theory.
their husbands. Hawkins (1974) refers to this as "unpacking"

18 24
the curriculum; Bussis, Chittenden and Anderson (1983), at this stage it is common to
Amarel (1976) refer to it as accessing the observe verbal "mediation" during which the
"deep structure" of the curriculum. learner rehearses the information required to
execute the skill. In the second stage, called
the "associative stage" by Fitts, the perfor-
1111101111111.1.11.111.11111 mance of the procedure is smoothed out. At
2. PROCEDURAL KNOWLEDGE this stage errors in the initial understanding
of the procedure are detected and dropped
Procedural knowledge is knowledge of how along with the need for verbal rehearsal.
to do things. As mentioned in Chapter 1, it During the third stage, the autonomous stage,
is intimately tied to declarative knowledge. the procedure is refined. It is at this level
If students do not know the factual knowl- that the procedure becomes automatic
edge of a content area they cannot learn pro- (Laberge and Samuels, 1974). That is, the
cedures which are built on that factual in- procedure once called on by the learner is
formation. As Sywlester (1985) says, mastery automatically executed and takes very little
of a procedure begins with declarative of the available space in working memory.
knowledge. This is supported by current re-
search on teaching; specifically, without ba- The stages described by Fitts and Labcrge
sic declarative knowledge, students have dif- and Samuels parallel research by Hall and
ficulty learning the procedural knowledge others. Their research suggests that when a
within a content area (Heller and Reif, 1984). person encounters a new operation or an in-
novation one can usually observe a predica-
Although obviously important, procedural ble set of stages through which they progress
knowledge is frequently overlooked in in- as they deal with the new knowledge (Hall,
struction. For example, Bcycr (1984) asserts 1976). They are identified in Figure 2.3.
that insufficient instruction in procedural
knowledge about school work is a leading Figure 2.3
factor in the poor performance of many stu-
dents. The implication is that content area Brief Definitions of Stages of
teachers should identify those procedures Concern About the Innovation.
specific to their content and explicitly teach
and reinforce them. For example, a social Awareness: Unconcerned about the in-
studies teacher might identify such proce- novation.
dures as map reading or locating information
in a reference book. A mathematics teacher Informational: Concerns about general
might identify procedures for solving spe- characteristics of the innovation and
cific types of problems. Science teachers what is required to use it.
need to identify the various processes or pro-
cedures involved in their respective areas. Personal: Concerns about one's role and
Sometimes a relatively simple laboratory ex- possible conflicts between that role and
ercise may involve dozens, even hundreds, of anticipated demands of the innovation.
such procedures. If the teacher is not aware
of this complexity, it is easy to fail to build Management: Concerns about time, or-
the prerequisite knowledge necessary to be ganizing, managing, and making the in-
successful. The effect is to penalize the less novation work smoothly.
able student.
Conseque-nce: Concerns about stz.dent
Research indicates that when learning a pro- outcomes.
cedure an individual will progress through
three stages. Fitts (1964) calls the first stage Collaboration: Concerns about working
the cognitive stage. At this stage the learner with others in use of the innovation.
can verbalize the process (describe it, if
asked) and can perform at least a crude ap- Refocusing: Concerns about finding
proximation of the procedure. According to another and even more effective way.

19
25
ViriiIIIM110101
To illustratc a possible approach to teaching Evertson (1980) found that this is precisely
a proccdurc, using the stages suggested by what effective teachers do with procedures
Fitts and the others cited, a teacher might related to social behavior in the classroom.
begin by idcntifying the declarative informa- That is, good teachers describe the proce-
tion essential to understanding the concepts dures (rulcs) they expect studcnts to follow
ticd to the procedure. and then give them explicit practice in the
procedures until they become integrated with
The first stage would be accompanied by the students' behavior. We suggest that the
making sure that students had an opportunity same process be followed to teach academic
to understand how the procedure is related to procedures inherent in specific subject areas.
knowledge already learned. Questions asked
and answered about cach proccdurc might
includc: What is it likc? How does it com-
pare with other procedures? What arc its
parts? What are its functions? What are
other things that might be confused with the 3. CONTEXTUAL
CON': KNOWLEDGE
proccdurc but are not like it? Why is the
proccdurc important? Why should I know Contextuai knowledge is actually a compo-
about it? nent of procedural knowledge but important
enough to be isc'ated as a type of knowledge
At the second stage, the procedures would be in its own right. Recall from the introduc-
explicated, described, broken down into their tory chaptcr that contcxtual knowledge is
components or subprocesses. Students will knowledge of when to use a proccdurc and
want to ask questions like: Is this the right the ways that contextual or situational vari-
way? Docs it work likc this? Docs this part ables affect the procedure. For example, 2+2
of the proccdurc fit with the other parts? As represents the procedure of adding two one-
this stage proceeds, students will naturally digit numbers. If we represented this prob-
smooth out procedures even if they are ini- lem in a different format, like that below,
tially inefficient. This smoothing out process we would be changing the contextual infor-
usually involves adaptation to each student's mation surrounding the procedure:
own style. The students may delete, add or
combine elements to make it work for them.
During this phase it will be important for
the teacher to provide feedback about the ef- 2
fects of these modifications. +2

Moving students to the third stage requires


systematic and consistent use of the procc-
durc. Anderson (1982) claims that for very One cannot assume that students who have
complex procedures a relatively long period learned a procedure in one context will be
of practice time is required. This is consis- able to perform the procedure in what ap-
tent with the recommendations of Hunter pears to them to be a different context. A
(1984) and Good, Grouws and Ebmeicr (1983) rather famous study by the Gestalt psycholo-
that students should receive ample opportu- gist, Max Wcrthermcir, (in Resnick, 1983) is
nity for independent practice. commonly used to illustrate this point.
Wcrthcrmcir (1945, 1959) reported interview-
Simply stated, we recommend that effective ing children who had been taught to find the
procedural instruction include the identifica- area of a parallelogram by dropping a per-
tion of important subject area procedures, pendicular line and then multiplying the
the description of these procedures, their pre- perpendicular by the base of the parallelo-
sentation to students and the use of activities gram. The students performed well on this
that allow students to integrate the proce- task as long as the problem was presented in
dures into their own manner of interacting the standard way as illustrated in the top of
with the content. Figure 2.4.

20
26
Figure 2.4
after introductory phrases and clauses
a. Standard form: at the beginning and end of non-
restrictive clauses

at the beginning and end of appositives.


Once key contextual information has been
identified the teacher should then present the
base---) content in the different contexts. For exam-
ple, mathematical and scientific algorithms
(like the parallelogram algorithm) should be
b. Altered context: presented in different formats. Students
should even be encouraged to identify dif-
ferent formats or modes of representation.
altitude The students should then be asked to discuss
how the contexts changed their approach to
the information.
<---base--)
INTEGRATION OF OF DECLARATIVE,
PROCEDURAL AND CONTEXTUAL
However, when Werthermeir asked the stu- KNOWLEDGE
dents to find the area of the parallelogram in
a different position (as in the bottom of Fig- Earlier we made the point that our model of
ure 2.4) students reported that the problem thinking skills is an integrated one; i.e., the
"was not fair" or that they "haven't had that components do not stand alone. The same is
yet." tree for the elements of the component we
have called "content thinking." The three el-
To teach contextual know edge in a class- ements of declarative, procedural and contex-
room setting requires a keen eye on the part tual knowledge are quite interactive in the
of the teacherspecifically, an eye for which real world.
content knowledge contains important
contextual information. Some content One way to illustrate this integration is to
knowledge by its very nature is mostly con- reference the work of general systems theo-
textual. For example, teaching students how rists. People within that field point out that
to use punctuation correctly is primary con- with the exception of the thousands of single
textual. Most students readily understand concepts (words) in our knowledge base, most
that a comma signals a pause. They also of the "stuff" of nature is actually systemic.
readily understand the procedure for using a Bertalanffy (1967, 1969) indicates that nature
comma, placing a small curved line between consists of an array of progressively elabo-
two words. However, the context in which rated systems. His hierarchy includes nine
the procedure should be used is difficult for levels. Boulding (1968) has constructed a
many students to integrate into their knowl- hierarchy of seven levels of systems ranging
edge of commas. The contexts in which com- from the simplicity of what he calls
mas should be used includes: "clockworks!! to an overarching perspective
expressed in "transcendent systems." Level
between items in a series, whether the six, for example, is the human level in which
items are words, phrases or clauses the individual person is the system. Level
seven is the level of social organization. A
between clauses of compounded sen- great deal of the content of educatio;
tences particularly at the secondary and college

21

27
levels, is at these higher system levels. We been recently expanded by research of hu-
believe that it is more appropriate to refer to man intelligence. What is emerging is the
"higher" levels of thinking in terms of the picture of the intelligent person as a "system"
graduated complexity of these systems rather thinkersomeone able to see the complex in-
than the quality of our thinking per se. teractions of systems and subsystems.
Whether it's a farmer, an international fi-
One example will help make the point. In nancier, a high level government official or a
the Midwest and other farming areas of the student in an automobile class who under-
country, agriculture is in crisis. The system stands the relationships between carburetor
is being restructured to make it more diffi- adjustments, air intake, gas consumption and
cult for the family farm to survive. To suc- spark ignition, success in the twenty-first
ceed on a family farm without a second century will depend on what we term
source of income, one must understand the Systemic Thinkingthe integration of all the
complex system that is farming. For exam- content andfunctions we describe in this
ple, the farmer must understand the cost monograph.
structure of agriculture including such things
as the trade off between the costs of labor
and technology. (Several years ago produc-
tivity could be increased best through in-
vestments in technology rather than labor.
Increasing costs of capital investments, how-
ever, have reversed that situation and now,
at least temporarily, productivity can be im-
provet4 more economically through invest-
ments labor rather than technology.) The
farmer must understand financial manage-
ment and be able to understand the conse-
quences of wide swings in interest rates,
rates of inflation and rates of return on
farm assets. He or she must know different
methods of financing debt and be aware of
the potential instability of different sources
of equity capital. The successful farmer
must have an understanding of the effects of
international trade, monetary exchange rates,
national debt and inflation rates on the de-
mand for agricultural products. He or she
must have marketing skills to compensate for
losses from federal price supports and sub-
sidy programs. And, of course, he or she
must possess a detailed knowledge of agricul-
ture production pe,. sesoil quality, fertil-
izer, animal husbandry, and on and on. The
days when you could successfully farm by
just planting in the spring, plowing in the
summer and harvesting in the fall have long
gone. Successful farming requires detailed
knowledge of systems and subsystems in biol-
ogy, finance, etc. Content, procedures and
context are intertwined in a very complex
way.

Our understanding of the complex, integrated


way in which we think about systems has
22
28
111111111111111-
REASONING

Figure 3.1

Outside Stimulus
Working < Transfer Long Term
or < Matching
World Perception
Short Term < Restructuring
Memory

To understand what we mean by reasoning term memory. Retrieval brings the


skills consider Figure 3.1, an adaptation of a knowledge back out into short term
model described by Anderson (1983). memory. Memorization and recall
would be the two common usage words
The figure illustrates the recent understand- that reflect these processes.
ing that our minds utilize two distinct com-
ponents as they interact with the outside 2. Matching is the process of comparing
world: a short term, working memory that information in short term memory with
has limited storage capacity and a much information in long term memory; later
larger long term memory. For example, Dyer we will explain how this process works.
(1976) states that it has been conservatively
estimated that long term memory can store 3. Restructuring involves the creation
an amount of information equivalent to one of new knowledge or the modification
hundred trillion words and that all of us use of old knowledge.
but a tiny fraction of this storage capacity.
Short term memory, on the other hand, can These processes work together in a unified
hold only about seven elements at any one way. For example, because our short term
time (Norman, 1969). What we call reasoning memories are relatively limited, we must ei-
involves three processes: ther find a way of recording our ongoing
experiences (That's why we take notes during
1. Transferring, the first process, is ac- a presentation and why good speakers usually
tually two subprocesses: the storage limit their main ideas to four or five avid
and retrieval of specific knowledge. frequently give us mnemonic devices to re-
Storage deposits information into long member what has been said.) or we must

23 29
place the new knowledge or information we Step 1. Identify the information you
are receiving into long term memory as wish to remember.
quickly as possible.
Step 2. Use guided imagery to high-
Transferring knowledge to long term memory light the information.
requires us to either create or build upon Step 3. If the information is part of
structured knowledge already in our minds. a related set of information, use a
Thus, for example, when we want to learn a memory framework.
new vocabulary word like "mnemonic" we
search our minds for words that are like the Step 1 might seem trivial but it is critical to
new one"memory," "retention," etc. We the storage and retrieval process. As Lindsay
match the new concept with the old concept and Norman (1977) explain, in order to make
to identify ways it is the same or different sense of the information constantly bombard-
and integrate it into our permanent know- ing us we must pick and choose among the
ledge base. In the process, we restructure the data. We could not possibly attend to all in-
old knowledge base. formation available at any point in time.
Hence, selection of important information is
We call this integrated process "reasoning" the first step in efficient processing. If stu-
because it incorporates most of the active dents know the importance of patterns, rela-
processes we associate with thinking. And, tionships and concepts, they can use these or-
in fact, most existing "thinking skills" pro- ganizational structures as the framework for
grams focus on one or more of the processes selection of information. That is, students
just named. We have reserved the word can look for key concepts, relationships and
"thinking," however, to incorporate all of the patterns to be stored and retrieved.
elements of our model, most of which have
previously been neglected within formal edu- Step 2, guided imagery, is a cornerstone of
cationsuch as pattern recognition, identifi- most memory techniques. Guided imagery
cation of different types of declarative creates a greater number of "cues" than are
knowledge, etc. We restrict the concept of usually stored with incoming information.
"reasoning" only to those elements of the pro- Early work by Penfield and Perot (1963), pi-
cess that involve the transfer of knowledge oneer brain surgeons, indicated that we tend
between long and short term memory through to store all components of experiences in long
matching and restructuring. term memory. That is, we store the visual,
auditory, kinesthetic, emotional and verbal
attributes of an event or experience there.
These form what Underwood (1969) calls
"attributes" or cues to memory. If these cues
1. TRANSFERRING are strong, the experience can be recalled by
bringing one of the cues to consciousness.
a. Storing This explains why people report that any one
b. Retrieving experience can generate a number of remem-
brances. As you read this monograph you
Storing and retrieving (memorizing and re- are being bombarded with images, kinesthetic
calling) are combined in our model because sensations, sounds, etc. Each of these could
they are both components of the transfer be a cue to a set of experiences stored in
process and as far as instruction is con- long term memory. If the cue is strong
cerned, there is a great deal of overlap be- enough, the experience to which it is at-
tween them. That is, the instructional tech- tached will be recalled. Consequently, as you
niques which facilitate storage also facilitate read this chapter an extreme in the tempera-
retrieval. ture of the room might be s cue to an expe-
rience you had ten years ago.
A fairly simple set of steps can be taught to
students which vastly improves their storage The purpose of Step 2 in the storage and re-
and retrieval capabilities: tric:val process is to artificially strengthen

24
30
the cues for information via guided imagery. student would then imagine all elements, de-
It involves artificially generating images, scribed above (e.g., the smell of the leather,
sensations, feelings and verbal information the verbal information, etc.). Retrieving the
about a thought. That is, when you use information (e.g., for a test) would simply
guided imagery you take a thought and arti- require saying the jingle to recall that the
ficially expand it so that it has all of the pegword for slot *1 is the bun. This cue
sensory components listed above. For exam- would then call up the visual images of
ple, if students were to use guided imagery George Washington in the giant bun which
about George Washington they might first would cue the remaining information. There
form a strong mental image of Washington on are many other types of memory frameworks
his horse (image). They might also imagine (e.g., loci or place methods, linking methods,
they smell the saddle leather and what it acronyms) which allow students to create an
might be like to sit on his horse (sensations). almost inexhaustible supply of slots.
The students might also verbalize some facts
about George Washington in their Memory frameworks are very useful study
minds"George Washington was the first tools and illustrate to students the power of
President; he was born in . . . ." (verbal their minds. Unfortunately, many classroom
information). Finally, the students might try teachers never utilize them because of the
to conjure up a sense of patriotism (feelings). unwarranted educational stigma attached to
"rote learning." However, we believe that
Step 3 of the storage and retrieval process is helping students to learn to identify impor-
used only if a student wishes to recall many tant information in material they read and
different pieces of information. For exam- then store that information efficiently using
ple, if a student has identified sets of infor- memory frameworks is an important part of
mation for a history test, then Step 3 might the overall development of thinking skills.
be appropriate. The key to Step 3 is the use
of a memory framework. Memory frame-
works create "locations" in which information 2. MATCHING
is stored. When students recall the location
they also retrieve the information. A good The essence of matching is to determine how
metaphor to describe memory frameworks is new information is similar to and different
that they create mental "slots" into which from old information. We mentioned in
students deposit information via guided im- Chapter 1 that there are five basic matching
agery. skills:

One of the simplest memory frameworks to a. categorizing


teach students is the rhyming pegword b. reasoning analogically
method (Miller, et al., 1960) in which stu- c. extrapolating
dents first memorize the following jingle: d. evaluating evidence
e. evaluating value.
One is a bun; two is a shoe; three is a
tree; four is a door; five is a hive; six is We will consider each briefly.
sticks; seven is heaven; eight is a gate;
nine is a line; ten is a hen. a. Categorizing
A student wanting to deposit information Categorization is usually done with concepts.
into one of the slots would use guided im- That is, we tend to compare and contrast
agery to make the association between the concepts and classify them into categories.
"pegword" and the information. To illustrate, The skill of categorization is directly related
assume n student wanted to put the informa- to the concept of clustering introduced in
tion about George Washington into slot *1. Chapter 2 as a way of facilitating vocabulary
The student might imagine a large hot dog development. One of the best ways to use
bun, the pegword for slot #1, with a diminu- categorization in a regular classroom setting
tive George Washington standing inside. The is to utilize semantic feature analysis.

I
25
31
The theory of semantic features asserts that Step 5. Ask students to add addi-
words are known or comprehended based on tional concepts and features and com-
specific semantic features they possess or do plete the expanded matrix with pluses
not possess. Figure 3.2 illustrates some se- an minuses.
mantic features:
Step 6. As a group, discuss the con-
cepts and their features.
Figure 3.2 An example of this analysis is shown in Fig-
ure 3.3.
D B1 C 2 E
Figure 3.3
cow lad son girl eraser
TOPIC: ANIMALS
bird boy daugh- lass desk
ter furry bark four legs
Larry Karen
dogs + + +
A snakes
birds
horses - +

As described by Marzano, Distefano, Valen- Semantic feature analysis can be used with
cia and Hagerty (1986) the words in set A preschoolers as well as college students. It
are all human, animate and two-legged. The can be a valuable tool within content area
words in B1 and B2 are differentiated by the classrooms. For example, assume that a his-
fact that all B1 words contain the added se- tory class is beginning a unit of study on at-
mantic feature of male; all B2 words have tributes of great leaders. Attributes of lead-
the semantic feature female. Words in Set C ership can be placed on the top of the grid
do not share a male/female distinction but and the leaders to be studied down the left-
they do share a semantic feature which hand side of the matrix. Students can fill in
might be called siblings. Set D words are pluses and minuses in the matrix to indicate
animate but gender-neutral. Set E words are which features are possessed by each leader.
inanimate. This is illustrated in Figure 3.4.
Johnson and Pearson (1984) recommend a six-
step process for using semantic feature anal-
ysis in the classroom. Figure 3.4
A B C
Step 1. Select a category (animals). Napoleon
Step 2. List, in a column, concepts Hitler
within the category (see Figure 3.3).
Alexander
Stcp 3. In a row across the top of the the Great
grid, list the attributes or features
shared by some of the concepts (furry, Henry VIII
bark, four legs).
Step 4. Put pluses or minuses beside Key:
each concept under each feature. A A = Flamboyant
plus indicates that the concept usually B = Egotistical
has a given feature. C = Brilliant Strategist

26 32
b. Reasoning Analogically Sternberg's components can be translated into
a fairly straightforward procedure for solv-
According to Reese Jenkins (Personal Report, ing analogy problems.
1985), historian and director of the Thomas
Edison papers at Rutgers University, Edison's
genius was in part due to his ability to use Step 1. Identify characteristics of the
analogical reasoning. For instance, when concepts in the first set.
writing about the kinetoscope, a forerunner Step 2. Identify possible relationships
of the motion picture, Edison is quoted as between these concepts.
saying:
I am experimenting upon an instrument Step 3. Identify which concept in the
which does for the eye what the phono- first set is most closely related to the
graph does for the ear. . . . The inven- element in the second set.
tion consists in photographing continu-
ously a series of pictures in a continu- Step 4. Identify what is missing in
ous spiral on a cylinder or plate in the the second set.
same manner as sound is recorded on
the phonograph.
The key to analogical reasoning appears to be
Within eJucation analogical reasoning refers Step 2, identifying the relationships between
to a particular type of reasoning problem adjacent concepts. Students will generally be
such as "A is to B as C is to D (A:B :: C:D). able to identify some type of relationship.
According to Sternberg (1977) the process of However, it might not be the one that would
analogical reasoning contains four compo- be most commonly identified by other stu-
nents: encoding, inferring, mapping and ap- dents or the one expected by a test maker.
plying. Consequently, students' abilities to solve
formal analogy problems (e.g., those found on
tests) can be greatly improved by teaching
(1) Encoding them the common relationships found in
analogy tests. Lewis and Green (1982) in
Encoding is the identification of the at- their study of analog tests identify a num-
tributes or characteristics of the concepts ber of relationships students should be ex-
within the analogy. posed to. Those relationships include:
(2) Inferring
a. Similar concepts: Adjacent concepts
Inferring is the identification of the rule are basically the same or very similar
that relates adjacent concepts. For example, in meaning:
in the analogy feather:bird :: leaf:treethe
relationship between adjacent concepts is swim: float :: shout:
part-to-whole.
a) whisper
(3) Mapping b) argue
c) scream*
Mapping is the identification of the relation-
ship between non-adjacent terms. For exam- b. Opposite concepts: Adjacent concepts
ple, in the analogy above, feather and leaf have opposite or very dissimilar
arc parts; bird and tree are wholes. meanings:

(4) Applying these: those :: go:

Applying refers to identifying the missing a) proceed


component in an analogy of the form b) run
feather:bird :: :tree. c) come*

27

33
c. Class membership: Adjacent concepts c. Extrapolating
share class membership:
Extrapolation is a direct extension of pattern
horse: lion blue: recognition. As was explained in Chapter 2,
pattern recognition helps students identify
a) bird and organize information they read or hear
b) pink* into large chunks. This activity is fairly
c) mood "text bound"it does not force the reader to
go beyond the information actually pre-
d. Class name and class member: One sented. Extrapolation on the other had,
concept is a class name; the other is a forces students to identify how patterns of
class member. information from one source of information
might be similar to patterns from another
April: month :: bee: source. Using he six pattern types men-
tioned in the second chapter (e.g., topic pat-
a) flower terns, generalization patterns, sequence pat-
b) spring terns, process patterns, similarity patterns
c) insect* and dissimilarity patterns) we operationally
define six kinds of extrapolation:
e. Derivation: One concept turns into I. matching the characteristics stated
another: in one topic pattern with characteristics
in another
flower: bud :: butterfly:
2. inaiching the examples of one gen-
a) pollen eralization with the examples of an-
b) wings other
c) caterpillar*
3. matching the sequence of events in
f. Function: One concept performs a one situation with that of another
function on or for another:
4. matching a process ir one situation
teacher: student :: driver: with the process in anot',er

a) golf 5. matching the similarities between


b) speed two patterns from one content area
c) car* with the similarities between patterns
from another content area
g. Quantity or size: concepts are related 6. matching the dissimilarities be-
by quantity or size: tween two patterns from one content
area with the dissimilarities between
mountain: hill :: tiger: two patterns from another content area.
a) jungle To illustrate, assume that students have read
b) housecat* a description in a basal reader about how to
c) lion bake a cake. As part of this process pattern
about cooking students might have identified
the following elements as important to the
In a classroom setting students can be pre- pattern:
sented with analogies from published materi-
als andjor they can be asked to create their Gather the ingredients.
own analogies using concepts from different
content areas. Mix the ingredients.

28

34
Put them in the oven. states that a cognitive ability such as this
develops long after a child has mastered the
Put the icing on. rudimews of language processing. However,
Arter (1976) found that instruction in the use
of metaphorical models facilitated the learn-
Once they have determined that the basic ing of low ability students.
pattern is a "process" they can then be asked
to try to identify some other process that is
not about cooking which contains some of d. Evaluating Evidence
the same elements as the process for baking a
cake. Evaluating evidence refers to identifying
whether a piece of information has backing
Students in Detroit might extrapolate this or proof and, if so, how valid the proof is.
pattern to building cars. They would then be Within many thinking skills programs this
asked to show how the process of building skill is called "critical thinking." The skill
cars has the same components as the process desciibed here is based on the work in logic
for baking a cake. Thus students might iden- of Toulmin (1958; Toulmin, Rieke and Janik,
tify the following likenesses. 1979). Students can be taught a fairly
straight forward process for evaluating of
logic. As described by M.rzano, et al., (1986)
Baking a Cake Making a Car that process is:

Gathering the Shipping Step 1. Identify an unusual claim. A


ingredients materials (e.g., claim is a statement of fact. An un-
aluminum, usual claim is one that is not self-
rubber) from evident or one you weren't aware of be-
different parts fore. For example, "The sky is some-
of the country times blue" is self-evident. However,
the claim that From an aerodynamic
Mixing the The assembly line perspective, bees should not be able to
ingredients operation fly" is not self-evident.
Putting the cake Using different Step 2: Decide if the claim is in the
in the oven heating processes domain of common knowledge. If it is
(e.g., welding) in then it requires no backing or proof.
the assembly line
Step 3:If the claim is not considered
Putting on the Painting the car common knowledge, is proof presented
icing and putting on for it? If no proof is presented, the
the trim. claim is unsubstantiated.

As long as a students can demonstrate how Step 4: If proof is presented, how


the extrapolated pattern has the same compo- reliable is it?
nents as the initial pattern their answer is
correct. Extrapolation, then, fosters diver- Step 5: If the proof is unreliable, the
gent thinking. In fact, it is very similar to claim is unsubstantiated. If the proof
the construction of metaphors. For example, is reliable, the claim is substantiated.
both metaphor and extrapolation have a topic
(the pattern being extrapolated to a new con-
text) and a vehicle (that context to which the This process is represented diagrammatically
pattern is being extrapolated). Ortony (1980) in Figure 3.4.

29

35
Figure 3.4 it. Overgeneralizations are common in ev-
eryday speech. For example, an individual
Identify Claim might rush into work in the morning and an-
nounce: "This has been the worst morning of
Is Claim in domain of my life. My car wouldn't start, when it fi-
common knowledge? nally did, I go. stuck in traffic and then got
a ticket!" In fact, the morning was probably
not the worst of his or her life. The over-
Yes No generalization is accepted as a way of drama-
sc tizing the situation. However, in newspaper
Claim needs Is proof articles, media presentations or serious con-
no proof presented? versations, overgeneralizations should be rec-
ognized and identified as unsubstantiated
Yes No claims.
4,
Is proof Claim is (3) Use of Informal Fallacies
reliable? unsubstantiated
Informal fallacies occur quite frequently.
Ye No Common examples include ambiguities,
4' vagueness or part/whole and whole/part er-
Claim is Claim is rors.
substantiated unsubstantiated
Ambiguities occur when a ward or idea is
One of the more difficult parts of the pro- used which can have more than one meaning.
cess is Step 4, determining the reliability of To illustrate, consider the following evimple
proof. Most critical thinking programs at- of ambiguity offered by Stottlemeier (1979;
tempt to teach students the various ways that p. 87):
backing or proof can be unreliable. Below
we will consider three ways. Girls alone are not permitted in th;
pool.
(1) Oversimplification of Cause
Does the sentence mean that girls, as distin-
To illustrate this type of unreliable backing guished from other categories of people (men,
consider the following: women, and boys) are not allowed in the pool
or that single girls unaccompanial by an-
The primary cause of World War I was other are not permitted?
the unrest of the working classes in
Europe. Lipman states that certain types of ambigui-
ties must be tolerated in social interaction.
This statement is not totally incorrect. There Sometimes ambiguities even serve a useful
is some truth to the assertion that the unrest purpose. This is comilonly the case when
of the working class in Europe added to the they are used in poetry. But in everyday dis-
outbreak of World War I. However, it was course they are usually dysfunctional.
not the primary cause of World War I; it was
not even one of the more important causes. Vague words lack clean cutoff points. To
Here the author of this claim has taken a illustrate, consider the following example of-
very complex set of causal relationships (e.g., fered by Stottlemeier (1979; p. 89):
the relationship of World War I to its many
causes) and oversimplified them. Is it cold today?
(2) Overgeneralizing What is cold? Cold to one person might be
warm to another. If you live in San Diego
Overgeneralizing occurs when a generaliza- the concept of cold might be quite different
tion far exceeds the facts which accompany than if you lived in Fairbanks.
30
36
Lipman states that students should be able to As described by Marzano, et al., (1986) most
recognize vague words and be able to distin- people consider the information in the first
guish contexts in which they are unaccept- statement as neutral; however, many Ameri-
able from those in which they are acceptable. cans consider the information in the second
statement as negative. You can usually tell
Part/whole and whole/part errors occur when if you value something by the emotional re-
you assume that if a part of a whole has a action it elicits.
specific feature, then the whole must have
the feature (part/whole error), or, if you as-
sume that if the whole has the feature, then The purpose of evaluating value is to iden-
all the parts must have the feature tify the weight or merit (good, bad, neutral)
(whole/part error). To illustrate consider the placed on information, identify the assump-
examples below. tions under which the value weight was as-
signed and identify a set of assumptions that
would yield a different value weight.
Mary's face is beautiful, therefore, she
must have a beautiful nose (whole/part
error). An outcome of the evaluation of value pro-
cess is that students recognize the subjectiv-
My car has the best tires made; there- ity of their own value systems. This is con-
fore, it is one of the best cars made sistent with Paul's conception of "dialectic"
(part/whole error). thinking. He states that:

Students can be taught to evaluate errors of Children can learn to consider it natu-
ral that people differ in their beliefs
logic whenever they hear or read information and points of view and they can learn
presented as fact. This means that they to grasp this not as a quaint peculiarity
should he mentally asking such questions as: of people but as a tool for learning.
They can learn how to learn from oth-
Are their statements being made which ers, even from their objectives, contrary
are out of the realm of common knowl- perceptions and differing ways of
thinking (Paul, 1984; p.12).
edge?

Is there proof or backing for these Spiro (1980) has stated that this "attitudinal"
claims? component of thinking is the central aspect
of cognition. It allows one to see the infor-
Does the proof or backing contain any mation base from which judgments are cre-
of the common sources of unreliability ated.
(e.g., overshaplification of causal rela-
tionships, overgeneralizing, use of in-
formal fallacies)? 3. RESTRUCTURING

In the introductory chapter we gave a brief


c. Evaluating Value example about how the addition of new in-
formation to existing information in long
Evaluation of value is the process of deter- term memory restructures the old knowledge
mining whether information is considered and, in effect, creates new knowledge.
good, bad or neutral on some accepted scale. Stated more broadly, all reasoning procedures
To illustrate, consider the following two mentioned thus far create new knowledge to
statements: a certain extent. However, some of the pro-
cedures mentioned are more focused on that
a) Wood is used to build houses. purpose than others. There are three basic
restructuring procedures that stand alone:
b) The Russians pulled out of the 1984 1) elaboration, 2) problem solving and 3) in-
Olympic games. vention.

31
37
a. Elaborating Out-of-the-ordinary actions: a particu-
Elaboration involves inferring information
lar dog saved someone's life ...
not explicitly stated in information read or Places (e.g.. Colorado)
heard. Various categories of inference have
been proposcd by researchers and theorists Location: in the Rocky Mountains.
(e.g., Bruce and Schmidt, 1974; Warren, et al.,
1979). Within our model three types of in- Size, shape, terrain: Colorado is a mod-
ference seem most important: 1) elaboration erately large state that has a square
of characteristics, 2) elaboration of causes shape. It is mountainous but it also has
and consequences and 3) elaboration of au- flatlands.
thor intention.
Events that habitually occur there: Col-
(1) Elaboration of Characteristics orado has a lot of snow in the winter
but very little precipitation in the other
As early as 1920, psychologists (e.g., Hull, seasons.
1920) were hypothesizing that humans store
characteristics of concepts in long term mem- Out-of-the-ordinary events or other
ory. That is, in addition to a linguistic label characteristics: Colorado has one of the
for a concept we also store the characteristics highest average elevations of any state
of the concept. Every time you read or hear in the union.
a word which represents a concept all of the
characteristics of the concept are available to Things (e.g., The Empire State Building)
you. For example, if you read a story about
1 little girl named Mary, all of the character- Physical dimensions: over 100 stories
istics of little girls come to mind simply by tall.
reading the label "little girl." The author
does not have to explain how little girls act, Location: in Manhattan, New York.
how they dress, etc. This comes with the la-
bel. Customary use: office building and a
place where tourists go.
Teachers can use this principle to structure
questions which help students elaborate on Out-of-the-ordinary use or other char-
the concepts they read and hear, thereby acteristics: once was the tallest building
building new information about those con- in the world.
cepts. Specifically, a teacher can select con-
cepts and have students elaoorate on unstated Events: (e g.. weddings)
information. There are four types of con-
cepts commonly found in content material: Participants: bride, groom, parents.
1) animate creatures, 2) places, 3) things and
4) events. Below is listed the information Goal or reason: unite two people.
usually associated with such concepts:
Time and duration: 1 or 2 hours on a
weekend.
Animate creatures (e.g,, dog)
Location: church, synagogue.
Physical dimensions: four-legged, furry
These "frames" for concepts can be used to
Emotional and psychological state of structure questions or assignments which re-
being: friendly, vicious ... quire students to elaborate on concepts read
or heard. To use a simple example, assume
Habitual actions: chases cars, chews on elementary school students had read a story
bones ... about a young girl named Jana. The teacher
32

38
might use the animate creature frame to ask 1. instrumental: using language as
such questions as: away of getting things
What did Jana look like? 2. regulatory: using language as a
means of controlling others
How tall do you think she was?
What did she dress like? 3. expressive: using language to
express feelings, emotions and
What type of personality did she have? opinions
Was she a happy child? Sad? Why? 4. informative: using language to
inform others
What are some things you think Jana
might have normally done on th,:: way imaginative:
to school? 5. using language to
create new ideas
What are some things Jana did that
were very different from what you or 6. heuristic: using language as a
other children normally do? means of finding out new inform-
ation.
At a more advanced level students might be
assigned to research the information in a These categories of intention can be used to
concept frame. For example, if they en- reinforce elaborations. That is, students can
counter the concept "festival" in a social be asked to identify the intention behind in-
studies unit, they might be asked to research formation read or heard and the specific
the participants, location, reasons, etc., for cues which signal the intention behind the
this "event" concept. message.

(2) Elaboration of Causes and Consequences


b. Problem Solving
Inferring causes and consequences appears to
be a basic human drive. Johnson-Laird Problem solving occurs when an individual
(1983) identifies causation as one of the basic must fill in missing information. This is at
"conceptual primitives" that build up more the core of all problems: information neces-
complex concepts. That is, we attempt to in- sary to accomplish a goal is missing. Without
fer causes about our own and others' behav- the missing information no problem exists.
ior and subsequent behaviors and attitudes Problem solving differs from invention, the
(Lavelle and Keogh, 1980). This natural ten- next process, in the specificity of the goal.
dency can be translated into questioning When you invent, your goal is initially very
techniques. Specifically, teachers may select general. As a matter of fact, what you end
statements from reading material and ask up with via the inventing process might be
students to elaborate on the causes and con- very different from what you initially in-
sequences of that statement. tended to do. During problem solving the
goal is usually obvious and quite
explicitoften, it is even impbsed on you
(3) Elaboration of Author Intention (e.g., you need to get to work but your car
won't start). As van Dijk and Kintsch (1983)
The intentions behind communications are state, a problem exists when there is an
studied within the field of linguistics called explicit goal to be reached. There are
"pragmatics." Theorists in pragmatics, such specific operations to be performed to reach
as van Dijk (1980), Bruce (1975), Halliday the goal and some component of Ele specific
(1967), and Tough (1976) have attempted to operations is not know to the problem solver.
describe the different intentions that can be
behind a message. Commonly six different In this model we make the distinction be-
intentions are identified: tween two types of problems: 1) everyday

33
problems, and 2) academic problems. Every- If you look for it, help will
day problems arc like the example above be available.
(e.g., your car won't start). Academic prob-
lems an- like those encountered in a math You are perfectly capable of
class or science class (e.g., solving simultane- taking cart of the problem.
ous linear equations, determining the effect
of mixing two chemicals). Obviously aca- Step 2. Begin talking to yourself about
demic problems arc very restricted in con- the problem. Verbalize the thoughts
tent, whereas everyday problems oan relate to you are having; i.e., think aloud about
such diverse topics as coming up with the the problem.
money to go on a vacation, threading a nee-
dle or mowing the lawn before it rains. An- Step 3. Start looking for what is miss-
other major difference between the two types ing and identify possible solutions.
of problems is the freedom of choice relative
to the goal. With everyday problems there is Step 4. For each solution identify the
always the possibility of rejecting the initial tools you will need or things you might
goal. For example, an individual might ini- have to have to attempt the solution, or
tially have the goal of mowing the lawn. the actions you will have to take.
Clouds gather overhead and the situation be-
comes problematic (e.g,. "How can I get the Step 5. Determine how accessible the
lawn done before it starts to rain?"). The in- tools for each solution are.
dividual has the option to ignore the initial
goal of mowing the lawn and watch televi- Step 6. Identify the solutior.Zs) you
sion instead. With academic problems, the think has the highest probability of 4
student usually does not have such freedom. working and assess the risk factor asso-
ciated with each solution.
Regardless of the type of problem (everyday
or academic) good problem solvers attack Step 7.. Try out the solution that you
problems systematically rather than in a feel has the highest probability of suc-
haphazard fashion (Covington, 1985; Brans- cess and that fits your comfort level of
ford, Nitsch and Franks, 1977). This implies risk.
that students should be provided with an ini-
tial framework with which to attack pi-et:- Step 8. If your solutions don't work,
1=s. The initial framework should not be clear your mind and be willing to sec
prescriptive in nature. That is, the problem the problem in a totally different way.
solving framework should be presented to Then gi back to step 3. Keep doing
students as a starting place from which they steps 3 through 7 until you solve the
can develop their own problem solving plans problem.
of attack.
Step 9. If no solution can be found,
( I ) Everyday Problems "revalue" what you were trying to ac-
complish. Look for a more basic goal
Below is a general problem solving frame- that can be accomplished even though
work for everyday problems: the one at hand cannot.
There are a few aspects of this problem solv-
Step When a problem arises, stop
1. ing framework that should be highlighted.
whatever you are doing and try to af- Step 1 deals- with attitudes that appear to aid
firm the following beliefs: problem solving. In general, good problem
solvers have confidence in their ability to
The problem probably has a solve a problem. That is, they think about
number of solutions and you themselves a certain way when they solve
will surely find one or more problems (Weiner, 1983). Step 1 helps stu-
of them. dents become aware of their beliefs about
34

40
--.......1,-,,,,.
themselves as problems solvers and reinforce unknowns. To illustrate, consider the follow-
those beliefs which aid in problem solving. ing four types of problems:

Step 2 reinforces a common technique used 1. A train can travel 10 miles in 4


by good problem solversthinking aloud. minutes. How far will it travel in 14
(Rowe, 1985) Technically, this is called ver- minutes?
bal mediationthe act of talking to yourself
to help define and solve a problem. 2. An airplane leaves location A for
location B traveling at 200 miles per
Steps 3, 4 and 5 deal with identifying what hour. 2500 miles away at the same time
is technically called the "problem space"the a plane leaves location B for location A
parameters of the problemwhat you know traveling at 300 miles per hour. At
and don't know about the problem. what point will the planes intersect?
3. You are to build a vehicle which is
Steps 6 and 7 deal with the inherent threat to capable of carrying a person weighing
self-worth imposed by problems (Covington, no less than 150 pounds for a distance
1985). Abraham Maslow once stated that we of 100 feet over solid ground., This ve-
tend to stay away from those situations hicle is not to have wheels. A wheel is
which threaten how we perceive ourselves. defined as any standard wheel or caster
Covington states that learning how to deal or any construction in part with a cir-
with the inherent risk in problem solving is a cular piece of material.
valuable tool for the strategic thinking neces-
sary to solve problems. Steps 6 and 7 help 4. A man was found in his locked
students accomplish this. room on the floor. Next to him was a
pool of water and a pool of blood
Step 8 is meant to help students generate dif- somewhat mixed together. There was
ferent types of solutions when the cues they also a note indicating that the man had
have already tried don't work. DeBono committed suicide. How did he kill
(1985) refers to this as "lateral thinking" and himself?
asserts that is an important element of prob-
lem solving. In problem 1 the missing information is a
simple formula (rate x time = distance). If a
Finally, Step 9 helps students adjust their ex- student knows that formula, no problem ex-
pectations and energies when a goal cannot ists; she or he simply plugs in the formula
be accomplished. and works out the answer. In problem 2 the
same formula is invalid. Assume that a stu-
(2) Academic Problems dent trying to solve this problem knows that
formula. There is still something miss-
For academic problems students should b,; inghow the "distance" part of the formula
given a task-specific problem solving frame- will interact for two sets of data. Problem 3
work. Polya (1957) developed a framework has a different type of unknownsthe way
for academic problem solving which current that a set of constraints will affect a com-
research (e.g., Polson and Jeffries, 1985) mon process (e.g., building a vehicle). This
seems to validate. Basically, that framework type of problem is given to elementary school
has four components: 1) understand the students in the competition entitled
problem, 2) design a plan, 3) carry out the "Olympics of the Mind" (Gourley and
plan and 4) look back to see what worked. Micklus, 1982). Finally, problem 4 has a to-
tally different type of unknownpossible
Understanding the problems involves identi- murder weapons not commonly used. (The
fying what is given, what is unknown and answer is, by the way, "He was stabbed with
the operations you can perform on the givens an icicle.")
to solve what is unknown. This is perhaps
the most difficult part of problem solving The point here is that step 1 in the academic
because there are so many types of possible problem solving framework is very difficult

35
41
because of the many types of unknowns that what types of unknowns students will
can exist for problems. In fact, van Dijk and encounter in problems
Kintsch (1983) identify five or six different
types of unknowns for a simple mathematics what types of information students will
story problem. That is, there are different be provided in problem situations
types of unknowns for different wordings of
the problem. What this implies is that teach- what types of strategies will work best
ers should carefully identify the types of for specific content area problems.
unknowns for problems that are presented to
students, and present problems in groups
with similar types of unknowns. In this way Finally, teaching academic problem solving
students will gradually learn the types of involves presenting students with highly
unknowns found in academic problems and structured practice problems and then dis-
be able to use that knowledge in future aca- cussing how the problems can be solved (not
demic problem solving situations. just the answers to the problems) so that stu-
dents can, over time, develop their own
Step 2, designing a plan, is fairly straight- frimeworks for solving academic problems.
forward. Here the student asks "How am I
going to find out what is unknown?" Re-
search indicates strategies that can be used to c. Inventing
answer this question. One strategy is called
decompositionbreaking a problem down Invention is the process of creating new in-
into smaller parts and solving each part. A formation or products. It is usually thought
student might do this with problems like 2 of as a process involving written language.
and 3 above, where there are a lot of pieces Without a doubt, composing in written form
and a lot is unknown. Another strategy is to is a premier thinking skill. For example,
identify previously solved problems that are Nickerson (1984) identifies writing as one, if
similar to the current problem. This is some- not the key procedure for enhancing think-
times called "solution by analogy." Another ing skills: "Writing is viewed not only as a
strategy is called "generate and test." Here medium of thought but also as a vehicle for
students generally guess as to what will work developing it" (p. 33). The constructive na-
in identifying the unknowns. They then test ture of writing (its generation of new cogni-
their hypothesis. There are other common tive structures) has been well documented.
strategies used to identify the unknowns in a For example, Flower and Hayes (1980) assert
problem (e.g., solution by contradiction, that writing is a generative process which
working backwards or "backward mapping"). creates new ideas for the writer.
The generalization to be made here is that
students should be taught a number of We use the word invention to refer to the
strategies and given enough practice so that generation of new information or products in
they can identify those that work best for any form. Building a Rube Goldberg ma-
them. chine is invention (a drawing, a machine, a
piece of music are all inventions). Invention
Step 3 and 4 usually involve such strategies occurs when you begin with a general goal of
as summarizing what has been done, elimi- creating something and then follow the goal
nating those things you know don't work and through to completion. There are three parts
selecting an alternative. If steps 3 and 4 are to the invention process: incubation and dis-
carried out, students have the possibility of covery, construction, and revising and polish-
experiencing sudden flashes of insight rela- ing.
tive to the problems (Rowe, 1985).

Teaching academic problems solving, then, (a) Incubation and discovery


involves giving students a general problem
solving framework to follow. It also requires The incubation and discovery phase occurs
the tea .-,her to identity: when the idea is conceived and initially
36
42
shaped. Flower and Hayes (1980) state that Step 2. Next, students should open
during incubation and discovery we primar- their minds to images of all kinds. At
ily use non-linguistic information. That is, first they should make no attempt to
prior to actually beginning a project, the in- exert any control over their images.
ventor must deal with information in a However, they should attempt to create
prelinguistic form. The ability to do this is a detail in their images; they should see
component of creativity. shapes and details in color and enhance
the images by adding sounds and scents.
According to Lewis and Greene (1982), Ein-
stein was capable of using "wordless thought" Step 3. Once they have obtained a
to conceptualize complex physical properties. basic ability to create images they
He is reported to have said, "When I exam- should practice "holding" a particular
ined myself and my methods of thought I image for an extended period. At first
came to the conclusion that the gift of fan- this will be very difficult, because the
tasy has meant more to me than my talent mind will want to jump to associated
for absorbing positive knowledge" (in Lewis images.
and Greene, 1982; p. 24).
Step 4. Step 3 should be continued
Apparently Einstein had perfected the tech- until students have a sense of control
nique of wordless thinking to such a high over their ability to image things.
level that he preferred to perform experi-
ments in his mind. Lewis and Greene refer
to these as "thought experiinents." About (b) Construction
Einstein's thought experiments they say:
The second phase of the inventing process is
construction. Here students begin to develop
In the early 1900's Einstein performed a physical or linguistic representation of
a thought experiment that was to shake what they created or discovered during the
the world of physics to its foundations. incubation and discovery phase. If they are
He had begun to realize that Newton's
theory of gravitation, until then the composing a written product (e.g., an essay)
unchallenged dogma, was seriously they might begin to write down ideas. At
flawed. To explore the concept he pic- first they might make a very rough outline
tured himself as the passenger in an el- and then fill in some sentences and para-
evator hurtling through the farthest graphs. They would keep adding to and
reaches of space at a speed faster than deleting from what they had written until
light. He then visualized a slot opening their basic idea had gone from a skeleton to
on one side of the elevator cage so that an unpolished creature with some meat on its
a beam of light was projected onto the
opposite wall. This enabled him to re- bones. If students were creating a machine
alize that if the elevator were moving of some type, the construction phase might
with sufficient velocity, it would travel involve making and testing prototypes of the
a finite distance in the time required machine. The overall intent of the construc-
for the beam to pass across the cage so tion phase of inventing is to produce a rough
that an observer in the cage would see approximation of the productone that has
the light beam as curved (p. 24).
all necessary components but is not yet the
final form.
Lewis and Greene recommend the following
steps for developing wordless thinking ability (c) Revising and Polishing
in students.
The revising and polishing phase is actually
Step 1. Have students learn how to a set of phases. The inventor keeps going
attain a state of relaxation. They over his/her product adding to and deleting
should loosen any tight clothing, sit in with more and more attention to detail. Af-
a relaxed position and keep their ter this phase is completed the inventor has a
breathing regular. fully developed product.

37 43
NIMENIMENOW----
LEARNING-TO-LEARN

The learning-to-learn skills are those which We will consider each area separately and
facilitate learning of all types. The assump- then consider how they might be combined
tion underlying these learning-to-learn skills into an instructional framework.
is that learning within a classroom setting is
a function of generalized competencies that
are used in all learning situationsnot just
those related to school. If students are 1. ATTENDING
taught these generalized competencies they
can use them in any situationschool related Cognitive psychologists identify two types of
and non-school related. attention: automatic and voluntary (Luria,
1973). Automatic attention is reflexivea
stimulus to a response. Automatic attention
To some extent every student has become occurs when some novel situation enters into
proficient learning at something. And, as an individual's awareness. For example, if a
they become proficient, they at least intu- young child hears a loud noise he or she will
itively learned to learn. As a reFult, it might turn the eyes and head toward the noise.
be that students do not have to learn these Voluntary attention occurs when an individ-
skills at all. Instead, they may simply need ual willfully shifts the general background
to learn to consciously control these skills of attention. For example, when driving at
and be responsible for using them in school. night in an open convertible you might vol-
untarily turn your attention to the stars At
this point new information becomes available
There are four general competencies in the to you because the backdrop of perception
learning-to-learn area: has changed. You begin to notice things
about the sky of which you were previously
unaware. Under voluntary attention there is
I. Attrtnding an awareness of the context or frame being
used to process information and a consequent
higher level of control of the information. It
2. Goal setting is the increase in frequency of voluntary at-
tention within the classroom that is of educa-
tional relevance. For convenience we refer
3. Monitoring attitudes to that ability here as controlling attention.
Operationally, controlling attention can be
4. Self-evaluating. described as a process with four components:

38

44
1. being aware of your level of by many of society's great minds. Bertrand
attention at a given moment Russell (1971), for example, used the concept.
2. being aware of the level of In a classroom situation bracketing can be
attention required for the task at used to set aside important thoughts that are
hand unrelated to the topic of instruction. For ex-
ample, a student in a reading class might be-
3. comparing your level of attention come aware that he or she is thinking about
with that required for the task the quiz in the upcoming math class and not
about the reading lesson. Although the math
4. adjusting your level of attention quiz is certainly important, thinking about it
if necessary. during reading does little for the student's
performance in reading or math. Hence the
Important to the utilization of this process is student would bracket or consciously put
an understanding of the critical attributes of aside his or her thoughts about the math quiz
attention. In this model we have identified and return attention to them after the read-
two critical attributes which should be ing lesson.
taught and reinforced with students: 1) the
physical characteristics of attending and 2) Once students are aware of the critical at-
the "bracketing" of spurious thoughts. tributes of attending they can then utilize
the attention control process. Initially this
will be teacher directed. That is, during
class the teacher will request that students
a. Physical Characteristics of Attending use the attention control process when stu-
dent engagement slackens. However, over
The act of attending has some phy3ical char- time students themselves should begin to ini-
acteristics (Harman, 1969; Luria, 1973). With tiate attention control. They might use it
very young children the physical characteris- when they are tired or when they are in a
tics involve sitting-up straight, widening of situation that does not contain much intrinsic
the eyes and deep breathing. These physical interest for them.
actions have the effect of increasing the en-
ergy level for a task. With older students en-
ergy level can be increased without necessar- 2. SETTING GOALS
ily exhibiting these secondary characteristics
of attending. What we suggest is that as a Over forty years ago Sears (1940) found that
preparation for teaching the attention control successful students tended to set explicit
process described above, students should be goals. More recently Brophy (1982) found
asked to explore and identify the physical at- that successful students set increasingly more
tributes of attending. When they are not at- difficult goals. That is, they use goal setting
tending but wish to increase their level of at- as a way of challenging themselves. Bandura
tention, they then can voluntarily generate and Schuck (1981) found that goal setting
the physical characteristics. should be proximal (short-term) rather than
distal (long-term) for optimum results.
A review of the current programs which
b. Bracketing teach goal setting (e.g., Tiece, 1976) indicates
that there are some general guidelines for
The second critical attribute of attending is setting effective goals. Those guidelines
bracketing. Bracketing is a concept with might be described to students in this way:
philosophical roots. The working principle
behind bracketing is that sometimes it is
beneficial to put certain ideas "on the back Step I. Start with short term goals:
burner" and think about them at a later date. Most people find it difficult, especially
This is a skill that has been reportedly used in the beginning, to stay committed to
long term goals. It is better to begin
39

45
with short term goals, or if you do have toward the goal. Technically, these mental
a long term goal, to break it down into attitudes are called "executive principles" or
a series of short term goals. "executive thoughts." For %.1cample, the atti-
Step 2. Make your goals concrete: The tude that "I should always be fair in my
most useful goals appear to be the more dealings with other people" would be an ex-
concrete goals. Some goals are easy to ecutive principle governing many behaviors.
make concrete (e.g., "I want $1,000"). These principles are so important to human
Fortuntely, most abstract goals can be behavior that some theorists have hypothe-
turned into concrete goais with a little sized that there is a special type of memory
bit of thought. which houses them called "executive memory"
(e.g., Sternberg, 1984; Gardner, 1933).
Abstract Goal Concrete Goal
As described by Marzano et al (1986), there
Having more Laughing with my fun are three types of executive attitudes which
fun at home family at least once appear to be useful to consider when dealing
per night about some- with difficult tasks: general attitudes about
thing that happens work, attitudes that stimulate exploration
at home. and attitudes that broaden preception.
Feeling better Each day writing
about myself down at least three a. General Attitudes
things I did that were about Work
accomplishments.
Step 3. Allow yourself to fail. Some- Research indicates that people who are
times you set a goal and don't accom- highly successful at accomplishing goals have
plish it. Other times you set a goal but some special attitudes about work. For ex-
change it. Both of these are appropri- ample, in the area of problem solving Whim-
ate actions to goal setting. Goals bey (1980) found that good problem solvers
ihould be tools to help in life, not rules exhibited these characteristics:
that constrain. If a goal is not of in-
terest anymore, it should be changed or
dropped. a commitment to persistent, systematic
analysis of problems
Once students have a grasp of the basics of
goal setting, they can be given the following a concern for accuracy
process to use:
the patience to employ a step-by-step
State your goal in written form. process
Identify a time frame in which you an avoidance of wild guessing
plan to accomplish your goal.
a determination to become actively in-
Daily imagine yourself accomplishing volved with the problem.
the goal.
Periodically identify the next steps to Similar findings to Whimbey's have been re-
take to accomplish the goal. ported by Sternberg (1984), Chi et al. (1982)
and Larkin (1981). If we summarize the re-
Occasionally review your goal to see if search, three basic attitudes about work
you should change it. emerge:

a willingness to be actively involved in


a task
3. MONITORING
MONITORING ATTITUDES
a commitment to persistence
Once a goal is set an individual will gener-
ally monitor his or her progress and 2 ttitudes a sensitivity to feedback.

40
46
Individuals who are highly efficient at ac- pect to perceive. Frank Smith (1978) drama-
complishing tasks operate from these princi- tizes this by saying:
ples. They have an ability to get deeply in-
volved in a task; they have a strong commit-
mcnt to precision and accuracy when en- What we have in our heads is a theory
gaged in tasks, and they are sensitive to how of what the world is like, a theory that
well the task is going and make corrections is the basis of all our perceptions and
or try something different if necessary. understanding of the world, the root of
all learning, the source of all hopes and
fears, motives and expectancies, reason-
b. Attitudes That Stimulate ing and creativity. And this theory is
Exploration all we have. If we can make sense of
the world at all, it is by interpreting
It is believed by some theorists that at an our interactions with the world in the
unconscious level human beings are fearful light of our theory. The theory is our
that circumstances work against the accom- shield against bewilderment (p. 57).
plishment of goals. For example, in a paper
entitled "On the Need to Know and the Fear In isolation this assertion implies a determin-
of Knowing," Abraham Maslow pointed out istic view of human cognition. If we per-
that humans are taught culturally not to trust ceive only what we expect to perceive, we
themselves or the inherent order of life. are stuck in a perceptual "programming loop."
This is consistent with research findings in
student motivation (e.g., Harter, 1980, 1983). However, along with science's realization
Specifically, it has been found that a key that perception is subjective is the parallel
factor in motivation to complete a task is a hypothesis that human beings have the power
student's trust that circumstances will not to shift perceptions at will. That is, we can
necessarily work against the completion of choose to see things in a different way. This
the task. It appears, then, that the control- concept of voluntary paradigm shifting has
ling principles relevant to academic success affected a wide range of human endeavors
might be: from theory and practice in research (Skrtic,
1983; Schwartz and Ogilvy, 1979) to economic
A belief that life is trustable. That is, theory (Henderson, 1985) and to human pro-
circumstances do not automatically ductivity (Bodek, 1984-1985). Another way
work against the accomplishment of a of saying this is that individuals who know
goal. that their perceptions are subjective and can
voluntarily shift them have a very powerful
Research suggests that people who operate tool which can be used for school-related and
from this controlling principle are willing to non-school-related tasks. We. might say, then,
engage in a wider range of behavior than that two attitudes which exert a high level of
those who operate from its negative counter- contra,: over cognition and behavior are:
part (e.g., life is not trustable). It has also
been found that a willingness to engage in a belief that perceptions are subjective
many and varied activities is a major factor and are generated from a specific point
in problem solving (Whimbey, 1984), creativ- of view
ity (Perkins, 1980) and productivity (Fromm,
1968). a belief that one's point of view is con-
trollable along with a willingness to
c. Attitudes That Broaden change a given point of view.
Perception
How do you introduce to students the con-
One of the more powerful scientific realiza- cept of monitoring attitudes? The first step
tions in the past few decades has been that is to discuss with them the fact that attitudes
perception is fundamentally subjective in na- affect behavior and the possibility that atti-
ture. That is, we perceive only what we ex- tudes can be controlled and changed.

41

47
The second step is to make students aware of complished. These milestones represent
some of the basic attitudes discussed above. "checkpoints" along they way.
This can be done through discussion and/or
by reading books, short stories and plays that Another useful self-evaluation technique rel-
seem to emphasize these attitudes. For ex- ative to long-term goals is action planning.
ample, Carol Snyder's Memo: To Myself When A simplified version of action planning
I Have A Teenage Daughter (1983) is about a might be:
thirteen-year-old girl name Karen who isn't
ready for love affairs but is going through Step 1. Identify actions you believe
those painful formative years convinced that should be taken to accomplish the goal.
her mother doesn't understand her. However,
her mother gives her a diary that she began Step 2. Prioritize those a^. %Ins.
when she was thirteen. This totally shifts
Karen's perception of her mother. Suddenly, Step 3. Keep moving though your
Mom becomes a human being. This dramatic list of prioritized actions with an em-
turn around in Karen's perceptions of her phasis on always doing something rela-
mother can be used to introduce the concept tive to your goal.
that perceptions emanate from specific points
of view and that you can change your point Step 4. Periodically stop working and
of view and your perceptions. reassess your action plan. Are there
any actions you have listed which you
Once basic attitudes have been presented to now believe are irrelevant to your goal?
the students, the next step is to help them Cross those off your list. Are there any
identify their own thinking relative to the actions important to the accomplish-
attitudes. Which attitudes do they already ment of your goal which you have not
operate from? How do these attitudes affect listed? Add these to your list.
thcir lives? This might be done in an exper-
imental fashion. Students can be asked to Whereas the techniques described above are
keep a journal for a few days. Every time fairly concrete, self-evaluation can be quite
they become aware of one of the attitudes in difficult if goals and tasks are primarily
thcir own lives they can record their thought cognitive. That is, for goals which require
and describe how the attitude shapes their complex mental operations there is very little
bch avior. external evidence to indicate how the task is
progressing. To overcome this inherent dif-
Finally, studcnts can try to develop new atti- ficulty with mental tasks, student3 can be
tudcs about their ability to be successful. asked to "think aloud" as they engage in the
For example, students might practice saying task. Recall that we introduced thinking
the following affirmation: aloud (verbal mediation) in the third chapter
in the discussion of problem solving. As
I can trust that when I try to do some- Whimbey and Lochhead (1980) state, thinking
thing, things will generally go well. aloud is a very powerful self-evaluation tool:
"If both students and experts vocalize their
thoughts as they work through complex ideas
and relationships, the steps that they take are
4. SELF-EVALUATING open to view and their activities can be ob-
served and communicated" (p. 24).
During the attainment of and upon comple-
tion of a goal, effective learners commonly Thinking aloud as a self-evaluation tech-
engage in self-evaluation techniques in which nique has been successfully used in mathe-
they identify what is working and what is matics and science-related tasks (e.g.,
not working relative to the goal. When goals Lochhead, 1985) as well as with language arts
are long term this is best accomplished by related cognitive tasks (e.g., Scardamalia and
setting "milestones"small goals which are Berietcr, 1983). In the "paired problem solv-
indications that the larger goal is being ac- ing approach" (Lockhead, 1985) students are

42
48
encouraged to work in pairs with one student a. Hold-off or "bracket" any
acting as the listener and the other as the thoughts unrelated to assigned
"doer." The listener has two major tasks: 1) class work.
to constantly check accuracy for the doer
and 2) to demand constant vocalization from b. Generate interest and value for
the doer. After students have received prac- the assigned class work.
tice as listeners and doers they switch roles. c. Commit to being involved and
Over time the process of monitoring how exerting necessary effort.
well a task is progressing becomes second na-
ture and students no longer need the aid of a d. Take a stand that you can do
"listener." Rather, they incorporate self-eval- well.
uation into their standard operating proce-
dures when they engage in complex tasks. 4. Goal Setting Phase:
a. Set some specific goals for the
THE ACTIVITY FRAMEWORK class.
The four generalized learning-to-learn com- b. Integrate the teacher's goals with
petencies described above can be presented to your own.
students in isolation or they can be combined 5.
into what we call the "activity framework." Task Engagement Phase:
It is presented in Figure 4.1: a. Be aware of whether you are
getting closer to or further away
from your stated goals.

Figure 4.1 b. Make any corrections necessary in


your own behavior or seek help to
ACTIVITY FRAMEWORK further the attainment of your
goals.
1. Refocusing Phase: Relax and end
whatever previous activity you were 6. Task Completion Phase:
engaged in. a. Determine if your goals were
2. Awareness Phase: accomplished.

a. Notice your level of distraction b. Evaluate what worked and what


(e.g,, how much are you attending did not work relative to your
to thoughts unrelated to this goal.
class?).
b. Notice your attitude toward the The activity framework is intended as a
class (e.g., do you believe the class "casing" or context for all content area in-
is valuable or not valuable? Do struction. For example, classes can begin
you believe the class is interesting with phases 1-4. Students can be asked to
or boring?).
end whatever activity they were previously
c. Notice your attitude toward engaged in (Phase 1). If they are particu-
working (e.g., are you committed larly distracted, they can be led through
to being involved in the class or some basic relaxing activities to help clear
do you want to coast?). their minds and focus on the upcoming tasks
for class. They can then be given a few
d. Notice your attitude toward their minutes to become aware of basic attitudes
ability (e.g., do you have a sense which will affect their performance (Phase
of power about your ability to
perform well in this class or do 2). Once students become aware of the atti-
you have a sense of sinking?). tudes they have brought to class they should
be requested to take responsibility for gener-
3. Responsibility Phase: ating some attitudes that will be particularly

43
49
useful to them ir. performing well within the With the exception of Step 2, this process fits
class (Phase 3). nicely in Phase 5 of the Activity Framework
Usually Phases 1-3 will take only a few min- (Hunter's Step 2 would be redundant with
utes at the beginning of class. However, the Phase 4 of the Activity Framework). Within
time spent is well worth it because students Phase 5 students would generally be involved
will likely be more highly engaged and suc- in what we have called "content thinking."
cessful. Sometimes the teacher may want to Our description of content thinking in the
expand the time used for phases 1-3. This second chapter, then, should add clarity to
might involve a prolonged relaxing activity Hunter's suggested instructional sequence.
or a prolonged time when students discuss That is, teachers could define whether they
thoughts they would like to bracket but are want to introduce (Step 3) new declarative
experiencing a difficult time with. In a sim- knowledge (e.g., a new concept, a relationship
ilar fashion teachers and students might en- or a pattern of information), new procedural
gage in a prolonged discussion of how their knowledge (e.g., teach students how to "do
attitudes are affecting their performance. something" new like read a bar graph) or new
contextual knowledge (e.g., teach students a
Phase 4 can also be quite short or extended. new situation in which a known procedure
In its brief form students would be asked to could be used). This step would be followed
write a few academic goals they wish to ac- by some form of modeling, checking for
complish during class. They would also be understanding, guided and independent prac-
asked to incorporate the teacher's goals into tice activities.
their own. During the extended version of
Phase 4, students might review long-term Finally, classes would end with phase 6.
goals they have set, make entries in their Here students and teachers would review to
journals relative to how well the goal setting see if they had accomplished their stated
goals. If so, they would try to identity what
process is working for them or engage in worked best for them. If goals were not ac-
some action planning relative to specific
goals. complished, they would try to identify what
did not work well.
During Phase 5 students and teacher engage Over time the activity framework will be-
in standard content area activities. As a come something students use in all
matter of fact, most of the instructional activitiesin and out of school. If we can
models currently within use (e.g., Hunter, believe current research and theory, such a
1984; Rosenshine, 1979) fit neatly into phase practice will make them more powerful and
To illustrate, consider the seven independent learners.
5. stet.
Hunter model:
Step 1. Provide students with a men-
tal set (anticipatory set) for the infor-
mation to be learners.
Step 2. Identify the objective and
purpose of the upcoming lesson.
Step 3. Provide new input to students.
Step 4. Model new knowledge or new
procedures for students.
Step 5. Check for understanding.
Step 6. Provide guided practice.
Step 7. Provide independent practice.

44
RESTRUCTURING ISSUES

The introductory chapter suggested that the minority groups. For example, in New York
teaching of thinking will require some shifts City, 50% of all high school age blacks and
in current educational practices. These Hispanics have left school. Of these 40,000
changes have been described as restructuring teenagers, only 9,000 will find jobs that
issues and have been discussed in depth by match their skill levels.
Arredondo and Marzano (1985). Some educa-
tional theorists believe that without instruc-
tional changes education will :cntinue to Of equal concern are the accusations that
function primarily as a soci::,:cono:nic sorting large numbers of high school graduates leav-
mechanism in society. ing school today are functionally illiterate,
,unprepared for any existing job and lacking
For example, socioeconomic sociologist in the knowledge or skills needed to be a
Persell (1977) in Education and Inequality: productive member of society. If this
The Roots and Stratificat:on in America's situation is true, public school systems are
Schools, documents the exten, to which public the obvious starting point for the remedia-
schools sort and classify students. Persell tion of this situation.
states that "in today's America, the institu-
tion of education is called upon to maintain,
reproduce, and legitimize the inequalities of Of even greater concern is tip.. fact that
society" (p. 30). Arredondo and Marzano schools historically have been asked to pre-
(1985) state that if we continue to produce pare students for working in the production
large numbers of under-educated young peo- sectors of our societymanufacturing, trans-
ple from the public schools, a growing public portation and food-production industries.
concern and discontent will be the inevitable Jobs in these areas did not require a high de-
result. gtce of academic skill. Today there are
fewer of these jobs in our society. Instead,
There are a number of indication., th.it we we have more jobs that involve much higher
are producing large numbers of under-edu- levels of abstrr...t thought. Insurance agents,
cated youth. For example, the present high people in finance, farmers, real estate agents
school dropout statistics indicate that approx- and many others are required to work with
imately 25°k of the nation's population be- complex information, make complex decisions
tween the ages of 14-18 years are no longer and upgrade their knowledge and skills on a
enrolled in school. Estimates of the size of regular basis. Schools must be more success-
this out-of-school population run as high as ful than they have had to be in past to pre-
40% in some larger cities where the largest pare students for life in the twenty-first cen-
percentage of these youths are members of tury.

45

51
Our society's success in competing with other
nations also depends on an increase in
productivity. That increase will not occur if
we do not learn to think more effectively. RESTRUCTURING ISSUES RELATED TO
THE TEACHING OF CONTENT
A basic assumption of this monograph is that THINKING SKILLS
the teaching of thinking skills is one of the
most powerful mechanisms for endii.g the The content thinking skills presented in this
sorting function of public education and im- monograph suggest a number of restructuring
proving student competency and productiv- issues. Fir is the need to have teachers be-
ity. The small percentage of students now come aware of and explicitly teach declara-
leaving school with the thinking skills tive, procedural and contextual knowledge in
necessary for success in the present and each subject area. This is not a new sugges-
future society are abie to do so because many tion. As mentioned earlier, it was Becker's
of them have acquired these skills either (1977) recommendation, after a thorough
outside of school or as an indirect result of analysis of the research on various interven-
classroom instruction. For example, most of tions for the educationally disadvantaged,
those students who do learn the thinking that systematic instruction in the basic con-
skills defined in this monograph develop cepts should be an educational priority.
them because of their backgrounds or out-of- Becker specifically asserted that the educa-
classroom experiences. tionally disadvantaged would benefit as well
as all other students:
Students from higher level socioeconomic
backgrounds have many out-of-school oppor- By the use of carefully structured pro-
grams to boost vocabulary competency
tunities to learn these skills; students with for low performing children in the
lower socioeconomic backgrounds have less early grades, the number of children in
of an opportunity to develop them. For ex- the lower end of this range can be re-
ample, extracurricular activities also provide duced. By structuring school programs
settings in which some of these skills, partic- to teach basic operations in the various
ularly the learning-to-learn skills, are ac- areas of knowledge using basic words,
quired; these activities are more frequently the advanced children would not neces-
sarily be held back (p. 539).
engaged in higher socioeconomic students
than those from lower socioeconomic back- Content area curriculum should be restruc-
grounds.
tured so as to make salient those concepts
that are crucial to the subject area. This im-
As school systems identify the thinking skills plies a rethinking and restructuring of most
that ought to be taught, place them in the existing courses.
curriculum, teach these skills, and then test
for specific skill development, all students A second issue has to do with the manner in
will have the direct opportunity to acquire which we teach these concepts. We believe
the competencies necessary in the informa- instruction should be consistent with the way
tion age. Such a change would have a con- students naturally learn concepts. The adop-
comitant impact on the fabric of public tion of such a recommendation would involve
schools. Below, we will consider a few re- another major restructuringthe restructur-
structuring issues we believe are necessary ing of our models for instruction.
for the systematic teaching of thinking skills.
Specifically, we will consider how each of In Chapter 2 we mentioned the growing body
the three thinking skill areas (content think- of research which suggests that knowledge is
ing, reasoning and learning-to-learn) necessi- developed and stored in two primary forms:
tates fundamental changes in schools. We imagery and verbal. Kaufman (in Sheikh,
will also consider necessary changes in test- 1983) states that these are the two primary
ing and evaluation and the integration of in- forms of thinking. Yet within formal educa-
struction. tion there is a lack of attention to and even

46
52
a distrust of the nonverbal aspects of cogni- and Tierney (1983) state that current in-
tion in spite of the growing evidence to sup- structional practice most commonly has the
port its central role in information process- following characteristics:
ing. We believe that to teach thinking effec-
tively teachers will need to highlight and use of many practice materials
model the nonverbal aspects of learning. Our
curriculum and instruction models must not little explanation of cognitive tasks
approach everything in a linguistic way. We
must operationalize the belief that many little interaction with students about
problems and a great deal of thinking in- the nature of specific tasks
volves experiences and skills that go beyond
the rote learning of dictionary-like defini- emphasis on one correct answer to the
tions of words and concepts. Again, restruc- extent of supplying the answers for
turing of our current instructional models students if they exhibit problems with
will be necessary to accomplish this. or confusion over a task.
The introduction of "relationship identifica-
tion" and "pattern recognition" into the cur- Pearson and Tierney imply that this is a gen-
riculum suggests another restructuring issue: eral model commonly used in all content ar-
the conscious introduction of organizational eas at all grade levels. If this is true, it can
patterns into textbooks and oral presenta- be said that current instructional practice
tions. For example, the more that complex does not conform to what appears to be nec-
organization patterns and relationships are essary for effective teaching and learning of
made salient in written material and oral basic cognitive abilities. What is needed is
presentations, the easier information is .to an instiuctional style that places the teacher
process and retrieve. Most textbooks and in the role of a filter between the students
many class presentations, however, do not and the assigned academic tasks. This role
clearly use such organizational patterns. As would be consistent with Fuerstein et al.'s
(1985) assertion that cognitive abilities are
a. result, students have to provide these pat-
terns for themselves. As mentioned previ- learned most effectively during "mediated
ously, better students look for or create these learning experiences." Direct instruction in
patterns as a basic comprehension strategy reasoning using this perspective would place
while less successful learners do not appear the teacher in the role of helping students
to have this meta-cognitive awareness. Con- learn how to store, retrieve, match or build
sequently, it is the job of the teacher to pro- new information. The teacher would become
vide organizational patterns students can use much more process oriented, helping students
to organize textbook and lecture material. think and verbalize about the thinking activ-
ities that a lesson called on them to apply.
Finally, classroom instruction needs to be re-
structured to create a balance between the
teaching of declarative knowledge (e.g., facts)
and the teaching of procedural and contex- RESTRUCTURING ISSUES RELATED
tual knowledge. It is not a matter of choos- TO THE TEACHING OF
ing between the domains but making sure LEARNING-TO-LEARN SKILLS
that we include all of them. That will be
difficult for many teachers unless they are
given strong support in learning how to teach The direct teaching of learning-to-learn
procedures and context. strategies represents a major restructuring
from the current instructional models that
focus responsibility for learning on the
RESTRUCTURING ISSUES RELATED TO teacher rather than the student. Basically, an
THE TEACHING OF REASONING SKILLS emphasis on learning-to-learn strategies
would convey the message that students must
In their review of the research on instruction take an active role in the learning process.
related to the teaching of reading, Pearson Baird and White (1982) contend that only
47
53
minor improvements will be made within ed- Such a focus would require that the areas de-
ucation unless there is a fundamental shift scribed in this model should be academically
from teacher to student responsibility for assessed. The difficulty is that many of the
learning. We believe that can only be ac- competencies described above cannot be as-
complished by helping students learn how to sessed using traditional formats sucn as mul-
focus their attention, set goals and monitor tiple choice questions. Furthermore, some
their own attitudes and progress. competencies we have described here have no
"correct answer" to use as a criterion (e.g.,
evaluation of value). Consequently, the in-
I' appears that many of the individuals con- clusion of many of the components of this
sidered successful in today's technological so- model would necessitate a shift in the scope
ciety are aware of the learning-to-learn skills and practice of assessment. Specifically, as-
and systematically use them. For example, sessment would have to involve data gather.
Peters and Waterman (1982) cite examples of ing techniques commonly associated with
top executives cultivating such meta- cogni- qualitative research (e.g., Miles and Huber-
tive strategies as goal setting, monitoring man, 1984). We believe that without such a
feedback, and cognitive restructuring. Not shift, formal education will remain en-
surprisingly, there are many powerful train- trenched in current testing practices which
ing programs within business and industry commonly are discriminatory against certain
(e.g., Tiece, 1976) which use adaptations of socioeconomic groups.
the learning-to-learn process presented here.
However, within mainstream education few
components are systematically taught even
though there has been a long standing man- RESTRUCTURING ISSUES INHERENT
date from the research community that such IN THE UNITARY NATURE
meta-cognitive awareness should be taught as OF INSTRUCTION
a part of the formal education process. For
example, McCombs (1984) asserts that this
area holds the promise of unlocking a door We have entitled the approach to teaching
for "those students whose deficiencies pre- described in this monograph as a "unitary
clude them from enjoying the positive bene approach." This is because in developing the
fits of learning and self-development" (p. model we have made an assumption that all
216). components (e.g., content thinking, reasoning
and learning-to-learn) must be an integrated
part of all content and instruction. The
learning-to-learn skills represent the frame-
TESTING AND
AND EVALUATION ISSUES work for content teaching. To ignore these
INVOLVED IN THE TEACHING OF skills is to ignore the context in which learn-
THINKING SKILLS ing occurs. All too often elegantly structured
lessons are wasted because students have not
One key to the success or failure of teaching generated the necessary energy, effort and
thinking in schools will be found in the re- interest to engage in the lesson.
structuring of testing and evaluation. Doyle
(1983) states that accountability drives the Given that students have accepted responsi-
academic tasks presented to students. Stu- bility for their involvement in the learning
dents tend to take seriously only those tasks process, the unitary model implies that class-
for which they are held accountable (Carter room content must be viewed as the balanced
and Doyle, 1982; King, 1980; Winne and presentation of three types of information:
Marx, 1982). We believe that teachers have I) declarative, 2) procedural, and 3) contex-
this same sensitivity. As a result, current tual. The omission or overemphasis of any
models of testing and evaluation must be re- one type of information will create gaps in
vised to include an explicit focus on thinking learning that threaten students understanding
skills. of the totality of the content.

48

54
Finally, when presenting content area mate-
rial, teachers must mediate the learning pro-
cess by modeling and reinforcing the reason-
ing skills necessary to process content and
expand on content.

All three components of the unitary model


are "basic." All three are needez! to restruc-
ture instruction so as to halt and reverse the
sorting function of the current educational
system.

Training programs based on the conceptual framework for


thinking skills presented in this monograph are available from
the Mid-continent Regional Educational Laboratory.

49 55
REFERENCES
Alexander, P.A. (1984) Training analogical reasoning skills in the gifted. Roeper Review, 6, (4), 191-194.

Anderson, J. (1982) Acquistion of cognitive skills, Psychological Review, 1982, 89, 369-406.

Anderson, J. (1983) The architiecture of cognition, Cambridge, Mass.: Harvard University Press.

Anderson, R., & Freebody, P. (1981) Vocabulary knowledge. In J.T. Guthrie (Ed.) Comprehension and teaching.
Newark, NJ: International Reading Association.

Anderson, T. (1978) Study skills and learning strategies. Technical Report N. 104. Urbana, Illinois: Center for the
Study of Reading.

Arter, J.L. (1976) The effects of metaphor on reading comprehension. Unpublished doctoral dissertation, University of
Illinois.

Arredondo, D. & Marsano, R. (1985) Restructuring education through the teaching of thinking. Paper submitted to
Educational Leadership.

Baird, J.R. & White, R.T. (1982) Promoting self-control of learning. Instructional Science, 11, 227-247.

Bandura, A. & Schunk, D. (1981) Cultivating competence, self-efficacy and intrinsic interest through proximal self-
motivation. Journal of Personality and Social Psychology, 41 (3), 586-598.

Becker, W. (1977) Teaching reading and language to the disadvantage --What we have learned from field research.
Harvard Educational Review, 47, 518-543.

Bellezza, F.S. (1981) Mnemonic devices: Classification, characteristics and criteria. Review of Educational Research, 51,
247..275.

Bereiter, C. (1984) How to keep thinking skills from going the way of all frills. Educational Leadership, 42 (1), 75-77.

Bertalanffy, L. von (1967) Robots, Men and Minds, New York: George Brazil ler.

Bertalanffy, L. von (1969) General Systems Theory, New York: George Brazil ler.

Beyer, B. (1984) Improving thinking skills -- defining the problem. Phi Delta Kappan, 45, 12-18.

Block, J.H. (1985) Belief systems and mastery learning. Outcomes, 4, (2), 3-14.

Bobrow, D.G. & Winograd, T. (1977) An overview of KRL, a knowledge representation language. Cognitive Science, 1,
3-46.

Bodek, N. (1984-85/Winter-Spring) Werner Erhard on transformation and productivity: An interview. Revision, 7 (2),
30-38.

Boul'ling, K.E. (1968) General Systems and Holism, In E. Laszlo (Ed.) Modern Systems Research for the Behavioral
Scientist, Chicago: Aldine Publishing Co.

Bransford, J.D., & Franks, J.J. (1971) The abstraction of linguistic ideas. Cognitive Psychology, 2, 331-350.

Brophy, J. (1982) Classroom organization and management. Washington D.C. National Institute of Education.

50
56
Bruce, B. C. (1975) Belief systems and language understanding. Cambridge, MA: Bolt, Beranek & Newman.

Bruce, B.C., & Schmidt, C.F. (1974) Episode understanding and belief guided parsing. New Brunswick, NH: Rutgers
University.

Bryen, D. N. (1983) InijLes into child language, Boston, MA: Allyn & Bacon.

Bugelski, B.R. (1977) The association of images. in J.M. Nichol's (Ed.) Images: perception and knowledge. Boston: D.
Reidel.

Bugelski, B. R. (1983) Imagery and thought processes. In A.A. Sheikh (Ed.) Imagery: Current theory, research and
application. Hillsdale, N.J: Erlbaum.

Carroll, J., Davies, P., & Richman, B. (1971) Word frequency book. Boston, MA: Houghton, Mifflin.

Carter, K., & Doyle, W. (1982, March) Variations in academic tasks in high and average ability classes. Paper presented
at the annual meeting of the American Education Research Association. New York.

Chi, M.T., Glaser, R. & Rees. E. (1982) Expertise in problem solving. In. R. Sternberg (Ed.) Advances in the
psychology of human intelligence. Hillsdale, N.J.: Erlbaum.

Condon, J.C. (1968) Semantics and communication. New York: MacMillan.

Covington, M.V. (1985) Strategic thinking and the fear of failure. In J.W. -Segal, S.F. Chipman & R. Glaser (Eds).
Thinking and learning skills, Vol. 1. Hillsdale, N.J: Erlbaum.

deBono, E. (1985) The CoRT thinking program. In J.W. Segal, S.F. Chipman & R. Glaser (Eds). Thinking and
learning skills, Vol. 1. Hillsdale, N.J.: Erlbaum.

Doyle, W. (1983) Academic work. Review of Education Research. 53, 159-199.

Dyer, W.W. (1976) Your enoneus zones, New York: Funk & Wagnalls.

Education Commission of the States. (1982) The information society: Are high school graduates ready? Denver, CO.

Evertson, C. (1980) Differences in instructional activities in high and low achieving junior high classes. (R & D Report
No. 6105) Austin, Texas: Texas University. Research and Development Center for Teacher Education.

Feurstein, R Instrumental enrichment An intervention program for cognitive modifiability. Baltimore: University Park
Press.

Fitts, P.M. (1964) Perceptual-motor skill learning. In A.W. Melton (Ed.). Categories of Human Learning. New York:
Academic Press.

Flower, L. Et Hayes, J.R. (1980) The cognition of discovery. Defining a rhetorical problem. College Composition and
Communication, 13, 21-32.

Fodor, J.A. (1976) The language of thought. Hassocks, Sussex: Harvester Press.

Fromm, E. (1968) The nonproductive character orientation. In. L. Gorlow & W. Katkousky (Eds.) Readings in the
psychology of adjustment. New York: McGraw Hill.

Gardner, H. (1983) Frames of mind. New York: Basic Books Inc.

t/'
51
57
Glasser, W. (1981) Stations of the mind. New York Harper & Row.

Goetz, E.T., Palmer, D.J. & Haensly, P.A. (1983) Metacognitive awareness of text variables in good and poor readers.
In J. Niles (Ed.) Searching for meaning in reading/language processes and instruction. Rochester, N.Y.: The
National Reading Conference.

Good, T., Grouws, D. & Ebmeier; H. (1983) Active mathematics teaching. New York. Longman.

Gourley, T. J. & Mick lus, C.S. (1982) Problems, problems, problems: Discussion and activities designed to enhance
creativity. Glassbro, New York: Creative Publications.

Gow, D.T. & Casey, T.W. (1983) Selecting learning activities. In. F. English (Ed.) Fundamental curriculum design.
Alexandria, Virginia: Association for Supervision and Curriculum Development.

Grimes, J.E. (1972) The thread of discourse. Ithaca, New York: Cornell University.

Hall, G.E. (1976) The Study of Individual Teacher and Professor conctrns about Innovation. Journal of Teacher
Education, 28 (1).

Halliday, M. (1967) Notes on transitivity and theme in English. Journal of Linguistics, 3, 37-81.

Halliday, M., & Hasan, R. (1976) Cohesion in English. London: Longman.

Harris, A. & Jacobson, M. (1972) Basic elementary reading vocabularies. New York: MacMillan.

Harter, S. (1983) The development of the self-system. In M.R. Hetherington (Ed). Carmichael's manual of child
psychology: Social and personality development. New York, NY: Wiley.

Harter, S. (1980) The perceived competence scale for children. Child Development, 51, 218-235.

Hawkins, D. (1974) The informed vision: Essays in learnin and human nature. New York: Agathon Press.

Heller, J. & Reif, F. (1984) Prescribing effective human problem-solving processes: Problem description in physics.
Cognition and Instruction, 1, 1984.

Henderson, H. (1984-1985/Winter-Spring) Post-economic policies for post-industrial societies. Revision, 7, 20-29.

Hull, C.L. (1920) Quantitative aspects of the evolution of concepts. Psychological Monograpghs, 28 (1).

Hunter, M. (1984) Knowing, teaching and supervising. In. P. Hosford (Ed.) Using what we know about teaching.
Alexandria Virginia: Association for Supervision and Curriculum Development.

Johnson, D.D. & Pearson, P.D. (1984) Teaching reading vocabulary. New York: Holt, Rinehart and Winston.

Johnson-Laird, P.N. (1983) Mental models. Cambridge, Mass.: Harvard University Press.

King, L.H. (1980) Student thought processes and the expectancy effect. (Research Report No. 80-1-8). Edmonton,
Alberta, Canada: Centre for Research in Teaching. The University of Alberta.

Kinstch, W., & van Dijk, T.A. (1978) Toward a model of text comprehension and production. Psychological Review, 85,
363-394.

Klausmeier, H.J. & Goodwin, W. (1971) Learning and human abilities: Educational psychology, New York: Harper &
Row.

52
58
Klausmeier, H.J., & Sipple, T. (1980) Learning and teaching concepts. New York: Academic Press.

La Berge, D., & Samuels, S.J. (1974) Toward a theory of automatic information processing in reading comprehension.
Cognitive Psychology, 6, 293-323.

Larkin, J. (1981) Enriching formal knowledge: A model for learning to solve texbook problems. In J. Anderson (Ed.)
Cognitive skills and their acquisition. Hillsdale, N.J.: Erlbaum.

Lavelle, N. & Keogh, B.K. (1980) Expectations and attributions of parents of handicapped children. New Directions for
Exceptional Children, 4, 1 -27.

Lehnert, W.G. (1978) The process of question answering, Hillsdale, N.J.: Erlbaum.

Leslie, L., & Jett-Simpson, M. (1983) The effects of recall instruction and story deletions on children's story
comprehension. In 3. Niles & L. Harris (Eds.) Searching for meaning in reading/language processing and
instruction. Rochester, NY: National Reading Conference.

Lewis, D & Greene, J. (1982) Thinking better. New York: Holt, Rinehart & Winston.

Lindsay, P.H., & Norman, D.A. (1977) Human information processing. New York, NY: Academic Press.

Lochhead, 3. (1985) Teaching analytic reasoning skills through pair problem solving. In. J.W. Segal, S.F. Chipman &
R. Glaser (Eds). Thinking and learning skills: Vol. 1. Hillsdale, New Jersey: Erlbaum.

Luria, A. (1973) The working brain. New York: Basic Books.

Marshall, N., & Glock, M. (1978-79) Comprehension of connected discourse: A study into the relationship between the
structure of text and the information recalled. Reading Research Quarterly,.76, 10-56.

Marzano, R. (1984) A cluster approach to vocabulary instruction. Reading Teacher, 38 (2), 168-173.

Marzano, R. (1983) A quantitative grammar of meaning and structure. Denver, CO: Mid-continent Regional
Educational Laboratory.

Marzano, R. de Dole, 3. (1983) Teaching relationships and patterns of information. Denver: Mid-continent Regional
Educational Laboratory.

Marzano, R., D. Stefano, P., Valencia, S. and Hagerty, D. (1986) Reading diagnosis and instruction: Theory into
practice. Englewood Cliffs, N.J.: Prentice Hall.

McCombs, B. (1984) Processes and skills underlying continuing intrinsic motivation to learn: Toward a definition of
motivational skills training intervention. Educational Psychologist, 19, (4), 199-218.

McNeill, D. (1975) Semiotic extension. In R.L. Solso (Ed.) Information processing and cognition: The Loyola
Symposion. Hillsdale, N.J.: Erlbaum.

Mervis, C.B. (1980) Category structure and the development of categorization. In. R.J. Spiro, B.C. Bruce & W.F.
Brewer (Eds.) Theoretical issues in reading comprehension, Hillsdale, N.J.: Erlbaum.

Meyer, 113. (1975) The organization of prose and its effects on memcry. Amsterdam: North Holland Publishing Co.

Miles, M. & Huberman, A. (1984) Qualitative data analysis. Beverly Hills, CA: Sage Publications Inc

53 59
Miller, G.A., Galanter, E. & Pribram, K.H. (1960) Plane and the structure of behavior, New York: Holt Rhinehart &
Winston.

Naisbitt, .1. (1922) Megatrends, New York: Warner.

National Commission on Excellence in Education. (1983) A nation at risk: The imperative for educational reform.
Washington, D.C.: Government Printing Office.

Neisser, V. (1967) Cognitive psychology. New York: Appleton.

Newell, A. & Simon H. (1972) Human problem solving, Englewood Cliffs, N.J.: Prentice-Hall.

Nickerson, R. (1984) Kinds of thinking taught in current programs. Educational Leadership, 42 (1), 26-37.

Ortony, A. (1980) Metaphor. In R.J. Spiro, C.B. Bertram, & W.F. Brewer (Eds.) Theoretical issues in reading
comprehension. Hillsdale, NJ: Erlbaum.

Paivio, A. (1983) Strategies in language learning. In. M. Pressley & J.R. Levin (Eds.) Cognitive strategy research:
Educational applications. New York: Springer - Verlag.

Paivio, A. (1971) Imagery and verbal processes. New York: Holt.

Paul, R. (1984) Critical thinking: Fundamental to education for a free society. Educational Leadership. 42. (1), Sept.
1984.
Pearson, P.D. & Tierney, R. (1983) In search of a model of instructional research in reading. In. S.G. Paris, G. M.
Olson & H.W. Stevenson, (Eds) Learning and motivation in the classroom. Hillsdale, New Jersey: Erlbaum.

Pearson, P.D. (1974-75) The effects of grammatical complexity on children's comprehension, recall and conception of
certain semantic relatives. Reading Research Quarterly, 10, 155-192.

Penfield, W. & Perot, P. (1963) The brain's record of auditory and visual experience: A final summary and discussion.
Brain 86, 595-696.

Perkins, D.N. (1984) Creativity by design. Educational Leadership, 42, 1, 18-25.

Persell, C. H. (1977) Education and inequality: The roots and stratification in America's schools. New York: Free Press.

Personal Report (April, 1985) New York: Research Institute of America.

Peters, T. & Waterman, R.H. (1982) In search of excellence. New York: Harper & Row.

Pitkin, W.L. (1977) X /Y: Some basic strategies of discourse. College English, 38, 660-672.

Poison, P.G. & Jeffries, R. (1985) Insturction in general problem-solving skills: An analysis of four aaproaches. In J.W.
Segal, S.F. Chipman & R. Glaser (Eds). Thinking and learning skills: Vol. 1. Hillsdale, N.J.: Erlbaum.

Polya, G. (1957) How to solve it. Princeton, N.J.: Princeton University Press.

Powers, W.T. (1973) Behavior: The control of perception. Chicago, IL: Aldine.

Resnick, L. (1983) Toward a cognitive theory of instruction. In. S. Paris, G. Olson & H.W. Stevenson (Eds). Learning
and motivation in the classroom. Hillsdale, New York: Erlbaum.

54
Richardson, A. (1983) Imagery: Definition and types. In A.A. Sheikh (Ed). Imagery: Current theory, research and
application: Hillsdale, N.J. Erlbaum.

Robertson, J. (1968) Pupil understanding of connectives in reading. Reading Research Quarterly, 1, 387-417.

Rosenshine, B. (1979) Content time and direct instruction. In. P. Peterson & H. Walberg (Eds.) Research on Teaching
Berkeley, CA: McCutchan Publishing Co.

Rowe, H.A. (1985) Problem solvii,g and intellignece. Hillsdale, N.J.: Erlbaum.

Russel, B. (1971) The conquest of happiness. New York: Liveright.

Sachs, J.S. (1967) Recognition memory for syntactic and semantic aspects of connected discourse. Perception and
Psychophysics, 2, 437-442.

Scardamalia, M. & Bereiter, C. (1983) Child as coinvestigator: Helping children gain insight into their own mental
processes. In. S.G. Paris, G.M. Olson & H.W. Stevenson (Eds). Learning and motiviation in the classroom.
Hillsdale, N.J.: Erlbaum.

Schwartz, P., & Ogilvy, J. (1979) The emergent paradigm: Changing Patterns of thought and belief. Values & lifestyles
program. Menlo Park, CA: SRI International.

Sears, P.S. (1940) Levels of aspiration in academically successful and unsuccessful children. Journal of Abnormal and
Social Psychology, 35, 498-536.

Sheikh, A.A. (Ed.) (1983) Imagery: Current theory, research and application. Hillsdale, N.J.: Erlbaum.

Sheikh, A.A. & Jordan, C.S. (198S) Clinical uses of mental imagery. In A.A. Sheikh (Ed.) Imagery: Current theory,
research and application. Hillsdale, N.J.: Erlbaum.

Skrtic, T. (1983) The doing of emergent paradigm research into educational organizations. Overland Park, KS:
Unversity of Kansas.

Smith, F. (1978) Understanding reading. New York: Holt, Rinehart & Winston.

Snyder, C. (1983) Memo to myself when I have a teenage daughter. New York: Coward-McCann.

Spiro, R.J. (1980) Constructive processes in prose comprehension. In R.J. Spiro, C.B. Bertram, & W.F. Brewer (Eds.)
Theoretical issues in reading comprehension. Hillsdale, NJ: Erlbaum.

Sternberg, R.J. (1984) What should intelligence tests test? Educational Researcher, 13, 5-15.

Sternberg, R.J. (1983) Criteria for intellectural skills training Educational Resea- chers, 12, 6-12.

Sternberg, R.J. (1977) Intelligence, information processing and analogical reasoning: The componential analysis of
human abilities. Hillsdale, N.J.: Erlbaum.

Stottlemeier, H. (1979) Philosophical inquiry: An instructional manual to accompany Harry Stottlemeir's discovery.
Upper Montclair, New Jersey: The Institute for the Advancement of Philosophy for Children.

Suinn, R. M. (1983) Imagery and sports. In A.A. Sheikh (Ed.) Imagery: Current theory, research and application.
Hillsdale, N.J.: Erlbaum.

55

61
Sywlester, R (1985) Research on memory: Major discoveries, major educational challenges. Educational Leadership, 42
(7), 69-75.

Taylor, B., & Samuels, S.J. (1983) Children's use of text in the recall of expository material. American Educational
Research Journal. 20, 517-528.

Tiece, L. (1976) Achieving your potential. Seattle: The Pacific Institute.

Tough, J. (1976) Listening to children talking. London: Schools Council Pulbications.

Toulmin, S. (1958) The uses of argument. Cambridge, England: Cambridge University Press.

Toulmin, S. Rieke, R., & Janik, A. (1979) An introduction to reasoning. New York, NY: Macmillan.

Tyler, R. (1975) Basic principles of curriculum and instruction. Chicago: University of Chicago Press.

Underwood, B.J. (1976) Attributes of memory. Psychological Review, 76, 559-573.

vanDijk, T.A. (1980) Macrostructures. Hillsdale, NJ.: Erlbaum.

vanDijk, T.A. & Kintsch, W. (1983) Strategies of discourse comprehension. New York: Academic Press.

Warren, W.H., Nickolas, D.W. & Trabasso, T. (1979) Event chains and inferences in understanding narratives. In. R.O.
Freed le (Ed.) New directions in discourse processing, Vol. 2, Norwood, N.J.: Ablex.

Waters, H.S. (1978) Superordin ate-subordinate structure in semantic memory: The roles of comprehension and
retrieval processes. Journal of Verbal Learning and Verbal Behavior, 17, 587-597.

Weiner, B. (1976) Attribution theory, achievement, motivation and the education process. Review of Educational
Research 42 (2), 203-215.

Weiner, B. (1983) Speculations regarding the role of ffect in achievement --change programs guided by attributimal
principles. In. J., M. Levine & M.C. Wang (Els). Teacher and student perce'tions. Hillsdale, N.J.: Erlbt.um.

Wertheimer, M. (1945, 1959) Productive thinking. New York: Harper & Row.

Whimbey, A. & Lochhead, J. (1980) Problem solving and comprehension: A short course in analytical reasoning.
Philadelphia: Franklin Institute Press.

Winne, D.H., & Marx, R.W. (1982) Stuck its and teachers views of the thinking processes for classroom learning.
Elementary School Journal, 82, 493-518.

Winograd, T. (1972) Understanding natural language. New York: Academic Press.

C6 62
THE THINKING SKILLS

I. CONTENT THINKING
Acquiring Declarative Knowledge
1. Attaining concepts: learning and relating new concepts to those already known.
2. Identifying relationships: establishing relationships between and among ideas.
3. Recognizing patterns: organizing blocks of information in meaningful ways.
Acquiring Procedural Knowledge
4. Proceduralizing: breaking a complex process into its component parts.
Acquiring Contextual Knowledge
5. Recognizing context: determining situations in which specific information and
skills should and should not be used.
II. REASONING
Transferring
1. Storing and retrieving: enhancing information for easy retrieval.
2. Memory frameworks: storing large sets of information in long-term memory.
Matching
3. Categorizing: organizing concepts into meaningful groups.
4. Reasoning analogically: recognizing the relationship between two concepts and
identifying another set of concepts with a similar relationship.
5. Extrapolating: matching the pattern of information from one context to another.
6. Evaluating evidence: deciding whether information follows the rules of logic.
7. Evaluating value: deciding how information matches with internalized values.
Restructuring
8. Elaborating: expanding information by identifying unstated characteristics,
causes, purposes and backgrounds.
9. Problem solving: identifying missing information in goal-driven situations.
10. Inventing: conceiving of and developing products in a polished state.
III. LEARNING-TO-LEARN
1. Attending: monitoring attention and raising it when necessary.
2. Setting goals: setting explicit short-term and long-term learning goals and
developing strategies to meet those goals.
3. Monitoring attitudes: identifying attitudes toward learning/school and
fostering those which facilitate academic success.
4. Self-evaluating: monitoring progress toward goals and making adjustments in
behavior if necessary.

63
NicREL McREL
12500 E. lliff Ave. Suite 201 4709 Belleview Ave.
Aurora, Colorado 80014 Kansas City, Missouri 64112
(303) 337-0990 (816) 756-2401

64

You might also like