You are on page 1of 18

Priming Effects in Complex Information Environments: Reassessing the Impact of News

Discourse on Presidential Approval


Author(s): Scott L. Althaus and Young Mie Kim
Source: The Journal of Politics , Vol. 68, No. 4 (Nov., 2006), pp. 960-976
Published by: The University of Chicago Press on behalf of the Southern Political Science
Association
Stable URL: https://www.jstor.org/stable/10.1111/j.1468-2508.2006.00483.x

JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide
range of content in a trusted digital archive. We use information technology and tools to increase productivity and
facilitate new forms of scholarship. For more information about JSTOR, please contact support@jstor.org.

Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
https://about.jstor.org/terms

The University of Chicago Press and Southern Political Science Association are collaborating with
JSTOR to digitize, preserve and extend access to The Journal of Politics

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
Priming Effects in Complex Information
Environments: Reassessing the Impact of News
Discourse on Presidential Approval
Scott L. Althaus University of Illinois at Urbana-Champaign
Young Mie Kim The Ohio State University

This paper revisits the original psychological literature on priming in order to assess new possibilities for research on
priming effects stimulated by news discourse. We detail some important theoretical limitations of existing priming
research; propose a method for studying the dynamics of priming effects in real-world, complex information
environments; and illustrate the usefulness of this approach with a case study of opinion change during the 1990–91
Persian Gulf Crisis. This case study documents for the first time the daily dynamics of priming effects in a complex
information environment and confirms that priming effects are not merely a function of changes in the volume of
news coverage about a given topic. Our findings suggest that news priming effects can be produced by changes in the
applicability of relevant knowledge constructs, rather than merely by their temporary accessibility in long-term
memory, and by cumulative as well as recent exposure to news coverage.

A
lthough the mass media were once widely Although it appears increasingly likely that
thought to have little impact on people’s politi- priming is responsible for a wide range of media
cal opinions (Klapper 1960), research on effects, priming research conducted by political com-
priming effects over the past two decades has demon- munication scholars has enjoyed only limited success
strated that mass media can influence opinions in pro- in drawing connections between observed effects and
found ways (e.g., Iyengar and Kinder 1987; Krosnick underlying causes. While the effects of news priming
and Brannon 1993; Krosnick and Kinder 1990; Miller have been most clearly identified in laboratory experi-
and Krosnick 1996, 2000). Priming research has shown ments (following the path breaking work on agenda-
that although media coverage by itself is unlikely to setting effects by Iyengar and Kinder 1987; Iyengar
change the political attitudes of many people, media et al. 1984; Iyengar, Peters, and Kinder 1982), only a
coverage can influence which attitudes people use to few studies have examined such effects outside the
make political judgments. Because priming can alter laboratory setting (Iyengar and Simon 1994; Krosnick
the criteria citizens use to evaluate political issues, and Brannon 1993; Krosnick and Kinder 1990; Pan
leaders, and events, priming effects can have important and Kosicki 1997). We argue below that the findings of
consequences for the outcomes of elections, the emer- all of these nonexperimental studies share common
gence of public support for policy initiatives, and the features that obscure both the underlying dynamics of
approval ratings of political leaders.1 news priming and the causal factors that shape

1
For example, campaigners in the recent 2004 presidential election seemed less interested in persuading voters so much as priming them
by influencing the criteria on which voters would choose between candidates. National surveys conducted during the campaign showed
that majorities favored Senator Kerry’s positions on health care and the economy, while majorities also favored President Bush’s leadership
style and his handling of the War on Terrorism. The Kerry campaign therefore attempted to focus public attention on the lack of job
growth over the president’s first term while the Bush campaign reminded voters of the 9/11 attacks and the need for strong leadership in
the face of continued threats. Each campaign attempted to produce priming effects by increasing the salience of attitudes that favored their
respective candidates rather than pursue the more difficult task of trying to talk voters out of their established opinions.
The Journal of Politics, Vol. 68, No. 4, November 2006, pp. 960–976
© 2006 Southern Political Science Association ISSN 0022-3816

960

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 U76 12:34:56 UTC
All use subject to https://about.jstor.org/terms
priming effects in complex information environments 961

priming effects in realistically complex information 1997; Power and Murphy 1996). Some outside observ-
environments. ers even suggest that political communication research
This article attempts to expand our knowledge of uses the term “priming” more as a metaphor than a
news priming effects by addressing these limitations of fully specified concept (Roskos-Ewoldesen, Roskos-
previous work. We revisit the original psychological Ewoldesen, and Dillman Carpentier 2002).
literature on priming to assess new possibilities for As a consequence of its limited engagement with
priming effects research conducted by political scien- developments in social psychology, the news priming
tists. We then propose a method for studying the literature has had difficulty providing satisfactory
dynamics of priming effects in real-world, complex answers to long-standing questions about the nature
information environments and illustrate the useful- of priming effects. First, the political science literature
ness of this approach with a case study of opinion has struggled to explain what causes priming effects
change during the 1990–91 Persian Gulf Crisis. This stimulated by news coverage, in part because the stan-
case study documents for the first time the daily dard research designs used in this literature obscure
dynamics of priming effects in a complex information the relative contributions of two causal mechanisms
environment and confirms that priming effects are not known to produce priming effects. Second, the news
merely a function of changes in the volume of news priming literature tends to measure priming effects at
coverage about a given topic. Priming effects on presi- only one or two points in time. As a consequence, it
dential job approval were influenced not only by has been unable to adjudicate the sharp disagreement
recent exposure to news about the Persian Gulf Crisis between experimental and survey-based priming
but also by cumulative exposure to relevant news dis- studies regarding the duration of priming effects.
course and changes in the evaluative tone of that dis- Laboratory experiments conclude that priming effects
course. Moreover, our findings suggest that news tend to be short-lived, largely disappearing within
priming effects can be produced by changes in the minutes or hours of exposure to the priming stimulus,
applicability of relevant knowledge constructs rather while survey-based studies using secondary analysis of
than merely in their temporary accessibility in long- panel data conclude that priming effects are highly
term memory. By expanding the study of news persistent, often lingering months or even years after
priming to include applicability as well as accessibility stimulus exposure. No convincing attempt has yet
effects, we illuminate the dynamic, short-term evolu- been made to reconcile these conflicting but consistent
tion of news priming effects that has gone unobserved findings produced by different strands of the research
in prior research. literature. Third, social psychological research has
documented a variety of stimulus attributes known to
influence priming effects, but previous news priming
What We Still Don’t Know about studies have reduced the complexity of news discourse
News Priming into a simple measure of topical prominence within
the agenda of news coverage (e.g., Pan and Kosicki
Over the past 25 years the priming literature in social 1997; Zaller 1992). Because such “big message” indi-
psychology has undergone a theoretical renaissance, cators do not control for other features of news
but during this same period the basic theoretical ori- content likely to stimulate priming effects, the political
entations and measurement strategies used in the communication literature may be drawing misleading
political science literature on priming have remained inferences about the reasons why news coverage pro-
stable. Empirical research on news priming has tended duces priming effects.
to focus on replicating the findings of two founda-
tional studies (Iyengar and Kinder 1987; Krosnick and How Are Priming Effects Produced?
Kinder 1990), with a recent emphasis on identifying
moderating variables that condition priming effects. Priming is the activation of knowledge stored in long-
As a consequence, the insights generated by recent term memory following exposure to a stimulus.
social psychological work on priming have yet to be Priming can produce a variety of judgmental effects,
fully incorporated into research on news priming but research conducted by political communication
effects conducted by political communication scholars scholars has focused almost exclusively on what are
(Price and Tewksbury 1997). Models of news priming known as accessibility effects. Accessibility can be
effects therefore remain relatively underspecified com- defined as the potential that knowledge stored in
pared to priming research in such topical domains memory will be activated for potential use in a judg-
as aggression and racial stereotyping (e.g., Anderson mental task (Higgins 1996, 134). The temporary ease

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
962 scott l. althaus and young mie kim

with which a construct may be called up into working effects has never been directly observed. What little we
memory can increase the likelihood that the activated know of applicability effects in the news priming lit-
construct will be used as the basis for making subse- erature comes from tests of the “gradient hypothesis”
quent evaluations of various kinds. (Iyengar and Kinder 1987; see also Miller and Kros-
The social psychological literature emphasizes nick 1996), which confirmed that news coverage logi-
that accessibility alone does not produce knowledge cally irrelevant to target attitudes does not tend to
activation and that increasing the accessibility of a prime those attitudes. But if accessible constructs gen-
construct does not ensure that it will be used as a erate priming effects only when those constructs are
criterion in subsequent judgments. Rather, accessibil- relevant to the task, then the standard finding that
ity is one of two primary factors moderating the acti- priming is a function of short-term changes in con-
vation of stored knowledge: the other is the degree struct accessibility must be only part of the story. In
to which a stimulus and a stored knowledge construct contrast, the social psychology literature shows how
are perceived as applicable to one another. Even if a cumulative exposure can generate strong accessibility
knowledge construct has a small chance of being acti- and applicability effects even in the absence of recent
vated due to its diminished accessibility, its chances of primes (Higgins 1996; Lau 1989). Media priming
being activated are increased by its perceived applica- studies in other domains have likewise demonstrated
bility or relevance to a judgmental task (Higgins applicability effects generated by frequent priming
1996). (e.g., Shrum and O’Guinn 1993). Since applicability
Perceptions of relevance are themselves con- effects are constructed over time as a consequence of
structed through priming, for by increasing the acces- accessibility effects, the tendency for news priming
sibility of a construct in the context of a judgment research to focus narrowly on short-term changes
task, priming also increases the odds that the construct in construct accessibility stimulated by recent news
will be used again when a person is faced with a similar exposure not only captures just part of the action, but
judgment task. The priming of a construct initially may have led previous research to misspecify the
produces accessibility effects, but subsequent primes causal mechanisms underlying news priming effects.
can produce applicability effects, since each priming
episode generates associations between the primed How Long Do Priming Effects Last?
construct and other constructs, stimuli, or judgmental
contexts (Higgins 1996; Higgins and King 1981). Our uncertainty regarding the relative influence of
Applicability effects can also be influenced by the accessibility and applicability for explaining priming
framing of the task (e.g., Trope and Ginossar 1988), effects is heightened by the type of research designs
the degree of attention to stimuli (e.g., Kim 2005; typically employed to study news priming. Experi-
Martin and Achee 1992), as well as by the motivations ments tend to study the immediate effects of recent
(Kruglanski 1989; Thompson et al. 1994), predisposi- stimulus primes, often within minutes of stimulus
tions (Fein and Spencer 1997), prior value commit- exposure. Those using response latency measures
ments (Domke, Shah, and Wackman 1998) and social assess the effects of priming within milliseconds after
norms (Mendelberg 2001; Valentino, Hutchings, exposure. Experimental designs tend to find priming
and White 2002) used by individuals to process effects that are short-lived, disappearing soon after
information. exposure to the stimulus prime. At the other extreme
Seen in this way, the social psychological literature are survey-based designs, which test for effects in
envisions priming as something like a two-stage which the stimulus primes occur months or even years
process: the priming stimuli should influence the before the target attitudes are measured. In contrast to
accessibility of some knowledge constructs more than the findings of experimental work, these survey-based
others, but whether people use those primed con- studies usually conclude that priming effects are
structs as evaluative criteria depends on the degree to durable and can be surprisingly long-lived.
which they are perceived as applicable to the judgmen- No attempt has yet been made to reconcile these
tal task. Against this theoretical background, the starkly divergent claims regarding the duration of
tendency for news priming research to focus on acces- priming effects. Doing so requires an analysis of the
sibility effects alone is a notable limitation. evolving dynamics of priming. The social psychology
News priming research has begun to explore some literature posits that priming effects are produced in
implications of associative network theory (Lodge and two ways: recent primes can temporarily increase the
Taber 2000; Miller and Krosnick 1996; Valentino accessibility of a construct, and frequent primes can
1999), but the dynamic construction of applicability gradually increase the applicability of a construct in

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
priming effects in complex information environments 963

ways that make the construct chronically accessible that might moderate priming effects. The way most
long after exposure to the stimulus (e.g., Price and studies of real-world priming operationalize media
Tewksbury 1997). Only the first mechanism has been content is merely by identifying the total amount of
directly tested in news priming studies, and these news coverage given to a topic without regard to
studies have tended to capture the effects of priming content variation within that topical coverage (e.g.,
at only one point in time: nearly all of the published Krosnick and Brannon 1993; Krosnick and Kinder
studies on news priming have employed a standard 1990; Pan and Kosicki 1997). In research on priming
pre/post treatment design that captures the impact of effects stimulated by the 1991 Gulf War, for instance,
a single stimulus “treatment.” Since the target attitudes the rich complexity and dynamic changes in media
for stimulus primes in these studies were all real-world content about the Iraqi invasion of Kuwait and its
attitudes about political issues that had been around aftermath were reduced to a single, one-dimensional
for a long time, the designs used by these studies are catchall category—“coverage about the war”—which
unable to distinguish whether observed effects are was then operationalized as simple counts of stories or
produced by the recency or cumulative frequency of lines of coverage about the war appearing in newspa-
primes. Priming effects produced by exposing subjects pers or on television.
to stimuli about a familiar issue could be a function of This notion of a “big message” effect (Pan and
the recent exposure itself. They could also be a func- Kosicki 1997; Zaller 1992) imposes important restric-
tion of frequent preexperimental exposure to relevant tions on priming research. While the “big message”
stimuli that has generated applicability effects which approach can capture the effect of a dominant, one-
themselves trigger the priming response observed in sided flow of information (i.e., Zaller’s “mainstream
the laboratory. If frequent exposure before the experi- effect”), it is of questionable value in explaining
ment is really driving priming effects that seem to priming effects stimulated by complex information
result from recent exposure in the laboratory, then our environments, where conflicting ideas compete with
inability to control for the frequency of preexperimen- one another in discourse. The rare studies to analyze
tal priming will lead us to overstate the apparent media effects in complex information environments
impact of the experimental manipulation. (Druckman 2004; Druckman and Nelson 2003; Sni-
Differentiating between recency and frequency as derman and Theriault 2004) have concluded that such
the mechanisms underlying observed effects would effects tend to disappear once strict controls on expo-
require the experimental manipulation of a com- sure to one-sided information flows are relaxed. Aside
pletely unfamiliar attitude construct over a long from raising the possibility that news priming effects
period of time, where close controls over cumulative may be a phenomenon of the laboratory rather than of
exposure could clarify the relative contribution of the everyday world, the results of these studies suggest
recent and frequent exposure to priming stimuli. Our that the presumption of “big message” effects needs to
paper is the first to do this, using a quasi-experimental be reconsidered.
analysis of the evolving dynamics of priming effects in Recent developments in the social psychological
presidential approval caused by the sudden onset of an literature suggest that the “big message” approach
unexpected and unfamiliar foreign policy crisis. could lead researchers to miss important effects of
news priming, as well as to misspecify the mechanisms
Is Priming Merely A “Big Message” Effect? by which such effects are produced. For instance, the
“big message” approach is at odds with the possibility
Political communication researchers have long pre- of applicability effects brought about by cumulative
sumed that priming effects are produced by the rela- exposure, since it presumes that priming is influenced
tive salience of a topic in news coverage. Priming only by the temporary dominance of a particular topic
studies conducted by political scientists have assumed in the overall news agenda. Moreover, research on
that news exposure inclines audiences to use the domi- applicability effects tends to conclude that constructs
nant agenda carried in the news as an evaluative in memory with a similar evaluative tone—as good is
criterion. Such claims are justified in the case of to nice, or happy is to joy—are more likely to activate
experimental studies with strict controls to rule out one another than constructs with a dissimilar evalua-
other possible influences, but cannot be presumed in tive tone, as good is to evil or happy is to sad. Research
studies using naturally occurring news exposure. Sur- by social psychologists has confirmed that priming is
prisingly, no studies of priming conducted outside the more likely to occur when the evaluative tone between
laboratory have examined directly the content and stimulus primes and target evaluations are consistent
tone of media messages about a given topic as factors with one another (e.g., Anderson 1983). Such findings

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
964 scott l. althaus and young mie kim

suggest that news priming effects might vary as a func- Persian Gulf on daily changes in the relative weight of
tion of the evaluative tone of news discourse, such as foreign policy attitudes in the president’s overall job
when news about a given subject is lopsidedly critical approval rating.
of the president. Recent theoretical studies have sug-
gested that the evaluative tone of media content
should have a bearing on the ways in which that
content primes subjects (Lodge and Taber 2000; Price Data and Methods
and Tewksbury 1997), but such relationships never
have been tested in news priming research. This omis- News Content Data
sion is especially glaring given the long line of persua-
sion research (e.g., Fan 1988; Zaller 1992) that finds Measures of news coverage during the Gulf Crisis
evaluative tone to be a major influence on other types come from content analysis data collected for every
of media effects. nightly news broadcast on each of the three major
networks that appeared during the period of interest.
A New Approach Compiled from full-text transcripts, the data set
includes every news story relevant to the crisis with
As a consequence of these three limitations in previous Iraq that appeared on ABC’s World News Tonight,
research, we know surprisingly little about the nature CBS’s Evening News, and NBC’s Nightly News
of news priming in realistically complex and dynamic (N = 3,854 stories).
information environments. Because the standard An unusually detailed coding protocol for these
methodological approaches used in this research data was designed to capture not only the substance of
obscure the temporal dynamics of priming effects— the policy debate among government officials, jour-
dynamics that have important theoretical implications nalists, and other sources appearing on the nightly
for clarifying how priming effects work—the literature news, but also the supporting arguments and frames
has been unable to settle the conflicting claims made of reference used by those sources to lend credibility
by experimental and survey-based priming studies to their policy positions. The coding scheme for
and is likely to have overstated the apparent impact of this study follows prior studies (e.g., Gamson and
recent exposure to relevant information. Modigliani 1989; Pan and Kosicki 1993) that identify
To address these limitations, we adopt a quasi- discrete thematic elements in discourse corresponding
experimental approach that allows us to track daily to available policy opinions, the rationales for imple-
changes in priming effects on presidential job menting policies or the goals to be achieved by those
approval stimulated by an unanticipated but highly policies (Mermin 1996, 1999; Nelson 1999), and
visible foreign policy crisis. On August 2, 1990, Iraqi context discourse suggesting core problems or frames
forces launched a surprise invasion of oil-rich Kuwait, in which the policies might be located (Dorman and
an event that precipitated an immediate series of high- Livingston 1994; Kirton 1993; Lang and Lang 1994).
profile responses by President George H. W. Bush that Despite the complexity of this coding scheme (for
led to the Persian Gulf War of 1991. By August 9, just additional details and a complete listing of themes, see
one week after the invasion, the Gallup Organization Althaus 2003), the resulting measures of news content
was in the field with the first of 20 national surveys are highly reliable. Intercoder reliability tests were per-
eventually covering the crisis period that asked formed on a sample of 101 randomly selected ABC
respondents about their exposure to news about the World News Tonight stories for all discourse themes
crisis, their overall approval of the president, and their taken together, which produced intercoder agreement
support for the president’s handling of the crisis. The on the presence of specific themes in 88% of cases
Gallup data allow us to estimate crisis-induced (Cohen’s kappa = .875; Brennan and Prediger’s
priming effects in presidential approval for 74 of the kappa = .877).
206 days of the crisis period.2 Coupled with a detailed The news content data used in the analysis were
content analysis of nightly news coverage given to the aggregated to produce daily measures of news cover-
crisis, these data allow us to track the unique influence age relevant to the Gulf Crisis. The measures used
of recent and cumulative exposure to news about the below include the average daily number of Gulf
Crisis stories appearing on a network newscast, the
2
average daily amount of policy discourse about the
As we define it, the Persian Gulf Crisis extended from the Iraqi
invasion until the start of the U.S.-led ground war that drove Iraqi Gulf Crisis contained in a nightly newscast, and the
forces out of Kuwait. average daily evaluative tone of news discourse about

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
priming effects in complex information environments 965

the Gulf Crisis relative to the Bush administration’s forces out of Kuwait.4 Respondents favoring offen-
stated positions.3 sive military action were assigned a value of one,
while all others were assigned a value of zero.
• Gulf Crisis approval, from the question “Do you
Opinion Data
approve or disapprove of the way George Bush is
Opinion data for this study come from national handling this current situation in the Middle East
surveys administered by the Gallup Organization involving Iraq and Kuwait?”5 Approving respon-
between August 9, 1990 and February 10, 1991. Twenty dents were assigned a value of one, and all others
surveys containing relevant variables were in the field were assigned a value of zero.
between the Iraqi invasion of Kuwait and the start of Exposure to news coverage is an additional control
the ground war in late February, administered over a variable commonly used in priming studies. These
total of 74 days. Since our analysis is concerned with studies typically treat news exposure as a moderating
daily changes in attitude structures corresponding to factor, since news exposure in one form or another
shifts in news content, we divide respondents in these must be a necessary condition for news to influence
multiday surveys by date of interview. It is important attitude structures. Our analysis shares this standard
to point out that the daily survey data analyzed below expectation, but the nature of our case requires us to
are therefore not daily random samples, but rather operationalize news exposure somewhat differently
come from random samples in which interviews were than other studies because public attention to news
conducted over a period of three or four days. Strictly about the Gulf Crisis was unusually widespread
speaking, data for each of these days are not represen- throughout the time period that these surveys were
tative of the American population as a whole. To help being administered. All of the Gallup surveys used in
compensate for this limitation, all analyses reported the analysis include a measure of self-reported news
below include controls for party identification exposure that asks, “How closely have you followed
(dummy variables for Republican and Democratic news about the situation involving the invasion of
identifiers, leaving independents as the reference cat- Kuwait by Iraq and the sending of U.S. troops to Saudi
egory), gender (males = 1, females = 0), race (non- Arabia? Would you say you have followed it very closely,
whites = 1, whites = 0), and age (in years). fairly closely, not too closely, or not at all closely?”
Several questions asked in identical or nearly iden- Averaging across the 74 days of Gallup data, 89% of
tical form in each of these surveys allow us to track the respondents reported paying either “very close” or
changing attitudinal structure of President Bush’s job “fairly close” attention to news coverage of the Gulf
approval ratings. Our measure of job approval comes Crisis (daily max = 98%, daily min = 74%). The level of
from the standard question, “Do you approve or dis- popular engagement with the Gulf Crisis was so high
approve of the way George Bush is handling his job as that the daily numbers of inattentive respondents are
president?” Approving respondents were assigned a too few to analyze with any confidence. Our solution is
value of one, and all others were assigned a value of to analyze only those respondents who reported paying
zero. Three independent variables are used to predict very or fairly close attention to news about the crisis,
job approval: omitting all others from the analyses that follow. This
• Support for troop deployment, from the question “In leaves us with a mean of 248 attentive respondents per
view of the developments since we first sent our day (max = 700, min = 43).6
troops to Saudi Arabia, do you think the United
4
States made a mistake in sending troops to Saudi Before the start of the air war on January 16, the question read “If
the current situation in the Middle East involving Iraq and Kuwait
Arabia or not?” Respondents saying the troop does not change by January (15, 1991), would you favor or oppose
deployment was not a mistake were assigned a value the United States going to war with Iraq in order to drive the Iraqis
of one, while all others were assigned a value of zero. out of Kuwait?” The question asked in the surveys conducted after
• Support for offensive force, from responses to two the start of the air war read “Do you approve or disapprove of the
United States’ decision to go to war with Iraq in order to drive the
similar questions asking respondents whether they Iraqis out of Kuwait?”
approved of the use of military force to drive Iraqi 5
In two of the 20 surveys, this question was phrased slightly dif-
ferently as “Do you approve or disapprove of the way George Bush
is handling this current situation in the Persian Gulf region?”
3 6
These measures all take the form of averages across the three Only 21 days contained fewer than 100 respondents after filtering
nightly newscasts because occasional missing transcripts for one away inattentive citizens. See the tables in the web appendix
or two networks makes it inappropriate to simply sum the total (http://www.journalofpolitics.org) for daily counts of valid cases
number of news elements across the broadcasts. used in the first-stage regressions.

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
966 scott l. althaus and young mie kim

During this period, the most common source of support variable from opposing to favoring the presi-
news was the nightly network newscasts. Nielsen view- dent’s policies. We then use these daily estimates of
ership ratings for this period reveal a combined direct priming effects in an OLS model that regresses the size
audience for the three evening news broadcasts of of the priming effect among respondents interviewed
between a quarter and a third of American house- in day d on the amount of particular types of news
holds, split fairly evenly among the three networks content appearing in evening newscasts on day d.7 If
(Althaus 2002). This direct audience for the network particular types of news content are influencing the
broadcasts was substantially larger than for any other size of a priming effect during the period of interest,
national news source. Moreover, the content of these this OLS model should return statistically significant
broadcasts should accurately reflect the daily agenda coefficients for those news content variables.
and tone of other national news sources during this This approach is obviously cruder than experi-
period (e.g., Danielian and Reese 1989; Entman 2003; mental designs for assessing priming effects, since dif-
Gans 1979; McCombs and Shaw 1972; Sparrow 1999). ferent types of individuals surely respond in different
Thus, we use network news broadcasts as a proxy for ways to the same news content. But our approach is
the daily news coverage about the 1990–91 Gulf Crisis superior in several respects to the standard survey-
that may have influenced Americans paying attention based strategies for assessing priming effects. Multiple
to news about the crisis. measures of key independent variables allow us to
Our analytical strategy for estimating daily shed additional light on the question of whether
priming effects brought about by news coverage pro- priming is mainly an accessibility or applicability
ceeds in two stages. In the first stage, we estimate daily effect, since accessibility should tend to prime related
changes in the size of individual-level priming effects. attitudes in similar ways. If news coverage of the Gulf
Our basic model takes the following form: Crisis produces similar priming effects across our
multiple measures of policy support, this would be
prob (Yi = 1) = α + β1Si + ∑ β k Cik + ∑ βl Dd + strong evidence that accessibility rather than applica-
bility was driving observed effects. We also estimate
∑ δ (S × D
l i d ) + ei priming effects in time periods that coincide with
daily news cycles, which is the naturally occurring
where Yi is respondent i’s presidential approval rating, duration of headline news in the United States. No
Si is respondent i’s support for the president’s Gulf previous survey-based study has studied priming
Crisis policies, Cik is respondent i’s score on the kth effects at such a fine level of detail regarding the time
control variable, Dd is a dummy variable taking a value sequencing of stimulus and attitudinal measures.
of 1 on date d (0 otherwise), Si ¥ Dd is the product of
respondent i’s support for the president’s Gulf Crisis
policies multiplied by the dummy variable for the Findings
respondent’s date of interview d, and ei is the error
term for the ith observation. In this equation, b1 is the Figure 1 displays opinion trends from Gallup polls
coefficient for the support variable, bk is the coefficient that document a gradual decline in public support for
for the kth control variable, bl is the coefficient for the the president following a rally that came immediately
lth date, and dl is the coefficient for the lth interaction after the Iraqi invasion of Kuwait. Four months of
term. This model was used on a pooled data set con- declining support for the president were then followed
sisting of all attentive Gallup respondents in the 20 by almost immediate surges in support after the start
national surveys conducted during the period of inter- of the bombing campaign. While some accounts using
est. The design of this model estimates a main effect monthly summaries of aggregate opinion (e.g.,
for each of the control variables over the entire time
period, but allows the effects of the model’s Gulf Crisis
support variable to vary by date of interview. Since the 7
We experimented with a number of alternative lag specifications
job approval variable used in this analysis is dichoto- before concluding that news data from the date of interview
provided the best fit. Most interviews appeared to have been
mous, logistic regression was used to estimate this conducted after the day’s nightly network newscasts, further sup-
model. porting our decision to model priming effects as a function of
In the second stage of the analysis, we calculate the news content that was broadcast on the date of interview. In addi-
daily priming effect of support for Gulf Crisis policies tion, the high degree of similarity between nightly news content
and the agenda of other national news sources appearing on the
on presidential approval as the change in the probabil- same day provides a strong theoretical rationale for structuring the
ity Yi = 1 that comes from shifting the value of the model in this way.

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
priming effects in complex information environments 967

FIGURE 1 Support for the President and the Use of Force during the Persian Gulf Crisis

100
Job Approval
Support for Troop Deployment
90 Support for Offensive Force
Gulf Crisis Approval
80

70

60
% Support

50

40

30

20
Start Start of
10 Iraqi Invasion of Air Ground
of Kuwait War War
0

8-Nov

22-Nov

20-Dec
5-Jul

19-Jul

16-Aug

11-Oct

25-Oct

6-Dec

3-Jan

17-Jan

31-Jan

14-Feb

28-Feb
2-Aug

30-Aug

13-Sep

27-Sep

14-Mar

28-Mar
FIGURE 2 Daily Priming Effects on Job Approval During the Persian Gulf Crisis

1.00
Iraqi Invasion Effect of Gulf Crisis Approval Start of Start of
of Kuwait Effect of Support for Troop Deployment Air War Ground War
Effect of Support for Offensive Force
.80
Size of Priming Effect

.60

.40

.20

.00
8-Nov

22-Nov

14-Mar

28-Mar
19-Jul

3-Jan

14-Feb

28-Feb
5-Jul

2-Aug

16-Aug

30-Aug

13-Sep

27-Sep

11-Oct

25-Oct

6-Dec

20-Dec

17-Jan

31-Jan

Note: Points within each trend indicate the size of daily priming effects, defined as the change in the probability of approving the
president’s job when the support variable is changed from oppose to support, holding all other variables constant. Trend lines represent
a moving average of the current day’s effect, the effect from the previous point in the trend line, and the effect from the next point in the
trend line.

Krosnick and Brannon 1993) incorrectly attribute raised and reset by the start of the air war, the attitude
President Bush’s widely noted jump in popularity to structures underlying the president’s approval ratings
the successful prosecution of the ground war in late are quite volatile during this time period. Figure 2
February, we see in this figure that the largest jump in shows daily changes in the size of priming effects
Bush’s approval rating is an immediate and direct con- influencing the president’s job approval rating. (Coef-
sequence of the start of the air war in mid-January. A ficients from the complete regression models are pro-
population that had been deeply divided about the vided in a separate appendix available from this
wisdom of going to war became, immediately follow- journal’s web site.) The size of each priming effect was
ing its onset, a public galvanized for action. calculated as the absolute change in the predicted
Although the opinion trends in Figure 1 follow probability of approving the president’s handling of
relatively stable declines until they are simultaneously his job when the value of the priming variable is

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
968 scott l. althaus and young mie kim

changed from opposition to support while holding the Figure 2 sheds light on two lingering questions
value of all other variables constant. The larger the in the priming literature. First, on the question of
change in the predicted probability of approving whether priming effects are of short or long duration,
the president’s handling of his job, the greater the Figure 2 shows that the magnitude of daily priming
weight that the priming variable has in the attitude effects is highly variable within each of the three
structure for job approval.8 For instance, black tri- trends. This pattern is consistent with the typical find-
angles in Figure 2 represent changes in the probability ings from experimental studies, which suggest that
that a person would approve of how the president is recent exposure to relevant stimuli tends to produce
handling his job when Gulf Crisis approval changes immediate priming effects of relatively short duration.
from disapprove to approve. On August 9, the first day At first glance, this pattern is more difficult to square
of the series, switching from disapproving to approv- with the findings of previous survey-based priming
ing President Bush’s handling of the Gulf Crisis studies that report lingering effects lasting several
increases the probability of approving his overall job months after exposure to the news coverage of inter-
as president by .45. Recalling that probabilities range est. If news priming effects were so durable, we might
from 0 to 1, this is a substantial impact. expect to see far less day-to-day variation in effect
To clarify the trends in these daily priming effects, sizes. Some of this day-to-day variance is surely
Figure 2 includes trend lines showing the size of one random, a consequence in part of the sometimes
day’s priming effect averaged with the size of the effect smallish numbers of respondents surveyed on a par-
immediately preceding and following it. The largest ticular day. But even though the size of priming effects
priming effects tended to come from approval of how can change dramatically from day to day, these effects
the president was handling the Gulf Crisis, followed in are not merely random: there are clear central tenden-
relative magnitude by support for the deployment of cies in the effect trends that evolve in meaningful ways
American military forces to Saudi Arabia, and support over time. The general pattern is for priming effects
for using those military forces to drive Iraqi forces out to increase in size over time for all three variables,
of Kuwait.9 An exception to this general pattern came although each trend also seems to be influenced by
around the start of the air war, when support for idiosyncratic factors.
offensive force briefly became a more important com- These trends shed light on the question of whether
ponent of President Bush’s job approval than support priming effects derive more from increased accessibil-
for troop deployment. ity or increased applicability. If accessibility alone were
driving changes in the size of these priming effects, we
8
Because of the complexity of the regression model used to esti- would expect news coverage about the Gulf Crisis to
mate daily priming effects, and because the key independent vari- influence these three closely related support variables
ables are not always available in the same surveys, separate
regression models are run for each of the three independent vari-
in similar ways: the size of the priming effects should
ables. This means that the effects shown in Figure 2 do not control be fairly similar for each of the three trends. Further-
for the simultaneous impact of all three variables. To test whether more, any movement in the size of priming effects
including all three variables simultaneously might change the pat- should occur in parallel if such movement were being
terns shown in Figure 2, the authors conducted separate regression
analyses for each survey in which more than one of these variables produced merely by differences in the accessibility of
were available. A total of 18 surveys contained the Gulf Crisis these constructs, presuming for the moment—as pre-
approval variable along with the support for troop deployment vious work has done—that accessibility is a function
variable, and six surveys contained both of those plus the support
for offensive force variable. The priming effect trends produced by of the overall amount of recent news coverage about
this analysis followed the same patterns as Figure 2, except that the the Gulf Crisis. Yet the size of effects differs across the
size of priming effects was relatively smaller for the troop deploy- three variables—generally largest with Gulf Crisis
ment and offensive force variables. This is to be expected, because
these variables simultaneously influence job approval and Gulf
approval and smallest with support for offensive
Crisis approval, and entering all three into a single model estimates force—despite the fact that the accessibility of all of
only their direct effects on the dependent variable. Since these them should be stimulated in similar ways by Gulf
variables also have significant indirect effects on job approval Crisis news coverage. Moreover, the three trends do
through Gulf Crisis approval, the trends shown in Figure 2 should
be understood as presenting the total effects of each variable on not always move in tandem: the correlation in the size
job approval. of priming effects between Gulf Crisis approval and
9
Gulf crisis approval influenced the probability of approving the support for offensive force is a healthy .60 (p ⬍ .01,
president’s job performance by an average of .60 (s.d. = .10, n = 27), while that between support for offensive force
min = .38, max = .86), while support for troop deployment had an and support for troop deployment is a more modest
average daily effect of .45 (s.d. = .12, min = .23, max = .77) and
support for offensive force had an average daily effect of .39 .43 (p ⬍ .05, n = 23), and that between Gulf crisis
(s.d. = .17, min = .12, max = .74). approval and support for troop deployment is just .25

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
priming effects in complex information environments 969

FIGURE 3 “Big Message” Indicators

60 20
Iraqi Invasion Amount of Policy Discourse Start of Start of
of Kuwait Number of Stories Air War Ground 18
War
50
16

Amount of Policy Discourse


14
40

Number of Stories
12

30 10

8
20
6

4
10
2

0 0

8-Nov

22-Nov
19-Jul

20-Dec
5-Jul

16-Aug

13-Sep

27-Sep
2-Aug

30-Aug

6-Dec

3-Jan

17-Jan

31-Jan

14-Feb

28-Feb

14-Mar

28-Mar
11-Oct

25-Oct

Note: Points within each trend indicate the average daily number of stories or discourse elements per broadcast. Trend lines represent a
five-day moving average across these points.

(p ⬍ .05, n = 66). In addition, the movement of effects that have little or no policy-relevant content (e.g.,
across the three trends varies considerably from day to descriptive stories about troop readiness or life in the
day, which suggests that some of these variables are Saudi desert). The other trend (squares with a gray
being primed differently than others. All of this points line) shows the average number of discourse ele-
to the conclusion, consistent with recent experimental ments about the Bush administration’s Gulf Crisis
work on priming effects (e.g., Miller and Krosnick policies appearing each day in nightly news pro-
2000; although see Valentino, Hutchings, and White grams. This more refined “big message” indicator is
2002), that accessibility alone is unlikely to be the positively correlated with the first trend (r = .66), but
main engine driving these effects. they clearly run different courses. The average
The tendency for priming effects in all three number of Gulf Crisis stories per broadcast peaks in
trends to increase in size over time likely represents a the month following the Iraqi invasion of Kuwait,
cumulative effect of exposure to Gulf Crisis news. The then declines rapidly into a low-coverage period
longer the crisis continued, the greater the cumulative from October through December. In January the
exposure to news about the crisis, and the larger the number of daily stories increases rapidly with the
priming effects tended to become regardless of nearing of the January 15th United Nations deadline
whether news of the day was giving much current for Iraqi withdrawal, then again reaches August 1990
attention to the crisis. An alternative explanation is levels in a second peak after the start of the air war.
that the central tendencies of the Figure 3 trends In contrast, the average number of policy discourse
reflect little more than recency effects, produced by the elements in a broadcast took a relatively smaller
ebb and flow of daily news coverage of the Gulf Crisis. decline before rebounding to August levels in late
If so, we should find that news coverage about the November and early December. Toward the end of
Gulf Crisis rose steadily in volume over the period of December policy discourse increases steadily to peak
interest. right before the start of the air war, after which it
However, Figure 3 shows a different pattern in declines rapidly before rebounding again in the
two “big message” indicators capturing the daily weeks leading up to the start of the ground war.
amounts of relevant news coverage over the crisis The evaluative tone of this policy discourse also
period. The first trend (diamonds with a black line evolves over time. Figure 4 shows the number of dis-
tracing a five-day moving average) shows the mean course elements in an average nightly newscast that
number of Gulf Crisis stories broadcast on nightly were favorable (diamonds and a black line showing
news programs for each day. This is a fairly broad a five-day moving average) and unfavorable (squares
measure of news attention, since it includes stories and a gray line) toward the Bush administration’s

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
970 scott l. althaus and young mie kim

FIGURE 4 Tone of Policy Discourse Indicators

25
Iraqi Invasion Favorable Discourse Start of Start of
of Kuwait Air War Ground
Unfavorable Discourse
War
20

Amount of Policy Discourse


15

10

8-Nov

22-Nov
5-Jul

19-Jul

16-Aug

30-Aug

13-Sep

27-Sep

6-Dec

20-Dec

31-Jan

14-Feb

28-Feb
2-Aug

3-Jan

17-Jan
11-Oct

25-Oct

14-Mar

28-Mar
Note: Points within each trend indicate the average daily number of discourse elements per broadcast. Trend lines represent a five-day
moving average across these points.

policies.10 A moderate positive correlation between day-to-day variance in the effect trends is quite pro-
these trends (p = .59) comes from the tendency for nounced, suggesting that daily changes in news cover-
both types of discourse to increase as the overall age might be driving much of the observed variance.
amount of news coverage goes up, but the balance of Moreover, the effect trends run different courses
favorable to unfavorable discourse changes consider- which suggest that news coverage was stimulating
ably over time. The flow of favorable discourse follows them in different ways, or stimulating some trends
generally the “big message” trends from Figure 3, with more than others.
the highest levels of favorable coverage immediately To clarify which elements of news content might
after the Iraqi invasion, during the period from late be influencing the priming effects in Figure 2, we
November to early December, and around the start of regressed each of the daily impact trends from
the air war. Unfavorable discourse is muted through Figure 2 on the four measures of news content in Fig-
most of the crisis until the second week of January, ures 3 and 4 along with additional measures capturing
when a divided Congress and growing public opposi- the cumulative count of stories and discourse
tion to the impending war produce news coverage that elements that appeared between August 2 and the date
is relatively balanced between positive and negative of interview. Comparing the size and significance of
perspectives. After the start of the air war, unfavorable bivariate regression coefficients for different types
discourse tapers off at a faster rate than favorable of news content reveals clear patterns of priming
discourse, before leveling out over the month of effects in this complex information environment.
February. Several patterns stand out in Table 1.
Comparing changes in the size of priming effects First, nearly all of the news content variables are
over time (Figure 2) to the news discourse trends (Fig- positively related at conventional significance levels to
ures 3 and 4) reveals a more nuanced relationship the size of priming effects for Gulf Crisis approval and
between stimulus material and priming effects than support for offensive force, but only one of them had
has been suggested by previous research. News atten- even a marginally significant relationship with the size
tion to the Gulf Crisis varied over the period in which of priming effects attributed to support for troop
priming effects tended to grow in size, suggesting that deployment. If the priming effects in Figure 2 were
recent exposure to the news was unlikely to be respon- being driven merely by the accessibility of relevant
sible for the steadily increasing effect sizes. Yet the attitudes, then we would expect to find significant and
positive coefficients in the support for troop deploy-
10
Neutral discourse elements are omitted from this figure but ment series as well. The dearth of such relationships
included in the measure of total discourse shown in Figure 3. suggests that accessibility alone is unlikely to be the

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
priming effects in complex information environments 971

TABLE 1 The Bivariate Impact of the Information Environment on the Attitude Structure of Presidential
Job Approval

Effect of Support for Effect of Support for Effect of Gulf


Troop Deployment Offensive Force Crisis Approval

b beta b beta b beta


Recent News Coverage
Number of Stories on Day of Interview .39 .11 3.31** .70 .77* .25
Amount of Discourse on Day of Interview .20 .13 .89* .48 .43** .32
Cumulative News Coverage
Cumulative Stories (100s) .81 .20 7.52** .68 1.45** .45
Cumulative Discourse (100s) .49† .21 3.51** .69 .94** .49
Tone of Discourse Variables
Favorable Discourse on Day of Interview .13 .05 1.04† .33 .46† .21
Unfavorable Discourse on Day of Interview .61 .19 1.78** .53 1.03** .37
N of Days = 66 27 74
†p ⬍ .10, *p ⬍ .05, **p ⬍ .01.
Note: Cells contain bivariate OLS regression coefficients. Cumulative news measures are scored in hundreds of stories or discourse
elements.

main mechanism driving the observed priming effects from opposition to support in the independent vari-
in Figure 2.11 able. Each news story on the Gulf Crisis in an average
Second, the recency of stimulus exposure seems to newscast increased by three points the daily probabil-
matter more for some trends than for others. The top ity that support for offensive force predicts approval of
two rows of Table 1 show that daily changes in news how President Bush was handling his job, but only
attention and news discourse about the Persian Gulf increased the predictive power of Gulf Crisis approval
Crisis increased the size of priming effects from by three-quarters of a point. A similar pattern holds
support for offensive force more than from Gulf Crisis for daily changes in the amount of policy-relevant
approval. To properly interpret the coefficients in discourse about the Gulf Crisis. In contrast, recent
Table 1, recall that we define a priming effect as the news exposure has no significant effects on the weight
change in the weight assigned to an independent vari- of support for troop deployment in the attitude struc-
able among the factors predicting a dependent vari- ture of presidential job approval.
able, where impact is measured as the absolute Third, the cumulative frequency of stimulus expo-
difference in predicted probabilities when moving sure was generally a more important factor than recent
exposure in determining the size of priming effects.
11
Another possibility is that the priming effects in this trend are Five of the six beta weights for the measures of cumu-
being influenced by an artifact of data collection. Since survey lative news exposure are larger than those for recent
respondents contacted on the first day of interviewing might be news exposure, and one of them reaches marginal
somehow different from respondents contacted in later days (if, for
instance, later interviews came from respondents who were harder
levels of significance in raising the weight of support
to contact), we tested whether the size of priming effects varied for troop deployment in the attitude structure of
systematically by the day of interview in each of the 20 surveys. We presidential approval.12 For every hundred news
found no evidence of systematic bias in priming effects for the stories focusing on the Gulf Crisis, the predicted
offensive force trend (F [3, 23] = .45, p = .72) or the Gulf Crisis
approval trend (F [3, 70] = .36, p = .78). However, there was a priming effect of support for offensive force on presi-
significant difference in the troop deployment trend (F [3, dential approval rose by 7.5 points, while that of Gulf
62] = 3.22, p = .03) caused by a higher average effect size for the Crisis approval rose by 1.5 points, and the effect of
fourth day of interviewing (M = .53, compared to means of
between .42 and .44 for the first three days of interviewing). It is support for troop deployment rose by a statistically
unlikely that this date of interview artifact is alone responsible for negligible .8 points. Since the average nightly news
a lack of significant news coverage effects, since Figure 2 shows program had broadcast 993 Gulf Crisis stories prior to
that the dynamics of priming effects in this trend took a different
path relative to the other two independent variables, quite apart
from any systematic error associated with the final day of inter-
12
viewing. Yet this artifact undoubtedly contributes to the lack of In addition, the coefficient for cumulative stories approached
significant relationships between news coverage and the size of marginal levels of significance (p = .105) in predicting the size of
priming effects for the troop deployment measure. priming effects from support for troop deployment.

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
972 scott l. althaus and young mie kim

the start of the air war, as the crisis unfolded the pre- The multivariate results in Table 2 generally
dicted impact of cumulative news exposure soon support the findings from the bivariate analysis in
became much larger than that of recent news expo- Table 1. Compared to recent exposure, cumulative
sure. For instance, at the start of the air war the pre- news exposure remains a stronger predictor of the size
dicted impact of cumulative news stories was to of priming effects in five of the six equations, generally
increase the priming effect of Gulf Crisis approval by having nearly twice the impact of recent news expo-
nearly 15 points. By comparison, the average number sure. But these relationships are robust across models
of Gulf Crisis stories per newscast was 6.7 per day over only when predicting the size of priming effects from
the entire crisis period, which predicts a 5.2 point Gulf Crisis approval: in these models, recent and
increase in the size of that same priming effect as a cumulative exposure were both significant predictors
result of recent news exposure. of priming effects regardless of whether they were
Fourth, the evaluative tone of Gulf Crisis news operationalized as discourse elements or discrete
coverage was an important factor in producing numbers of relevant news stories. By contrast, in the
priming effects. Unfavorable policy discourse signifi- equations predicting the size of priming effects from
cantly primed support for offensive force and Gulf support for offensive force, cumulative exposure
crisis approval,13 while favorable policy discourse was drives priming effects when news exposure is mea-
only marginally significant in priming Gulf crisis sured as the amount of policy-related discourse in the
approval. Support for offensive force and Gulf Crisis news, but recent exposure drives those effects when
approval had substantially greater weight in predicting news exposure is measured as numbers of stories
job approval on days in which the news contained about the Gulf Crisis.14 This difference is likely an
higher levels of unfavorable policy discourse. More- artifact of when the offensive force series began: the
over, in every case the impact of unfavorable discourse other two support variables were measured over a
was nearly twice as large as that for favorable dis- longer period with more variance in daily news cover-
course. This is another piece of evidence inconsistent age, but the offensive force variable was measured only
with the idea that accessibility alone is the main engine late in the crisis when both cumulative and daily
driving priming effects. amounts of news coverage were rising in tandem. This
The bivariate coefficients in Table 1 challenge a unfortunate coincidence makes it difficult to sort out
good deal of conventional wisdom about priming whether priming effects for offensive force support
effects. Yet these coefficients are also ambiguous were produced more by cumulative or recent news
because they represent the total effects of each support exposure, but the R-squared values for both equations
variable on job approval, rather than their unique show that news exposure of whatever origin explained
effects when simultaneously controlling for the influ- around half of the variance in the size of priming
ence of the other support variables. Because the effects for this variable. As was the case with Table 1,
Gallup surveys rarely included all three support mea- none of the news variables turns out to be a significant
sures in their surveys at once, our ability to parcel out predictor of priming effects from the support for
the unique effects of each variable is quite limited (see troop deployment variable.
note 8). A second source of ambiguity is that multiple The main difference between the bivariate and
dimensions of news coverage are likely to be shaping multivariate results is that tone of policy discourse
priming effects at the same time, but up to this point fails to become a significant predictor of priming
we have considered each in isolation from the others. effects in any of the six multiple regression equations.
We therefore ran multiple regression models that Nonetheless, the negative signs on these coefficients
simultaneously estimated the effects of recent and are in the expected direction: the more negative the
cumulative news exposure, as well as the tone of Gulf news on a particular day, the larger the priming effect
Crisis discourse. To minimize collinearity as well as the from the support variables even after controlling for
number of coefficients needing to be estimated from the effects of recent and cumulative news exposure.
small numbers of cases, this multivariate analysis uses Although our analysis produces mixed results on the
a differenced measure of discourse tone (favorable dis- impact of news tone on priming effects, we believe
course minus unfavorable discourse appearing in each that these findings are sufficiently promising to merit
day’s average newscast).

13 14
In addition, the coefficient for unfavorable policy discourse in In the support for the offensive force model, the coefficient for
predicting the size of priming effects for support for troop deploy- cumulative stories nearly reaches conventional levels of signifi-
ment was significant at the p = .12 level. cance (p = .108).

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
priming effects in complex information environments 973

TABLE 2 The Multivariate Impact of the Information Environment on the Attitude Structure of
Presidential Job Approval

Effect of Support for Effect of Support Effect of Gulf


Troop Deployment for Offensive Force Crisis Approval

b beta b beta b beta


Amount of Discourse
Amount of Discourse on Day of Interview .16 .10 .35 .19 .32* .23
Cumulative Discourse (100s) .37 .16 2.97** .58 .79** .41
Discourse Tone (Differenced) on Day of -.41 -.14 -.58 -.17 -.34 -.13
Interview
Constant 40.74** -4.42 50.40**
Adj. R2 = .02 .46 .26
N of Days = 66 27 74
Number of News Stories
Number of Stories on Day of Interview .45 .13 2.12* .45 .88** .29
Cumulative Stories (100s) .70 .17 3.81 .34 1.41** .44
Discourse Tone (Differenced) on Day of -.41 -.14 -.57 -.17 -.35 -.13
Interview
Constant 38.24** -8.93 45.91**
Adj. R2 = .02 .52 .25
N of Days = 66 27 74
†p ⬍ .10, *p ⬍ .05, **p ⬍ .01.
Note: Cells contain OLS multiple regression coefficients. Cumulative news measures are scored in hundreds of stories or discourse
elements.

further research on the relationship between tone of short-term and long-term components. Experiments
news discourse and the size of priming effects. are likely to have captured a mix of short-term effects
stimulated by recent exposure in the laboratory plus
whatever cumulative exposure subjects brought with
Conclusion them to the lab. In contrast, survey-based priming
studies are likely to have captured long-term effects
Taken together, the findings in Tables 1 and 2 suggest from the cumulative frequency of exposure purged of
a pattern of nuanced influences on priming effects recency effects. Our study, the first to document the
rather than a mechanistic and determinative relation- separate effects of recent and cumulative news expo-
ship between construct accessibility and construct sure, suggests that apparently contradictory conclu-
weight in relevant attitude structures. We confirm that sions from experimental and survey-based research on
“big message” accessibility effects can influence the duration of priming are both correct. The appar-
priming in complex information environments, but in ent contradiction arises because they are capturing
more subtle ways than previous studies have identi- different components of priming effects.
fied. Recent exposure to relevant news content can Our findings also suggest that priming in complex
generate priming effects, but cumulative exposure to information environments seems to be a function of
relevant news tended to be a more important factor applicability effects as well as construct accessibility.
influencing the size of priming effects in the case con- Contrary to the claim that priming is driven by acces-
sidered here. The greater the cumulative exposure to sibility alone, no measured aspect of the information
relevant stimuli, the greater the likelihood that “mere environment was significantly and consistently related
mention” of relevant stimuli triggered priming of to changes in the size of priming effects across the
applicable attitudes, regardless of the amount of board. To the contrary, the pattern of findings makes
recent coverage in the news. more sense when we consider how construct accessi-
These findings help to clarify why experiments bility appears to be moderated by applicability effects.
and surveys have tended to draw such different con- The impact of factors other than construct accessibil-
clusions about the duration of priming effects: natu- ity took five different forms in our findings: in the
rally occurring priming effects seem to have both different dynamic courses taken by priming effects

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
974 scott l. althaus and young mie kim

from the three support variables; in the tendency for cannot provide strong evidence of applicability effects
Gulf Crisis approval effects to be consistently larger because the Gallup data used in this analysis contain
than effects of support for troop deployment, which no direct means of measuring construct applicability.
in turn were consistently larger than the effects of The presumed applicability effects that we observe
support for offensive force; in the tendency for news could be influenced by the nature of the news stimu-
discourse to have larger effects on the size of priming lus, by the ways that individual motivations and pre-
effects from Gulf Crisis approval than on those from dispositions affect judgmental processes, or by a
support for offensive force; in the tendency for unfa- combination of both. Future research on news
vorable discourse to produce larger priming effects priming will need to grapple with the challenge of
than favorable discourse; and in the finding that news sorting out which of various kinds of applicability
discourse had no consistently significant effects on the effects might be moderating priming processes.
weight of support for troop deployment in the attitude Finally, our approach to modeling the daily
structure of presidential job approval. Data limitations dynamics of priming effects using survey data invites
in the Gallup surveys preclude us from testing specific any number of possible confounds or spurious rela-
psychological mechanisms that might be contributing tionships to obscure the precise mechanisms that
to these observed patterns, but the important point is produce observed effects. In particular, replacing the
that these patterns cannot be explained by accessibility notion of a “big message” effect with one that allows
effects alone. for the dynamic flow of multiple dimensions to news
These findings, coming as they do from a case discourse makes it difficult to pin down precisely
study of a unique event, are unlikely to be universal or which elements of news content might be responsible
definitive. Moreover, each of the observed relation- for observed changes in the structure of attitudes. We
ships between news primes and observed effects, while modeled three such dynamics—recency, cumulative
plausible, would be difficult to predict in advance frequency, and evaluative tone—and found effects for
given the current state of the literature. Thus, the value each, but our study might have produced different
of this analysis lies less in the light that it sheds on the results had we chosen to model different dimensions
changing structure of job approval attitudes than in of news coverage.
the challenge it presents for the conventional wisdom We believe that the methodological approach
regarding the causes and cognitive mechanisms developed in this paper, suitably refined, holds
underlying priming effects stimulated by news cover- promise for future work in priming effects. We are
age. This conventional wisdom has developed largely hopeful that replications of this method in other cases
without reference to a broad range of empirical and other contexts will clarify the ways that accessibil-
research conducted by social psychologists, research ity and applicability moderate the impact of priming
that is entirely consistent with the findings reported effects produced by exposure to news content, as well
here. as the features of news content most likely to moderate
Our approach naturally has its share of limita- these effects.
tions relative to the standard methods of assessing
priming effects outside the laboratory. While theo-
retical considerations guided the particular choices
we made in operationalizing assumptions about Acknowledgments
priming effects from the social psychological litera-
ture, the limited availability of survey data allowed us The authors thank Michael Cobb for coding the
to test only rudimentary attitude structures. We are evening news data and the Research Board at the Uni-
also fully aware that our choice to analyze priming versity of Illinois at Urbana-Champaign for funding
effects within the fairly unique context of the Gulf the collection of these data. We are indebted to Kath-
Crisis reduces our confidence in generalizing to other leen Frankovic, Nehemiah Geva, Philip Habel, Jennifer
cases from the patterns revealed in our analysis. Jerit, James Kuklinski, Kathleen McGraw, Thomas
However, since so much of the research on news- Nelson, Paul Quirk, Thomas Rudolph, Mira Sotirovic,
induced priming effects has been conducted on the David Tewksbury, and members of the UIUC Citizen
Gulf Crisis, our choice of cases seems appropriate for Competence Group for their assistance and helpful
a study aiming to reassess the standard approaches to comments on various aspects of this project.
studying priming effects.
While we observe patterns that are consistent with Manuscript submitted 7 January 2005
expectations about applicability effects, our study Manuscript accepted for publication 17 February 2006

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
priming effects in complex information environments 975

References Iyengar, Shanto, Mark D. Peters, and Donald R. Kinder. 1982.


“Experimental Demonstrations of the ‘Not-So-Minimal’ Con-
sequences of Television News Programs.” American Political
Althaus, Scott L. 2002. “American News Consumption during Science Review 76 (4): 848–58.
Times of National Crisis.” PS: Political Science & Politics 35 (3): Iyengar, Shanto, and Adam Simon. 1994. “News Coverage of the
517–21. Gulf Crisis and Public Opinion: A Study of Agenda-Setting,
Althaus, Scott L. 2003. “When News Norms Collide, Follow the Priming, and Framing.” In Taken by Storm: The Media, Public
Lead: New Evidence for Press Independence.” Political Commu- Opinion, and U.S. Foreign Policy in the Gulf War, eds. W. L.
nication 20 (4): 381–414. Bennett and D. L. Paletz. Chicago: University of Chicago Press.
Anderson, Craig A. 1997. “Effects of Violent Movies and Trait Kim, Young Mie. 2005. “Use and Disuse of Contextual Primes in
Hostility on Hostile Feelings and Aggressive Thoughts.” Aggres- Dynamic News Environments.” Journal of Communication 55
sive Behavior 23: 161–78. (4): 737–55.
Kirton, John. 1993. “National Mythology and Media Coverage:
Anderson, John R. 1983. The Architecture of Cognition. Cambridge, Mobilizing Consent for Canada’s War in the Gulf.” Political
MA: Harvard University Press. Communication 10: 425–41.
Danielian, Lucig H., and Stephen D. Reese. 1989. “A Closer Look at Klapper, Joseph. 1960. The Effects of Mass Communication.
Intermedia Influences on Agenda Setting: The Cocaine Issue of Glencoe, IL: Free Press.
1986.” In Communication Campaigns about Drugs: Government
Krosnick, Jon A., and Laura A. Brannon. 1993. “The Impact of the
Media and the Public, ed. P. J. Shoemaker. Hillsdale, NJ:
Gulf War on the Ingredients of Presidential Evaluations: Mul-
Lawrence Erlbaum.
tidimensional Effects of Political Involvement.” American
Domke, David, Dhavan V. Shah, and Daniel B. Wackman. 1998. Political Science Review 87 (4): 963–75.
“Media Priming Effects: Accessibility, Association, and Activa- Krosnick, Jon A., and Donald R. Kinder. 1990. “Altering the Foun-
tion.” International Journal of Public Opinion Research 10 (1): dations of Support for the President Through Priming.” Ameri-
51–74. can Political Science Review 84: 497–512.
Dorman, William A., and Steven Livingston. 1994. “News and Kruglanski, Arie W. 1989. Lay Epistemics and Human Knowledge:
Historical Content: The Establishing Phase of the Persian Gulf Cognitive and Motivational Bases. New York: Plenum.
Policy Debate.” In Taken by Storm: The Media, Public Opinion,
Lang, Gladys Engel, and Kurt Lang. 1994. “The Press as Prologue:
and U.S. Foreign Policy in the Gulf War, eds. W. L. Bennett and
Media Coverage of Saddam’s Iraq, 1979–1990.” In Taken by
D. L. Paletz. Chicago: University of Chicago Press.
Storm: The Media, Public Opinion, and U.S. Foreign Policy in the
Druckman, James N. 2004. “Political Preference Formation: Com- Gulf War, eds. L. Bennett and D. Paletz. Chicago: University of
petition, Deliberation, and the (Ir)Relevance of Framing Chicago Press.
Effects.” American Political Science Review 98 (4): 671–87. Lau, Richard R. 1989. “Construct Accessibility and Electoral
Druckman, James N., and Kjersten R. Nelson. 2003. “Framing and Choice.” Political Behavior 11 (1): 5–32.
Deliberation: How Citizens’ Conversations Limit Elite Influ- Lodge, Milton, and Charles Taber. 2000. “Three Steps toward a
ence.” American Journal of Political Science 47 (4): 729–45. Theory of Motivated Political Reasoning.” In Elements of
Entman, Robert M. 2003. Projections of Power: Framing News, Reason: Cognitions, Choice, and the Bounds of Rationality, eds.
Public Opinion and U.S. Foreign Policy. Chicago: University of A. Lupia, M. McCubbins, and S. Popkin. New York: Cambridge
Chicago Press. University Press.
Fan, David P. 1988. Predictions of Public Opinion from the Mass Martin, Leonard, and John Achee. 1992.“Beyond Accessibility: The
Media. Westport, CT: Greenwood Press. Role of Processing Objectives in Judgment.” In The Construc-
tion of Social Judgments, eds. L. Martin and A. Tesser. Hillsdale,
Fein, S., and S. J. Spencer. 1997. “Prejudice as Self-Image Mainte-
NJ: Erlbaum.
nance: Affirming the Self Through Derogating Others.” Journal
of Personality and Social Psychology 73: 31–44. McCombs, Maxwell, and Donald Shaw. 1972.“The Agenda-Setting
Function of Mass Media.” Public Opinion Quarterly 36: 176–87.
Gamson, William A., and Andre Modigliani. 1989. “Media Dis-
course and Public Opinion on Nuclear Power: A Construction- Mendelberg, Tali. 2001. The Race Card: Campaign Strategy, Implicit
ist Approach.” American Journal of Sociology 95 (1): 1–37. Messages, and the Norm of Equality. Princeton: Princeton Uni-
versity Press.
Gans, Herbert. 1979. Deciding What’s News: A Study of CBS
Mermin, Jonathan. 1996. “Conflict in the Sphere of Consensus?
Evening News, NBC Nightly News, Newsweek, and Time. New
Critical Reporting on the Panama Invasion and the Gulf War.”
York: Pantheon.
Political Communication 13 (2): 181–94.
Higgins, E. Tory. 1996.“Knowledge Activation: Accessibility, Appli- Mermin, Jonathan. 1999. Debating War and Peace: Media Coverage
cability, and Salience.” In Social Psychology: Handbook of Basic of U.S. Intervention in the Post-Vietnam Era. Princeton: Princ-
Principles, eds. E. T. Higgins and A. W. Kruglanski. New York: eton University Press.
Guilford.
Miller, Joanne M., and Jon A. Krosnick. 1996. “News Media Impact
Higgins, E. Tory, and Gillian A. King. 1981. “Accessibility of Social on the Ingredients of Presidential Evaluations: A Program of
Constructs: Information-Processing Consequences of Indi- Research on the Priming Hypothesis.” In Political Persuasion
vidual and Contextual Variability.” In Personality, Cognition, and Attitude Change, eds. D. C. Mutz, P. M. Sniderman and
and Social Interaction, eds. N. Cantor and J. Kihlstrom. Hills- R. A. Brody. Ann Arbor: University of Michigan Press.
dale, NJ: Erlbaum. Miller, Joanne M., and Jon A. Krosnick. 2000. “News Media Impact
Iyengar, Shanto, and Donald Kinder. 1987. News that Matters: on the Ingredients of Presidential Evaluations: Politically
Television and American Opinion. Chicago: University of Knowledgeable Citizens are Guided by a Trusted Source.”
Chicago Press. American Journal of Political Science 44 (2): 295–309.
Iyengar, Shanto, Donald R. Kinder, Mark D. Peters, and Jon A. Nelson, Thomas E. 1999. “Public Rhetoric, Policy Goals, and
Krosnick. 1984. “The Evening News and Presidential Evalua- Political Attitudes.” Paper presented at the annual meeting of
tions.” Journal of Personality and Social Psychology 46: 778–87. the American Political Science Association, Atlanta.

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms
976 scott l. althaus and young mie kim

Pan, Zhongdang, and Gerald M. Kosicki. 1993. “Framing Analysis: Thompson, Erik P., Robert J. Roman, Gordon B. Moskowitz, Shelly
An Approach to News Discourse.” Political Communication 10: Chaiken, and John A. Bargh. 1994. “Accuracy Motivation
55–75. Attenuates Covert Priming Effects: The Systematic Reprocess-
Pan, Zhongdang, and Gerald M. Kosicki. 1997. “Priming and ing of Social Information.” Journal of Personality and Social
Media Impact on the Evaluations of the President’s Perfor- Psychology 66: 474–89.
mance.” Communication Research 24 (1): 3–30. Trope, Yaacov, and Zvi Ginossar. 1988. “On the Use of Statistical
Power, J. Gerard, and Sheila T. Murphy. 1996. “Priming Prejudice.” and Nonstatistical Knowledge: A Problem-Solving Approach.”
Human Communication Research 23: 1–36. In The Social Psychology of Knowledge, eds. D. Bar-Tal and A. W.
Kruglanski. New York: Cambridge University Press.
Price, Vincent, and David Tewksbury. 1997. “News Values and
Public Opinion: A Theoretical Account of Media Priming and Valentino, Nicholas A. 1999. “Crime News and the Priming of
Framing.” In Progress in Communication Sciences, eds. G. Racial Attitudes during Evaluations of the President.” Public
Barnett and F. Boster. London: Ablex Publishing. Opinion Quarterly 63 (3): 293–320.
Roskos-Ewoldesen, David R., Beverly Roskos-Ewoldesen, and Valentino, Nicholas A., Vincent L. Hutchings, and Ismail K. White.
Francesca R. Dillman Carpentier. 2002. “Media Priming: A 2002. “Cues that Matter: How Political Ads Prime Racial Atti-
Synthesis.” In Media Effects: Advances in Theory and Research, tudes during Campaigns.” American Political Science Review 96
eds. J. Bryant and D. Zillmann. Mahwah, NJ: Lawrence (1): 75–90.
Erlbaum Associates. Zaller, John. 1992. The Nature and Origins of Mass Opinion. New
Shrum, L. J., and Thomas C. O’Guinn. 1993. “Processes and Effects York: Cambridge University Press.
in the Construction of Social Reality.” Communication Research
20: 436–71.
Sniderman, Paul M., and Sean M. Theriault. 2004. “The Dynamics Scott L. Althaus is associate professor of political
of Political Argument and the Logic of Issue Framing.” In
Studies in Public Opinion: Gauging Attitudes, Nonattitudes, science and speech communication, University of Illi-
Measurement Error and Change, eds. W. E. Saris and P. M. nois at Urbana-Champaign, Urbana, IL 61801. Young
Sniderman. Princeton: Princeton University Press. Mie Kim is assistant professor of communication, The
Sparrow, Bartholomew H. 1999. Uncertain Guardians: The News Ohio State University, Columbus, OH 43210.
Media as a Political Institution. Baltimore: Johns Hopkins Uni-
versity Press.

This content downloaded from


200.130.19.138 on Thu, 21 Feb 2019 14:53:17 UTC
All use subject to https://about.jstor.org/terms

You might also like