You are on page 1of 10

International Studies Quarterly (2023) 67, sqac081

Names from Nowhere? Fictitious Country Names in Survey Vignettes


Affect Experimental Results
RESEARCH NOTE

JACKLYN MAJNEMER
Massachusetts Institute of Technology, USA

AND

G U S TAV M E I B A U E R

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


Radboud University Nijmegen, The Netherlands

Using fictitious country names in hypothetical scenarios is widespread in experimental international relations research. We
survey sixty-four peer-reviewed articles to find that it is justified by reference to necessary “neutralization” compared to real-
world scenarios. However, this neutralization effect has not been independently tested. Indeed, psychology and toponymy
scholarship suggest that names entail implicit cues that can inadvertently bias survey results. We use a survey experiment
to test neutralization and naming effects. We find not only limited evidence for neutralization, but also little evidence for
systematic naming effects. Instead, we find that respondents were often more willing to support using force against fictitious
countries than even adversarial real-world countries. Real-world associations may provide a “deterrent” effect not captured
by hypothetical scenarios with fictitious country names. In turn, fictionalization may decrease the stakes as experienced by
respondents. Researchers should therefore carefully explain rationales for and expected effects of fictitious country names,
and test their fictitious names independently.
El uso de nombres de países ficticios en escenarios hipotéticos está muy extendido en la investigación experimental en el
ámbito de las RRII. En un estudio de 64 artículos revisados por pares, observamos que esto se justifica con referencia a la
«neutralización» necesaria en comparación con los escenarios del mundo real. Sin embargo, este efecto de neutralización no
se ha comprobado de forma independiente. De hecho, los estudios en el campo de la psicología y de la toponimia sugieren
que los nombres conllevan pistas implícitas que pueden sesgar inadvertidamente los resultados de las encuestas. Utilizamos un
experimento con encuestas para comprobar los efectos de neutralización y de asignación de nombres. Encontramos pruebas
limitadas de neutralización, pero también pocas pruebas de efectos sistemáticos de la asignación de nombres. En cambio,
observamos que los encuestados suelen estar más dispuestos a apoyar el uso de la fuerza contra países ficticios que incluso
contra países antagonistas del mundo real. Las asociaciones del mundo real pueden proporcionar un efecto «disuasorio» que
no se capta en los escenarios hipotéticos con nombres de países ficticios. A su vez, la ficcionalización puede disminuir lo que
está en juego según los encuestados. Por lo tanto, los investigadores deben explicar cuidadosamente las razones y los efectos
esperados de los nombres ficticios de los países, y comprobar sus nombres ficticios de forma independiente.
L’utilisation de noms de pays fictifs dans les scénarios hypothétiques est courante dans la recherche expérimentale en re-
lations internationales. Nous examinons 64 articles vérifiés par des pairs pour conclure qu’elle se justifie par référence à la
nécessité de « neutralisation » par rapport aux scénarios réels. Néanmoins, cet effet de neutralisation n’a pas fait l’objet d’une
évaluation distincte. En effet, les chercheurs en psychologie et toponymie estiment que les noms véhiculent des indications
implicites susceptibles d’influencer les résultats d’enquête. Nous avons recours à une expérience de sondage pour vérifier la
neutralisation et les effets d’appellation. Nous ne recueillons qu’un nombre limité de preuves attestant de la neutralisation,
mais aussi des effets d’appellation systématiques. Nous observons plutôt que les personnes sondées ont plus souvent tendance
à soutenir l’usage de la force à l’encontre de pays fictifs que de pays réels, même ennemis. Les liens avec le monde réel peuvent
générer un effet « dissuasif » non représenté par les scénarios hypothétiques incluant des noms de pays fictifs. La fictionnal-
isation peut, quant à elle, réduire les enjeux envisagés par les personnes sondées. Ainsi, les chercheurs devraient expliquer
précisément les raisons motivant leur utilisation de noms de pays fictifs, et les effets attendus, mais aussi essayer leurs noms
fictifs séparément.

Introduction
Jacklyn Majnemer is a Stanton Nuclear Security Fellow at the Massachusetts Experimental surveys have become an increasingly popular
Institute of Technology’s Security Studies Program. Her research focuses on nu- tool in IR research. They are used widely to gauge atti-
clear security and alliance politics. tudes, simulate decisional dynamics, and elucidate psycho-
Gustav Meibauer is an Assistant Professor in International Relations at the De- logical and behavioral concepts in political science and
partment of Political Science, Radboud University Nijmegen. His research focuses
on international relations theory and foreign policy decision-making.
Authors’ note: The authors contributed equally to this article. They are thank- Department’s Security/Statecraft and Theory Colloquiums for useful comments
ful to Gokhan Ciflikli, Anna Getmansky, Jörg Meibauer, Paola Solimena, Haley and feedback. The data underlying this article are available on the ISQ Dataverse,
Swedlund, Peter Trubowitz, and Reinout van der Veer, as well as the LSE IR at https://dataverse.harvard.edu/dataverse/isq.

Majnemer, Jacklyn, and Gustav Meibauer. (2023) Names from Nowhere? Fictitious Country Names in Survey Vignettes Affect Experimental Results. International Studies Quarterly,
https://doi.org/10.1093/isq/sqac081
© The Author(s) (2023). Published by Oxford University Press on behalf of the International Studies Association. This is an Open Access article distributed under the terms of the
Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium,
provided the original work is properly cited.
2 Fictitious Country Names Affect Experimental Results

international relations (IR). They underpin work on peace affect the results or indeed offer alternative (better)
and conflict, regime theory, foreign policy decision-making, explanations (McDermott 2011b). This extends to experi-
public opinion, and media, as well as political psychology mental vignettes.
(e.g., Beer, Healy, and Bourne 2004; Hudson and Butler Vignette features (including wording, question order, and
2010; Mintz, Yang, and McDermott 2011; McDermott 2011a; survey length) can bias responses regardless of the underly-
Jensen, Mukherjee, and Bernhard 2014). Frequently, such ing characteristics ostensibly being measured. Even minor
research employs experimental surveys with vignettes de- changes can change the perceived meaning of questions or
scribing hypothetical scenarios that involve fictitious coun- vignettes (Pasek and Krosnick 2010, 43). Also, experimen-
tries (e.g., Kerejistan) or abstracted countries (e.g., “a coun- tal surveys are cognitively taxing. This can lead respondents
try”). We have identified sixty-four peer-reviewed articles in to knowingly or unknowingly use “shortcuts,” including pre-
political science and IR (published between 1971 and 2021) conceived notions, schemas, or prejudices, to guide their
with a total of eighty-six unique fictitious countries in exper- responses, thereby effectively reaching outside of the ex-
imental vignettes (not including abstract names, e.g., “the periment (Groves et al. 2011, 219). The vignette’s features
state”). should not inadvertently incentivize these shortcuts to an

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


While the reasoning behind the selection of a particular extent that fundamentally skews results (Dafoe, Zhang, and
fictitious name is often not articulated, the assumption that Caughey 2018).
fictitious or abstract country names function as a kind of The use of fictitious or abstract country names in exper-
empty placeholder and therefore have a neutralizing effect imental IR research has not been subject to much schol-
on experimental results underlies much of this research. arly scrutiny. This extends to their potentially independent
Fictitious or abstract names should therefore remove bias causal effects on survey responses (for initial insights, see
and increase the validity of results. However, this assumption Dafoe, Zhang, and Caughey 2018; Kreps and Roblin 2019;
(the “neutralization hypothesis”) has not itself been empiri- McDonald 2020; Croco, Hanmer, and McDonald 2021;
cally tested. Indeed, based on insights from toponymic, lin- Brutger et al. 2022). This is interesting because fictitious
guistic, and psychological research, fictitious country names country names are often used in experimental surveys to
are likely to contain implicit cues that can bias partici- prevent inadvertent biasing in vignette design: authors seek
pant responses (“naming effects”). Building on relevant lit- to address an internal validity concern around the biasing
erature from IR and political science (Dafoe, Zhang, and effects of real-world country names. However, the idea that
Caughey 2018; Kreps and Roblin 2019; McDonald 2020; fictitious country names can help with this concern rests on
Croco, Hanmer, and McDonald 2021; Brutger et al. 2022) untested assumptions, as we detail below.
and adapting a widely used scenario from experimental IR Experimental vignettes have employed a multitude of
(Tomz and Weeks 2013), we investigate whether different fictitious aspects and characters, such as fictitious re-
fictitious names equally neutralize a real-world country, and gions (Keller and Yang 2016), fictitious characters (Caspi,
whether there are naming effects depending on the ficti- Olekalns, and Druckman 2017; Balmas 2018; Schwartz and
tious name employed. Blair 2020), non-state entities (Garcia and Geva 2016), or
Our results do not uniformly support the neutralization fictitious op-eds (Baele, Coan, and Sterck 2018). We focus
hypothesis. At the same time, we find only limited evidence on fictitious countries in particular for two reasons: (1) The
for the existence of systematic naming effects. Instead, we state is central to most mainstream conceptions of the disci-
find that participants were more willing, across the board, to pline and (perhaps therefore) and (2) the use of fictitious
support attacking fictitious countries than real-world coun- countries is a pervasive and easily traceable phenomenon in
terparts. This “fictionalization effect” applied to both ficti- experimental IR research.
tious countries and abstracted country names. We find that Earliest examples of fictitious countries in experimental
the respondents’ willingness to use force is highest against IR research include articles on simulations (as quasi-
country names more easily identifiable as fictitious, slightly experiments) otherwise used to train diplomats and grad-
lower for abstracted country names, and weaker still for ficti- uate students (Guetzkow 1959; Brody 1963; Winham and
tious names that closely resemble real-life places (e.g., Kere- Bovis 1978, 1979). Morse and Gergen (1971) and Hopmann
jistan). These findings raise the question whether fiction- and Walcott (1976) start employing vignettes with fictitious
alization of real-world countries in experimental vignettes countries to investigate IR questions. Experimental usage
is the best way to measure general attitudes toward various of fictitious countries then takes off with Beer et al.’s piece
aspects of IR. Respondents may be more willing to use vi- on information cues and foreign policy choice (Beer et al.
olence in a doubly costless setting: not only is the scenario 1987). Their scenario is modeled after the Falklands crisis
hypothetical, the possible targets are also fictionalized or ab- and uses “Afslandia” and “Bagumba.” An A–B logic seems
stracted. We conclude with implications and suggestions for likely, but they do not explain these names further aside
further research. from calling them “unlikely” and set in a “fantasy world”
(Beer et al. 1987, 708).
Since fictitious countries have become ubiquitous, exper-
Experimental Research and Fictitious Country Names
imental IR has employed a colorful range of candidates
Fictitious or abstract country names in experimental survey (e.g., Alpha, Ruritania, Cygnus, Erqat, and Moereland). Fic-
vignettes can pose internal validity problems when they bias titious country names used in experimental vignettes are of-
respondents’ answers. While external validity concerns have ten “passed down” to a wider network with shared senior au-
been reviewed extensively (e.g., Mintz, Yang, and McDer- thors (Beer et al. 1995; Bourne et al. 1996; Healy et al. 2002),
mott 2011; Hainmueller, Hangartner, and Yamamoto 2015; but amended to fit new research (Beer, Healy, and Bourne
Kreps and Roblin 2019), internal validity concerns are less 2004). Mintz and Geva invented the most influential such
often scrutinized. Internal validity concerns the extent to fictitious setup to investigate domestic incentives for keep-
which evidence, for example, an experimental survey, can ing the democratic peace (Geva, DeRouen, and Mintz 1993;
actually support a particular causal claim. It requires re- Mintz and Geva 1993). As no real cases exist of democra-
searchers to ensure that there are no unknown or unmea- cies invading their neighbors, the authors used a scenario
sured factors in research design or execution that could that “borrowed features from the Iraqi invasion of Kuwait”
JACKLYN MAJNEMER AND G U S TAV M E I B A U E R 3

(Mintz and Geva 1993, 491). Around the original dyad of This first hypothesis tests whether respondents care about
Gorendy and Raggol, consecutive authors added Winmont, names provided to them in vignettes in the first place. It
Minalo, Kerzoune, Purportes, Vermaid, and Zorka (Mintz could be the case, otherwise, that preferences about using
et al. 1997; Geva and Hanson 1999; Redd 2002; Christensen military forces are fixed independent of provided context
and Redd 2004; Mintz 2004; Rubenzer and Redd 2010; (e.g., strict pacifism) or that respondents may not pay atten-
Horowitz and Redd 2017, 2018). tion to names at all, or as much as other information also
provided to them.
Neutralization H2 : A change from a real-world country name to a fictitious or ab-
Most authors do not explain why they use fictitious country stract country name will affect respondents’ willingness to use force.
names.1 Boettcher discusses the unintended consequences H3 : Respondents’ willingness to attack a fictious/abstract country
of framing in vignettes, but uses fictitious countries without will lie between their willingness to attack a positively associated
further explanation (Boettcher 1995, 577). Others mention real-world country and a negatively associated real-world country.
their scenario’s real-world basis (Astorino-Courtois 2000;

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


Keller and Yang 2008; Davies and Johns 2013, 2016, 349). While there is no clear-cut prediction about how neutral-
Of the scholars that justify the selection of a fictitious coun- ization may affect results based on the above studies, it often
try, most argue that it is aimed at increasing internal validity. seems to imply the presence of a baseline attitude about for-
Specifically, they suggest that the fictionalization has a eign policy that can be amplified or dampened based on the
neutralizing effect compared to using real-world names. associated country. In this sense, neutralization can function
Using fictitious countries would allow scholars to avoid as a kind of mid-point between positive bias, for example,
the biases and preconceptions that participants may have associated with a close ally, and negative bias, for example,
about real countries, which could undermine the experi- associated with a foreign adversary.
ment and muddy results (Beer et al. 1992, 323; Sirin 2011,
289; McLean and Roblyer 2017, 239). Unlike real countries,
participants should have no prior associations or particular Naming Effects
feelings about a fictitious country. Instead, they will have to Scholarship in linguistics, and in particular into onoma-
wholly rely on the information that is given to them by the tology and toponymy, has long suggested (and experimen-
experimental vignette, allowing for a “pure” test of experi- tally tested) naming effects.2 Different names, including
mental manipulations (Balmas 2018, 510; O’Brien, Leidner, fictitious ones, may entail implicit information that biases
and Tropp 2018, 950). The use of fictionalized countries participant responses (Dafoe, Zhang, and Caughey 2018).
should therefore increase the validity, reliability, and gen- Such naming effects could explain why neutralization might
eralizability of their findings. For example, Balmas suggests work for some names and not others, and what direction
that “participants [ … ] could not have had prior knowl- or strength we might expect the changes due to differ-
edge about the citizens of Cedria” and therefore “evaluated ent names have, based on three types of interlinked cues
Cedrians based only on their evaluation of its leader, which that provide information on plausibility, familiarity, foreign-
could have been derived only from the content of the arti- ness, and even value of different names: toponymic, lexico-
cle” (Balmas 2018, 510). graphic, and sound-symbolic.
This argument also holds for abstract versions of coun- Toponymic cues relate to knowledge of how place names
try names (e.g., “country X,” “a foreign adversary”). Earlier usually work, and what these names mean or encode in
authors seemed to have shied away from such abstraction, terms of foreignness. Even fictitious names are usually ori-
perhaps because a fictitious name increases memorability, ented toward existing toponymy (e.g., in using endings such
which is often advantageous. Still, abstraction with “the/a as –stan and –land).3 Some authors switch out real-world
country/state” seems to have become experimental stan- place names (e.g., of cities) for country names (McDermott
dard (e.g., Heinrich, Kobayashi, and Peterson 2017; Kreps and Cowden 2001; McDermott, Cowden, and Koopman
and Maxey 2018; Schwartz and Blair 2020; Tomz, Weeks, 2002). This links to a plausibility requirement: to elicit rea-
and Yarhi-Milo 2020), presumably because this would fur- sonable responses, fictitious names must be believable to
ther “neutralize” experimental results compared to fictitious participants (Finch 1987, 111). Place names are revealing
names. about a place’s “physical geography, culture, history, and
Participants are assumed to lack knowledge of fictitious population” (Kadmon 2000; Medway and Warnaby 2014,
or abstract countries and will therefore only use the in- 154). For example, Winmont (Horowitz, Redd, and Ye 2014)
formation that is conveyed about the country in the vi- or Highland (Schafer 1997, 1999) evokes hills or moun-
gnette, rather than any preconceived notions or attitudes tains. Place names also “evoke powerful images and conno-
that bias their responses. Fictitious countries are thus sup- tations, contributing to the development of a sense of place”
posedly “empty” placeholders well suited to robustness tests and help in “the social construction of space and the con-
and generalization beyond specific real-world cases (Li et al. tested process of attaching meaning to places” (Graham and
2016, 1008). However, this neutralizing effect is an assump- Howard 2012, 196). For example, Celesta (Keller and Yang
tion: it should itself be experimentally tested in the con- 2016) evokes the sky and heaven. This induces cognitive ef-
text of IR scholarship. To do so, we formulate the following fects, for example, that people tend to prefer places (they
hypotheses:
2
While, to our knowledge, this particular scholarship has not previously been
H1 : A change in real-world country name will affect respondents’ introduced into IR, it connects with IR scholars’ increasing interest into the in-
willingness to use force. tersections of language, psychology, and IR. In particular, the perception of dif-
ference and its relevance for behavior has long been a focus in IR scholarship,
especially in conflict studies (Kertzer and Tingley 2018) (see Fierke 2002; Albert
et al. 2008; McDermott 2011a; Kertzer and Tingley 2018).
1 3
Perhaps authors enjoy inventing poignant or humorous names with hidden Of the eighty-six fictitious country names we identified in experimental sur-
meanings, for example, Morse and Gergen’s (1971) Negreg or Dill and Schu- vey vignettes, fifteen fictitious country names end in –ia, six in –land, and two in
biger’s (2021) Esor. –stan.
4 Fictitious Country Names Affect Experimental Results

think are) more like their own, as well as according value below) because of toponymic, lexicographic, and/or sound-
judgments. Consider Westria that entails information about symbolic cues.
a geographical location, but could also be associated with
“the West” as a sociocultural realm (Brooks and Valentino H4 : An increase in toponymic cues evoking negative value judg-
2011). In turn, based on toponymic knowledge of English ments should increase respondents’ willingness to use force.
speakers, Drakhar (Keller and Yang 2016), Nizwar (Davies
and Johns 2016), Bachran (Falomir-Pichastor et al. 2012), H5 : An increase in lexicographic cues evoking negative value judg-
Kibagho (Terris and Tykocinski 2016), etc., may be associ- ments should increase respondents’ willingness to use force.
ated with geographic and/or sociocultural spaces in Africa H6 : An increase in sound-symbolic cues evoking negative value
and the Middle East. Kuzeya (Sirin 2011) or Abazie might judgments should increase respondents’ willingness to use force.
connote Eastern European or Central Asian countries (in-
tentionally so in Falomir-Pichastor et al. 2012).
Lexicographic cues concern the degree of familiarity a
Methods
name evokes given the respondent’s name lexicon. While

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


Westria or Celesta might sound familiar compared to other To test neutralization and naming effects of fictitious coun-
known country names for an English-language speaker, Rag- try names in experimental vignettes, we conducted an ex-
gol might imply strangeness (Davies 1990, 208). In turn, we perimental survey through the YouGov Omnibus on July
know from previous literature that the name lexicon inter- 25–26, 2019. Participants were representative of British
acts with sociocultural background and, importantly, norma- adults (N = 1,613), and randomly assigned to treatment
tive judgments. For example, people are likely to be able groups. Each treatment group was given the same vignette,
to locate Kerejistan on a real-world map or even comment with changes limited to the country name in a hypothet-
on its customs, regime type, etc., because they orient them- ical scenario (full vignette and instructions in the online
selves toward what they do know (or think they know) about appendix).
similarly named countries. It may not matter for this asso- Our vignette was based on Tomz and Weeks’ (2013) in-
ciation whether the respondent knows that Kerejistan does fluential article on the democratic peace. It contained a
not exist. Specific types of names become attached to associ- disclaimer to participants that the scenario that we were de-
ated characteristics precisely because names primarily func- scribing was hypothetical, even though it might bear resem-
tion as referential markers (Bright 2003). The association of blance to then-current events. Where we used a fictitious
fictitious Kerejistan with, for example, Afghanistan in turn country name, participants were also informed that it was
evokes value judgments, which may extend to factors under a fictitious country. We did not include any potentially bias-
investigation, such as the legitimacy of killing noncombat- ing information or other variables (regime type, alliances,
ants or the trustworthiness of leaders (Dafoe, Zhang, and military capabilities, etc.). Our experiment focuses on the
Caughey 2018). effect of the difference in name only, rather than poten-
Sound-symbolic cues aid in interpreting fictitious names tial interaction effects between name and other informa-
based on language-specific sounds. This holds especially in tion in more elaborate experiments. This allows the names
contexts where information that might otherwise be consid- to “soak up” some of the missing information respondents
ered crucial is lacking (Dafoe, Zhang, and Caughey 2018). otherwise use to inform their choices. Absent this informa-
Sound symbolism suggests that there are relationships be- tion, respondents are thus especially likely to use available
tween the meaning of a word and certain letter combina- cues. We have thus intentionally designed our experiment to
tions (producing sounds) it includes (Westbury et al. 2018, be particularly sensitive to naming effects. This allows us to
122; Svantesson 2017 for a review). These nonarbitrary asso- check whether names matter in the context of experimental
ciations are based on word features and meanings already IR, and whether the way they matter follows some system-
existent in the lexicon (Knoeferle et al. 2017; Westbury atic pattern (i.e., that suggested by naming effects scholar-
et al. 2018, 124).4 Sound symbolism relates to perceived ship). A null result would indicate that even in an IR ex-
“conventionality,” which in turn links with individual value periment explicitly designed to evoke naming effects (like
judgments (Elsen 2017; Westbury et al. 2018). It thus im- ours), the difference in effect between various fictitious and
bues names with specific meaning: this may include, for abstract names is negligible. In turn, significant or mixed re-
example, size/shape, power (versus weakness), masculinity sults would indicate the need for further research to assess
(versus femininity), and danger (versus safety) (Knoeferle the impact on specific experimental results, for example, in
et al. 2017). In marketing, different arrangements of vow- the form of replication studies, and for careful design of any
els and consonants shape the interpretation of brand names future experimental vignettes.
(Klink 2000; Preziosi and Coane 2017). Consider the name The vignette described a situation in which a ficti-
Drakhar, whose consonant combinations (and the sounds tious country was 6 months away from developing nuclear
they produce) may, for English speakers, be associated neg- weapons, had unknown motivations and disposition toward
atively: with harshness, darkness, danger, etc. Such inference the United Kingdom, and could be prevented from devel-
of attribute meaning and evaluation through sound is auto- oping nuclear weapons if the UK military would strike its
matic, uncontrollable, and outside of awareness (Yorkston nuclear development sites. Participants were asked to rate
and Menon 2004, 43). their approval to attack the sites on a scale of 1 (“strongly
Based on the above literature, we should find differences disapprove”) to 7 (“strongly approve”). Participants were in-
between the effects of various fictitious and abstract names formed of the survey’s true purpose after they had answered
(which we take from experimental IR literature and detail and could withdraw consent (none did).
In addition to two real-world country names, we selected
4
fictitious country names used in previous studies and pub-
Standard examples involve gl and fl, which do not have a meaning themselves
but may encode “short/rapid/intense visual experience/movement” in [glimmer,
lished in high-ranking disciplinary journals. As explained,
glint, glean, glow, glare] or [flame, flicker, flutter, flare, fly], connoted with light. we tried to maximize expected difference between the se-
Similarly, sl may be encoded pejoratively in [slant, sly, slander, slut, slump, slang, lected names per the naming effects logic. This resulted in
sloppy] (Svantesson 2017). seven treatment groups:
JACKLYN MAJNEMER AND G U S TAV M E I B A U E R 5

Table 1. Overall approval of use of force (1 = lowest, 7 = highest) across all treatment groups

Responses 1 (lowest) 2 3 4 5 6 7 (highest) Total

Frequency 317 174 195 407 223 90 207 1,613


Percentage 19.65 10.79 12.09 25.23 13.83 5.58 12.83 100.00

Mean Standard error 95% confidence interval


Participant response 3.708617 0.0482489 3.61398 3.803255

• “Iran” (treatment group size N = 246). Iran is salient and Table 2. Mean approval for use of force, standard deviations, and
schema-consistent to the scenario (Brutger et al. 2022, number of responses by treatment
14–15), given that the vignette is based on this real-world
Country Average approval Standard deviation Frequency

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


case and that the experiment was run during increased
tensions between Iran and the United Kingdom over the Canada 2.319588 1.6417253 194
Iranian nuclear program. Iran 3.569106 1.9020131 246
• “Canada” (N = 194). Canada is schema-inconsistent to Kerejistan 3.792683 1.8388404 246
the scenario. Due to Canada’s friendly relations with the The country 3.89083 1.894441 229
United Kingdom, we expect it to severely decrease partic- Minalo 3.985185 1.9395519 270
ipants’ willingness to use force compared to Iran. Drakhar 4.094171 1.9160564 223
• “The/a country” (N = 229). Based on the neutralization Celesta 4.102439 1.8508726 205
and naming effect hypotheses, “a country” should be most
empty in terms of preconceptions and cues.
• “Celesta” (N = 205) (Keller and Yang 2016). “Celesta” control for respondent age, gender, political attention, and
provides lexicographic, toponymic, and sound-symbolic education level.
cues that are likely to evoke positive value judgments. We Respondents are significantly less likely to support using
therefore expect it to decrease participants’ willingness to military force to strike in a hypothetical scenario that em-
use force compared to all other fictitious names. ploys Canada than one that employs Iran.5 This provides
• “Minalo” (N = 270) (Mintz et al. 1997; Redd 2002; confirmatory evidence that the names provided in the sce-
Christensen and Redd 2004; Rubenzer and Redd 2010; nario matter to respondents, that is, that exchanging the
Horowitz and Redd 2017, 2018). Minalo provides lexi- country name in the vignette can have a significant effect
cographic cues that mean that we expect it to increase on responses (H1 ). We find some existence of a neutraliza-
participants’ willingness to use force compared vis-à-vis “a tion effect for fictitious and abstract country names in the
country” and Celesta. sense that they differ from the Iran baseline (H2 ). While all
• “Kerejistan” (N = 246) (Druckman, Olekalns, and Smith fictitious country names differ from the real-world baseline
2009; Druckman and Olekalns 2013; Caspi, Olekalns, and Iran, not all differences are statistically significant.
Druckman 2017). “Kerejistan” provides lexicographic and However, contrary to H3 , respondents are more likely to
toponymic cues that are likely to evoke negative value support attacking Celesta, Drakhar, and Minalo (p < 0.01)
judgments. We therefore expect it to increase partici- as well as “the country” (p < 0.05). Rather than at some
pants’ willingness to use force compared to “a country,” mid-point between a friendly, positively associated country
Celesta and Minalo. (Canada) and an adversarial, negatively associated country
• “Drakhar” (N = 223) (Keller and Yang 2008, 2016). (Iran), respondent support for using force was consistently
“Drakhar” provides toponymic, lexicographic, and sound- higher for fictitious countries. Kerejistan is not significantly
symbolic cues that are likely to evoke negative value judg- different compared to Iran (p = 0.208). Overall, this pro-
ments. We therefore expect it to increase participants’ vides weak support for the neutralization hypothesis, and
willingness to use force compared to “a country,” Celesta, suggests that a different, “fictionalization” effect might be
Minalo, and Kerejistan. at play, which we discuss below. Female respondents as well
as those with a higher education level were less willing to
support using military force (p < 0.01).
Results The confidence intervals (figure 1) already indicate
mixed results regarding systematic naming effects (H4 , H5 ,
Across treatment groups, respondents slightly favor not us- H6 ). A Kruskal–Wallis test showed that there was statistically
ing military force in this scenario (mean = 3.71), with 25 significant difference in willingness to use force between all
percent of all respondents opting for the middle option and seven treatment groups (compared by mean ranks; χ 2 (2) =
clustering around both extreme responses (table 1). 127.527, p = 0.0001; table 4). We used Dunn–Bonferroni
The treatment-group-specific averages are loosely clus- post hoc tests on each pair of groups, and adjusted the
tered around the across-group average, with the clearest de- p-values for false discovery rates using the Benjamini–
viations in mean for Canada and Celesta. Iran, our baseline Hochberg method. As expected, this provided signifi-
country, has a mean response of 3.57 (table 2). Interestingly, cant differences between the Iran and Canada treatment
all fictitious country names score higher than Iran on aver- groups as well as between Canada and all fictitious coun-
age. try names. Iran was also significantly different from Celesta
To test the neutralization hypotheses, we first run an and Drakhar at p < 0.05. However, it did not significantly
ordinary least squares regression on the baseline “Iran”
(table 3). If we had an Iran-based scenario and wanted to 5
Note that even though Canada is schema inconsistent to the chosen vignette
neutralize it per the assumptions prevalent in experimental (it is unrealistic that it would be placed in the provided scenario), we do not see
IR literature, we would abstract and/or fictionalize Iran. We results that could suggest that respondents did not take the question seriously.
6 Fictitious Country Names Affect Experimental Results

Table 3. Ordinary least squares (OLS) regression on “Iran” as baseline

Coefficient Standard error t P > |t| 95% confidence interval

Constant 4.804849 0.3157116 15.22 0.000 4.185598 5.42101


Country
Canada −1.266281 0.1762189 −7.19 0.000 −1.611924 −0.9206368
Celesta 0.5250181 0.1733122 3.03 0.002 0.1850756 0.8649607
Drakhar 0.5147249 0.1695385 3.04 0.002 0.1821842 0.8472655
Kerejistan 0.2081938 0.1654583 1.26 0.208 −0.1163437 0.5327314
Minalo 0.4200486 0.161504 2.60 0.009 0.1032673 0.7368299
The country 0.3316844 0.1683771 1.97 0.049 0.0014219 0.6619469
Age 0.0012402 0.002993 0.41 0.679 −0.0046303 0.0071108
Gender −0.3712228 0.0927164 −4.00 0.000 −0.5530811 −0.1893646
Highest education −0.3859341 0.0635528 −6.07 0.000 −0.5105895 −0.2612786

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


Political attention 0.0081894 0.0214211 0.38 0.702 −0.033827 0.0502057

SS df MS Observations 1,613
Model 675.551382 10 67.5551382 F (10,1602) 20.13
Residual 5,377.49884 1,602 3.35674085 Probability > F 0.0000
Total 6,053.05022 1,612 3.75499393 R2 0.1116
Adjusted R2 0.1061
Root MSE 1.8321

Canada

Celesta

Drakhar

Kerejistan

Minalo

The country

−1.5 −1 −.5 0 .5 1

Figure 1. Response effect estimates and confidence intervals of treatment groups mapped against the baseline “Iran” (vertical
line at position “0”).

differ compared to Kerejistan, Minalo, and “the country.” article text or the respective appendices, where available)
Importantly, the fictitious country names did not perform that fictitious country names actually provided a neutraliza-
significantly differently compared to each other in the way tion effect.6 Instead, they relied on two untested assump-
we might expect based on naming effects literature (H4 –6 ). tions: that all fictitious country names are similarly neutral-
Of our experiment’s fictitious countries, Kerejistan per- izing and that there is no biasing effect from the fictitious
formed most similar to Iran (compared to other fictitious name itself. Our experiment seeks to test these assumptions
names). Beyond Kerejistan, we did not find evidence that to investigate what effect, if any, fictionalized or abstract
variation between different fictitious country names has an names have on respondents’ willingness to use force.
effect on survey responses. We find only limited support for the neutralization hy-
pothesis. The example of Kerejistan (as compared to the
Iran baseline) already shows that not all fictitious names
Discussion have a uniform effect. It also runs counter to the neutraliza-
Previous studies that employed fictitious or abstract country tion hypothesis that both fictionalized and abstract names
names did often not provide an explicit reason for doing
so. Even among those articles that did, usually based on in- 6
With the possible exception of Dill and Schubiger, who show that the name
ternal validity concerns, none demonstrated (in either the “Esor” did not drive their results (Dill and Schubiger 2021).
JACKLYN MAJNEMER AND G U S TAV M E I B A U E R 7

Table 4. Kruskal–Wallis equality-of-populations rank test and Dunn–Bonferroni post hoc test (adjusted)

Country name Observations Rank sum

Canada 194 92,531.00


Celesta 205 184,858.50
Drakhar 223 200,650.00
Iran 246 190,316.50
Kerejistan 246 203,237.50
Minalo 270 234,715.00
The country 229 195,382.50

Chi-squared 123.496 with 6 df


Probability 0.0001
Chi-squared with ties 127.527 with 6 df
Probability 0.0001

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


Dunn’s pairwise comparison of respondent choices by country name (Bonferroni)

Canada Celesta Drakhar Iran Kerejistan Minalo

Celesta −9.252439
(0.0000)
Drakhar −9.395682 0.044487
(0.0000) (1.0000)
Iran −6.741038 2.955401 2.976137
(0.0000) (0.0328) (0.0306)
Kerejistan −7.934474 1.743650 1.736797 −1.270894
(0.0000) (0.8528) (0.8654) (1.0000)
Minalo −9.094823 0.763850 0.734430 −2.368092 −1.067978
(0.0000) (1.0000) (1.0000) (0.1877) (1.0000)
The country −8.412077 1.101630 1.080113 −1.890160 −0.642215 0.391386
(0.0000) (1.0000) (1.0000) (0.6167) (1.0000) (1.0000)

Family wise error rate 0.05

increase willingness to use force. We also find only lim- realistic-ness of a country name is (at least partially) a func-
ited evidentiary support for systematic naming effects (with tion of perceived toponymic plausibility and lexicographic
the exception of Kerejistan), that is, differences between familiarity. Note that this could also lead respondents to
fictitious names induced by lexicographic, toponymic, or consider real-life country names unrealistic, depending on
sound-symbolic cues. While Celesta, Drakhar, and Minalo their individual knowledge of country names, geography,
prompted significantly different responses compared to the and their respective native languages. While we have not
baseline Iran, the different fictitious names were not signif- separately asked our respondents to rate the realistic-ness
icantly different from each other. This matters because they of the provided name or scenario, it seems likely that differ-
were selected based on assumed difference of embedded ent fictitious names connote realistic-ness to different de-
cues. Even below significance thresholds, the order and di- grees. Consider the difference between Celesta, Drakhar,
rection in which the fictitious names differ from the baseline and Minalo on the one hand, and Kerejistan on the other—
do not support the naming effect hypotheses. respondents may more readily identify the former as ficti-
Notably, our findings suggest that fictitious and abstract tious, while the latter may challenge respondents not famil-
names increase participants’ willingness to support the use iar with the geography of central Asia. In turn, perceived
of force compared to real-world (or realistic) counterparts. realistic-ness influences their responses.
This holds even compared to schema-consistent real world, Indeed, our results indicate that Kerejistan does not have
adversarial, and/or pariah states. It questions whether the significantly different effects on participant responses com-
neutralization effect actually neutralizes—or whether in- pared to Iran. Kerejistan may evoke connotations that are,
deed there is a “fictionalization effect” that may lead schol- on average and for British respondents, similar to those
ars to overestimate respondents’ willingness to use force evoked by Iran. The close lexicographic and toponymic as-
in hypothetical scenarios involving fictitious or abstract sociation of Kerejistan with, for example, Afghanistan seems
countries. Our results suggest that the more clearly ficti- likely to evoke value judgments that overlap with those
tious a country name, the easier to condone attacking it— respondents make regarding Muslim, Middle-Eastern, or
fictionality and its perceived costlessness can therefore em- autocratic states, despite the considerable real-world differ-
bolden respondents to provide more aggressive responses. ences between Iran and Afghanistan. This possible informa-
These results point to the relevance of perceived realistic- tion equivalence problematizes the neutralization hypothe-
ness: the more “real” a country name sounds to respon- sis: not all fictitious country names are similarly neutraliz-
dents, the weaker the fictionalization effect. In particular, ing. It implies the necessity for experimental researchers to
there seems to be a deterrent effect associated with realistic- carefully justify or pilot fictitious country names and
ness, for example, of being able to imagine more easily the scenarios in advance of collecting results (also see Steiner,
consequences associated with attacking Iran, especially bar Atzmüller, and Su 2017).
any additional information that “fills out” the scenario. The
8 Fictitious Country Names Affect Experimental Results

Among the treatments employed, “the country” is the breakdown of real-world associations induced by fictional-
most abstract fictionalization—it does not offer a name but ization seems to cognitively decrease the stakes as experi-
a placeholder. In terms of results, it constitutes a borderline enced by respondents; in turn, realistic or plausible names
case. While not significantly different from Iran in our cross- may have a deterrent effect. The fictionalization effect con-
treatment comparison above, participants evaluated “the stitutes an important avenue for future research, including
country” similar to the other fictitious names. In principle, with an eye to generalization beyond the characteristics of
its lexicographic, toponymic, and sound-symbolic “empti- the population here surveyed.
ness” could induce respondents to think about which coun- Notably, our results cannot currently tell us whether,
try could be meant—which, given the salience of Iran to for example, the results of Tomz and Weeks’ study would
both the context in which our experiment was conducted differ (in what way) had they used any particular, differ-
and the hypothetical vignette, could have led respondents ent name in their vignette. This is partially a function of
to infer that the vignette meant Iran. Instead, “the country” our experimental design: in particular, future research may
seems to have increased the willingness to support the use of seek to investigate the strength of the fictionalization effect
force in similar ways to the other fictitious names. From this when experimental vignettes include additional informa-

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


perspective, it is thus not consistently less fictitious (or more tion/variables. Interaction between names and other infor-
neutral) than more colorful names. This is especially rel- mation might vary, for example, where people have stronger
evant because employing abstract names has become stan- attitudes toward some policy areas rather than others (e.g.,
dard in experimental IR more recently. toward using force compared to trade sanctions). The fic-
Finally, then, we may ask whether fictionalization of real- tionalization effect could be stronger if respondents base
world countries (through experimental vignettes) is the best their responses on their attitudes toward the countries in-
way to measure general attitudes toward IR or foreign policy volved to compensate for their lack of strongly held general
choice (also see McDonald 2020; Croco, Hanmer, and Mc- attitudes toward less salient issues. This means that while it
Donald 2021). It may well be preconceived notions about a must remain unclear to what extent the internal validity of
country (name) that predict survey responses, rather than any one study employing fictitious names is undermined,
the respondents’ attitudes toward foreign policies. This is we uphold the possibility that different names can affect
the standard justification for using fictitious names in the survey responses by increasing willingness to use force and
first place. However, doing so may carry its own effects, per- perhaps also in other unintended ways. At a minimum, this
vasive enough so that past results would not in fact capture indicates that abstraction and fictionalization need to be jus-
any “true” baseline untainted by the preconceptions respon- tified carefully, matched with the overall research design,
dents hold about real-world countries. Is the respondents’ and ideally piloted in pre-surveys before use in experimental
acceptance of attacking fictitious countries (rather than vignettes.
Iran) more reflective of participants’ general attitudes, or
only of their attitude toward fictitious countries (McDonald
2020)? If the latter, previous research employing fictitious Supplementary Information
country names may have too freely generalized respondents’ Supplementary information is available at the International
attitudes on a wide range of concepts and processes of IR. Studies Quarterly data archive.

Conclusion
Funder Information
We challenge the assumption that fictitious names are
The International Relations Department at the London
an unproblematic means of removing respondent bias in
School of Economics and Political Science provided funding
experimental IR research. What name is chosen for the
to conduct the experimental survey underlying this article.
vignette matters—and experimental researchers need to fac-
tor this into their survey design (Dafoe, Zhang, and Caughey
2018; Renshon, Dafoe, and Huth 2018). The most com- References
mon rationale for the use of fictitious or abstract coun- ALBERT, MATHIAS, OLIVER KESSLER, AND STEPHAN STETTER. 2008. “On Order and
try names within experimental surveys suggests that they Conflict: International Relations and the ‘Communicative Turn’.” Re-
provide what we label the “neutralization effect,” allowing view of International Studies 34 (1): 43–67.
respondents to provide their views on the phenomena of ASTORINO-COURTOIS, ALLISON. 2000. “The Effects of Stakes and Threat on
interest while avoiding that their personal opinions of real Foreign Policy Decision-Making.” Political Psychology 21 (3): 489–509.
countries and/or available background information bias https://doi.org/10.1111/0162-895X.00200
BAELE, STEPHANE J., TRAVIS G. COAN, AND OLIVIER C. STERCK. 2018. “Security
their responses. Testing this assumption, we find limited sup-
through Numbers? Experimentally Assessing the Impact of Numerical
port for the neutralization effect, which indicates that previ- Arguments in Security Communication.” The British Journal of Politics
ous experimental results may not be as robust as previously and International Relations 20 (2): 459–76.
assumed. We also find only limited support for systematic BALMAS, MEITAL. 2018. “Tell Me Who Is Your Leader, and I Will Tell You Who
naming effects (beyond perceived toponymic closeness in You Are: Foreign Leaders’ Perceived Personality and Public Attitudes
the example of Iran and Kerejistan). We find an overall ef- toward Their Countries and Citizenry.” American Journal of Political Sci-
fect of fictitious and abstract country names on responses ence 62 (2): 499–514.
of increasing willingness to use force. However, these re- BEER, FRANCIS A., ALICE F. HEALY, AND LYLE E. BOURNE. 2004. “Dynamic Deci-
sults seem to be driven by a different kind of logic than the sions: Experimental Reactions to War, Peace, and Terrorism.” In Ad-
hypothesized naming effects. vances in Political Psychology, edited by Margaret G. Hermann, 139–67.
Oxford: Elsevier.
Instead, complementing previous literature (Dafoe,
BEER, FRANCIS A., ALICE F. HEALY, GRANT P. SINCLAIR, AND LYLE E. BOURNE. 1987.
Zhang, and Caughey 2018; Brutger et al. 2022), we find ev- “War Cues and Foreign Policy Acts.” American Political Science Review 81
idence suggestive of a fictionalization effect. Respondents (3): 701–15.
are more willing to use violence against fictitious countries BEER, FRANCIS A., JEFFREY F. RINGER, GRANT P. SINCLAIR, ALICE F. HEALY, AND
regardless of the name employed, more so even than against LYLE E. BOURNE. 1992. “Ranking International Cooperation and Con-
real-world countries that are perceived as adversarial. The flict Events.” International Interactions 17 (4): 321–48.
JACKLYN MAJNEMER AND G U S TAV M E I B A U E R 9

BEER, FRANCIS A., GRANT P. SINCLAIR, ALICE F. HEALY, AND LYLE E. BOURNE. 1995. GROVES, ROBERT M., FLOYD J. FOWLER, MICK P. COUPER, JAMES M. LEPKOWSKI,
“Peace Agreement, Intractable Conflict, Escalation Trajectory: A Psy- ELEANOR SINGER, AND ROGER TOURANGEAU. 2011. Survey Methodology. Lon-
chological Laboratory Experiment.” International Studies Quarterly 39 don: Wiley.
(3): 297–312. GUETZKOW, HAROLD. 1959. “A Use of Simulation in the Study of Inter-Nation
BOETTCHER, WILLIAM A. 1995. “Context, Methods, Numbers, and Words: Relations.” Behavioral Science 4 (3): 183–91.
Prospect Theory in International Relations.” Journal of Conflict Resolu- HAINMUELLER, JENS, DOMINIK HANGARTNER, AND TEPPEI YAMAMOTO. 2015. “Vali-
tion 39 (3): 561–83. dating Vignette and Conjoint Survey Experiments against Real-World
BOURNE, LYLE E., GRANT P. SINCLAIR, ALICE F. HEALY, AND FRANCIS A. BEER. Behavior.” Proceedings of the National Academy of Sciences 112 (8): 2395–
1996. “Peace and Gender: Differential Reactions to International 2400.
Treaty Violations.” Peace and Conflict: Journal of Peace Psychology 2 (2): HEALY, ALICE F., JOSHUA M. HOFFMAN, FRANCIS A. BEER, AND LYLE E. BOURNE.
143–49. 2002. “Terrorists and Democrats: Individual Reactions to International
BRIGHT, WILLIAM. 2003. “What Is a Name? Reflections on Onomastics.” Lan- Attacks.” Political Psychology 23 (3): 439–67.
guage and Linguistics 4 (4): 669–81. HEINRICH, TOBIAS, YOSHIHARU KOBAYASHI, AND TIMOTHY M. PETERSON. 2017.
BRODY, RICHARD A. 1963. “Some Systemic Effects of the Spread of Nuclear “Sanction Consequences and Citizen Support: A Survey Experiment.”
Weapons Technology: A Study through Simulation of a Multi-Nuclear International Studies Quarterly 61 (1): 98–106.
Future.” Journal of Conflict Resolution 7 (4): 663–67. HOPMANN, P. TERRENCE, AND CHARLES WALCOTT. 1976. “The Impact of Interna-

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


BROOKS, DEBORAH JORDAN, AND BENJAMIN A. VALENTINO. 2011. “A War of One’s tional Conflict and Detente on Bargaining in Arms Control Negotia-
Own: Understanding the Gender Gap in Support for War.” Public Opin- tions: An Experimental Analysis.” International Interactions 2 (4): 189–
ion Quarterly 75 (2): 270–86. 206.
BRUTGER, RYAN, JOSHUA D. KERTZER, JONATHAN RENSHON, DUSTIN H. TINGLEY, HOROWITZ, SHALE, AND STEVEN B. REDD. 2017. “Leadership Preferences in
AND CHAGAI M. WEISS. 2022. “Abstraction and Detail in Experimental Ethno-Territorial Disputes: An Experimental Approach.” Foreign Policy
Design.” American Journal of Political Science. Accessed June 5, 2022. Analysis 13 (4): 950–67.
https://doi.org/10.1111/ajps.12710. ———. 2018. “International Norms in Ethno-Territorial Disputes: Legiti-
CASPI, PLIA VAISMAN, MARA OLEKALNS, AND DANIEL DRUCKMAN. 2017. “After the macy and Efficacy in Outsiders’ Views of Independence and Irreden-
Fall: Regulatory Focus, Trust and Negotiators’ Responses to a Crisis.” tism.” Civil Wars 20 (1): 66–88.
Journal of Trust Research 7 (1): 51–70. HOROWITZ, SHALE, STEVEN REDD, AND MIN YE. 2014. “Leadership Preferences
CHRISTENSEN, EBEN J., AND STEVEN B. REDD. 2004. “Bureaucrats versus the Ballot in International Conflict: Experimental Results from the People’s Re-
Box in Foreign Policy Decision Making: An Experimental Analysis of public of China and Taiwan.” SSRN Scholarly Paper ID 2476100. So-
the Bureaucratic Politics Model and the Poliheuristic Theory.” Journal cial Science Research Network, Rochester. Accessed March 12, 2022.
of Conflict Resolution 48 (1): 69–90. https://papers.ssrn.com/abstract=2476100.
CROCO, SARAH E., MICHAEL J. HANMER, AND JARED MCDONALD. 2021. “At What HUDSON, NATALIE FLOREA, AND MICHAEL J. BUTLER. 2010. “The State of Exper-
Cost? Reexamining Audience Costs in Realistic Settings.” The Journal of imental Research in IR: An Analytical Survey.” International Studies Re-
Politics 83 (1): 8–22. view 12 (2): 165–92.
DAFOE, ALLAN, BAOBAO ZHANG, AND DEVIN CAUGHEY. 2018. “Information Equiv- JENSEN, NATHAN M., BUMBA MUKHERJEE, AND WILLIAM T. BERNHARD. 2014. “Intro-
alence in Survey Experiments.” Political Analysis 26 (4): 399–416. duction: Survey and Experimental Research in International Political
DAVIES, EIRLYS. 1990. “Creativity and Convention: Some Strategies of Name- Economy.” International Interactions 40 (3): 287–304.
Coining.” Language & Communication 10 (3): 207–18. KADMON, NAFTALI. 2000. Toponymy: The Lore, Laws and Language of Geographical
DAVIES, GRAEME A.M., AND ROBERT JOHNS. 2013. “Audience Costs among the Names. New York: Vantage Press.
British Public: The Impact of Escalation, Crisis Type, and Prime Minis- KELLER, JONATHAN, AND YI EDWARD YANG. 2008. “Leadership Style, Decision Con-
terial Rhetoric.” International Studies Quarterly 57 (4): 725–37. text, and the Poliheuristic Theory of Decision Making: An Experimen-
———. 2016. “The Domestic Consequences of International Over- tal Analysis.” Journal of Conflict Resolution 52 (5): 687–712.
Cooperation: An Experimental Study of Microfoundations.” Conflict ———. 2016. “Problem Representation, Option Generation, and Poliheuris-
Management and Peace Science 33 (4): 343–60. tic Theory: An Experimental Analysis.” Political Psychology 37 (5): 739–
DILL, JANINA, AND LIVIA I. SCHUBIGER. 2021. “Attitudes towards the Use of Force: 52.
Instrumental Imperatives, Moral Principles and International Law.” KERTZER, JOSHUA D., AND DUSTIN H. TINGLEY. 2018. “Political Psychology in In-
American Journal of Political Science 65 (3): 612–33. ternational Relations: Beyond the Paradigms.” Annual Review of Political
DRUCKMAN, DANIEL, AND MARA OLEKALNS. 2013. “Motivational Primes, Trust, Science 21: 319–39.
and Negotiators’ Reaction to a Crisis.” Journal of Conflict Resolution 57 KLINK, RICHARD R. 2000. “Creating Brand Names with Meaning: The Use of
(6): 966–90. Sound Symbolism.” Marketing Letters 11 (1): 5–20.
DRUCKMAN, DANIEL, MARA OLEKALNS, AND PHILIP L. SMITH. 2009. “Interpretive KNOEFERLE, KLEMENS, JIXING LI, EMANUELA MAGGIONI, AND CHARLES SPENCE. 2017.
Filters: Social Cognition and the Impact of Turning Points in Negotia- “What Drives Sound Symbolism? Different Acoustic Cues Underlie
tion.” Negotiation Journal 25 (1): 13–40. Sound-Size and Sound-Shape Mappings.” Scientific Reports 7 (1): 5562.
ELSEN, HILKE. 2017. “The Two Meanings of Sound Symbolism.” Open Linguis- KREPS, SARAH, AND SARAH MAXEY. 2018. “Mechanisms of Morality: Sources of
tics 3 (1): 491–99. Support for Humanitarian Intervention.” Journal of Conflict Resolution
FALOMIR-PICHASTOR, JUAN, ANDREA PEREIRA, CHRISTIAN STAERKLÉ, AND FABRIZIO 62 (8): 1814–42.
BUTERA. 2012. “Do All Lives Have the Same Value? Support for Inter- KREPS, SARAH, AND STEPHEN ROBLIN. 2019. “Treatment Format and External Va-
national Military Interventions as a Function of Political System and lidity in International Relations Experiments.” International Interactions
Public Opinion of Target States.” Group Processes & Intergroup Relations 45 (3): 576–94.
15 (3): 347–62. LI, MENGYAO, BERNHARD LEIDNER, HYUN EUH, AND HOON-SEOK CHOI. 2016. “The
FIERKE, K.M. 2002. “Links across the Abyss: Language and Logic in Interna- Contagion of Interstate Violence: Reminders of Historical Interstate
tional Relations.” International Studies Quarterly 46 (3): 331–54. (but Not Intrastate) Violence Increase Support for Future Violence
FINCH, JANET. 1987. “The Vignette Technique in Survey Research.” Sociology against Unrelated Third-Party States.” Personality and Social Psychology
21 (1): 105–14. Bulletin 42 (8): 1003–24.
GARCIA, BLAKE E., AND NEHEMIA GEVA. 2016. “Security versus Liberty in the MCDERMOTT, ROSE.2011a. “New Directions for Experimental Work in Inter-
Context of Counterterrorism: An Experimental Approach.” Terrorism national Relations.” International Studies Quarterly 55 (2): 503–20.
and Political Violence 28 (1): 30–48. ———. 2011b. “Internal and External Validity.” In Cambridge Handbook of
GEVA, NEHEMIA, KARL R. DEROUEN, AND ALEX MINTZ. 1993. “The Political Incen- Experimental Political Science, edited by Arthur Lupia, Donald Greene,
tive Explanation of ‘Democratic Peace’: Evidence from Experimental James Kuklinski, and James Druckman, 27–40. Cambridge: Cambridge
Research.” International Interactions 18 (3): 215–29. University Press.
GEVA, NEHEMIA, AND CHRISTOPHER HANSON. 1999. “Cultural Similarity, Foreign MCDERMOTT, ROSE, AND JONATHAN COWDEN. 2001. “The Effects of Uncertainty
Policy Actions, and Regime Perception: An Experimental Study of In- and Sex in a Crisis Simulation Game.” International Interactions 27 (4):
ternational Cues and Democratic Peace.” Political Psychology 20 (4): 353–80.
803–27. MCDERMOTT, ROSE, JONATHAN COWDEN, AND CHERYL KOOPMAN. 2002. “Framing,
GRAHAM, BRIAN, AND PETER HOWARD. 2012. The Ashgate Research Companion to Uncertainty, and Hostile Communications in a Crisis Experiment.” Po-
Heritage and Identity. London: Ashgate. litical Psychology 23 (1): 133–49.
10 Fictitious Country Names Affect Experimental Results

MCDONALD, JARED. 2020. “Avoiding the Hypothetical: Why ‘Mirror Experi- RUBENZER, TREVOR, AND STEVEN B. REDD. 2010. “Ethnic Minority Groups and
ments’ Are an Essential Part of Survey Research.” International Journal US Foreign Policy: Examining Congressional Decision Making and
of Public Opinion Research 32 (2): 266–83. Economic Sanctions.” International Studies Quarterly 54 (3): 755–77.
MCLEAN, ELENA, AND DWIGHT ROBLYER. 2017. “Public Support for Economic SCHAFER, MARK. 1997. “Images and Policy Preferences.” Political Psychology 18
Sanctions: An Experimental Analysis.” Foreign Policy Analysis 13 (1): (4): 813–29.
233–54. ———. 1999. “Cooperative and Conflictual Policy Preferences: The Effect of
MEDWAY, DOMINIC, AND GARY WARNABY. 2014. “What’s in a Name? Place Brand- Identity, Security, and Image of the Other.” Political Psychology 20 (4):
ing and Toponymic Commodification.” Environment and Planning A: 829–44.
Economy and Space 46 (1): 153–67. SCHWARTZ, JOSHUA A., AND CHRISTOPHER W. BLAIR. 2020. “Do Women Make
MINTZ, ALEX. 2004. “Foreign Policy Decision Making in Familiar and Unfa- More Credible Threats? Gender Stereotypes, Audience Costs, and Cri-
miliar Settings: An Experimental Study of High-Ranking Military Offi- sis Bargaining.” International Organization 70 (4): 872–95.
cers.” Journal of Conflict Resolution 48 (1): 91–104. SIRIN, CIGDEM V. 2011. “Examining the Effects of Political Information and In-
MINTZ, ALEX, AND NEHEMIA GEVA. 1993. “Why Don’t Democracies Fight Each tervention Stages on Public Support for Military Interventions: A Panel
Other? An Experimental Study.” Journal of Conflict Resolution 37 (3): Experiment.” Acta Politica 46 (3): 261–93.
484–503. STEINER, PETER M., CHRISTIANE ATZMÜLLER, AND DAN SU. 2017. “Designing Valid
MINTZ, ALEX, NEHEMIA GEVA, STEVEN B. REDD, AND AMY CARNES. 1997. “The Ef- and Reliable Vignette Experiments for Survey Research: A Case Study

Downloaded from https://academic.oup.com/isq/article/67/1/sqac081/6987670 by guest on 01 February 2023


fect of Dynamic and Static Choice Sets on Political Decision Making: on the Fair Gender Income Gap.” Journal of Methods and Measurement
An Analysis Using the Decision Board Platform.” American Political Sci- in the Social Sciences 7 (2): 52–94.
ence Review 91 (3): 553–66. SVANTESSON, JAN-OLOF. 2017. “Sound Symbolism: The Role of Word Sound in
MINTZ, ALEX, YI YANG, AND ROSE MCDERMOTT. 2011. “Experimental Approaches Meaning.” Wiley Interdisciplinary Reviews: Cognitive Science 8 (5): e1441.
to International Relations.” International Studies Quarterly 55 (2): 493– TERRIS, LESLEY G., AND ORIT TYKOCINSKI. 2016. “Inaction Inertia in Inter-
501. national Negotiations: The Consequences of Missed Opportunities.”
MORSE, STANLEY J., AND KENNETH GERGEN. 1971. “Material Aid and Social At- British Journal of Political Science 46 (3): 701–17.
traction.” Journal of Applied Social Psychology 1 (2): 150–62. TOMZ, MICHAEL, AND JESSICA L.P. WEEKS. 2013. “Public Opinion and the Demo-
O’BRIEN, THOMAS C., BERNHARD LEIDNER, AND LINDA R. TROPP. 2018. “Are They cratic Peace.” American Political Science Review 107 (4): 849–65.
for Us or against Us? How Intergroup Metaperceptions Shape For- TOMZ, MICHAEL, JESSICA L.P. WEEKS, AND KEREN YARHI-MILO. 2020. “Public Opin-
eign Policy Attitudes.” Group Processes & Intergroup Relations 21 (6): ion and Decisions about Military Force in Democracies.” International
941–61. Organization 74 (1): 119–43.
PASEK, JOSH, AND JON A. KROSNICK. 2010. “Optimizing Survey Questionnaire WESTBURY, CHRIS, GEOFF HOLLIS, DAVID M. SIDHU, AND PENNY M. PEXMAN. 2018.
Design in Political Science.” In The Oxford Handbook of American Elections “Weighing up the Evidence for Sound Symbolism: Distributional Prop-
and Political Behavior, edited by Jan E. Leighley, 27–50. Oxford: Oxford erties Predict Cue Strength.” Journal of Memory and Language 99: 122–
University Press. 50.
PREZIOSI, MELISSA, AND JENNIFER COANE. 2017. “Remembering that Big Things WINHAM, GILBERT R., AND H. EUGENE BOVIS. 1978. “Agreement and Breakdown
Sound Big: Sound Symbolism and Associative Memory.” Cognitive Re- in Negotiation: Report on a State Department Training Simulation.”
search: Principles and Implications 2 (1): 10. Journal of Peace Research 15 (4): 285–303.
REDD, STEVEN B. 2002. “The Influence of Advisers on Foreign Policy Decision ———. 1979. “Distribution of Benefits in Negotiation: Report on a State
Making: An Experimental Study.” Journal of Conflict Resolution 46 (3): Department Training Simulation.” Journal of Conflict Resolution 23 (3):
335–64. 408–24.
RENSHON, JONATHAN, ALLAN DAFOE, AND PAUL HUTH. 2018. “Leader Influence YORKSTON, ERIC, AND GEETA MENON. 2004. “A Sound Idea: Phonetic Effects of
and Reputation Formation in World Politics.” American Journal of Polit- Brand Names on Consumer Judgments.” Journal of Consumer Research
ical Science 62 (2): 325–39. 31 (1): 43–51.

You might also like