Professional Documents
Culture Documents
1 s2.0 S0272494421001055 mmc1
1 s2.0 S0272494421001055 mmc1
perceptions scale’
Literature search
A literature search was conducted in PsycINFO using the queries ‘climate change
perception’ and ‘climate change belief’, returning a total of 192 papers. After inspecting the
titles and abstracts, the full texts of 110 papers were examined to extract relevant items.
A database of 234 items from 54 papers was created (see Appendix A). Items from the other
56 papers were not included because the items were duplicates of items previously extracted.
The number of items was further reduced by removing highly similar items and items that did
not match the definition of at least one of the dimensions outlined in the introduction.
Some items were edited according to the following criteria. First, items that referred to
specific locations or groups of people were adjusted such that they would be applicable to any
participant. Second, items that were formatted as a question were rephrased into a statement.
Third, items that referred to ‘global warming’ were changed to ‘climate change’. Finally,
some novel items were added when not enough items had been found; this was particularly
the case for spatial and temporal distance. In total, 67 items were included in the final item
pool that was rated by the experts (Reality: 16 items; Causes: 21 items; Valence of the
Expert review
Participants
papers on climate change perceptions to participate in the expert review session. Of the
The experts were invited to participate via email. The email contained a link to the
online questionnaire which was completed in Qualtrics. After a week, the experts received a
reminder e-mail. The experts were first given a description of the aims of the research and our
definition of each type of climate change perception as described in the introduction. After
providing their informed consent, the experts rated the 67 items of the item pool, split up into
four blocks1 that each presented all items associated with one type of climate change
perception. Experts rated each item on two aspects, namely its relevance to the construct it is
supposed to assess, and its clarity. Both ratings were completed using a 5-point Likert scale (1
Haynes, & Hay, 2014). Finally, experts could provide written comments at the end of each
block of items.
Data analysis
We took the following steps to select the five best items for each type of climate
change perception. Items were ordered by their mean ratings of the experts for both clarity
and relevance. The similarity of the items was also taken into consideration to avoid the
inclusion of highly similar items. Additionally, we decided that each dimension should
include two to three reverse-coded items in order to increase the coverage of each dimension
and to capture it from multiple angles (Weijters & Baumgartner, 2012). There were highly
rated reverse-coded items available for each dimension and the quality of the selected items
Results
1
At this point, we still considered psychological distance as one dimension, and items for spatial and temporal
distance were presented simultaneously. Later, it was decided to split this dimension into two separate
dimensions.
The mean expert ratings for the relevance of the items ranged from 2.57 to 4.57 out of
5 (see Table 1). The mean expert ratings for the clarity of the items ranged from 2.21 to 4.50
out of 5. The following considerations were made in selecting the final items. Firstly, we
decided that the item ‘I am sceptical about the existence of climate change’ should not be
included despite its high scores, as some experts indicated that scepticism refers to a distinct
construct. Secondly, the items ‘People will suffer as a result of the consequences of climate
change’ and ‘The consequences of climate change will overall benefit humankind’ were not
included as these items specifically referred to consequences of climate change for people,
and these items therefore more closely relate to our definition of risk perception of climate
The final selected items and their mean scores for both relevance and clarity are
reported in Table 1. The mean scores for relevance of the selected items ranged from 3.93 to
4.57 out of 5 (Mrelevance = 4.22, SDrelevance = 0.20). The mean scores for clarity of the selected
items ranged from 3.43 to 4.50 out of 5 (Mclarity = 3.97, SDclarity = 0.26). All selected items were
therefore rated by the experts as better than average on both clarity and relevance, and most
For perceived reality, causes, valence of the consequences, and temporal distance,
items were selected without any further editing. For the spatial distance items, we found that
some of the items implied that the consequences of climate change are negative, which
represents potential overlap with the valence of the consequences items (e.g., ‘The region
where I live is vulnerable to the impacts of climate change’). Therefore, words that implied
that the consequences of climate change are negative were changed to words with a more
neutral connotation.
References
Latner, J. D., Mond, J. M., Kelly, M. C., Haynes, S. N., & Hay, P. J. (2014). The loss of
Weijters, B., & Baumgartner, H. (2012). Misresponse to reversed and negated items in
https://doi.org/10.1509/jmr.11.0368
Table S1
Overview of total item pool and results from the expert review session
Mean Mean
Relevance Clarity
Reality
1. Our climate has been changing in the last decades. 4.00 3.00
2. Climate change is not occurring.* 4.36 4.00
3. The evidence for climate change is weak and unconvincing.* 3.86 3.71
4. Climate change is occurring now. 3.71 3.79
5. Climate change is a proven fact. 3.36 3.43
6. I do not believe that climate change is real.* 4.07 3.86
7. Climate change is happening. 4.14 3.93
8. Climate change is a theory that has not yet been proven.* 3.50 2.79
9. Climate change is already underway. 4.00 3.50
10. I believe that climate change is real. 4.29 4.36
11. I have already noticed some signs of climate change. 3.64 4.00
12. Climate change is real. 4.07 3.93
13. The issue of climate change is believable. 2.57 2.21
14. Climate change is a hoax.* 3.64 3.79
15. The world’s climate is changing. 4.29 4.00
16. I am skeptical about the existence of climate change.* 4.14 4.07
Causes
1. Human activities are a major cause of climate change. 4.50 4.50
2. Climate change is mainly due to natural causes.* 4.21 4.14
3. The main causes of climate change are human activities. 4.57 4.21
4. Climate change is caused mostly by natural changes in the 4.29 3.93
environment.*
5. Climate change is mostly caused by human activity. 4.57 4.29
6. Climate change is mostly because of natural changes in the Earth’s 3.50 2.86
environment.*
7. Any warming on earth is the result of natural trends.* 3.64 2.86
8. The climate is always changing and what we are currently observing 3.93 3.64
is just natural fluctuation.*
9. Human carbon dioxide emissions cause climate change. 3.79 3.43
10. Humans are too insignificant to have an appreciable impact on the 3.71 3.29
earth’s climate.*
11. Human activities are accelerating climate change. 3.43 3.64
12. I believe climate change is primarily caused by humans. 4.36 4.21
13. Human activities are to be blamed for climate change. 3.43 2.86
14. Climate change is caused entirely by natural processes.* 4.07 4.14
15. Humans have little control over the forces of nature such as climate 3.36 2.93
change.*
16. I believe that human activity is a substantial cause of climate change. 4.14 3.79
17. Climate change is caused entirely by humans. 3.29 3.21
18. Humans have very little effect on climate change.* 3.93 3.93
19. It is arrogant to assume that humans can influence the earth’s 2.86 3.21
climate.*
20. Any changes in the global climate simply reflect naturally occurring 4.21 3.86
variation.*
21. Climate change is just a natural fluctuation.* 3.71 3.00
Consequences
1. There will be mostly positive consequences of climate change.* 4.07 3.64
2. Climate change will bring about serious negative consequences. 4.21 3.79
3. The seriousness of the consequences of climate change has been 3.93 3.57
exaggerated.*
4. The consequences of climate change will be very serious. 4.07 3.79
5. Climate change will do more harm than good. 3.93 3.86
6. The consequences of climate change will be bad for people across the 3.57 3.71
world.
7. The consequences of climate change will be negative. 3.43 3.07
8. Climate change will have negative consequences for the world. 4.00 3.71
9. The consequences of climate change will be good.* 3.57 3.36
10. Climate change will mostly have positive consequences.* 4.14 4.14
11. Overall, climate change will bring more negative than positive 4.36 4.07
consequences to the world.
12. People will suffer as a result of the consequences of climate change 4.14 4.21
13. The consequences of climate change will be harmful for nature. 4.07 3.64
14. The consequences of climate change will overall benefit 4.21 3.64
humankind.*
Spatial distance
1. My local area will be affected by climate change. 4.50 4.21
2. The region where I live is vulnerable to the impacts of climate 4.29 3.79
change.
3. The consequences of climate change will also take place near me. 3.71 3.07
4. The effects of climate change will be visible close to me. 3.64 3.00
5. The effects of climate change will affect the nearby environment. 3.57 3.00
6. Climate change will only impact locations far away from me.* 4.21 3.79
7. The consequences of climate change will only take place in 3.93 3.57
distant locations.*
8. Climate change will also affect the place where I live. 3.93 3.64
Temporal distance
1. Climate change will not happen in the near future.* 3.57 3.21
2. The effects of climate change will be felt very soon. 3.93 3.43
3. The consequences of climate change will soon be experienced. 3.64 3.14
4. The consequences of climate change will only be experienced in 4.00 3.93
the far future.*
5. The consequences of climate change will not be felt during the next 3.93 3.43
decades.*
6. The consequences of climate change are visible now. 4.43 4.21
7. It will be a long time before the consequences of climate change 4.07 3.93
are felt.*
8. Only future generations will experience the consequences of 4.21 3.79
climate change.*
Note: items in bold are items that were selected for inclusion in Study 1. * = reverse-coded
items.
Table S2
Item pool of 234 items from 54 papers
First author and Item Answering scale Potential subscale
year of
publication
Alcock 2017 Thinking about the Climate change will Valence of the
effects of climate have an impact on consequences
change, which of the other countries, but
following best not on the UK (0);
describes your Climate change is not
views? happening/will not
have an impact on the
UK or other countries
(0); Climate change
will have less of an
impact on the UK
than on other
countries (1); Climate
change will have as
much of an impact on
the UK as on other
countries (2)
Alcock 2017 Thinking about the Climate change will Valence of the
effects of climate not have a real impact consequences
change, which of the in my lifetime, but
following best will have a real
describes your impact on future
views? generations (0);
Climate change is not
happening/will never
have a real impact (0);
Climate change is not
yet having a real
impact, but will do in
my lifetime (1);
Climate change is
already having a real
impact (2)
Alcock 2017 How concerned are Very unconcerned Valence of the
you about climate (0); Fairly consequences
change? unconcerned (0);
Neither concerned nor
unconcerned (0);
Fairly concerned (1);
Very concerned (2)
Alcock 2017 Do you personally ‘Extensive and long- Valence of the
believe: lasting flooding consequences
caused by climate
change is likely to
take place in the UK -
No’ & ‘Extensive and
long-lasting flooding
caused by climate
change is likely to
take place in low-
lying countries like
Bangladesh or the
Netherlands - No’ (0);
‘Extensive and long-
lasting flooding
caused by climate
change is likely to
take place in the UK -
No’ & ‘Extensive and
long-lasting flooding
caused by climate
change is likely to
take place in low-
lying countries like
Bangladesh or the
Netherlands - Yes’
(1); ‘Extensive and
long-lasting flooding
caused by climate
change is likely to
take place in the UK -
Yes’ (2)
Alcock 2017 Do you personally Climate change is Valence of the
believe likely to cause severe consequences
food shortages in the
UK - No’ & ‘Climate
change is likely to
cause severe food
shortages in places
like Africa and India -
No’ (0); ‘Climate
change is likely to
cause severe food
shortages in the UK -
No’ & ‘Climate
change is likely to
cause severe food
shortages in places
like Africa and India -
Yes’(1); ‘Climate
change is likely to
cause severe food
shortages in the UK -
Yes’ (2)
Alcock 2017 Do you personally People in the UK will Temporal distance
believe: be affected by climate
change in the next 30
years - No’ & ‘People
in the UK will be
affected by climate
change in the next
200 years - No’ (0);
‘People in the UK
will be affected by
climate change in the
next 30 years - No’ &
‘People in the UK
will be affected by
climate change in the
next 200 years - Yes’
(1); ‘People in the UK
will be affected by
climate change in the
next 30 years -Yes’
(2)
Arbuckle 2015 There is increasing Climate change is not Reality and causes
discussion about occurring. There is
climate change and not sufficient
its potential impacts. evidence to know
Please select the with certainty whether
statement that best climate change is
reflects your beliefs occurring.
about climate Climate change is
change. occurring and it is
caused mostly by
natural changes in the
environment. Climate
change is occurring
and it is caused
equally by natural
changes in the
environment and
human activities.
Climate change is
occurring, and I is
caused mostly by
human activities.
Arbuckle 2015 I am concerned Strongly disagree, Valence of the
about the potential disagree, uncertain, consequences
impacts of climate agree, strongly agree.
change on Iowa’s
agriculture.
Arbuckle 2015 I am concerned Strongly disagree, Valence of the
about the potential disagree, uncertain, consequences
impacts of climate agree, strongly agree.
change on my farm
operation.
Arbuckle 2015 I believe that Strongly disagree, Valence of the
extreme weather disagree, uncertain, consequences
events will happen agree, strongly agree.
more frequently in
the future.
Arbuckle 2015 Climate change is Strongly disagree, Valence of the
not a big issue disagree, uncertain, consequences
because human agree, strongly agree.
ingenuity will enable
us to adapt to
changes.
Benjamin 2017 [GW/CC] is Strongly disagree, Temporal distance
occurring now mildly disagree,
unsure, mildly agree,
strongly agree.
Benjamin 2017 I am quite sure that Strongly disagree, Temporal distance
[GW/CC] is mildly disagree,
occurring now unsure, mildly agree,
strongly agree
Benjamin 2017 I do not believe that Strongly disagree, Reality
[GW/CC] is real.* mildly disagree,
unsure, mildly agree,
strongly agree
Benjamin 2017 The evidence for Strongly disagree, Reality
[GW/CC] is weak mildly disagree,
and unconvincing.* unsure, mildly agree,
strongly agree
Benjamin 2017 I have already Strongly disagree, Temporal distance
noticed some signs mildly disagree,
of [GW/CC]. unsure, mildly agree,
strongly agree
Benjamin 2017 It seems to me that Strongly disagree, Valence of the
temperature is mildly disagree, consequences
warmer now than in unsure, mildly agree,
years before strongly agree
Benjamin 2017 It seems to me that Strongly disagree, Temporal distance
weather patterns mildly disagree,
have changed unsure, mildly agree,
compared to when I strongly agree
was a child
Benjamin 2017 Changes in the Strongly disagree, Temporal distance
climate have mildly disagree,
impacted my life unsure, mildly agree,
already strongly agree
Benjamin 2017 [GW/CC] is mainly Strongly disagree, Causes
due to natural mildly disagree,
causes, not human unsure, mildly agree,
activity.* strongly agree
Benjamin 2017 The main causes of Strongly disagree, Causes
[GW/CC] are human mildly disagree,
activities. unsure, mildly agree,
strongly agree
Benjamin 2017 [GW/CC] is merely Strongly disagree, Causes
a natural fluctuation, mildly disagree,
not caused by unsure, mildly agree,
human activity. strongly agree
Benjamin 2017 I am quite sure that Strongly disagree, Causes
human activities are mildly disagree,
responsible for unsure, mildly agree,
[GW/CC]. strongly agree
Benjamin 2017 There will be some Strongly disagree, Valence of the
positive mildly disagree, consequence
consequences of unsure, mildly agree,
[GW/CC] for the strongly agree
environment.*
Benjamin 2017 The consequences of Strongly disagree, Valence of the
[GW/CC] will be mildly disagree, consequence
harmful for the unsure, mildly agree,
environment. strongly agree
Benjamin 2017 [GW/CC] will bring Strongly disagree, Valence of the
about some serious mildly disagree, consequence
negative unsure, mildly agree,
consequences strongly agree
Benjamin 2017 The consequences of Strongly disagree, Valence of the
[GW/CC] will be mildly disagree, consequence
more positive than unsure, mildly agree,
negative overall.* strongly agree
Blennow 2016 Do you believe that Yes, definitely. Valence of the
the climate is Yes, probably. Do not consequence
changing to such an know. Probably not.
extent that it will Definitely not.
substantially affect
your forest?
Blennow 2016 Have you Yes, definitely. Valence of the
experienced any Yes, probably. Do not consequence
extreme weather know. Probably not.
conditions or change Definitely not.
in climate that you
interpret as caused
by long-term, global
climate change?
Bloodhart 2015 Is climate change Yes, no, don’t know. Reality
happening?
Bloodhart 2015 Assuming climate mostly caused by Causes
change humans, caused by
is happening, do you both humans and
think it is... changes in the
environment, mostly
caused by natural
changes in the
environment, caused
by other things, or
none of the above
because climate
change isn’t
happening
Bloodhart 2015 when, if ever, do “now”, “in 10 years”, Temporal distance
you think climate “in 25 years”, “in 50
change will harm years”, “in 100
people in Virginia? years”,or “never”
Bloodhart 2015 Will climate change Not at all – Great Valence of the
harm you deal. consequence/Spatial
personally? distance
Borick 2010 From what you’ve Yes, No, Not sure Reality
read and heard, is
there solid evidence
that the average
temperature on Earth
has been getting
warmer over the past
four decades?
Borick 2010 Is the Earth getting Human causes, Causes
warmer because of natural causes, about
human activity such equal, not sure
as burning fossil
fuels or mostly
because of natural
patterns in the
Earth’s
environment?
Borick 2010 There is not enough Strongly agree, Reality
scientific evidence somewhat agree,
to support claims somewhat disagree,
that the Earth is strongly disagree, not
getting warmer. sure
Borick 2010 Scientists are Strongly agree, Reality
overstating evidence somewhat agree,
about global somewhat disagree,
warming for their strongly disagree, not
own interests sure
Borick 2010 The Earth’s Strongly agree, Causes
atmosphere is too somewhat agree,
large for man’s somewhat disagree,
activity to change strongly disagree, not
the climate. sure
Borick 2010 Any recent warming Strongly agree, Causes
on Earth is the result somewhat agree,
of natural trends and somewhat disagree,
not the activities of strongly disagree, not
man sure
Borick 2010 The media is Strongly agree, Reality
overstating the somewhat agree,
evidence about somewhat disagree,
global warming strongly disagree, not
sure
Bostrom 2012 ‘‘How likely do you ‘extremely unlikely’’ Causes
think it is that to ‘‘extremely likely.
human actions have
changed global
climate?
Bradley 2017 I am certain that Unknown Reality
climate change is
happening.
Bradley 2017 Climate change will Unknown Valence of the
have notable consequence/Spatial
negative impacts on distance
my health (over the
next 25 years).
Bradley 2017 How concerned are Unknown Valence of the
you, if at all, about consequence
climate change?
Brenkert-Smith Climate change has Strongly agree to Valence of the
2015 increased the risk of strongly disagree consequences/Spatial
wildifres in Boulder distance
and Larimer
Counties
Brenkert-Smith I am sceptical about Strongly agree to Reality
2015 the existence of strongly disagree
climate change
Brenkert-Smith Climate change and Strongly agree to Valence of the
2015 wildfire risk are not strongly disagree consequences
related
Brody 2017 GW and CC will Strongly agree – Valence of the
have a negative Strongly disagree consequence/Spatial
impact on my distance
health/financial
situation/local
environment in the
next 25 years.
Carrico 2015 How likely do you (1 = extremely Temporal distance
think it is that the unlikely, 7 =
climate in the U.S. extremely likely)
will change
significantly over
the next 50 years?
Carrico 2015 If the climate in the (1 = extremely Valence of the
U.S. changed positive, 4 = neutral, 7 consequence
significantly over = extremely negative)
the next 50 years,
how positive or
negative would the
impacts be?
Chang 2016 How risky do you 1 = not at all risky, 7 Valence of the
perceive the = very risky consequence
consequences of
climate change to
yourself/others/the
next generation.
Clayton 2014 How much do you Unknown Valence of the
think global consequence/Spatial
warming will harm distance
you personally?
Clayton 2014 Do you think that Unknown Reality
global warming is
happening?
Cook 2016 The climate is Strongly disagree – Causes
always changing and Strongly agree
what we are
currently observing
is just natural
fluctuation.
Cook 2016 Most of the warming Strongly disagree – Causes
over the last 50 Strongly agree
years is due to the
increase in
greenhouse gas
concentrations
Cook 2016 The burning of fossil Strongly disagree – Causes
fuels over the last 50 Strongly agree
years has caused
serious damage to
the planet’s climate
Cook 2016 Human CO2 Strongly disagree – Causes
emissions cause Strongly agree
climate change.
References
Alcock, I., White, M. P., Taylor, T., Coldwell, D. F., Gribble, M. O., Evans, K. L., … Fleming, L.
E. (2017). ‘Green’ on the ground but not in the air: Pro-environmental attitudes are related to
household behaviours but not discretionary air travel. Global Environmental Change, 42,
136–147. https://doi.org/10.1016/j.gloenvcha.2016.11.005
Arbuckle, J. G., Morton, L. W., & Hobbs, J. (2015). Understanding Farmer Perspectives on
Climate Change Adaptation and Mitigation: The Roles of Trust in Sources of Climate
Information, Climate Change Beliefs, and Perceived Risk. Environment and Behavior, 47(2),
205–234. https://doi.org/10.1177/0013916513503832
Benjamin, D., Por, H.-H., & Budescu, D. (2017). Climate Change Versus Global Warming: Who
Is Susceptible to the Framing of Climate Change? Environment and Behavior, 49(7), 745–
770. https://doi.org/10.1177/0013916516664382
Blennow, K., Persson, J., Persson, E., & Hanewinkel, M. (2016). Forest Owners’ Response to
Climate Change: University Education Trumps Value Profile. PLOS ONE, 11(5), e0155137.
https://doi.org/10.1371/journal.pone.0155137
Bloodhart, B., Maibach, E., Myers, T., & Zhao, X. (2015). Local Climate Experts: The Influence
e0141526. https://doi.org/10.1371/journal.pone.0141526
Borick, C. P., & Rabe, B. G. (2010). A Reason to Believe: Examining the Factors that Determine
Bostrom, A., O’Connor, R. E., Böhm, G., Hanss, D., Bodi, O., Ekström, F., … Sælensminde, I.
(2012). Causal thinking and support for climate change policies: International survey findings.
https://doi.org/10.1016/j.gloenvcha.2011.09.012
Bradley, G. L., & Reser, J. P. (2017). Adaptation processes in the context of climate change: A
https://doi.org/10.1007/s10818-016-9231-x
Brenkert-Smith, H., Meldrum, J. R., & Champ, P. A. (2015). Climate change beliefs and hazard
mitigation behaviors: Homeowners and wildfire risk. Environmental Hazards, 14(4), 341–
360. https://doi.org/10.1080/17477891.2015.1080656
Brody, S. D., Lee, Y., & Highfield, W. E. (2017). Household adjustment to flood risk: A survey of
coastal residents in Texas and Florida, United States. Disasters, 41(3), 566–586.
https://doi.org/10.1111/disa.12216
Carrico, A. R., Truelove, H. B., Vandenbergh, M. P., & Dana, D. (2015). Does learning about
Chang, J. J., Kim, S.-H., Shim, J. C., & Ma, D. H. (2016). Who Is Responsible for Climate
Change? Attribution of Responsibility, News Media, and South Koreans’ Perceived Risk of
https://doi.org/10.1080/15205436.2016.1180395
Clayton, S., Luebke, J., Saunders, C., Matiasek, J., & Grajal, A. (2014). Connecting to nature at the
Cook, J., & Lewandowsky, S. (2016). Rational Irrationality: Modeling Climate Change Belief
https://doi.org/10.1111/tops.12186
Davidson, D. J., & Haan, M. (2012). Gender, political ideology, and climate change beliefs in an
study on how to involve consumers in a transition to a low-carbon society. Appetite, 98, 19–
27. https://doi.org/10.1016/j.appet.2015.12.001
de Boer, J., Wouter Botzen, W. J., & Terpstra, T. (2014). Improving Flood Risk Communication
DeBono, R., Vincenti, K., & Calleja, N. (2012). Risk communication: Climate change as a human-
health threat, a survey of public perceptions in Malta. The European Journal of Public Health,
Deng, Y., Wang, M., & Yousefpour, R. (2017). How do people’s perceptions and climatic disaster
experiences influence their daily behaviors regarding adaptation to climate change? — A case
study among young generations. Science of The Total Environment, 581–582, 840–847.
https://doi.org/10.1016/j.scitotenv.2017.01.022
Deryugina, T., & Shurchkov, O. (2016). The Effect of Information Provision on Public Consensus
https://doi.org/10.1371/journal.pone.0151469
Dickinson, J. L., McLeod, P., Bloomfield, R., & Allred, S. (2016). Which Moral Foundations
Predict Willingness to Make Lifestyle Changes to Avert Climate Change in the USA? PLOS
Ekholm, S., & Olofsson, A. (2017). Parenthood and Worrying About Climate Change: The
Limitations of Previous Approaches: Parenthood and Worrying About Climate Change. Risk
European Social Survey. (2016). ESS Round 8 Source Questionnaire. London: ESS ERIC c/o City
University London.
Fusco, E., Snider, A., & Luo, S. (2012). Perception of global climate change as a mediator of the
https://doi.org/10.1080/13504622.2012.672965
Greenberg, M. R., Weiner, M. D., Noland, R., Herb, J., Kaplan, M., & Broccoli, A. J. (2014).
Public Support for Policies to Reduce Risk After Hurricane Sandy: Policies to Reduce Risk
Heath, Y., & Gifford, R. (2006). Free-Market Ideology and Environmental Degradation: The Case
https://doi.org/10.1177/0013916505277998
Hennes, E. P., Ruisch, B. C., Feygina, I., Monteiro, C. A., & Jost, J. T. (2016). Motivated recall in
the service of the economic system: The case of anthropogenic climate change. Journal of
Hine, D. W., Reser, J. P., Phillips, W. J., Cooksey, R., Marks, A. D. G., Nunn, P., … Glendon, A.
https://doi.org/10.1016/j.jenvp.2013.08.006
Hoffarth, M. R., & Hodson, G. (2016). Green on the outside, red on the inside: Perceived
bias, perceived causes, and policy attitudes. Journal of Environmental Psychology, 36, 27–36.
https://doi.org/10.1016/j.jenvp.2013.07.003
Johnson, D. R. (2017). Bridging the political divide: Highlighting explanatory power mitigates
https://doi.org/10.1016/j.jenvp.2017.04.008
Kaklamanou, D., Jones, C. R., Webb, T. L., & Walker, S. R. (2015). Using Public Transport Can
Make Up for Flying Abroad on Holiday: Compensatory Green Beliefs and Environmentally
https://doi.org/10.1177/0013916513488784
Kittipongvises, S., & Mino, T. (2013). The Influence of Psychological Factors on Global Climate
Change Perceptions Held by the Rural Citizens of Thailand. Ecopsychology, 5(2), 126–135.
https://doi.org/10.1089/eco.2012.0080
Le Dang, H., Li, E., Nuberg, I., & Bruwer, J. (2014). Farmers’ assessments of private adaptive
measures to climate change and influential factors: A study in the Mekong Delta, Vietnam.
Leiserowitz, A. A., Maibach, E. W., Roser-Renouf, C., Smith, N., & Dawson, E. (2012).
Climategate, Public Opinion, and the Loss of Trust. American Behavioral Scientist, 20.
Leviston, Z., & Walker, I. (2012). Beliefs and Denials About Climate Change: An Australian
Maibach, E. W., Roser-Renouf, C., & Leiserowitz, A. A. (2009). Global warming’s six americas
Mäkiniemi, J.-P., & Vainio, A. (2013). Moral intensity and climate-friendly food choices. Appetite,
Milfont, T. L., Milojev, P., Greaves, L. M., & Sibley, C. G. (2015). Socio-structural and
44(1), 14.
Nolan, J. M. (2010). “An Inconvenient Truth” Increases Knowledge, Concern, and Willingness to
https://doi.org/10.1177/0013916509357696
O’Connor, R. E., Bard, R. J., & Fisher, A. (1999). Risk Perceptions, General Environmental
Beliefs, and Willingness to Address Climate Change. Risk Analysis, 19(3), 461–471.
https://doi.org/10.1111/j.1539-6924.1999.tb00421.x
Poortinga, W., Spence, A., Whitmarsh, L., Capstick, S., & Pidgeon, N. F. (2011). Uncertain
climate: An investigation into public scepticism about anthropogenic climate change. Global
Reynolds, T. W., Bostrom, A., Read, D., & Morgan, M. G. (2010). Now What Do People Know
About Global Climate Change? Survey Studies of Educated Laypeople: Now What Do People
https://doi.org/10.1111/j.1539-6924.2010.01448.x
Rosentrater, L. D., Sælensminde, I., Ekström, F., Böhm, G., Bostrom, A., Hanss, D., & O’Connor,
Saleh Safi, A., James Smith, W., & Liu, Z. (2012). Rural Nevada and Climate Change:
Vulnerability, Beliefs, and Risk Perception: Vulnerability and Climate Change. Risk Analysis,
Schuldt, J. P., & Roh, S. (2014). Of Accessibility and Applicability: How Heat-Related Cues
Affect Belief in “Global Warming” Versus “Climate Change”. Social Cognition, 32(3), 217–
238. https://doi.org/10.1521/soco.2014.32.3.217
Shao, W., & Goidel, K. (2016). Seeing is Believing? An Examination of Perceptions of Local
Weather Conditions and Climate Change Among Residents in the U.S. Gulf Coast. Risk
People Question Human Causation? Analyses of Social Issues and Public Policy, 13(1), 245–
261. https://doi.org/10.1111/asap.12008
Sinatra, G. M., Kardash, C. M., Taasoobshirazi, G., & Lombardi, D. (2012). Promoting attitude
change and expressed willingness to take action toward climate change in college students.
Soliman, M., & Wilson, A. E. (2017). Seeing change and being change in the world: The
relationship between lay theories about the world and environmental intentions. Journal of
Spence, A., Poortinga, W., & Pidgeon, N. (2012). The Psychological Distance of Climate Change.
Stanley, S. K., Wilson, M. S., Sibley, C. G., & Milfont, T. L. (2017). Dimensions of social
Taylor, A., de Bruin, W. B., & Dessai, S. (2014). Climate Change Beliefs and Perceptions of
Weather-Related Changes in the United Kingdom: Climate Change Beliefs. Risk Analysis,
Whitmarsh, L. (2008). Are flood victims more concerned about climate change than other people?
The role of direct experience in risk perception and behavioural response. Journal of Risk
Table S4
Comparing the factor structure of the scale to more parsimonious models (Study 1)
difference 5
factor model
Benchmark (Hu & >.95 < .06 < .08 N/A N/A N/A
Bentler, 1999)
Four factor model .929 .088 .064 11908.635 12038.919 χ2 (4) = 58.73, p
and Consequences
Four factor model .923 .092 .070 11905.449 12035.733 χ2 (4) = 96.72, p
Consequences)
Four factor model .933 .085 .039 11853.596 11983.880 χ2 (4) = 100.88,
Consequences and
Spatial distance)
Three factor model .894 .105 .053 12042.947 12161.735 χ2 (7) = 149.89,
Consequences,
Spatial distance,
Two factor model .762 .155 .070 12809.333 12920.457 χ2 (9) = 239.09,
Causes,
Consequences, and
collapse Spatial
distance and
Temporal Distance)
Comparing the factor structure of the scale to more parsimonious models (Study 2)
model
Benchmark (Hu & >.95 < .06 < .08 N/A N/A N/A
Bentler, 1999)
factors)
dimensional items)
Consequences,
Spatial distance,
Predictive validity
Mitigation behaviour .27 .30 .30 -.31 -.30
Adaptation behaviour .19 .18 .18 -.22 -.15
Mitigation policy support .66 .71 .68 -.58 -.54
Adaptation policy support .57 .56 .56 -.48 -.41
Study 2
Convergent validity Reality Cause Consequence Spatial Temporal
NEP .51 .58 .57 .54 -.63
Negative affect .74 .68 .61 .63 -.53
Risk Perception .82 .70 .68 .70 -.59
Predictive validity
Mitigation behaviour .30 .26 .28 .30 -.32
Adaptation behaviour .09 .04 .07 .10 .02
Mitigation policy support .68 .66 .59 .62 -.51
Adaptation policy support .65 .50 .51 .54 -.41
Study 3
Convergent validity Reality Cause Consequence
Biospheric values .24 .24 .28
Predictive validity
Aspiration reduce energy .26 .22 .30
Aspiration renewable energy .35 .33 .37
Acceptability wind energy .18 .27 .24
Acceptability solar energy .31 .28 .31
Table S7
Post-hoc Mann Whitney U tests to test discriminant validity for the single-items version of the scale in Studies 1, 2, and 3.
Men Women Democrats Republicans
Mean SD Mean SD U p 95% CI Mean SD Mean SD U p 95% CI
Study 1
Reality 6.02 1.33 5.94 1.53 15136 .41 [-0.23, 0.38] 6.56 0.77 4.91 1.78 10580 < .01 [1.23, 2.07]
Causes 5.37 1.72 5.53 1.60 13669 .25 [-0.52, 0.19] 6.04 1.11 4.18 2.03 9381 < .01 [1.35, 2.37]
Consequences 5.72 1.33 5.74 1.54 13494 .18 [-0.33, 0.29] 6.20 1.16 4.75 1.57 9427 < .01 [1.05, 1.87]
Spatial distance 2.59 1.48 2.43 1.38 15046 .19 [-0.15, 0.46] 2.02 1.06 3.51 1.78 3001 < .01 [-1.93, -1.03]
Temporal distance 2.75 1.62 2.50 1.73 15942 .03 [-0.11, 0.61] 2.13 1.48 3.72 1.86 3029 < .01 [-2.08, -1.09]
Study 2
Reality 6.26 1.14 6.08 1.38 15432 .80 [-0.09, 0.45] 6.51 0.90 5.23 1.77 9447 < .01 [0.85, 1.72]
Causes 5.75 1.50 5.67 1.49 14294 .76 [-0.24, 0.41] 6.08 1.21 4.71 1.98 7849 < .01 [0.84, 1.90]
Consequences 6.02 1.29 5.97 1.26 14253 .74 [-0.23, 0.32] 6.28 1.15 5.31 1.46 7779 < .01 [0.56, 1.38]
Spatial distance 5.78 1.28 5.86 1.24 13214 .27 [-0.36, 0.19] 6.10 1.10 5.11 1.54 7663 < .01 [0.56, 1.40]
Temporal distance 3.06 1.84 2.60 1.63 15717 .01 [0.09, 0.84] 2.45 1.67 3.89 1.77 2980 < .01 [-1.95, -0.93]
Study 3
Reality 6.20 1.01 6.19 1.05 126667 .45 [-0.13, 0.13]
Causes 5.26 1.35 5.47 1.45 125842 .01 [0.04, 0.39]
Consequences 5.68 1.24 5.81 1.14 122054 .08 [-0.02, 0.28]
Note: Corrected alpha level for tests is .05/5 = .01 in Study 1 and Study 2, and 0.05/3 = .017 in Study 3.
Measurement invariance across age groups
Upon a reviewers’ request, we tested whether the scale was measurement invariant across
different age groups. We compared the age groups 18-34 and 35+ in studies 1 and 2, since
there were very few respondents over the age of 65. In Study 3, we compared the groups 18-
34, 35-64, and 65+.
In Study 1, the fit of the model was excellent if both age groups were considered separately
(omnibus Satorra-Bentler scaled χ2 (134) = 150.34 , χ2/df = 1.12 , p = .16, scaled CFI = .993,
scaled RMSEA = .027, 90% CI [0.00, 0.044], SRMR = .026). There was no evidence of
measurement non-invariance across factor loadings (χ2(9) = 4.16, p = .90), intercepts (χ2(9) =
13.06, p = .16), or residuals (χ2(14) = 23.53, p = .05) between the different age groups.
In Study 2, the fit of the model was also excellent if age groups were considered separately
(omnibus Satorra-Bentler scaled χ2 (448) = 543.28, χ2/df =1.21, p = .001, scaled CFI = .982,
scaled RMSEA = .036, 90% CI [.026, .044], SRMR = .038). There was no evidence of
measurement non-invariance across factor loadings (χ2(16) = 24.70 , p = .08). There was
evidence of non-invariance of intercepts (χ2(16) = 39.75 , p < .001), but the change in model
fit was marginal (ΔCFI = -.002, ΔRMSEA = .002). Moreover, the difference between the
model constraining intercepts and factor loadings and the model constraining only factor
loadings was non-significant after constraints on the intercepts for one item (“I believe that
climate change is real“) were removed (χ2(15) = 23.78, p = .07), showing that the scale was at
least partially invariant. There was also evidence of non-invariance of the residuals (χ2(25) =
52.65, p < .01), with some changes to the model fit indices (ΔCFI = -.022, ΔRMSEA = .015).
The difference between the model constraining residuals, intercepts, factor loadings and the
model constraining only intercepts and factor loadings was only marginally significant after
constraints on the residuals for five items (Reality 1, Spatial Proximity 2, Spatial Distance 2,
Temporal distance 1, Temporal distance 3) were removed, (χ2(19) = 30.59 p = .045),
suggesting that the model was at least partially invariant.
In Study 3, the fit of the model was good if age groups (18-34, 35-64, and 65+) were
considered separately (omnibus Satorra-Bentler scaled χ2(51) = 146.62, χ2/df =2.87, p < .001,
scaled CFI = .960, scaled RMSEA = .080, 90% CI [.067, .093], SRMR = .045). There was no
evidence of measurement non-invariance across factor loadings (χ2(10) = 10.23, p = .42),
intercepts (χ2(10) = 12.58, p = .25), or residuals (χ2(16) = 8.43, p = .94) between the different
age groups.