You are on page 1of 9

Journal of Cleaner Production 172 (2018) 4110e4118

Contents lists available at ScienceDirect

Journal of Cleaner Production


journal homepage: www.elsevier.com/locate/jclepro

Perceptions and valuation of GM food: A study on the impact and


importance of information provision
Marieta Valente a, *, Cristina Chaves b
a ~o and NIMA, Universidade do Minho, Campus de Gualtar, 4710-057 Braga, Portugal
Escola de Economia e Gesta
b
Faculdade de Economia, Universidade do Porto, Rua Dr. Roberto Frias, 4200-464 Porto, Portugal

a r t i c l e i n f o a b s t r a c t

Article history: Given the scientific uncertainties and differing arguments for and against genetically modified food,
Received 3 May 2016 perceptions and valuation may depend on information about their different and conflicting potential
Received in revised form effects. In this study we explore generic attitudes towards genetically modified organisms, particularly in
13 December 2016
food, and adopt an economic contingent valuation approach to highlight the relevance of information
Accepted 6 February 2017
Available online 7 February 2017
provision. The study focuses on young college students, who are more scientifically informed than the
rest of the population. It explores perceptions and economic valuation of genetically modified food, and
exposes respondents randomly to three information treatments concerning genetically modified or-
Keywords:
GM food
ganisms’ impacts (negative, positive or mixed). Applying the contingent valuation methodology allows
Consumers’ perceptions us to expose individuals to a situation where they can express their willingness to accept a genetically
Public awareness modified ingredient in exchange for lower prices. We observe that exposing respondents to critical ar-
Contingent valuation guments about this kind of food negatively affects their economic valuations, whereas positive or mixed
Information provision information have no impact. Albeit the conclusions are limited in terms of generalizability to the rest of
Public policy the population, the results suggest there may still be scope for information provision. Furthermore, both
policy-makers and firms may benefit from a more informed public. Policy-makers can gauge public
opinion to legitimize policy options and firms can shape market decisions based on more informed and
stable consumer preferences.
© 2017 Elsevier Ltd. All rights reserved.

1. Introduction GMOs can play within the sustainability challenge and, on the other
hand, the role public policy should play in relation to GMOs. Public
The ongoing sustainability debate highlights how sustainable policy in terms of information is not likely to smooth the relation
consumption and production are connected. The fact is that many between the production side and demand. In fact, information
advances have occurred on the supply side, and which in turn also policies can draw consumers away from GMOs and there is even
underlines the key role consumers can play (Blok et al., 2015). The evidence that labelling policies can influence the perception of
relation between sustainable consumption and production is often safety of genetically modified (GM) food (Costanigro and Lusk,
virtuous and there is scope for the role of government in mutually 2014; Kolodinsky, 2008; Lusk and Rozan, 2008).
reinforcing it where there are, for example, system failures such as In the meantime, at least in the European Union (EU), the pre-
in terms of information (Stevens, 2010). In the broader sustain- cautionary principle (PP) has been invoked in relation to GMOs,
ability debate, public policy can indeed foster the relation between which has slowed down GMOs adoption. However, as of January
production and consumption. 2015 rather than an EU-wide policy, each member state can decide
In the specific case of genetically modified organisms (GMOs), whether to continue with the restrictions that stem from the
this relation has not been straightforward in most cases (Pino et al., application of the PP.
2016). On the one hand, there is no consensus about the role that At this stage it is relevant for each member state to understand
the acceptability of GMOs within their borders. Studies show
wariness of GMOs in Europe (e.g. European Commission, 2010) and
* Corresponding author.
research has highlighted that providing different types of addi-
E-mail addresses: mvalente@eeg.uminho.pt (M. Valente), cristina.chaves@fep. tional information to survey respondents can affect attitudes and
up.pt (C. Chaves). behavior (e.g. Rousu et al., 2007). As such, we argue the importance

http://dx.doi.org/10.1016/j.jclepro.2017.02.042
0959-6526/© 2017 Elsevier Ltd. All rights reserved.
M. Valente, C. Chaves / Journal of Cleaner Production 172 (2018) 4110e4118 4111

of national public policies informing the public in general and po- Our sample is at the initial stage more supportive of GMOs than
tential consumers as to the certainties and uncertainties, costs and average respondents in the Eurobarometer 1 on biotechnology
benefits of GMOs. An informed population can make informed (European Commission, 2010), and while positive and mixed in-
choices concerning not only national policies, such as maintaining formation has no statistically significant effect on valuations, we
the restrictions or not, supporting more or less permissive regula- find that negative information reduces the acceptability of GM
tion, but also consumption choices in the marketplace. Further- food. Given these results for this particular group, we argue that
more, informed consumers with stable preferences can make there is scope for public policy to engage the public in terms of
certain investments by firms in (non-)GMOs more or less viable. information provision. This should occur before gauging public
In this study we propose to contribute to this debate by opinion and before defining national public policy towards GMOs,
exploring the potential impacts of information provision so as to both to legitimize national options towards GMOs and to empower
argue for a widespread information policy. In this research we potential consumers in the marketplace. As Scholderer and Frewer
analyze generic attitudes and perceptions towards GMOs, and (2003, p. 125) argue, this should not be a matter of “attempting to
move beyond opinions towards market behavior, by using the well- align their views with those held by expert communities” but
established economics technique of non-market valuation of GM rather of “engaging the public in the debate”.
attributes in food. A questionnaire was carried out in an EU member This article is organized as follows. Section 2 briefly contextu-
state (Portugal) to explore, firstly, perceptions and attitudes to- alizes the topic of GMOs in terms of policy issues and then discusses
wards GMOs, and, secondly, economic value associated with GM the relevance of applying economic valuation techniques con-
food. Thirdly, and based on other studies about GMOs, we examine cerning GMOs. In section 3, we present the methodology adopted
the impact of exposing respondents to information about GMOs and discuss the different parts of the questionnaire administered.
(negative, positive or mixed - that is, combining both negative and Section 4 describes the sample in terms of attitudes and percep-
positive arguments) to establish whether those perceptions and tions and presents the results from the hypothetical valuation
values are prone to persuasion. scenario. We then explore the impact of the different information
With this study we address several issues which we deem treatments on valuation. Finally, in section 5 results are discussed
relevant for the current debate about GMOs. First we aim to and section 6 concludes.
contribute to the literature on controlled impacts of information
about GMOs, by exposing a specific group of individuals to infor- 2. Framework
mation about their merits, their demerits or both (mixed infor-
mation). Additionally, the impact of negative or mixed information 2.1. GMOs and public opinion within a policy context
provision has been addressed in the literature much less frequently
than supportive information. GMOs in general and GM food in particular represent a
We hypothesize that attitudes and economic acceptability of controversial topic within the scientific community and in terms of
GMOs are not definitive and put forward the hypotheses that public opinion. Scholderer (2005, p. 263) summarizes the recent
exposing individuals to negative information on GMOs can poten- history of GMOs as “first they were hailed as a triumph of modern
tially decrease their acceptance, whereas exposing them to positive science, then abandoned as a threat to consumer health and the
information may increase their acceptance. As for mixed informa- environment, now resurrected and about to enter the European
tion, as it presents arguments on both sides, we do not expect it to food markets”. In terms of policy, different countries have adopted
influence respondents. different regulatory strategies concerning the release of GMOs
Secondly, we focus on a particular group rather than the whole (Vigani and Olper, 2013) often invoking contrasting arguments,
population. The present study was carried out with a specific group with some countries imposing mandatory labelling policies, while
of people, namely university students between the ages of 18e30, others simply prohibiting their use, and with the same GM food
who provide us with the glimpse of the next generation of con- being granted or refused authorization (Busch, 2002; Kvakkestad
sumers, with an expectedly above-average income in line with and Vatn, 2008). This debate is not confined to developed coun-
above-average qualifications; given that these are university stu- tries as pointed out by Kothamasi and Vermeylen (2011, p. 536):
dents, we also expect them to be more scientifically informed on “since the 1998s, the rhetorical GM wars have moved to the south
average than the general population. By using a convenient focusing on issues such as food security in developing countries”.
mechanism (namely a university’s mailing list for recruitment and In Europe the debate about the (dis)merits of GMOs is all the
an online survey for administration of the questionnaires), we more timely as since January 2015, each member can impose a ban
explore how this group perceives GMOs, how their attitudes or restriction on GM crops, which will result in different public
compare with the rest of the population, both in Portugal and policies towards GMOs within the EU (Directive 2015/412/EU2). For
Europe, and whether exposing respondents to positive, negative or each EU member state to design specific national policies that
mixed information on GMOs impacts attitudes and valuation of GM reflect the public opinion on this topic, it is important to under-
food. stand the attitudes and perceptions of residents. If, as we argue,
The focus on this population group aims to capture attitudes and public opinion is not definitive, then the first step that policy
information impacts on a more scientifically aware group, generally makers should take is to inform the public about the different as-
more prepared than the average population to critically analyze the pects of the technology as well as the merits and demerits of the
pros and cons of different issues, and with the potential to shape different policies towards GMOs. According to Costa-Font and
market outcomes through consumption choices. However, we Mossialos (2005a, 2005b), there is evidence in Europe that con-
propose using this exploratory study as a basis for future research, sumers who are less informed about GMOs seem to react following
arguing that the same methodology may be applied to other groups a “precautionary” or “self-protective” attitude and become more
of interest or national representative samples so as to inform public wary of their use. These results highlight the need for information
policy and firms.

2
Directive 2015/412/EU, amending Directive 2001/18/EC as regards the possi-
1
The Eurobarometer is a public opinion survey carried out across all EU member bility for EU Member States to constrain or prohibit the cultivation of GMOs in their
states and is commissioned by the European Commission. territory (OJ L 2015.68.001).
4112 M. Valente, C. Chaves / Journal of Cleaner Production 172 (2018) 4110e4118

policies so that informed consumers and citizens can form stable valuation method (CVM), elicit an economic value from re-
preferences and decision-makers may choose accordingly. spondents relative to a hypothetical scenario presented often in a
A country may decide to continue to enforce the precautionary questionnaire (Bateman et al., 2002; Bateman and Willis, 1999;
principle simply banning GMOs. On the contrary, it may loosen Brown, 2003; Carson, 2000). CVM is used to either assess the
restrictions, and ultimately allow consumers to decide in the willingness to pay (WTP) of individuals for goods or services or the
marketplace. In fact, GMOs are a policy area where the PP is willingness to accept (WTA) a welfare-reducing situation. This is
commonly invoked, rather than the polluter-pays principle or the useful for example to conduct benefit-cost analysis as the method
prevention principle. As argued in the report on the PP by UNESCO allows for the inclusion of people’s preferences (Hanley et al.,
COMEST (2005, p. 7): “the emergence of increasingly unpredictable, 2009).
uncertain, and unquantifiable but possibly catastrophic risks such A panel of experts legitimized the use of CVM by providing
as those associated with Genetically Modified Organisms, climate guidelines for its application and concluding it can even “produce
change etc., has confronted societies with the need to develop a estimates reliable enough to be the starting point of a judicial
third, anticipatory model to protect humans and the environment process of damage assessment” (Arrow et al., 1993, p. 4610). A
against uncertain risks of human action”, as such the “emergence of competent application of the CVM involves several design consid-
the PP has marked a shift from postdamage control (civil liability as erations such as care with elicitation formats, administration mode
a curative tool) to the level of a pre-damage control (anticipatory and consideration of potential biases, as well as thorough design of
measures) of risks”. The PP is often called upon in the presence of the survey (Haab and McConnell, 2002; Whitehead, 2006).
scientific uncertainty and irreversibility in causing damages (Myhr The CVM has been extensively used in areas related to the
and Traavik, 2002), which is the case of allowing the cultivation of environment, and in the particular case of Portugal, it has been
GM crops, given the potential for cross-contamination with con- applied to issues of landscape valuation (Cunha-e-Sa  et al., 2012;
ventional crops (Notarnicola et al., 2012). Yet, the enforcement of Marta-Pedroso et al., 2007), natural area preservation (Madureira
the PP in relation to GMOs has been subject to debate and is not et al., 2011; Nunes, 2002), fauna conservation (Botelho and Pinto,
uncontroversial. Tagliabue (2016) for instance asserts that the 2002), waste management (Ferreira and Marques, 2015), renew-
principle may be easily misunderstood or, depending on the pur- able energy (Botelho et al., 2016), and water quality (Pinto et al.,
poses, willfully misused. 2016). To the best of our knowledge, an application of CVM to
In the EU the PP is applied “where scientific information is GMOs in Portugal has not been undertaken.
insufficient, inconclusive, or uncertain and where there are in- In this paper, we design an economic valuation question which
dications that the possible effects on the environment, or human, concerns specifically the inclusion of a GMO ingredient and its
animal or plant health may be potentially dangerous and incon- economic value. In this study we are neither interested in the actual
sistent with the chosen level of protection” (European Commission, economic value attached to GM food, nor on extrapolating the
2000, p. 7). Measures to restrain or forbid the spread of GMOs may valuation results to the aggregate population. We focus instead on
be based on such reasoning. Public support for the enforcement of how this valuation varies across a relatively homogenous group and
PP or for loosening restrictions should not be the deciding factor in assess whether attitudes translated into economic valuations (more
issues where scientific evidence is available, but it legitimizes specifically the WTA a GM ingredient) are affected by the provision
public options in representative democracies. of information.
Furthermore, given that the technology behind GMOs and GM We opt for a CV question since it resembles a market situation
food is evolving and is rather complex, it is likely that public per- and goes beyond mere perceptions, towards market behavior.
ceptions are not yet definitive and are still volatile, which makes it Desaint and Varbanova (2013), while not dismissing surveys as a
all the more relevant to more thoroughly study them to be able to research instrument, emphasize the need for other approaches to
have a clearer grasp of public opinion. studying public opinion towards GMOs such as observing actual
Not only public policy but also business decisions depend on the choices. This becomes evident for example in a study carried out on
perceptions and valuation of (non-)GM food by individuals. behalf of the European Commission that shows that attitudes to-
Research on attitudes and behavior towards GM food has shown wards GM food differ from actual market behaviors
that individuals express concern and reluctance when surveyed, (ConsumerChoice Consortium, 2008). In the case of the market
but in the marketplace are less concerned about GM food and scenario we constructed, this is not possible as the good does not
willing to buy it for a sufficiently low price (ConsumerChoice exist, so we elicit a market-framed choice instead.
Consortium, 2008; Desaint and Varbanova, 2013; Sleenhoff and There are several studies involving GM food using the stated
Osseweijer, 2013). As Costa-Font et al. (2008) argue, actual pur- preferences methodology, either contingent valuation or the choice
chase behavior of GM food is a result of a complex decision making experiment methodology, which find a price premium for non-GM
process, that ultimately combines not only attitudes (which stem food compared to GM food (e.g. Grimsrud et al., 2004; Moon and
from individual characteristics, as well as information and trust Balasubramanian, 2004). When analyzing both hypothetical valu-
concerning GMOs) but also price. To account for the economic ation surveys as well as incentivized auctions, a price premium is
acceptability of GMOs, in our study, we move beyond questions consistently estimated across elicitation mechanisms (e.g. both
about attitudes and perceptions to a market-based scenario, albeit hypothetical and real stakes) and food types (Colson and Rousu,
hypothetical. Our study combines survey questions with a contin- 2013; Dannenberg, 2009; Lusk, 2011; Lusk et al., 2005). Of partic-
gent valuation (CV) question to explore the impact of information ular relevance to our study, is the result reported by Lusk et al.
provision. In the next subsection, we present the method and re- (2005) that while the estimates for prime premiums vary signifi-
view studies, which apply it to GMOs. cantly across studies, student samples do not systematically bias
results relative to more representative samples.
2.2. The contingent valuation method and GMOs Some valuation studies on GMOs specifically focus on infor-
mational considerations and how providing information to partic-
Valuation methods are commonly used in Economics when ipants impacts the GM price premium, more commonly GMO
there are no markets for a given good or service, and researchers supportive (positive) information. Lusk et al. (2004) expose par-
are interested in attaching a monetary value (Carson, 2000). Spe- ticipants randomly to sectorial benefits of GMOs and observe that
cifically stated preference methods, such as the contingent information on the environmental benefits of GMOs causes
M. Valente, C. Chaves / Journal of Cleaner Production 172 (2018) 4110e4118 4113

consumers to reduce their WTA bids for GM food, i.e. makes them CV question around a hypothetical scenario concerning the pur-
more receptive to GMOs. On the contrary, information on positive chase of a V5 box of breakfast cereals. The valuation concerns the
health effects or positive impacts in developing countries is not WTA a discount in case one of the boxes includes GM ingredients e
behaviorally relevant. Jaeger et al. (2004) also only address the the characteristics of the breakfast cereals are listed and only differ
impact of positive information, and find that it lowers the discount because one of the brands (X) includes the indication that “this
required to purchase GM food. Scholderer and Frewer (2003) and product does not contain genetically modified ingredients” and the
Frewer et al. (2003) report no impact of positive information on other brand (Y) indicates that “this product is made with genetically
attitudes and the former even observe a decline in the probability modified corn”. A picture with the nutritional content is included for
of buying GM food. each brand with the indication described above. The valuation
Moving beyond just studying the impact of supportive infor- question is phrased as: “Please consider the following situation.
mation, both Wachenheim et al. (2007) and Rousu et al. (2007) Suppose you go to the grocery store to buy a box of chocolate breakfast
implement auctions to elicit the WTP for GM and non-GM food cereals. You see Cereals X which is your favorite brand. 1 kg box costs
items and randomly expose participants to supportive and critical V5. There is another brand available (Cereal Y). Cereal X and Y only
(negative) information on GMOs. Wachenheim et al. (2007) use a differ in the type of corn used in the production, all else being identical
student sample and only convey information on environmental (flavor and nutritional content). Now consider that the grocery store is
impacts, in some cases supportive information and in the other offering a discount on Cereal Y. What is the minimum discount you
cases negative information finding no clear impact on valuations. In would be willing to accept to buy these cereals? The following options
a study closer to our design, Rousu et al. (2007) expose participants are available: V0; intervals of V0.10 from ]V0; V0.10] to ]V1.90;
to comprehensive information sets that cover several issues V2.00]; more than V2.00; and “I would not buy these cereals”.
(“general information, scientific impact, human impact, financial The valuation part takes place in two stages. First, the re-
impact and environmental impact” (Rousu et al., 2007, p. 416). The spondents were asked to answer the questionnaire without any
sample used in their study is randomly selected from the general extra information provided. In the second stage we randomly
population. While overall in the study GM food items are on presented participants with information about GMOs. After indi-
average discounted relative to their non-GM alternatives, when cating their birth month, the respondent was conducted to one of
exposed to GMO supportive information participants are actually three information treatments presented according to the month,
willing to pay a small premium for some GM varieties. On the which approximates a random exposure to information. We design
contrary, when exposed to the critical information or both critical one treatment with critical information about GMOs (which we
and supportive, participants discount GM alternatives. will refer to as negative information), another with supportive in-
Using a different setup of a conventional CV survey, rather than formation (positive) and finally one with mixed information about
an experimental auction, and an expectedly more knowledgeable three dimensions (health impacts, economy and environment). We
sample, we further explore how supportive, critical and mixed in- compile some arguments commonly used by opponents and ad-
formation impact choices concerning GM food. vocates of GMOs (e.g. Lusk et al., 2004; Notarnicola et al., 2012;
Rousu et al., 2007). In terms of the information treatments used
3. Questionnaire and implementation in our study, the main negative and positive arguments are
included in Table 1. The mixed treatment combines both informa-
We design a questionnaire to gauge perceptions of respondents tion sets. The actual text used is included in the appendix.
about GMOs in general and GM food in particular and then intro- After reading through the information provided, respondents
duce them to a valuation scenario. To explore how prone to were asked if they wished to change their previous valuation and
manipulation perceptions and valuations they are, we expose re- were presented with the valuation question again. The difference
spondents randomly to three short summaries of the debate sur- between the two stages was that they had received additional in-
rounding GMOs and then compare how these information formation in the second stage of the questionnaire.
treatments impact responses. This study focus on a particular group, namely young people
The questionnaire has four parts and starts with attitudinal (18e30 years old) attending university, that is individuals with
questions, followed by the valuation scenario. Then participants are above-average academic qualifications that are likely to be more
randomly exposed to an information treatment and again faced informed about biotechnology issues. The use of convenience
with the valuation scenario. Finally, the questionnaire includes samples of university studies has been criticized for example by
background questions on socio-demographic characteristics. Peterson and Merunka (2014), in that it limits generalizability and
In the first part, we explore attitudes towards GMOs and general reproducibility.
perceptions on the topic. The first question ascertains whether On the other hand, some studies on GM food valuation already
respondents had heard of GMOs previously and thought of their present findings specific to university students. Moreover, in terms
impacts on food and health. Then, we ask if they had searched for of valuation of GM food, Lusk et al. (2005) find no differences in
information about GMOs, if this information was sufficient and their meta-analysis between college students and the general
which source was most trusted. The questionnaire includes ques- population.
tions similar to the European Eurobarometer on biotechnology However, we acknowledge that the group targeted in our study
(European Commission, 2010) so as to be able to compare re- is likely to be more open to GMOs than the rest of the population.
sponses in the sample with both the Portuguese and the European That goes in line with Grimsrud et al. (2004), where that type of
Eurobarometer results and explore if there is a bias in our results in respondents are more accepting of GM food in terms of requiring a
terms of more or less support for GM food. In particular several lower discount to buy a GM variety.
statements concerning GMOs and GM food are presented and re- Nonetheless, we emphasize that the aim of our study is not to
spondents are asked to rate on a 5-point Likert scale their agree- generalize the effects of information on GMO acceptance within the
ment (completely disagree, disagree, indifferent, agree, completely sample to the general population and claim the effects would be
agree). similar. By gauging the perception within this group we are in fact
Second, we design an economic valuation question which con- focusing on the next generation of consumers with above average
cerns the inclusion of a GMO ingredient in a food item and the qualifications and expectedly above average future incomes, which
economic value that respondents attribute to it. We opt to design a is itself worthy of interest.
4114 M. Valente, C. Chaves / Journal of Cleaner Production 172 (2018) 4110e4118

Table 1
Negative and positive information treatments.

Treatment Health Economy Environment

Negative There are health damages, for instance GM seeds cannot be stored; they have to be purchased every In the long run an increasingly amount of herbicide is
there is higher allergenic potential in GM year and furthermore mostly from one company. Farmers needed (even though it may decrease in the short
food (example: the case of GM soya). are thus dependent from its market position, facing run), expanding the pollution of soil and water.
increased costs.
Positive GM food has increased nutritious value to Bigger crop yields and improved resistance to extreme Use of harmful pesticides and herbicides is reduced
supply daily food needs (especially weather conditions allows increased profits and better due to a greater resistance from GMOs to insects and
important in undernourished living conditions for farmers particularly in less developed other pests.
populations). countries.

4. Results Table 2
Opinion of GM food in our sample, in Portugal and in Europe.
4.1. Sample GM food … sample Portugal Europe

is good for the economy [p ¼ 0.284]


The study was carried out via an internet questionnaire in April (totally) disagree 32 35 50
2013, with recruitment occurring through a Portuguese university’s indifferent/no reply 46 36 19
mailing list (University of Porto in Northern Portugal), and had 97 (totally) agree 22 29 31
helps people in developing countries [p ¼ 0.534]
valid replies. The average age in our sample is 22.8 years (median
(totally) disagree 24 30 37
23) with 37.6% male respondents. In terms of the highest level of indifferent/no reply 40 34 20
education attained by respondents, 59.8% already had an under- (totally) agree 36 36 43
graduate degree and 40.2% had completed secondary education. To is fundamentally unnatural [p ¼ 0.028]**
control for environmental interest of respondents we asked if they (totally) disagree 38 21 20
indifferent/no reply 19 22 10
were taking or had taken a course related to environmental issues,
(totally) agree 43 57 70
which 51.5% had. is safe for future generations [p ¼ 0.081]*
(totally) disagree 28 42 58
indifferent/no reply 36 33 21
4.2. Attitudes and perceptions (totally) agree 36 25 21
is good for you and your family [p ¼ 0.029]**
(totally) disagree 31 49 54
The present exploratory study aims firstly to characterize atti- indifferent/no reply 32 26 16
tudes and perceptions towards GM food, by comparing responses in (totally) agree 37 25 30
the sample to the Eurobarometers on attitudes towards biotech- benefits some people but puts others at risk [p ¼ 0.045]**
nology (European Commission, 2010) and attitudes towards the (totally) disagree 28 20 25
indifferent/no reply 20 35 18
environment (European Commission, 2011).
(totally) agree 53 45 57
The Eurobarometer 2010 shows widespread awareness of GM does no harm to the environment [p ¼ 0.006]***
food with 84% of European respondents confirming they had heard (totally) disagree 52 33 53
about them. In Portugal the share of informed respondents is 59%. indifferent/no reply 36 39 24
However, only 19% of respondents list the use of GMOs in farming (totally) agree 12 28 23

as one of the top 5 environmental concerns (and 13% in Portugal) Note: the p-value refers to the Pearson chi2 test of independence between this
according to the Eurobarometer 2011. In our sample, 98% of re- study’s sample and the Portuguese Eurobarometer sample; the number of asterisks
refers to the conventional levels of statistical significance. Data from the sample
spondents have previously heard of GMOs and 66% have previously
refers to our study and data for Portugal and Europe is from the European
thought of the impacts of GMOs on food and health matters. In Commission (2010).
terms of information on GMOs, 40% of respondents state they had
looked for information and their most trusted source is the scien-
tific community (82%). disagree. Concerning the statement “GM food is good for you and
Table 2 presents the frequencies of replies for our sample, as for your family” 54% of Europeans disagree, 49% of Portuguese, and
the Portuguese and European samples. We have performed Pearson only 31% disagree in the sample. Our sample thus seems biased
chi2 independence tests comparing our sample and the Portuguese towards the support of GMOs relative to the Portuguese and the
Eurobarometer 2010 responses and report the p-value in the table. overall European Eurobarometer 2010 sample.
The perceptions of sample respondents concerning the relation In terms of how respondents perceive the relation between the
between GM food and the economy match the responses for environment and GM food, there appears to be, however, concern
Portugal. As for GM food and its impact on the national economy, for the impacts, since 52% of respondents indicate that GM food can
more people disagree than agree that it can have a positive impact. do harm, which is in line with the opinion of 53% of Europeans.
On the contrary, more respondents believe GM food can help In terms of how certain individual characteristics affect the
developing countries than those who disagree. perception of GMOs we hypothesize that having an academic in-
We clearly observe differences between our sample and general terest in environmental issues would bias respondents against
Eurobarometer 2010 sample, suggesting more support for GMOs GMOs. However, when comparing agreement with the statement
amongst respondents in our study. For example when asked to “GM food does no harm to the environment” and taking an envi-
comment on the claim that “GM food is fundamentally unnatural” ronmentally related course, we do not find a statistically significant
the general European sample reports 70% of agreement, 57% for the relation (Pearson chi2 ¼ 1.27 p ¼ 0.53).
Portuguese sub-sample, whereas in our sample only 43% the re- As illustrated in Fig. 1, 65% respondents support biotechnology
spondents agree. Also in terms of safety for oneself and others, 58% involving food. In terms of acceptance and risks of GM food,
of Europeans disagree that “GM food is safe for future generations”, opinions are split: on the one hand, roughly one third support GM
42% of Portuguese do so, but in our sample only 28% of respondents food as long as the majority of people agrees and consider risks are
M. Valente, C. Chaves / Journal of Cleaner Production 172 (2018) 4110e4118 4115

We expose respondents to the three brief information summaries


described above and observe that 26.8% change their replies to the
WTA valuation scenario. In each treatment there are respectively
38.5%, 22.4% and 12.9% respondents who change their responses.
When comparing these proportions using tests of independence,
there is support for the dependence between treatment and
changing behavior or not (Pearson test p-value ¼ 0.056).
Inspecting the WTA decision after the information exposure, we
find that 38.5%, 18.5% and 25.8% of individuals would not buy the
GM food in the negative, positive and mixed information treat-
ments respectively (Table 3). These shares are consistent with the
Fig. 1. Support for GM food. information provided, with the negative information respondents
being more averse to buying than the positive information re-
spondents. Furthermore, we can compare these shares before and
bearable; on the other hand, the same share opposes these after the information treatments and observe only a statistically
statements. significant increase in the negative information treatment
Overall, we find the opinions in the sample do not differ (following a Pearson test of independence: p-value ¼ 0.082). When
significantly from the Portuguese Eurobarometer response in terms performing the same test for the mixed and the positive informa-
of economic impact of GM food, with more people believing it helps tion shares before and after the information exposure, we find no
developing countries than the share who claim it helps the Portu- statistically significant differences (Pearson test of independence
guese economy. In terms of perception of the risk of GM food for the for positive information p-value ¼ 0.340, mixed information: p-
respondents, their family and future generations, this study’s re- value ¼ 0.767).
spondents are more likely to support GM food than Portuguese and Finally, we can analyze the WTA of those individuals who would
European respondents, when directly asked for their attitudes. buy the GM food after the information treatments to see if the
We next present the results from the valuation question, which information provided affects this economic value. We only find
creates a hypothetical market situation and elicits a monetary value statistically significant differences between stated values for the
for a GM ingredient, to later briefly expose respondents to infor- negative information, where WTA increases relative to the initial
mation on GMOs and present the valuation question again. valuation question, following a non-parametric within-subject
comparison (Wilcoxon test for negative information: p-
4.3. Valuation of GM ingredient value ¼ 0.015, positive information: p-value ¼ 0.851, mixed infor-
mation: p-value ¼ 0.529; similarly for a t-test of equality between
4.3.1. Before information treatments valuations: p-value ¼ 0.034, p-value ¼ 0.739, p-value ¼ 0.377,
After the attitudes questions, the questionnaire includes the respectively).
previously presented valuation question geared towards studying
behavioral choices regarding GM food.
The results from the WTA question are in Fig. 2. We find that 5. Discussion of results
23.7% of respondents would not buy these GM cereals. On the
contrary, 4.1% would not require a discount to buy them. Of those In this study we apply a questionnaire to analyze individuals’
who indeed have a positive WTA (72.2% of all respondents), for 14% perception of GMOs both in terms of attitudes and economic
it is below 0.50 euros (which is 10% of the hypothetical good’s price) valuation. While the implementation was exploratory in terms of
but for 21.4% it is higher than 2 euros (which is 40% of the hypo- the sampling methods, and does not intend to be extrapolated to
thetical good’s price). These results illustrate that GM food is the general population, we aim to draw tentative suggestions for
perceived to be of lower quality by the majority of respondents, as public policy design concerning GMOs, which is all the more rele-
most of them require a discount to buy the item. The elicited WTA vant after the changes in European policy in early 2015.
varies across individuals. We focused on young university students (18e30 years old) for
this study, as these are likely to be more accurately informed than
4.3.2. After information treatments the average population about scientific issues, given the field’s
Respondents are assigned to information treatments according continuous developments. In fact our sample had almost all heard
to the month of birth with 39, 27 and 31 respondents in the of GMOs prior to the questionnaire. We observe that the sample is
negative, positive and mixed information treatments respectively. less biased against GMOs in relation to the Portuguese and Euro-
pean results in the Eurobarometer 2010 in terms of attitudes. For
example, Grimsrud et al. (2004) also find that younger with above-
average education respondents were more accepting of GMOs.
Notwithstanding this bias, respondents clearly show differences in
their economic valuation of GM food, illustrated in the spread of
WTA responses and the fact that almost one quarter would not buy
the item. It should be noted that we do not aim to estimate the

Table 3
Share of respondents not willing to buy the GM food.

Before After

Negative 20.5% 38.5%


Positive 29.6% 18.5%
Mixed 22.6% 25.8%
Fig. 2. Distribution of replies to the WTA scenario (% of total).
4116 M. Valente, C. Chaves / Journal of Cleaner Production 172 (2018) 4110e4118

economic value of GMOs or make inferences to the general popu- On the other hand, it is also in the interest of firms involved in
lation. On the contrary, by focusing on a relatively homogenous the supply of (non-)GM food that consumers exhibit more stable
group, we can test whether exposure to additional information preferences so as to justify making long-term investment decisions.
impacts behavior, minimizing issues of sample background With a possible loosening of restrictions, GM food may prove to be
heterogeneity. economically viable in the marketplace. In our study, some in-
We extended the study by providing different types of infor- dividuals are willing to buy a GM alternative at a lower price, which
mation on GMOs. We not only include a treatment with a summary corresponds to the WTA we elicited. Alternatively, some may be
of supportive information (as is the case of most other studies), but willing to pay a price premium for non-GM food. Understanding
expose participants to a negative information treatment and a these economic valuations is crucial to ascertain the economic
treatment where both positive and negative information is pro- viability of (non-) GM food. Policy makers can thus ensure that
vided. There is no clear consensus in the literature about the impact consumers have access to complete information about benefits and
of positive, negative or balanced information in samples. We find costs of GMOs, which in turn empowers consumers to be able to
that providing participants with information on the potential make more informed choices. While our study finds that in an
negative impacts of GMOs leads them to change their initial valu- informed and homogenous group negative information is behav-
ations more than with other information treatments and makes iorally relevant, it is possible that in other population groups other
them less willing to buy GM food. It also increases the required types of information matter. Therefore, unless there is an a priori
discount to accept GM cereals. On the contrary, positive or mixed political agenda for or against GMOs, both types of information
information do not change valuations as observed in most studies. should be made available to citizens and consumers. However, it
These results are in line with the evidence reviewed in the meta- may be the case that given the still on-going scientific debate about
analysis by Hess et al. (2016, p. 729) who conclude that “re- the net impact of GMOs on human health and the environment,
spondents on average react more strongly with negative attitudes that negative information reinforces the perceptions of riskiness by
to potential risks from biotechnology, than with positive attitudes the public over the perceived benefits.
to potential benefits”. Our study does not aim to make extrapolations about the type of
It should be noted that the population group targeted by our relevant information and the direction of attitude change, rather to
study is likely to interpret information more easily than other highlight the behavioral relevance of information on this still
groups, so it is not clear whether in a more representative sample, controversial topic. Further research, framed by the methodology
the same effects would be observed. However, our results indicate we propose and relying on other populations may continue to
that even amongst more scientifically aware individuals, which are enrich the debate surrounding GMOs and their role in the sus-
also more receptive to GMOs when compared to EU and Portuguese tainability challenge.
Eurobarometer respondents, negative information can engender
changes in choices. Furthermore, the meta-analysis by Lusk et al. Acknowledgments
(2005) does not present differences in valuation between univer-
sity students and the general population. Therefore, although the The authors would like to thank the editor and three anonymous
conclusions cannot be inferred to the general population, the study referees for helpful comments and suggestions. The authors also
highlights that, within a relatively homogenous group, individuals acknowledge the research assistance of Sara Costa in administering
respond asymmetrically to information provision. the questionnaire and collecting the data. This research received no
specific grant from any funding agency in the public, commercial,
6. Conclusions or not-for-profit sectors.

Given the observed results, we argue that providing additional Appendix. Information scenarios
information to individuals is potentially behaviorally relevant,
which is all the more striking as our sample consists of more Negative information
informed individuals than the average population.
Our results show that in this particular group, negative infor- Please read carefully the following information about some
mation about GMOs is behaviorally relevant while positive or disadvantages of genetically modified organisms.
mixed information has no effect. We acknowledge that it is not Health: Some genetically modified foods contain more allergens
straightforward that these results will hold in the general popula- than other foods, so may be worse for human health. Soy, for
tion, given that we focused on a particular population group and example, contains about 16 allergenic proteins and their genetically
given the limited sample size. Rather it consists of an exploratory engineered or transgenic variant has a significantly higher con-
study within a relatively homogenous group about the potential centration (about 27%), which may cause allergies and more
that information can have to change opinions about the impacts of problems in the digestive tract.
GMOs when they seem to be not definitive. We argue that there is Economy: Transgenic seeds have to be purchased every year,
still scope to ascertain whether additional information impacts unlike traditional varieties that can be stored. Furthermore, there is
individuals’ attitudes towards GMOs. only a big company to commercialize the seeds and the herbicide
However, advocating information policies does not necessarily for them. Thus, farmers are dependent on this company and its
mean convincing the public of the dangers of GMOs, as suggested prices, incurring in increasing costs.
by our results, or increasing acceptance of GMOs. It is rather a Environment: Although in the early stages of transgenic seeds
matter of engaging the public and empowering consumers in the use, the amount of herbicide used decreases, in the following years
marketplace. its quantity may have to be increased, and the final concentration
We propose that the result of behavioral relevance of informa- may be higher than the conventional variety, thus increasing soil
tion on GMOs, albeit of limited generalizability, calls for informa- and water pollution.
tion policies. Information policies have the merit of allowing
informed citizens to support or not government policies via dem- Positive information
ocratic representation, legitimizing the further application of the
precautionary principle or the loosening of restrictions on GMOs. Please read carefully the following information which briefly
M. Valente, C. Chaves / Journal of Cleaner Production 172 (2018) 4110e4118 4117

refers to some advantages of genetically modified organisms Colson, G., Rousu, M.C., 2013. What do consumer surveys and experiments reveal
and conceal about consumer preferences for genetically modified foods? GM
(GMOs), also known as transgenics.
Crops Food 4, 158e165.
Health: The transgenic varieties of foods can be more nutritious. ConsumerChoice Consortium, 2008. Do Europeans Buy GM Foods? Final Report
Vitamins and minerals may be added to food allowing people to European Commission: Framework 6. Project no. 518432.
fulfil their daily needs. This is especially important for people with Costa-Font, J., Mossialos, E., 2005a. ‘Ambivalent’ individual preferences towards
biotechnology in the European Union: products or processes? J. Risk Res. 8,
limited resources who sometimes rely on one crop per year. 341e354.
Economy: In transgenic varieties, more abundant crops and Costa-Font, J., Mossialos, E., 2005b. Is dread of genetically modified food associated
resistance to more extreme weather conditions can contribute to a with the consumers’ demand for information? Appl. Econ. Lett. 12, 859e863.
Costa-Font, M., Gil, J.M., Traill, W.B., 2008. Consumer acceptance, valuation of and
higher profit and better living conditions for farmers, particularly in attitudes towards genetically modified food: review and implications for food
developing countries. policy. Food Policy 33, 99e111.
Environment: Transgenic plants have a greater resistance to Costanigro, M., Lusk, J.L., 2014. The signaling effect of mandatory labels on genet-
ically engineered food. Food Policy 49 (Part 1), 259e267.
insects and other pests which reduces the need for pesticides and Cunha-e-Sa , M.A., Madureira, L., Nunes, L.C., Otrachshenko, V., 2012. Protesting and
herbicides (which typically are used in large quantities and infil- justifying: a latent class model for contingent valuation with attitudinal data.
trating the land and water). Environ. Resour. Econ. 52, 531e548.
Dannenberg, A., 2009. The dispersion and development of consumer preferences
for genetically modified food d a meta-analysis. Ecol. Econ. 68, 2182e2192.
Mixed information Desaint, N., Varbanova, M., 2013. The use and value of polling to determine public
opinion on GMOs in Europe: limitations and ways forward. GM crops food 4,
183e194.
Please read carefully the following information on genetically European Commission, 2000. Communication from the Comission on the Precau-
modified organisms. tionary Principle COM(2000) 1 Final. Commission of the European Commu-
nities, Brussels.
Health: Transgenic varieties of foods can be more nutritious; European Commission, 2010. Europeans and Biotechnology in 2010-Winds of
vitamins and minerals can be increased so that people who have a Change? (Eurobarometer 341-Biotechnology) a Report to the European Com-
limited access to food can fulfill their daily needs. However, some mission’s Directorate-General for Research, Directorate-General for Research
Science in Society and Food, Agriculture & Fisheries, & Biotechnology. European
genetically modified foods contain more allergens and can there- Commission, Brussels (Oct).
fore be worse for human health. Soy, for example, contains about 16 European Commission, 2011. Special Eurobarometer 365-Attitudes of European
allergenic proteins and its transgenic variant has a far higher con- Citizens towards the Environment. Conducted by TNS Opinion & Social at the
request of Directorate-General for the Environment.
centration (about 27%) which may cause allergies and other prob-
Ferreira, S., Marques, R.C., 2015. Contingent valuation method applied to waste
lems over the digestive tract. management. Resour. Conserv. Recycl. 99, 111e117.
Economy: Transgenic varieties allow more abundant crops and Frewer, L.J., Scholderer, J., Bredahl, L., 2003. Communicating about the risks and
resistant to more extreme weather conditions, which contributes to benefits of genetically modified foods: the mediating role of trust. Risk Anal. 23,
1117e1133.
a higher profit and better living conditions for farmers, particularly Grimsrud, K.M., McCluskey, J.J., Loureiro, M.L., Wahl, T.I., 2004. Consumer attitudes
in developing countries. But reverse of the situation also occurs, in to genetically modified food in Norway. J. Agric. Econ. 55, 75e90.
that transgenic seeds have to be purchased every year, unlike Haab, T.C., McConnell, K.E., 2002. Valuing Environmental and Natural Resources:
the Econometrics of Non-market Valuation. Edward Elgar Publishing, Chel-
traditional varieties that can be stored. Moreover, there is only one tenham, UK.
large company selling seeds and herbicides that are effective with Hanley, N., Barbier, E.B., Barbier, E., 2009. Pricing Nature: Cost-benefit Analysis and
these seeds, and as such farmers are permanently dependent on Environmental Policy. Edward Elgar Publishing, Cheltenham, UK.
Hess, S., Lagerkvist, C.J., Redekop, W., Pakseresht, A., 2016. Consumers’ evaluation of
that company, and may incur increasing costs. biotechnologically modified food products: new evidence from a meta-survey.
Environment: Transgenic plants have a greater resistance to Eur. Rev. Agric. Econ. 43, 703e736.
insects and other pests which reduces the need for pesticides that Jaeger, S.R., Lusk, J.L., House, L.O., Valli, C., Moore, M., Morrow, B., Traill, W.B., 2004.
The use of non-hypothetical experimental markets for measuring the accep-
typically are used in large quantities and that infiltrate the soil and tance of genetically modified foods. Food Qual. Prefer. 15, 701e714.
ground water. However, there are researchers who claim that Kolodinsky, J., 2008. Affect or information? Labeling policy and consumer valuation
although at the beginning the amount of herbicide used is lower for of rBST free and organic characteristics of milk. Food Policy 33, 616e623.
Kothamasi, D., Vermeylen, S., 2011. Genetically modified organisms in agriculture:
the transgenic varieties, in the following years the amount may
can regulations work? Environ. Dev. Sustain. 13, 535e546.
need to be increased leading to a higher final concentration. Kvakkestad, V., Vatn, A., 2008. Regulating the release of GMOs: contrasts between
the European Union and Norway. Environ. Plan. C Gov. Policy 26, 968e981.
Lusk, J., 2011. Chapter 10 consumer preferences for genetically modified food. In:
References Carter, C.A., Moschini, G., Sheldon, I. (Eds.), Genetically Modified Food and
Global Welfare. Emerald Group Publishing Limited, Bingley, UK, pp. 243e262.
Arrow, K., Solow, R., Portney, P.R., Leamer, E.E., Radner, R., Schuman, H., 1993. Report Lusk, J.L., House, L.O., Valli, C., Jaeger, S.R., Moore, M., Morrow, J.L., Traill, W.B., 2004.
of the NOAA panel on contingent valuation. Fed. Regist. 58, 4601e4614. Effect of information about benefits of biotechnology on consumer acceptance
Bateman, I.J., Carson, R.T., Day, B., Hanemann, M., Hanley, N., Hett, T., Jones-Lee, M., of genetically modified food: evidence from experimental auctions in the
Loomes, G., Mourato, S., Ozdemiroglu, E., 2002. Economic Valuation with Stated United States, England, and France. Eur. Rev. Agric. Econ. 31, 179e204.
Preference Techniques: a Manual. Edward Elgar Publishing, Cheltenham, UK. Lusk, J.L., Jamal, M., Kurlander, L., Roucan, M., Taulman, L., 2005. A meta-analysis of
Bateman, I.J., Willis, K.G., 1999. Valuing Environmental Preferences: Theory and genetically modified food valuation studies. J. Agric. Resour. Econ. 30, 28e44.
Practice of the Contingent Valuation Method in the US, EU and Developing Lusk, J.L., Rozan, A., 2008. Public policy and endogenous beliefs: the case of
Countries. Oxford University Press, Oxford. genetically modified food. J. Agric. Resour. Econ. 33, 270e289.
Blok, V., Long, T.B., Gaziulusoy, A.I., Ciliz, N., Lozano, R., Huisingh, D., Csutora, M., Madureira, L., Nunes, L.C., Borges, J.G., Falc~ ao, A.O., 2011. Assessing forest manage-
Boks, C., 2015. From best practices to bridges for a more sustainable future: ment strategies using a contingent valuation approach and advanced visual-
advances and challenges in the transition to global sustainable production and isation techniques: a Portuguese case study. J. For. Econ. 17, 399e414.
consumption: introduction to the ERSCP stream of the special volume. J. Clean. Marta-Pedroso, C., Freitas, H., Domingos, T., 2007. Testing for the survey mode effect
Prod. 108 (Part A), 19e30. on contingent valuation data quality: a case study of web based versus in-
Botelho, A., Lourenço-Gomes, L., Pinto, L., Sousa, S., Valente, M., 2016. Using stated person interviews. Ecol. Econ. 62, 388e398.
preference methods to assess environmental impacts of forest biomass power Moon, W., Balasubramanian, S.K., 2004. Is there a market for genetically modified
plants in Portugal. Environ. Dev. Sustain. 18, 1323e1337. foods in Europe? contingent valuation of GM and non-GM breakfast cereals in
Botelho, A., Pinto, L.C., 2002. Hypothetical, real, and predicted real willingness to the United Kingdom. AgBioForum (The Journal of Agrobiotechnology Manage-
pay in open-ended surveys: experimental results. Appl. Econ. Lett. 9, 993e996. ment and Economics) 6, 128e133.
Brown, T.C., 2003. Introduction to stated preference methods. In: Champ, P.A., Myhr, A.I., Traavik, T., 2002. The precautionary principle: scientific uncertainty and
Boyle, K.J., Brown, T.C. (Eds.), A Primer on Nonmarket Valuation. Kluwer Aca- omitted research in the context of GMO use and release. Journal of Agricultural
demic Publishers, Dordrecht, The Netherlands, pp. 99e110. and Environmental Ethics 15, 73e86.
Busch, L., 2002. The homiletics of risk. J. Agric. Environ. Ethics 15, 17e29. Notarnicola, B., Hayashi, K., Curran, M.A., Huisingh, D., 2012. Progress in working
Carson, R.T., 2000. Contingent valuation: a user’s guide. Environ. Sci. Technol. 34, towards a more sustainable agri-food industry. Journal of Cleaner Production
1413e1418. 28, 1e8.
4118 M. Valente, C. Chaves / Journal of Cleaner Production 172 (2018) 4110e4118

Nunes, P.A.L.D., 2002. Measuring the economic benefits of protecting the Parque Scholderer, J., Frewer, L.J., 2003. The biotechnology communication paradox:
Natural do Sudoeste Alentejano e Costa Vicentina from commercial tourism experimental evidence and the need for a new strategy. Journal of Consumer
development: results from a contingent valuation survey. Portuguese Economic Policy 26, 125e157.
Journal 1, 71e87. Sleenhoff, S., Osseweijer, P., 2013. Consumer choice. GM Crops & Food 4, 166e171.
Peterson, R.A., Merunka, D.R., 2014. Convenience samples of college students and Stevens, C., 2010. Linking sustainable consumption and production: the govern-
research reproducibility. Journal of Business Research 67, 1035e1041. ment role. Natural Resources Forum 34, 16e23.
Pino, G., Amatulli, C., De Angelis, M., Peluso, A.M., 2016. The influence of corporate Tagliabue, G., 2016. The Precautionary principle: its misunderstandings and misuses
social responsibility on consumers’ attitudes and intentions toward genetically in relation to “GMOs”. New Biotechnology 33, 437e439.
modified foods: evidence from Italy. Journal of Cleaner Production 112 (Part 4), UNESCO COMEST, 2005. The Precautionary Principle, World Commission on the
2861e2869. Ethics of Scientific Knowledge and Technology (COMEST). United Nations
Pinto, R., Brouwer, R., Patrício, J., Abreu, P., Marta-Pedroso, C., Baeta, A., Franco, J.N., Educational, Scientific and Cultural Organization (UNESCO), Paris.
Domingos, T., Marques, J.C., 2016. Valuing the non-market benefits of estuarine Vigani, M., Olper, A., 2013. GMO standards, endogenous policy and the market for
ecosystem services in a river basin context: testing sensitivity to scope and information. Food Policy 43, 32e43.
scale. Estuarine, Coastal and Shelf Science 169, 95e105. Wachenheim, C., Lambert, D., Van Wechel, T., 2007. Willingness to pay for geneti-
Rousu, M., Huffman, W.E., Shogren, J.F., Tegene, A., 2007. Effects and value of veri- cally modified foods under differing information scenarios. Journal of Food
fiable information in a controversial market: evidence from lab auctions of Products Marketing 13, 57e77.
genetically modified food. Economic Inquiry 45, 409e432. Whitehead, J., 2006. A practitioner’s primer on the contingent valuation method. In:
Scholderer, J., 2005. The GM foods debate in Europe: history, regulatory solutions, Alberini, A., Kahn, J. (Eds.), Handbook on Contingent Valuation. Edward Elgar,
and consumer response research. Journal of Public Affairs 5, 263e274. Cheltenham, UK, pp. 66e91.

You might also like