You are on page 1of 21

This article was downloaded by: [134.117.10.

200] On: 06 August 2020, At: 07:26


Publisher: Institute for Operations Research and the Management Sciences (INFORMS)
INFORMS is located in Maryland, USA

Management Science
Publication details, including instructions for authors and subscription information:
http://pubsonline.informs.org

Creating Social Contagion Through Firm-Mediated


Message Design: Evidence from a Randomized Field
Experiment
Tianshu Sun, Siva Viswanathan, Elena Zheleva

To cite this article:


Tianshu Sun, Siva Viswanathan, Elena Zheleva (2020) Creating Social Contagion Through Firm-Mediated Message Design:
Evidence from a Randomized Field Experiment. Management Science

Published online in Articles in Advance 05 Aug 2020

. https://doi.org/10.1287/mnsc.2020.3581

Full terms and conditions of use: https://pubsonline.informs.org/Publications/Librarians-Portal/PubsOnLine-Terms-and-


Conditions

This article may be used only for the purposes of research, teaching, and/or private study. Commercial use
or systematic downloading (by robots or other automatic processes) is prohibited without explicit Publisher
approval, unless otherwise noted. For more information, contact permissions@informs.org.

The Publisher does not warrant or guarantee the article’s accuracy, completeness, merchantability, fitness
for a particular purpose, or non-infringement. Descriptions of, or references to, products or publications, or
inclusion of an advertisement in this article, neither constitutes nor implies a guarantee, endorsement, or
support of claims made of that product, publication, or service.

Copyright © 2020, INFORMS

Please scroll down for article—it is on subsequent pages

With 12,500 members from nearly 90 countries, INFORMS is the largest international association of operations research (O.R.)
and analytics professionals and students. INFORMS provides unique networking and learning opportunities for individual
professionals, and organizations of all types and sizes, to better understand and use O.R. and analytics tools and methods to
transform strategic visions and achieve better outcomes.
For more information on INFORMS, its publications, membership, or meetings visit http://www.informs.org
MANAGEMENT SCIENCE
Articles in Advance, pp. 1–20
http://pubsonline.informs.org/journal/mnsc ISSN 0025-1909 (print), ISSN 1526-5501 (online)

Creating Social Contagion Through Firm-Mediated Message


Design: Evidence from a Randomized Field Experiment
Tianshu Sun,a Siva Viswanathan,b Elena Zhelevac
a
Marshall School of Business, University of Southern California, Los Angeles, California 90089; b Robert H. Smith School of Business,
University of Maryland, College Park, Maryland 20742; c Department of Computer Science, University of Illinois at Chicago, Chicago,
Illinois 60607
Contact: tianshus@marshall.usc.edu, https://orcid.org/0000-0002-9786-044X (TS); sviswana@rhsmith.umd.edu,
https://orcid.org/0000-0002-2730-0746 (SV); ezheleva@uic.edu (EZ)

Received: February 6, 2017 Abstract. We study whether and how a firm can enhance social contagion simply by
Revised: July 15, 2018; November 28, 2018 varying the message shared by customers with their friends. We focus on two key com-
Accepted: January 3, 2019 ponents of information contained in the message—information about the sender’s purchase
Published Online in Articles in Advance: status prior to referral and information about the existence of referral rewards—and their
August 5, 2020 impacts on the recipient’s purchase decision and further referral behavior. In collaboration
https://doi.org/10.1287/mnsc.2020.3581 with an online daily-deal platform, we design and conduct a large-scale randomized field
experiment involving more than 75,000 customers to identify the causal effect of different
Copyright: © 2020 INFORMS message designs on creating social contagion. We find that small variations in message
content can have a significant impact on both recipients’ purchase and referral behaviors.
Specifically, we find that (1) adding only information about the sender’s purchase status
increases the likelihood of the recipient’s purchase but has no impact on follow-up referrals,
(2) adding only information about referral reward increases the recipient’s follow-up re-
ferrals but has no impact on purchase likelihood, and (3) adding information about both the
sender’s purchase and the referral rewards increases neither the likelihood of purchase nor
follow-up referrals. We build a model to analyze the tradeoff between more adoption and
more diffusion and implement the best-performing message design in a production system
with millions of shared messages per year (with a projected increase in net profits of more
than US$1 million per year). We further exploit the rich heterogeneity in deal, recipient,
sender, and social-tie characteristics and examine the mechanisms underlying the effect of
message design. The results suggest that both social learning and social utility are at work,
and the attenuation in the recipient’s purchase is mainly driven by a decrease in social
learning resulting from credibility concerns. The findings of the study provide actionable
guidelines to firms for optimal design of messages at the aggregate and more granular levels.

History: Accepted by Anandhi Bharadwaj, information systems.


Fundings: T. Sun acknowledges the research grant and support from USC Greif Center for Entre-
preneurial Studies, USC Institute of Outlier Research in Business (iORB), and ICCI.
Supplemental Material: The online appendices are available at https://doi.org/10.1287/mnsc.2020.3581.

Keywords: randomized field experiment • social contagion • online word of mouth • observational learning • referrals

1. Introduction An important element of online social interactions,


Online social interactions, in the form of website- and the primary medium by which social influence is
mediated emails, social media posts, and mobile transmitted, is the message that is shared between
messages, are becoming increasingly important and senders and recipients. In the case of firm-mediated
have been studied extensively (Godes and Mayzlin messaging among users, although the sender can choose
2004, Chen et al. 2011, Aral and Walker 2012, Gu et al. the recipients with whom he or she shares the message,
2012, Susarla et al. 2012, Muchnik et al. 2013, Hong the firm, nevertheless, has the ability to control several
et al. 2016, Wang et al. 2018, Sun and Taylor 2020). An aspects of the message. Such firm-mediated messaging
interesting aspect of the online setting is that while is increasingly the norm in a large number of online
consumers are able to quickly disseminate online websites, retailers, and social platforms. Despite the
word of mouth about firms and products, firms are increasing use of such mechanisms and the large volume
also increasingly able to mediate these interactions of firm-mediated information sharing,1 there is very
among customers. Firms have transitioned from be- limited understanding of how different message de-
ing passive observers and moderators to becoming signs impact social contagion. Given the ability of the
active mediators of online social interactions and firm to partially control the content of the message that
referrals (Godes et al. 2005). is shared between the sender and the recipient, our study
1
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
2 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

seeks to examine whether and how a firm can enhance We focus on two key components of information con-
social contagion simply by varying the message shared tained in the message—information about the sender’s
by customers with their social connections. purchase of the deal prior to referral and informa-
Identifying the effect of message content on social tion about the existence of a monetary reward for
contagion (recipient’s purchase and further referrals) referrals2—and their impacts on two key outcomes—
has been traditionally difficult for three reasons: First, the recipient’s purchase and the recipient’s further
the content of the message in interpersonal commu- successful referrals. In collaboration with a leading
nications is usually unobservable by researchers (Godes daily-deal platform in the United States, we designed
et al. 2005); second, and probably more fundamental, a randomized field experiment to study the causal
the content of the message may be correlated with impact of each message component and their com-
sender and recipient characteristics, tie strength, and bination in creating social contagion. We created four
the characteristics of the recommended product, that is, versions of the message by including or excluding each
the issue of endogeneity (Manski 1993, Ma et al. 2015); message component and randomly assigned the shared
and third, there is the issue of external incentives, messages into one of these four variants immediately
because interpersonal communications are often stra- after a sender initiates the share (Figure 1). We worked
tegic (Crawford and Sobel 1982). Several approaches inside the platform and implemented the randomized
for identifying peer effects have been proposed, in- experiment involving more than 22,000 senders and
cluding dynamic matched sampling (Aral et al. 2009), 53,000 recipients in a large-scale in vivo environment
structural models (Ghose and Han 2011), and in- (Aral and Walker 2012, Walker and Muchnik 2014,
strumental variables (Tucker 2008). However, most of Bapna and Umyarov 2015, Taylor and Eckles 2018).
these methods are not appropriate for studying the We find that small variations in the message con-
causal impact of message design on social contagion tent can have very large impacts on both recipient’s
outcomes because of unobserved data and potential purchase and referral behaviors. The results are both
endogeneity; finally, a sender’s sharing action already statistically and economically significant, suggesting
increases product awareness and signals product
that a minor change in message design at zero cost can
quality to the recipient, regardless of the message
potentially have a substantial impact on customer
content (Kornish and Li 2010). There is a strong in-
behaviors and the firm’s profits. Specifically, we find
fluence between the sender and recipient, even in a
that (1) adding only information about the sender’s
basic message with only product information. Thus, a
purchase status increases the likelihood of the re-
priori, it is not clear whether changes in message
cipient’s purchase by more than 11% but has no
content would lead to any incremental improvement
significant impact on the recipient’s successful re-
in social contagion outcomes. Recognizing these chal-
ferrals, (2) adding only information about the referral
lenges, we actively design the shared message by care-
reward increases the recipient’s successful referrals
fully adding or hiding certain information components
and conduct a field experiment with a leading digital by more than 50% but has no impact on purchase
platform to identify the causal impact of message design. likelihood, and (3) when the two components of in-
The randomized and large-scale experiment allows us to formation are made available at the same time, sur-
fully observe the message content, overcome the endo- prisingly, neither purchase likelihood nor successful
geneity issue, and have enough power to detect the effect referrals increase over the baseline message. The at-
of message design. tenuation3 is significant for both the recipient’s pur-
Specifically, we are interested in the following chase and the recipient’s further successful referrals.
questions: Such a negative attenuation effect highlights a po-
1. Can firms influence social contagion outcomes tential tradeoff faced by the firm in designing the
through the design of the shared message? message: should the firm increase adoption or en-
2. If so, can firms improve the two key outcomes hance diffusion? Detailed analysis reveals that firms
in social contagion—that is, the recipient’s purchase should design messages that can increase adoption
(adoption) and the recipient’s further successful re- when the baseline adoption rate is relatively low (as in
ferrals (diffusion)—at the same time? our case and most e-commerce settings) but may
3. Can we gain some insights about the underlying choose the message that encourages diffusion when
process and understand why certain message designs the baseline adoption rate is relatively high (e.g., free
can be more effective? products, apps, and content). We also find that imple-
4. Are particular types of message designs more ef- mentation of the best-performing message design (with
fective for promoting specific deals or engaging partic- only information about the sender’s purchase) leads to
ular recipients when sent by specific types of senders? a significant increase in revenues from sharing for the
In other words, should firms design the message dif- collaborating platform and improves customer ex-
ferently based on the patterns of information sharing? perience, as shown by satisfaction surveys.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS 3

Figure 1. Message Design Used in the Randomized Field Experiment

Notes. The email subject line is the same across four groups. Users see different messages once they click the email. (Upper left) Mes-
sage template for control group C. (Lower left) Message template for treatment group T1 (only add information about sender’s purchase
status). (Upper right) Message template for treatment group T2 (only add information about referral reward). (Lower right) Message
template for treatment group T3 (add information for sender’s purchase and referral reward).

We then unpack the black box to investigate the information about the sender’s purchase is more ef-
underlying mechanisms for both the increase in re- fective for social than nonsocial deals. The spectrum
cipient’s purchase and the attenuation effect. We in- of moderator effects not only reveals the underlying
vestigate the two underlying mechanisms suggested mechanisms but also helps firms understand whether
by prior research—social learning and social utility— particular types of message designs are more effective
by exploiting the rich heterogeneity in deal, sender, for promoting specific deals or engaging particular
recipient, and social-tie characteristics. We find that recipients when sent by specific types of senders and
the effect of information about the sender’s purchase shared through specific types of social ties.
is larger and more significant for recipients with less Investigating the effect of message design on social
experience as compared with those with greater ex- contagion provides new insights that are manageri-
perience, for less popular deals as compared with ally and theoretically valuable. Our study contributes
more popular ones, and for purchases at an early to existing research and practice in a number of ways.
stage of the deal sales cycle as compared with those in First, our study contributes to the word-of-mouth
later stages—instances where information gleaned (WOM) literature (Godes and Mayzlin 2004, Duan
from the sender’s purchase status is more valuable. et al. 2008, Gu et al. 2012). In all previous studies, the
We also find that under these same conditions char- firm either serves as a passive observer or as an ac-
acterized by higher uncertainty, adding information tive facilitator of WOM through monetary and non-
about the referral rewards attenuates the positive effects monetary intervention (Burtch et al. 2017). Our paper
of the sender’s purchase information. Consistent with demonstrates a new and promising role of the firm:
the social-utility mechanism, we also find that adding the firm may serve as an active mediator or designer
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
4 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

that can partially determine the content of online call by researchers (Godes 2011) who highlight the need
WOM that is shared among customers. Given the to move from understanding whether to why in social
large volume of firm-mediated messaging and the contagion research.
increasing ability of firms to partially control the content Finally, our study provides an operational frame-
of such shared messages, understanding the new role work for firms to evaluate the design of message
and effect of message design is managerially valuable. content through experimentation. In previous liter-
Specifically, the findings from our study highlight a ature, the content of the message was always taken
tradeoff between the adoption and referral outcomes in as endogenous and inseparable from the product or
the social contagion process4 and provide guidelines sender characteristics. However, in reality, each WOM
to firms. message (a social media post, a tweet, or a referral) may
Second, our study provides new and useful insights contain multiple information components. Our study
about the mechanisms underlying the social influence is among the first to investigate the incremental effect
process (Iyengar et al. 2015). First, embedding ad- of each information component within the message
ditional components into a WOM message can still and how to optimally combine them in the message
lead to an incremental improvement in social influ- design. We present a new experimental framework to
ence.5 Such a finding suggests that a sender’s pur- causally identify the effect and implement an in vivo
chase decision and explicit recommendation may experiment to demonstrate how firms can actively
embody different signals and complement each other design shared messages to enhance social contagion
in message design. In addition, the analyses of the in a production system involving millions of cus-
moderator effects of a rich set of sender, recipient, tomers. This framework enables the firm to under-
deal, and social-tie characteristics also shed light on stand the incremental contribution and cost of each
the process. Our findings are consistent with the message component.
notions that two mechanisms—social utility and so-
cial learning—are driving recipients’ purchases un- 2. Theory and Hypothesis
der different conditions. Understanding these different In this section, we theorize the mechanisms under-
underlying mechanisms is not only of theoretical im- lying the effect of message design and develop hy-
portance but also of practical value because firms can potheses on the treatment effects on both recipient’s
adopt alternative mechanisms (e.g., online review, a re- purchase and further referrals (Figure 2). In the context
ferral program, or network seeding) to drive conversions of WOM communication, the act of sharing by the
depending on whether social learning or social utility sender already conveys a strong signal to the recip-
is at work. In doing so, our study also answers the recent ient (Kornish and Li 2010). However, a firm’s active

Figure 2. (Color online) Effect of Message Design on Recipient’s Purchase and Further Referrals

Notes. Negative attenuation effect on recipients’ purchase after adding info about referral reward (Hypothesis 1b, T3–T1 on purchase outcome). All
statements in the figure are based on comparison with the purchase outcome or referral outcome in baseline message C. The two negative attenuation
effects—one on recipients’ purchase and one on recipients’ further referrals—are represented using two arrows. H1a, Hypothesis 1a; H1b, Hy-
pothesis 1b; H2b, Hypothesis 2b.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS 5

design of the message component in a WOM com- acceptable, and the use of referral rewards introduces
munication may create an additional impact on re- a sales aspect that may harm the perceived sincerity of
cipients’ purchases. Specifically, we hypothesize that the sender. Drawing on the multiple-motives infer-
adding different information components into the ence framework (Reeder et al. 2002), Verlegh et al.
message design may affect recipients’ purchase de- (2013) theorize and validate that referral rewards may
cisions through two mechanisms: social learning and adversely affect recipients’ responses because it leads
social utility (Qiu et al. 2015). Social learning happens them to infer ulterior (financial) motives for the re-
when information about product quality is conveyed ferral. Specifically, in our context, when information
through direct observation of others’ decision or about a postpurchase referral reward is added to the
word of mouth (Banerjee 1992), whereas social utility message with the sender’s purchase, the recipient
(or network effect) exists when one’s payoff depends may immediately infer that the sender is eligible for a
positively on other people’s action to consume the monetary incentive in the referral process with full
same product (e.g., participating in the same event; certainty. The recipient may therefore question the
Gilchrist and Sands 2016).6 Previous studies have credibility of the share and the motive of the sender (is
examined these two mechanisms in different con- the sender sharing because the deal is good for me or
texts: Cai et al. (2009) find that social learning is crucial because of the monetary incentive?) and become less
in determining individuals’ choice in restaurant din- likely to make the purchase (Figure 2, left-to-right
ing; Katona et al. (2011) demonstrate evidence of arrow). Thus, we hypothesize the following.
strong social utility among members of a social net-
Hypothesis 1b (Negative Attenuation Effect on Recipients’
work site—for example, an individual who is con-
Purchase). Compared with the message with only informa-
nected to existing adopters also has a higher adoption
tion about the sender’s purchase, adding information about
probability. Both mechanisms may also drive the im-
the referral reward will significantly decrease the likelihood
pact of message designs in our context. First, infor-
of recipients’ purchase—that is, Prob(Purchase|Showing
mation about the sender’s purchase of the deal serves
Both Information) − Prob(Purchase|Showing Sender’s Pur-
as a social learning cue (Banerjee 1992, Cai et al. 2009),
chase) < 0.
and such information could positively influence the
recipient’s belief about the quality of the deal and, We now turn our attention to the effect of message
consequently, increase his or her likelihood of pur- design on the other important outcome in social
chase. Second, for social deals that are characterized contagion—that is, recipients’ further successful re-
by positive local network effects (e.g., events/shared ferrals. On the one hand, adding only information
experience; Sundararajan 2007), knowledge about a about the referral reward program may raise the
friend’s purchase could provide additional social recipients’ awareness of the monetary incentive for
utility to the recipient and boost his or her purchase sharing and therefore increase their further referral
likelihood. Combining both social learning and social behaviors (Hong et al. 2016). Such an increase in re-
utility, we hypothesize the following. ferral behaviors would lead to more successful re-
ferrals (Biyalogorsky et al. 2001). On the other hand,
Hypothesis 1a (Effect of Information About Sender’s Pur- compared with the message with only information
chase on Recipients’ Purchase). Compared with the con- about the postpurchase referral reward, adding in-
trol message, adding information about the sender’s pur- formation about the sender’s purchase status may
chase will significantly increase the likelihood of recipients’ remove any uncertainty about the sender’s eligibil-
purchase—thatis,Prob(Purchase|ShowingSender’sPurchase)− ity of getting referral rewards and allow the recipi-
Prob(Purchase|Control Condition) > 0.7 ent to immediately draw the inference and potentially
However, once information about referral reward raise concerns about the sender’s motive and credi-
is added to the message, the message design may bility. Similarly, the recipient may also form the be-
become less effective because the recipient might lief that if he or she initiates a referral, his or her
have a credibility concern about the sender’s share friends could easily infer his or her eligibility of getting
(Kornish and Li 2010). With the referral-reward in- referral rewards 8 through the message design and
formation, the recipient might infer that the sender’s thus raise concerns about his or her credibility (Ryu
share of the deal to him or her is not driven by intrinsic and Feick 2007, Hong et al. 2016). As a result, the
motives (e.g., caring about him or her or excitement recipients under such a message design with both
about the deal) but rather by the external incentive. In referral reward and purchase status visible may be
other words, the recipient may perceive the sender’s less likely to make further referrals because of
share as a type of sales relationship. Tuk et al. (2009) concern about one’s own image (Figure 2, top-to-
draw on theories of interpersonal relations (Fiske bottom arrow, attenuation effect) and, naturally, be
1992) and argue that friendship and sales relation- less likely to bring in successful referrals. We hypoth-
ships differ in the behaviors that are perceived as esize the following.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
6 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

Hypothesis 2a (Effect of Referral Reward on Recipients’ characterized by higher uncertainty as discussed earlier,
Further Successful Referrals). Compared with the control adding information about the presence of postpurchase re-
message, adding only information about the referral reward ferral rewards to the sender’s purchase status will have a
will significantly increase recipients’ further successful more significant attenuation on the positive effect of the
referrals—that is, Successful_Referrals(Showing Referral sender’s purchase information.
Reward) – Successful_Referrals(Control Condition) > 0. As discussed earlier, for social deals, information
about the sender’s purchase status could also serve
Hypothesis 2b (Negative Attenuation Effect on Recipients’
another important purpose: offering additional social
Further Successful Referrals). Compared with the message
utility to the recipient. When knowing that the sender
with information about referral reward, adding information
is going to consume a social deal, the recipient is more
about the sender’s purchase will significantly decrease re-
likely to make the purchase because the sender can
cipients’ further successful referrals—that is, Successful_
serve as a companion and create an additional net-
Referrals(Showing Both) – Successful_Referrals(Showing
work effect (Hartmann 2010, Gilchrist and Sands
Referral Reward) < 0.
2016). Thus, we would expect a larger increase in
We further theorize how user and deal character- the effect of the sender’s purchase information for
istics may moderate the effect of message design. This social deals versus nonsocial deals. In addition, such
allows us to examine the potential mechanisms un- social utility should not be attenuated by the presence
derlying the impacts of message design (Iyengar et al. of a referral reward because only friends’ adoption
2015). As discussed earlier, social learning may play status matters in creating network effects. Social
an important role in the effect of message design on utility, by nature, only depends on other people’s
the recipient’s purchase decision. Previous research adoption decision (Sundararajan 2007) rather than
has shown that social learning is more effective when sharing motive or learned information. Previous re-
the decision maker has less experience and more search has examined the role of network effect and
uncertainty about the focal product (Cai et al. 2015), social learning and finds that those two channels
because the additional information may lead to a more work independently (Cai et al. 2015, Qiu et al. 2015).
positive update on his or her belief. As a result, the Thus, the attenuation of social learning as a result of
message design with information about the sender’s credibility concerns would not lead to the attenuation of
purchase may have a larger and more significant network effect. Thus we hypothesize the following.
impact on purchases for recipients with less experi-
ence, for less popular deals, and for purchases at an Hypothesis 4a (Moderator Effect of the Social Deal on the
early stage of the deal sales cycle—instances where Effect of the Sender’s Purchase). The message design with
information gleaned from the sender’s purchase status only information about the sender’s purchase can lead to
is more valuable. We also theorize that under these larger and more significant increase in purchases for social
same conditions characterized by higher uncertainty, deals as compared with nonsocial deals.
adding information about the presence of postpurchase
Hypothesis 4b (Moderator Effect of the Social Deal on
referral rewards to the sender’s purchase may atten-
the Negative Attenuation Effect). There should not be any
uate the positive effects of message design. Under
significant difference in the attenuation effect in recipients’
those conditions, the recipients need the information
purchase between social deals and nonsocial deals.
most when making their purchase decision. When
they raise a credibility concern and infer ulterior
motives for the referral, they may lose trust in the 3. Research Context
sender’s share (Tuk et al. 2009). The attenuation from In collaboration with a leading online daily-deal
such information loss may also lead to a larger decrease platform, we design a randomized field experiment
in their purchase. Thus we hypothesize the following. to study the causal impact of firm-mediated message
Hypothesis 3a (Moderators of the Effect of Sender’s design on social contagion outcomes. The platform
Purchase on Recipients’ Purchase). The message design offers a wide range of daily deals for local services and
with only information about the sender’s purchase can lead standard products at significant discounts and has a
to a larger and more significant increase in purchases for large customer base. On each deal page on the firm’s
recipients with less experience as compared with those with website, the platform provides channels through which
greater experience, for less popular deals as compared with customers (senders) can share these deals with their
more popular ones, and for purchases at an early stage of the social connections. Customers (senders) can share deals
deal sales cycle as compared with those in later stages. with their friends both before and after purchase by
clicking specific channel buttons (which are prominently
Hypothesis 3b (Moderators of the Negative Attenuation displayed). Specifically, senders who wish to share
Effect on Recipients’ Purchase). Under the same situations through email can add a recipient’s email address in
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS 7

the pop-up window and click “Send.”9 For email information in the message—(1) information about the
referrals, the platform will then automatically deliver sender’s purchase status and (2) information about
emails to each recipient’s email address separately,10 the existence of a referral reward—on the recipient’s
using a predefined message template (Figure 1, control purchase and further successful referrals (Figure 3).
message). The current experiment focuses on the In addition to the original message used by the
postpurchase sharing through email.11 Every day, a platform (control), we create three new versions of the
large volume of email shares is made by customers shared message (T1–T3) by varying the visibility of
through the platform.12 After purchasing the deal, the the sender’s purchase status and the referral reward
customer gets a voucher that he or she can use to program, as illustrated in Figure 1. After the sender
redeem the specific service or product within a period confirms his or her share by clicking the “Send”
of time (usually six months or more). The vast ma- button, all of his or her messages are randomly
jority of senders have not actually consumed the assigned to one of the four test groups (one control (C)
service or product at the time of sharing. and three treatments (T1, T2, and T3; Figure 4). The
The platform sometimes uses a referral program to randomization happens after the sender’s share, and
encourage social interactions. Customers would be thus the message content is completely orthogonal to
eligible to get the referral reward only after they the sender’s own characteristics and sharing behav-
purchase the deal.13 Specifically, the referral reward ior.15 Any difference in the recipient’s purchase and
banner is stated as “Buy first, then share a special link. further referral behaviors can therefore be directly
You may be eligible to get the deal for free.” To attributed to the difference in message design. Using
participate in this program, a user is first required to the experiment design, we are able to identify the
purchase a particular deal (referral reward banner: effects of both message components on the recipient’s
“Buy first ...”). Then the user is given the option to purchase and further referrals and whether adding
share the deal with as many friends as desired. The one would attenuate the effectiveness of the other.
user gets a referral reward when a certain number of When analyzing effectiveness of message design on
the recipients, as predetermined by the platform, pur- the recipient’s purchase, we focus on the direct re-
chase the deal.14 Prior to our experiment, the platform ferrals by initial senders (i.e., first-degree adoption)
used the baseline message design for all shared rather than on the further referrals by recipients who
message (Figure 1, control group). share after they make a purchase. In addition, when a
recipient purchases the shared deal and initiates a
4. Experiment Design new set of referrals on the same deal, he or she is
Although previous experiments on social influence randomly assigned to one of the four test groups.
(Aral and Walker 2011a, b, 2012; Bapna and Umyarov Thus, the difference in a recipient’s successful further
2015; Sun et al. 2019b) have identified how users’ referrals is driven by the difference in the recipient’s
adoption of a product/service influences others, the sharing behavior rather than the message content.
objective of this study is to identify how message
design, conditional on a user having organically shared 4.1. Level of Randomization and Control
the deal with his or her social connections, may further of Contamination
enhance such influence. As noted earlier, our study Our intervention (message design) can vary at the level
seeks to understand the effect of two components of of each sender–recipient share. However, to prevent

Figure 3. (Color online) Key Social Contagion Outcomes Under Tracking: Recipient’s Purchase and Recipient’s Further
Successful Referrals

Notes. In the illustrated scenario, two recipients out of three have purchased the deal through the sender’s share. Furthermore, one recipient
(recipient A) has brought one successful referral (the gray dot) after his or her own purchase. Thus, at the recipient level, the outcomes for
recipient A are as follows: recipient’s purchase = 1; recipient’s further successful referrals = 1.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
8 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

Figure 4. Illustration of Implementation of Message social utility mechanism, we use a two-stage structure
Design Experiment to control for the role of attention/saliency in creating
social contagion.
Specifically, we maintain the same subject line in
the sharing email (“[Friend’s name] thinks you may
like the product”). Thus, prior to opening the email
in the inbox, there should not be any difference in
attention/awareness because the email and its subject
line are exactly the same across the different treat-
ments and control. Once the email is opened and read
(indicating that the recipient is paying attention and is
interested in the content of the message), the message
contained in the email is simple, clear, and concise
potential contamination within the local network of (Figure 1) and is not likely to lead to any major dif-
a sender, we design the randomization at the level ferences in attention/saliency.18 Thus, our design
of the sender—that is, all recipients of a sender who tries to minimize potential differences that could arise
shares a specific deal receive the same message. Ran- from differences in attention or saliency and enables
domization at the level of the sender (rather than at us to focus on the two mechanisms of interest.
the level of recipients) allows for a better control of
potential spillovers between control and treatment 5. Data
groups and helps ensure that the stable unit treat- The randomized field experiment was run for a period
ment value assumption (SUTVA) is less likely to be of six weeks and resulted in a large and random
violated (Wooldridge 2012).16 Specifically, such spill- sample comprising more than 20,000 unique senders
overs happen much more often within the local network (i.e., more than 5,000 senders in each test group)
of a sender as compared with across senders’ networks sharing more than 5,000 unique deals. The number of
(Aral and Walker 2011a). For instance, two friends of recipients who were exposed to the deals in our
a sender S are much more likely to communicate study period exceeds 50,000 (because a sender may
about a specific deal (through sharing the deal or share a deal with multiple recipients). The data for our
through other modes of communication) and influ- study come from customer-to-customer email shares/
ence each other’s decision as compared with recipi- referrals through the platform. For every firm-mediated
ents of two different senders. (However, this is still a email share, we record the unique hashed identifier of
possibility, and we later discuss approaches to miti- the sender (customer ID), the recipient (hashed email
gate this concern; see Online Appendix B). address), the shared deal, and the assigned test group.
We record all recipients whom the sender specifies in the
4.2. Control of Attention/Saliency as a batch of sent messages, the timestamp of the share, and
Contagion Mechanism the purchase and referral decisions of each recipient. We
In addition to identifying the treatment effects of further augment the preceding main data set with his-
message design, we also carefully designed our ex- torical data on sender’s and recipient’s purchase his-
periment to identify specific mechanisms underlying tory, the interactions between them, and detailed
social contagion. As noted in previous literature (e.g., characteristics of the deals (price, category, popularity,
Cai et al. 2009, Zhang 2010, Godes 2011, Sun et al. etc.). The resulting data set enables us to analyze the
2019a), contagion may be driven by several mecha- impact of message design at both the aggregate and
nisms, including attention/saliency, social learning, granular levels (i.e., heterogeneous treatment effects or
local network effects, conformity, and so on. In our moderator effects of sender, recipient, deal, and social-
context, the first three channels are likely to be the most tie characteristics). To control spillover, we follow the
prominent.17 Attention/saliency is expected to in- procedures in Online Appendix B and remove recipi-
fluence contagion (Cai et al. 2009). For instance, the ents who are exposed to more than one sender or more
increased attention resulting from the awareness of a than one type of message during our experiment
friend’s purchase of a deal could in itself lead to a (consisting of less than 4% of our sample).
higher likelihood of purchase, even if no additional
information is learned about the deal from the friend’s 6. Model Specification
purchase (social learning). In addition, previous litera- To identify the effect of each information compo-
ture has also shown that information-display formats nent in a sender’s shared message on the social
can also affect users’ decisions (e.g., Hong et al. 2004, contagion outcomes (i.e., recipient’s purchase and
Kumar and Benbasat 2004, Jiang and Benbasant 2007). further successful referrals), we estimate models at
Because our focus is on the role of social learning and the recipient level (linear probability, probit, and logit
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS 9

for recipients’ purchase and ordinary least squares Here Yjk indicates the total number of recipients’
(OLS), Poisson, and negative binomial model for num- purchases from sender j’s share of deal k. Later, we
ber of recipients’ further successful referrals) using the also use it to indicate alternative sender-level out-
following specification (Equation (1)). A similar strat- comes such as net profits resulting from each sender’s
egy is widely used in field experiment studies in referral or the total number of a recipient’s further
economics and marketing, as illustrated in Duflo et al. referrals that originate from the sender. The error
(2007) and Duflo et al. (2011). term errorjk is again clustered at the deal level.
To further estimate how the effect of message de-
Equation (1) (Recipient-Level Model to Estimate the Effect sign is moderated by user and deal characteristics,
of Message Design). we interact the moderating variables with the test
∑ group indicator and estimate the model at recipi-
Yijk  α + βg × Tg + errorijk , ent level using the following specification (Duflo

Yijk  α + βg × Tg + SenderCharj + DealChark et al. 2011):
+ RecipientChari + SocialTieCharij + errorijk . (1)
Equation (3) (Recipient-Level Model on the Moderation
Yijk indicates individual i’s binary purchase decision Effects of User and Deal Characteristics).
after receiving sender j’s share on deal k. We also use it ∑ ∑
Yijk  α + βg × Tg + βm × ModeratingVarijk,m
to indicate the recipient’s further successful referrals ∑
and the recipient’s feedback about the consumption + γm × Tg × ModeratingVarijk,m
experience. As elaborated on in Online Appendix B, in + SenderCharj + DealChark + RecipientChari
our experimental data, each sender at most shares one
deal during the experiment period (with one or multiple + SocialTieCharij + errorijk , (3)
recipients), but each deal may be shared by multiple where ModeratingVarijk,m denotes the mth moderating
senders. Thus, deal k can be perfectly inferred from variables included in the model. As discussed in
sender index j. Therefore, Yijk can be simplified to Yij. Sections 1 and 2, we theorize and construct a series of
The dummy variable Tg indicates the test group to moderator variables such as recipient’s past experi-
which that sender is assigned. The omitted category ence, the deal characteristics, and social-tie strength.
is usually the baseline message (C) in most of the We use binary indicators to represent all moderator
cases, but later we also use treatment groups (T1 or T2) as variables to simplify the interpretation of modera-
the baseline to identify the attenuation effect in re- tion effects and the discussion of related manage-
cipient’s purchase (T3–T1) and that in the recipi- rial implications. Our results are robust under an
ent’s referrals (T3–T2). Variable SenderCharj indicates alternative definition and measure for moderator
sender-level characteristics, including sender’s past (see Online Appendix A4, e.g., continuous measure;
purchases and account length; DealChark indicates all Irwin and McClelland 2003). Please see more dis-
deal control variables, including price of the deal, cussion in Section 7.
category of the deal, and popularity of the deal;
RecipientChari indicates all recipient characteristics,
including recipient’s past purchases and the account 7. Empirical Findings
length; And SocialTieCharij indicates the social-tie We provide descriptive statistics in Table 1. As a
strength between the sender and the recipients based check of randomization, Table 1 presents the tests of
on sharing history. The errorijk is clustered at the deal equality of sender, recipient, deal, and social-tie cova-
level (and we also tested an alternative clustering riates across the four test groups. The sample is well
structure at the sender level, as discussed in Section 7). balanced across all the covariates, indicating that our
In addition, we perform robustness checks and run randomization is at work (also see temporal distribution
regressions (OLS, Poisson, and negative binomial) at in Figure A1 in Online Appendix A). We closely follow
the sender level using the following specification the framework and order of Section 2 and first present
similar to Duflo et al. (2007): our main findings on the effect of different message
designs on recipient’s purchase decision and fur-
Equation (2) (Sender-Level Model to Estimate the Effect of
ther successful referrals (Figure 2, Hypotheses 1 and
Message Design).
Hypotheses 2).

Yjk  + βg × Tg + errorjk  7.1. Effect of Message Design on Recipient’s
∑ Purchase and Further Successful Referrals
Yjk  + βg × Tg + SenderCharj + DealChark + errorjk .
We estimate the effect of message design on recip-
(2) ient’s purchase using models at both the recipient
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
10 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

Table 1. Descriptive Statistics and Randomization Check

Treatment group Treatment group Treatment group


Control 1 2 3
p-Value
Characteristics Mean SD Mean SD Mean SD Mean SD (C = T1 = T2 = T3)

Sender characteristics (N = 5,626) (N = 5,684) (N = 5,687) (N = 5,643)


Total number of past purchases 7.352 9.335 7.288 9.305 7.197 9.115 7.532 9.488 0.269
(before test)
Total spending (before test) 285.9 458.1 289.0 471.4 279.9 428.8 296.7 445.7 0.255
Days after creating account 899.8 422.2 900.3 422.4 893.5 425.7 913.3 424.3 0.587
Shared deal characteristics (N = 1,457) (N = 1,493) (N = 1,529) (N = 1,492)
Average price 45.7 123.1 47.3 120.6 45.3 103.1 46.2 117.9 0.815
Popularity 740.5 1571 705.7 1319 685.2 1243 720.5 1362 0.181
Category dummy
Restaurant 0.189 0.391 0.193 0.394 0.197 0.398 0.193 0.395 0.722
Entertainment 0.365 0.481 0.364 0.481 0.349 0.477 0.358 0.480 0.279
Fast-food/QSR 0.027 0.163 0.024 0.154 0.025 0.156 0.026 0.160 0.709
Home service 0.087 0.281 0.083 0.276 0.079 0.27 0.083 0.276 0.536
Retail product 0.033 0.18 0.038 0.192 0.032 0.177 0.038 0.191 0.197
Active/fitness 0.154 0.361 0.145 0.353 0.152 0.359 0.150 0.357 0.598
Beauty/spa/massage 0.101 0.301 0.105 0.308 0.112 0.321 0.104 0.306 0.136
Escape 0.044 0.206 0.046 0.209 0.048 0.214 0.046 0.210 0.836
Recipient characteristics (N = 13,161) (N = 13,746) (N = 13,509) (N = 13,548)
Total number of past purchases 2.325 6.331 2.303 6.278 2.231 5.928 2.286 6.276 0.639
(before test)
Total spending in USD (before test) 89.1 283.4 87.4 265.6 85.8 257.4 85.7 255.2 0.688
Days after creating account 546.9 512.8 552.0 513.6 550.4 511.4 554.4 514.4 0.698
Social-tie characteristics
Number of past deal shares 0.505 1.024 0.514 1.033 0.497 1.005 0.490 1.007 0.231
between a pair
Percentage of reciprocal ties 0.08 0.271 0.077 0.266 0.076 0.264 0.076 0.265 0.621

Note. QSR, quick-service restaurant; USD, US dollars; SD, standard deviation.

level (Equation (1)) and the sender level (Equation (2)). effects and moderation effects, we mainly use the
At the recipient level, the outcome variable is the re- recipient-level model to present our empirical find-
cipient’s binary purchase decision (see Figure 3 for an ings (Tables 2 and 3). We use the sender-level model
example). At the sender level, the outcome variable is to provide robustness checks and to deliver addi-
the number of recipients’ purchases from the share of tional insights on the effect of message design on net
each sender. To maintain consistency between treatment profits (Table 4).

Table 2. Effect of Message Design on Recipients’ Purchase Decision (Corresponding


Equation: Equation (1))

Whether the recipient makes a purchase or not

Linear probability model


Outcome Linear probability model with deal fixed effect

Model
T1–C 0.0116** 0.0130*** 0.0118*** 0.0136***
T2–C −0.00362 −0.00242 −0.00282 −0.00221
T3–C 0.00250 0.00330 −0.00159 0.000116
Sender controls No Yes No Yes
Deal controls No Yes No Yes
Recipient controls No Yes No Yes
Social-tie controls No Yes No Yes
Observations 53,964 53,964 53,964 53,964
Negative interaction on purchases
(T3–T1) −0.0091* −0.0097** −0.0134*** −0.0135***

Notes. Please see the detailed coefficients for sender, deal, recipient, and social-tie controls in Tables A1, A5,
and A6 in Online Appendix A. Tables with full information (e.g., p-values and standard deviations) are also
available upon request.
*p < 0.1; **p < 0.05; ***p < 0.01.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS 11

Table 3. Effect of Message Design on Recipients’ Further Successful Referrals


(Corresponding Model: Equation (1))

Number of recipients’ further successful


referrals

OLS with deal fixed


Outcome OLS effect

Model
T1–C 0.00328 −0.00294 −0.00107 −0.00566
T2–C 0.0414** 0.0417** 0.0532** 0.0569**
T3–C −0.00198 −0.00477 −0.00580 −0.00720
Negative attenuation on further successful referrals −0.0434** −0.0464** −0.0590** −0.0641**
(T3–T2)
Sender controls No No No No
Deal controls No Yes No Yes
Recipient controls No Yes No Yes
Social-tie controls No Yes No Yes

Note. OLS, ordinary least squares.


**p < 0.05.

Our experiment generates four main findings on the purchase (Kornish and Li 2010), embedding addi-
treatment effects, corresponding to Hypotheses 1a, 1b, 2a, tional components into the message can still lead to an
and 2b. First, compared with the baseline mes- incremental improvement. In other words, from the
sage (C), simply adding information about the sender’s recipient’s perspective, the sender’s purchase deci-
purchase status (T1) leads to a large increase in the sion and WOM recommendation may embody dif-
recipient’s purchase likelihood (p(T1 = C) < 0.01; Hy- ferent signals and complement each other. Second,
pothesis 1a supported). The regression results fur- and interestingly, once information about the post-
ther confirm the t-test (Table 2, column (2), p < 0.01 purchase referral reward is provided in addition to
with control; Table 4, column (2), p < 0.01 with con- information on the sender’s purchase status (T3), the
trol). The increase is statistically significant and eco- increase in the recipients’ purchase likelihood is at-
nomically sizable (an 11% increase in the recipient’s tenuated (T3-T1 < 0, p(T3 = T1) = 0.017; Hypothesis 1b
purchase likelihood compared with the control supported), and the difference from control becomes
group). Such an additional increase over the baseline insignificant (p(T3 = C) = 0.52). The regressions further
message is highly remarkable given the very large confirm the t-test results (Table 2, p(T3 = T1) = 0.04
number of shared messages per year (approximately with control; Table 4, p(T3 = T1) = 0.03 with control).
millions) and the very low cost of message design The attenuation effect caused by adding referral
(approximately no cost). It is also theoretically sig- reward information (T3–T1) is sizable and statisti-
nificant and indicates that even though the base- cally significant (amounting to removing 81% of the
line WOM communication already provides a strong lift in T1–C originating from adding the sender’s
signal and is effective in driving the recipient’s purchase). This finding is consistent with previous
work (Verlegh et al. 2013) on the recipient’s inference
Table 4. Effect of Message Design on the Recipients’ about the sender’s credibility/motivation. Once the
Purchases and Overall Net Profits, Measured at the Level of recipient realizes that the sender may be eligible for
Each Sender (Corresponding Model: Equation (2)) a referral reward (after simultaneously receiving in-
formation about the postpurchase referral reward and
Net profits brought the sender’s purchase status), he or she may question
by each sender’s the credibility of the referral or infer ulterior motives
Number of recipients’ referrals (referred
purchases from the revenue-referral from such sharing (Tuk et al. 2009).
Outcome sender’s referrals cost) Third, adding information about referral rewards may
increase recipients’ awareness of the monetary reward
T1–C 0.0366*** 0.0312*** 1.489** 1.392**
and raise the number of further successful referrals
T2–C −0.00467 −0.00526 −0.208 −0.243
T3–C 0.0127 0.00837 1.004 0.939 they are making (Hypothesis 2a). We observe such a
Sender controls No Yes No Yes response in our experiment (Table 3). On average, re-
Deal controls No Yes No Yes cipients who are exposed to messages with only the
Recipient controls No No No No referral reward information (T2) make 53% more suc-
Social-tie controls No No No No
cessful referrals compared with recipients in the con-
**p < 0.05; ***p < 0.01. trol group (p(T2 = C) = 0.03; Hypothesis 2a supported).
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
12 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

The regression results further confirm the t-test (and even more significant) after we include deal
(Table 3, columns (1) and (2); p = 0.035 without control fixed effects. Fifth, we also perform the main effect
and p = 0.029 with control). Interestingly, recipients using an alternative model employing a two-by-two
who receive the message with both pieces of infor- representation (two message components and their
mation are much less likely to make further successful interactions rather than T1–T3). The results are robust
referrals compared with the group with only informa- (Table A1 in Online Appendix A; with detailed ex-
tion about referral rewards (i.e., T3–T2 < 0, p(T3 = T2) = planations on the rationale behind our choice of
0.021; Hypothesis 2b supported). The regression re- current representation in Online Appendix A1). Fi-
sults are consistent (Table 3; p(T3 = T2) = 0.032 with- nally, we examine the out-of-bound issue in the linear
out control, p(T3 = T2) = 0.013 with control). Such a probability model (Horrace and Oaxaca 2006) and
decrease in further successful referrals may be due to ensure that our results are robust after corrections
the concern about one’s own image in sharing (Ryu (Table A6 in Online Appendix A).
and Feick 2007, Wirtz et al. 2012), because the friends We also want to note that we were following tra-
who receive the message with both information com- dition in the information systems and economic lit-
ponents may immediately infer their own eligibility erature and consider conventional thresholds for
for getting a referral reward and thus raise concern statistical significance, p < 0.05 (Lin et al. 2013, Burtch
about their motive. et al. 2017). However, one might also need to carefully
We run a series of robustness checks to make sure consider the potential issue of multiple testing19 when
that our results are valid under a range of conditions. interpreting the statistical significance of the results,
First, our findings remain robust under alternative especially for those with a p-value smaller but close
models at both levels, including Poisson and negative to 0.05. Applying a Bonferroni correction to account
binomial models for recipients’ further successful for multiple comparisons would have relatively little
referrals and probit and logit models for recipients’ impact on our hypothesis tests; Hypotheses 1a, 1b,
purchase (Tables A2 and A8 in Online Appendix A). and 2b would continue to be supported with strong
The treatment effects on recipients’ purchase and fur- confidence (as revealed by the consistently low p-value
ther successful referrals are statistically more signif- from t-tests and the results from a range of alterna-
icant under those models. Second, our main findings tive models), whereas Hypothesis 2a on the effect of
on treatment effects also remain qualitatively similar message design on further successful referrals would
(and quantitatively similar in magnitude) under the be weakly supported.
sender-level model (Table 4, columns (1) and (2) and As discussed earlier, we find that a simple variation
Table A7 in Online Appendix A). But the treatment in message design can greatly enhance social conta-
effect is less statistically significant than the recipient- gion (Figure 2). On the one hand, adding information
level model, which is consistent with a smaller sample about the sender’s purchase (T1) significantly in-
size in the sender-level model. The reader should still creases the recipient’s likelihood of purchase. On the
interpret this with caution. Third, the recipients who other hand, adding information about the referral reward
share the same sender might be similar because of alone (T2) increases the recipient’s successful referrals.
homophily. Thus, we also run a regression with errors Both effects are economically significant. However,
clustered at the sender level or sender–deal level because of the negative attenuation effects when the
(Table A4 in Online Appendix A; Cameron and Trivedi two message components are put together, the firm
2005). The standard deviations from all these models cannot achieve the best outcome and increase the recip-
are smaller than those in current model (i.e., clus- ient’s purchase and successful referrals at the same time.
tering at the deal level). Our results are more sig- Therefore, the firm faces a tradeoff: whether to encourage
nificant under alternative clustering. Fourth, cus- adoption (through T1) or diffusion (through T2). We
tomers share a wide range of deals in our experiment build a model (detailed in Online Appendix C) and show
(following a long-tail distribution). For some of the that the firm should increase adoption when the baseline
deals, the number of senders is very small. Even adoption rate is relatively low (as in our case, ~10%) but
though the deals are randomized into one of the four may choose the message that encourages diffusion
groups and the number of deals is very large in our when the baseline adoption rate is relatively high (e.g.,
test, it is still possible (though unlikely given the large free products, content, and apps). Based on the model and
sample size) that our estimates can be biased if some parameters estimated from our data, we identify the
of the “good” deals are all randomized into the same message design that would lead to the highest increase
group (we define a deal as good if the treatment can lead in the total number of adoptions (combining recipients’
to an increase in purchases for the deal). Thus, we run the purchases and successful referrals)—T1, adding in-
models with deal fixed effects and take advantage of formation about sender’s purchase only.
within-deal variation for our identification (columns (3) With the increase in recipients’ purchases and re-
and (4) in Tables 2 and 3). The results are consistent ferrals, the firm may incur an additional cost in the
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS 13

form of sender’s referral reward. Thus, we examine Our rich data set allows us to test the hypotheses
the net profit the firm can gain by aggregating net and reveal the underlying mechanisms. We construct
revenue and cost from referrals at the sender level measures for recipient experience, deal popularity,
(i.e., total profits from all the recipient’s purchases the stage of the deal’s sales cycle, and the “social-
and further referrals minus the sender’s referral re- ness” of the deal in the following way. First, using the
ward). Consistent with previous results, we find that complete purchase history of recipients from the time
adding information about the sender’s purchase leads they join the platform, we are able to identify whether
to a large increase in the net profits for the platform, the recipient has purchase experience on the platform.
after accounting for the cost of referral rewards: We define a recipient as experienced if he or she has
~$1.5 increase from each sender (Table 4, columns (3) made at least one purchase in the past. We also ex-
and (4), p(T1–C) = 0.028 without control and 0.032 amine alternative measures for recipient experience
with control). The increase is significant given the (e.g., user tenure). Second, we define deal popularity
large volume of senders per year (i.e., few million). based on deal sales within each category. If the deal
sales are within the top 50th percentile of all shared
7.2. Mechanisms Underlying the Effectiveness of deals in our experiment, we categorize it as popular; if
Message Design the deal sales are within the bottom 50th percentile,
Having identified the treatment effects at the aggre- we categorize it as unpopular. Third, because we
gate level, we further examine how the effectiveness observe the timing of each purchase for every deal in
of message design varies across different situations our experiment (including purchases from nonsharing
by exploring the heterogeneity in treatment effect channels), we can calculate the percentage of sales that
on different types of deals, different types of recipi- have occurred for the deal when it is shared with the
ents and senders, and across social ties with different recipient. We define a recipient as an early customer if he
strengths. The moderator effects will reveal when certain or she received the share in the early part (initial 50%) of
message designs would work best and provide addi- the deal sales cycle. Finally, the shared deals in our
tional insights into the contagion mechanisms underly- sample range across 8 categories and 92 subcategories
ing the process. As elaborated by Iyengar et al. (2015), (including restaurant, entertainment, fast-food/desserts,
the multiple moderator effects, though not causal, would home service, retail products, active/fitness, beauty/spa,
provide strong evidence of underlying mechanisms. and escape at the category level). Two coders indepen-
Because there are a large number of characteristics dently go over the deals in each subcategory. Based on the
at different levels, we choose to examine moderator nature of the subcategory (whether it involves a group
effects as guided by social contagion mechanisms activity or not and whether friends can redeem the deal at
studied in previous literature (Cai et al. 2009, Qiu et al. the same time or not;20 Hartmann 2010), the coders code
2015, Lee et al. 2015). As discussed in Section 2 (Hy- and classify the subcategory into social versus nonsocial
potheses 3 and 4), two mechanisms—social learning subcategories. Cronbach’s alpha equals 0.88 (above
and social utility—may be at work in driving the typically acceptable thresholds of 0.7), and the raters
increase in the recipient’s purchases. If social learning agree on the categorization of 84 of the 92 subcate-
is at work, we should see a larger increase in pur- gories (91.3% agreement). The coders then examined
chases for less-experienced users when they observe the remaining eight subcategories together and made
their friend’s purchase because they may place more a final decision. We report the main results based on
weight on the new information relative their own subcategory-level coding. We also test alternative
knowledge (Banerjee 1992). Similarly, we should see categorization for each of the preceding constructs
an increase in purchases for recipients who receive using alternative cutoff points and more granular
messages about less-popular deals and who receive measures (Online Appendix A4). Our results are ro-
messages about deals that are in the earlier stage of bust across alternative definitions of each moderator
the deal sales cycle (Qiu et al. 2015). On the other (Tables A9–A11 in Online Appendix A) and under
hand, if social utility is at work, we should see a larger alternative coding (Table A13 in Online Appendix A)
increase in purchases for recipients of “social” deals and alternative specifications (e.g., Table A12 in Online
because they can gain additional social utility from Appendix A, with fixed effects).
their friends’ participation (Katona et al. 2011). Those We conduct our analysis at the recipient level and
user- and deal-level constructs are motivated from interact each of the preceding moderating variables
different theories and represent different mechanisms with the indicator of treatment group while con-
and, thus, are less likely to be correlated with each trolling for all other factors (Equation (3) in the em-
other. Correlation analysis between moderators in- pirical strategy). The results are presented in Table 5.
deed confirms the conjecture and supports our choice First, we find that the effect of adding information
(the pairwise correlation among the moderators is about the sender’s purchase status (T1–C) varies
generally smaller than 0.04). across the different types of individuals and deals.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
14 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

Table 5. Effect of Message Design Moderated by User and Deal Characteristics: Evidence
of Social Learning and Social Utility (Corresponding Model: Equation (3))

Recipients’ purchase decision (0/1)


(measured at recipient level)

T1–C (effect of adding T3–T1 (attenuation effect


sender’s of adding referral
Outcome purchase status) reward)

Treatment effect 0.0288*** 0.0287*** −0.0344*** −0.0348***


Recipients’ experience 0.119*** 0.152*** 0.0913*** 0.0959***
Treatment × recipients’ experience −0.0278** −0.0286** 0.0291** 0.0274**
Deal popularity 0.0343*** 0.0363*** 0.0125* 0.0139*
Treatment × deal popularity −0.0218** −0.0227** 0.0207** 0.0210**
Late stage in deal lifecycle 0.0114* 0.0112* −0.00592 −0.00466
Treatment × late stage in deal lifecycle −0.0173** −0.0171** 0.0242*** 0.0217***
Social deal 0.0281*** 0.0148 0.0442*** 0.0326***
Treatment × social deal 0.0160** 0.0169** −0.0113 −0.0103
Sender controls No Yes No Yes
Deal controls No Yes No Yes
Recipient controls No Yes No Yes
Social-tie controls No Yes No Yes

Note. The definition and measure of each moderator is illustrated in Section 7.2.
*p < 0.1; **p < 0.05; ***p < 0.01.

Information about the sender’s purchase has a larger social learning, and they also serve as companions
and more significant effect on recipients who are less and confer social utility to the recipients for social
experienced, on less popular deals, and on deals in the product and events. Appropriate message design
earlier stages of the deal sales cycle (negative and may help strengthen the role of the sender in both
significant interaction terms in columns (1) and (2) of these processes.
Table 5; p < 0.05 for all three terms; Hypothesis 3a
supported). Second, the incremental attenuation ef-
7.3. Additional Evidence for Social Learning and
fect of information about referral rewards on recipi-
Social Utility: Social-Tie Strength
ent’s purchase (T3–T1) is larger and more significant
We further explore the heterogeneity in the treatment
for the situations described earlier (columns (3) and (4)
effect, which may help us better understand the un-
of Table 5; p < 0.05 for all three interaction terms;
derlying mechanisms at work. There are several im-
Hypothesis 3b supported). The empirical findings in
portant variables that would further moderate the effect
Table 5 are consistent with the notion that social
of message design, including the social-tie strength
learning might be at work in the instances with higher
uncertainty for the recipient, and sender’s credibility between the sender and recipient, the “target-iveness”
is crucial in the learning process. By contrast, we also of the sender’s share, and the recipients’ past expe-
find some evidence that social utility also plays a role rience with referrals. We focus on the discussion of
(Table 5). When information about a friend’s purchase social-tie strength because of its prominent role in the
is revealed to the recipient, the increase in the re- literature (Aral and Walker 2014, Bapna et al. 2017)
cipient’s purchase is higher and more significant for and refer readers to Online Appendix A5 for addi-
social (versus nonsocial) deals (p((T1–C) × social tional analyses on other moderators. Tie strength may
deal > 0) < 0.05; Hypothesis 4a supported). This is moderate both social learning and social utility.21 On
consistent with the explanations that the recipient the one hand, the recipient can learn more from a
may enjoy additional utility from a friend’s partici- friend with a stronger social tie because he or she
pation in the event. In addition, we did not find any places more trust when observing a purchase from
difference in the attenuation effect between social such friend (Cai et al. 2015, Bapna et al. 2017). Thus,
versus nonsocial deals (p((T1–C) × social deal > 0) = 0.21; we should observe a larger increase when the sender’s
Hypothesis 4b supported). This is expected given the purchase is added to the message (T1–C). For a similar
nature of social utility discussed in Hypothesis 4b. reason, the attenuation effect (T3–T1) should be smaller
In summary, our results, consistently supported by in such a case (Verlegh et al. 2013, Hong et al. 2016).
a series of moderator effect analyses, indicate that On the other hand, if the shared deal is a social
senders serve two important roles in the social con- deal, the recipient may gain additional utility from
tagion process: they serve as credible sources of in- consuming the deal with a closer friend (Katona
formation to their social connections and facilitate et al. 2011).
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS 15

We construct the measure for social-tie strength and referrals at the same time by including infor-
using the sharing history between sender and re- mation about the sender’s purchase and referral re-
cipient since the beginning of the platform. If the ward. Such a finding is aligned with the notion that
historical share within a pair is reciprocal (i.e., both trust can be sustained by strong ties and repeated
parties have sent and received shares from the other interactions (Bapna et al. 2017), and there is little
party), then we define the tie strength of the pair as credibility concern between individuals with a strong
strong (Granovetter 1973); otherwise, the tie strength tie (Verlegh et al. 2013). As discussed in Verlegh et al.
is considered weak.22 (2013), recipients with prior interaction experience
Table 6 illustrates the additional results on hetero- with (and thus more knowledge of) the sender may be
geneity in treatment effect by examining the moderation less likely to infer an ulterior motive and place more
effect of tie strength using the same model specification trust in the WOM communication process.
as discussed earlier (Equation (3)). We find that the
strength of the social tie between a sender and a re- 7.4. Effect of Message Design on
cipient significantly moderates the treatment effect of Customer Experience
different message designs. Adding information about Finally, we explore the welfare implications of mes-
the sender’s purchase leads to a significantly higher sage design. Although social learning may lead to
lift in purchases for sender–recipient pairs with strong more purchases and benefit the firm, it may, never-
ties compared with those pairs with weak ties (posi- theless, lead to irrational herding and harm customers
tive interaction term for (T1–C) × tie strength in (Banerjee 1992). Social utility, by contrast, is always
Table 6, p((T1–C) × strong tie) = 0.029 without control welfare enhancing. Thus, overall, it is not clear whether
and 0.017 with control). The moderation effect of tie the optimal message design for the firm (T1) would
strength is economically significant: showing infor- also lead to a higher satisfaction of customers after
mation about the sender’s purchase to a recipient who consumption. We measure customer satisfaction using
shares a strong tie will lead to a 37% increase in the automated customer surveys sent by the platform on
recipient’s purchase likelihood! (In contrast, showing the customer’s redemption of a voucher. The survey
the sender’s purchase leads to an 8% increase for a is simple and includes a question on customer sat-
recipient sharing a weak tie with the sender.) This isfaction: thumbs up or thumbs down for your visit.23
indicates the importance of tie strength because of The automated email survey is sent out only if the
both social learning and social utility. More inter- merchant has reported a customer’s redemption of a
estingly, we find that for WOM sharing between re- voucher or if the customer labels his or her voucher as
ciprocal ties, there is no negative attenuation effect used. Thus, the final data we have from the automated
when adding the referral reward (positive interaction survey are determined by two factors: (1) the mer-
term (T3–T1) × tie strength in Table 6; p((T3–T1) × chant’s report (or a customer’s self-report) of deal
strong tie) = 0.021 without control and 0.02 with voucher redemption and (2) the response rate to the
control). Thus, for strong ties, firms may leverage emails sent out. The final recipients who have pro-
message design to increase the recipient’s purchase vided feedback are slightly less than 10% of the

Table 6. The Moderator Effect of Social-Tie Strength on the Effectiveness of Message


Design on Recipients’ Purchase (Corresponding Model: Equation (3))

Recipients’ purchase decision (measured at recipient level)

T1–C (effect of adding T3–T1 (attenuation effect of


Outcome sender’s purchase status) adding referral reward)

Treatment effect 0.00919** 0.00849** −0.0116*** −0.0121***


Strong tie 0.0112 −0.0150 0.0428*** 0.0202*
Treatment × strong tie 0.0316** 0.0344** 0.0336** 0.0329**
Sender controls No Yes No Yes
Deal controls No Yes No Yes
Recipient controls No Yes No Yes

Notes. The social-tie strength is constructed by using the sharing history between sender and recipient
since the beginning of the platform. If the historical share within a pair is reciprocal (i.e., both parties
have sent and received shares from the other party), then we define the tie strength of the pair as strong
(Granovetter 1973); otherwise, the tie strength is considered weak. The results are robust under al-
ternative measures of tie strength such as the existence of historical sharing (Table A10 in Online
Appendix A).
*p < 0.1; **p < 0.05; ***p < 0.01.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
16 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

total purchasers. The sample size in each test group is the context and the nature of the product, firms may
approximately the same. Table 7 illustrates the differ- identify other message components as important de-
ence in customer feedback across the four groups at the terminants in driving social contagion outcomes. Our
aggregate level and decomposed into social deal versus study serves as the first to build the framework and
nonsocial deal. We find suggestive evidence that re- paves the way for firms to conduct a structured search of
cipients who receive the message with only the sender’s optimal message design to enhance social contagion.
purchase information (T1) are more likely to report a We first examine the impact of two important
positive experience (thumbs up; p(T1 = C) = 0.052). This informational components—information about the
increase is larger in magnitude for social deals than sender’s purchase of the product and information
for nonsocial deals (but not statistically significant), about the referral rewards for the sender—in influ-
suggesting that social utility might play a role in encing the effectiveness of a referral message. We
customer satisfaction. Interestingly, in our context, identify an interesting tradeoff between customer’s
the optimal message design, with sender’s purchase purchase and referral outcomes when the two in-
information, also improves both firm profits and formation components are embedded in a WOM
customer welfare over the control message. communication (summarized in Figure 2). Because
the firm cannot attain the sweet spot of increasing
both the recipient’s purchase and further referrals, it
8. Discussions and Conclusion faces a tradeoff between encouraging more purchases
Of all the various aspects of WOM communication— versus further referrals. We show that such negative
including the sender, recipient, social tie between the tradeoffs would be especially strong or weak under
sender and the recipient, channel of communication, certain conditions (e.g., moderated by tie strength)
and the message—that drive the effectiveness of word and also discuss potential underlying mechanisms.
of mouth in creating social contagion, the message is We speculate that such a tradeoff would be very robust
the primary component that actually transmits social when monetary rewards are offered to increase cus-
contagion. Firms today have an unprecedented ability to tomers’ referrals.24 We build a model and identify the
mediate and directly intervene in the online WOM optimal message design (T1, with information about the
process and actively design the message shared by sender’s purchase only). Implementation of optimal
users. Despite the growing importance of message message design by the platform across all markets in
design in creating social contagion, there is very little North America has led to a significant increase in net
understanding of how different components of a mes- profits from sharing, even after accounting for the
sage impact social contagion outcomes. Our study is cost of referral rewards (~$1.5 increase in net profits
among the first to address this issue by providing an from each sender’s referrals; projected increase in net
operational framework to identify optimal message profits over US$1 million per year).
design based on two key outcomes in social contagion: Identifying optimal design of firm-mediated mes-
recipient’s purchase and referrals. Although the de- saging at an aggregate level is a useful first step. With
sign of messages is often open ended and done in an the availability of a large amount of data on sender and
ad hoc fashion, our study proposes a new experi- recipient behaviors and their historical interactions
mental intervention and demonstrates how firms can and the ability to process requests in real time, firms
use a field-experiment framework to identify the can actually personalize message design at a sender–
impact of different components of a message and recipient level. Although personalization is a common
optimally combine them based on patterns of recip- practice in the context of firm–customer interactions,
ients’ purchases and further referrals. Depending on personalization of firm-mediated customer–customer
social interactions is still in its infancy. As an im-
Table 7. Customer Feedback After Consuming the Deal: portant step in this direction, our study examines
Welfare Implication of Message Design (Corresponding various moderators to shed light on the variations
Model: Equation (1)) in treatment effects for different types of senders,
recipients, strength of ties, and products (Tables 5
Recipients’ response to “How do you rate your
experience with the deal?” (thumbs up = 1,
and 6). We envision that in the near future when a
thumbs down = 0) firm gets a request for email share from a sender to
a recipient, it would leverage historical information
Outcome: All Stand-alone deal Social deal
to extract product characteristics and sender’s and
T1–C 0.0845* 0.0449 0.119* recipient’s purchase and interaction histories, calcu-
T2–C 0.0535 0.0274 0.0696 late optimal message design, and deliver the mes-
T3–C 0.0185 −0.0533 0.0864 sage in real time in a personalized fashion.25 Our
Observations 419 209 210
work serves as a valuable proof of concept of this
*p < 0.1. impending development.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS 17

Although the field experiment enables us to iden- Future research can further investigate the mechanisms
tify how message components influence social con- underlying the effectiveness of message design by cre-
tagion, our rich data set also enables us to explore the ating exogenous variation in moderators in the labo-
underlying mechanisms at work. First, we find that ratory setting. Third, we focus on postpurchase sharing
embedding information about a sender’s purchase in because we seek to understand the effect of information
natural word of mouth can lead to an additional in- about senders’ purchase in message design. In our
crease in a recipient’s purchase. We examine the two context, a large portion of the messages is sent out by
primary mechanisms behind such positive impact senders postpurchase. Future research may extend
and find suggestive evidence that both social learning our framework and examine prepurchase sharing.
and social utility may be at work, albeit to different Finally, stimulating social contagion through mes-
degrees in different situations. Second, we find that sage design is complementary to other social inter-
the presence of referral rewards may attenuate social ventions, such as targeting opinion leaders (Iyengar
learning but not social utility. Overall, our findings et al. 2015), network seeding and coordination (Dou
suggest the two key roles played by friends—they et al. 2013, Sun et al. 2019), online review (Duan et al.
can serve as sources of information (social learning) 2008, Yin et al. 2016, Huang et al. 2018), WOM design
or provide companionship and shared experience (Jung et al. 2020), social network integration (Huang
(social utility). Distinguishing between these under- et al. 2019), social media engagement (Chen et al. 2015,
lying mechanisms of social contagion is important not Yang et al. 2019), viral product design (Aral and Walker
only from a theoretical perspective but also from a 2011a), viral content design (Berger and Milkman
practical perspective. If social learning is the primary 2012), viral marketing (Schulze et al. 2014), and re-
mechanism at work, then the firm can adopt alternate ferral programs (Schmitt et al. 2011), among others.
strategies to encourage adoption, such as providing It would be valuable to examine how message design
additional information about the product through cus- complements these approaches. We hope that our
tomer testimony and third-party reviews and offering study serves as a valuable first step for those future
guarantees and flexible return policies to reduce uncer- research directions.
tainty. By contrast, if social utility is the primary driver of
social contagion (as is more likely to be the case for social
Endnotes
products), the firm can invest in identifying key influ- 1
Each year, millions of product-related messages are shared through
encers, adopting appropriate network seeding strategies, the platform we collaborate with in this study. The platform can vary
and providing group rewards. the design of those messages. Even a small increase in the conversion
In conclusion, our study represents one of the first rate of the shared messages would lead to a large increase in net
large-scale field experiments to understand the causal profits for the platform.
2
role of message design on the effectiveness of WOM We carefully review the literature related to social contagion and
communication and social contagion at a granular identify two broad streams of research: one on adoption behavior
(Bapna and Umyarov 2015) and the other on referral behavior
component level. Our study not only contributes to (Ryu and Feick 2007, Jung et al. 2020). The adoption literature focuses
our understanding of the mechanisms underlying primarily on how firms can directly provide information about
WOM communication and the social contagion pro- others’ adoption in encouraging the focal users’ adoption. By con-
cess, but our findings also provide valuable guide- trast, the sharing/referral literature focuses primarily on how firms
lines for firms seeking to manage such online social can directly provide information about referral rewards to incentivize
more referrals. Our study draws motivation and information inter-
interactions through message design. The quantita- ventions from these two streams of research but focuses on their
tive estimates and qualitative understanding gained effects in an entirely new context—firm-mediated message design.
from this series of component-level studies can guide 3
As detailed later, the attenuation effect is defined as the incremental
the optimal design of messages to improve the ef- contribution of adding a message component and is calculated by
fectiveness of social interactions. Small changes to the using the difference between two test groups (e.g., the effect of adding
message design can be accomplished with very little referral-reward information is the effect of displaying both message
components minus the effect of displaying only the sender’s pur-
cost and effort and promise substantial gains to the
chase). The attenuation effect is different from the interaction effect
firm. There are several limitations to this study, which between two message components. Rather, it is the net effect of the
also presents many opportunities for future research. new message component plus its interaction effect.
First, our study focuses on two major message com- 4
Previous studies have focused on a single outcome in social con-
ponents in social commerce when identifying optimal tagion, either the recipient’s purchase (Cai et al. 2015) or the recip-
message design. Future study may build on our frame- ient’s referrals (Ryu and Feick 2007). By tracking both outcomes, we
are able to identify a tradeoff between customers’ adoptions and
work and search optimal messages in a larger compo-
referrals across message designs and connect two streams of research
nent space. Second, the moderator variables are not in social contagion—that is, peer influence (focusing on adoptions)
controlled in our experiment; thus, their effects could be and referral marketing (focusing on referrals).
confounded. We observe multiple moderator effects 5
Unlike previous studies in which there is no peer influence in the
consistent with the social learning and network effect. control group (Cai et al. 2009), in our experiment, there is a strong
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
18 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

influence between the sender and recipient, even in the control group. rewards to adopters, are widely used in different industries, in-
Thus, identifying whether message design could further enhance cluding credit-card agencies (e.g., American Express), manufacturers
peer influence is more challenging than detecting the existence of (e.g., Tesla), internet companies (e.g., PayPal and LivingSocial), and
peer influence (Bakshy et al. 2012, Iyengar et al. 2015). Though sharing-economy platforms (Uber and Airbnb), among others.
previous studies have examined the effect of word of mouth and 14
Without information about the sender’s purchase, the recipient
information about peer adoption separately (Chen et al. 2011), no cannot infer whether the sender is eligible to get a referral reward or
study has examined the effect of information about peer adoption
not with full certainty (e.g., message with only information about
when it is embedded in WOM communications.
referral reward).
6
Besides social learning and social utility, other mechanisms such as 15
Our randomization approach is different from the series of pre-
saliency and conformity might also play a role in the social influence
vious studies (e.g., Aral and Walker 2011a, b; Bapna and Umyarov
process. For instance, showing others’ decisions or opinions may cast
2015), as illustrated in Section 1. Specifically, we vary only the
additional pressure for action, according to the theory of social
message content without changing the organic sharing pattern
conformity (Asch 1955, Bernheim 1994, Bond and Smith 1996). In
Sections 4 and 6, we provide more discussions on how we control the (i.e., sender’s natural choice of recipients).
16
saliency mechanism and the potential role of conformity underlying However, it is very hard to rule out the Stable Unit Treatment Value
the effect of message design. We thank one reviewer for the excel- Assumption (SUTVA) violation. For example, certain recipients may be
lent suggestion. excluded from the experiment if they are cross-contaminated by different
7
Though previous studies have examined the effect of word of mouth senders. Such exclusion may be biased, because a person with more
and information about peer adoption separately (Chen et al. 2011), to friends is more likely to be contaminated. We do our best to mitigate the
the best of our knowledge, no study has examined the effect of in- concern with experiment design and also robustness checks (see Online
formation about peer adoption when it is embedded in word of Appendix B). The reader should still interpret this with caution.
17
mouth (see endnote 4). Hypothesis 1a on the incremental contribution It is notoriously hard to rule out the conformity (or peer
of the information component in the WOM message is crucial from pressure/norm) channel. Conformity is usually most crucial in a
both theory and managerial perspectives. group environment, where one could observe many others’ opinions
8 and one’s decision could be observed or influenced by many others
To avoid gaming behavior, most businesses (including our collab-
orating platforms) only grant referral rewards to those who have (Asch 1955, Bond and Smith 1996). In our context, conformity might
already purchased the product and make it clear in the referral- be of less concern given the one-to-one interpersonal communication
reward introduction that the reward is conditional on “purchase process (no external audience or group activity) and the nature of the
first” (Section 3). In other words, a user would be eligible to get the decision (deal purchase, not opinion or review/rating). However,
referral reward only if he or she already purchased the deal. How- conformity may still play an important role under certain circum-
ever, because users may share a product with or without a purchase, a stances (e.g., share among strong ties). We discuss this in Section 7.3.
user’s friend cannot immediately infer whether the user has pur- 18
Though the referral reward banner is relatively short, it is still
chased or not based on the share and whether the user is eligible to
possible that information about the sender’s purchase status would
enjoy the referral reward or not. When only information about the
become less salient in its presence in T2 and T3. We thank one re-
postpurchase referral reward is shown in the message, the sender
viewer for highlighting this.
may enjoy this ambiguity of the message. However, when the in- 19
formation about the sender’s purchase status is explicitly added into There is some disagreement in the literature about when and
the message (i.e., message design “showing both information”), there whether to employ multiple testing corrections (Duflo et al. 2007).
no longer exists any such ambiguity. His or her friend would know Recent studies suggest that multiple comparisons are specifically
his or her eligibility to get the referral reward, and he or she cannot relevant for untheorized tests, such as detecting heterogeneity in the
control how his or her friends infer his or her sharing motive. treatment effect with a very large number of moderators; in contrast,
Consequently, the user is less likely to make further referrals because thoughtful experiment design and preanalysis plan may alleviate the
of concerns about his or her own image. concerns for multiple testing. Our experiment carefully laid out a
9
The message that the recipients would see does not appear in the preexperiment plan for design and analysis of the main treatment
pop-up window. effects: each message component is designed to improve one out-
10
Even though the sender may specify multiple recipients in a single come. In addition, our main effects and moderation effects (Hy-
send, each email is sent separately, and hence each recipient receives potheses 1–4) are driven by the same underlying mechanisms, and
the email as a one-to-one personal share. Hence, we define each the consistent empirical pattern provides further support for the
sender–recipient pair in a multirecipient share as an independent share. causal effects (Iyengar et al. 2015). We have added detailed discus-
11 sions and hypotheses to provide theoretical support for empirical
We choose to focus on postpurchase senders because we seek to
tests. We sincerely thank one reviewer for this suggestion.
understand the effect of information about senders’ purchase status
20
in the message design. In our context, a large portion of the messages We identify the two coding criteria for social versus nonsocial deals
is sent out by senders after the purchase; thus, the results are (1) based on our discussion with the experienced managers at the
managerially relevant. The effect of message design may be different platform on how the platform categorizes deals in the business de-
if the message is shared by senders prior to purchase because they velopment process and (2) based on the theoretical definition of
may have different motives and follow a different pattern. network effects and group behaviors in previous literature (Hartmann
12
A fraction of the senders also shares deals through their own 2010, Gilchrist and Sands 2016). The coding process does not involve
channels (e.g. copy–paste the deal URL into their own social media or user behaviors in the experiment.
21
email account), leading to successful referrals. Those senders should Social conformity may also play a role in the moderator effect of
be equally distributed across test groups. Our field experiment focuses social-tie strength. In general, an individual might be likely to con-
only on senders using the firm’s email channel to make referrals. The form more to the opinion or decision of a strong tie than to that of a
email channel is also the dominant sharing channel on the platform. weak tie. We thank one of the reviewers for these suggestions.
13 22
Most referral-reward programs in the industry are designed for The results are robust under alternative measures of tie strength,
existing customers who have already made the adoption decision. such as the existence of historical sharing. See discussions in Section 4
Such postadoption referral programs, which only offer referral and Table A11 in Online Appendix A.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS 19
23
The survey also includes a question on “will you ever return? Chen H, De P, Hu YJ (2015) IT-enabled broadcasting in social media:
(yes/no),” but it is not a direct measure of customers’ satisfaction An empirical study of artists’ activities and music sales. Inform.
with the current deal consumption. The results are qualitatively Systems Res. 26(3):513–531.
similar to those on the customers’ satisfaction. Chen Y, Wang Q, Xie J (2011) Online social interactions: A natural
24
For future research, it would be interesting to examine whether experiment on word of mouth vs. observational learning.
nonmonetary interventions (e.g., altruistic framing) can be used to J. Marketing Res. 48(2):238–254.
improve referrals without hurting adoptions. Crawford VP, Sobel J (1982) Strategic information transmission.
25
Our study is focused on the message design in one-to-one social Econometrica 50(6):1431–1451.
communication, but in reality, digital platforms such as Yelp and Dou Y, Niculescu MF, Wu DJ (2013) Engineering optimal network
Facebook might have the ability to personalize message design in effects via social media features and seeding in markets for
one-to-many social communication: showing the same post/review digital goods and services. Inform. Systems Res. 24(1):164–185.
to different users by highlighting different aspects of the message. Duan W, Gu B, Whinston AB (2008) Do online reviews matter? An
Message design in such a public broadcast setting may involve new empirical investigation of panel data. Decision Support Systems
considerations such as information spillover and discrimination and 45(4):1007–1016.
is worth detailed investigation in a separate study. Duflo E, Glennerster R, Kremer M (2007) Using randomization in
development economics research: A toolkit. Schultz T, Strauss J,
eds. Handbook of Development Economics, vol. 4 (North Holland,
References Amsterdam), 3895–3962.
Aral S, Walker D (2011a) Creating social contagion through viral Duflo E, Dupas P, Kremer M (2011) Peer effects, teacher incentives,
product design: A randomized trial of peer influence in net- and the impact of tracking: Evidence from a randomized eval-
works. Management Sci. 57(9):1623–1639. uation in Kenya. Amer. Econom. Rev. 101(5):1739–1774.
Aral S, Walker D (2011b) Identifying social influence in networks Fiske AP (1992) The four elementary forms of sociality: Framework
using randomized experiments. IEEE Intelligent Systems 26(5): for a unified theory of social relations. Psych. Rev. 99(4):689–723.
91–96. Ghose A, Han SP (2011) An empirical analysis of user content
Aral S, Walker D (2012) Identifying influential and susceptible generation and usage behavior on the mobile Internet. Man-
members of social networks. Science 337(6092):337–341. agement Sci. 57(9):1671–1691.
Aral S, Walker D (2014) Tie strength, embeddedness, and social in- Gilchrist DS, Sands EG (2016) Something to talk about: Social spill-
fluence: A large-scale networked experiment. Management Sci. overs in movie consumption. J. Polit. Econom. 124(5):1339–1382.
60(6):1352–1370. Godes D (2011) Commentary—Invited comment on “Opinion lead-
Aral S, Muchnik L, Sundararajan A (2009) Distinguishing influence- ership and social contagion in new product diffusion”. Marketing
based contagion from homophily-driven diffusion in dynamic Sci. 30(2):224–229.
networks. Proc. Natl. Acad. Sci. USA 106(51):21544–21549. Godes D, Mayzlin D (2004) Using online conversations to study
Asch SE (1955) Opinions and social pressure. Sci. Amer. 193(5):31–35. word-of-mouth communication. Marketing Sci. 23(4):545–560.
Godes D, Mayzlin D, Chen Y, Das S, Dellarocas C, Pfeiffer B, Libai B,
Bakshy E, Eckles D, Yan R, Rosenn I (2012) Social influence in social
advertising: Evidence from field experiments. Proc. 13th ACM Sen S, Shi M, Verlegh P (2005) The firm’s management of social
Conf. Electronic Commerce (ACM, New York), 146–161. interactions. Marketing Lett. 16(3–4):415–428.
Gu B, Park J, Konana P (2012) The impact of external word-of-mouth
Banerjee A (1992) A simple model of herd behavior. Quart. J. Econom.
sources on retailer sales of high-involvement products. Inform.
107(3):797–817.
Systems Res. 23(1):182–196.
Bapna R, Umyarov A (2015) Do your online friends make you pay?
Granovetter M (1973) The strength of weak ties. Amer. J. Sociol. 78(6):
A randomized field experiment in an online music social net-
1360–1380.
work. Management Sci. 61(8):1902–1920.
Hartmann WR (2010) Demand estimation with social interactions and
Bapna R, Qiu L, Rice SC (2017) Repeated interactions vs. social ties:
the implications for targeted marketing. Marketing Sci. 29(4):
Quantifying the economic value of trust, forgiveness, and rep-
585–601.
utation using a field experiment. MIS Quart. 41(3):841–866.
Hong W, Thong JY, Tam KY (2004) The effects of information format
Berger J, Milkman K (2012) What makes online content viral?
and shopping task on consumers’ online shopping behavior:
J. Marketing Res. 49(2):192–205.
A cognitive fit perspective. J. Management Inform. Systems 21(3):
Bernheim BD (1994) A theory of conformity. J. Political Econom. 102(5): 149–184.
841–877. Hong Y, Pavlou PA, Wang K, Shi N (2016) On the role of fairness
Biyalogorsky E, Gerstner E, Libai B (2001) Customer referral man- and social distance in designing effective social referral systems.
agement: Optimal reward programs. Marketing Sci. 20(1):82–95. MIS Quart. 41(3):787–809.
Bond R, Smith PB (1996) Culture and conformity: A meta-analysis of Huang N, Sun T, Chen P, Golden JM (2019) Word-of-mouth system
studies using Asch’s (1952b, 1956) line judgment task. Psych. implementation and customer conversion: A randomized field
Bull. 119(1):111–137. experiment. Inform. Systems Res. 30(3):805–818.
Burtch G, Hong Y, Bapna R, Griskevicius V (2017) Stimulating online Huang N, Burtch G, Gu B, Hong Y, Liang C, Wang K, Fu D, Yang B
reviews by combining financial incentives and social norms. (2018) Motivating user-generated content with performance
Management Sci. 64(5):2065–2082. feedback: Evidence from randomized field experiments. Man-
Cai H, Chen Y, Fang H (2009) Observational learning: Evidence from agement Sci. 65(1):327–345.
a randomized natural field experiment. Amer. Econom. Rev. 99(3): Horrace WC, Oaxaca RL (2006) Results on the bias and inconsistency
864–882. of ordinary least squares for the linear probability model.
Cai J, De Janvry A, Sadoulet E (2015) Social networks and the decision Econom. Lett. 90(3):321–327.
to insure. Amer. Econom. J. Appl. Econom. 7(2):81–108. Irwin JR, McClelland GH (2003) Negative consequences of dichot-
Cameron AC, Trivedi PK (2005) Microeconometrics: Methods and Ap- omizing continuous predictor variables. J. Marketing Res. 40(3):
plications (Cambridge University Press, Cambridge, UK). 366–371.
Sun, Viswanathan, and Zheleva: Social Contagion and Firm-Mediated Message Design
20 Management Science, Articles in Advance, pp. 1–20, © 2020 INFORMS

Iyengar R, Van den Bulte C, Lee JY (2015) Social contagion in new Sun T, Taylor SJ (2020) Displaying things in common to encourage
product trial and repeat. Marketing Sci. 34(3):408–429. friendship formation: A large randomized field experiment.
Jiang Z, Benbasat I (2007) The effects of presentation formats and task Quant. Marketing Econom. Forthcoming.
complexity on online consumers’ brand understanding. MIS Sun T, Gao G, Jin GZ (2019b) Mobile messaging for offline group
Quart. 31(3):475–500. formation in prosocial activities: A large field experiment.
Jung J, Bapna R, Golden J, Sun T (2020) Words matter! Toward pro- Management Sci. 65(6):2717–2736.
social call-to-action for online referral: Evidence from two field Sundararajan A (2007) Local network effects and complex network
experiments. Inform. Systems Res. Forthcoming. structure. B. E. J. Theoret. Econom. 7(1), https://doi.org/10.2202/
Katona Z, Zubcsek PP, Sarvary M (2011) Network effects and per- 1935-1704.1319.
sonal influences: Diffusion of an online social network.
Susarla A, Oh JH, Tan Y (2012) Social networks and the diffusion of
J. Marketing Res. 48(3):425–443.
user-generated content: Evidence from YouTube. Inform. Syst.
Kornish LJ, Li Q (2010) Optimal referral bonuses with asymmetric
Res. 23(1):23–41.
information: Firm-offered and interpersonal incentives. Mar-
Taylor SJ, Eckles D (2018) Randomized experiments to detect and
keting Sci. 29(1):108–121.
estimate social influence in networks. Lehmann S, Ahn Y-Y, eds.
Kumar N, Benbasat I (2004) The effect of relationship encoding, task
Complex Spreading Phenomena in Social Systems (Springer, Cham,
type, and complexity on information representation: An em-
Switzerland), 289–322.
pirical evaluation of 2D and 3D line graphs. MIS Quart. 28(2):
255–281. Tuk MA, Verlegh PW, Smidts A, Wigboldus DH (2009) Sales and
Lee YJ, Hosanagar K, Tan Y (2015) Do I follow my friends or the sincerity: The role of relational framing in word-of-mouth
crowd? Information cascades in online movie ratings. Manage- marketing. J. Consumer Psych. 19(1):38–47.
ment Sci. 61(9):2241–2258. Tucker C (2008) Identifying formal and informal influence in tech-
Lin M, Lucas HC Jr, Shmueli G (2013) Research commentary—Too nology adoption with network externalities. Management Sci.
big to fail: Large samples and the p-value problem. Inform. 54(12):2024–2038.
Systems Res. 24(4):906–917. Verlegh PW, Ryu G, Tuk MA, Feick L (2013) Receiver responses to
Ma L, Krishnan R, Montgomery AL (2015) Latent homophily or social rewarded referrals: the motive inferences framework. J. Acad.
influence? An empirical analysis of purchase within a social Marketing Sci. 41(6):669–682.
network. Management Sci. 61(2):454–473. Wirtz J, Orsingher C, Chew P, Tambyah SK (2012) The role of
Manski CF (1993) Identification of endogenous social effects: The metaperception on the effectiveness of referral reward programs.
reflection problem. Rev. Econom. Stud. 60(3):531–542. J. Service Res. 16(1):82–98.
Muchnik L, Aral S, Taylor SJ (2013) Social influence bias: A ran- Wooldridge JM (2012) Econometric Analysis of Cross Section and Panel
domized experiment. Science 341(6146):647–651. Data (MIT Press, Cambridge, MA).
Reeder GD, Kumar S, Hesson-McInnis MS, Trafimow D (2002) In-
Walker D, Muchnik L (2014) Design of randomized experiments in
ferences about the morality of an aggressor: The role of perceived
networks. Proc. IEEE 102(12):1940–1951.
motive. J. Personality Soc. Psych. 83:789–803.
Wang A, Zhang M, Hann IH (2018) Socially nudged: A quasi-
Ryu G, Feick L (2007) A penny for your thoughts: Reward programs
experimental study of friends’ social influence in online prod-
and referral likelihood. J. Marketing 71(1):84–94.
uct ratings. Inform. Systems Res. 29(3):641–655.
Schmitt P, Skiera B, Van den Bulte C (2011) Referral programs and
customer value. J. Marketing 75(January):46–59. Yang M, Ren Y, Adomavicius G (2019) Understanding user-generated
Schulze C, Schöler L, Skiera B (2014) Not all fun and games: Viral content and customer engagement on Facebook business pages.
marketing for utilitarian products. J. Marketing 78(1):1–19. Inform. Systems Res. 30(3):839–855.
Qiu L, Tang Q, Whinston AB (2015) Two formulas for success in social Yin D, Mitra S, Zhang H (2016) When do consumers value positive vs.
media: Learning and network effects. J. Management Inform. negative reviews? An empirical investigation of confirmation
Systems 32(4):78–108. bias in online word of mouth. Inform. Systems Res. 27(1):131–144.
Sun M, Zhang X, Zhu F (2019a) U-shaped conformity in online social Zhang J (2010) The sound of silence: Observational learning in the
networks. Marketing Sci. 38(3):461–480. U.S. kidney market. Marketing Sci. 29(2):315–335.

You might also like