Professional Documents
Culture Documents
Abstract
This study investigates the influence of online news and clickbait headlines on online users’ emotional
arousal and behavior. An experiment was conducted to examine the level of arousal in three online news
headline groups—news headlines, clickbait headlines, and control headlines. Arousal was measured by
two different measurement approaches—pupillary response recorded by an eye-tracking device and self-
assessment manikin (SAM) reported in a survey. Overall, the findings suggest that certain clickbait
headlines can evoke users’ arousal which subsequently drives intention to read news stories. Arousal
scores assessed by the pupillary response and SAM are consistent when the level of emotional arousal is
high.
Keywords
Introduction
What makes users click on online news headlines? This study investigates this question by examining the
effects of online news media on users’ emotional response and intention to read news stories. In the
online context, news media providers have developed several strategies that attempt to make online users
visit their websites so that they can make profit from advertising. One of the traditional strategies is to
create news headlines that catch users’ attention by incorporating sensational, provoking, and gossip-like
content (Deci 1971; Grabe et al. 2001; Schaffer 1995; Uribe and Gunter 2007).
This study aims to examine a type of tabloid headlines that is widely spread in social media websites—
clickbait. We define a clickbait headline as an extremely exaggerated news headline hyperlink that entices
users to click to continue reading an online article. In general, clickbait headlines rely on forward-
reference technique (Yang 2011) which is a narrative strategy that provides just enough information to
create curiosity and suspense, which subsequently arouse users to click on a headline to further read the
full story to fulfill their curiosity. In general, the true goal of such clickbait headline is to direct online
users to a website that collects the view stats or number of clicks which are further used to generate
income from the website’s advertising.
Since the primary intent of clickbait headlines is to generate clicks, the headlines and their content are
often misleading, unverified, and seldom corrected. Clickbait headlines that circulate rumors and
misinformation have repeatedly posted danger to both public and business sections. For example, in
2008, a fraudulent Internet report claiming that Apple CEO, Steve Jobs, had suffered a serious heart
attack was spread throughout social media. The story caused a panic on Wall Street which consequently
led to approximately 10 percent drop in Apple’s stock price (Sandoval 2008). More recently, there was a
social media story reporting that a 3-year-old disfigured girl was asked to leave a KFC restaurant because
her appearance was scaring customers (Jenkins 2014). The story was created as a clickbait headline and
circulated through social media sites. It was later found to be a fake story; however, the company’s
reputation was already damaged.
While previous studies have investigated the effects of news headlines on user response (e.g., Gibbons et
al. 2005; Kim et al. 2010), research specific to the area of clickbait headlines still remains
underdeveloped. Specifically, it is not clear how such headlines are perceived by online users. In general,
clickbait headlines are written with provocative writing style. However, studies in the journalism domain
report that, if readers feel that the news headlines are overly exaggerated, they tend to ignore and avoid
reading the headlines (Loewenstein 1994). In addition, in the information systems (IS) domain, some
online users also consider clickbait headlines as spams (Doyle 2014), and this could result in decreasing
value of online news networks as a whole (Tandoc 2014). Therefore, this study aims to provide insights
into online users’ perceptions of clickbait headlines, especially emotional arousal, which is considered as a
key factor in determining user behavior (Grabe et al. 2000; Kim et al. 2010).
In addition, in order to assess emotional arousal, past studies have primarily relied on self-reported
measures. Such passive measurement approach has been found to valid only in certain circumstances
(e.g., individual differences must be measured) and the subjects have to be aware of and are capable of
reporting their momentary emotional states (Mauss and Robinson 2009). Consequently, the second goal
of this study is to employ an innovative approach, pupillary response observation, to assess arousal.
Users’ average pupil diameter is used as an indicator of arousal and the results are then compared with
the self-reported measure.
Literature Review
Clickbait Headlines
Clickbait headlines can be considered as a tabloid version of online news headlines. However, clickbait
headlines are different from news headlines in the way that news headlines generally provide “hard news”
content (e.g., politics, crimes, science, and economics) while clickbait headlines often contain “soft news”
content (e.g., entertainment, gossip, and fiction). Clickbait headlines are typically written using forward-
referring narrative strategy that provokes curiosity and then postpones what the story is about. This can
entice users to click on the headlines to further read the full stories and allow media websites to generate
click views to earn revenue from advertising. Since the content is often divorced from the headlines, the
proliferation of social networking websites, such as FacebookTM and TwillterTM, has provided
opportunities for clickbait to be advertised and shared. The tactics used to create clickbait are typically
considered deceptive and generally problematic (Chen et al. 2015). Few studies in the literature have
examined clickbait headlines and their consequences. For example, Chen et al. (2015) examined methods
to detect clickbait and provide potential cues for recognizing both textual and non-textual clickbait. Blom
and Hansen (2015) investigated techniques used to create and identify clickbait. While the use of clickbait
headlines is increasing and can raise serious ethical and financial issues to individuals or organizations, it
has received little attention in the IS literature. Therefore, this study aims to fill this gap by providing a
better understanding how clickbait headlines are perceived by online users.
the writing style or deter such emotion by providing deceptive and misleading information. Consequently,
this study aims to provide empirical evidence of arousal in clickbait headlines. Figure 1 presents an
example from Chen et al. (2015) to illustrates a headline presented in two different formats—traditional
news headline and clickbait headline.
Figure 1. Two Headline Formats— (a) News and (b) Clickbait (Chen et al. 2015)
Methodology
Participants
Seventeen undergraduate students (10 males) from a midwestern university participated in the
experiment for a unit course extra credit. All reported normal vision, extensive website experience, and
daily Internet usage for reading online news and checking emails.
Materials
Forty headlines selected from news media websites that contained self-produced news content were used
as the experimental stimuli. The stimuli consisted of 10 news headlines, 15 clickbait headlines, and 15
neutral-arousal headlines (control group). The news headlines and neutral-arousal headlines were
selected from legitimate newspaper websites and public service websites. The news headlines included
hard news content regarding disasters, terrorist attacks, and crimes. This high-arousal content was
chosen for the news headlines so that it can be compared with the arousal level evoked by sensational
writing style in the clickbait headlines. The clickbait headlines were obtained from websites that primarily
aimed at generating online advertising revenue (e.g., www.buzzfeed.com). The clickbait headlines content
contained soft news, such as entertainment, gossip, and fiction. In addition to the news and clickbait
headlines, 15 neutral-arousal headlines were included in the experiment as a baseline control group. All
headlines were forward-reference stories and had approximately equal number of words. The news and
clickbait headlines are presented in Tables 4 and 5.
Procedure
Seventeen experimental sessions were conducted in a laboratory. Each session contained one participant
and lasted approximately 30 minutes. The headlines were displayed on a desktop computer monitor
located at an approximate distance of 40 in. from where the participant was seated.
Upon arrival, the participant signed a consent form and was seated in a recliner in a small, sound-
attenuated dimly lit room. A chinrest was used to maintain a viewing area of the participant. Then, the
participant was instructed to read a series of headlines and was asked “what do you feel about this
headline?” The experiment began with a 9-point calibration sequence by asking the participant to fixate
on nine dots displayed on the computer monitor in a sequential order calibrate the eye tracker. The
tracking precision was then determined. The threshold of the accuracy was 90 percent; otherwise, the
calibration process was repeated until the accuracy reached the threshold.
Following five practice trials, eight headline sets including two sets of new headlines, three sets of
clickbait headlines, and three sets of neutral-arousal headlines (control) were presented in random order.
Each set included five headlines. Each headline was displayed for 4 seconds. There was a 6-second delay
between each set of the headlines.
After all the headlines presented, the chinrest were then removed and the participant was asked to fill out
a post-experimental questionnaire which included a 5-point SAM arousal measure ranging from “Calm
(1)” to “Excited (5)” and a 7-point Likert scale to measure intention to later read the news story ranging
from “Strongly Disagree (1)” to “Strongly Agree (7)”. The experimenter then debriefed and thanked the
participant.
Results
Mean Differences between the Three Headline Groups
Two samples were removed from the dataset due to device errors. Pupil data that were obscured due to
blinking or software or hardware errors were identified and removed from the dataset. For each headline,
a 1-sec pre-trial was removed from the dataset after the headline onset as the subjects were reading the
headline.
Consequently, the average pupil diameter is derived from the average of the left and right pupil diameters
in a window from 2 to 4 sec. after headline onset. Table 1 presents the means and standard deviations
across the three headline groups. The means of SAM arousal scores and intention are statistically
significant different across the three headline groups. However, the p-value does not reach the significant
level of 0.05 for pupil diameter.
The relationships between pupil diameter, arousal (SAM), and intention were further investigated using
linear regression analysis. The results (Table 3) reveal that, both pupil diameter and arousal (SAM)
appear to be statistically significant predictors of intention to read.
Further analysis was carried out to evaluate the mean differences between pupil diameter and arousal
(SAM) for each headline. Result from a series of t-test analysis on the means of pupil diameter and
arousal (SAM) are presented in Table 4 and Table 5. Non-significant p-values represent consistency
between the two arousal measures—SAM and pupil diameter.
According to the results, in the news headline group, arousal (SAM) and pupil diameter are consistent in
seven out of 10 headlines (No8, N07, N10, N06, N01, N04, and N05). In the clickbait headline group, only
one out of 15 headlines (C05) that the arousal measures are consistent. These results indicate that both
pupil diameter and SAM perform relatively well in assessing high arousal. Note that the headlines
presented in the tables are sorted descending based on the SAM arousal scores.
N08 North Korea prepares for possible missile launch: Yonhap 3.79 4.0251 0.546
N07 Paris massacre: At least 128 die in attacks 3.64 4.0308 0.278
Obama says stands with France in hunting down those behind
N10 3.57 3.9903 0.180
Paris attack
Exclusive: U.S. delivers ammunition to Syrian Arab fighters
N06 3.50 4.0450 0.061
battling Islamic State
N01 People screaming clawing to get away 3.43 4.0946 0.063
N04 8 dead babies found in German apartment, police say 3.43 4.0540 0.116
10 killed after French high-speed train derails and crashes into
N05 3.43 4.0538 0.102
canal
College student from California studying abroad killed in Paris
N02 3.14 4.0921 0.025*
attacks
N09 Italy buries first quake victims 2.50 4.0192 0.000*
About 1,500 Mormons resign from church in protest of same-sex
N03 2.21 4.0788 0.000*
policy
Table 4. Means of Arousal (SAM) and Pupil Diameter: News Headlines (* p<0.05)
C04 Why Apple should kill off the Mac… 2.64 4.0140 0.003*
C15 Why using shortcut keys can save you hundreds of dollars a day… 2.64 3.8669 0.002*
C07 The three deadliest drugs in America are all totally legal… 3.07 4.0072 0.008*
C11 Scientists have figured out what makes women attractive… 2.55 3.9695 0.001*
A man falls down and cries for help twice. The second time, my jaw
C02 2.64 4.0140 0.003*
drops…
What happens when a horse discovers a kiddie pool? You won’t
C08 2.50 4.0289 0.000*
believe it...
Cupcakes kept disappearing from the counter. So they set up a
C01 2.27 4.0485 0.004*
hidden camera – Wow...
C09 8 things you should never feed to dogs and cats… 2.27 3.9960 0.002*
Watch the first 15 seconds. That’s all I ask. You’ll be hooked after
C10 2.21 3.9826 0.000*
that, I swear…
C14 See how one man made $$$ in his bedroom… 2.21 3.9324 0.000*
I left my husband & daughter at home and this happened! I can’t
C03 2.18 4.0280 0.000*
believe it…
Table 5. Means of Arousal (SAM) and Pupil Diameter: Clickbait Headlines (* p<0.05)
REFERENCES
Blom, J. N., and Hansen, K. R. 2015. "Click Bait: Forward-Reference as Lure in Online News Headlines,"
Journal of Pragmatics (76), pp. 87-100.
Bradley, M. M., and Lang, P. J. 1994. "Measuring Emotion: The Self-Assessment Manikin and the
Semantic Differential," Journal of Behavior Therapy and Experimental Psychiatry (25:1), pp. 49-59.
Bradley, M. M., Miccoli, L., Escrig, M. A., and Lang, P. J. 2008. "The Pupil as a Measure of Emotional
Arousal and Autonomic Activation," Psychophysiology (45:4), pp. 602-607.
Caune, D. 2013. "What Are the Most Commonly Used Words in Clickbait Titles?" Retrieved April 19,
2016, from https://www.quora.com/What-are-the-most-commonly-used-words-in-clickbait-titles.
Chen, Y., Conroy, N. J., and Rubin, V. L. 2015. "Misleading Online Content: Recognizing Clickbait as
"False News"," in Proceedings of the 2015 ACM on Workshop on Multimodal Deception Detection,
Seattle, WA, pp. 15-19.
Cho, J., Boyle, M. P., Keum, H., Shevy, M. D., McLeod, D. M., Shah, D. V., and Pan, Z. 2003. "Media,
Terrorism, and Emotionality: Emotional Differences in Media Content and Public Reactions to the
September 11th Terrorist Attacks," Journal of Broadcasting & Electronic Media (47:3), pp. 309-327.
Deci, E. L. 1971. "Effects of Externally Mediated Rewards on Intrinsic Motivation," Journal of Personality
and Social Psychology (18:1), pp. 105-115.
Desmet, P. 2005. "Measuring Emotion: Development and Application of an Instrument to Measure
Emotional Responses to Products," in Funology: From Usability to Enjoyment, M.A. Blythe, K.
Overbeeke, A.F. Monk and P.C. Wright (eds.). Dordrecht: Springer Netherlands, pp. 111-123.
Doyle, T. 2014. "Don’t Click That: The Clickbait Virus." Retrieved February 19, 2016, from
http://www.ahundredmonkeys.com/clickbaitadvertising/
El-Arini, K. 2014. "News Feed Fyi: Click-Baiting." Retrieved April 19, 2016, from
http://newsroom.fb.com/news/2014/08/news-feed-fyi-click-baiting/
Gibbons, J. A., Lukowski, A. F., and Walker, W. R. 2005. "Exposure Increases the Believability of
Unbelievable News Headlines Via Elaborate Cognitive Processing," Media Psychology (7:3), pp. 273-
300.
Grabe, M. E., Zhou, S., and Barnett, B. 2001. "Explicating Sensationalism in Television News: Content and
the Bells and Whistles of Form," Journal of Broadcasting & Electronic Media (45:4), pp. 635-655.
Grabe, M. E., Zhou, S., Lang, A., and Bolls, P. D. 2000. "Packaging Television News: The Effects of
Tabloid on Information Processing and Evaluative Responses," Journal of Broadcasting & Electronic
Media (44:4), pp. 581-598.
Heath, C. 1996. "Do People Prefer to Pass Along Good or Bad News? Valence and Relevance of News as
Predictors of Transmission Propensity," Organizational Behavior and Human Decision Processes
(68:2), pp. 79-94.
Jenkins, C. 2014. "Kfc: The Story of a 3-Year-Old Girl Being Asked to Leave Was a Hoax." Retrieved
February 15, from http://www.businessinsider.com/scarred-mississippi-girl-asked-leave-kfc-untrue-
2014-6
John, O. P., and Robins, R. W. 1994. "Accuracy and Bias in Self-Perception: Individual Differences in Self-
Enhancement and the Role of Narcissism," Journal of Personality and Social Psychology (66:1), pp.
206-219.
Kim, S. M., Valitutti, A., and Calvo, R. A. 2010. "Evaluation of Unsupervised Emotion Models to Textual
Affect Recognition," in Proceedings of the NAACL HLT 2010 Workshop on Computational
Approaches to Analysis and Generation of Emotion in Text, Los Angeles, CA, pp. 62-70.
Loewenstein, G. 1994. "The Psychology of Curiosity: A Review and Reinterpretation," Psychological
Bulletin (116:1), pp. 75-98.
Masciocchi, C. M., and Still, J. D. 2013. "Alternatives to Eye Tracking for Predicting Stimulus-Driven
Attentional Selection within Interfaces," Human-Computer Interaction (28:5), pp. 417-441.
Mauss, I. B., and Robinson, M. D. 2009. "Measures of Emotion: A Review," Cognition and Emotion
(23:2), pp. 209-237.
Mehrabian, A., and Russell, J. A. 1974. An Approach to Environmental Psychology, Cambridge, MA: MIT
Press.
Partala, T., Jokiniemi, M., and Surakka, V. 2000. "Pupillary Responses to Emotionally Provocative
Stimuli," in Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, Palm
Beach Gardens, FL, pp. 123-129.
Sandoval, G. 2008. "Who's to Blame for Spreading Phony Jobs Story?" Retrieved February 15, 2016,
from www.cnet.com/news/whos-to-blame-for-spreading-phony-jobs-story/
Schaffer, D. 1995. "Shocking Secrets Revealed! The Language of Tabloid Headlines," ETC: A Review of
General Semantics (52:1), pp. 27-46.
Stanners, R. F., Coulter, M., Sweet, A. W., and Murphy, P. 1979. "The Pupillary Response as an Indicator
of Arousal and Cognition," Motivation and Emotion (3:4), pp. 319-340.
Tandoc, E. C. 2014. "Journalism Is Twerking? How Web Analytics Is Changing the Process of
Gatekeeping," New Media & Society (16:4), pp. 559-575.
Uribe, R., and Gunter, B. 2007. "Are ‘Sensational’ News Stories More Likely to Trigger Viewers' Emotions
Than Non-Sensational News Stories?: A Content Analysis of British TV News," European Journal of
Communication (22:2), pp. 207-228.
Yang, Y. 2011. "A Cognitive Interpretation of Discourse Deixis," Theory and Practice in Language Studies
(1:2), pp. 128-135.