Scribd
Upload
13 views15 pages

Survey Experiment Design in Immigration Research

The document discusses survey experiments, particularly focusing on a study about support for immigration by Hainmueller & Hiscox (2010), where respondents are randomly assigned to different treatment groups. It outlines the differences between between-subject and within-subject designs, as well as potential issues like realism and social desirability bias, along with suggested fixes. Additionally, it encourages students to design their own experiments related to personal causal questions.

Uploaded by

eunice
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
13 views15 pages

Survey Experiment Design in Immigration Research

The document discusses survey experiments, particularly focusing on a study about support for immigration by Hainmueller & Hiscox (2010), where respondents are randomly assigned to different treatment groups. It outlines the differences between between-subject and within-subject designs, as well as potential issues like realism and social desirability bias, along with suggested fixes. Additionally, it encourages students to design their own experiments related to personal causal questions.

Uploaded by

eunice
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Survey Experiment

a.k.a., Randomized experiment embedded within survey


Survey experiment
Example: Support-for-Immigration (Hainmueller & Hiscox 2010)

› Divide (randomly) survey respondents to


2 experimental groups

› Present each group with 1 of 2 versions of the


survey question (treatment) on immigration
Survey experiment
Example: Support-for-Immigration (Hainmueller & Hiscox 2010)

› Group 1: Preferences over high-skilled immigration


› Group 2: Preferences over low-skilled immigration

› Randomization = 2 groups are equal (on average)


in all observed and unobserved characteristics
What’s the treatment?
What’s the design?
Between-subject design
* Subject acts in one state of the world (treatment)
* Each subject is treated only once

Within-subject design
* Subject acts in multiple states of the world (treatments)
* Each subject is treated more than once
2 x 2 x 2 factorial experiment

• 3 treatment dimensions
• Each dimension has 2 elements
• Hence: 2 x 2 x 2
(8 possible combinations in total)
Vignette treatment
What happens to DV
when a characteristic (your IV) is changed?
• E.g. Gender
• E.g. Race
• ….
Some Potential Problems
› Realism

› Social Desirability Bias

› Attention
Some Potential Fixes
› Attention
Some Potential Fixes
› Realism
Some Potential Fixes
› Social Desirability Bias
Hybrids
(Different types of experiments embedded in a survey)
Idea for diary entry

• Think of an important causal question


that pertains to your own life.

• Design an experiment that can


answer this question in principle.
RESEARCH TITLE:
WILL THE LOCAL RESIDENTS
LIVING NEAR THE INTENDED SITES
OF LOCALLY UNWANTED LAND
USES (LULUS) SHOW HIGHER
TOLERANCE TOWARDS THE PLANS
IF THEY ARE BETTER INFORMED?

Students in
POLI 2104

You might also like