Social Research Methods

MAN-10
Erlan Bakiev, Ph. D

Experimental Research

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 Types of Research Questions

• Causal relationships
• Ethical and practical limitations
• Capable of manipulation conditions
• Narrow in scope
– Confounding variables
• Generally good for micro-level data
• Convention

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 History of Experimental Design

• Wilhelm M. Wundt (1832-1920)

• Behaviorism
• Quantification
• Introduction of anonymity
• Applied research

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
Random Assignment

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
Random Sampling

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
How to Random Assign

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 Matching vs. Random Assignment

• Matching

• Random Assignment

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 Experimental Design Logic
Language of Experiments

• Subjects
• Treatment
• Pretest
• Posttest
• Experimental group
• Control group

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 Experimental Design Logic
Steps in an Experiment

• Hypothesis
• Choose a design
• Design experiment
– How to introduce IV
– How to measure DV
• Locate subjects
• Randomly assign subjects
• Gather pretest data
• Run experiment
– Introduce treatment
– Measure DV
– Gather posttest data
– Debrief
• Analyze data
Copyright ©2011 by Pearson Education, Inc.
All rights reserved.
 Experimental Design Logic
Control in Experiments

• Controlling all aspects of the experiment

• Deception

• Confederate

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
Classical Experimental Design

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
Preexperimental Design

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 Quasi-experimental Design

• Two-Group Posttest-Only
• Interrupted Time Series
• Equivalent Time Series
• Latin Square
• Solomon Four-Group
• Factorial

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
Quasi-experimental Design

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
Copyright ©2011 by Pearson Education, Inc.
All rights reserved.
Internal and External Validity

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 Internal Validity
• Threats to internal validity
– Selection bias
– History
– Maturation
– Testing
– Instrumentation
– Experimental mortality
– Statistical regression

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 Internal Validity
• Threats to internal validity
– Diffusion of treatment
– Compensatory behavior
– Experimenter expectancy
• Double-blind/Single-blind
– Demand characteristics
– Placebo effect

• Manipulation check

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 External Validity
• Population generalization

• Naturalistic generalization
– Mundane realism
– Reactivity
• Hawthorne effect
• Theoretical generalization
– Experimental realism

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
External Validity

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.
 Practical Considerations

• Planning and pilot tests

• Instructions to subjects
• Postexperiment interview
– Debrief

Copyright ©2011 by Pearson Education, Inc.

All rights reserved.