Professional Documents
Culture Documents
18
Experimental and
Quasi-Experimental
Research
Chapter ??
Chapter Outline
• Sources of invalidity
• Threats to internal validity
• Threats to external validity
• Controlling threats to internal validity
• Controlling threats to external validity
• Types of designs
Experimental Research Tries
to Establish Cause and Effect
• Selection of a good theoretical framework
• Application of appropriate experimental
design
• Use of correct statistical model and analysis
• Proper selection and control of independent
variables
• Appropriate selection and measurement of
dependent variables
• Correct interpretation of results
Three Criteria for Cause and Effect
• Randomization
– Real randomization
– Matched pairs (not matched groups)
– Randomizing treatments or counterbalancing
• Placebos
• Blind setups
(continued)
Controlling Threats to
Internal Validity (continued)
• Double-blind setups
• Reactive effects of testing: eliminate
pretest.
• Instrumentation
– Calibration and test reliability
– Halo effects
• Experimental mortality: keeping participants
Controlling Threats
to External Validity
One-shot studies
T O
One-group pretest-posttest
O1 T O2 Statistical analysis?
Static group comparison
T O1
--------------- Statistical analysis?
O2
Types of Designs:
True Experimental Designs
Randomized-groups design
R T O1 Statistical analysis?
R O2
Extending the levels—randomized-groups
design
R T1 O1 Statistical analysis?
R T2 O2
R O3
(continued)
Types of Designs:
True Experimental Designs (continued)
(continued)
Types of Designs:
True Experimental Designs (continued)
Statistical analysis?
(continued)
Types of Designs:
True Experimental Designs (continued)
Solomon four-group design—purpose
R O1 T O2
R O3 O4
R T O5
R O6
Statistical analysis (factorial ANOVA)
No treatment Treatment
Pretested O4 O2
Unpretested O6 O5
Quasi-Experimental Designs:
Reversal (Figure 18.1)
Quasi-Experimental Designs:
Time Series (Figure 18.2)
Quasi-Experimental Designs:
Ex Post Facto
T O1
-------------------- Statistical analysis?
O2
Quasi-Experimental Designs:
Switched Replication
Quasi-Experimental Designs:
Single Participant
(continued)
Quasi-Experimental Designs:
Single Participant (continued)