QUANTITATIVE RESEARCH

METHODOLOGIES
(Experimental Research)
EXPERIMENTAL RESEARCH

Best research
methodology to
establish cause-and-
effect relatonships
among variables
EXPERIMENTAL RESEARCH

Tests hypotheses
about cause-and-
effect
relationships.
EXPERIMENTAL RESEARCH

Independent Variable Dependent Variable

Experimental or Criterion or Outcome

Treatment Variable Variable
Essential Characteristics of
Experimental Research

A. Comparison of groups

• 2 groups (experimental & control grps)

• experimental group receives treatment

• control group does not receive treatment

Essential Characteristics of
Experimental Research

B. Manipulation of the independent variable

• The independent variable may be

established as one form of the variable
versus another

Example: A study comparing the learning

by doing method with lecture method in
TLE.
Essential Characteristics of
Experimental Research

B. Manipulation of the independent variable

• The independent variable may be

established as the presence versus
absence of a particular form

Example: A study comparing the use of

DLP versus no DLP in teaching history.
Essential Characteristics of
Experimental Research

B. Manipulation of the independent variable

• The independent variable may be

established as varying degrees of the same
form

Example: A study comparing the effects of

different contact hours on students interest
in Mathematics.
Essential Characteristics of
Experimental Research

C. Randomization

• Subjects are randomly assigned to

groups.
• Random assignment:
- individual participants have the
chance of being assigned to any of the
two groups

- eliminates extraneous variables

3 things to remember about randomization
Randomization

1) takes place before the experiment begins

2) is a process of assigning or distributing

individuals to groups not a result of such
distribution

3) forms groups that are equivalent and

differ only by chance
GROUP DESIGNS IN
EXPERIMENTAL RESEARCH
Weak Experimental Designs

The One-Shot Case Study

A single group is exposed to treatment and

a dependent variable is observed
(measured) to assess the effect of the
treatment
Weak Experimental Designs

The One-Shot Case Study Design

X O
Treatment Observation
(Dependent Variable)

Weakness: Absence if any control - researcher has no way of knowing

if the results obtained at O are due to treatment X

Example: suppose you wish to see if a new textbook increasues

student interest in your course (history, science, statistics, etc.)
Weak Experimental Designs

The One-Group Pretest-Posttest Design

A single group is measured or observed

before and after the treatment.
Weak Experimental Designs

The One-Group Pretest-Posttest Design

O X O
Observation Treatment Observation
(Pretest) (Posttest)

Weakness: Uncontrolled-for threats to internal validity that might

explain the results of the posttest (Example: maturation, data collector
characteristics, etc.)
Example: suppose you want to assess the effects of weekly
counseling sessions on the attitudes of identified bullies in school
Weak Experimental Designs

The Static-Group Comparison Design

Two existing intact (static) groups are used

Also called nonequivalent control group
design
Weak Experimental Designs

The Static-Group Comparison Design

X O
O
X - treatment
Blank space - control (with no treatment or with a different treatmen)
O - observed
Dash - indicated that the two groups are not randomly assigned

Weakness: Uncontrolled-for threats to internal validity (Vulnerable to

maturity and location)

Example: Suppose you want to test the effect of a new textbook in increasing
interest of students in class. Find two intact groups, assign the new textbook to
one class and have the other class use the regular textbook, then measure the
degree of interest in both classes at the same time.
Weak Experimental Designs

The Static-Group Pretest-Posttest

Design

Two existing intact (static) groups are used

Pretest is given to both groups

Pretest score is subtracted from posttest

score, permitting analysis of "gain or
change"
Weak Experimental Designs

The Static-Group Pretest-Posttest Design

O X O
O O
Weakness: amount of gain often depends on initial performance
True Experimental Designs

Subjects are randomly assigned to

treatment and control groups.
True Experimental Designs

The Randomized Posttest-Only Control

Group Design

Involves two groups formed by random

assignment

One group receives treatment whike the

other does not, then both groups are
posttested
True Experimental Designs

The Randomized Posttest-Only Control Group Design

Treatment
Group
R X O
Control
Group
R C O
R - random assignment of individals to groups
X - treatment/exposure to treatment
C - control group
O - observation (measurement) of the dependent variable
Example

The Randomized Posttest-Only Control Group Design

R X O
50 teachers Dance for Posttest:
Peace Faculty Self-
100 randomly selected Training- Awareness
Workshop Questionnaire
teachers
R C O
50 teachers No training Posttest:
Faculty Self-
Awareness
Questionnaire
True Experimental Designs

The Randomized Pretest-Posttest

Control Group Design

Involves two groups formed by random

assignment

Both groups are pretested and posttested

Measurements or observations are

collected at the same time for both groups
True Experimental Designs

The Randomized Pretest-Posttest Control Group Design

Treatment
Group
R O X O
Control
Group
R O C O
R - random assignment of individals to groups
X - treatment/exposure to treatment
C - control group
O - observation (measurement) of the dependent variable
Example

The Randomized Posttest-Only Control Group Design

R O X O
50 teachers Pretest: Dance for Posttest:
Faculty Self- Peace Faculty Self-
100 randomly Awareness Training- Awareness
Questionnaire Workshop Questionnaire
selected
teachers O C O
R Pretest: No training Posttest:
50 teachers Faculty Self- Faculty Self-
Awareness Awareness
Questionnaire Questionnaire
True Experimental Designs

The Randomized Solomon Four-Group

Design

Involves random assignment of participants to four

groups with two groups being pretested and two
not

One of the pretested groups and one of the

unpretested groups is exposed to treatment.

All four groups are posttested

True Experimental Designs

The Randomized Solomon Four-Group Design

Treatment
Group
R O X O
Control
Group
R O C O
Treatment
Group
R X O
Control
Group
R C O
The first two groups represent the pretest-posttest control group
design, while the last two groups represent the posttest-only control
group design.
Example
The Solomon Four- Group Design
R O X O
25 Pretest: Dance for Posttest:
teachers Faculty Self-Awareness Peace Training- Faculty Self-Awareness
Questionnaire Workshop Questionnaire
R O C O
25 Pretest: No training Posttest:
teachers Faculty Self-Awareness Faculty Self-Awareness
100 Questionnaire Questionnaire
randomly R X O
selected 25 Dance for Posttest:
teachers teachers Peace Training- Faculty Self-Awareness
Workshop Questionnaire
R C O
25 No training Posttest:
teachers Faculty Self-Awareness
Questionnaire
True Experimental Designs

Random Assignment with Matching

Pairs of individuals are matched on certain

variables (choice of variables to match is based
on previous research, theory and/or experience of
researcher)

Members of each matched pair are assigned to

the experimental and control groups at random.
True Experimental Designs

The Randomized Posttest-Only Control Group Design,

Using Matched Subjects

Treatment
Group
Mr X O
Control
Group
Mr C O
Mr - Memhers of each matched pair are randomlyassigned to
experimental and control groups
True Experimental Designs

The Randomized Pretest-Posttest Control Group Design,

Using Matched Subjects

Treatment
Group
Mr O X O
Control
Group
Mr O C O
Quasi-Experimental Designs

No random assignment of
participants or subjects
Quasi-Experimental Designs

The Matching-Only Design

Participants (subjects) from intact groups are

matched.
Quasi-Experimental Designs

The Matching-Only Posttest-Only Control Group Design

Treatment
Group
M X O
Control
Group
M C O
M - Memhers have been matched but not randomly assigned
Quasi-Experimental Designs

The Matching-Only Pretest-Posttest Control Group Design

Treatment
Group
M O X O
Control
Group
M O C O
M - Memhers have been matched but not randomly assigned
Quasi-Experimental Designs

Counterbalanced Designs

Each group is exposed to ALL treatments in

different order. Order is determined randomly.

Any number of treatments may be involved.

Example

Three-Treatment Counterbalanced Design

Group I X1 O X2 O X3 O
Group II X2 O X3 O X1 O
Group III X3 O X1 O X2 O
Quasi-Experimental Designs

Time-Series Designs

Involve repeated observations or measuremetns

over a period of time both before and after
treatment.

Basic Time-Series Design

01 O2 O3 O4 O5 X O6 O7 O8 O9 O10
Factorial Designs

with or without random assignment of participants

or subjects

Extend the number of relationships that may be

examined in an experimental study.

The interaction of an independent variable with

one or more moderator variables can be studied.

Moderator variables may be either treatment

variables or subject characteristic variables.
Example

Factorial Design (2 x 2 factorial design)

Treatment R O X Y1 O
Control R O C Y1 O
Treatment R O X Y2 O
Control R O C Y2 O

Y1 and Y2 - moderator variables with two levels

Example

Factorial Design (2 x 2 factorial design)

X C
Y1

Y2
Example

Factorial Design (2 x 2 factorial design)

X C
Learning Lecture
by Doing
Y1
(Male)

Y2
(Female)