INTRODUCTION TO

EXPERIMENTAL DESIGN
Stat Q2 Week 2
 Outline
1. Observational vs. Experimental
studies
2. Basic Terms in Experimental Design
3. The Four Principles in Experimental
Design
4. Completely Randomized Design
5. Randomized Complete Block Design

STAT 1 | Introduction to Experimental Design

 Observational vs.
Experimental Studies

Observational Study Experimental Study

A study where the researcher A study where variables are
does not interfere with the manipulated, and treatments are
subjects or variables. applied.

STAT 1 | Introduction to Experimental Design

Types of
Observational Studies
Prospective Study
an observational study in which subjects are
followed to observe future outcomes.

Example:
A group of 100 people with high risk factors
for AIDS are followed for 10 years to see if
they developed the disease. A second group
of 100 people who have low risk factors are
also followed for comparison.

STAT 1 | Introduction to Experimental Design

Types of
Observational Studies
Retrospective Study
an observational study in which subjects are
selected and then their previous conditions
or behaviors are determined.
Example:
A group of 100 people with AIDS might be
asked about their lifestyle choices and
medical history in order to study the origins
of the disease. A second group of 100
people without AIDS are also studied and
the two groups are compared.
STAT 1 | Introduction to Experimental Design
 Basic Terms in
Experimental Study

• Individual
• Factors
• Treatments
• Response

STAT 1 | Introduction to Experimental Design

 Designing Experimental Studies

In an experiment, there is a random assignment

of individuals to treatments.

Individuals may be people, animals, or objects

which are being studied in an experiment.
Subjects / Participants
refer to people whom the experiment will be conducted
Experimental Units
refer to inanimate objects such as plants and animals

STAT 1 | Introduction to Experimental Design

Example
A researcher would like to study the
effect of vitamin C doses on the tooth
growth of guinea pigs.

Individual Independent Variable

The experimental units in this Vitamin C dosage
study are the guinea pigs.
Dependent Variable
Tooth Length
STAT 1 | Introduction to Experimental Design
 Designing Experimental Studies

A factor is a variable whose levels are

manipulated by the experimenter. there is an
effect to the other variable. This is also called an
explanatory variable.

A treatment is a level of factors, or a

combination of the levels of different factors.

STAT 1 | Introduction to Experimental Design

Example
A researcher would like to study the
effect of vitamin C doses on the tooth
growth of guinea pigs.

Factor Treatments
Vitamin C dosage amount of Vitamin C (per day)
(0.5 mg, 1.0 mg, 2.0 mg)

Take note that there could be more than 1 factor in an experiment, thus there will be
combinations of levels in each factor (refer to the next example)
STAT 1 | Introduction to Experimental Design
Suppose a teacher is interested to know whether self -
regulated onscreen review is an effective method in studying
for exams. Two modes of review will be used (reviewer printed
on a paper and an online reviewer). Moreover, timed and self-
regulated (no time limit) review will be implemented. After the
review period, the students will take an exam and their scores
will be recorded.

Factor
- Mode of Review (2 levels)
- Time Limit (2 levels)
STAT 1 | Introduction to Experimental Design
Treatments
There are 4 treatments
- Online, with time limit
- Online, self-regulated
- Offline, with time limit
- Offline, self-regulated
 Recall: What is an
experiment?
A study where one or several variables are manipulated, and their
effect on a response variable is noted, all this while keeping other
things constant.

Main advantage of doing an experiment: Proof of Causality

STAT 1 | Introduction to Experimental Design

The Four Principles of
Experimental Design
Control | Randomize | Replicate | Block
 Control
Extraneous factors are factors that are not of
interest in the current study, but are thought
to affect the response.

We need to control sources of variation other than

the factors we are testing by making conditions as
similar as possible for all treatment groups.

STAT 1 | Introduction to Experimental Design

 Control: Example
If we want to compare the stain-removing ability of
detergents available in the market, we can control
the following variables: (1) type of water, (2)
temperature of water, (3) length of time of washing
the clothes, and (4) type of cloth.

However, the results of the experiment cannot be

generalized for the factors that have not been
tested.

STAT 1 | Introduction to Experimental Design

 Randomize
• In reality, we cannot control all extraneous
variables in the study. Hence, we randomize.
• By randomizing, subjects are randomly assigned
to the treatments.
• Randomization allows us equalize the effects of
unknown or uncontrollable sources of variation
because the effects of these unknown sources
are distributed across the treatments.
• Randomization is also done to avoid bias.
• “Control what you can, randomize the rest”
STAT 1 | Introduction to Experimental Design
 Replicate
• Assigning only one subject or experimental unit
per treatment will not make the study valid and
generalizable. Thus, we need to replicate.
• To replicate means placing several individuals in
each treatment.
• Replication allows us to see the variation of the
responses with respect to a particular treatment.
• Another kind of replication is when the entire
experiment is repeated on a different population
of experimental units.
STAT 1 | Introduction to Experimental Design
 Block
• To block means to group individuals together
based on their common characteristic, which you
are not interested to study, and to randomize
these individuals within each block.
• Blocking isolates the variability that is
attributable to the difference between the
blocks.
• However, block is not a required principle in an
experimental design.

STAT 1 | Introduction to Experimental Design

Control Treatments
Blinding | Placebo
 Control Group

A control group consists of experimental units

assigned to a “baseline” treatment level (control
treatment) typically either the default treatment
or a null, placebo treatment.

Main purpose: the response of the control group

provides basis for comparison.

SCIENCE CLASS | OLDMEAD SECONDARY SCHOOL

Example
A researcher would like to study the
effect of vitamin C doses on the tooth
growth of guinea pigs.

Factor: Vitamin C dosage

Treatments 0 mg 0.5 mg 1.0 mg 2.0 mg
Control treatment
Group assigned to Experimental Group
this treatment:
Control Group

STAT 1 | Introduction to Experimental Design

When comparing similar products in the
market, one common strategy is to
conceal the brands. Why?
HUMANS are susceptible to
ERRORS in judgement
 Blinding
A procedure in which one or more parties in an
experiment are kept unaware of which
treatment participants have been assigned to.

STAT 1 | Introduction to Experimental Design

 Blinding
Two classes of individuals who can affect the
outcome of an experiment:

Those who could influence the results.

Those who evaluate the results.

Single-blind experiment:
when either of these classes are blinded
Double-blind experiment:
when both of these classes are blinded
STAT 1 | Introduction to Experimental Design
 Placebo
A treatment known to have no
effect, administered so that all
groups experience the same
conditions.
Placebo effect - The tendency of
many human subjects (often 20%
or more of experiment subjects)
to show a response even when
administered a placebo
STAT 1 | Introduction to Experimental Design
 Types of
Experimental Design
Completely Randomized Design
Randomized Complete Block Design
Match Pairs Design
 Completely Randomized Design (CRD)
Each experimental unit is randomly assigned to a
random group to receive a treatment.

Example: A researcher would like to study the effect of vitamin C

doses on the tooth growth of guinea pigs. Suppose 20 guinea
pigs will be used for the study
Group A: 5 GP 0mg vit. C
Random

Group B: 5 GP 0.5mg vit. C Compare

20 Guinea Pigs tooth length
Group C: 5 GP 1.0mg vit. C
Group D: 5 GP 2.0mg vit. C
STAT 1 | Introduction to Experimental Design
 Randomized Complete Block Design (RCBD)

An experiment design in which participants are

randomly assigned to treatments within each block.

Example: After menopause, some women take supplemental

estrogen. There is some concern that if these women also drink
alcohol, their estrogen levels will rise too high. Twelve volunteers
who were receiving supplemental estrogen were randomly divided
into two groups, as were as 12 other volunteers not on estrogen. In
each case, one group drank an alcoholic beverage. An hour later,
everyone’s estrogen level was checked. Only those on supplemental
estrogen who drank alcohol showed a marked increase.
STAT 1 | Introduction to Experimental Design
 RCBD - Example
Individuals (participants): 24 postmenopausal women
Factor: Alcohol level (2 levels)
Treatment: alcoholic and non-alcoholic beverages
Blocking variable: Estrogen supplement intake (2 levels)
Response variable: Increase in estrogen levels
Group A:

Random
12 Women w/ alcohol
Taking estrogen 6 women Compare increase
24 supplement Group B: in estrogen level
no alcohol
Postmenopausal 6 women
Women 12 Women Group C:
w/ alcohol

Random
Not taking estrogen 6 women Compare increase
supplement Group D: in estrogen level
no alcohol
6 women
STAT 1 | Introduction to Experimental Design
Interfering Variables
Lurking | Confounding
Interfering Variables
Lurking Variable – a variable associated
with the independent variable (x) and
dependent variable (y) that makes it
appear that x may be causing y.

STAT 1 | Introduction to Experimental Design

Interfering Variables
Lurking Variable: Example
There is a strong, positive correlation
between ice cream sales and number of shark
attacks in a certain beach. What do you think
is the lurking variable in this scenario?

STAT 1 | Introduction to Experimental Design

Interfering Variables
Confounding Variable – is associated with
the independent variable (in a noncausal
way) and affects the dependent variable.

Two variables are confounded when their

effects on the response variable cannot
be distinguished.

STAT 1 | Introduction to Experimental Design

Interfering Variables
Confounding Variable – Examples
You want to study the effect of the amount of
fast food taken and the life expectancy. What
could be a possible confounding variable here?

You want to study the effect of varying

teacher’s teaching style to student’s
understanding of a lesson. What could be a
possible confounding variable here?
STAT 1 | Introduction to Experimental Design