RESEARCH DESIGN

Designs in quantitative research

 Detailed plan of the investigation

 A blueprint of the detailed
procedures of testing the
hypotheses and analysing the data
 Sequence of the steps taken ahead
 The selection of any research design is not
based upon the whims of the researcher, rather
it is based upon the purpose of the
investigation, types of variables and the
conditions in which the research is to be
conducted.
Functions of research design

 1. It answers the research questions as objectively, validly and

economically as it is possible
 2. It acts as a control mechanism
Helps the researcher to control unwanted variances
3 types of common variances
 Experimental Variance (Produced in the D.V by manipulating I.V)
Tries to maximize E.V
 Extraneous variance or Control Variance
Tries to minimize it
 Error Variance
Tries to minimize it
3 distinct features of Error Variance
 Error Variance is self- compensating because
sometimes the variability is positive and
sometimes the variability is negative
 in several repeated measurements the mean
of the error variance will be zero
 Unpredictable because it is based on random
errors
Criteria of a strong research design

 1. Capability to answer research

questions adequately
 2. Control of variables
 3. Generalizability
To the extent to which the results of the experiment
or research obtained can be generalized to subjects,
groups or conditions not included in sample of the
research
Basic Principles of Experimental
Design
(Ostle & Mensing, 1975)
1. Replication (permits revalidation of previous study
or raises some questions about the previous studies)

 2. Randomization (improves validity and control

extraneous variables)

 3. Local Control (the amount of balancing, blocking

and grouping of the subjects or the experimental units
employed in the experimental design)
Schematic representation of
Experimental design
Experimental
Design

Between-
groups design

Randomized Matched- Factorial

groups design groups design design

Two-
randomized
groups design

More than
two
randomized
groups design
 Within-
groups
design

Complete Incomplete
Factorial Design (Multi- groups
design)
 Can be defined as a design in which the selected values of two or
more independent variables are manipulated in all possible
combinations so that their independent as well as interactive effects
upon the dependent variable may be studied.
3 major characteristics of F.D
1. Two or more independent variables are manipulated in all possible
combinations
2. Different subgroups or subjects must serve under every possible
combination of the independent variables. An equal number of subjects
in all subgroups is preffered.
3. The factorial design enables the experimenter to study the
independent effect as well as the interactive effect of the two or more
variables.
Example
 Reseach problem
Do noise and illumination affect the rate of learning a list of 15 consonent
syllables?
Independent variables
A- Noise: High noisy condition(A1) and Low noisy condition (A2)
B- Illumination- High illumination (B1) and Low illumination (B2)
Dependent Variable
Rate of learning
Factorial Design: 2*2 (4 maximum possible combinations: A1B1, A1B2, A2B1,
A2B2)
2*2 Factorial design for two
independent variables

A1 (High noise) A2 (Low noise)

B1(High illumination) A1B1 A2B1

B2( Low illumination) A1B2 A2B2

Statistics used in Factorial
design
 Analysis of Variance (ANOVA)
- R A Fisher
Within- groups Design

 Same group of subjects will be treated differently in

different experimental conditions and finally, their
dependent variable scores are compared.
 Also called repeated- treatment design
 eg: Effect of a drugg upon retention of a verbal task
condition 1: Normal condition without drug
condition 2: with drug
Two types: 1. Two conditions and many subjects
2. More than two conditions and many subjects
Between- groups design Vs
Within- groups design
1) In a within- groups design the same group is used under all experimental
conditions whereas in a between-groups design a seperate group serves under
each exprimental condition
More economic
Easy to complete
2) Since the experimenter repeats the measures on the same group of subjects
in within-group design, the factor of individual difference is automatically
controlled.
Reduces the error variance
3) preparation time is less in Within- group design
4) Within- groups design cannot be used where there are practice effects and
fatigue effects (Transfer effects or Asymmetric transfer)
5) Within- groups designs are more appropriate in longitudinal studies
Experimental Design- Campbell
and Stanley Classification

Campbell & Stanley, 1963

Symbols
R: Random selection of subjects or random assignment of treatment to
experimental groups
X: Treatment or Experimental variable which is manipulated. When treatments are
compared, they are levelled as X1, X2 X3 etc
O: Observation or measurement of test. Where there is more than one 'O' an
arbitrary subscript O1, O2, O3 and so on, is used
One or more X and O in same row: Applied to the same persons
Parallel rows of symbols unseparated by a dashed line: groups have been equated
by randomization
Seperated by dashed line: groups have not been equated by randomization
1. Pre- experimental design (Non- designs)

Do not provide a Control group

Less internal validity
1. One- shot case study
XO
Treatment X is given to a single group and subsequently an
observation O is made to assess the effects of treatment upon the
group
2. One- group Pretest-Posttest Design
O1 X O2
The effects of treatment (X) are judged by making a comparison between pre-test and
Post-Test scores. No Control group is used.

3. Static-group Comparison (or Intact-group Comparison)

XO1
............
O2
Two groups are taken, one group (O1) gets the experimental treatment (X) and another
group does not experience the treatment (O2). Subsequently these groups are compared.
2. True Experimental Designs

Control group and experimental groups are formed

Equivalence is established through randomization
All the factors or variables contributing to to internal validity are controlled
1. Post test only, Equivalent- group design

R X O1
R O2

t Test or ANOVA can be used

2. Pre Test- Post Test Control goup Design
R O1 X O2
R O2 O2
Makes a provision for pre test for both groups before experimental and
control treatments are administered.

3. Solomon Four-Group Design

Developed by Solomon (1949)
Combination the two other designs
 R O1 X O2
R O3 O4
R X O5
R O6
The effect of X(treatment) is replicated in four ways: O2>O1;
O2>O4; O5>O6; and O4>O3
This design increases the external validity or generalizbility
ANOVA can be used
3. Quasi- Experimental Designs

 Quasi Experimental Designs are partly like true experimental designs

 They control some but not all extraneous variables, which give threats
to internal validity
 Randomzation is not followed
Campbell & Stanley (1963) proposed different types of quasi- experimental
designs
1. Time- Series Design
when a control group cannot be included
O1 O2 O3 O4 X O5 O6 O7 O8
 2. Equivalent Time- Sample Design
An extension of the Time-Series Design with the repeated introduction of
the treatment or the experimental variable
A single group is used and exposed to repeated treatments in some
systematic way
X1O1 X0O2 X1O3 X0O4
eg: Showing films on nationalism and attitude change of students
 2. Non- equivalent Control Group design

No scope for randomisation

Control group and Experimental groups are not equivalent
O1 X O2
......................
O3 O4
3. Counterbalanced Design (Cross over Designs)
The experimental control is achieved by randomly applying experimental
teatments

Gr. A X1O X2O X3O X4O

.................................................
Gr. B X2O X4O X1O X3O
..................................................
Gr. C X3O X1O X4O X2O
.................................................
Gr. D X4O X3O X2O X1O
............................................
Variables like history, maturation, testing, instrumentation and selection
Steps in Experimentation

Step 1 : Label the experiment (Deciding title, time and location of the
experiment)

Step 2: Review of the Literature

Step 3: Formulation of the problem

Step 4: Formulation of the hypothesis and defining the variables

Step 5: Preliminaries and apparatus (Prelimiaries- brief history of the

subjects including name, age-range,sex, educational status etc)
 Step 6: Control of extraneous variables

 Step 7: Design of the Experiment

 Step 8: Selection of subjects

 Step 9: Procedure of the experiment

 Step 10: Statistical treatment

 Step 11: preparartion of the discussion report

 Step 12: Generalization of the obtained findings