Post Hoc Test in ANOVA

What are post hoc tests?

Post hoc tests are designed for situations in which the
researcher has already obtained a significant omnibus F-
test with a factor that consists of three or more means and
additional exploration of the differences among means is
needed to provide specific information on which means
are significantly different from each other.
 Type of post hoc procedures
The Least Significant Difference (LSD) Test
Tukeys HSD (Honestly Significant Difference) Test
Scheffes Test
Tukey-Kramer Test
Brown-Forsythes Test
Duncans Multiple Range Test
Newman-Keuls Test
 Duncans Multiple Range test and the
Newman-Keuls test provide different critical
difference values for particular comparisons
of means depending on how adjacent the
means are.

Both tests have been criticized for not

providing sufficient protection against alpha
slippage and should probably be avoided.
 LSD test
Explore all possible pair-wise comparisons of means
comprising a factor using the equivalent of multiple t-
tests.

This procedure was named the Least Significant

Difference (LSD) test.

The LSD is the minimum difference between a pair of

means necessary for statistical significance.
 The least significant difference between two means is

calculated by:

where,
MSE Mean Square Estimate) = MSW (Mean Square
With-in)
t = the critical, tabled value of the t-distribution with the
df associated with MSE, the denominator of the F
statistic and
n = the number of scores used to calculate the means
of interest.
df = the df of MSW
 Tukeys HSD test
Tukeys test was developed in reaction to the LSD test
and studies have shown the procedure accurately
maintains alpha levels at their intended values as long
as statistical model assumptions are met (i.e., normality,
homogeneity, independence).

Tukeys HSD was designed for a situation with equal

sample sizes per group, but can be adapted to unequal
sample sizes as well (the simplest adaptation uses the
harmonic mean of n-sizes).
 The formula for Tukeys is:

where,
q = the relevant critical value of the studentized range
statistic
n = is the number of scores used in calculating the
group means of interest.
df = MSW df
Studentized Range Statistics
 Scheffes test
Scheffes procedure is perhaps the most popular of the post
hoc procedures, the most flexible, and the most
conservative.
Scheffes procedure corrects alpha for all pair-wise or simple
comparisons of means, but also for all complex comparisons
of means as well.
Complex comparisons involve contrasts of more than two
means at a time.
As a result, Scheffes is also the least statistically powerful
procedure.
Scheffes is a poor choice of procedures unless complex
comparisons are being made.
 For pair-wise comparisons, Scheffes can be
computed as follows:

where,
k = no. of treatment
n1, n2, n3 = no. of observation of treatment 1, 2, 3,
N = total no. of observation of all treatments
k-1 = numerator degree of freedom
N-k = denominator degree of freedom
 The following table shows the results obtained in an investigation
into the stability of a fluorescent reagent stored under different
conditions. The values given are the fluorescence signals (in
arbitrary units) from dilute solutions of equal concentration. Three
replicate measurements were made on each sample. Test whether
the difference between the sample means is too great to be
explained by the random error.
 SUMMARY

Groups Count Sum Average Variance

A 3 303 101 1

B 3 306 102 3

C 3 291 97 4

D 3 276 92 4
ANOVA
Source of Variation SS df MS F P-value F crit
Condition 186 3 62 20.67 0.0004 4.07
Within Groups 24 8 3

Total 210 11
 Example

Thirty six modern-language students were randomly

assigned to one of three instructors and to one of three
texts. Achievement was measured on a test administered at
the end of the term. The scores and the design of the study
are shown in the table below. Apply the analysis of variance
at 5% significance level to the data and make the
necessary interpretations.
 Text Teachers
A B C
41 50 41
X 40 48 40
39 48 38
38 45 38
41 42 46
Y 39 42 43
38 41 43
38 40 42
43 45 41
Z 41 44 41
39 44 39
38 43 38
Sourceof
Variation SS df MS F Fcrit
Text 6.167 2 3.083 1.266 3.35
Teachers 145.5 2 72.75 29.87 3.35
Interaction 125.3 4 31.33 12.87 2.73
Within 65.75 27 2.435

Total 342.75 35