ONE WAY ANOVA

13.1 Analysis of Variance SSE=SST −SSC

Analysis of Variance (ANOVA) is used to test
hypothesis about three or more population means rather
than population variances. The F-test is used to test the
significance of the differences of the population means
named after R.A. Fisher.
Assumptions underlying the use of the ANOVA
1. The individuals in the various subgroups should be
selected on the basis of random sampling from
normally distributed populations.
2. The variances of the subgroups should be homogenous.
2 2 2 2
(σ 1 =σ 2 =σ 3 =.. .=σ n )
3. The samples that constitute the groups should be
independent.
The purpose of ANOVA, as the term implies, is to
establish the variations (or sources of differences) between
groups and within groups. In comparing the groups, there
are three possible sources of variation, these are:
1. Variation between groups (column means or
treatments).
2. Variation within groups (experimental error).
3. Total variation among the values of all groups.
When solving ANOVA problems, it is helpful to
organize the term that will be used in the computations into
a matrix called ANOVA table.
The following steps should be followed when
employing ANOVA:
1. State the null and alternative hypothesis
2. Level of significance
3. Test to be used
4. Establish the critical region: Reject Ho if
f ≥ f ∝, v 1 ,v 2 where ν1 =k−1, ν 2=N−k .
5. Computations:
a. SSC, SSE, SST
b. ANOVA table
6. Decision
7. Conclusion
Analysis of Variance for One Way Classification
Sum of Degrees
Source of Mean Computed
Square of
where: ni = sample size per group
N = total number of observations
k = number of groups
y ..=¿ grand total
y i . =¿ total of ith group/column
13.2 Post Hoc Analysis
A significant F ratio tells us that there are differences
between at least one pair of means. The purpose of post hoc
analysis is to find out exactly where those differences are. A
variety of different types of post hoc analysis allow us to
make multiple pairwise comparisons and determine which
pairs are significantly different and which are not. The
interpretation of this analysis is similar to that of the two-
sample t test.
A. For Equal Sample Size – use Tukey’s HSD
Tukey’s HSD (honestly significant difference) is one of
the most popular procedures used in post hoc analysis. This
test is used to test the hypothesis that all possible pairs of
means are equal. To perform this multiple comparison test,
we select an overall significance level, which denotes the
probability that one or more of the null hypothesis is false.
Those pairs whose differences exceed the HSD are
considered significantly different. The formula for
computing HSD is:
MSE
T RANCE =q α ,k , v
where:
2
√ n
q = Tukey’s table of critical values
MSE = error mean square
n = sample size per group
B. For Unequal Sample Size – use Scheffe’s Multiple
Comparison Test
Scheffe’s Multiple Comparison test will be computed
using the formula:
S RANGE=sδ
where:
s= √( k−1 ) (f α ,v )
, v2
1

Variation Square f

(√ n1 + n1 ) MSE
s Freedom
Column SSC δ=
Means
SSC k –1 MSC=
k−1 MSC 1 2
f= 13.3 EXAMPLES
SSE MSE
Error SSE N –k MSE=
N −k Illustration 1: The following represent the number of hours
of pain relief provided by 4 different brands of headache
Total SST N –1
k n 2
tablets administered to 20 subjects. The 20 subjects were
y.. randomly divided into 4 groups and each group was treated
SST =∑ ∑ y 2ij −
i=1 j=1 N with a different brand. Test the hypothesis at the 0.05 level
k 2 of significance that the mean number of hours of relief
y
i. y . .2 provided by the tablets is the same for all four brands.
SSC=∑ −
i=1 ni N Tablets

Page 1 of 3
 ONE WAY ANOVA
A B C D 6. Decision: Since f computed > f tabular , reject Ho
5 9 3 2 7. Conclusion: At least two of the means are not equal.
4 7 5 3 8. Post Hoc Analysis: use Tukey’s HSD (equal sample
8 8 2 4 size)
6 6 3 1 a. Determine the critical Trange
3 9 7 4
yi . 26 39 20 14 2. 78
ý i . 5.2 7.8 4.0 2.8
T RANGE =4 .05
T RANGE =3 .02
√ 5

Solution: b. Compare the absolute mean difference to that of

1. State the Null and Alternative hypothesis: Trange (consider the table below)
Ho: μ1=μ 2=μ3=μ 4 Absolute
Critical
Ha: at least two of the means are not equal Pairs Mean Description
TRANGE
2. Level of significance, ∝=¿ 0.05 Difference
3. Test Statistic: The test follows the F-distribution A–B 2.6 < 3.02 NS
4. Establish the critical region/Decision Rule: A–C 1.2 < 3.02 NS
v1 = k – 1 = 4 – 1 = 3 A–D 2.4 < 3.02 NS
v2 = N – k = 20 – 4 = 16 B–C 3.4 > 3.02 S
Reject Ho if computed f-value ≥ 3.24 B–D 5.0 > 3.02 S
5. Computation
C-D 1.2 < 3.02 NS
a. y ..=¿ 99
2
b. ∑yij =¿ 603 Interpretation: Pair B - C is significantly different. The
c. SST: mean number of hours of relief provided by B is
992 significantly different from the mean number of hours of
SST =603− relief provided by C. Also, the mean number of hours of
20 relief provided by B is significantly different from the mean
SST =112.95 number of hours of relief provided by D.
d. SSC: Illustration 2: A large marketing firm owns many
262 392 20 2 142 992 photocopy machines, several of each of different models.
SSC=
5
+
5
+ (
5
+
5
−
20 ) Over the last six months, the officer manager has tabulated
for each machine the average number of minutes per week
SSC=68.55
that it is out of service due to repairs, resulting in the
following data:
e. SSE = SST – SSC
SSE=44.4 y i . ý i .
Model A: 56 68 42 82 70 318 63.6
Model B: 74 77 92 54 297 74.25
Model C: 25 36 56 44 48 38 247 41.17

Test at the 0.01 level of significance whether the differences

among the four sample means are significant.

Solution:
ANOVA Summary Table 1. State the Null and Alternative hypothesis:
Source of Sum of Degrees of Mean Computed Ho: μ1=μ 2=μ3
Variation Squares Freedom Square f Ha: at least two of the means are not equal
Column 2. Level of significance, ∝=¿ 0.01
68.55 3 22.85
Means
3. Test Statistic: The test follows the F-distribution
Error 44.4 16 2.78 8.22 4. Establish the critical region/Decision Rule:
Total 112.95 19 v1 = k – 1 = 3 – 1 = 2
v2 = N – k = 15 – 3 = 12
Reject Ho if computed f-value ≥ 6.93
Page 2 of 3
 ONE WAY ANOVA
5. Computation: the mean number of minutes per week that machine C has
a. y ..=¿ 862 been out of service.
2
b. ∑ yij =¿ 54,674 EXERCISES:
c. SST: 1. Fifteen trainees in a technical program are randomly
8622 assigned to three different types of instructional approaches,
SST =54,674− all of which are concerned with developing a specified level
15
SST =5137.73 of skill in computer-assisted design. The achievement test
d. SSC: scores at the conclusion of the instructional unit are
reported below along with the mean performance score
3182 2972 247 2 8622
SSC=
5
+ (4
+
6
−
15 ) associated with each instructional approach. Use the
analysis of variance to test the null hypothesis that the three
SSC=2,908.95 sample means are equal, using the 1 percent level of
e. SSE = SST – SSC significance for the test.
SSE=2,228.78 Test Scores
A1 86 79 81 70 89
ANOVA Summary Table A2 90 76 88 82 81
Degrees A3 82 68 73 71 84
Source of Sum of Mean Computed
of
Variation Squares Square f
Freedom 2. The following data represents the semi-monthly salary of
Column the faculties (in thousands) of four state universities.
2908.95 2 1454.48
Means Faculties were randomly selected for each school. Is there a
Error 2228.78 12 185.73 7.831 significant difference among the salary of the faculties of
the four state universities?
Total 5137.73 14 State University
A B C D
6. Decision: Since f computed > f tabular , reject Ho 15 12 20 15
7. Conclusion: At least two of the means are not equal. 20 19 23 17
8. Post Hoc Analysis: use Scheffe’s Multiple Comparison 16 18 18 16
Test (unequal sample size) 13 10 16 12
a. Determine the critical Srange 17 30

s= ( k −1 )⋅F( α , v
√ =√ ( 3−1 )⋅6 .93=3 .723
1,v2)

δ A−B = (√ 15 + 14 )185 . 73=9. 14

δ A−C
√ 115 161
= ( + ) 185 . 73=8 . 25

δ B−C
√4 6
= ( + ) 185 . 73=8 . 80

b. Compare the absolute mean difference to that of

critical Srange (consider the table below)

Absolute Critical
Pairs Mean S RANGE=s δ Description
Difference
A–B 10.65 < 34.00 NS
A–C 22.73 < 30.69 NS
B–C 33.08 > 32.74 S

Interpretation: Pair B - C is significantly different. The

mean number of minutes per week that machine B has been
out of service due to repairs is significantly different from
Page 3 of 3