ANOVA (Analysis of Variance)

An ANOVA test is a way to find out if survey or experiment results are

significant. They help you to find out if you need to reject the null hypothesis or accept
the alternative hypothesis. Basically, you’re testing groups to see if there is a
difference between them. Example of when you might want to test different groups:

 A group of psychiatric patients are trying three different therapies: counseling,

medication and biofeedback. You want to see if one therapy is better than
others.
 A manufacturer has two different processes to make light bulbs. They want to
know if one process is better than the other.

ANOVA (Analysis of Variance)

 It is a form of statistical hypothesis testing used in the analysis of

experimental data.
 An extension of 2-sample independent t-test.
 Its purpose is to test the significance of 3 or more independent population
means.

Properties of ANOVA:

1. ANOVA employs an additive data decomposition, and its sums of squares

indicate the variance of each component of the decomposition.
2. Comparisons of mean squares.
3. ANOVA provides strong statistical analysis
4. It has been adapted to the analysis of a variety of experimental design.

One-way ANOVA

 Random samples of size n are selected from each of k populations. The k

different populations are classified on the basis of a single criterion such
as different treatments or groups.
 It is used to test for differences among 3 or more independent groups
(mean)
 Comparing of 3 or more population means
 Single factor ANOVA

BUENAFLOR, MADONNA C.
Methods for testing the hypothesis:

𝐻0 : 𝜇1 = 𝜇2 = 𝜇3 = ⋯ 𝜇𝑘 𝑤ℎ𝑒𝑟𝑒 𝑘 = 𝑝𝑜𝑝𝑢𝑙𝑎𝑡𝑖𝑜𝑛

𝐻𝑎 : 𝑎𝑡 𝑙𝑒𝑎𝑠𝑡 𝑜𝑛𝑒 𝑚𝑒𝑎𝑛 𝑑𝑖𝑓𝑓𝑒𝑟𝑠 𝑓𝑟𝑜𝑚 𝑡ℎ𝑒 𝑜𝑡ℎ𝑒𝑟

Group 1 Group 2 Group 3

𝑥11 𝑥21 𝑥31
𝑥12 𝑥22 𝑥32
𝑥13 𝑥23 𝑥33
⋯ ⋯ ⋯
⋯ ⋯ ⋯
𝑥1𝑛 𝑥2𝑛 𝑥3𝑛
𝑇1 . 𝑇2 . 𝑇3 . 𝑇…

ANOVA TABLE

Source of variation Sum of Df Mean Square F computed

Squares
Column = Between SSB k-1 𝑆𝑆𝐵 𝑆12
𝑆12 =
𝑘(𝑛 − 1) 𝑆22
Error = Within SSW k(n-1) 𝑆𝑆𝑊
𝑆22 =
𝑘−1
Total = Total SST nk-1

For Equal Sample Size:

SST (Sum of Squares Total)

𝑇. .2
2
𝑆𝑆𝑇 = ∑ ∑ 𝑥𝑖𝑗 − =If equal sample size
𝑛𝑘
𝑗 𝑖

SSB (Sum of Squares in Between)

=If equal sample size

BUENAFLOR, MADONNA C.
 ∑ 𝑇𝑖 . .2 𝑇. .2
𝑆𝑆𝐵 = −
𝑛 𝑛𝑘
SSW (Sum of Square Within)

SSW= SST-SSB

For Unequal Sample Size:

2
𝑇. .2
𝑆𝑆𝑇 = ∑ ∑ 𝑥𝑖𝑗 −
𝑁
𝑗 𝑖

𝑇1 .2 𝑇2 .2 𝑇3 .2 𝑇. .2
𝑆𝑆𝐵 = + + =
𝑛1 𝑛2 𝑛3 𝑁

𝑆𝑆𝑊 = 𝑆𝑆𝑇 − 𝑆𝑆𝐵

Example 1:

Below are the ages that female get married in Valencia City, Malaybalay City
and Maramag at a 0.10 level of significance, perform an ANOVA Test to see if the
average age of marriage in these 3 municipalities are equal.

Valencia City Malaybalay City Maramag

18 18 21
19 20 22
20 16 17
21 20 18
22 21 22
23 20 19
18 18 21
19 19 20
20 17 18
21 13 23

Steps:

1. 𝐻0 : 𝜇1 = 𝜇2 = 𝜇3 = ⋯ 𝜇𝑘
𝐻𝑎 : 𝑎𝑡 𝑙𝑒𝑎𝑠𝑡 2 𝑚𝑒𝑎𝑛𝑠 𝑎𝑟𝑒 𝑛𝑜𝑡 𝑒𝑞𝑢𝑎𝑙
2. 𝛼 = 0.05
3. Critical Region: Reject H0 if 𝐹 > 𝐹𝛼,𝑣2,𝑣1
4. Test-statistic: F-test

BUENAFLOR, MADONNA C.
 5. Computation:
6. Decision:
7. Conclusion:

Solution:

1. 𝐻0 : 𝜇1 = 𝜇2 = 𝜇3
𝐻𝑎 : 𝑎𝑡 𝑙𝑒𝑎𝑠𝑡 1 𝑚𝑒𝑎𝑛 𝑖𝑠 𝑑𝑖𝑓𝑓𝑒𝑟𝑒𝑛𝑡
2. 𝛼 = 0.10
3. Critical Region: Reject H0 if 𝐹 > 2.51
4. Test-statistic: F-test
5. Computation:
2
∑∑𝑥𝑖𝑗 = 11 506
𝑇1⋅ = 201
𝑇2⋅ = 182
𝑇3⋅ = 201
𝑇⋅⋅ = 584

2042 + 1822 + 2012 5842

𝑆𝑆𝐵 = −
10 30
= 24.0667

5842
𝑆𝑆𝑇 = 11,506 −
30
= 137.4667

𝑆𝑆𝑊 = 137.4667 − 24.0667

= 113.4

ANOVA TABLE

Source of variation Sum of Df Mean Square F computed

Squares
Between 24.0667 27 0.8913 0.01
Within 113.4 2 56.7
Total 137.4667 29

6. Decision: Accept H0
7. Conclusion:

BUENAFLOR, MADONNA C.
Example 2:

Part of a study conducted at Virginia Tech was designed to measure serum

alkaline phosphatase activity levels (in Bessey-Lowry units) in children with seizure
disorders who were receiving anticonvulsant therapy under the care of a private
physician. Forty-five subjects were found for the study and categorized into four drug
groups:

G-1: Control (not receiving anticonvulsants and having no history of seizure

disorders)
G-2: Phenobarbital
G-3: Carbamazepine
G-4: Other anticonvulsants

From blood samples collected from each subject, the serum alkaline
phosphatase activity level was determined and recorded as shown in table. Test the
hypothesis at the 0.05 level of significance that the average serum alkaline
phosphatase activity level is the same for the four drug groups.

Serum Alkaline Phosphatase Activity Level

G-1 G-2 G-3 G-4
49.20 97.50 97.07 62.10 110.60
44.54 105.00 73.40 94.95 57.10
45.80 58.05 68.50 142.50 117.60
95.84 86.60 91.85 53.00 77.71
30.10 58.35 106.60 175.00 150.00
36.50 72.80 0.57 79.50 82.90
82.30 116.70 0.79 29.50 111.50
87.85 45.15 0.77 78.40
105.00 70.35 0.81 127.50
95.22 77.40

Solution:

1. H0: μ1 = μ2 = μ3 = μ4,

H1: At least two of the means are not equal.

2. 𝛼 = 0.05
3. Critical region: f > 2.836
4. Test statistic: F-test

BUENAFLOR, MADONNA C.
 5. Computations:

T1. = 1460.25,
T2. = 440.36,
T3. = 842.45,
T4. = 707.41, and
T.. = 3450.47.

1460.252 440.362 842.452 707.41 3450.472

𝑆𝑆𝐵 = ( + + + )−
20 9 9 7 45

= 𝟏𝟑, 𝟗𝟑𝟗

3450.472
𝑆𝑆𝑇 = 331,886.9701 −
45
= 𝟔𝟕, 𝟑𝟏𝟓

𝑆𝑆𝑊 = 𝑆𝑆𝑇 − 𝑆𝑆𝐵

𝑆𝑆𝑊 = 67,315 − 13,939

= 𝟓𝟑 𝟑𝟕𝟔

Source of variation Sum of Df Mean Square F computed P value

Squares
Between (SSB) 13 939 3 4646 3.57 0.022
Within (SSW) 53 376 41 1302
Total (SST) 67 315 44

6. Decision: Reject H0
7. Conclusion: Therefore, the average serum alkaline phosphatase activity levels
for the four drug groups are not all the same.

BUENAFLOR, MADONNA C.
Exercise 1:

Organophosphate (OP) compounds are used as pesticides. However, it is

important to study their effect on species that are exposed to them. In the laboratory
study, Some Effects of Oiyanophosphate Pesticides on Wildlife Species, by the
Department of Fisheries and Wildlife at the Virginia Polytechnic Institute and State
University, an experiment was conducted in which different dosages of a particular
OP pesticide were administered to 5 groups of 5 mice (peromysius leucopus). The 25
mice were female of similar age and condition. One group received no chemical. The
basic response y was a measure of activity in the brain. It was postulated that brain
activity would decrease with an increase in OP dosage. The data are as follows:

Animal Dose, Activity, 𝑦

𝑚𝑔
𝑥 ( 𝑘𝑔 𝑏𝑜𝑑𝑦 𝑤𝑒𝑖𝑔ℎ𝑡) (moles/liter/min)
1 0.0 10.9
2 0.0 10.6
3 0.0 10.8
4 0.0 9.8
5 0.0 9.0
6 2.3 11.0
7 2.3 11.3
8 2.3 9.9
9 2.3 9.2
10 2.3 10.1
11 4.6 10.6
12 4.0 10.4
13 4.6 8.8
14 4.6 11.1
15 4.6 8.4
16 9.2 9.7
17 9.2 7.8
18 9.2 9.0
19 9.2 8.2
20 9.2 2.3
21 18.4 2.9
22 18.4 2.2
23 18.4 3.4
24 18.4 5.4
25 18.4 8.2

Construct an analysis-of-variance table in which the lack of fit and pure error
has been separated. Determine if the lack of fit is significant at the 0.05 level. Interpret
the results.
BUENAFLOR, MADONNA C.
Exercise 2:

21 students at the University of Madrid in Spain were selected for an informal

study about student study skills; 7 first year, 7 second year, 7 third year
undergraduates were randomly selected. The study skills assessment has a maximum
score of 100. As researchers, we are interested in whether or not a difference exists
somewhere between the three different year levels. Test the hypothesis at the 0.05
level of significance.

First year Second year Third year

82 71 64
93 62 73
61 85 87
74 94 91
69 78 56
70 66 78
53 71 87

BUENAFLOR, MADONNA C.