PCBA116 MODULE NO.

9
Analysis of Variance
(ANOVA)
 Analysis of Variance
• Analysis of variance (ANOVA) is
a statistical technique that is used
to check if the means of two or
more groups are significantly
different from each other. 

• Developed by Ronald Fisher in 1918.

 TERMINOLOGIES RELATED TO ANOVA

 Grand Mean- there are two kinds of means that we

use in ANOVA calculations, which are separate
sample mean and the grand mean

 Hypothesis- a hypothesis is an educated guess

about something in the world around us.
 TERMINOLOGIES RELATED TO ANOVA

 Between Group Variability- It refers to variations

between the distributions of individual groups (or
levels) as the values within each group are
different.

1 2
 TERMINOLOGIES RELATED TO ANOVA
 Within Group Variability- It refers to variations
caused by differences within individual groups (or
levels) as not all the values within each group are
the same.

2
TERMINOLOGIES RELATED TO ANOVA

 F-Statistic- The statistic which measures if

the means of different samples are
significantly different or not is called the F-
Ratio.
Examples of when you might want to test
different groups:
 A group of psychiatric patients are trying
three different therapies: counseling,
medication and biofeedback. You want to
see if one therapy is better than the others.
 Students from different colleges take the
same exam. You want to see if one college
outperforms the other.
 What Does One-Way ANOVA Mean?

ONE-WAY ANOVA
 A one way ANOVA is used to compare
two or more means from one
independent (unrelated) groups using
the F-distribution.
FORMULA:
Sum-of-square for between group variability

Where:
n=sample size
x=mean
G
of each class
x=grand mean

Sum-of-square for within group variability

f
Where:
x =elements of each group
x= mean of each class
Degrees of freedom for between group variation
dfbetween=k-1
Where:
k=number of the group or levels

Degrees of freedom for within group variation

dfwithin=(N-1) - (k-1) = N-1-k+1=N-k.
Where:
N=population

Mean Squares for between group variation

Divide the SSbetween by the dfbetween to get the MSbetween

Mean Squares for within group variation

Divide the SSwithin by the dfwithin to get the MSwithin

Once you have the variances, you divide them to find the F test statistic.
So, divide MS(between) by MS(within)  to get F.
Example:
A recent study claims that using music in a class
enhances the concentration and consequently helps
students absorb more information. As a teacher, your
first reaction would be skepticism.

What if it affected the results of the students in a

negative way? Or what kind of music would be a
good choice for this? Considering all this, it would be
immensely helpful to have some proof that it actually
works.
Null hypothesis
H0: there is no significant difference
between the three music treatments.

Alternative Hypothesis
H1: there is a significant difference
between the three music treatments.
 What Does Two-Way ANOVA Mean?

TWO-WAY ANOVA
 A Two Way ANOVA is an extension of
the One Way ANOVA. Use a two way
ANOVA when you have one
measurement variable (i.e. a quantitative
variable) and two nominal variables.
We already know how to calculate SS (within)/df (within) in our one-way
ANOVA section, but in two-way ANOVA the formula is different.

Where:
Yijk=elements of the class
Yij=mean of combination

dfsound=a-1
Where:
MSsound=Sssound/dfsound
r= number of replicates
a=number of factors
b=number of levels

dfage=b-1
Msage=SSage/dfsound
In two-way ANOVA, we also calculate SSinteraction and
dfinteraction which defines the combined effect of the two factors.
Calculate the F-test: Calculate critical F-value. If you
found the F-value less than the critical F-value then
you will not be able to reject the null hypothesis.

F-statistics

F1= MSsound/Mswithin

F2= MSage/MSwithin

F12= MSinteraction/MSwithin
A two-way ANOVA can have up to three hypotheses, which
are as follows:

Two null hypotheses will be tested if we have placed only one

observation in each cell. For this example, those hypotheses
will be:
H1: All the music treatment groups have equal mean score.
H2: All the age groups have equal mean score.

For multiple observations in cells, we would also be testing a

third hypothesis:
H3: The factors are independent or the interaction effect does
not exist.