Topic:

Analysis of Variance (ANOVA)

Subject:
Analytical Chemistry
Submitted to:
Sir Arif
Submitted by:
Roll No. Name of Students
MCEC-19-12 Fatima-tul-Zahra
MCEC-19-30 Rimsha Razzaq
MCEC-19-37 Fatima Khan
MCEC-19-43 Sabahat Nosheen
MCEC-19-50 Samreen Kausar Laghari
MCEC-19-53 Sadia Maryam

BS Chemistry
4th Semester (2019-23)
EMERSON UNIVERSITY MULTAN
Analysis of Variance (ANOVA)
Analysis of variance is a statistical method used to test the difference between
two or more means. It may seem odd that the technique is called Analysis of Variance
rather than analysis of mean. But the name is appropriate because inferences about
the means are made by analyzing variance. Analysis of variance (abbreviated as
ANOVA) is an extremely useful technique concerning researches in the fields of
economics, biology, education, psychology, sociology, business/industry and in
researches of several other disciplines. This technique is used when multiple sample
cases are involved. As stated earlier, the significance of the difference between the
means of two samples can be judged through either z-test or the t-test, but the
difficulty arises when we happen to examine the significance of the difference
amongst more than two sample means at the same time. The ANOVA technique
enables us to perform this simultaneous test and as such is considered to be an
important tool of analysis in the hands of a researcher. Using this technique, one can
draw inferences about whether the samples have been drawn from populations
having the same mean
Example:
For example, we have four data sets.
B C D
B Same mean
C Same mean
D Same mean
C Different mean
D Same mean
D Same mean
The conclusion is that at least one mean is different from at least one other mean.
However, since that ANOVA does not reveal which means are different from which,
it offers less specific.
Information than Turkey HSD test. However, there is no logical or statistical reason
why we don't use the Tukey test. You might be wondering why you should learn
about ANOVA when the t-test is better. One reason is that there are complex types
of analysis that can be done with ANOVA, not with t-test.
The second is that ANOVA is the most commonly used technique for comparing
means and it is important to understand ANOVA to understand research reports.
Analysis of variance (ANOVA)
Professor R.A. Fisher was the first man to use the term ‘Variance’* and, in fact, it
was he who developed a very elaborate theory concerning ANOVA, explaining its
usefulness in practical field. Analysis of variance is an analysis tool used in statistics
that splits the aggregate variability found inside a data set into two parts.
i. Systematic factors
ii. Random factors

The systematic factors have a statistical influence on the given data set but the
random factor does not analyze. Analysis of variance test used to determine the result
that independent variables have on the dependent variable used as regression study
ANOVA is called the Fisher analysis of variance. It is the extension of the z-test and
t-test used for the analysis of variance in part
Formula:
The formula for F used in ANOVA is F= between group variance estimate
Group Variance Estimate:
𝑀𝑆𝐵
F= 𝑀𝑆𝑊
Every variance estimate has two parts the sum of squares and the (SSB and SSW)
And degree of freedom DF.
Importance of ANOVA
ANOVA technique one can, in general, investigate any number of factors which are
hypothesized or said to influence the dependent variable. One may as well
investigate the differences amongst various categories within each of these factors
which may have a large number of possible values. If we take only one factor and
investigate the differences amongst its various categories having numerous possible
values, we are said to use one-way ANOVA and in case we investigate two factors
at the same time, then we use two-way ANOVA. In a two or more way ANOVA, the
interaction (i.e., inter-relation between two independent variables/factors), if any,
between two independent variables affecting a dependent variable can as well be
studied for better decisions
Types of ANOVA
There are two types of analysis of variance or unidirectional and two way or factorial
ANOVA
One way or two way refers to the number of independent variables in your analysis
of variance test.
One-way ANOVA
One-way ANOVA has just one independent variable. one way ANOVA is used to
compare two means from two independent groups using f-distribution. The null
hypothesis for the test is that the two means are equal therefore a significant result
means that means are unequal.
when to use one way.
Situation 1:
You have a group of individuals randomly split into small groups and completing
different tasks. example: you might be studying the effects of tea on weightlessness
and form three groups: green tea, black tea and no tea.
Situation 2:
Similar to situation 1, but in this case the individuals are split into two groups based
on an attribute they possess. For example, you might be studying the leg strength of
people according to weight. you could split participants into weight categories
(overweight and normal) and measure their leg strength on a weight machine.
Limitations of One-way ANOVA
A One-way ANOVA will tell you that at least two groups were different from each
other. But it won't tell you what groups were different.
Two-way ANOVA
"Two-way ANOVA refers to an ANOVA using two independent variables."
Two-way ANOVA is an extension of one-way ANOVA.
When to use two-way ANOVA
A two-way ANOVA is used when you have one measured variable (i.e a quantitative
variable) and two nominal variables. In other words, if your experiment has a
quantitative outcome and you have two categorical explanatory variables, a two-way
ANOVA is appropriate.
For example:
You might want to find out if there is an interaction between income and gender for
anxiety level at job interviews. The anxiety level is the outcome or the variable that
can be measured. Gender and Income are the two categorical variables. These
categorical variables are also the independent variables, which are called factors in
a two-way ANOVA. The factors can be split into levels. In the above example,
income level could be split into three levels: low, middle and high income. Gender
could be split into three levels: male, female, and transgender.
Treatment groups are all possible combinations of the factors. In this example, there
would be
3 x 3 = 9 treatment groups.
Assumptions of Two-Way ANOVA
❖ The population must be close to a normal distribution.
❖ Samples must be independent.
❖ Population variance must be equal.
❖ Groups must have equal sample sizes.
Factorial ANOVA
A factorial ANOVA is an Analysis of Variance test with more than one independent
variable, or “factor“. It can also refer to more than one Level of Independent
Variable. For example, an experiment with a treatment group and a control group
has one factor (the treatment) but two levels (the treatment and the control). The
terms “two-way” and “three-way” refer to the number of factors or the number of
levels in your test. Four-way ANOVA and above are rarely used because the results
of the test are complex and difficult to interpret.
A two-way ANOVA has two factors (independent variables) and one dependent
variable. For example, time spent studying and prior knowledge are factors that
affect how well you do on a test.
A three-way ANOVA has three factors (independent variables) and one dependent
variable. For example, time spent studying, prior knowledge, and hours of sleep are
factors that affect how well you do on a test
Factorial ANOVA is an efficient way of conducting a test. Instead of performing a
series of experiments where you test one independent variable against one dependent
variable, you can test all independent variables at same time.
Main Effect and Interaction Effect
The results from two-way ANOVA will calculate the main effect and an interaction
effect. The main effect is similar to a one-way ANOVA each factor's effect is
considered separately. With the interaction effect, all factors are considered at the
same time. Interaction effects between factors are easier to test if there is one
observation in each cell. For the previous example, multiple stress scares could be
entered into cells. If you do enter multiple observations into cells the number in each
cell must be equal. Two null hypothesis are tested if you are placing one observation
in each cell. For example, these hypotheses would be
Ho1: All the income groups have equal mean stress.
Ho2: All the gender groups have equal mean stress.
For multiple observations in cells, you would also be testing the third
hypothesis.
Ho3: The factors are independent or the interaction effect does not exist.

Steps for ANOVA Table

The various steps involved are as follows:
1. Use the coding device, if the same simplifies the task
2. Take the total of the values of individual items (or their coded values as the
case may be) in all the samples and call it T.
3. Work out the correction factor as under:
Correction factor=(T)2/n
4. Find out the square of all the item values (or their coded values as the case
may be) one by one and then take its total. Subtract the correction factor from
this total to obtain the sum of squares of deviations for total variance.
Symbolically, we can write it as: Sum of squares of deviations for total
variance or
Total SS=ΣXij 2 -(T)2/n
5. Take the total of different columns and then obtain the square of each column
total and divide such squared values of each column by the number of items
in the concerning column and take the total of the result thus obtained. Finally,
 subtract the correction factor from this total to obtain the sum of squares of
deviations for variance between columns or (SS between columns).
6. Take the total of different rows and then obtain the square of each row total
and divide such squared values of each row by the number of items in the
corresponding row and take the total of the result thus obtained. Finally,
subtract the correction factor from this total to obtain the sum of squares of
deviations for variance between rows (or SS between rows).
7. Sum of squares of deviations for residual or error variance can be worked out
by subtracting the result of the sum of (v)th and (vi)th steps from the result of
(iv)th step stated above. In other words,
Total SS – (SS between columns + SS between rows) = SS for residual or
error variance.
8. Degrees of freedom (d.f.) can be worked out as under:
D.f. for total variance=(c.r–1)
D.f. for variance between columns = (c – 1)
D.f. for variance between rows = (r – 1)
D.f. for residual variance = (c – 1) (r – 1)
where c = number of columns r = number of rows
ANOVA table can be set up in the usual fashion as shown below: