STAT6174– Probability Theory and

Applied Statistics
Topik – 8
Analysis of Variance
 LEARNING OUTCOMES
LO2 : Use proper statistical techniques for statistical
decision making in the real problem

LO3 : Use MINITAB software to conduct analyses

LO4 : Interpret the results of statistics calculation and output of

analysis using MINITAB

LO5 : Explain the suitable decision from statistical

method solution
 OUTLINE
• One-factor analysis of variance
• Multiple Comparison Method
• Experimental with two factors
• Application with MINITAB
One-factor analysis of variance
Definition

Analysis of variance is mainly used for tests

of hypotheses that three or more population
means are all equal against that at least one
mean is different.

is a technique for assessing how one or several

nominal independent variables (called
factors) affect a continuous dependent
variable.
Definition

ANOVA in which only one nominal independent

variable is involved is called 1-way ANOVA.

ANOVA in which only two nominal independent

variables are involved is called 2-way ANOVA.

ANOVA is an extension to the independent-two-

sample t test.
 ANOVA
• Statistical studies can be classified as either experimental or observational.
• In an experimental statistical study, an experiment is conducted to
generate the data.
• An experiment begins with identifying a variable of interest.
• Then one or more other variables, thought to be related, are identified and
controlled, and data are collected about how those variables influence the
variable of interest.
 Example

Suppose in an industrial experiment that an engineer is interested in

how the mean absorption of moisture in concrete varies among 5
different concrete aggregates.

Aggregates 1  may be interested

in making
Aggregates 2 individual
comparisons
among these 5
Aggregates 3 population means
 How the different
Aggregates 4 aggregates effect
on absorption of
Aggregates 5 moisture
 Example
The samples are exposed to moisture for 48 hours. It is decided that 6 samples
are to be tested for each aggregate, requiring a total of 30 samples to be tested.
 Assumptions

1. For each population, the response variable is normally

distributed.

2. The variance of the response variable, denoted σ2, is the same

for all of the populations.

3. The observations must be independent.

F Distribution
 Hypothesis Test
• A nominal independent variable with k treatment is called a
factor with k levels.
Hypothesis Test
 ANOVA Table
• ANOVA table is use to calculate test statistics F
 ANOVA Table

SSTR
 Example
Demonstrate that the aggregates do not have the same mean absorption. α =
5%
 Example
• Hypothesis :

H0: μ1 = μ2 = · · · = μ5 (the aggregates have the same mean

absorption)
H1: At least two of the means are not equal (the aggregates do not
have the same mean absorption)
 Example
• Statistic test :
SST = 209377
SSA= 85356
SSE = 209377 − 85356 = 124020
F= 4.30

• Critical region:
F > 2.76 with 4 and 25 degrees of freedom
 Example
• ANOVA table is use to calculate test statistics F

85356 4 21339 4,3

124020 25 4961
209377 29
Multiple Comparison Method
 Definition

If random variable X1 measures the number of successes

observed in a sample of size n1 from population 1, then

X1 ~ B(n1, p1)

Then random variable X2 measures the number of

successes observed in a sample size n2 from population 2,
then X2 ~ B(n2, p2)
Definition

ANOVA
The population means are not all equal

Multiple comparison procedures

Purpose : determine where the differences
among means occur
LSD Procedure
Experimental with two factors
 Definition

A completely randomized design is useful when the

experimental units are homogeneous. If the experimental
units are heterogeneous, blocking is often used to form
homogeneous groups.

A completely randomized block design is an extension of

paired samples to accommodate the comparison a set of k
population means or factor levels
 Definition
• A typical layout for the randomized complete block design using 3
measurements in 4 blocks is as follows :
• k × b Array for the RCB Design
 Hypothesis Test

TEST FOR THE EQUALITY OF k TREATMENT

Hypothesis
H0 : µ1 = µ2 = µ 3 = …. = µk
H1: At least two of the means are not equal
Test Statistics
MSTR
F 
MSE
Rejection Rule
Reject H0 if F > F(α,k-1,(k-1)(b-1))
 Hypothesis Test
TEST FOR THE EQUALITY OF b BLOCKS
Hypothesis
H0 : β1 = β 2 = β 3 = …. = βb
H1: At least two of the means are not equal
Test Statistics
MSBL
F 
MSE

Rejection Rule
Reject H0 if F > F(α,b-1,(k-1)(b-1))
 ANOVA Table
• ANOVA table is use to calculate test statistics F
 ANOVA Table
SSTR + SSBL + SSE

SSTR

SSBL
 Example
Four different machines, M1, M2, M3, and M4, are being considered for the
assembling of a particular product. It was decided that six different operators
would be used in a randomized block experiment to compare the machines.
The machines were assigned in a random order to each operator. The
operation of the machines requires physical dexterity, and it was anticipated
that there would be a difference among the operators in the speed with which
they operated the machines
Example
 Example
• ANOVA Table

Source of Sum of Degree of Mean

Variation Square freedom Square F
Machine 15.92458 3 5.308194 3.338779
Operator 42.08708 5 8.417417 5.294435
Error 23.84792 15 1.589861
Total 81.85958 23   
 Example
Hypothesis
H 0 : µ1 = µ2 = µ 3 = µ4
H1: At least two of the means are not equal
Test Statistics
F = 3.338779
Rejection Rule
Reject H0 if F > F(0.05; 3, 15)
Reject H0 if F > 3.2873
Conclusion:
Because 3.338779 > 3.2873 so H0 rejected. Then at least two of the speed means of Machines are not
equal.
 Example
Hypothesis
H0 : β1 = β 2 = β 3 = …. = β6
H1: At least two of the means are not equal
Test Statistics
F = 5.294435
Rejection Rule
Reject H0 if F > F(0.05; 5, 15)
Reject H0 if F > 2.9013
Conclusion:
Because 5.294435 > 2.9013 so H0 rejected. Then at least two of the speed means of Operators are not
equal.
Application with MINITAB
One Factor Analysis of Variance (Example 2)
Output
EXERCISES
(1)
(2)
 REFERENCES

Hayter, Anthony.J, (2012), Probabilty and Statistics for Engineers

and Scientiest 4th edition,Cengage Learning, Chapter 11