STATISTIKA

PERTEMUAN XII

ONE-WAY ANALYSIS OF VARIANCE

INTRODUCTION
(Pallant, 2010: 249-254)

In the previous chapter, we used t-tests to compare the scores of two different
groups or conditions. In many research situations, however, we are interested in
comparing the mean scores of more than two groups. In this situation, we would use
analysis of variance (ANOVA). One-way analysis of variance involves one independent
variable (referred to as a factor) which has a number of different levels. These levels
correspond to the different groups or conditions. For example, in comparing the
effectiveness of three different teaching styles on students’ maths scores, you would have
one factor (teaching style) with three levels (e.g. whole class, small group activities, self-
paced computer activities). The dependent variable is a continuous variable (in this case,
scores on a maths test).
Analysis of variance is so called because it compares the variance (variability in
scores) between the different groups (believed to be due to the independent variable) with
the variability within each of the groups (believed to be due to chance). An F ratio is
calculated, which represents the variance between the groups divided by the variance
within the groups. A large F ratio indicates that there is more variability between the
groups (caused by the independent variable) than there is within each group (referred to
as the error term).
A significant F test indicates that we can reject the null hypothesis, which states
that the population means are equal. It does not, however, tell us which of the groups
differ. For this we need to conduct post-hoc tests.

ONE-WAY BETWEEN-GROUPS ANOVA WITH POST-HOC TESTS

One-way between-groups ANOVA is used when you have one independent
(grouping) variable with three or more levels (groups) and one dependent continuous
variable. The ‘one-way’ part of the title indicates there is only one independent variable,
and ‘between-groups’ means that you have different participants in each of the groups.

Summary for one-way between-groups ANOVA with post-hoc tests

Example of research question: Is there a difference in optimism scores for young, middle-
aged and old participants?

What you need: Two variables:

• one categorical independent variable with three or more distinct categories. This
can also be a continuous variable that has been recoded to give three equal groups

1
 (e.g. age group: participants divided into three age categories, 29 and younger,
between 30 and 44, 45 or above)
• one continuous dependent variable (e.g. optimism scores).
What it does: One-way ANOVA will tell you whether there are significant differences in
the mean scores on the dependent variable across the three groups. Post-hoc tests can
then be used to find out where these differences lie.

Interpretation of output from one-way between-groups ANOVA with post-hoc tests

Descriptives
This table gives you information about each group (number in each group, means,
standard deviation, minimum and maximum, etc.). Always check this table first. Are the
Ns for each group correct?

Test of homogeneity of variances

The homogeneity of variance option gives you Levene’s test for homogeneity of
variances, which tests whether the variance in scores is the same for each of the three
groups. Check the significance value (Sig.) for Levene’s test. If this number is greater than
.05 (> .05), you have not violated the assumption of homogeneity of variance. If it is smaller
than .05 (< .05), you have violated the assumption of homogeneity of variance. If you have
found that you violated this assumption, you will need to consult the table in the output
headed Robust Tests of Equality of Means. The two tests shown there (Welch and
Brown-Forsythe) are preferable when the assumption of the homogeneity of variance is
violated.

ANOVA
This table gives both between-groups and within-groups sums of squares, degrees
of freedom etc. You may recognise these from your statistics books. The main thing you
are interested in is the column marked Sig. (this is the p value). If the Sig. value is less
than or equal to .05 (≤ .05), there is a significant difference somewhere among the mean
scores on your dependent variable for the three groups. This does not tell you which
group is different from which other group. The statistical significance of the differences
between each pair of groups is provided in the table labelled Multiple Comparisons,
which gives the results of the post-hoc tests.
The means for each group are given in the Descriptives table. A Sig. value of less
than .05 indicates a statistically significant result somewhere among the groups. Having
received a statistically significant difference, we can now look at the results of the post-
hoc tests that we requested.

Multiple comparisons
You should look at this table only if you found a significant difference in your
overall ANOVA; that is, if the Sig. value was equal to or less than .05. The post-hoc tests

2
in this table will tell you exactly where the differences among the groups occur. Look
down the column labelled Mean Difference. Look for any asterisks (*) next to the values
listed.
If you find an asterisk, this means that the two groups being compared are
significantly different from one another at the p <.05 level. The exact significance value is
given in the column labelled Sig.

ACTIVITIES
1. Read 5.7 A Brief Overview of One-Way ANOVA in your main reference [Larson-
Hall, J. (2010). A guide to doing statistics in second language research using SPSS. New
York: Routledge] (pp. 139-140).
2. Read pp. 268-279 of your main reference.
3. Read the following explanations.

IMPORTANT TABLES

The study involved one categorical independent variable, i.e. differing amounts of
planning time, with three levels (categories or groups), i.e. NP (No Planning), PTP
(Pretask Planning), and OLP (Online Planning), and one continuous dependent variable,
i.e. Syntax Variety.

Table 10.3 Output from the One-Way ANOVA: Descriptives (p. 278)

Table 10.3 consists of descriptive statistics about the data, and you should check
the sample size in the first column to make sure all the participants you expected were
included. Notice that in this study each group has equal numbers of participants (N =
14). You can involve groups with different numbers of participants.

3
Table 10.4 Output from the One-Way ANOVA: Levene’s Test (p. 278)

Look at the Levene Statistic value. A significance value above .05 (> .05) means
that the groups have equal (homogeneous) variances. Look at df1 and df2 columns. The
df is the degree of freedom. Df1 is the degree of freedom for the groups, called the df
between groups, and df2 is the degree of freedom for the participants within groups,
called the df within groups. The df between groups is 2 (the number of groups, i.e. 3,
minus 1), and the df within groups is 39 (the sum of the number of participants in each
group (14 minus 1), i.e. 13 + 13 + 13).

Table 10.5 Output from the One-Way ANOVA: Omnibus One-Way ANOVA (p. 278)

For the variable of SyntaxVariety, the ANOVA table shows a statistical difference
among groups. To report this you will note the value of the F-test (9.05), the degrees of
freedom between groups (2) and within groups (39), and the p-value (p = .001).

4
Table 10.6 Output from the One-Way ANOVA: Post-Hocs (p. 279)

Since there are three groups, three unique comparisons are made (NP versus PTP,
NP versus OLP, and PTP versus OLP). Howell (2002) recommends the LSD test as the
most powerful post-hoc test to find differences if you only have three means. Table 10.6
shows the results of three post-hoc tests, namely Tukey HSD, LSD, and Games-Howell.
Look at the Mean Difference (I-J) and Sig. columns.
The results of the Tukey HSD test show there is a significant difference between
NP_No planning and PTP-PretaskPlanning (Mean Difference = -5.857 and Sig. = .000),
there is no significant difference between NP_No planning and OLP_OnlinePlanning
(Mean Difference = -2.643 and Sig. = .147), and there is no significant difference between
PTP-PretaskPlanning and OLP-OnlinePlanning (Mean Difference = 3.214 and Sig. = .063).
Check the rest on your own.

ASSIGNMENT

ONE-WAY ANALYSIS OF VARIANCE

Use fictitious data for the one-way analysis of variance to find out the difference
in the mean IELT posttest scores among the group learning through interactive learning
media, internet-based learning media, and power-point learning media. Use the data
from at least 20 students in each group.

5
HOW TO ORGANIZE THE DATA
As stated in the introduction, the one-way analysis of variance involves one
categorical variable (as the independent variable) and one continuous variable (as the
dependent variable). In this context, the independent variable is MEDIA_TYPES with
three levels, i.e. INTERACTIVE, INTERNET-BASED, and POWER-POINT. The
dependent variable is IELTS_SCORES (ranging from 4 to 8). Organize the data as follows.

No MEDIA_TYPES IELTS_SCORES
1 1 6
2 1 6.5
3 1 7
… … …
… … …
… … …
20 1 7.5
21 2 6
23 2 7
24 2 5.5
… … …
… … …
… … …
40 2 5
41 3 7
42 3 7
43 3 7.5
… … …
… … …
… … …
60 3 6.5

HOW TO ANALYZE THE DATA

1. Open the SPSS data sheet. Type the data on the SPSS data sheet. Click Variable
View. Label VAR00001 with MEDIA_TYPES and VAR00002 with IELTS_SCORES.
Click Values for MEDIA_TYPES. In Value Labels, type 1 in the Value box and
INTERACTIVE in the Label box. Click Add. Then, type 2 in the Value box and
INTERNET-BASED in the Label box. Click Add. Then, type 3 in the Value box and
POWER-POINT in the Label box. Click Add and then OK. Click Data View.
2. From the menu at the top of the screen, click on Analyze, then select Compare
Means, and then One-way ANOVA.
3. Click on your dependent (continuous) variable (IELTS_SCORES). Move this into
the box marked Dependent List by clicking on the arrow button.

6
 4. Click on your independent (categorical) variable (MEDIA_TYPES). Move this
into the box labelled Factor.
5. Click the Options button and click on Descriptive and Homogeneity of
variance test.
Click on Continue.
6. Click on the button marked Post Hoc. Click on LSD.
7. Click on Continue and then OK.

QUESTIONS
Based on the results of your data analysis, answer the following questions:
1. Are the variances of the three groups equal (homogeneous)? How do you know?
Show the Levene Statistic value and the Sig. value.
2. Is there any significant difference in the mean IELT posttest scores among the three
groups? How do you know? Show the F value and the Sig. value.
3. Is there any significant difference in the mean IELT posttest scores between each
pair of groups? Ho do you know? Show the Mean Difference (I-J) value and the
Sig. value.

ASSIGNMENT FORMAT

Include the following in your assignment:

1. Identity (name, student number, week, and submission date)
2. Raw data
3. Analysis results
4. Answers to the questions