7/15/20

Introduction to Multi-Group Designs Results of the study (made-up data)

IV = Clinical condition
DV=Attention to adult

1 2

Analysis Multi-group designs

(aka Multiple-level designs)
of
Results

3 4

Hypothesis Testing measures Hypothesis Testing measures

• Null Hypothesis tests • Null Hypothesis tests
– Analysis of Variance – Analysis of Variance
• Two-step procedure • Two-step procedure
1. CONDUCT THE ANOVA on all conditions 1. CONDUCT THE ANOVA on all conditions
2. IF AND ONLY IF 2. IF AND ONLY IF
the ANOVA shows a significant effect, the ANOVA shows a significant effect,
conduct POST HOC tests (two group null hypothesis test) conduct POST HOC tests (two group null hypothesis test)

• Alternative Hypothesis tests • Alternative Hypothesis tests

– Overall effect size: eta squared h2 – Overall effect size: eta squared h2
– From Post hoc analyses: – From Post hoc analyses:
• Cohen’s d • Cohen’s d We won’t
do these
• Confidence Intervals • Confidence Intervals by hand

5 6

1
 7/15/20

Results of the study (made-up data)

IV = Clinical condition
DV=Attention to adult

Calculating F and h2

7 8

Results of the study (made-up data) Results of the study (made-up data)
IV = Clinical condition IV = Clinical condition
DV=Attention to adult DV=Attention to adult

9 10

Total Total
Variability Variability
SSTOTAL SSTOTAL

Between-Groups Within-Groups Between-Groups Within-Groups

Variability Variability Variability Variability
SSBetween SSWithin SSBetween SSWithin
Variability Explained by
Variability Explained by
EVERYTHING BUT
the INDEPENDENT VARIABLE the INDEPENDENT VARIABLE

11 12

2
 7/15/20

1. CALCULATE TOTAL VARIABILITY

1. CALCULATE TOTAL VARIABILITY
SSTOTAL
SSTOTAL

13 14

1. CALCULATE TOTAL VARIABILITY 1. CALCULATE TOTAL VARIABILITY

SSTOTAL SSTOTAL

15 16

The Data
IV = Clinical condition
1. CALCULATE TOTAL VARIABILITY DV=Attention to adult
SSTOTAL

17 18

3
 7/15/20

2. CALCULATE Within Group VARIABILITY 2. CALCULATE Within Group VARIABILITY

SSWITHIN SSWITHIN

19 20

2. CALCULATE Within Group VARIABILITY 2. CALCULATE Within Group VARIABILITY

SSWITHIN SSWITHIN

21 22

2. CALCULATE Within Group VARIABILITY 3. CALCULATE Between Group VARIABILITY

SSWITHIN SS BETWEEN

SSWITHIN = 8 + 6 + 8 = 22

23 24

4
 7/15/20

3. CALCULATE Between Group VARIABILITY 3. CALCULATE Between Group VARIABILITY

SS BETWEEN SS BETWEEN

25 26

3. CALCULATE Between Group VARIABILITY 3. CALCULATE Between Group VARIABILITY

SS BETWEEN SS BETWEEN

27 28

3. CALCULATE Between Group VARIABILITY

SS BETWEEN Create Source Table

29 30

5
 7/15/20

SS: You just calculated them Source Table

df BETWEEN = k-1 = 3-1 = 2

31 32

Source Table Source Table

df BETWEEN = k-1 = 3-1 = 2 df BETWEEN = k-1 = 3-1 = 2

df WITHIN = N-k = 9-3 = 6

df WITHIN = N-k = 9-3 = 6
df TOTAL = N-1 = 9-1 =8

33 34

Source Table Source Table

MSBetween = 126/2 = 63.0

MSWithin = 22/6 = 3.67

35 36

6
 7/15/20

Source Table Source Table

F =63.0/3.67 = 17.18

37 38

F-Ratio (formula for F-test) F-Ratio (formula for F-test)

AKA: Analysis of Variance or ANOVA AKA: Analysis of Variance or ANOVA

Differences due to the Independent Variable

F=
Differences due to unknown factors

Variability among Group Means

F=
Variability inside the groups

39 40

Source Table Table of Critical Values for F

41 42

7
 7/15/20

Table of Critical Values for F Table of Critical Values for F

F = MS Between
MSWithin

43 44

Table of Critical Values for F Table of Critical Values for F

45 46

47 48

8
 7/15/20

FCV = 5.14

49 50

Expanded Source Table What DOESN’T this tell us?

51 52

53 54

9
 7/15/20

55 56

57 58

POST HOC tests

59 60

10
 7/15/20

Tukey’s HSD Tukey’s HSD

This formula assumes equal sample sizes

across all conditions.

61 62

Q(3,6) =

63 64

Q(3,6) = 4.34

Q = 4.34 N=9
n=3

65 66

11
 7/15/20

Tukey’s HSD = 4.80 HSD = 4.80

| 3-6 | = 3.0
3.0 < 4.8
No significant difference

67 68

HSD = 4.80 HSD = 4.80

| 3-12 | = 9.0 | 6-12 | = 9.0

9.0 > 4.8 6.0 > 4.8
Significant difference Significant difference

69 70

EFFECT SIZE: Eta Squared EFFECT SIZE: Eta Squared

126 126
η 2 = SS BETWEEN = = 0.851 η 2 = SS BETWEEN = = 0.851
SS TOTAL 148 SS TOTAL 148

71 72

12
 7/15/20

Proportion of Variability of
EFFECT SIZE: Eta Squared DV ”explained by” IV
126 126
η 2 = SS BETWEEN = = 0.851 η 2 = SS BETWEEN = = 0.851
SS TOTAL 148 SS TOTAL 148

73 74

Expanded Source Table

75

13