You are on page 1of 5

While statistical significance shows that an effect exists in a study, practical significance shows that the effect is large

enough t

Statistical significance alone can be misleading because it’s influenced by the sample size. Increasing the sample size always m

In contrast, effect sizes are independent of the sample size. Only the data is used to calculate effect sizes.

In statistics analysis, the effect size is usually measured in three ways: (1) standardized mean difference, (2) odd ratio, (3) corre

Pearson’s r, like Cohen’s d, can only be used for interval or ratio variables.
Nominal data - The effect size of the population can be known by dividing the two population mean differences by their stand
Categorical data - Common effect sizes for 2-by-2 tables are odds ratios (OR), risk ratios (RR), or the phi ( ϕ ) coefficient.

Cohen's d measures the size of the difference between two groups


while Pearson's r measures the strength of the relationship between tw
Cohen's D Pearson's r
0.2, it is considered a small effect .1 to .3 or -.1 to -.3 Effect size
E S 0.5, the effect is medium .3 to .5 or -.3 to -.5 a err prob
F I 0.8 or more, it is a large effect .5 or greater or -.5 or less power (1-B err prob)
F Z numerator df
E E
C Number of groups
T η 2
Number of measurements
0.01-0.06: small 1%-6% Corr aamong rep measures
0.06-0.14: medium 6%-14% Nonsphericity
>0.14:large >14%
hat the effect is large enough to be meaningful in the real world. Statistical significance is denoted by p values, whereas practical significan

sing the sample size always makes it more likely to find a statistically significant effect, no matter how small the effect truly is in the real w

fference, (2) odd ratio, (3) correlation coefficient.

ean differences by their standard deviation.


the phi ( ϕ ) coefficient.

Pearson’s r also tells you something about the direction of the relationship (positive/negative)
f the relationship between two variables For Pearson’s r, the closer the value is to 0, the smaller the effect size. A value close

tells you how meaningful the relationship between variables or the difference between group
rejecting the null hypothesis when it is actually true
power (1-B err prob) failing to reject the null hypothesis when it is actually false
numerator df levels-1??? is equal to the number of group associated to the factor minus one in th

Number of groups the number of levels in your between-subject factor. So say your design contains a factor "gen
Number of measurements the number of levels in your within-subject factor/repeated measure. So if you collected data
Corr aamong rep measures
Nonsphericity
es, whereas practical significance is represented by effect sizes.

the effect truly is in the real world.

(positive/negative)
er the effect size. A value closer to -1 or 1 indicates a higher effect size

the difference between groups is. It indicates the practical significance of a research outcome. A large effect size means that a research fin

d to the factor minus one in the case of a fixed factor. When interactions are studied, it is equal to the product of the degrees of freedom a

r design contains a factor "gender", the number of groups would be 2 (for male and female). If there is no between-subjects factor, you w
asure. So if you collected data at 4 different time points for example, the number of measurements would be 4.
size means that a research finding has practical significance, while a small effect size indicates limited practical applications.

ct of the degrees of freedom associated to each factor included in the interaction.

etween-subjects factor, you would enter 1.


tical applications.

You might also like