Regression Tests

Predictor Variable Outcome Variable Research Question

Example
Simple linear  Continuous  Continuous What is the effect of
regression  1 predictor  1 outcome income on longevity?

Multiple linear  Continuous  Continuous What is the effect of

regression  2 or more  1 outcome income and minutes
predictors of exercise per day on
longevity?
Logistic regression  Continuous  Binary What is the effect of
drug dosage on the
survival of a test
subject?
Regression tests are used to test cause-and-effect relationships. They look for the effect of one
or more continuous variables on another variable.

Comparison tests

Predictor Variable Outcome Variable Research Question

Paired t-test
Independent t-test
Example
 Categorical  Quantitative What is the effect of
 1 predictor  groups come two different test prep
from the same programs on the
population average exam scores
for students from the
same class?
 Categorical  Quantitative What is the difference
 1 predictor  groups come in average exam scores
from different for students from two
populations different schools?

ANOVA  Categorical  Quantitative What is the difference

 1 or more  1 outcome in average pain levels
predictor among post-surgical
 patients given three
different painkillers?
MANOVA  Categorical  Quantitative What is the effect of
 1 or more  2 or more flower species on petal
predictor outcome length, petal width, and
stem length?

Comparison tests look for differences among group means. They can be used to test the effect of a
categorical variable on the mean value of some other characteristic. T-tests are used when comparing the
means of precisely two groups (e.g. the average heights of men and women). ANOVA and MANOVA
tests are used when comparing the means of more than two groups.
Choosing a nonparametric test

Non-parametric tests don’t make as many assumptions about the data, and are useful when one or
more of the common statistical assumptions are violated. However, the inferences they make aren’t as
strong as with parametric tests

Predictor variable Outcome variable Use in place of…

Spearman Ordinal Ordinal Regression and
correlation tests
Sign test Categorical Quantitative T-test
Kruskal–Wallis  Categorical Quantitative ANOVA
 3 or more
groups

Wilcoxon Rank-Sum  Categorical  Quantitative Independent t-test

test  2 groups  groups come
from different
populations

Wilcoxon Signed-  Categorical  Quantitative Paired t-test

rank test  2 groups  groups come
from the same
population

Correlation tests

Correlation tests check whether two variables are related without assuming cause-and-effect
relationships. These can be used to test whether two variables you want to use in (for example) a
multiple regression test are auto correlated.

Predictor variable Outcome variable Research question

example
Pearson Continuous Continuous How are latitude and
temperature related?
Chi-Square Categorical Categorical How is membership in a
sports team related to
membership in drama
club among high school
students?
Hypothesis Testing Decision Rule:

 If Calculated value < Table Value (Maximum Permissible Difference for given DOF and
LOS) then the differences are because of chance. (H0 not rejected)

 If p-value < 0.05 then a significant relation exists between the dependent & independent
variable i.e. it is because of some assignable cause (H0 rejected)

 If p-value > 0.05 then a no significant relation exists between the dependent & independent
variable i.e. it is because of chance only (H0 not rejected).