Professional Documents
Culture Documents
5 Hypothesis Testing
5 Hypothesis Testing
5 Hypothesis Testing
Objectives:
Students should know the difference between one-and twodirectional hypothesis testing
Students should know what alpha, beta, power, and p-values are
Hypothesis Testing
The second type of inferential statistics
Hypothesis testing is a statistical method used to
make comparisons between a single sample and a
population, or between 2 or more samples.
The result of a statistical hypothesis test is a
probability, called a p-value, of obtaining the results
(or more extreme results) from tests of samples, if
the results really werent true in the population.
Hypothesis Testing
In all hypothesis testing, the numerical result from the
statistical test is compared to a probability distribution to
determine the probability of obtaining the result if the result is
not true in the population.
Examples of
two
probability
distributions:
normal
distribution
t distribution
the normal
and tdistributions
-4
-3
-2
-1
Steps in Statistical
Hypothesis Testing
1. Formulate null and research hypotheses
2. Set alpha error (Type I error) and beta
error (Type II error)
3. Compute statistical test and determine
statistical significance
4. Draw conclusion
Directional vs
Non-directional
Hypotheses
Null and research hypotheses are either non-directional (two-tailed) or
directional (one-tailed):
Non-directional (two-tailed):
Directional (one-tailed):
H0: Drug A = Drug B
H0: Drug A Drug B
HR: Drug A Drug B
HR: Drug A > Drug B
or
H0: Drug A Drug B
HR: Drug A < Drug B
Rejection
Region
2.5%
NonRejection
Region
Rejection
Region
2.5%
NonRejection
Region
Rejection
Region
5.0%
Example:
Directional vs Nondirectional
Research question: Does age of onset of paranoid
schizophrenia differ for males and females?
Non-directional (two-tailed):
H0: Male Age = Female Age
HR: Male Age Female Age
Directional (one-tailed):
H0: Male Age Female Age
HR: Male Age > Female Age
(or the opposite)
Rejection
Region
2.5%
NonRejection
Region
NonRejection
Region
Rejection
Region
2.5%
Rejection
Region
5.0%
P-values
P-values are the actual probabilities calculated from
a statistical test, and are compared against alpha to
determine whether to reject the null hypothesis or
not.
Example:
alpha = 0.05; calculated p-value = 0.008; reject
null hypothesis
alpha = 0.05; calculated p-value = 0.110; do not
reject null hypothesis
A type I error occurs when a true null hypothesis is
Possible Outcomes in
Statistical Testing
Null Hypothesis
(Treatment A = Treatment B)
POPULATION
Decision Based
on Inferential
Statistical Test
Accept H0
(No difference)
Reject H0
(Difference)
True
(No difference)
False
(Difference)
Correct
Decision
Type II Error
(beta () error)
Type I Error
(alpha ()
error)
Correct
Decision
Power (1-)
Hypothesis Testing
Step 3
Compute statistical test and determine statistical
significance
Test statistic:
(x1 x 2 )
t
SE(x1 x 2 )
Hypothesis Testing
Step 4
Draw conclusion about the population
based on the results of the statistical test
on the sample
Statistical conclusion: the results either are
or are not statistically significant
BUT
You need to interpret the results in a
meaningful (and not just statistical) way
There is a direct relationship between levels of alpha set for a statistical test and the level set for
constructing a confidence interval.
For example, alpha = 0.05 for a 2-sided statistical test is equivalent to a 95% confidence interval
Rejection
Region
2.5%
NonRejection
Region
Rejection
Region
2.5%
If the NULL VALUE for a statistical hypothesis test using alpha = 0.05
is contained within the 95% confidence interval,
we can conclude NO statistical significance at alpha = 0.05
without doing the hypothesis test:
mean age SD
12
26.8
5.8
12
29.6
6.2