Professional Documents
Culture Documents
Goal: Make Statement(s) Regarding Unknown Population Parameter Values Based On Sample Data - Elements of A Hypothesis Test
Goal: Make Statement(s) Regarding Unknown Population Parameter Values Based On Sample Data - Elements of A Hypothesis Test
True State
H0 True Correct Type I Error
Decision
H0 False Type II Error Correct
Decision
H A : New Std 0
• Experimental (Sample) data:
y New y Std
s New sStd
nNew nStd
Sampling Distribution of Difference in Means
Y1 Y 2
Z ~ N (0,1)
2
2
1 2
n1 n2
• 12 and 22 are unknown and estimated by s12 and s22
Example - Efficacy Test for New drug
• Type I error - Concluding that the new drug is better than the
standard (HA) when in fact it is no better (H0). Ineffective drug is
deemed better.
– Traditionally = P(Type I error) = 0.05
y1 y 2
T .S . : zobs
s12 s22
n1 n2
P val : p P ( Z zobs )
Large-Sample Test H0:1-2=0 vs H0:1-2>0
y1 y 2
T .S . : z obs
s12 s22
n1 n2
R.R. : zobs z
P value : P ( Z zobs )
y1 10.1 s1 3.6 n1 33
y 2 7.7 s2 3.4 n2 35
Source: Wissel, et al (2001)
Example - Botox for Cervical Dystonia
Test whether Botox A produces lower mean Tsui
scores than placebo ( = 0.05)
H 0 : 1 2 0
H A : 1 2 0
10.1 7.7 2. 4
T .S . : zobs 2.82
2
(3.6) (3.4) 2 0.85
33 35
R.R. : zobs z z.05 1.645
P val : P ( Z 2.82) .0024
· Example:
· H0: 1- 2 = 0 HA: 1- 2 > 0
= n1 = n2 = 25
· Decision Rule: Reject H0 (at =0.05 significance level) if:
y1 y 2 y1 y 2
zobs 1.645 y1 y 2 2.326
2
2
2
1
2
n1 n2
Power of a Test
• Now suppose in reality that 1-2 = 3.0 (HA is true)
• Power now refers to the probability we (correctly)
reject the null hypothesis. Note that the sampling
distribution of the difference in sample means is
approximately normal, with mean 3.0 and standard
deviation (standard error) 1.414.
• Decision Rule (from last slide): Conclude population
means differ if the sample mean for group 1 is at least
2.326 higher than the sample mean for group 2
• Power for this case can be computed as:
2.326 3
Power P(Y 1 Y 2 2.326) P( Z 0.48) .6844
1.41
2 z 2
/2 z
n1 n2
2
Example - Rosiglitazone for HIV-1
Lipoatrophy
• Trts - Rosiglitazone vs Placebo
• Response - Change in Limb fat mass
• Clinically Meaningful Difference - 0.5 (std dev’s)
• Desired Power - 1- = 0.80
• Significance Level - = 0.05
2
2
Y 1 Y 2 ~ N 1 2 , 1 2
n n
1 2
• Thus, we can expect (with 95% confidence) that our sample
mean difference lies within 2 standard errors of the true difference
(1-)100% Confidence Interval for 1-2
y
2 2
s s
1 y 2 z / 2 1
2
n1 n2
• Standard level of confidence is 95% (z.025 = 1.96 2)
• (1-)100% CI’s and 2-sided tests reach the same
conclusions regarding whether 1-2= 0
Example - Viagra for ED
• Comparison of Viagra (Group 1) and Placebo (Group 2)
for ED
• Data pooled from 6 double-blind trials
• Subjects - White males
• Response - Percent of succesful intercourse attempts in
past 4 weeks (Each subject reports his own percentage)