Hypothesis Testing

Attribution Non-Commercial (BY-NC)

38 views

Hypothesis Testing

Attribution Non-Commercial (BY-NC)

- 5HypothesisTesting.pptx
- STAT 201 (1).docx
- Introduction to the Practice of Basic Statistics (Textbook Outline)
- HW10-solu-F09[2]
- Assignment 02 (a)
- Marketing Research R Studio
- Weekly 3
- Stats Mock Exam
- 1-10
- EM561 Lecture Notes - Part 3 of 3[1]
- Sol_PQ220-6234F.Ch-10
- Chapter 9 Fundamental of Hypothesis Testing
- chelsea stats
- Abid ResearchMethods Vadodra
- articol biostatistica
- Agresti 9 Notes 2012
- Chapter 11 (2)
- Chap 008
- Hypothesis Testing
- W5INSE6220

You are on page 1of 30

Objectives:

Students should be able to identify the null and alternative (research) hypotheses in a statistical test Students should know the difference between one-and two-directional hypothesis testing Students should know what alpha, beta, power, and p-values are Students should be able to identify/define type I and type II errors Students should understand the differences between statistical significance and clinical importance Students should know how to determine statistical significance given alpha and a calculated p-value OR given alpha and a corresponding confidence interval

Hypothesis Testing

The second type of inferential statistics

Hypothesis testing is a statistical method used to make comparisons between a single sample and a population, or between 2 or more samples. The result of a statistical hypothesis test is a probability, called a p-value, of obtaining the results (or more extreme results) from tests of samples, if the results really werent true in the population.

Tests for quantitative data (i.e. comparing means): Two groups: t-test (paired or 2-sample) Two or more groups (ANOVA: analysis of variance) Tests for categorical (nominal, ordinal) data (i.e. comparing proportions): Chi-square, Fishers exact test Tests for association between two quantitative variables: Correlation and regression

Hypothesis Testing

In all hypothesis testing, the numerical result from the statistical test is compared to a probability distribution to determine the probability of obtaining the result if the result is not true in the population.

the normal and t-distributions

-4

-3

-2

-1

1. Formulate null and research hypotheses 2. Set alpha error (Type I error) and beta error (Type II error) 3. Compute statistical test and determine statistical significance 4. Draw conclusion

Null Hypothesis (H0): There is no difference between groups; there is no relationship between the independent and dependent variable(s). Research Hypothesis (HR): There is a difference between groups; there is a relationship between the independent and dependent variable(s).

Null and research hypotheses are either non-directional (two-tailed) or directional (one-tailed):

Non-directional (two-tailed): H0: Drug A = Drug B HR: Drug A Drug B Directional (one-tailed): H0: Drug A Drug B HR: Drug A > Drug B or H0: Drug A Drug B HR: Drug A < Drug B

NonRejection Region

NonRejection Region

Research question: Does age of onset of paranoid schizophrenia differ for males and females?

Non-directional (two-tailed): H0: Male Age = Female Age HR: Male Age Female Age

Rejection Region 2.5% NonRejection Region Rejection Region 2.5%

Directional (one-tailed): H0: Male Age Female Age HR: Male Age > Female Age (or the opposite)

NonRejection Region Rejection Region 5.0%

Alpha () is the level of significance in hypothesis testing:

Alpha is a probability specified before the test is performed.

By convention, typical values of alpha specified in medical research are 0.05 and 0.01. Alphas have corresponding critical values, the same ones used to calculate confidence intervals 0.05/1.96, 0.01/2.575

Beta () is the probability of accepting the null hypothesis when it is false.

Typical values for beta are 0.10 to 0.20

Beta is directly related to the power of a statistical test: Power is the probability of correctly rejecting the null hypothesis when it is false. Power = 1 - Beta A type II error occurs when a false null hypothesis is accepted.

P-values

P-values are the actual probabilities calculated from a statistical test, and are compared against alpha to determine whether to reject the null hypothesis or not. Example:

alpha = 0.05; calculated p-value = 0.008; reject null hypothesis

A type I error occurs when a true null hypothesis is rejected.

Null Hypothesis (Treatment A = Treatment B) POPULATION True (No difference) Decision Based on Inferential Statistical Test Accept H0 (No difference) Reject H0 (Difference) Correct Decision Type I Error (alpha () error) False (Difference) Type II Error (beta () error) Correct Decision Power (1-)

What are the null and alternative hypotheses for a two-tailed test? Null Hypothesis (H0) There is no difference in posttreatment mortality between the CABG and PTCA groups (the post treatment mortality is equal, i.e. P1 = P2) Research Hypothesis (HR) There is a difference in posttreatment mortality between the CABG and PTCA groups (the post treatment mortality is not equal, i.e. P1 P2)

Hypothesis Testing

on the type of test

then converted to a probability of obtaining that test statistic if the null hypothesis is true.

measurement being tested, and the variability of the measurement in the sample (the SE of the measurement).

Does age of onset of paranoid schizophrenia differ for males and females? H0: Male Age = Female Age HR: Male Age Female Age n 12 12 mean age 26.8 29.6 SD 5.8 6.2

Male Female

Test statistic:

(x1 x 2 ) t SE (x1 x 2 )

Does age of onset of paranoid schizophrenia differ for males and females? calculated test statistic: t = -1.142

Critical value of t for alpha = 0.05: + 1.960 The computed value of t does not exceed the critical value so the null hypothesis of no difference in age is not rejected (the p value is greater than 0.05) Conclusion: The mean age of onset is not different for males versus females

Is the post treatment mortality different for patients receiving CABG compared to patients receiving PTCA?

There are a number of statistical tests that can be used: 2 examples are 1) chi-square test, or 2) z test for proportions. The resulting p values will be the same regardless of the test used. The researchers used a z test: the p value from the test was 0.3508.

Is the post treatment mortality different for patients receiving CABG compared to patients receiving PTCA?

The p value is 0.3508 this is >0.05, so the conclusion from the study is that there is no difference

If there is truly no difference between CABG and PTCA, the probability of obtaining the difference of 0.6% is ~35%

Hypothesis Testing

Step 4 Draw conclusion about the population based on the results of the statistical test on the sample

Statistical conclusion: the results either are or are not statistically significant

BUT You need to interpret the results in a meaningful (and not just statistical) way

Principles for Statistical Significance 1. The size of a p value does not indicate importance of the result. 2. Interpret nonsignificance cautiously. a. finding no difference may be important b. statistically nonsignificant clinically unimportant 3. Results may be statistically significant but clinically trivial.

There is a direct relationship between levels of alpha set for a statistical test and the level set for constructing a confidence interval. For example, alpha = 0.05 for a 2-sided statistical test is equivalent to a 95% confidence interval

NonRejection Region

Statistical significance can be obtained from a confidence interval as well as a hypothesis test

AND

Confidence intervals convey more information than p values For this reason, most medical journals now prefer that results be presented with confidence intervals rather than p values.

If the NULL VALUE for a statistical hypothesis test using alpha = 0.05 is contained within the 95% confidence interval, we can conclude NO statistical significance at alpha = 0.05 without doing the hypothesis test:

Example: For differences between means or proportions, the null hypothesis is that the difference is equal to zero: If the 95% CI includes the value zero, the differences are not statistically significant at alpha = 0.05. For the test comparing the ages of males and females for onset of paranoid schizophrenia, the null hypothesis is that the difference in age is zero years.

P Values vs. Confidence Intervals Example: Male Female n 12 12 mean age 26.8 29.6 SD 5.8 6.2

The difference in age obtained from the sample is: 26.8-29.6 = -2.8 years The standard error of the difference is 2.45 (calculation not shown)

The 95% confidence interval is: -2.8 +/- 2(2.45) = -2.8 +/- 4.9 = -7.7 to 2.1 years

The 95% confidence interval is: -2.8 +/- 2(2.45) = -2.8 +/- 4.9 = -7.7 to 2.1 years This means that the true population mean difference in age is somewhere between males being 7.7 years younger to males being 2.1 years older than females

The 95% CI includes 0 years, so there is no statistically significant difference in age. In addition, we have information about the precision of our estimate of the difference, which cannot be obtained from p values alone.

Note: This is a relatively wide confidence interval because the sample size is small

We can be 95% confident that the true difference in mortality between CABG and PTCA is between 0.6% and +1.7%

This confidence interval contains the value zero; therefore, we could have concluded that the mortality is not different based on the confidence interval alone.

For ratio variables, such as relative risk and odds ratio, the value one represents equality. The null hypothesis is that the ratio is equal to one: If the 95% CI includes the value one, the difference is not statistically significant at alpha = 0.05.

- 5HypothesisTesting.pptxUploaded bySwati Sharma
- STAT 201 (1).docxUploaded byTran Pham Quoc Thuy
- Introduction to the Practice of Basic Statistics (Textbook Outline)Uploaded byEugene Johnson
- HW10-solu-F09[2]Uploaded byNimroz Momin
- Assignment 02 (a)Uploaded byrubelkk
- Marketing Research R StudioUploaded byasethi100
- Weekly 3Uploaded byMichael Nader Abdelshahid
- Stats Mock ExamUploaded bySteve Dang
- 1-10Uploaded bySaid Shoaib
- EM561 Lecture Notes - Part 3 of 3[1]Uploaded byAbel Carr
- Sol_PQ220-6234F.Ch-10Uploaded byzwolf
- Chapter 9 Fundamental of Hypothesis TestingUploaded byRayhan Atunu
- chelsea statsUploaded byapi-242022165
- Abid ResearchMethods VadodraUploaded byVivek Sharma
- articol biostatisticaUploaded bym_963934629
- Agresti 9 Notes 2012Uploaded bythanhtra023
- Chapter 11 (2)Uploaded bymaustro
- Chap 008Uploaded byThinesshvaranKanniappan
- Hypothesis TestingUploaded byChaitu Un PrediCtble
- W5INSE6220Uploaded byJaideep Singh
- StatisticsUploaded byCarlos de la Calleja
- skittles project epofolioUploaded byapi-220502804
- Ch8pUploaded byrohitrgt4u
- Hypothesis TestUploaded byKanav Gupta
- skittles project - senah parkUploaded byapi-388620252
- Assignment #3 Hypothesis TestingUploaded byJihen Smari
- Biomath 12Uploaded byHabib Mrad
- For Chapter 5Uploaded byAdriana Carinan
- Open Dialogue - The Widespread Abuse of Statistics by Researchers - What is the Problem and What is the Ethical Way FordwardUploaded byHircocervo
- Hypothesis Testing v1_1Uploaded byVbaluyo

- Managerial Accounting, Hilton, 7eUploaded byMohit Srivastava
- Concepts for CATHUploaded byMohit Srivastava
- IMO2013SLUploaded byHimansu Mookherjee
- IMO2012SLUploaded byHimansu Mookherjee
- 335 Retail Executive Specialty Stores Sector Leaflet 2011Uploaded byMohit Srivastava
- Managerial Accounting Chap 2, 7eUploaded byMohit Srivastava
- IMO2011SLUploaded byHimansu Mookherjee
- Managerial Accounting, Chap 4, 7eUploaded byMohit Srivastava
- Managerial Accounting, Chap 3, 7eUploaded byMohit Srivastava

- integratedreviewoftheliteratureUploaded byapi-455505955
- tmpCFF0.tmpUploaded byFrontiers
- w22991Uploaded byLUIS FERNANDO ESPINOZA
- Simple Test of HypothesisUploaded byRamoj Frogoso
- 436_-_Nurfadhila_R (1)Uploaded bySyafiqah Hasan
- E commerce.docUploaded bybuswas
- Andrews Six Keys RevisitedUploaded byNizam Muhamad
- Evidence From Strandings for Geomagnetic Sensitivity in CetaceansUploaded bygrattanuvole
- Quatitative analysisUploaded byGarick Bhatnagar
- Past 3 ManualUploaded byFernando Antonio Uribe Vasquez
- Spss Base User's Guide 12.0Uploaded bySheepCat
- 5 THE IMPACT OF DEPRESSION ON THE ACADEMIC PRODUCTIVITY OF UNIVERSITY STUDENTS.pdfUploaded byLim Shwe Wen
- [Larry_B._christensen]_Research Methods, Design, And AnalysisUploaded byZahra Amalia Kahfi Adila
- Moskovsky & Alrabai 2009 Intrinsic Motivation in Saudi Learners of English as a Foreign LanguageUploaded byhoorie
- MiniTablCg&CgkUploaded byRupesh Sangve
- “Consumer Involvement level of fast food industry in Lahore, Pakistan"Uploaded byFaHEEM DILAWAR
- spss20p4.pdfUploaded byAnand Nilewar
- [11]Trust in AdvertisingUploaded byIrina Găgeanu
- Stat992(Chap14)Uploaded byYanhua Lee
- wkshp maUploaded byapi-210827368
- Past 3 ManualUploaded byFrancisco Javier Parra Navarrete
- An Introduction to Statistics With Python With Applications in the Life SciencesUploaded bysreekanth22063140
- Week 6 Chick PointUploaded byMohammad Mazen
- MOTIVATION AND LEARNING STATUS OF SECONDARY STUDENTS AFFECTED BY MARAWI SIEGE: BASIS FOR PSYCHOSOCIAL INTERVENTIONUploaded bynico frits brioso
- Gender Stereotyping of Parents RepresntationUploaded bysmart_eng2009
- nmUploaded byTamara Colesnic Gandrabura
- 168 Sample ChapterUploaded byAnonymous jTY4ExM
- Anthropometry of Male Agricultural Workers of Western India for the Design of Tools and EquipmentsUploaded byRavindra vyavahare
- Chap 012Uploaded byBG Monty 1
- Solving Repeated Measures ANOVA ProblemsUploaded byBeba Echevarria

## Much more than documents.

Discover everything Scribd has to offer, including books and audiobooks from major publishers.

Cancel anytime.