Professional Documents
Culture Documents
Week 1
Research Principles
1
Research Principles
1. Research Questions
2. Treatment and Control Groups
These fundaments 3. Rationale for Random Assignment
will get things
started. 4. Statistical Hypothesis Test
5. Significance Level and P-value
6. Levels of Measure
7. Types of Variables
8. Statistical Selection
2
Research Questions
• Statistics can be used to answer a
variety of research questions
• Choice of statistics depends on:
– the research question
– how the data were gathered
– data configuration
– type(s) of variables in the data set
3
Research Questions
• Descriptive Statistics (Chapter 4)
– Descriptive statistics can be used to
describe and summarize a data set of
any size.
– Graphs (histograms with normal curve
and bar charts) provide further insight
of the data.
4
Research Questions
• Descriptive Statistics (Chapter 4)
– Questions answered:
• What percentage of students graduated?
• What’s the lowest age?
• What’s the highest age?
• What’s the average age?
5
Research Questions
6
Research Questions
• T-Test and Mann–Whitney U Test
(Chapter 5)
– Questions answered:
• What is the best way to teach a subject:
Method A or Method B?
• Which drug produces the best result:
Placebo or Drug A 20 mg?
• What lighting source enables fastest
reading: Regular room lighting or Acme
reading lamp?
7
Research Questions
• ANOVA and Kruskal–Wallis Test
(Chapter 6)
– Similar to the t-test
– Compares the scores of three or more
groups
– Usually involves a control group and
two or more treatment groups
– Indicates if any group significantly
outperformed any of the other groups
8
Research Questions
• ANOVA and Kruskal–Wallis Test
(Chapter 6)
– Questions answered:
• What is the best way to teach a subject:
Method A, Method B, or Method C?
• Which drug produces the best result:
Placebo, Drug A 20 mg, or Drug A 40 mg?
• What lighting source enables fastest
reading: Regular room lighting, reading
Acme lamp, or generic reading lamp?
9
Research Questions
• Paired T-test and Wilcoxon Test
(Chapter 7)
– Similar to t-test, but instead of two
groups, the sample is contained within
a single group
– Each member of the (single) group is
administered the same test twice:
(1) Pretest Treatment (2) Posttest
10
Research Questions
• Paired T-test and Wilcoxon Test
(Chapter 7)
– Questions answered:
• Does chocolate cake improve mood?
• Does a change in lighting enhance
productivity?
• Does a treatment reduce fever?
11
Research Questions
• Pearson Correlation and
Spearman Correlation
(Chapter 8)
– Compare two continuous variables to
determine their relationship to each
other
12
Research Questions
• Pearson Correlation and
Spearman Correlation
(Chapter 8)
– Questions answered:
• What is the relationship between grade and
homework hours?
• What is the relationship between income and
happiness?
• What is the relationship between height and
self-esteem?
13
Research Questions
• Chi-Square Test (Chapter 9)
– Compares categorical variables to
detect differences in proportions
among categories
14
Research Questions
• Chi-Square Test (Chapter 9)
– Questions answered:
• Is gender (Female, Male) associated with
ice cream flavor preference (Chocolate,
Strawberry, Vanilla)?
• Does parent’s marital status (Married,
Single) associated with high school
graduation (Graduated, Not graduated)?
• Is handedness (Right, Left, Ambidextrous)
associated with blood type (A-, A+, B-, B+,
AB-, AB+, O-, O+)?
15
Treatment and Control Groups
16
Treatment and Control Groups
• Research question
17
Treatment and Control Groups
Example 1: 1 Group Design
Treatment Group
22
Statistical Hypothesis Test
• A statistical hypothesis test is a formal procedure used to
decide whether the data at hand sufficiently support a
particular hypothesis.
• Format of hypotheses
– Hypotheses are clear statements about the outcome
possibilities:
• H0 is the Null hypothesis
– It states that there is no difference when comparing the
results of the Treatment group with the results of the
Control group (the treatment had a Null effect)
• H1 is the Alternative hypothesis
– It states that the Treatment group outperformed the
Control group
23
Statistical Hypothesis Test
• Example of hypotheses
24
Significance level and P-value
• The significance level α for a given hypothesis
test is a value for which a P-value less than or
equal to α is considered statistically significant.
• Typical values for α are 0.1, 0.05, and 0.01.
These values correspond to the probability of
observing such an extreme value by chance.
• The most commonly used significance level is
α = 0.05.
25
Significance level and P-value
28
Level of Measure
• Ordinal
– Similar to Nominal, but can be ordered (ranked)
– Numbers represent categories, hence cannot
perform traditional arithmetic on them
– Represent categories that have order
• Education: 1 = High school, 2 = AA, 3
= BA, 4 = MA, 5 = PhD
• Size: 1 = Small, 2 = Medium, 3 = Large
• Income: 1 = Low, 2 = Medium, 3 = High
29
Level of Measure
• Interval
– Numbers that are equally spaced (1, 2, 3,…)
– Range: -…+ (can be negative)
• Bank account balance: -$2.13…$6,578.09
• Temperature: -2°…95°
• Attitude: -5 = pessimistic…+5 = optimistic
30
Level of Measure
• Ratio
– Numbers that are equally spaced (1, 2, 3,…)
– Range: 0… (cannot be negative)
• Income: $0…$100,000
• Score: 0%…100%
• Age: 0…99
31
Types of Variables
• Variable type
(Categorical/Continuous) guides you
in selecting appropriate statistical
tests
Categorical Continuous
• Nominal • Interval
• Ordinal • Ratio
32
Statistical Selection
Statistic When to Use
Ch. 4 – Descriptive
Any continuous or categorical variable
Statistics
Ch. 5 – T-Test and
Two groups with continuous variables
Mann–Whitney U Test
Ch. 6 – ANOVA and More than two groups with continuous
Kruskal–Wallis Test variables
Ch. 7 – Paired T-Test and Compare pretest versus posttest
Wilcoxon Test (continuous variables within 1 group)
Ch. 8 – Correlation –
Two continuous variables
Pearson and Spearman
Ch. 9 – Chi-Square Test Two categorical variables
33