Paired t-tests and independent

sample t-tests

Email: greg.benson@ucumberlands.edu
Phone: 941-822-1000
Appointment: Text or email
Statistical Tests:
 Differences in two groups of data
• In many instances, it is necessary to compare
numeric data from two groups to see which one is
greater than the other. How do we know that
random chance did not cause the apparent
difference between groups if one group had a mean
score of 79 and the other produced an average
score of 81? In this instance, I am thinking about
continuous data, means, and normal curves,
whether skewed or not. Such a situation calls for a
t-test.
 T-test Basics
• Null Hypothesis for Independent and Paired
Samples T-Test is that the MEANS ARE SIMILAR.
This means that there is not a significant
difference between the means of the 2 groups.
• If the test results show a p-value of <.05, then
we reject the null hypothesis and say that there
is a significant difference between the means.
• (t [df] = t statistic, p less than or greater
than .05).
 What is the difference in types of t-tests?
• Before we go further, it is important to point out the
situational differences between a paired samples and
independent samples t-test. An independent samples t-
test is used to compare data from two groups when there
is no direct connection between the two groups (i.e.,
males and females). A paired samples t-test is used in a
pre- and post-test scenario. Another example would be
data on freshmen infractions as compared to the same
students’ infractions tallied during their sophomore year.
If you were comparing different groups of freshmen to
sophomores, then it would require an independent
samples t-test.
 Types of t- tests
• Independent samples • Paired samples also
also known as: known as:
– Two-Sample – Repeated Measures
Assuming Equal Variance – Matched Pairs
– Natural Pairs
– Correlated samples t-
tests
– Paired sample for means

T distribution on table D in Appendix C (Spatz, 10th edition)

 Degrees of Freedom
• Degrees of freedom of an estimate is the number of independent
pieces of information that went into calculating the estimate. It’s
not quite the same as the number of items in the sample. In order
to get the df for the estimate, you must subtract 1 from the number
of items.
• Why do we subtract 1 from the number of items? Another way to look at
degrees of freedom is that they are the number of values that are free to
vary in a data set.
• In a paired samples test, we subtract 1 from the number of pairs of data.
(N-1)
• In an independent samples test, we subtract 1 from the number of data
points in each set. (n-2)
 Table 8: Paired sample t-test Transactional Leadership MBE: Active and Laissez-Faire Leadership MBE: Passive

An example of a paired samples t-test from a

dissertation
• A paired sample t-test was
administered to compare data
generated between Transactional   MBE: Active MBE: Passive

Leadership MBE: Active and Mean 1.440298507 1.013432836

Laissez-Faire Leadership MBE: Variance 0.576684758 0.60936228

Passive. Data in Table 8 show a Observations 67 67

significant difference between the Pearson Correlation 0.468086249

samples Transactional Leadership Hypothesized Mean Difference 0

characteristic of Management by Df 66

Exception: Active (M = 1.44) and t Stat 4.398296847

the Laissez-Faire Leadership P(T<=t) one-tail 2.03352E-05

characteristic of Management by t Critical one-tail 1.668270515

Exception: Passive (M = 1.01), (t P(T<=t) two-tail 4.06705E-05

[66] = 4.39, p < .01).
t Critical two-tail 1.996564396  
 Let’s try a t-test together
• A teacher wanted to • How should she proceed?
know an intervention in – Since she is looking at the
her math class made a same students, before and
after the intervention, she
difference in student selects a pair two sample
scores. She gave the t-test.
students a pre-test – She loads the students
before the intervention, scores in excel (row one
and a post-test after the contains labels, row two is
student Aa__ , row three is
intervention. student Ab___,…)
 2. Select
Using excel: Data
Analysis
1. Select
the Data
Tab

3. Scroll
down to t-
test,
Paired
Two
Sample
for Means
Pre and Post Test Scores:
4. Click Variable 1 Range
Box, Highlight Column A
(Rows 1-21).
5. Click Variable 2 Range,
Highlight Column B (Rows
1-21).
6. Click the Box labels
(since row one does not
contain numbers, but
identifies our variables)
7. Click the output range
box, and select an open
cell (d18, for example).
8. Click OK.
Your screen
should look
like this now.
 The results
t-Test: Paired Two Sample for Means

  Pre-Test Post-Test
Mean 71 75.75
Variance 180.5263158 77.03947368
Observations 20 20
Pearson Correlation 0.238766431
Hypothesized Mean Difference 0
df 19
t Stat -1.497409772
P(T<=t) one-tail 0.075357904
t Critical one-tail 1.729132812
P(T<=t) two-tail 0.150715809
t Critical two-tail 2.093024054  

The pre-test scores (M = 71) were not significantly different

than the post-test scores (M = 75.75), (t [19] = -1.498, p
> .05).
In the previous slide, we
saw that the df is 19 and
the t-statistic is 1.50. The
T-critical value is 2.093.
Since the calculated t-stat
is less than the critical
value, we accept the null
hypothesis that the means
are similar, and that the p-
value is >.05

Look on the table, at 19 df, and for the alpha

level under .05 in the two-tailed test column.
 Choosing one-tail or two-tail
• The tail refers to the end of the distribution of the test statistic for the
analysis that you are conducting.

• A two-tailed test is appropriate if you want to determine if there is any

difference between the groups you are comparing. For instance, if you
want to see if Group A scored higher or lower than Group B, then you
would want to use a two-tailed test.
• A one-tailed test is appropriate if you only want to determine if there is a
difference between groups in a specific direction. So, if you are only
interested in determining if Group A scored higher than Group B, and you
are completely uninterested in possibility of Group A scoring lower than
Group B, then you may want to use a one-tailed test.
 An independent samples t-test example from
a dissertation
• Comparison of Post Legislation
Implementation on Energy Use in Energy Star
Districts and Districts that Employed Energy  
Energy Star Post-
Legislation (2013)
Energy Manager Post-
Legislation (2013)
Managers. As can be seen in Table 7, the
Mean 55.71905 61.82857
independent samples t-test for post
Variance 66.82162 134.5731
legislation Energy Star school districts and
post legislation school districts which Observations 21 21

employed energy managers indicated a Pooled Variance 100.6974  

significant post-legislation reduction in the

mean energy use among districts that were Hypothesized Mean Difference 0  
Energy Star districts (M = 55.72), compared df 40  
to districts that employed energy managers
t Stat -1.97284  
(M = 61.83); (t [40] = -1.972, p <.05). The
results were significant at the .05 level, in a P(T<=t) one-tail 0.027726  

one-tail test, which ruled out random t Critical one-tail 1.683852  

chance. Districts that were designated Energy P(T<=t) two-tail 0.055452  

Star had a greater reduction in energy t Critical two-tail 2.021075  

consumption than those districts that only
employed an energy manager.
 Let’s try another t-test
• A state administrator • How should he proceed?
was assigned two – He selected an independent
sample t-test to determine if
counties to evaluate there was a difference in the
their ACT performance. two district’s scores.
He wanted to know if – Columns were labeled for
there was a difference the two counties. He
randomly listed all the ACT
between ACT scores in scores for each student in
the districts even County A, in column A. He
though they use the randomly listed all ACT
scores for each student in
same common core. County B, in column B.
Click data tab, select data analysis
again. Scroll down to t-test two
sample assuming equal variances.
Next:

1. Click Variable 1 Range,

highlight Column A
(Rows 1-21.)
2. Click Variable 2 Range,
highlight Column B
(Rows 1-25).
3. Click Labels box.
4. Click output range, and
select a cell (d1, for
example).
5. Click OK.
 The results:
t-Test: Two-Sample Assuming Equal Variances

  County A County B
Mean 23.2 22.41666667
Variance 35.32631579 33.64492754
Always look Observations 20 24
at the two- Pooled Variance 34.40555556
Hypothesized Mean Difference 0
tail first. df 42
Is .66 greater t Stat 0.441089379
P(T<=t) one-tail 0.330705325 Next, look
than .05? t Critical one-tail
P(T<=t) two-tail
1.681952357
0.66141065
at the
t Critical two-tail 2.018081703   one-tail, is
.33
County B ‘s ACT scores (M = 22.4) were not greater
significantly different than County A’s ACT than .05?
scores (M = 23.2), (t [42] = .44, p > .05). There
is no significant difference in County A and
County B’s ACT performance.
 Next…
• Practice problems using excel to solve both paired
and independent sample t-tests.
• Understand the difference in paired and
independent sample. What do the results mean?
• Note: results that look like: 4.1203E-08 indicate a
very small number. If you get this result for the
two tailed test, then we report that p<.001