Hypothesis

- Not specific when mode of delivery is referred to

- Hypothesis does not match research question
- Hypothesis is towards the end of the article
- No directionality in the hypothesis due to lack of supporting literature
Research Design
- Not clearly outlined in the article
- Mixed methods design (Quantitative : Cause and Effect)
- IV: mode of instruction (2 groups online vs. paper), DV: summative test, workload stress
Participants
- Pretest was not on actual skills regarding apostrophe usage.
- Should know about specific ages, discipline that theyre studying, whether they were required to
write papers, how they were selected (i.e. the sampling procedure)
- Unsure where the research takes place (are they British)?
- Were any students grad students?
- Should know students skill level with the English language (ex. grades in English courses), not
just their attitudes
o Is this a true pre-test?
What did you find interesting regarding the studys results?
- They state that the most outstanding result is that the paper-based lessons were significantly
higher than the online group, but they also state that the reasons behind the outcome need to
be examined (perhaps some of their potential reasons or influencing variables should have been
considered in the studys design).
- Topic itself may have influenced the findings more directly related to paper-based learning.
- Link between results and research questions Did the study results show the answers to the
research questions?
- Surprised that the results downplayed the statistical significance of mastering skills at high
school
- It was surprising that 24% did better on the paper-based lesson, given that there is a push for
online learning in general.
o What was the reason for this?
- There is detail given in the study, but it is not reproducible
NASA-TLX Scale
- Last item asks five questions in one
- Do not know how to score the items
- No mention of scales validity
Weaknesses
- Operational definition issue do not state what they mean by online learning
- Type of exercise had participants do things that do not happen in the classroom
Ethical Considerations
- Who approached the participants? (gave out studies in class)
- Was it a professor (power-interaction relationships)
- Was there an incentive to participate?
- No mention of who the instructors are
- Is there an issue with the peer review process (so many issues in this journal)