Professional Documents
Culture Documents
ABSTRACT. The aim of this study was to explore whether a representational approach
could impact on the scores that measure students’ understanding of mechanics and their
ability to reason. The sample consisted of 24 students who were undergraduate, preservice
physics teachers in the State University of Malang, Indonesia. The students were asked to
represent a claim, provide evidence for it, and then, after further representational
manipulations, refinement, discussion, and critical thought, to reflect on and confirm or
modify their original case. Data analysis was based on the pretest–posttest scores and
students’ responses to relevant phenomena during the course. The results showed that
students’ reasoning ability significantly improved with a d-effect size of 2.58 for the
technical aspects and 2.51 for the conceptual validity aspects, with the average normalized
gain being 0.62 (upper–medium) for the two aspects. Students’ conceptual understanding
of mechanics significantly improved with a d-effect size of about 2.50 and an average
normalized gain of 0.63. Students’ competence in mechanics shifted significantly from an
under competent level to mastery level. This paper addresses statistically previously
untested issues in learning mechanics through a representational approach and does this in
a culture that is quite different from what has been researched so far using student-
generated representational learning as a reasoning tool for understanding and reasoning.
INTRODUCTION
There has been widespread interest and concern amongst physics teachers
about student understanding of Newtonian mechanics. For example, some
research has investigated student difficulties in interpreting velocity and
acceleration (McDermott, Rosenquist & van Zee, 1987; Trowbridge &
McDermott, 1980, 1981), while other studies have utilized multiple-
choice tests such as the Force Concept Inventory (Hestenes, Wells &
Schwackhammer, 1992) and the Force and Motion Conceptual Evaluation
(Sokoloff & Thornton, 1998) that incorporate easily understood and non-
technical questions to investigate student knowledge. Some researchers have
shown that some students have difficulty with the concept of force
(Champagne, Klopfer & Anderson, 1980; Rosenblatt & Heckler, 2011). The
previous research has focused on upper high school or university students.
Characterizing Reasoning
It is reasonable to claim that a person’s ability to explain can indicate their
level of understanding. The Science Framework (NRC, 2012) states that
there is a need to justify one’s understandings with peers to ensure that
they are adequate and implies that this process is interactive.
In science, reasoning and argument are essential for identifying the strengths and
weaknesses of a line of reasoning and for finding the best explanation for a natural
phenomenon. Scientists must defend their explanations, formulate evidence based on a
solid foundation of data, examine their own understanding in light of the evidence and
comments offered by others, and collaborate with peers in searching for the best
explanation for the phenomenon being investigated. (NRC, 2012: 67).
Aim of Study
The aim of this study is to explore whether a representational approach
can impact the learning of mechanics and students’ ability to reason. That
is, the paper addresses lecturers’ perceived concerns about the inadequate
preparation of physics content knowledge. It adopts a largely student-
generated representational approach where students need to display their
understanding of mechanics through negotiating, validating, and reason-
ing (Waldrip, Prain & Sellings, 2013). The focus of this paper is restricted
to the achievement measures in the pre- and post-test and relates them to
levels of reasoning skills and mastery of mechanics concepts, rather than
providing an in-depth description of the implementation of the represen-
tational approach, especially dealing with the student–student talks during
their group discussions. That is, to what extent did a representational
approach to teaching and learning mechanics impact on students’ ability
to reason and their achievement scores?
METHOD
Context of Study
This study was implemented in a preservice physics teacher program in
Indonesia. Indonesian physics teachers are prepared through an undergrad-
uate, 4-year program. The curriculum is concurrent in that students learn
both content knowledge and pedagogical knowledge concurrently through-
out the program. For preparing students with deep physics content
knowledge, the first year students learn introductory physics that covers all
topics typically covered in university physics textbooks (e.g. Halliday,
Resnick & Walker, 2011; Serway & Jewett, 2010; Young, Freedman &
Ford, 2008). In the following years, students study other advanced physics.
746 SUTOPO AND BRUCE WALDRIP
Students learn physics through practical and theoretical classes. The current
curriculum provides a course designed to help students to grasp the essential
topics closely related to the school physics curriculum. Some universities
name the course the Selected Topic of School Physics (STSP). Historically,
this course was developed to address students’ markedly deficient
understanding of essential concepts of school physics when they com-
menced their teacher preparation program. A deep content knowledge and
good reasoning ability are critical competencies for becoming an effective
physics teacher in Indonesia.
This research implemented a representational approach to learning
mechanics on the STSP course, in the Physics Education Department, at
the State University of Malang, Indonesia. The physics topics covered in
this course include mechanics, sound waves, thermodynamics, and
electromagnetism. However, this research focused on students’ learning
of mechanics. Students enrolling this course have previously learned
mechanics through introductory physics and mechanics courses. The
study was implemented from August 2011 to December 2011 and
involved 24 students. Nineteen students were female, indicating female
domination in Indonesian preservice physics teacher education programs.
The teaching was conducted in English and Bahasa Indonesia, the
national language of Indonesia, as the students involved in this study were
being prepared to teach physics in National-Plus schools where science
and mathematics should be taught in English. Both the lecturer and the
students were expected to use English as much as possible in order to
improve students’ English skill. All teaching materials, including the test,
were provided in English. However, the lecturer allowed the students to
use Indonesian during small group discussions as well as in responding to
the test, both in the pretest and posttest.
The “generic outline” of the teaching and learning process can be
described as follows: (1) The lecturer exposes an open-ended, multifaceted
problem (see Fig. 1 as an example) and asks the students to solve the problem
using coherent multiple representations including tables, graphs, diagrams,
equations, and words. (2) Through collaborative work in a group of three to
four students, the students should construct and critique their representations
by arguing, writing, collecting data, drawing, modeling, and graphing in order
to solve the problem using coherent multiple representations. They also need
to prepare their best presentation and be ready to defend their work in the next
whole class discussion. (3) During this group discussion, the lecturer moves
around the groups and gives necessary prompts or assistance according to the
need of each group depending on: (a) Whenever students have a high degree
of certainty about their representations, the lecturer prompts them to justify
IMPACT OF A REPRESENTATIONAL APPROACH ON SUDENTS 747
Figure 1. A multiflash motion diagram for which students need to describe how
position, velocity, and acceleration change with time, as well as the net force acting on the
object. The images are taken successively every second
the physics of a roller coaster. It took 7 weeks, with one 3-h session a week, to
finish these topics. The representational task dealing with the first four topics
was similar, i.e., students constructed a comprehensive description of motion
using coherent multiple representations based on the given multiflash motion
diagram as described in advance. Students’ learning activities dealing with
the problem of “the physics of a roller coaster” were quite different. This
problem was designed to facilitate students in employing their skills and
knowledge that they have already acquired throughout solving the previous
problems. To solve this problem, students needed to apply their knowledge
about linear motion, parabolic motion, and circular motion in terms of both
their kinematics and dynamics aspects, as well as the basic concepts in
mechanics such as mechanical energy conservation and Newton’s laws of
motion. Students needed to have mathematical skills such as geometry,
IMPACT OF A REPRESENTATIONAL APPROACH ON SUDENTS 749
TABLE 1
Rubric to code the technical aspect of student’s reasoning quality, adapted from Furtak et
al. (2010)
TABLE 2
Rubric to code the conceptual validity aspect of student’s reasoning
Fully valid 3 Claim is correct and follows from the relevant and correct
backup
Partially 2 • Claim is correct but the backup is not fully appropriate
valid (incomplete or partially irrelevant), or
• Claim is incorrect since it follows from an inappropriate
backup
Invalid 1 • Claim is incorrect since it follows a fully incorrect
backup or does not logically follow from backup, or
• Claim is correct but fully follows incorrect backup
Unidentified 0 • No rationale, or the rational is tautological
between item score with total score varied from 0.32 (pG0.05) to 0.62 (pG
0.01); the item’s discrimination index varied from 0.29 (moderate) to 0.86
(very high), and the item difficulty index varied from 0.12 (difficult) to 0.63
(moderate). This pilot study corroborated the claim of Hestenes & Wells
(1992) that the test was not easy. The Cronbach’s Alpha coefficient of this
instrument was 0.81, indicating a very good reliability (Everitt & Skrondal,
2010). For checking the coding reliability, 25 % of the reasoning units were
coded by the primary rater (researcher) and one secondary independent rater.
There were 528 reasoning units (i.e. 24 students×22 items) for each data set.
The percentage agreement of the two raters was 78 % for the technical aspect
and 87 % for the conceptual validity aspect; yielding Cohen’s kappa of 0.71
and 0.80, respectively.
Quantitative analysis included Cohen’s d-effect size (Ellis, 2010) and
normalized gain (N-gain) (Hake, 1998). The average N-gain is defined as
〈g〉 ¼ 〈posttest〉−〈pretest〉
100−pretest , where the maximum score has been scaled to 100. In
this study, the categorizations used were: low if 〈g〉 G 0.25, lower–medium if
0.25 ≤ 〈g〉 G 0.45, upper–medium if 0.45 ≤ 〈g〉 G 0.65, and high if 〈g〉 ≥ 0.65.
provide an adequate response but did not explore why this response was
correct.
The mean of the posttest was greater than that of the pretest (Fig. 3, right).
A paired-samples ttest yielded t = 14.12, p = 0.00 (two-tailed), suggesting
that the representational approach implemented in this research improved
students’ understanding of mechanics concepts. The improvement was
strong as its d-effect size was 2.5, in the category of “much larger than
typical” (Morgan, Leech, Gloeckner & Barrett, 2004, p.91), and Hake’s
average N-gain was 0.63 (upper–medium category). Students with lower
TABLE 3
Mechanics concepts covered by the MBT and the lesson
Figure 3. Scatter plots of N-gain versus the pretest (left) and posttest versus pretest
(right). The mean of the pretest (dashed vertical line), posttest (horizontal line in figure
right), and N-gain (horizontal line in figure left) was 39.2 (SD = 15.3), 77.5 (SD = 13.0),
and 0.64 (SD = 0.17) respectively. The bullets represent single data, while the squares
represent double data
(less than the average) pretest score tended to get a lower gain, and vice versa
(Fig. 3, left). This suggests that most students took proportional advantage
from the teaching-learning process to improve their understanding of
mechanics concepts.
It is useful to examine the improvement of students’ understanding in
terms of their competence in mechanics. Hestenes & Wells (1992) argued that
a score of 60 % on the MBT is the threshold for problem-solving competence.
Below this threshold, students’ grasp of Newtonian concepts is too limited for
effective problem solving. A score of 80 % is the threshold for mastery of
basic Newtonian concepts. They believed that when this is approached, other
goals of physics instruction would be much easier to attain. We define
students’ mechanics competence levels as follows: “under-competent” if the
MBT score is G60.0 %, “competent in problem solving” if there is a 60.0 %≤
MBT score G80.0 %, and “mastery in basic Newtonian mechanics” if the
MBT score is ≥80.0 %. Figure 3 (right) shows that the approach successfully
assisted most students to jump from an “under-competent” level to the
“mastery” level. Moreover, there were no students in the mastery level before
instruction, whereas 50 % of students were in this level after instruction.
The low result of the students’ mechanics competence before instruction
was not expected as they had previously taken first semester courses in
Mechanics and Introductory Physics. This phenomenon was similar to our
previous study (Sutopo, Waldrip & Rusdiana, 2011) involving 35 students
who had taken Introductory Physics, plus 24 students who had taken both
754 SUTOPO AND BRUCE WALDRIP
diagram; (3) could not define the change of position (Δx) even though they
had been able to make vector operations such as (A+B) and (A−B) where A
and B are vectors unconnected to any physical quantity; and (4) believed that
acceleration was always in the same direction as the velocity, the minus sign
on acceleration meant deceleration, and acceleration should be inferred from
the resultant force; but not in reverse. It can be believed that these deficiencies
in understanding have caused the low student scores on the pretest.
The students worked in small groups where they developed solutions
as a group and developed a common response as to why their solution
was adequate. During this process, students made and justified a claim as
to the solution, through student–student and a group–teacher dialogue.
The following transcript shows an example of a dialogue in a group when
the group attempted to describe how velocity changes with time. This
dialogue happened when the group had described how position changes with
IMPACT OF A REPRESENTATIONAL APPROACH ON SUDENTS 755
time. Students discussed the problem (lines 1–9) and faced a deadlock (line
9). The lecturer’s prompt (line 10) inspired students to propose a new idea
(line 11). Afterward, the lecturer required students to construct another
representation (line 14).
1. S1: “Now we should describe how the position changes with time”.
2. S2: “From diagram we can know the distance traveled for some
interval of time. For example at t = 2 s, the distance is 36 m then v =
18 m/s. At t = 4 s …
3. S1: “Is 63 m then v = 15.75 m/s?”
4. S2: “At t = 6 s, the distance is 80 m then v = 13.33 m/s ....”
5. S3: “Yah, It means that the velocity is decreasing …”
6. S1: “Wait! Why do we always start from t zero? … how about if we
calculate the velocity at every interval of 2 seconds, from t = 0 to 2 s,
then from t = 2 s to 4 s, etc.?”
7. S2: “Could be, let’s try. … For the first interval, v=36/2=18 m/s.
For second interval, v = (63−36)/2 = 13.5 m/s, … for the third … v =
8.5 m/s … Yah, it’s decreasing too”.
8. S1: “Yah, but the result is different from the previous one. Look, v3 is
very different! Our previous result was 13.3 but now is 8.5. …”
9. S3: “So how?” [Discussion faced deadlock]
10. L: “What are you talking about? You are really talking about speed
rather than velocity. Moreover, you are talking about average speed,
instead of instantaneous speed. Your task is to describe how velocity
changes with time. It means you need to talk about instantaneous
velocity. For example, what’s the velocity at t = 2 s, at t = 3 s, and so
on?”
11. S1: “I have an idea. We’ve had an equation of position x (t) =
−1.2 t2 + 20.4 t. To get velocity, we need to simply take its derivative
v=dx/dt … the result is v(t) = −2.4 t + 20.4.”
12. S2: “Yah, this equation describes how the velocity changes with
time.”
13. S3: “We can also use this equation to define the velocity at any
instant of time. For example, at t = 0, v = 20.4 m/s; at t = 2, v = −4.8 +
20.4 = 16.4 m/s, etc.”
14. L: “Good job! So, you’ve gotten a mathematical representation of the
velocity. Now, please describe it using a diagram, that is, draw the
velocity vector at any instant of time”
Throughout the lessons, there was evidence that most students had
improved their conceptions and developed a better understanding in the
areas outlined above. It can be argued that the representational approach
756 SUTOPO AND BRUCE WALDRIP
By trying to describe our idea using a variety of representations, we can more deeply understand
the concepts being discussed … are able to describe physics phenomena scientifically (using the
relevant physics ideas appropriately) and convincingly (using a variety of coherent
representations). .... Now we are able to dare to not rely on the textbooks in solving physics
problem; instead we need to deepen our understanding of the essential concepts and use them
consistently. … Learning physics becomes enjoyable as we can find out the key concepts
involved in a problem and successfully solve the problem; we engage in the finding of the key
concepts throughout the lessons. .... We improve our skills in using computer software such as
Microsoft Excel to make graphs, calculations, and data analysis. We improve our skills of
discussion and collaboration in a group.
TABLE 4
Descriptive statistics of students’ reasoning scores
TABLE 5
Posttest–pretest cross-tabulation of reasoning levels for the technical aspect
pretest to about 63 % in the posttest, whereas the lowest two levels decreased
from about 65 % to about 21 %.
The improvement in students’ abilities to reason was as expected according
to the anecdotal comments from the lecturer and students’ reflection on their
learning. In this respect, the lecturer argued that:
The approach encouraged students to think critically and reason logically throughout the
lessons. Through constructing representations to solve problems of discussion, students
learned to check the consistence of their representations with the available data and the
relevant theories, concepts, and principles underlying the problems, as well as to check
the coherence of their tentative representation with the previous representation(s) they
had already constructed. Through group and whole class discussions, students attempted
to make the best argumentation for defending their idea.
By trying to describe our idea using a variety of representations, we were able to describe
physics phenomena scientifically (using the relevant physics ideas appropriately) and
convincingly (using a variety of coherent representations).
It can be argued that the approach has provided students with ample
opportunities to develop their ability to construct the claims that were
backed up by appropriate theory and comprehensive data analysis. As a
result, students could develop both reasoning and representational skills
IMPACT OF A REPRESENTATIONAL APPROACH ON SUDENTS 761
TABLE 6
Posttest–pretest cross-tabulation of reasoning levels for the conceptual validity aspect
CONCLUSION
REFERENCES
Sutopo
Physics Department
State University of Malang
Malang, Indonesia
E-mail: sutopo@fisika.um.ac.id
Bruce Waldrip
Faculty of Education
Monash University
Churchill, Australia
E-mail: bruce.waldrip@monash.edu