Professional Documents
Culture Documents
Understanding ongoing chemical processes in the laboratory requires constant shifting between
different representational levels—the macroscopic, submicroscopic, and symbolic levels—and analysis of
the various mechanistic features of each of these levels. Thus, the ability to explain observations of
chemical phenomena with regard to their submicroscopic levels in the laboratory is a key requirement.
Research shows that students have difficulty in discerning and comprehending the meaning and
visualization of the submicroscopic level. Traditional laboratory instruction often fails to help students
discern the relationship between their observations and the corresponding chemical processes.
Consequently, there is a high demand for new teaching strategies which address these issues.
Therefore, we developed and implemented a scaffold for the organic laboratory and tested it in a
research study using qualitative methods. The scaffold encourages students to purposefully separate and
connect the macroscopic and submicroscopic representational levels. The implementation of the
scaffold was accompanied by semi-structured pre- and post-interviews with students (N = 22) and an
Received 10th July 2020, analysis of students’ work with the scaffold in the laboratory. We analysed students’ sense-making
Accepted 2nd October 2020 approach while reflecting on organic syntheses before and after working with the scaffold, and
DOI: 10.1039/d0rp00206b characterized changes in their approach. The findings emphasize the need to develop further resources
to support students’ understanding of the submicroscopic level. Implications of these findings for
rsc.li/cerp research and teaching to foster meaningful learning in the organic laboratory are discussed.
Introduction (Reid and Shah, 2007; Collison et al., 2012). While in the lab, the
processes beyond the beaker may not be discussed thoroughly
Learning and teaching in the laboratory is a core component enough to help students develop robust understanding of
of chemistry education and has the potential to enrich the processes at the macroscopic and submicroscopic levels and
formation of science concepts (Hofstein and Lunetta, 1982; to translate between them (Gabel and Bunce, 1984; Johnstone,
Johnstone, 1991; Bretz, 2019; Molvinger et al., 2020). Laboratory 2000; Gkitzia et al., 2019; Sumfleth and Nakoinz, 2019).
teaching aims at meeting numerous learning objectives required Students’ difficulties in understanding and representing the
to successfully grasp practical syntheses, connect theory presented nature of matter at the individual representational levels,
in lectures with laboratory observations, and understand the and especially at the submicroscopic level, is a well-known
processes ‘‘beyond the beaker’’ (Bretz, 2019; Walker et al., 2019; challenge in chemistry education (Johnstone, 1982; Ben-Zvi
Czysz et al., 2020). et al., 1986; Griffiths and Preston, 1992; Kozma and Russell,
Most laboratory curricula still employ ‘‘cookbook’’ procedures 1997; Gilbert and Treagust, 2009a, 2009b; Cheng and Gilbert,
that require students to follow the recipe, stepwise, in order to 2017; Faulconer et al., 2018).
synthesize the desired product. Consequently, students acquire Besides the challenge of transitioning between represen-
limited and superficial knowledge about procedures and tational levels, students also struggle to fully account for
chemical processes (Hofstein and Lunetta, 1982; Domin, 1999; underlying mechanisms when analysing laboratory work-up
Galloway and Bretz, 2015) and lose the connection between the procedures in organic chemistry. While they are able to
theory taught in lectures and the practical work of the laboratory identify the respective entities, they miss the properties and
activities that produce a given phenomenon (Keiner and
Justus-Liebig-University Giessen, Institute of Chemistry Education,
Graulich, 2020). Although research emphasizes the need to
Heinrich-Buff-Ring 17, 35392 Giessen, Germany. explicitly communicate each level and to connect the macro-
E-mail: Nicole.Graulich@didaktik.chemie.uni-giessen.de scopic and submicroscopic levels in a meaningful way, the
This journal is © The Royal Society of Chemistry 2020 Chem. Educ. Res. Pract.
View Article Online
potential for connecting macroscopic observations and Learning (POGIL) activities in the expository laboratory. The
analysing the submicroscopic level often goes untapped in effectiveness of POGIL in general, and particularly in organic
traditional labs. chemistry (Schroeder and Greenbowe, 2008; Vishnumolakala
Increased awareness of this untapped potential has led to et al., 2017), was evidenced by improved student performance
the implementation of various learning approaches to support and a corresponding decrease in the number of students
students’ laboratory work in chemistry education. Researchers withdrawing from the course (Farrell et al., 1999; Spencer,
have developed additional instructional media to improve 1999; Stegall et al., 2016).
the teaching in organic laboratories. Pölloth et al. (2020), for A recent study emphasized the metacognitive aspect of using
example, created a library of online videos to prepare students the representational levels. Thomas (2017) described a classroom
for the upcoming laboratory techniques and syntheses in the intervention in which the teacher used the term ‘triangulation’ as
laboratory. They could show that the videos have a positive an expression to stimulate metacognitive reflection in students to
impact on students’ self-concept of ability and that students consider the importance and use of the three representational
show an increase of knowledge in a know-how test on labora- levels for learning chemistry. In this study, students improved
tory techniques (Pölloth et al., 2020). Furthermore, there has their understanding due to this metacognitive reflection, however,
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
been an increase in the use of digital badges (Hennah and students’ views of the importance and the cognitive processes
Seery, 2017) and student-generated videos in chemistry labora- associated with it varied across individuals.
tories (Schmidt-McCormack et al., 2017; Seery et al., 2017; The above approaches were successful in helping students
Gallardo-Williams et al., 2020). In the organic teaching labora- understand and explain the underlying process of their
tory, for example, digital media applications, such as virtual lab procedures. However, the ability to reflect on and make
reality, become more and more important (Ferrell et al., 2019). connections between the macroscopic and the submicroscopic
Virtual reality allows immersive interactions with a dynamic representational levels in a laboratory setting has not yet been
molecular world and engage students in exploring molecular explored as an in-lab means to support students’ understanding.
structures, motions, and particle interactions. Such virtual Based on the ongoing discussion of students’ difficulties
reality applications could enable students to understand and in the organic laboratory, we designed and implemented a
visualize the invisible chemical processes beyond the beaker. scaffold that aims at encouraging students to consciously
Other research groups focused on specific practical laboratory separate and connect the macroscopic and submicroscopic
techniques and developed laboratory instructions for these representational levels during their practical lab work.
techniques. For example, meaningful learning strategies for
liquid–liquid extractions were developed and tested
(Assadieskandar et al., 2020; Wu et al., 2020). Other approaches Theoretical framework
include restructuring the curriculum to foster students’ cognitive
and practical skills (Seery et al., 2018; Lipton, 2020) and mixed Explaining the interactions ‘‘beyond the beaker’’
approaches with tutorials and practical work (Molvinger et al., Chemists need to think ‘‘beyond the beaker’’ in order to
2020). Supasorn et al. (2008) tested the impact of a pre-laboratory understand the system that, for instance, extracts, purifies,
organic extraction simulation on comprehension and attitudes of and transports molecules in the flask (see Fig. 1). To explain
undergraduate chemistry students. This instructional approach the interactions beyond the beaker, chemists use models at the
aimed at helping students to visualize extraction concepts at the particle level. With regard to making inferences, one of the
molecular level, and afterwards to connect these concepts with most powerful and productive ideas in chemistry education was
the respective macroscopic observations. The pre-lab activity and the introduction of the ‘‘chemistry triplet’’, also called the
the animations were limited to the extraction steps and did not ‘‘Johnstone triangle’’ (Johnstone, 1982).
presented further synthesis steps. Thanks to Johnstone’s triangle, it is common practice to
Other classroom interventions or initiatives, such as the rationalize chemical phenomena at three levels of representa-
Science Writing Heuristic (SWH) and Process-Oriented Guided tion—the macroscopic (observable) level, the submicroscopic
Inquiry Learning (POGIL), focused on a well guided and struc- (particle) level, and the symbolic level (Gabel et al., 1992;
tured prompting to support students in making sense of their Johnstone, 1993; Gabel, 1999; Gilbert and Treagust, 2009a, 2009b).
laboratory work. The Science Writing Heuristic (SWH) (Schroeder The macroscopic level describes tangible and visible obser-
and Greenbowe, 2008; Stephenson and Sadler-McKnight, 2016), vations of a phenomenon and is the most accessible level while
a laboratory report format is based on a learning cycle whereby conducting experiments in the laboratory. This includes obser-
students explore concepts to look for trends or patterns, rather vations, such as colour changes or the formation of new
than to verify an expected outcome (Lawson, 1989; Keys et al., products, e.g. gases (Treagust et al., 2003).
1999; Lawson, 2001). Students who used the SWH format per- The submicroscopic level describes the invisible processes
formed significantly better on an American Chemical Society of a phenomenon, the particle level (see Fig. 1), in terms of the
(ACS) standardized exam (Hand et al., 2004), as well as on movement, organization, or collision of particles, electrons,
in-class lecture exams and quizzes (Burke et al., 2006; Greenbowe molecules, or atoms.
et al., 2007). Another widespread approach in chemistry education To communicate and visualize the observed processes,
is the implementation of Process-Oriented Guided Inquiry chemists commonly use the symbolic level, which includes
Chem. Educ. Res. Pract. This journal is © The Royal Society of Chemistry 2020
View Article Online
This journal is © The Royal Society of Chemistry 2020 Chem. Educ. Res. Pract.
View Article Online
Fig. 2 Description of the mechanistic features in general and at the macroscopic and submicroscopic representational levels.
complex task, such as conducting an organic synthesis, may underlying mental models while being engaged to make a
impose on the learner should be reduced by the scaffold continuous effort to comprehend and explain, i.e. to make
(Sweller et al., 1998; Kirschner, 2002). Slowly students learn to sense of a scientific phenomenon. Thus, in this study we
independently solve the problem, building up the necessary use the term ‘‘sense-making approach’’ to capture students’
reasoning skills and heuristics. approaches to describe and explain chemical phenomena and
the underlying molecular processes.
To answer these research questions, we performed a quali-
Goals and research questions tative interview study with chemistry student teachers enrolled
Based on our findings in a previous study (Keiner and in an organic laboratory course.
Graulich, 2020), we developed a scaffold that purposefully
prompts students to (a) carefully consider their macroscopic Methods
observations and submicroscopic explanations separately, and
(b) connect both levels and judge if they reached their synthesis Context and participants
goal. In this study we attempt to elicit, qualitatively, whether The research study was conducted at a German university in
the extent to which students’ make use of the scaffold changes July and August 2019. Students were recruited on a voluntary
the way they explain organic synthesis on both levels; and basis from the practical course ‘‘Organic Chemistry Laboratory’’
whether they make use of multiple mechanistic features when via in-class announcements. The course is part of the teacher
explaining organic syntheses. Our study is guided by the training programme for student teachers and normally takes
following research questions: place during the summer break between the fifth and sixth
1. To what extent does students’ activation of mechanistic semesters of their studies. The organic chemistry laboratory
features (at the macroscopic and submicroscopic levels) change course covers a period of four weeks during which students attend
after they have worked with the scaffold during two organic a lecture from 8:00 am to 10:00 am and work in the lab from 10:00
syntheses? am to 6:00 pm. Successful completion of the module ‘‘Organic
2. What kind of sense-making approaches (with regard to Chemistry I’’ (OC I) is the prerequisite for participating in the
the representational levels) do students use while reasoning practical ‘‘Organic Chemistry Laboratory’’ course. The OC I lecture
about an organic synthesis before and after working with the provides basic knowledge of organic chemistry and discussions
scaffold? on typical reaction mechanisms (e.g. electrophilic addition
3. To what extent is each student’s individual work with the reaction, nucleophilic substitution, radical polymerization,
scaffold related to a change in his or her sense-making and esterification).
approach? During the laboratory course, students synthesize six given
The term ‘‘sense-making’’ is widely used in the educational compounds through nucleophilic substitutions, electrophilic
literature (Fitzgerald and Palincsar, 2019) to express a learner’s additions, or elimination reactions and report the synthesis in
approach to make sense of phenomena. A sense-making process a traditional lab protocol that also requires information on
can be broadly understood as an expression of the learner’s the mechanism and the obtained yield. Students use typical
Chem. Educ. Res. Pract. This journal is © The Royal Society of Chemistry 2020
View Article Online
laboratory procedures—isolation and purification (e.g. washing 3. Particle level. In the third part, students were prompted
with sodium carbonate, fractional distillation)—for the work- to describe what they had concluded after their observations
up. These laboratory techniques are provided in advance in a (e.g. describe the underlying process of the mechanism of the
written online manual. The protocol used in this laboratory reaction). Afterwards, students were prompted to visualize the
course does not explicitly encourage students to connect the process before and after this step at the submicroscopic level.
different representational levels to each other. Students were free to choose whether to draw the particles or
A total of 22 undergraduate chemistry student teachers use symbolic representations of the molecules.
(15 female and 7 male) agreed to participate in the study. They 4. Conclusion and aim. In the fourth part, students were
were between 22 and 47 years old (the average age was 24 years) prompted to decide, based on their observations and sub-
and were invited via an announcement to students attending a microscopic explanations, if they had achieved the goal of the
class lecture or in the laboratory. All students who volunteered synthesis step. Students could not always assess whether they
for this study were provided with information about their rights had been successful or not because, as in the example with two
and the handling of the data; informed consent was obtained colourless solutions, the results were hard to differentiate. After
from all participants. Institutional Review Board approval is not each of the first three parts, students were asked to rate the
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
required at German universities, but the recruitment process perceived difficulty of filling out these parts of the scaffold.
followed ethical guidelines and it was clarified to the students Unlike the previous three parts, the last step required students
that they could opt out at any time. to rate how sure they were that they had achieved the aim of
All students provided written informed consent for (a) the this synthesis step.
use of transcripts of their interviews by the research team,
(b) the analysis of their data by the research team, and (c) the Data collection
use of their data, including their drawings and notes, for This study aims to understand the extent to which a scaffold
publication. In this study, participants were assigned pseu- administered in an organic laboratory course can stimulate
donyms; no identifying information was recorded or scanned students to activate mechanistic features and influence their
that would allow the re-identification of participants’ data. approach to making sense of synthesis steps. To compare
The interviews were conducted in German, and students’ students’ approaches before and after instruction, the first
interview excerpts and written notes were translated from author conducted pre- and post-semi-structured interviews.
German to English. During these semi-structured interviews, students were
prompted to comment on their experiences in the lab and to
Research instrument explain, step-by-step, how they carried out one of the six organic
The research instrument consisted of a scaffold (see Fig. 3) syntheses. Additional questions based on their responses, were
designed to support students’ reflection on macroscopic obser- used to engage students in reflecting on the macroscopic or the
vations, the respective submicroscopic level, and the goals of submicroscopic level (see Fig. 4).
each individual step of the synthesis (e.g. isolation or purifica- In our previous work, it became apparent that students
tion of a given compound). Generally, students concentrate on could take shortcuts in explaining a given phenomenon. Thus,
the experiment as a whole and pay little attention to the to ensure that we elicited the capabilities, we (a) prompted
individual steps (e.g. the purification steps). Since individual students to consider the submicroscopic level when they began
steps are important, we gave students explicit instructions to to describe the macroscopic level of the synthesis and
focus on these individual steps, collect their observations (b) prompted students to consider the macroscopic level when
during the synthesis, and reflect on the ongoing chemical they began to describe the submicroscopic level. In the pre-
processes of each synthesis step at the particle level. As a first interview, which took place after the second of six completed
part, students were asked to note the name of the synthesis and syntheses, students were asked to choose one synthesis and
describe the synthesis step they were working on currently. describe it step-by-step.
Second, students were asked to fill in four parts for each The decision to give the students the choice to choose which
synthesis step: synthesis and, consequently, which mechanism they would like
1. Goal. In the first part, students were instructed to describe to discuss in the interview was made consciously. Giving
the goal of this synthesis step and explain why they were students the opportunity to choose one of their two syntheses
working on this step. was intended to relieve their nervousness during the interview
2. Observation. After defining the goal of the synthesis step, situation and allowed them to choose a familiar content area.
students were prompted to describe and visualize their obser- The syntheses and related mechanisms are very similar. Almost
vations, before, during, and after this step. It should be noted every synthesis has certain preparatory steps, a main reaction,
that some observations did not always differ substantially. For and ongoing purification steps. Due to these similarities of the
example, if students mixed two colourless solutions for five respective syntheses, we considered it appropriate to allow the
hours and the solution remained colourless, they were not able students choose which synthesis they want to explain in the
to observe any visible changes. Furthermore, students were interview. To answer our research questions, we were more
instructed to draw a sketch of their observations before and interested in students’ sense-making approaches when they
after the synthesis step, if possible. explained a synthesis of their choice, than to test them all on
This journal is © The Royal Society of Chemistry 2020 Chem. Educ. Res. Pract.
View Article Online
Fig. 3 The scaffold used in the organic laboratory course for each synthesis step (translated from German).
the same synthesis. We assume that this process helps them The interview typically started with the sentence, ‘‘Please tell
feel at ease with the task, so that the students feel more me in detail what you have done in your organic synthesis and why
comfortable and are willing to share their thoughts. you have done the individual steps’’. After the interview, students
Chem. Educ. Res. Pract. This journal is © The Royal Society of Chemistry 2020
View Article Online
that we were mainly interested in their imagination and ing the interviews. The interviews lasted on average 30 minutes.
conceptions of levels, particularly the particle level. To show
them how to use the scaffold in the laboratory, we demon- Data analysis
strated an exemplary solution to an organic synthesis that was To acquire deeper understanding of how students interacted
not part of the course. After introducing the scaffold, the with the scaffold, we conducted a qualitative data analysis. All
students used the scaffold for the next two syntheses. interviews were transcribed verbatim and analysed using the
During the lab activity, the first author played the role of a coding software MAXQDA. To evaluate whether the scaffold led
mediator. She interacted with the students, checked if they to changes in students’ approach and to answer our research
were comfortable with the instructional approach, answered questions, we analysed the data using the following steps:
questions, addressed any uncertainties and arranged the Step I: identifying the activated features of a mechanism. We
appointment for the second interview when students had used the coding scheme from our previous study (Keiner and
completed their scaffold assignments. During the lab activity, Graulich, 2020), which consists of eight categories, to code the
a question most frequently asked by students was how detailed mechanistic features students would need to activate in their
they should describe the individual parts of the scaffold and explanations. Table 1 provides an overview of the codes and a
how they should depict the processes on the particle level. The student example for each coding category. In this part of the
first author advised the students to describe the chemical analysis, we coded when and how often students used entities,
phenomena as detailed as possible and to choose which properties, organization, and activities at the macroscopic and
visualization (e.g. Lewis structures or particle drawings) they submicroscopic representational levels during the pre- and
want to use to represent the synthesis step. Overall, students post-interviews. The features were coded individually. If some-
felt comfortable working with the scaffold and could always one mentioned a macroscopic entity (e.g. water), it was coded
Table 1 Coding rubric for analysis step I: mechanistic features at the macroscopic and submicroscopic levels
EntityS ‘‘. . .CaCl2 which means, I have Ca2+ and two Cl ions.’’ Entities are described by using the name of the particle or referring to
the molecules of a substance (e.g. functional groups, ions, water
molecules).
PropertyS ‘‘. . .the partial positive charged carbon atom in acetic Properties are described by reference to an invisible physical or
acid.’’ chemical property (e.g. deprotonated entity, aggregate state).
ActivityS ‘‘The acetate molecule attacks the nucleophile.’’ Activities are described by referring to an invisible physical or chemical
transformation which results in a change of properties, with reference
to molecules or particles.
OrganizationS ‘‘. . .in the aqueous phase we have Na+ and Cl .’’ Organization of entities is described by referring to the temporal and
spatial organization (e.g. more H3O+ ions) of submicroscopic entities.
This journal is © The Royal Society of Chemistry 2020 Chem. Educ. Res. Pract.
View Article Online
with the code macroscopic entity (EM). Those features that This process resulted in various combinations, such as from
students activated frequently or rarely may depend on the type the macroscopic (M) to the submicroscopic (S) level without a
of organic synthesis in question. After coding each feature, we prompt (M–S), from the macroscopic to the submicroscopic
counted the frequencies of the total number of coded features level after a prompt (M–P–S) or staying at the macroscopic level
and then calculated different percentages. The given percentages (MM). The individual sections of meaning were then coded with
in the result chapter (e.g. 75% macroscopic; 25% submicroscopic these three occurring combinations (MS; MM; MPS) between the
in the pre-interview) therefore refer to the individual features, macroscopic and submicroscopic representational level. In the
which means that 75% of the overall coded features (like entities, next step of analysis, we determined the distribution of the respec-
properties, activities and organization) are labelled as macro- tive transitions for each student in the pre- and post-interviews.
scopic ones and 25% of the coded features are submicroscopic. Therefore, we counted how often students used which approach to
The percentages of the coded mechanistic features overall explain the synthesis steps. For instance, we counted the amount
students in the pre- and post-interview (e.g. 57% EM; 20% PM. . .) of sections of meaning in which a student explained the chemical
are related to the total amount of all macroscopic and submicro- phenomena at the macroscopic level (sense-making approach I),
scopic respectively. in which the student transitioned after being prompted to the
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
The changes with regard to the activated mechanistic submicroscopic level (sense-making approach II), and in which the
features from the pre- to the post-interview were explored for student switched to the submicroscopic level without a prompt
statistical significance using a paired-sample t-test. (sense-making approach III). We, thus, generated a bar chart for
Step II: characterizing students by their attempt to make each student, showing the respective percentages of each approach
sense of an organic synthesis. To answer our second research in the pre- and post-interview (cf. Fig. 12). The changes in students’
question, we categorized students by their approach (with sense-making approaches from the pre- to the post-interview were
regard to the individual sections of meaning) to making sense explored for statistical significance using a paired-sample t-test.
of their chosen organic synthesis at the macroscopic and Step III: evaluating students’ individual work with the
submicroscopic representational levels, before and after scaffold. To explore a potential correlation between students’
working with the scaffold. We assumed that deliberately mak- sense-making approach on the sections of meaning and their
ing use of the macroscopic and submicroscopic levels when individual work with the scaffold, we created a rubric that
explaining a chosen synthesis (as students had done in the lab), categorizes students’ qualitative description of the reaction
was an indicator of proficiency, whereas a description limited process in the scaffold worksheet. For this purpose, we differ-
to the macroscopic level could indicate students’ difficulty with entiated between fully described (2 points), partially described
apprehending multiple levels. (1 point), and insufficiently described (0 points).
Therefore, we divided the interview transcripts into smaller Furthermore, we divided a synthesis into three main parts
content-related ‘‘sections of meaning’’ (e.g. the description of a (see Fig. 5). These were the preparatory steps, the main reaction
phase separation, the evolution of gas, or the main reaction step). step, and the work-up procedures (e.g. purification steps). For
The sections of meaning could be differentiated by an interview each of these three parts, we rated students’ description of the
prompt or a content-related change by the student. Such a verbal synthesis steps with the rubric by focusing on the completeness
section of meaning focuses on one aspect of the observed syn- of the descriptions and on the correct separation of the
thesis (e.g. a phase separation or a distillation process) and can macroscopic and submicroscopic levels. This rating indicates
occur at one or both representational levels. The subdivision into whether students made the correct observations of the respec-
smaller sections of meaning was useful because the students in tive step at the macroscopic level and described and visualized
this study did not consistently use just one approach to describe it at the particle level.
their synthesis. Depending on the synthesis step, they may have Unreadable or incomprehensible (insufficient) descriptions
reasoned on one of the two levels or changed the representational were awarded 0 points; partial descriptions of the individual
level in different ways. The subdivision into smaller sections of synthesis step, with correct differentiations between the macro-
meaning provided the opportunity to better compare changes scopic and submicroscopic levels and with few aspects missing
from the pre- to the post-interview (e.g. the explanation of a phase or incorrect, were awarded 1 point; full and correct descriptions
separation in both interviews). Consequently, we first separated of the synthesis step were awarded 2 points.
or divided each section of meaning in students’ interview To assess how students worked with the scaffold overall,
transcripts. The first part of analysis step II did not include any we summed up their points on both syntheses and calculated a
coding of the transcripts, but only the division of the interviews total score. The total score may differ depending on the
into content-related sections of meaning. described organic synthesis because not every synthesis has a
To better characterize students’ sense-making approaches, ‘‘preparatory step’’. Some organic syntheses start directly
we were interested in the type of transition used to explain their with the ‘‘main reaction step’’. We therefore calculated the
synthesis steps in such a section of meaning. Therefore, we percentage of available points achieved by each student. Based
categorized, for example, whether a transition occurred from on the attained percentage, we divided the students into three
one representational level to another and whether this shift was ‘‘groups’’, to indicate how students worked, in general, with the
caused by the interviewer’s prompt or was made freely and scaffold. Zero to 33% represented group I (mainly insufficient
deliberately by the student. description); 34% to 66% represented group II (mainly partial
Chem. Educ. Res. Pract. This journal is © The Royal Society of Chemistry 2020
View Article Online
Fig. 5 Illustrative example of the rubric for use of the scaffold. In this case, the student obtained ten out of twelve points and therefore achieved 83% in
total, indicating that the synthesis steps were fully described in the scaffold worksheet.
description); and 67% to 100% represented group III (mainly post-interview (macroscopic features 73%, submicroscopic
full description). Fig. 5 gives an overview of this analysis. features 27%). In the post-interview, students included more
The first author (PhD candidate with a master’s degree in reasoning about the underlying chemical processes, as indi-
chemistry education) coded the entire data set from all rounds cated by an increase of the feature activity. Fig. 6 shows an
of coding and analysis. During the data analysis, the authors overview of the percentage of activated features in the pre- and
regularly discussed the coding scheme. Furthermore, constant post-interview. It is apparent that in both pre- and post-
discussions with the whole research group were conducted. interviews, entities were activated most frequently (pre: EM:
57%; ES: 69%; post: EM: 61%; ES: 69%), followed by properties
(pre: PM: 20%; PS: 14%; post: PM: 17%; PS: 14%), organization
Results and discussions (pre: OM: 15%; OS: 8%; post: OM: 14%; OS: 10%), and activities
(pre: AM: 8%; AS: 9%; post: AM: 8%; AS: 16%).
We analysed students’ interview data and written work and With regard to the activation of individual features at the
characterized different sense-making approaches in students’ representational levels, we did not observe any major differ-
sections of meaning and the related changes with regard to the ences except for two submicroscopic features—the entities and
scaffold worksheet. Overall, students demonstrated increased activities (see the dotted lines in Fig. 6). The submicroscopic
understanding of organic synthesis in their post-scaffold inter- activity was activated, on average, twice as often in the post-
views. To facilitate the interpretation and discussion of the results interview (16%) as in the pre-interview (8%). This increase is
in accordance with our research questions, we divided the results significant (p o 0.05) and has a large effect size (Cohen’s d =
into three parts. The first part describes students’ activation of 0.812). With the exception of two students, all students showed
mechanistic features while explaining their organic synthesis in an increase in this mechanistic feature in the post-interview.
the pre and post-scaffold interview. The second part illustrates The statistical analysis of the other features as well as the
students’ sense-making approach in the sections of meaning. The confidence intervals are presented in the appendix (cf. Table 3).
third part illustrates students’ work with the scaffold and the Consequently, they activated considerably fewer submicro-
related changes in their sense-making approach. scopic entities ( 9%) in the post-interview. One can interpret
To what extent did students’ activation of mechanistic
features (at the macroscopic and submicroscopic levels) change
after they worked with the scaffold during a synthesis?
All features of a mechanism were activated at least once by each
student during their explanation of the synthesis, but with varying
frequencies. Because naming a property, organization, or activity is
generally accompanied by a reference to an entity, it is unsurprising
that entity was the mechanistic feature used most at both levels.
Our analysis revealed that students activate, on average,
Fig. 6 Percentage of mechanistic features activated in students’ sense-
more macroscopic features than submicroscopic features. making approaches in the pre- (left) and post- (right) interview. The blue
Close to equal percentages were obtained in the pre-interview coloured elements indicate macroscopic features and the red coloured
(macroscopic features 75%, submicroscopic features 25%) and the submicroscopic features.
This journal is © The Royal Society of Chemistry 2020 Chem. Educ. Res. Pract.
View Article Online
this finding as an increase in process-oriented thinking in the working with the scaffold, we observed small qualitative differ-
post-interviews. This is a promising finding as we found in one ences in their explanations (see Fig. 7).
of our previous studies (Keiner and Graulich, 2020) that stu- What kind of sense-making approaches (with regard to the
dents, when prompted to explain organic work-up procedures, representational levels) do students use while reasoning about an
tend to focus more on static entities and less on process- organic synthesis before and after working with the scaffold?
oriented features like the activity. Moreira et al. (2019) found To answer this question, we examined how students made
that students tend to explain chemical phenomena without sense of organic synthesis steps with regard to their transition
reference to the activity. They concluded that students’ expla- from the macroscopic level to the submicroscopic level, and
nations incorporate activities of one or more entities of the analysed whether their sense-making changed after working
system only at a higher level of sophistication, indicating a with the scaffold. Depending on how students explained the
change from a static to a more dynamic perspective of the reaction process in the section of meaning, different transitions
phenomenon. In our previous study (Keiner and Graulich, 2020) were observable (see Fig. 8). The sections of meaning fell into
we confirmed the observation that students often struggle to one of three categories: students who transitioned from the
describe the activities that give rise to entities or properties that macroscopic to the submicroscopic level independently, those
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
are responsible for earlier or subsequent activities. The following who did so after a prompt by the interviewer, and those who
example illustrates students’ use of the feature activity. remained at the macroscopic level even after a prompt. It is
important to note that none of the students began their
explanation of a phenomenon at the submicroscopic level.
The sections of meaning categories are as follows:
Sense-making approach I. The first approach that character-
ized a section of meaning was a student explaining chemical
synthesis macroscopically using macroscopic features. Even
after a prompt to consider the particle level, the explanation
remained at the macroscopic level and did not include sub-
microscopic features.
Sense-making approach II. This sense-making approach
characterized those sections in which students analysed a
synthesis step at the macroscopic level then, after a prompt
from the interviewer, transitioned to the submicroscopic repre-
sentational level and activated the submicroscopic features.
Fig. 7 Illustrative quotes from Darly as he thought through a nucleophilic Sense-making approach III. The third sense-making approach
attack in the pre- and post-interviews. characterized sections of meaning in which students described the
chemical phenomenon at the macroscopic level and transitioned,
without being prompted, to the submicroscopic level.
Specifically, we compared student Darly’s explanation from In the following section, we illustrate the sense-making
the pre- and post-interview in which he worked out the nucleo- approach with student examples. Fig. 9 shows student Carol’s
philic attack (the main reaction step) in two different organic
syntheses. In the pre-interview, Darly listed many properties
(e.g. ‘‘partially negative; partially positively charged; positively
charged’’) without reference to the formation (i.e. the respective
activities). In the post-interview, he once again mentioned the
comparable properties of entities (e.g. ‘‘negatively charged;
positively polarized C-atom; oxygen is electronegative’’). However,
in contrast to the pre-interview, he included more descriptions
about the formation of the properties (‘‘attracts the electrons’’)
and the activity of the entity (‘‘attacks as a nucleophile’’).
To summarize our findings for the first research question,
we noted that students activated all mechanistic features, but
with different frequencies. They most frequently mentioned
entities, followed by properties, organization, and, least fre-
quently, activities. The high percentage of activated entities in
both cases can be attributed to the fact that naming a property,
organization, or activity is generally accompanied by a refer-
ence to an entity. Therefore, it is not surprising that the most
used mechanistic feature at both levels was the entity. Although Fig. 8 Three sense-making approaches which characterize students’
students activated, predominantly, the same features after sections of meaning in explaining synthesis steps.
Chem. Educ. Res. Pract. This journal is © The Royal Society of Chemistry 2020
View Article Online
Fig. 9 Carol’s sense-making approach (I) to the aggregate states and the
dissolving process in the pre-interview.
Fig. 11 Darly’s sense-making approach (III) as he describes the separation
of two phases in the pre-interview.
sense-making approach for the dissolving process of chloroc-
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
This journal is © The Royal Society of Chemistry 2020 Chem. Educ. Res. Pract.
View Article Online
comparison of sense-making approach I and II as well as the We noted that students who fully described the synthesis
confidence intervals are presented in the appendix (cf. Table 4). steps in the scaffold worksheet (green box) usually showed an
The eight students in group I (green box) described the increase in sense-making approach III in the post-scaffold
synthesis steps in the scaffold more or less fully. The twelve interview; this result is highlighted with red boxes (see
students in group II (yellow box) described the synthesis steps Fig. 12). This means that these students tended to describe
in the scaffold only partially. Only the two students in group III their chosen synthesis in the post-scaffold interview at the
(red box) described the steps insufficiently. Fig. 12 also shows macroscopic and submicroscopic levels without being explicitly
the percentage of sense-making approaches I-III in the prompted. Furthermore, we noticed a small increase in the
pre-scaffold interviews and the respective percentages in the number of students who explained the submicroscopic level after
post-scaffold interviews (visualized by different coloured bars, a prompt, whereas in the pre-scaffold interview they often
Fig. 12). We observed a relationship between the completeness remained at the macroscopic level even after being prompted.
of the description in the scaffold worksheet and the sense- Students who partially described the synthesis steps in the scaffold
making approaches in the pre- and post-scaffold interviews. (yellow box) showed few changes in their sense-making approach.
During the pre-scaffold interviews, only one student was explain-
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
Chem. Educ. Res. Pract. This journal is © The Royal Society of Chemistry 2020
View Article Online
This journal is © The Royal Society of Chemistry 2020 Chem. Educ. Res. Pract.
View Article Online
account for a chemical phenomenon. The order of use, i.e. whether the transition between the macroscopic and submicroscopic
a submicroscopic explanation is inferred from a macroscopic representational levels:
phenomenon or vice versa is secondary and depends on the context (1) Sense-making approach I (i.e. macroscopic–prompt–
and the question asked. macroscopic); (2) sense-making approach II (i.e. macroscopic–
If a chemical phenomenon shows no obvious observations prompt–submicroscopic); (3) sense-making approach III
(e.g. a colourless solution reacts with a colourless solution), it is (i.e. macroscopic–submicroscopic, without a prompt).
difficult to make sense of the observation. However, guiding We observed that students who fully described their synthesis
students to attend to macroscopic changes, even if they are steps in the scaffold exhibited an improvement in their sense-
small or hardly visible is an essential skill in the inquiry making approach between the pre- and post-scaffold interviews:
process. Relating observable changes to the underlying mole- they transitioned more often, without prompts, from the macro-
cular processes is as important as being aware, that a reaction scopic to the submicroscopic representational level (sense-making
may take place even when there is nothing to observe. approach III). Although these observations are promising, it is
If students argue and explain only at one of the two apparent from the scaffold worksheets and interview transcripts
representational levels and, for example, remain completely that some students struggled to describe and visualize their
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
on the macroscopic level, they are missing the other half of the observations at the particle level, even when explicitly prompted
story. The same issue arises when students neglect macroscopic to think about the properties and activities of the entities while
observations and only consider the submicroscopic level in working with the scaffold. In this study, students often referred to
their explanations. Thus, students need to be encouraged to the final product in their scaffold worksheet but did not explain
consciously reflect on a chemical process macroscopically and how to get there (e.g. when they described a property, they did not
submicroscopically (Taber, 2013). They also have to be able to mention how it is formed).
connect both representational levels in a meaningful way If a mental model of how particles interact is missing in
(Anderson, 1978; Johnstone, 1991; Gabel et al., 1992; Treagust students’ reasoning processes, it is difficult for them to make a
et al., 2003; Gilbert and Treagust, 2009a, 2009b; Krist et al., connection between the macroscopic and submicroscopic
2018; Keiner and Graulich, 2020). These abilities are addressed levels. Such mental models do not develop naturally in students
by the structure of the scaffold. (Deratzou, 2006). Thus, it is important to provide students with
To reprise, the central goals of this study were as follows: the opportunity to constantly reflect on and connect these
(1) Analyse to what extent students are able to activate representational levels. The scaffold sought to elicit this ability
mechanistic features (at the macroscopic and submicroscopic in students and it seems that reflective work with the scaffold
levels) during pre- and post-scaffold interviews. had a positive effect on students’ ability to transition between
(2) Characterize how students make sense of synthesis steps. the macroscopic and submicroscopic representational levels.
(3) Determine if there is a relationship between students’ This aspect of encouraging students to first think about how
sense-making approaches and their use of the scaffold. they can depict entities and chemical phenomena at the
Our analysis revealed that students use all mechanistic individual representational levels and how to combine them
features at both representational levels to make sense of afterwards in a meaningful way has as well been illustrated by
organic synthesis. In the pre- and post-scaffold interviews, the study from Thomas (2017). The worksheet used in this
students were able to activate entities and properties at both study is to some extend similar to our scaffold and directed
representational levels but used fewer activities and less orga- students’ metacognition in an explicit way, i.e. to attend to the
nization. Analysing the use of these features in detail revealed separate nature of each of the representational levels and the
that the causal link between the features (particularly during relationships between them.
the pre-scaffold interview) was often missing and students’ Conscious reflection on the macroscopic and submicro-
explanations can be considered as static. This finding is in scopic representational levels does not happen automatically
accordance with previous research (Grove et al., 2012; Caspari in the laboratory. This requires active engagement by students
et al., 2018; Moreira et al., 2018; Keiner and Graulich, 2020) in in the process such as scaffolding. For example, students who
which students’ explanations tend to include initial starting fully described their syntheses in the scaffold showed the most
material and products but little description of the underlying positive changes in their approach.
reaction. During the post-scaffold interview, after students had The structure of the scaffold worksheet could be applied to all
completed two organic syntheses using the scaffold, we observed occurring chemical processes where it is important that students’
a small increase in the activation of process-related mechanistic observations are connected at the particle level and that students
features as students described activities more frequently. are able to transition between representational levels. For
Thus, we can assume that students’ work with the scaffold example, inorganic chemistry students could use the scaffold
encouraged them to reflect more deeply on the particle level of while analysing an unknown compound (analytical chemistry);
their synthesis steps. However, further research is needed to or biology students could use the scaffold while testing various
elucidate the effect of the scaffold using quantitative methods fertilizers in relation to plant growth and visual changes. This type
and a larger sample. of scaffolding can be smoothly integrated into existing teaching
Our analysis also revealed that three main sense-making practices to expand upon what students already do and to help
approaches characterize students’ explanations with regard to them connect their observations with the particle level.
Chem. Educ. Res. Pract. This journal is © The Royal Society of Chemistry 2020
View Article Online
Nevertheless, the large effect size for the increase of sense-making sense-making approach III significantly (p = 0.008) more often
approach III indicates that the work with the scaffold seems to than sense-making approaches I or II. This increase is coupled
influence students’ reasoning. In order to generalize the results with a large effect size (Cohen’s d = 0.88). Changes in sense-
and to investigate whether this effect is sustainable or holds true making approach I and II are not statistically significant and
for larger classes, further studies are necessary. show no effect size.
Third, students were asked to explain their synthesis in an
individual interview setting that was quite different from the
environment in the laboratory. Students appeared to feel comforta- Appendix 2. Students’ evaluation of
ble with the research team and the interview setting, which may have
prompted them to pay closer attention to the work with the scaffold
the scaffold
than they would have paid in a laboratory situation. Fig. 16 shows the percentages achieved by students in the scaffold
and the points achieved in the separate categories—preparatory
Conflicts of interest steps, main reaction step, and work-up procedures. As not every
This journal is © The Royal Society of Chemistry 2020 Chem. Educ. Res. Pract.
View Article Online
synthesis has a preparatory step, some fields are left blank. The Chemistry: Starting It in General Chemistry, J. Chem. Educ.,
last column indicates the overall percentage of available points 96, 213–226.
attained. Crandell O. M., Lockhart M. A. and Cooper M. M., (2020),
Arrows on the Page Are Not a Good Gauge: Evidence for
the Importance of Causal Mechanistic Explanations about
Acknowledgements Nucleophilic Substitution in Organic Chemistry, J. Chem.
Educ., 97, 313–327.
This publication represents part of the first author’s doctoral Czysz K., Schroeder L. and Clark G. A., (2020), Making Acids
(Dr rer. nat.) thesis at the Faculty of Biology and Chemistry, and Bases MORE Basic: Supporting Students’ Conceptuali-
Justus-Liebig-University Giessen, Germany. We thank all students zation of Acid Base Chemistry through a Laboratory Exer-
who participated in the study. We also thank the Graulich cise That Connects Molecular-Level Representations to
research group for fruitful discussions about the research and Symbolic Representations and Experimentally Derived Evi-
Professor Richard Göttlich for his support. dence, J. Chem. Educ., 97, 484–489.
Davis E. A., (2000), Scaffolding students’ knowledge integration:
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
Chem. Educ. Res. Pract. This journal is © The Royal Society of Chemistry 2020
View Article Online
Gkitzia V., Salta K. and Tzougraki C., (2019), Students’ Compe- Kozma R. B. and Russell J., (1997), Multimedia and under-
tence in Translating Between Different Types of Chemical standing: expert and novice responses to different represen-
Representations, Chem. Educ. Res. Pract., 21, 307–330. tations of chemical phenomena, J. Res. Sci. Teach., 34,
Greenbowe T. J., Poock J. R., Burke K. and Hand B. M., (2007), 949–968.
Using the science writing heuristic in the general chemistry Krist C., Schwarz C. V. and Reiser B. J., (2018), Identifying
laboratory to improve students’ academic performance, Essential Epistemic Heuristics for Guiding Mechanistic
J. Chem. Educ., 84, 1371. Reasoning in Science Learning, J. Learn. Sci., 28, 160–205.
Griffiths A. K. and Preston K. R., (1992), Grade-12 students’ Lawson A. E., (1989), A Theory of Instruction: Using the Learn-
misconceptions relating to fundamental characteristics of ing Cycle To Teach Science Concepts and Thinking Skills.
atoms and molecules, J. Res. Sci. Teach., 29, 611–628. NARST Monograph, Number One, 1989.
Grotzer T. A., (2003), Learning to understand the forms of Lawson A. E., (2001), Using the learning cycle to teach biology
causality implicit in scientifically accepted explanations, concepts and reasoning patterns, J. Biol. Educ., 35, 165–169.
Stud. Sci. Educ., 39, 74. Lipton M. A., (2020), Reorganization of the Organic Chemistry
Grove N. P., Cooper M. M. and Cox E. L., (2012), Does mecha- Curriculum to Improve Student Outcomes, J. Chem. Educ.,
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
This journal is © The Royal Society of Chemistry 2020 Chem. Educ. Res. Pract.
View Article Online
Salmon W. C., (1984), Scientific explanation and the causal comprehension and attitudes of undergraduate chemistry
structure of the world, Princeton: Princeton University Press. students, Chem. Educ. Res. Pract., 9, 169–181.
Scalco K. C., Talanquer V., Kiill K. B. and Cordeiro M. R., (2018), Sweller J., Van Merrienboer J. J. and Paas F. G., (1998), Cognitive
Making Sense of Phenomena from Sequential Images versus architecture and instructional design, Educ. Psychol. Rev., 10,
Illustrated Text, J. Chem. Educ., 95, 347–354. 251–296.
Schmidt-McCormack J. A., Muniz M. N., Keuter E. C., Shaw S. K. Taber K. S., (2002), Chemical misconceptions: prevention, diagnosis
and Cole R. S., (2017), Design and implementation of and cure, London: Royal Society of Chemistry.
instructional videos for upper-division undergraduate Taber K. S., (2013), Revisiting the chemistry triplet: drawing
laboratory courses, Chem. Educ. Res. Pract., 18, 749–762. upon the nature of chemical knowledge and the psychology
Schroeder J. D. and Greenbowe T. J., (2008), Implementing of learning to inform chemistry education, Chem. Educ. Res.
POGIL in the lecture and the Science Writing Heuristic in the Pract., 14, 156–168.
laboratory—student perceptions and performance in under- Talanquer V., (2010), Exploring Dominant Types of Explana-
graduate organic chemistry, Chem. Educ. Res. Pract., 9, 149–156. tions Built by General Chemistry Students, Int. J. Sci. Educ.,
Seel N. M., (2011), Encyclopedia of the Sciences of Learning, 32, 2393–2412.
Published on 02 October 2020. Downloaded on 10/20/2020 9:45:58 PM.
Springer Science & Business Media. Talanquer V., (2018), Education Research and Practice in Asia-
Seery M. K., Agustian H. Y., Doidge E. D., Kucharski M. M., Pacific and Beyond, Singapore: Springer, pp. 39–52.
O’Connor H. M. and Price A., (2017), Developing laboratory Thomas G. P., (2017), ‘Triangulation:’an expression for
skills by incorporating peer-review and digital badges, Chem. stimulating metacognitive reflection regarding the use of
Educ. Res. Pract., 18, 403–419. ‘triplet’representations for chemistry learning, Chem. Educ.
Seery M. K., Agustian H. Y. and Zhang X., (2018), A Framework Res. Pract., 18, 533–548.
for Learning in the Chemistry Laboratory, Isr. J. Chem., 59, Treagust D. F., Chittleborough G. and Mamiala T., (2003), The
546–553. role of submicroscopic and symbolic representations in
Sevian H. and Talanquer V., (2014), Rethinking chemistry: a chemical explanations, Int. J. Sci. Educ., 25, 1353–1368.
learning progression on chemical thinking, Chem. Educ. Res. Vishnumolakala V. R., Southam D. C., Treagust D. F., Mocerino
Pract., 15, 10–23. M. and Qureshi S., (2017), Students’ attitudes, self-efficacy
Spencer J. N., (1999), New directions in teaching chemistry: a and experiences in a modified process-oriented guided
philosophical and pedagogical basis, J. Chem. Educ., 76, 566. inquiry learning undergraduate chemistry classroom, Chem.
Stegall S. L., Grushow A., Whitnell R. and Hunnicutt S. S., Educ. Res. Pract., 18, 340–352.
(2016), Evaluating the effectiveness of POGIL-PCL workshops, Walker J. P., Van Duzor A. G. and Lower M. A., (2019), Facil-
Chem. Educ. Res. Pract., 17, 407–416. itating Argumentation in the Laboratory: The Challenges of
Stephenson N. S. and Sadler-McKnight N. P., (2016), Developing Claim Change and Justification by Theory, J. Chem. Educ.,
critical thinking skills using the Science Writing Heuristic in 96, 435–444.
the chemistry laboratory, Chem. Educ. Res. Pract., 17, 72–79. Wood D., Bruner J. S. and Ross G., (1976), The role of tutoring
Sumfleth E. and Nakoinz S., (2019), Chemie verstehen– in problem solving, J. Child Psychol. Psychiatry, 17, 89–100.
beobachtbare makroskopische Phänomene auf submikros- Wu N., Kubo T., Hall A. O., Zurcher D. M., Phadke S., Wallace
kopischer Ebene modellbasiert interpretieren [Understand R. L. and McNeil A. J., (2020), Adapting Meaningful Learning
chemistry - interpret observable macroscopic phenomena Strategies to Teach Liquid Liquid Extractions, J. Chem.
at the submicroscopic level based on models], Z. Didakt. Educ., 97, 80–86.
Naturwiss., 25, 231–243. Yeo J. and Gilbert J. K., (2014), Constructing a scientific
Supasorn S., Suits J. P., Jones L. L. and Vibuljan S., (2008), explanation—A narrative account, Int. J. Sci. Educ., 36,
Impact of a pre-laboratory organic-extraction simulation on 1902–1935.
Chem. Educ. Res. Pract. This journal is © The Royal Society of Chemistry 2020