Professional Documents
Culture Documents
net/publication/234066312
CITATIONS READS
12 3,299
4 authors, including:
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Yu-Teh Kirk Lin on 03 June 2014.
To cite this article: Silvia Wen-Yu Lee, Yung-Chih Lai, Hon-Tsen Alex Yu & Yu-Teh Kirk Lin (2011): Impact of biology
laboratory courses on students’ science performance and views about laboratory courses in general: innovative
measurements and analyses, Journal of Biological Education, DOI:10.1080/00219266.2011.634017
This article may be used for research, teaching, and private study purposes. Any substantial or systematic
reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any form to
anyone is expressly forbidden.
The publisher does not give any warranty express or implied or make any representation that the contents
will be complete or accurate or up to date. The accuracy of any instructions, formulae, and drug doses
should be independently verified with primary sources. The publisher shall not be liable for any loss, actions,
claims, proceedings, demand, or costs or damages whatsoever or howsoever caused arising directly or
indirectly in connection with or arising out of the use of this material.
JOURNAL OF BIOLOGICAL EDUCATION, 2011, iFirst Article, 1–7 1
Research paper
Impact of biology laboratory courses
on students’ science performance
and views about laboratory courses
in general: innovative measurements
and analyses
Silvia Wen-Yu Lee a, Yung-Chih Lai b,c,
Downloaded by [National Taiwan University], [Kirk Lin] at 02:40 14 November 2011
Despite the fact that some educational researchers believe that laboratory courses promote outcomes in
cognitive and affective domains in science learning, others have argued that laboratory courses are costly in rela-
tion to their value. Moreover, effective measurement of student learning in the laboratory is an area requiring
further investigation. The present study set out to examine learning outcomes by measuring students’ academic
performance and their skill in writing research proposals and investigated students’ views about laboratory
courses through interviews. Comparisons were made between students taking lectures only (control group) and
students enrolled in both lecture and laboratory courses (experimental group). A total of 78 undergraduate
students participated in the study. Stepwise discriminant analysis, analysis of covariance, and multidimensional
scaling were used to analyse the data. Results showed that students in the experimental group did not perform
as well as students in the control group in examination questions that required rote memorisation but they per-
formed better than their counterparts in classification of species and in essay writing. In addition, in terms of
research study design, proposals written by students in the experimental group were not only of higher quality
but also more consistent in quality than those written by students in the control group. Implications for
curriculum design and future research are described with respect to the innovative measurements and analytical
methods we used to evaluate laboratory learning outcomes, the role of laboratory courses in biology teaching,
and students’ learning styles.
Introduction
For the past several decades, educational researchers 2004; Freedman 1997; Henderson et al. 2000). For
have suggested that laboratory courses are beneficial instance, Freedman (1997) showed that students who
and make unique contributions to science education. experienced hands-on laboratory programmes
Science educators have designed laboratory activities achieved higher scores on mid-term and final science
with the intention of promoting student learning in examinations than those who did not participate in
cognitive and affective domains such as understanding such courses. Despite promoting laboratory courses in
scientific concepts, interest and motivation, scientific science curricula (eg National Science Teachers
practical skills, scientific inquiry, and understanding Association recommendations), some educators were
the nature of science (Hofstein and Lunetta 1982, concerned that laboratory courses were costly and of
Corresponding author: Yu-Teh Kirk Lin, Department of Life Sciences, National Taiwan University, Taipei 10617, Taiwan.
Email: kirklin@ntu.edu.tw
Journal of Biological Education ISSN 0021–9266 print/ISSN 2157–6009 online Ó 2011 Society of Biology
http://www.tandfonline.com
http://dx.doi.org/10.1080/00219266.2011.634017
2 S.W.-Y. LEE ET AL. _______________________________________________________________________________________________
limited value and felt that some of the same goals for To what extent did students in the experimen-
learning could be achieved more effectively through tal and control groups perform differently in
other pedagogies or activities (Jenkins 2007). While writing research proposals?
there is little direct evidence to support this position, What were students’ views of laboratory
some researchers have argued that laboratory courses courses in general after taking this vertebrate
have more potential advantages than is shown in biology laboratory course in addition to the
research (Hofstein and Lunetta 1982; Roth 1994). course lecture?
A part of the aforementioned problems was attrib-
uted to another problem in science education – the
lack of effectively and efficiently assessing students’ Materials and methods
learning in the laboratory environment. Some Participants
researchers argued that achievement instruments were Participants were 78 undergraduate students who
not designed to measure the kinds of higher-level enrolled in a vertebrate biology course at a university
skills that are emphasised in laboratory courses, such in northern Taiwan. The majority of the students were
as problem-solving, study design, hypothesis testing, second- and third-year college students, but there
or interpretation of experimental results (Hofstein and
Downloaded by [National Taiwan University], [Kirk Lin] at 02:40 14 November 2011
Group Second year (n) Third year (n) Fourth year (n) Total (n)
Experimental group 12 7 3 22
Control group 33 22 1 56
Total 45 29 4 78
____________________________________________________________________________ RESEARCH PAPER 3
given term on the mid-term exam. For example, included: reasons for taking the laboratory course,
one essay question asked: ‘Please describe the func- their impression of the course, what they felt they
tion of pharyngeal slits in tunicates, lancelets, and learned in the laboratory, and suggestions for future
mammals’. The final examination included five sec- laboratory courses. The first author, who is an inde-
tions: multiple-choice questions, fill-in-the-blank pendent researcher from a different institute, con-
questions, two types of matching questions, and ducted the interviews. Each interview lasted
essay questions. For example, one fill-in-the-blank approximately 50 minutes and dialogues were then
question asked: ‘The structure birds use to reduce transcribed verbatim. The interview results were par-
turbulence and maintain air flow over their upper ticularly important as the researchers tried to under-
wing surface is called __________’. The two types stand students’ views of the laboratory course and
of matching questions included matching a taxo- identify factors that might contribute to any differ-
nomic order to its description and matching ences between the experimental and control groups.
Chinese and English taxonomic orders. Also,
students’ grade point averages (GPA) from the three
previous terms (ie autumn 2006, spring 2007 and Data analysis
autumn 2007) were collected as baseline data. We employed stepwise discriminant analysis to ana-
lyse the student achievement data and identify factors
that would discriminate between students who took
Research proposal writing or did not take the laboratory course. We included
As a requirement of the course, each student wrote a 22 variables in the analysis: GPAs from three previous
research plan for a study in vertebrate biology. The semesters (autumn 2006, spring 2007 and autumn
instructor gave a brief set of instructions to both 2007), scores in eight blocks of questions on the mid-
groups of students regarding how to design research term examination, scores on 10 blocks of questions in
and write proposals. No additional instruction or the final examination, and scores assigned to the
information was given to students in the laboratory research proposals. Twelve students had one or more
course. A coding rubric was created by three experts missing GPAs values. We used the class average to fill
in vertebrate biology to judge the quality of the pro- in missing values. Because several pairs of variables
posals. The coding rubric included 15 evaluation cri- were significantly correlated with one another, we
teria: whether motivation for the research question used stepwise discriminant analysis to avoid the
was stated; whether the research question was rele- multi-colinearity problem.
vant to vertebrate biology; clarity of the research The results of the stepwise discriminant analysis
question; whether a multi-part research question was indicated that the experimental and control groups
asked; whether the multi-part research question had a differed in overall academic performance during pre-
focused theme; whether hypotheses were stated; vious semesters (see the Results section). Because
whether methods were consistent with the research students’ academic backgrounds could influence their
question asked; viability of the proposed methods; performance in the vertebrate biology course, we
whether the methods were focused; method thor- used one-way analysis of covariance (ANCOVA) to
oughness; sampling method clarity; overall practicality compare the final grades in our vertebrate biology
of the methods; whether expected results of the pro- course between the two groups. The two groups
posed research were stated; whether references were were treated as a fixed factor and GPA in the
listed; and overall impression of the proposal. Each autumn semester of 2006 was used as a covariate to
proposal was assigned randomly to two of the three control for differences in students’ academic back-
experts in a blind review process. The three experts grounds.
4 S.W.-Y. LEE ET AL. _______________________________________________________________________________________________
The results of the stepwise discriminant analysis on three short essay questions in the final examina-
also indicated that the two student groups may differ tion (Table 3). The findings indicated that students
in organisation or articulation abilities (see the in the experimental group did worse than students in
Results section). To address this question, we looked the control group in terms of grades in autumn
further at their performance in proposal writing. 2006. The grades of students in the experimental
Multidimensional scaling (MDS) was employed to group were also lower than those in the control
determine if the two groups performed differently, group in spring 2007 and autumn 2007, though this
and how grading criteria affected the grades received difference was not statistically significant. Thus, in
by the two groups. general, students who took the vertebrate biology
To interpret the interview data, we first applied laboratory had not performed as well academically in
an open coding technique to elicit emergent previous semesters when compared with students
themes. We then organised those themes into a who took the lecture course alone.
cognitive domain and an affective domain by adopt- Question 4 on the mid-term exam assessed the
ing Bloom’s Taxonomy (Bloom and Krathwohl ability to correctly define vertebrate biology termi-
1956). The cognitive domain included learning not nology. Students who took vertebrate biology lab-
only factual knowledge (eg learning about an ani- oratory performed worse than those taking the
Downloaded by [National Taiwan University], [Kirk Lin] at 02:40 14 November 2011
mal), but also learning conceptual knowledge (eg lecture only on this set of questions. Conversely,
learning the animal classification system) and proce- those taking the laboratory course performed better
dural knowledge (eg setting up equipment). Affec- on Questions D and E – Part 1 on the final
tive domains were defined by Bloom and exam. Question D assessed the ability to correctly
Krathwohl (1956) as the way in which people deal match classification names in Chinese and English.
with things emotionally, including feelings, values, Question E – Part 1 included three essay questions
appreciation, enthusiasms, motivations, and attitudes. asking for explanations of the ‘dynamic soaring of
As shown in Table 2, seven sub-categories emerged birds’, ‘the counter-current mechanism’, and ‘major
from our data for the cognitive domain and four advantages of group formation’. The discrimination
sub-categories emerged for the affective domain. between the two groups of students in terms of
Triangulation was performed between results of stu- GPA and Question 4 suggests that students who
dents’ performances and interview data to gain took the laboratory course were not good at rote
insight into how students perceived the learning memorisation. Thus, they tended to perform less
experience in the laboratory and to aid interpreta- satisfactorily when defining terms, and in biology
tion of statistical results. courses as a whole. However, in the vertebrate
biology laboratory, those students participated in
several sessions that involved classification terms, as
Results well as discussion sessions that allowed them to
Course achievement articulate the relationships between various struc-
The results of stepwise discriminant analysis yielded tures and functions. Those laboratory exercises may
a statistically significant discriminant function have contributed to their higher scores on ques-
(P < 0.001, Wilk’s Lambda = 0.689), which correctly tions D and E, the matching and essay questions,
classified 83.1% of students into the experimental and respectively.
control groups. The discriminant function included One-way ANCOVA found no significant differ-
four variables: GPA in autumn 2006, scores on ence in final grades between the experimental and
Question 4 in the mid-term examination, scores control groups (F1,62 = 0.116; P = 0.734) in the ver-
on Question D in the final examination, and scores tebrate biology course.
Table 2. Students’ views of learning in the laboratory in the cognitive and affective
domains
Visualising what is learned in the lecture class Field trips are exciting and fun
(through physical manipulation or observation) Field biology ecology is interesting
Learning to recognise animals Designing a good experiment is difficult and complicated
Learning the animal classification system Conducting research in the field is difficult
Learning to write reports
Learning to set up equipments in the field
Problem solving
Learning through social interactions
____________________________________________________________________________ RESEARCH PAPER 5
Variable Coefficient
specimens, learned to set up equipment and learned of the present study is that it further illustrates the
to write reports. types of examination questions that differentiated
Students also viewed the laboratory experience as performance between the control group (lecture
an opportunity for problem-solving. During some only) and the experimental group (lecture and labo-
laboratory sessions, students were asked to complete ratory). In other words, the impact of laboratory
tasks with limited direction from the instructors. courses may be evident from answers to examination
When they were given a chance in the laboratory to questions even when it is not evident in final grades
solve problems, they felt they were able to develop or exam scores. In addition, laboratory experiences,
an in-depth understanding of the problem presented. including experience in the field, may improve
Students also found interactions with other students, students’ abilities to design research studies. For
teaching assistants, and/or professors an essential part instance, students indicated in the interviews that the
of that process. As one student stated: ‘You learned opportunity to actually set up equipment in the field
from discussing with fellow students in the lab. You helped them to think more realistically about
don’t get that kind of opportunity in a lecture class’. research methodology. The laboratory course seemed
to introduce successfully practical skills to students as
well – not only laboratory techniques, but also better
Downloaded by [National Taiwan University], [Kirk Lin] at 02:40 14 November 2011
study suggests that educators and researchers anonymous reviewers that improved our manuscript
should measure the impact of laboratory extensively. The present study was supported by the
courses on student achievement at a finer National Science Council of Taiwan, under grant
level; eg science concept or assessment type. numbers NSC99-2511-S-018-003-MY2 NSC100-
In addition, future studies should consider 2628-S-018-001 MY3 to S.W.-Y. Lee, and a teaching
using the two analytical methods we enhancement grant from National Taiwan University
employed, discriminant analysis and multiple to H.-T.A. Yu and Y.K. Lin.
dimensional scaling, for further comparisons
between experimental and control groups.
Alternative assignments such as proposal writing References
can be effective methods for assessing practical Bloom, B.S., and D.R. Krathwohl. 1956. Taxonomy of educational objectives:
skills gained from inquiry-driven laboratories. the classification of educational goals. Cognitive Domain Longmans, New
York: Handbook I.
A detailed grading rubric is essential when Bowen, G.M., and W.-M. Roth. 2007. The practice of field ecology:
using this approach. Insights for science education. Research in Science Education 37:
Although laboratory courses are time-consum- 171–87.
Freedman, M.P. 1997. Relationship among laboratory instruction attitude
ing and may require additional teaching
Downloaded by [National Taiwan University], [Kirk Lin] at 02:40 14 November 2011