You are on page 1of 7

undergraduate education

Can virtual reality improve anatomy education?


A randomised controlled study of a
computer-generated three-dimensional anatomical
ear model
Daren T Nicholson,1 Colin Chalk,2 W Robert J Funnell3 & Sam J Daniel4

INTRODUCTION The use of computer-generated DISCUSSION Our findings stand in contrast to the
3-dimensional (3-D) anatomical models to teach handful of previous randomised controlled trials that
anatomy has proliferated. However, there is little evaluated the effects of computer-generated 3-D ana-
evidence that these models are educationally effect- tomical models on learning. The equivocal and neg-
ive. The purpose of this study was to test the educa- ative results of these previous studies may be due to
tional effectiveness of a computer-generated 3-D the limitations of these studies (such as small sample
model of the middle and inner ear. size) as well as the limitations of the models that were
studied (such as a lack of full interactivity). Given our
METHODS We reconstructed a fully interactive positive results, we believe that further research is
model of the middle and inner ear from a magnetic warranted concerning the educational effectiveness
resonance imaging scan of a human cadaver ear. To of computer-generated anatomical models.
test the model’s educational usefulness, we conduc-
ted a randomised controlled study in which 28 KEYWORDS randomized controlled trial [publica-
medical students completed a Web-based tutorial on tion type]; anatomy ⁄ *education; *models, anatomic;
ear anatomy that included the interactive model, teaching materials; Quebec; *education, medical;
while a control group of 29 students took the tutorial undergraduate.
without exposure to the model. At the end of the
tutorials, both groups were asked a series of 15 quiz Medical Education 2006; 40: 1081–1087
questions to evaluate their knowledge of 3-D rela- doi:10.1111/j.1365-2929.2006.02611.x
tionships within the ear.

RESULTS The intervention group’s mean score on INTRODUCTION


the quiz was 83%, while that of the control group was
65%. This difference in means was highly significant The dramatic advances in computer technology over
(P < 0.001). the past few decades have profoundly affected health
care, including the domain of medical education. For
years medical educators have shown great interest in
1
using computer applications in medical-school cur-
Department of Medical Informatics and Clinical Epidemiology,
Oregon Health and Science University, Portland, Oregon, USA
ricula to augment, or in some cases replace, tradi-
2
Department of Neurology and Neurosurgery and Centre for Medical tional teaching methods such as lectures, laboratories
Education, McGill University, Montréal, Québec, Canada
3
and textbooks. In the domain of human anatomy,
Departments of BioMedical Engineering and Otolaryngology, McGill
University, Montréal, Québec
many medical educators have turned to 3-dimen-
4
Department of Otolaryngology, McGill University, Montréal, Québec, sional (3-D) computer models as an alternative
Canada means of teaching this fundamental body of know-
Correspondence: Dr DT Nicholson, Oregon Health and Science ledge. One obvious factor underlying this trend is the
University, Department of Medical Informatics and Clinical decreased use of human cadavers to teach anatomy.
Epidemiology, 3181 SW Sam Jackson Park Road, BICC, Portland, OR
97239–3098, USA. Tel: (503) 418 2317; Fax: (503) 494 4551; Many medical-school curricula do not include cada-
E-mail: darensemail@yahoo.com ver dissection laboratories (including 8 of the 11

 Blackwell Publishing Ltd 2006. MEDICAL EDUCATION 2006; 40: 1081–1087 1081
1082 undergraduate education

compared the efficacy of computer-assisted anatomy


instruction (CAAI) with that of traditional teaching
Overview methods.3 The educational intervention that Hall-
gren and colleagues described as ÔWeb-based exerci-
What is already known on this subject sesÕ does not appear to involve computer-generated
anatomical models.4
There are only a few published evaluations of
computerised anatomical models, and these To supplement the results of Lewis’s review, we
studies have had negative or equivocal results. searched Medline (from April 1965 to 1 June 2005)
using the combined MeSH headings ÔanatomyÕ and
What this study adds Ôcomputer-assisted instructionÕ and found only 4
randomized controlled studies that evaluated compu-
Our study presents positive results based on a ter-generated anatomical models. Three of these 4
relatively large sample size. In addition, our articles comprise a series of studies conducted by Garg
anatomical model is more interactive than the and colleagues5–7 that evaluated the educational
models used in previous studies. effectiveness of an interactive 3-D model of the carpal
bones. The intervention groups in these studies were
Suggestions for further research able to interact with the 3-D model and were thereby
exposed to multiple views of the carpal bones. By
Future studies with large sample sizes should contrast, members of the control groups were presen-
be conducted to validate the positive results ted with a limited number of ÔkeyÕ views of the carpal
found in our study. bones (such as the dorsal and palmar perspectives).
This presentation of a small number of canonical views
is consistent with the approach taken by most ana-
medical schools in Australia).1 Reasons cited for this tomical atlases. Based on the results of these 3 studies,
decline include the rising costs and decreasing the authors offered the following mixed conclusion:
availability of cadavers2 as well as the advent of new Ôthe potential for dynamic display of multiple orienta-
teaching methods, such as problem-based learning, tions provided by computer-based anatomy software
which do not include dissection laboratories.1 may offer minimal advantage to some learners and…
may disadvantage learners with poorer spatial abilityÕ.7
In some instances traditional teaching modalities, The fourth randomised controlled study that we
such as cadaver dissection, prove to be ineffective identified compared the use of a shoulder arthroscopy
teaching tools. For example, the complexity of the simulator to the use of traditional 2-dimensional (2-D)
middle and inner ear, coupled with the small size of images of shoulder anatomy. Both the control group
its anatomical structures, creates many obstacles to and the intervention group scored poorly on the
teaching ear anatomy with traditional instructional evaluation quiz, and there was no statistically signifi-
techniques. Because of the small size of ear specimens cant difference between the groups’ mean scores.8
and because the ear is embedded in bone, studying a
cadaveric ear requires advanced dissection skills, Computer-assisted anatomy instruction is generally
which most medical students lack. As an alternative or perceived by medical students to be enjoyable,9 but
supplement to cadaveric ears, some educators use whether it actually enhances learning is unproven. As
magnified, artificial models of the ear as a 3-D our literature review attests, the evidence supporting
demonstration aid. However, due to the high price the educational effectiveness of CAAI is lukewarm at
and decreasing availability of such models, providing best. Furthermore, much of what is considered to be
adequate access to artificial models for large medical Ôcomputer-assisted instructionÕ is in reality little more
schools is virtually impossible. Furthermore, many than static text and images on a screen and does not
anatomical details are absent from these models. truly exploit the unique advantages of the medium.
Computerized 3-D anatomical models promise to Although the use of computer-generated 3-D ana-
overcome many of these educational challenges. tomical models has potential advantages over tradi-
tional anatomy instruction methods, the time and
Although many educators have developed computer- financial resources needed to develop and adopt
generated anatomical models as teaching tools, there these models are significant. For instance, the
has been little published research on the effective- authors spent approximately 160 person-hours to
ness of these models. In a recent literature review, develop the 3-D ear model evaluated in this study
Lewis found only 1 study (by Hallgren et al.) that had (excluding the hundreds of hours spent previously

 Blackwell Publishing Ltd 2006. MEDICAL EDUCATION 2006; 40: 1081–1087


1083

writing the software used to generate the 3-D model). the middle and inner ear of a human cadaver.10 From
We believe that it is important to evaluate properly these images we reconstructed our model using
the effectiveness of computer-generated anatomical software developed in our laboratory (specifically,
models before continuing to invest time and financial two programs named Fie and Tr3, which were written
resources in this new technology. and are maintained by one of the authors, WRJF, and
can be downloaded free from the Internet at: http://
In this context we conducted a randomised con- audilab.bmed.mcgill.ca/funnell/AudiLab/sw/).
trolled study to assess the educational value of a The model includes the major anatomical structures
computer-generated 3-D anatomical model of the (ossicles, tympanic membrane, vestibulocochlear
ear. In designing the study, we specifically sought to apparatus, etc.) of the middle and inner ear (see
test whether learning is enhanced by exploiting a Fig. 1). The model is stored as a virtual reality
property of computer technology for which good modelling language file. (VRML is an ISO standard
counterparts are lacking in traditional teaching for distributing 3-D models on the Web.) After
media: the ability to manipulate 3-D structures in generating the model, we built an online ear-anatomy
space. A firm grasp of the 3-D relationships of tutorial around it. The tutorial is presented as a series
anatomical structures is central to the learning and of Web pages that display text and 2-D images of the
clinical application of anatomy. We hypothesised that middle and inner ear with links to various versions of
student learning of 3-D anatomical relationships the 3-D model. When a user clicks on a link to a 3-D
within the ear would be improved by use of our model, the model is displayed and can be manipu-
computer-generated 3-D model in addition to the lated by the user within the Web browser. A VRML
standard teaching modalities of text and 2-D images. viewer plug-in must be installed in the user’s Web
browser prior to using the tutorial. Several such
viewers are freely available. During our study we used
METHODS Cosmo Player. (Cosmo Player is no longer supported,
but it can still be downloaded from several sites on
Study design the Web.) Viewing capabilities in Cosmo Player
include arbitrary rotation of the model and an in ⁄ out
We used a randomised control-group design for our zoom feature. Also, when hovering the mouse over a
study. The outcome measure was the score on a 15- given 3-D structure, a label is displayed to identify the
item quiz administered after a computer-based anat- structure.
omy tutorial. Our study was approved by the McGill
University Institutional Review Board. Procedures

Participants Our study’s ultimate goal was to evaluate whether our


3-D model improves students’ learning of 3-D ana-
We recruited our study subjects from the first-year tomical relationships in the ear. The 3-D model is not
medical-school class at McGill University (Montréal, meant to improve students’ ability simply to recog-
Québec) via e-mail and class announcements. All nise and name anatomical structures. To be certain
first-year students were eligible for the study. Partici- that all participants in the study had sufficient a
pation in the study was voluntary and a small priori knowledge of the names and appearances of
remuneration was offered for completion of the middle- and inner-ear structures, we required all
study. All volunteers provided written consent. participants to take an online tutorial that reviews
these structures using text and 2-D images (phase 1 of
We felt that a difference of 2 or more in the mean the study). Following the phase 1 tutorial, the
quiz scores (of a total of 15) between the intervention students were required to pass a quiz (7 of 8 answers
and control groups would be a meaningful effect. To correct) to qualify for the main portion of the study
detect this difference in means at a significance level (phase 2). For each phase 1 quiz question, a 2-D
of 95% and with a power of 0.90, we estimated that a representation of an anatomical ear structure was
total sample size of 60 students (30 in each group) displayed and the student had to name the structure.
would be necessary. Students who failed the quiz were allowed to retake
the phase 1 tutorial and quiz until they were able to
Materials achieve a pass mark. We allowed the participants to
complete this preliminary tutorial and quiz from any
The source of the 3-D model used in our study was a Internet-connected computer. At the end of phase 1
high-resolution magnetic resonance imaging scan of we collected baseline information about the

 Blackwell Publishing Ltd 2006. MEDICAL EDUCATION 2006; 40: 1081–1087


1084 undergraduate education

Figure 1 Structures included in ear model.

4 sessions, which were offered over a 2-day period.


Table 1 Baseline information questions
We randomly assigned the students (using a ran-
dom-number table) to either the control or the
1. Please select your sex (female or male)
2. Have you studied ear anatomy previous to medical school?
intervention group. Students worked at their own
(yes or no) pace through the online tutorial. This tutorial was
3. Do you regularly engage in any of the following activities: identical for the 2 groups except that the links to
painting, sculpture, carpentry or 3-D graphic design? (yes
or no)
the 3-D model were disabled for those in the control
4. How much experience do you have playing 3-D video group. Once a participant felt ready, he or she
games? proceeded to the phase 2 quiz page. The quiz
o Never (I have never played 3-D video games in the past)
o Some (I play, or have played in the past, not more than
consisted of 15 questions, each designed to assess
once a month) the participants’ perceptions of 3-D relationships
o Moderate (I play, or have played in the past, more than among ear structures. Twelve of these questions
once a month but less than 5 times per month)
o Lots (I play, or have played in the past, 5 times per
were multiple-choice, while the remaining 3 re-
month or more often) quired the students to name a structure by comple-
ting a free-text data entry field. Participants were
instructed not to return to the tutorial Web pages
once they began the phase 2 quiz. Web-server logs
were used to calculate the time each student spent
participants, including their gender, their past completing the tutorial and quiz.
experiences with ear anatomy and their past experi-
ences with visual-spatial tasks (see Table 1). We also Analysis
assessed their visual-spatial skills using a standard
visual-spatial test.11 The primary outcome measure of our study was the
mean score on the phase 2 quiz. We compared the
Phases 1 and 2 of our study were conducted mean scores of the intervention and control groups
concurrently with the students’ usual teaching about with a 2-tailed Student’s t-test (using SPSS statistical
the anatomy of the ear (a 1-hour whole-class lecture software). We also used Student’s t-test to compare
plus a small-group demonstration using a large the mean scores on the visual-spatial test and the
plaster model of the ear). Phase 2 was conducted in mean length of time taken to complete the phase 2
a computer laboratory with students assigned to 1 of tutorial and quiz. To analyse the participants’

 Blackwell Publishing Ltd 2006. MEDICAL EDUCATION 2006; 40: 1081–1087


1085

responses concerning their prior experience with


3-D games, we conducted Wilcoxon’s rank sum test. DISCUSSION
Finally, v2 tests were used to ensure that the groups
were comparable with respect to gender, previous With this study we have demonstrated that a com-
exposure to ear anatomy and experience in visual puter-based 3-D anatomical model enhances medical
arts. students’ learning of ear anatomy. Our findings stand
in contrast to the handful of previous attempts to
evaluate the effects of computer-generated 3-D ana-
RESULTS tomical models on learning. The negative or equi-
vocal results of previous studies may, in part, be the
Sixty-one students agreed to participate in the study, result of study design. The equivocal results found by
and we randomised them to either the control Hariri et al. (shoulder model study) may be due to
group (n ¼ 30) or the intervention group (n ¼ 31). low statistical power (their sample size was only 29
Four of these students (1 from the control group students).8 The 3 studies by Garg et al. (carpal bones
and 3 from the intervention group) were disquali- model) failed to show any learning advantage using
fied from the study because they returned to the computer-generated 3-D models. However, our 3-D
tutorial Web pages after having begun the phase 2 model of the middle and inner ear differs from the
quiz. Thus, the final sample sizes were n ¼ 29 for carpal-bones model of Garg et al. in several respects.
the control group and n ¼ 28 for the intervention First, our 3-D ear model is fully interactive: it may be
group. zoomed in and out, panned across the screen, and
rotated smoothly in all three directions (x, y and z
The mean phase 2 quiz score for the control axes). Moreover, the structures involved in the
group was 9.8 ⁄ 15 (65%) while that of the inter- middle and inner ear are far more complex and
vention group was 12.5 ⁄ 15 (83%) (see Fig. 2, Table volumetric than the carpal bones. Indeed, Garg and
2). The standard deviations for the control and colleagues themselves note that their findings might
intervention groups were 1.8 ⁄ 15 (12%) and 1.7 ⁄ 15 be ÔconstrainedÕ by the fact that the carpal bones Ôfall
(11%), respectively. This difference in mean quiz naturally into two planesÕ.7 Thus, it may be the
scores (18% with a confidence interval of 12–24%) greater level of interactivity inherent in our model
was highly significant (P < 0.001). With regard to and the greater complexity of the modelled structure
the participants’ baseline information, there were that led to a positive effect on the participants’
no significant differences between the two groups learning.
(see Table 2). There was a significant difference in
the mean length of time spent to complete the Our study also has limitations. First, our outcome
phase 2 tutorial and quiz (control group mean: measure (the phase 2 quiz score) is merely a
16 min; intervention group mean: 21 min; differ- surrogate measure of 3-D anatomical understanding.
ence of means: 5 min; confidence interval of We did not test the reliability nor the validity of our
difference of means: 2.8–7.2 min; significance: outcome measure. Second, it was not possible to
P < 0.001). measure the participants’ effort levels during the
study. Without any incentive to score well on the
quiz, some participants may well have worked at less
than maximal effort. Thus, our results could be due
110
to a higher average effort level in the intervention
group as opposed to the control group. This
100 maximum limitation is not unique to our study and would
upper quartile apply to the previous work in this field. Finally, we
90
Score (%)

median did not impose a time limit on the participants. As


80 noted, students in the intervention group spent
lower quartile more time completing the tutorial and quiz than did
70
minimum those in the control group. Perhaps the improve-
60 ment in mean quiz scores was not due to the
50 intrinsic value of the 3-D model as a teaching tool;
rather, the novelty of the 3-D model may have
40
Control Intervention encouraged the intervention group to spend more
time and to concentrate more on the material as
Figure 2 Box-plot of mean quiz scores. opposed to the control participants, thereby leading

 Blackwell Publishing Ltd 2006. MEDICAL EDUCATION 2006; 40: 1081–1087


1086 undergraduate education

Table 2 Comparison of average data points between groups

Control Intervention
group group Statistical
result result test P-value
Measure

Mean score on phase 2 quiz (%) 65 83 Student’s t < 0.001


Mean length of time to complete phase 2 (min) 16 21 Student’s t < 0.001
Percentage female 62 64 v2 0.86
Percentage with prior anatomy experience 38 46 v2 0.52
Percentage with prior art experience 7 11 v2 0.61
Mean rank of prior 3-D game experience 27.7 30.3 Wilcoxon’s rank sum 0.52
Mean percentage score on visual–spatial quiz 95 93 Student’s t 0.56

to better quiz scores. One can argue that, either way, Funding: funding for this study was provided by the
the outcome is the same: better understanding of McGill University Centre for Medical Education and the
3-D anatomical relationships. Division of Neurology, Montreal General Hospital. Funding
for the development of the ear model was provided by the
Although our study subjects were medical students, it Canadian Institutes of Health Research and by the Natural
Sciences and Engineering Research Council (Canada).
seems plausible that our ear model would also be an
Dr Nicholson was supported by National Library of
effective method of teaching residents and practising
Medicine Training Grant 5.T15-LM007088-14.
physicians. Indeed, our ear model, which we devel- Conflicts of interest: none.
oped originally as a teaching tool for otolaryngology Ethical approval: ethical approval for this study was
residents, was well received during teaching sessions granted by the McGill University Institutional Review Board.
for residents.

Computer-based interactive 3-D models may also be REFERENCES


valuable teaching tools in other biomedical domains
which involve complex 3-D relationships, such as 1 Parker LM. What’s wrong with the dead body? Use of
histology and cell biology, as well as 3-D-intensive the human cadaver in medical education. Med J Aust
non-biomedical domains. 2002;176(2):74–6.
2 Berube D, Murray C, Schultze K. Cadaver and com-
In summary, the use of CAAI is already widespread. puter use in the teaching of gross anatomy in physical
Only a few studies have attempted to evaluate the therapy education. J Phys Ther Educ 1999;13(2):41–6.
effectiveness of these teaching tools and, to date, 3 Lewis MJ. Computer-assisted learning for teaching
there is little objective evidence that computer- anatomy and physiology in subjects allied to medicine.
Med Teach 2003;25(2):204–6.
assisted instruction improves anatomy teaching. The
4 Hallgren RC, Parkhurst PE, Monson CL, Crewe NM.
results of this study, however, are very positive and An interactive, web-based tool for learning anatomic
suggest that further work is warranted both on the landmarks. Acad Med 2002;77(3):263–5.
development of interactive 3-D models and on the 5 Garg A, Norman GR, Spero L, Maheshwari P. Do vir-
evaluation of their effectiveness. tual computer models hinder anatomy learning? Acad
Med 1999;74(10 Suppl.):S87–9.
6 Garg AX, Norman G, Sperotable L. How medical stu-
Contributors: each of the authors contributed to the study dents learn spatial anatomy. Lancet
design as well as the drafting of the article. Drs Nicholson 2001;357(9253):363–4.
and Funnell were responsible for collection and analysis of 7 Garg AX, Norman GR, Eva KW, Spero L, Sharan S. Is
data. there any real virtue of virtual reality? The minor role
Acknowledgements: the authors would like to of multiple orientations in learning anatomy from
acknowledge Drs O.W. Henson Jr and M. Henson of the computers. Acad Med 2002;77(10 Suppl.):S97–9.
University of North Carolina at Chapel Hill for providing 8 Hariri S, Rawn C, Srivastava S, Youngblood P, Ladd A.
the MRI scan that we used to construct our 3-D ear model. Evaluation of a surgical simulator for learning clinical
The MRI scan was conducted at Duke University’s Center anatomy. Med Educ 2004;38(8):896–902.
for in vivo Microscopy. We would also like to thank Dr Sam 9 Nieder GL, Nagy F. Analysis of medical students’ use of
David of McGill University for his valuable input web-based resources for a gross anatomy and embry-
concerning the text of our tutorial. ology course. Clin Anat 2002;15(6):409–18.

 Blackwell Publishing Ltd 2006. MEDICAL EDUCATION 2006; 40: 1081–1087


1087

10 Henson OW, Henson M. Scan S16885. Available at: (VIZ). Available at: http://viz.bd.psu.edu/viz/
http://cbaweb2.med.unc.edu/henson_mrm/pages/ (accessed April 2004).
Scans_Primates.html (accessed September 2003).
11 Pennsylvania State University at Erie. The Behrend Received 6 September 2005; editorial comments to authors
College Visualization Assessment and Training Project 23 September 2005; accepted for publication 5 May 2006

 Blackwell Publishing Ltd 2006. MEDICAL EDUCATION 2006; 40: 1081–1087

You might also like