You are on page 1of 6

IT in Medical Education

The Impact of E-Learning in Medical


Education
Jorge G. Ruiz, MD, Michael J. Mintzer, MD, and Rosanne M. Leipzig, MD, PhD

Abstract
The authors provide an introduction to personal learning objectives. In diverse scholarship. Innovations in e-learning
e-learning and its role in medical medical education contexts, e-learning technologies point toward a revolution in
education by outlining key terms, the appears to be at least as effective as education, allowing learning to be
components of e-learning, the evidence traditional instructor-led methods such as individualized (adaptive learning),
for its effectiveness, faculty development lectures. Students do not see e-learning enhancing learners’ interactions with
needs for implementation, evaluation as replacing traditional instructor-led others (collaborative learning), and
strategies for e-learning and its training but as a complement to it, transforming the role of the teacher. The
technology, and how e-learning might forming part of a blended-learning integration of e-learning into medical
be considered evidence of academic strategy. A developing infrastructure to education can catalyze the shift toward
scholarship. support e-learning within medical applying adult learning theory, where
education includes repositories, or digital
educators will no longer serve mainly as
E-learning is the use of Internet libraries, to manage access to e-learning
the distributors of content, but will
technologies to enhance knowledge and materials, consensus on technical
performance. E-learning technologies become more involved as facilitators of
standardization, and methods for peer
offer learners control over content, review of these resources. E-learning learning and assessors of competency.
learning sequence, pace of learning, presents numerous research Acad Med. 2006; 81:207–212.
time, and often media, allowing them to opportunities for faculty, along with
tailor their experiences to meet their continuing challenges for documenting

T oday’s medical educators are facing care institutions to community-based outlining the following: key terms, the
different challenges than their settings for chronic care, have required components of e-learning, the evidence
predecessors in teaching tomorrow’s adaptations in educational venues.2 for its effectiveness, faculty development
physicians. In the past few decades, Finding time to teach “new” fields such needs for implementing e-learning,
changes in health care delivery and as genomics, palliative care, geriatrics, evaluation strategies for e-learning and its
advances in medicine have increased and complementary medicine is difficult technology, and the potential for e-
demands on academic faculty, resulting when medical school curricula are learning to be considered evidence of
in less time for teaching than has already challenged to cover conventional academic scholarship.
previously been the case.1 Changes in materials.1 Traditional instructor-
sites of health care delivery, from acute centered teaching is yielding to a learner-
centered model that puts learners in Definitions
control of their own learning. A recent
Dr. Ruiz is assistant professor of clinical medicine, E-learning is also called Web-based
Division of Gerontology and Geriatric Medicine, shift toward competency-based curricula
learning, online learning, distributed
University of Miami Miller School of Medicine, emphasizes the learning outcome, not the
Miami, Florida; associate director for learning, computer-assisted instruction,
process, of education.3
education/evaluation, Geriatric Research, Education, or Internet-based learning. Historically,
and Clinical Center, VA Medical Center, Miami, there have been two common e-learning
Florida; and senior investigator, Stein Gerontological
E-learning refers to the use of Internet
Institute, Miami, Florida. technologies to deliver a broad array of modes: distance learning and computer-
solutions that enhance knowledge and assisted instruction. Distance learning
Dr. Mintzer is associate professor of clinical uses information technologies to deliver
medicine, Division of Gerontology and Geriatric performance.4,5 E-learning can be used by
Medicine, University of Miami Miller School of medical educators to improve the instruction to learners who are at remote
Medicine, Miami, Florida; director, Community efficiency and effectiveness of educational locations from a central site. Computer-
Academic Partnerships, and investigator, Geriatric assisted instruction (also called
Research, Education, and Clinical Center, VA Medical interventions in the face of the social,
Center, Miami, Florida; and senior investigator, Stein scientific, and pedagogical challenges computer-based learning and computer-
Gerontological Institute, Miami, Florida. noted above. It has gained popularity in based training) uses computers to aid in
Dr. Leipzig is professor, Department of Geriatrics the past decade; however, its use is highly the delivery of stand-alone multimedia
and Adult Development; and vice chair for variable among medical schools and packages for learning and teaching.7
education, Brookdale Department of Geriatrics and appears to be more common in basic These two modes are subsumed under
Adult Development, Mount Sinai School of e-learning as the Internet becomes the
Medicine, New York, New York. science courses than in clinical
clerkships.6,7 integrating technology.
Correspondence should be addressed to Dr. Ruiz, VA
Medical Center, GRECC (11GRC), 1201 NW 16th
Street, Miami, FL 33125; telephone: (305) 575-3388; In this article, we review the current state A concept closely related to e-learning
fax: (305) 575-3365; e-mail: 具jruiz2@med.miami.edu典. of e-learning in medical education by but preceding the birth of the Internet is

Academic Medicine, Vol. 81, No. 3 / March 2006 207


IT in Medical Education

multimedia learning. Multimedia uses learn by relating new learning to past based learning modules. Content creators
two or more media, such as text, experiences, by linking learning to use instructional design and pedagogical
graphics, animation, audio, or video, to specific needs, and by practically applying principles to produce learning objects
produce engaging content that learners learning, resulting in more effective and and instructional materials.
access via computer. Blended learning, a efficient learning experiences.11 Learning
fairly new term in education but a enhancement permits greater learner Content management includes all the
concept familiar to most educators, is an interactivity and promotes learners’ administrative functions (e.g., storing,
approach that combines e-learning efficiency, motivation, cognitive indexing, cataloging) needed to make
technology with traditional instructor-led effectiveness, and flexibility of learning e-learning content available to learners.
training, where, for example, a lecture or style. Learning is a deeply personal Examples include portals, repositories,
demonstration is supplemented by an experience: we learn because we want to digital libraries, learning-management
online tutorial.8 learn. By enabling learners to be more systems, search engines, and ePortfolios.
active participants, a well-designed A learning-management system, for
Faculty, administrators, and learners find e-learning experience can motivate them example, is Internet-based software that
that multimedia e-learning enhances to become more engaged with the facilitates the delivery and tracking of
both teaching and learning. These content.12 Interactive learning shifts the e-learning across an institution.15,16 A
advantages can be categorized as focus from a passive, teacher-centered learning-management system can serve
targeting either learning delivery or model to one that is active and learner- several functions beyond delivering e-
learning enhancement. centered, offering a stronger learning learning content. It can simplify and
stimulus. Interactivity helps to maintain automate administrative and supervisory
Learning delivery is the most often cited
the learner’s interest and provides a tasks, track learners’ achievement of
advantage of e-learning and includes
means for individual practice and competencies, and operate as a repository
increased accessibility to information,
reinforcement. Evidence suggests that for instructional resources twenty-four
ease in updating content, personalized
e-learning is more efficient because hours a day.15,16 Learning-management
instruction, ease of distribution,
learners gain knowledge, skills, and systems familiar to medical educators are
standardization of content, and
attitudes faster than through traditional WebCT® or Blackboard®, but there are
accountability.4,5 Accessibility refers to
instructor-led methods. This efficiency is more than 200 commercially available
the user’s ability to find what is needed,
likely to translate into improved motivation systems, a number that is growing
when it is needed. Improved access to
and performance.12 E-learners have rapidly.
educational materials is crucial, as
demonstrated increased retention rates
learning is often an unplanned
and better utilization of content, Content delivery may be either
experience.5,7 Updating electronic
resulting in better achievement of synchronous or asynchronous.5
content is easier than updating printed
knowledge, skills, and attitudes.12 Synchronous delivery refers to real-time,
material9: e-learning technologies allow
Multimedia e-learning offers learners the instructor-led e-learning, where all
educators to revise their content simply
flexibility to select from a large menu of learners receive information
and quickly. Learners have control over
media options to accommodate their simultaneously and communicate
the content, learning sequence, pace of
diverse learning styles.12 directly with other learners. Examples
learning, time, and, often, media, which
include teleconferencing (audio, video, or
allows them to tailor their experience to
both), Internet chat forums, and instant
meet personal learning objectives.10 Components of E-Learning messaging. With asynchronous delivery,
Internet technologies permit the
Creating e-learning material involves the transmission and receipt of
widespread distribution of digital content
several components: once content is information do not occur
to many users simultaneously anytime
developed, it must be managed, simultaneously. The learners are
and anywhere.
delivered, and standardized. responsible for pacing their own self-
An additional strength of e-learning is instruction and learning. The instructor
that it standardizes course content and Content comprises all instructional and learners communicate using e-mail
delivery; unlike, for instance, a lecture material, which can range in complexity or feedback technologies, but not in real
given to separate sections of the same from discrete items to larger instructional time. A variety of methods can be used
course. Automated tracking and modules. A digital learning object is for asynchronous delivery, including e-
reporting of learners’ activities lessen defined as any grouping of digital mail, online bulletin boards, listservs,
faculty administrative burden. Moreover, materials structured in a meaningful way newsgroups, and Weblogs.
e-learning can be designed to include and tied to an educational objective.13
outcomes assessment to determine Learning objects represent discrete, self- In addition to establishing, managing,
whether learning has occurred.11 contained units of instructional material and delivering content, a fourth
assembled and reassembled around component is part of the e-learning
Advantages in learning enhancement are specific learning objectives, which are equation. It is becoming increasingly
a less well recognized but potentially used to build larger educational materials clear that standards are needed for the
more revolutionary aspect of e-learning such as lessons, modules, or complete creation of new e-learning material.17
than are those related to learning courses to meet the requirements of a Such standards promote compatibility
delivery. E-learning technologies offer specified curriculum.14 Examples include and usability of products across many
educators a new paradigm based on adult tutorials, case-based learning, computer systems, facilitating the
learning theory, which states that adults hypermedia, simulations, and game- widespread use of e-learning materials.

208 Academic Medicine, Vol. 81, No. 3 / March 2006


IT in Medical Education

Several organizations have been engaged computer-based instruction to traditional instructor-led training but as a
in creating broad e-learning standards.17 teaching methods. The studies used a complement to it, forming part of a
Although not specifically designed for variety of designs in both training and blended-learning strategy.11,22
medical education, these standards offer academic environments, with
medical educators important advantages. inconsistent results for many outcomes.
The most well-known set of standards is Yet learners’ knowledge, measured by Availability of E-Learning
the Advanced Distributed Learning: pre-post test scores, was shown to Resources
Sharable Content Object Reference improve. Moreover, learners using Thanks to the growth of educational
Model (SCORM). SCORM is a group of computer-based instruction learned technologies and the Internet, the
specifications developed through a more efficiently and demonstrated better number of e-learning resources available
collaborative effort of e-learning retention. to educators has dramatically increased.
organizations funded by the United Within medical education, repositories or
States Department of Defense.17 SCORM Recent reviews of the e-learning digital libraries have been established to
specifications prescribe the manner in (specifically Web-based learning) manage access to e-learning materials.
which a learning-management system literature in diverse medical education Although few at this time, such
handles e-learning products.17 E-learning contexts reveal similar findings.22 repositories offer a vision of expanded
material built to SCORM specifications Chumley-Jones and colleagues22 reviewed access to a large number of high-quality,
will interact with a conformant learning- 76 studies from the medical, nursing, and peer-reviewed, sharable e-learning
management system, allowing for the dental literature on the utility of Web- materials (see Table 1). Examples include
prescription of the learning experience based learning. About one-third of the the Association of American Medical
and tracking of learner performance. In studies evaluated knowledge gains, most Colleges’ (AAMC’s) MedEdPortal, a
medical education, MedBiquitous, a using multiple-choice written tests, repository for curriculum and assessment
consortium of academic, government, although standardized patients were used materials organized around core
and health care industry organizations, is in one study. In terms of learners’ competencies in medical education and
working to develop SCORM-compliant achievements in knowledge, Web-based populated with up-to-date, peer-
specifications and standards for medical learning was equivalent to traditional reviewed teaching and assessment
education.18 methods. Of the two studies evaluating materials.23 The End of Life/Palliative
learning efficiency, only one Education Resource Center is a free-
demonstrated evidence for more efficient access repository of digital content for
The Evidence for Effective and learning via Web-based instruction.22 health profession educators involved in
Efficient E-Learning palliative care education.24 The Health
The effectiveness of e-learning has been A substantial body of evidence in the Education Assets Library (HEAL)
demonstrated primarily by studies of nonmedical literature has shown, on the provides high-quality digital materials for
higher education, government, corporate, basis of sophisticated cost analysis, that health sciences educators25 and promotes
and military environments.11,19 However, e-learning can result in significant cost- the preservation and exchange of useful
these studies have limitations, especially savings, sometimes as much as 50%, educational assets such as individual
because of the variability in their compared with traditional instructor-led graphic, video, or audio elements, while
scientific design.19,20 Often they have learning.11 Savings are related to reduced respecting ownership and privacy. HEAL
failed to define the content quality, instructor training time, travel costs, and has begun a peer-review process for all
technological characteristics, and type of labor costs, reduced institutional e-learning materials submitted to the
specific e-learning intervention being infrastructure, and the possibility of library.25 The Multimedia Educational
analyzed. In addition, most have included expanding programs with new Resource for Learning and Online
several different instructional and educational technologies.11 Only one Teaching (MERLOT) is designed
delivery methodologies, which study in the medical literature evaluated primarily for faculty and students of
complicates the analysis.21 Most of these the cost-effectiveness of e-learning as higher education.26 The service collects
studies compared e-learning with compared with text-based learning. The links to online learning materials, along
traditional instructor-led approaches.15,19 authors found the printing and with annotations such as users’ reviews
distribution of educational materials to and assignments. MERLOT contains a
Yet three aspects of e-learning have been be less costly than creating and growing science and technology section
consistently explored: product utility, disseminating e-learning content.22 that includes health care education e-
cost-effectiveness, and learner learning materials.26 The International
satisfaction. Utility refers to the Studies in both the medical and Virtual Medical School (IVIMEDS) is an
usefulness of the method of e-learning. nonmedical literature have consistently international organization whose mission
Several studies outside of health care have demonstrated that students are very is to set new standards for e-learning in
revealed that most often e-learning is at satisfied with e-learning.11,22 Learners’ medical education through a partnership
least as good as, if not better than, satisfaction rates increase with e-learning of medical schools and institutions, using
traditional instructor-led methods such compared to traditional learning, along a blended-learning approach. IVIMEDS
as lectures in contributing to with perceived ease of use and access, hosts a repository for use by its member
demonstrated learning.5,11 Gibbons and navigation, interactivity, and user- medical schools.27 Most of the materials
Fairweather11 cite several studies from the friendly interface design.11,22 in this repository are free to use, although
pre-Internet era, including two meta- Interestingly, students do not see some materials have clearly defined
analyses that compared the utility of e-learning as replacing traditional conditions for use. In the future, these

Academic Medicine, Vol. 81, No. 3 / March 2006 209


IT in Medical Education

that is highly entertaining in its use of


Table 1 multimedia but superficial in its content
Medical Education Organizations Supporting E-Learning may be rated as excellent.
Organization Characteristics
Tracking and monitoring learners’
MedEdPortal, Association of American Medical Repository knowledge, attitudes, and skills via a
Colleges (AAMC) All digital content types
具http://www.aamc.org/meded/mededportal/典
learning-management system can greatly
Material linked to educational competencies simplify the process of evaluating the
Peer reviewed gains made through e-learning. An
“Virtual patients” bank approach that combines assessment of
.........................................................................................................................................................................................................
End of Life/Palliative Education Resource Center Repository skills and attitudes using e-learning
(EPERC) Digital content in end-of-life issues technology with facilitator-mediated
具http://www.eperc.mcw.edu/典 observation would allow a more in-depth
Peer reviewed
evaluation of skills and behavior. By
Links to other online resources
......................................................................................................................................................................................................... contrast, evaluating the direct result of an
The Health Education Assets Library (HEAL) Repository education program by measuring changes
具http://www.healcentral.org典 Large number of learning assets in learners’ behaviors, institutional
Growing number of learning objects changes, and better patient care is often
Peer reviewed
.........................................................................................................................................................................................................
complex, time-consuming, and costly.
Multimedia Educational Resource for Learning Repository for higher education E-learning assessments can be one
and Online Teaching (MERLOT) Links to other online resources with peer- valuable component in such overall
具http://www.merlot.org典 review comments evaluation of medical school curricula.
Growing science and technology section
.........................................................................................................................................................................................................
International Virtual Medical School (IVIMEDS) A consortium of medical schools
E-Learning as Academic
具http://www.ivimeds.org/典 Setting standards in medical education Scholarship
Repository for member schools
The literature regarding faculty
Partnerships
development or promotion of e-learning
Blended learning
as evidence of scholarly pursuit is almost
nonexistent to our knowledge; however,
and other repositories may require a computer skills, hardware, or software as noted above, e-learning requires
membership or other fees to cover the required? These and other questions faculty competencies that go beyond
ongoing expenses of Web-site place new demands on peer reviewers traditional instructional activities.
maintenance. engaged in process evaluation of Furthermore, by its nature, e-learning
e-learning. In fact, the AAMC, at the offers learners and instructors the
request of the Council of Deans, has possibility of widespread use, access, and
Evaluating E-Learning Processes begun a peer-review process of e-learning sharing unmatched by other types of
and Outcomes that recognizes these materials as instruction. Evaluation data from peer
Adopting e-learning and its technology evidence of scholarly activity for faculty review as well as learning-management
requires large investments in faculty, promotion and recognition.28 system tracking and monitoring of
time, money, and space that need to be e-learning use can provide evidence of its
justified to administrators and leadership. Outcome evaluation of changes in quality and effectiveness. How are faculty
As with other educational materials, there learners’ knowledge, skills, or attitudes members recognized and rewarded for
are two major approaches to the allows e-learning developers to gauge their dedication to this effort? The
evaluation of e-learning: process and program effectiveness. The evaluation following activities could be considered
outcomes. framework outlined by Kirkpatrick29 in evidence of scholarship for faculty
the 1950s and later adapted to health promotion:
Process evaluation examines an care education30 can be used to evaluate ▪ Publication of e-learning materials in a
e-learning program’s strengths and e-learning interventions.31 The national online peer-reviewed
weaknesses and how its results are Kirkpatrick model defines four levels of repository.
produced, often providing information evaluation based on outcome:
that will allow others to replicate it. Peer satisfaction, learning, change in learner ▪ Faculty and learner evaluations of one’s
review is one type of process evaluation. behavior, and organizational change/ e-learning material.
Traditional peer review for journal patient outcome.
articles verifies the quality of content. ▪ Peer-reviewed publications describing
E-learning requires the consideration of Satisfaction measures learners’ reactions the process, impact, and scientific
additional dimensions. For example, is it to the material: was it easy to use, hard to contributions of e-learning to medical
easy to “navigate” through the online use, fun, boring, and so forth. But education.
material? Is the appearance conducive to satisfaction measures alone do not ▪ Successful grant awards in e-learning.
education? Are multimedia elements used measure learning. For example, excellent
effectively? Is the interactivity appropriate content that learners find difficult to use ▪ Participation in national (and
for the level of the learner? Are special may be rated as poor. Likewise, a module international) societies concerned with

210 Academic Medicine, Vol. 81, No. 3 / March 2006


IT in Medical Education

the development, application, and use high. In continuing medical education, attitudes at the beginning of online
of e-learning in medical education. physicians with daily clinical obligations training in order to deliver educational
can attend medical “e-conferences” using materials at the level most appropriate for
Numerous research opportunities exist in e-learning. each learner.11 In the online environment
the relatively new field of e-learning. of e-learning, adaptive learning is
Faculty, administrators, and the public The complexity and breadth of medical possible through identification of the
will demand that educators evaluate the education content, together with the learner, personalization of content, and
impact of e-learning on the quality and scarcity of experts and resources in individualization of tracking, monitoring,
efficiency of medical education. e-learning, make the creation of centers support, and assessment.11,21 Adaptive
Extrapolating methods from other of excellence in e-learning a reasonable learning is the ultimate learner-centered
clinical and educational research, proposition. The Federal Interagency experience because it individualizes a
including comparative studies, is Working Group on Information unique learning path for each learner that
insufficient because such studies often Technology Research and Development is likely to target his or her specific
ignore the complexity of the learning has recommended the establishment of learning needs and aptitudes.
process and the methods of delivery centers to explore “new delivery modes
characteristic of e-learning. Potential for educating medical practitioners and The potential for collaborative learning
areas for research include assessing providing continuing medical to break the isolation of learners is
contexts for effective use of e-learning in education”33; e-learning clearly fits that realized in e-learning technologies.
medical education, the differential use of description. Such centers could offer a Advances in synchronous distance
e-learning in preclinical versus clinical wide range of services, including system education and collaborative technologies
years, the adaptation of e-learning to a deployment and administration, training like Weblogs, message boards, chats,
wide variety of medical specialties and of faculty and administrators, assistance e-mail, and teleconferencing are making
clinical settings, an exploration of in content development, the design of such collaborative learning more readily
methods for simplifying the e-learning learning pathways and programs, available. Quantitative and qualitative
creation process to gain wider acceptance marketing and support, supervision, studies of collaborative learning in
and use, the incorporation of e-learning maintenance, research, and consultation. medicine have shown higher levels of
as part of a blended-learning strategy, The Internet2 is a U.S.-based, learner satisfaction, improvements in
and the use of a multimedia instructional collaborative, university-led project knowledge, self-awareness,
design process by medical educators. started in 1996 to develop additional understanding of concepts, achievement
infrastructure for the Internet backbone of course objectives, and changes in
capable of superhigh bandwidth.34 The practice.38,39
Integrating E-Learning into
Medical Education Internet2’s vision of extremely fast speed,
complex real-time multimedia An evolving emphasis within medical
The integration of e-learning into capabilities, and quality of service would education on lifelong learning and
existing medical curricula should be the provide educators enormous potential to competency-based education has forced
result of a well-devised plan that begins enhance the learning experience.34 Larger educators to reevaluate their traditional
with a needs assessment and concludes bandwidth offers the promise of roles.10 In this changing paradigm,
with the decision to use e-learning.32 sophisticated immersive simulations and educators no longer serve as the sole
Although some institutions have tried to the use of full-motion video in real time, distributors of content, but are becoming
use e-learning as a stand-alone solution in both asynchronous and synchronous facilitators of learning and assessors of
to updating or expanding their curricula, modes of instruction, delivered to any competency. E-learning offers the
we believe it is best to begin with an desktop computer.35 Many medical schools opportunity for educators to evolve into
integrated strategy that considers the and health care organizations are already this new role by providing them with a
benefits and burdens of blended learning producing high-fidelity e-learning set of online resources to facilitate the
before revising the curriculum. In materials, such as virtual patient learning process.10
undergraduate medical education, simulations, that could soon be within the
e-learning offers learners materials for reach of any educator and learner.35–37
self-instruction and collaborative Summary
learning. In graduate medical education, E-learning refers to the use of Internet
the Accreditation Council for Graduate Directions for the Future technologies to deliver a broad array of
Medical Education has established six Developments in e-learning and learning modes that enhance learners’
core competencies toward which technologies are creating the groundwork knowledge and performance. There is
e-learning can be applied. E-learning for a revolution in education, allowing evidence for the effectiveness and
materials suited for each of these learning to be individualized (adaptive acceptance of e-learning within the
competencies can be integrated into the learning), enhancing learners’ medical education community, especially
education of residents and fellows, interactions with each other when combined with traditional teacher-
replacing lectures and other synchronous (collaborative learning), and led activities in a blended-learning
methods of instruction. Asynchronous transforming the role of the teacher educational experience. Several digital
e-learning can be effectively used during (from disseminator to facilitator). repositories of e-learning materials exist,
demanding clinical care rotations, some with peer review, where instructors
especially when duty hours are limited Adaptive learning uses technology to or developers can submit materials for
yet curriculum requirements remain assess learners’ knowledge, skills, and widespread use or retrieve them for

Academic Medicine, Vol. 81, No. 3 / March 2006 211


IT in Medical Education

creating new materials. The evaluation of in medical education. Lancet. 2001;357: 24 Anderson R, Biernat K, Rehm J. A pathway to
e-learning should include a peer-review 792–96. advancing end-of-life education. J Palliat
Med. 2002;5:428–31.
process and an assessment of outcomes 8 Masie E. Blended learning: the magic is in the
such as learner satisfaction, content mix. In: Rossett A (ed). The ASTD E- 25 Candler CS, Uijtdehaage SH, Dennis SE.
Learning Handbook. New York: McGraw- Introducing HEAL: the Health Education
usability, and demonstration of learning. Hill, 2002:58–63. Assets Library. Acad Med. 2003;78:249–53.
Faculty skills in creating e-learning may
9 Chu LF, Chan BK. Evolution of web site 26 Malloy TE, Hanley GL. MERLOT: a faculty-
differ from those needed for traditional design: implications for medical education on focused Web site of educational resources.
teaching; faculty rewards for scholarly the Internet. Comput Biol Med. 1998;28: Behav Res Methods Instrum Comput. 2001;
activity must recognize this difference 459–72. 33:274–76.
and should be commensurate with effort. 10 Chodorow S. Educators must take the 27 Harden RM, Hart IR. An international virtual
With technological advancement, the electronic revolution seriously. Acad Med. medical school (IVIMEDS): the future for
future offers the promise of high-fidelity, 1996;71:221–26. medical education? Med Teach. 2002;24:
261–67.
high-speed simulations and personalized 11 Gibbons A, Fairweather P. Computer-based
instruction using both adaptive and instruction. In: Tobias S, Fletcher J (eds). 28 Anderson M. Bromwell , senior associate vice
Training & Retraining: A Handbook for president, Division for Medical Education,
collaborative learning. Centers of Association of American Medical Colleges,
Business, Industry, Government, and the
excellence in e-learning can provide Military. New York: Macmillan Reference Washington, DC. Personal communication,
national support for the design, USA, 2000:410–42. March 18, 2005.
development, implementation, 12 Clark D. Psychological myths in e-learning. 29 Kirkpatrick D. Evaluating Training Programs.
evaluation, collaboration, and sharing of Med Teach. 2002;24:598–604. 2nd ed. San Francisco: Berrett-Koehler, 1998.
digital e-learning materials. The 13 Smith R. Guidelines for Authors of Learning 30 Barr H, Freeth D, Hammick M, Koppel I,
integration of e-learning into Objects 具http://www.nmc.org/guidelines/ Reeves S. Evaluating interprofessional
undergraduate, graduate, and continuing NMC/20LO/20Guidelines.pdf典. Accessed 22 education: a United Kingdom review of
November 2005. The New Media health and social care 具http://www.health.
medical education will promote a shift
Consortium, Austin, TX, 2004. ltsn.ac.uk/publications/occasionalpaper/
toward adult learning in medical occasionalpaper02.pdf典. Accessed 22
education, wherein educators no longer 14 Littlejohn A. Issues in reusing online November 2005. Centre for the Advancement
resources. In: Littlejohn A (ed). Reusing
serve solely as distributors of content, but of Interprofessional Education, London, UK
Online Resources: A Sustainable Approach to 2002.
become facilitators of learning and eLearning. London: Creative Print and
assessors of competency. Design, 2003:1–6. 31 Horton W. Evaluating E-learning.
Alexandria, VA: American Society for
15 Johnson CE, Hurtubise LC, Castrop J, et al . Training and Development, 2001.
Acknowledgments Learning management systems: technology to
measure the medical knowledge competency 32 Kern D, Thomas P, Howard D, Bass E.
The authors would like to acknowledge the of the ACGME. Med Educ. 2004;38:599–608. Curriculum Development for Medical
support from the D.W. Reynolds Foundation and Education Baltimore, MD: Johns Hopkins
the State of Florida Agency for Health Care 16 Phelps C, Michea YF. Learning management University Press, 1998.
Administration. Drs. Ruiz and Mintzer would systems’ evaluation focuses on technology not
learning. AMIA Annu Symp Proc. 2003:969. 33 Reddy R, Wladawsky-Berger I (co-chairs).
like to thank Dr. Bernard Roos for his President’s Information Technology Advisory
mentorship. 17 Fallon C, Brown S. E-learning Standards: A Committee. Transforming Health Care
Guide to Purchasing and Deploying through Information Technology. Arlington,
Standards-Conformant E-learning. Boca VA: National Coordination Office for
References Raton: St Lucie Press, 2003. Information Technology Research &
1 Ozuah PO. Undergraduate medical 18 The MedBiquitous Consortium: Enabling Development, 2001.
education: thoughts on future challenges. Collaboration for Healthcare Education 34 Internet 2 Web page 具http://www.internet2.
BMC Med Educ. 2002;2:8–10. 具http://www.medbiq.org典. Accessed 22 edu典. Accessed 22 November 2005. Internet 2
2 Nair BR, Finucane PM. Reforming medical February 2005. MedBiquitous, Baltimore, Consortium, Ann Arbor, MI, 2005.
education to enhance the management of MD 2005.
35 Walker R, Dieter M, Panko W, Valenta A.
chronic disease. Med J Aust. 2003;179:257– 19 Bernard R, Abrami PL, Lou Y, Borokhovski What it will take to create new Internet
59. E. How does distance education compare initiatives in health care. J Med Syst. 2003;27:
3 Leung WC. Competency based medical with classroom instruction? a meta-analysis 95–103.
training: review. BMJ. 2002;325:693–96. of the empirical literature. Rev Educ Res.
36 Tidmarsh PJ, Cummings J, Hersh WR,
2004;74:379–439.
4 Rosenberg M. E-Learning: Strategies for Freidman CP. Distributed medical
Delivering Knowledge in the Digital Age. 20 Letterie GS. Medical education as a science: informatics education using Internet2. Proc
New York: McGraw-Hill, 2001. the quality of evidence for computer-assisted AMIA Symp. 2002:787–91.
instruction. Am J Obstet Gynecol. 2003;188:
5 Wentling T, Waight C, Gallaher J, La Fleur J, 37 Vincent DS, Berg BW, Hudson DA,
849–53.
Wang C, Kanfer A. E-Learning: A Review of Chitpatima ST. International medical
Literature 2000 具http://learning.ncsa.uiuc.edu/ 21 Piemme TE. Computer-assisted learning and education between Hawaii and Thailand over
papers/elearnlit.pdf典. Accessed 22 November evaluation in medicine. JAMA. 1988;260:367– Internet2. J Telemed Telecare. 2003;9 (2
2005. University of Illinois National Center 72. suppl):S71–S72.
for Supercomputer Applications, Urbana- 22 Chumley-Jones HS, Dobbie A, Alford CL. 38 Wiecha J, Barrie N. Collaborative online
Champaign, IL, 2000. Web-based learning: sound educational learning: a new approach to distance CME.
6 Moberg TF, Whitcomb ME. Educational method or hype? A review of the evaluation Acad Med. 2002;77:928–29.
technology to facilitate medical students’ literature. Acad Med. 2002;77 (10 suppl):S86- 39 Wiecha JM, Gramling R, Joachim P,
learning: background paper 2 of the medical S93. Vanderschmidt H. Collaborative e-learning
school objectives project. Acad Med. 1999;74: 23 MedEdPortal 具http://www.aamc.org/meded/ using streaming video and asynchronous
1146–50. mededportal典. Accessed 22 November 2005. discussion boards to teach the cognitive
7 Ward JP, Gordon J, Field MJ, Lehmann HP. Association of American Medical Colleges, foundation of medical interviewing: a case
Communication and information technology Washington, DC, 2005. study. J Med Internet Res. 2003;5:e13.

212 Academic Medicine, Vol. 81, No. 3 / March 2006

You might also like