You are on page 1of 14

Journal of Intensive Care Medicine

1-14
The Top Ten Websites in Critical Care ª The Author(s) 2018
Reprints and permission:
sagepub.com/journalsPermissions.nav
Medicine Education Today DOI: 10.1177/0885066618759287
journals.sagepub.com/home/jic

Traci A. Wolbrink, MD, MPH1,2, Lucy Rubin, BA1,3,


Jeffrey P. Burns, MD, MPH1,2, and Barry Markovitz, MD4,5

Abstract
Introduction: The number of websites for the critical care provider is rapidly growing, including websites that are part of
the Free Open Access Med(ical ed)ucation (FOAM) movement. With this rapidly expanding number of websites, critical
appraisal is needed to identify quality websites. The last major review of critical care websites was published in 2011, and
thus a new review of the websites relevant to the critical care clinician is necessary. Methods: A new assessment tool for
evaluating critical care medicine education websites, the Critical Care Medical Education Website Quality Evaluation Tool
(CCMEWQET), was modified from existing tools. A PubMed and Startpage search from 2007 to 2017 was conducted to
identify websites relevant to critical care medicine education. These websites were scored based on the CCMEWQET.
Results: Ninety-seven websites relevant for critical care medicine education were identified and scored, and the top ten
websites were described in detail. Common types of resources available on these websites included blog posts, podcasts,
videos, online journal clubs, and interactive components such as quizzes. Almost one quarter of websites (n ¼ 22) classified
themselves as FOAM websites. The top ten websites most often included an editorial process, high-quality and appro-
priately attributed graphics and multimedia, scored much higher for comprehensiveness and ease of access, and included
opportunities for interactive learning. Conclusion: Many excellent online resources for critical care medicine education
currently exist, and the number is likely to continue to increase. Opportunities for improvement in many websites include more
active engagement of learners, upgrading navigation abilities, incorporating an editorial process, and providing appropriate
attribution for graphics and media.

Keywords
online learning, e-learning, web-based learning, websites, critical care medicine, intensive care medicine, pediatric critical care
medicine

Introduction
The amount of online educational resources for critical care
medicine (CCM) is rapidly expanding. This rapid growth has
been facilitated by the increasing ease with which individuals 1
Department of Anesthesiology, Critical Care and Pain Medicine, Boston
can create, upload, and share resources online,1,2 which has Children’s Hospital, Boston, MA, USA
2
contributed to a rapid explosion in the number of websites Department of Anaesthesia, Harvard Medical School, Boston, MA, USA
3
available on the Internet. Only 17 000 websites existed in Tufts University School of Medicine, Boston, MA, USA
4
Department of Pediatrics, Children’s Hospital Los Angeles, University of
2000; currently there are over 1 billion.3 Another key driver
Southern California Keck School of Medicine, Los Angeles, CA, USA
of this explosion in resources has been the FOAM movement, 5
Department of Anesthesiology Critical Care Medicine, Children’s Hospital
conceived in 2012, which has inspired the development of at Los Angeles, University of Southern California Keck School of Medicine, Los
least 275 blog sites in critical care and emergency medicine Angeles, CA, USA
alone.4 FOAM refers to Free Open Access Med(ical ed)uca- Received December 22, 2017. Received revised January 20, 2018.
tion, an extensive online community of resources for physi- Accepted January 24, 2018.
cians and trainees, often shared on social media, including
blogs, podcasts, videos, applications, and more.5 The last major Corresponding Author:
Traci A. Wolbrink, Department of Anesthesiology, Critical Care and Pain
review of websites applicable to the critical care clinician was Medicine, Boston Children’s Hospital, 300 Longwood Avenue, Bader 634,
published in 2011 by Kleinpell et al.6 Of the 135 websites Boston, MA 02115, USA.
identified in this review, only 67 are still available online. This Email: traci.wolbrink@childrens.harvard.edu
2 Journal of Intensive Care Medicine XX(X)

rapidly changing landscape suggests that a new review of avail- and/or faculty medical education websites in critical care
able critical care educational resources is needed. medicine, the Critical Care Medical Education Website Qual-
With this vast expansion in the number of available websites ity Evaluation Tool (CCMEWQET). Several experts in crit-
for critical care medicine education, there is also an obvious ical care medicine and medical education reviewed each of
need to critically appraise these websites for accuracy and the tools’ items, and items that were not applicable to critical
quality.7 There are many evaluation tools for websites,8 includ- care medicine were either modified or discarded. We com-
ing several for medical education sites 9,10 and FOAM pared the CCMEWQET criteria to those criteria utilized
blogs;11 however, no formal evaluation tool for assessing the when evaluating general medical or nonmedical web pages,
quality of critical care medicine education websites was iden- such as the Health on the Net Code of Conduct for medical and
tified. In this report, we describe the development of an evalua- health websites,12-14 and found them to be very similar in cri-
tion tool for critical care medicine education websites, provide teria. Additionally, we compared these criteria to the established
the results of a literature and web search designed to identify metrics for evaluating blog quality to ensure that all metrics were
critical care medicine education websites, and describe in detail also incorporated in the tool, trying to ensure that the tool would
the top ten scoring websites for critical care medicine education also be effective when evaluating FOAM websites.11
based on their performance in the evaluation tool.
Literature Review and Web Search
Methods To identify websites in critical care medicine education, a lit-
erature review and web search were conducted in collaboration
The following steps were performed to identify and evaluate
with the Boston Children’s Hospital library services (Figure 1).
the top ten websites in critical care medicine education:
We performed a PubMed search from 2007 to 2017 using the
1. Modification of a medical education website assess- following search terms: (“critical care” OR “intensive care”)
ment tool for use in the field of critical care medicine. AND (“online resources,” “online education,” “online
2. Literature review and web search to identify critical learning,” “educational website(s),” “educational video(s),”
care medicine education websites. “video-based education,” “video-based learning,” “e-learning,”
3. Evaluation and ranking of identified websites using the “internet-based resources,” “internet-based education,”
modified tool. “internet-based learning,” “web-based resources,” “web-
based education,” “web-based learning,” “web-based educa-
tional resources,” “podcast(s),” “vodcast(s),” “blog(s),”
“serious gaming,” “free open access medical education,” OR
Modification of a Medical Education Website
“FOAMed”). Titles and abstracts of all resulting English lan-
Assessment Tool guage articles were screened for relevance, which was defined
An objective tool was required to evaluate existing critical care as relating to online critical care medicine education for phy-
medicine websites. A literature search utilizing PubMed was sicians or physician trainees. Relevant articles were further
conducted using the following search terms: “medical educa- reviewed for website titles/URLS.
tion website assessment,” “medical e-learning evaluation,” Additional websites were then identified using the Start-
“medical education quality,” and “critical care education web- page (www.startpage.com) search engine, which generates
site evaluation.” The search yielded several website evaluation Google results that are not influenced by geographic location
tools but none specific for critical care medicine. Two website or user browser history. We performed a search using the
evaluation tools were designed specifically for medical educa- terms: (“education,” “learn,” “resource,” “FOAM”) AND
tion and seemed most closely aligned with the aim of this study. (“critical care,” “intensive care,” “ICU,” “CCM,” “pediatric
The Medical Education Website Quality Evaluation Tool critical care,” “pediatric intensive care,” “PICU,” OR
(MEWQET) was developed and validated by Alyusuf et al for “PCCM”). The resulting websites were screened by title and
the assessment of undergraduate medical education websites description for relevance, again defined as relating to online
in the field of pathology.10 This tool was subsequently mod- critical care medicine education for physicians and physician
ified and validated by Yang et al for the assessment of under- trainees. Relevant websites were further reviewed for website
graduate and graduate medical education websites in the field titles/URLs.
of Otolaryngology as the Modified Education in Otolaryngol- Websites that had educational materials relevant for physi-
ogy Website (MEOW) assessment tool.9 Both tools assign a cian providers in critical care medicine were free to access,
score to websites based on authorship, credibility, aim/scope, written in English, and functioning were included. Websites
comprehensiveness, content quality/accuracy, currency of that had less than 5 relevant posts,were solely medical calcu-
information, site navigability, access, interactivity, and gra- lators, YouTube channels, Googleþ communities or were
phic/media elements uaccuracy, and ease of access), a second designed for emergency department–based critical care (not
content expnmarked set by lucyrubin. applicable in an intensive care unit environment) were
A modified assessment tool based on the MEWQET and excluded. Online journals were felt to be beyond the scope of
MEOW was constructed to be applicable to resident, fellow, this article; however, websites of online journals were included
Wolbrink et al 3

Figure 1. The PubMed and Startpage search strategy used to identify websites for scoring with CCMEWQET. CCMEWQET indicates Critical
Care Medical Education Website Quality Evaluation Tool.

if they contained other types of educational materials (eg, pod- generated by the other 2 independent reviewers, and scored
casts) on their website. All websites were reviewed on a com- each website in these 4 items. All scores were reviewed for
puter and were not assessed for functionality in a tablet or agreement and consensus was achieved. No reviewer reviewed
mobile environment. his or her own website.

Evaluation of Identified Websites/Tool Application Results


Two independent reviewers (T.W., L.R.) reviewed all websites The CCMEWQET was developed (Table 1) and contains 30
identified from the literature and online search, and scored items assessing 10 domains (authorship/credibility/disclosure,
them based on the CCMEWQET. All scores were reviewed aim/scope/audience, content quality, currency of information,
for agreement, and any disagreement was discussed with both navigability/speed, access, interactivity, graphics/media, lay-
reviewers until consensus was reached together. To provide out/design, and hyperlinks) for a total possible score of 73.
additional review of the 4 more subjective questions in the Seventy-nine articles and 114 websites were identified
CCMEWQET assessment tool (relevancy, comprehensive- through the initial PubMed and Startpage search, and addi-
ness, accuracy, and ease of access), a second content expert tional websites were identified from references and links from
in critical care medicine (B.M.) was blinded to the scores these resources.15-25 After inclusion and exclusion criteria
4 Journal of Intensive Care Medicine XX(X)

Table 1. The Critical Care Medical Education Website Quality Evaluation Tool (CCMEWQET).

Category Criteria Weight

1. Authorship, credibility and 1.1 Disclosure of content author(s)?


disclosure A. Author(s)’ name(s), credentials, and contact information A¼3
B. Author(s)’ name(s) and credentials B¼2
C. Author(s)’ name(s) C¼1
D. No disclosure of authorship D¼0
1.2 If content author(s)’ credentials are given, author is (if multiple authors, the majority are):
A. Critical care physician A¼2
B. Other health-care professional/scientist B¼1
C. Other or no credentials listed C¼0
1.3 Disclosure of content author(s)’ institution?
A. Educational, nonprofit or governmental institution A¼3
B. Other or no disclosure of institution B¼0
1.4 Is the website domain educational, nonprofit, or governmental (ie .org, .edu, or .gov)? Yes ¼ 3 No¼ 0
1.5 Is there an editorial review process stated on the website? Yes ¼ 3 No ¼ 0
1.6 Is there a general disclosure, including a privacy policy? Yes ¼ 1 No ¼ 0
1.7 Are references provided? Yes ¼ 2 No ¼ 0
1.8 Is an e-mail or contact form provided for feedback to the webmaster? Yes ¼ 2 No ¼ 0
1.9 Is advertising distinct from content?
A. No external commercial advertisements A¼4
B. Yes B¼1
C. No C¼0
Subtotal /23
2. Aim, scope and audience 2.1 Is critical care medicine the intended subject scope?
A. Yes, exclusively critical care medicine A¼2
B. Yes, critical care medicine as part of another resource, that is, Emergency Medicine B¼1
C. No C¼0
2.2 Is the educational material relevant to residents, fellows, and/or faculty in critical care?
A. Highly relevant A¼5
B. Relevant B¼3
C. Minimally relevant C¼1
D. Not relevant D¼0
Subtotal /7
3. Content quality 3.1 Comprehensiveness: Does it cover critical care medicine education comprehensively?
A. Yes A¼7
B. No, but fairly comprehensive coverage of more than one specific area of interest B¼6
C. No, but fairly comprehensive coverage of one specific area of interest C¼4
D. No, even specific area(s) of interest is/are not covered comprehensively D¼1
3.2 Accuracy: Is the information accurate?
A. Accurate A¼6
B. Somewhat accurate B¼3
C. Inaccurate C¼0
3.3 Does the website have summary statements/take-home points? Yes ¼ 2 No ¼ 0
Subtotal /15
4. Currency of information 4.1 Is the date of content creation/revision disclosed? Yes ¼ 1 No ¼ 0
4.2 When was the website/content last updated?
A. <1 year ago A¼2
B. 1 year ago but <5 years ago B¼1
C. 5 years ago or not disclosed C¼0
Subtotal /3
5. Navigability and speed 5.1 Can necessary information be found easily from the main homepage of the site? Yes ¼ 1 No ¼0
5.2 Does the site include a usable search engine or table of contents? Yes ¼ 2 No ¼0
5.3 Does every page include a way to return to the homepage for the site? Yes ¼ 1 No ¼0
5.4 Was the website or server accessible in a timely manner? Yes ¼ 2 No ¼0
Subtotal /6
6. Access 6.1 Is the site accessible from the main search engines? Yes ¼ 1 No ¼0
6.2 How does access to the information through this website compare to other available sources?
A. Easier to find/use A¼2
B. About the same effort to find/use B¼1
C. More difficult to find/use C¼0
(continued)
Wolbrink et al 5

Table 1. (continued)

Category Criteria Weight

6.3 Is special hardware or software required to access some or all of the resources?
A. No A¼1
B. Some or all of the site require special hardware or software B¼0
Subtotal /4
7. Interactivity 7.1 Are there any interfaces requiring relevant action on the part of the learner (eg, quizzes,
self-assessments, interactive figures)?
A. Definitely A¼6
B. Somewhat B¼3
C. No C¼0
Subtotal /6
8. Graphics and media 8.1 Are graphic/media elements included to provide additional information to clarify existing
content?
A. Present, pertinent, high-quality, and with appropriate attribution A¼2
B. Present, pertinent, and with appropriate attribution B¼1
C. Not present, not pertinent, and/or not appropriately attributed C¼0
8.2 Are graphic/media elements well integrated into the website? Yes ¼ 1 No ¼0
Subtotal /3
9. Layout and design 9.1 Is the display of information clear and professional? Yes ¼ 1 No ¼0
9.2 Is the website user friendly and intuitive, with a logical layout? Yes ¼ 2 No ¼0
Subtotal /3
10. Hyperlinks 10.1 Are there any links to provide relevant additional information? Yes ¼ 2 No ¼0
10.2 If links are provided, are they active (90% of total links)? Yes ¼ 1 No ¼0
Subtotal /3
Total Score /73

were applied to the screened websites, 97 websites were websites, the FOAM websites were far less likely to have
included and reviewed using the CCMEWQET. A list of the an explicit editorial process and provide appropriate attribu-
included websites can be found in Table 2, along with the tion for graphics and multimedia.
website name, URL, description, and ranking by tertile. The The top 10 sites in critical care medicine differed from the
average score across all websites was 46. Nine (9%) web- rest of the critical care medicine educational websites in several
sites were from national or international societies, 22 (23%) important ways (Table 3). First, the majority provided details
websites declared themselves as FOAM, and 64 (66%) web- about an editorial process for website content, included high-
sites were associated with an educational institution. In quality and appropriately attributed graphics and multimedia,
terms of the types of resources available, 35% featured blog and included a privacy policy. Additionally, these websites
posts, 27% featured podcasts, 33% featured videos, 15% scored much higher for comprehensiveness, universally pro-
featured online journal clubs, and 37% had interactive com- vided disclosure of authors’ institutions as an educational, non-
ponents such as quizzes (Figure 2). Questions to test the profit, or governmental institution, and all were updated within
learner’s knowledge represented the majority of the interac- the last year. Finally, all of the top 10 sites scored higher for
tive components, with polls, medical calculators, and simu- ease of access including perception that the website was user-
lators rounding out that category. friendly and intuitive. Each of the top 10 critical care medicine
Compared to the rest of the critical care medicine educa- educational websites is described in detail below (in alphabe-
tional websites, those that described themselves as FOAM tical order):
websites differed from the other critical care medicine web- The American Thoracic Society (ATS) Critical Care web-
sites in several important ways (Table 3). The majority of site (https://www.thoracic.org/professionals/clinical-
FOAM website domains were not educational, nonprofit, or resources/critical-care/) contains peer-reviewed educational
governmental (.edu/.org/.gov). The FOAM websites were materials for intensivists, developed by the ATS Critical Care
updated more recently than the other critical care medicine Assembly. Resources have integrated self-assessment ques-
educational websites. Finally, the access to information in tions and include clinical cases, video lectures, slide presenta-
the FOAM websites was scored as more difficult to find/ tions, text-based tutorials, podcasts, and an online journal
use, included layouts that were scored as less logical or club with recorded webinars. There are also links to external
intuitive, and contained fewer opportunities for interactivity. free resources for ultrasound, echocardiography, and
When comparing the FOAM websites to the top 10 procedures.
6 Journal of Intensive Care Medicine XX(X)

Table 2. The Website Name, URL, Description, and Overall Ranking by Tertile for Each Critical Care Medicine Education Website Reviewed
With the CCMEWQET.

Website URL Description

Top 10 websites, in alphabetical order


American Thoracic Society Critical https://www.thoracic.org/professionals/clinical- Clinical cases, online journal club, podcasts,
Care resources/critical-care/ text-based information, and links to external
resources. Website of the American
Thoracic Society
Critical Care Project http://ccproject.com/ Videos, text-based information, and clinical
cases with questions. Associated with the
University of Maryland, Tulane University,
the University of Pennsylvania, and the
National Institutes of Health
Intensive Blog http://intensiveblog.com/ FOAM website with clinical cases, online
journal club, and text-based information
with videos, graphics, and self-assessment
questions. Associated with The Alfred
Hospital in Australia
LearnPICU http://www.learnpicu.com/home Text-based information with associated
literature summaries and self-assessment
questions. Associated with Stanford
University
Medscape Critical Care https://emedicine.medscape.com/critical_care Text-based summaries of topics with graphics
and videos, interactive CME activities, and
updates on news and research in the field
Merck Manual Critical Care Medicine http://www.merckmanuals.com/professional/ Text-based information with figures, videos,
critical-care-medicine and quizzes
OPENPediatrics https://www.openpediatrics.org/ Videos, self-paced courses, interactive
simulators, congenital heart lesion library,
medical calculators, and medical animation
and illustration gallery. Associated with
Boston Children’s Hospital
PedsCCM.org http://pedsccm.org/ Online journal club, updates on news and
research, and links to external resources
SurgicalCriticalCare.net http://www.surgicalcriticalcare.net/ Collection of text-based PDFs, videos, and
medical calculators for surgical critical care.
Associated with Orlando Regional Medical
Center
WikEM https://wikem.org/wiki/Category:Critical_Care Text-based information and reference tables
for emergency medicine, with a specific
category for critical care
Remainder of upper tertile, in alphabetical order
CHEST http://www.chestnet.org/ Free educational resources include links for
trainees, videos, a blog, and an interactive
section from the journal, including podcasts
and clinical cases. Website of the American
College of Chest Physicians
Deranged Physiology http://www.derangedphysiology.com/main/ Collection of notes, short answer questions,
and slide presentations to provide study
support for the College of Intensive Care
Medicine (CICM) of Australia and New
Zealand Part 2 examination
EMCases https://emergencymedicinecases.com/ FOAM blog and podcast, with associated text-
and video-based summaries, and a section
with critical care cases
EMCrit https://emcrit.org/ FOAM blog and podcast for emergency
medicine and critical care with associated
PulmCrit blog for pulmonary and critical
care medicine
(continued)
Wolbrink et al 7

Table 2. (continued)

Website URL Description

European Society of Intensive Care https://www.esicm.org/ Free educational resources include past
Medicine webinars, an online journal club, and a blog.
Website of the European Society of
Intensive Care Medicine
Heart-lung.org http://www.heart-lung.org/home.html Videos, podcasts, links to the author’s writings,
and learning modules relating to
cardiopulmonary interaction in the ICU
ICM Case Summaries https://icmcasesummaries.com/ Collection of cases with evidence-based
summaries written by intensive care
medicine trainees from the United Kingdom
ICU Delirium http://www.icudelirium.org/ Resources for delirium prevention and safety,
including downloadable tools, slide
presentations, and videos. Associated with
Vanderbilt University Medical Center
ICU Primary Prep https://icuprimaryprep.com/ Collection of notes and short answer
questions to provide study support for the
College of Intensive Care Medicine (CICM)
of Australia and New Zealand primary
examination
Intensive Care Medicine Working http://icmwk.com/ FOAM website with a collection of posts and
Knowledge links to resources and key papers
Interpretation of the ICU chest https://www.med-ed.virginia.edu/courses/rad/ Tutorial for chest film interpretation in an ICU
radiograph from the University of chest/index.html setting with multiple-choice questions
Virginia throughout. Associated with the University
of Virginia
PICUDoctor Cardiac Guide http://www.picudoctor.org/PICU/ Document containing text-based information
and figures for pediatric cardiac critical care
PulmCCM https://pulmccm.org/ Online journal club, blog, and quizzes
Rational Evidence Based Evaluation of http://rebelem.com/category/clinical/critical-care/ Critical appraisals of research as podcasts and
Literature in Emergency Medicine text-based information, and a collection of
(REBEL EM) review charts, with a category specifically
for critical care
Scottish Intensive Care Society http://www.scottishintensivecare.org.uk/ Learning modules with text and assessment
questions covering core ICU topics, as well
as links to resources for trainees and slide
presentations. Website of the Scottish
Intensive Care Society
Society for Neuroscience in http://www.snacc.org/ Quizzes, interactive case presentations, and
Anesthesiology and Critical Care audio and video interviews with experts.
(SNACC) Website of the Society for Neuroscience in
Anesthesiology and Critical Care
Society of Critical Care Medicine http://www.sccm.org/Pages/default.aspx Free educational materials include iCritical
Care podcasts and LearnICU with
collections of resources categorized by
topic. Website of the Society of Critical
Care Medicine
Surviving Sepsis Campaign http://www.survivingsepsis.org/Pages/default.aspx Videos, slide presentations, and links to
podcasts relating to sepsis
The Alliance https://organdonationalliance.org/ Collection of resources on organ donation
topics, including articles, slide presentations,
one-page educational documents, and a blog
The Bottom Line http://www.thebottomline.org.uk/ FOAM website with critical appraisals of
literature and a blog
The New England Journal of Medicine http://www.nejm.org/page/critical-care-medicine Case-based scenarios for discussion with
(NEJM) Critical Care Medicine associated review articles. Additional free
educational materials for pulmonary and
critical care medicine include interactive
cases and clinical images
(continued)
8 Journal of Intensive Care Medicine XX(X)

Table 2. (continued)

Website URL Description

Wiki Journal Club https://www.wikijournalclub.org/wiki/ Online journal club with text-based summaries
WikiJournalClub:Usable_articles#Critical_Care of clinical trials, with a specific category for
critical care
World Federation of Pediatric Intensive http://www.wfpiccs.org/ Video library and collection of slide
and Critical Care Societies presentations and PDFs. Website of the
World Federation of Pediatric Intensive and
Critical Care Societies
Middle tertile, in alphabetical order
Acid-Base Physiology from http://www.anaesthesiamcq.com/AcidBaseBook/ Text-based information for acid-base
AnesthesiaMCQ ABindex.php physiology
BestBETs http://bestbets.org/database/browse-by- Literature reviews for topics in emergency
topic.php?CategoryID¼248 medicine, with a specific category for critical
care
Broome Docs http://broomedocs.com/category/critical-care-icu/ FOAM blog and podcast for rural doctors,
with a specific category for critical care
Crit Cloud https://www.crit.cloud/ FOAM website with an online journal club,
slide presentations, and a blog
Critical Care and Emergency Medicine https://www.usa.philips.com/healthcare/ Text-based information with graphics and
Ultrasound Education from Philips education-resources/education-training/ imaging for ultrasound in critical care and
ultrasound-education-critical-care-emergency- emergency medicine
medicine
Critical Care Consortium Milwaukee http://www.cccmke.org/ FOAM website with videos, a blog, and slide
presentations
Critical Care Northampton https://criticalcarenorthampton.com/ FOAM blog with podcasts, literature
summaries, slide presentations, videos,
medical calculators, an ICU drug formulary,
and links to external resources
Critical Care Nutrition https://www.criticalcarenutrition.com/ Research group for improving nutrition in the
critically ill, with slide presentations, PDFs,
tools, and information about current
research
Critical Care Practitioner http://www.jonathandownham.com/ Blog, podcast, and text-based information
Critical care professional education http://www.edwards.com/gb/education/ecce eLearning modules for Edwards critical care
from Edwards Lifesciences products, a guidebook for cardiopulmonary
care, interactive learning games, and past
webinars. Requires registration
Critical Care Reviews http://www.criticalcarereviews.com/ Videos of presentations from the annual
meeting, podcasts, and links to noteworthy
articles and external resources
Critical USG http://www.criticalusg.pl/en/home Text and imaging-based tutorials covering
ultrasound topics relating to anesthesiology
and critical care. Associated with the Polish
Society of Anesthesiology and Intensive
Care
Echocardiography in the ICU from https://web.stanford.edu/group/ccm_echocardio/ Text and imaging-based content on point-of-
Stanford University cgi-bin/mediawiki/index.php/ care echocardiography for intensivists and
Echocardiography_in_ICU:About emergency physicians. Associated with
Stanford University
EM Daily http://emdaily.cooperhealth.org/topics/critical- Blog and podcast for emergency medicine,
care with a specific category for critical care.
Associated with Cooper University Hospital
Emergency and intensive care http://www.acidbase.org/echo/index.php Text-based information and slide
ultrasound from AcidBase.org presentations covering various ultrasound
topics in emergency and intensive care
ICU Web http://www.aic.cuhk.edu.hk/web8/index.htm Text-based information, slide presentations,
and an image library. Associated with the
Chinese University of Hong Kong
Intensive Care Network https://intensivecarenetwork.com/ FOAM website with a podcast, blog, and
clinical and imaging cases
(continued)
Wolbrink et al 9

Table 2. (continued)

Website URL Description

International Respiratory and Severe http://depts.washington.edu/intrsect/ Videos and links to external resources on
Illness Center (INTERSECT) respiratory diseases and severe illness.
Associated with the University of
Washington
Life in the Fast Lane Critical Care https://lifeinthefastlane.com/ccc/ FOAM blog with a collection of posts
Compendium specifically for critical care
Online ICU guidebook from the http://chicago.medicine.uic.edu/wp-content/ Document covering core topics in the ICU,
University of Illinois at Chicago uploads/sites/6/2017/09/icuguidebook.pdf with text-based summaries, algorithms, and
links to external resources. Associated with
the University of Illinois at Chicago
OpenAnesthesia https://www.openanesthesia.org/subspecialty/ Podcasts and links to key articles organized
critical-care-and-perioperative-medicine/ into a curriculum for critical care and
perioperative medicine
PBL Curriculum for Critical Care https://sunnybrook.ca/education/content/ Series of modules presenting patient cases
Trainees ?page¼critical-care-pbl-elearning with self-assessment questions. Associated
with Sunnybrook Health Sciences Centre
and the University of Toronto
Pediatric EM Morsels http://pedemmorsels.com/category/critical-care/ FOAM blog with text-based summaries of
pediatric emergency medicine topics, with a
specific category for critical care
PICU lectures from the University of http://www.pediatrics.uthscsa.edu/CriticalCare/ Slide presentations covering topics in pediatric
Texas Health Science Center lectures.asp critical care medicine. Associated with the
University of Texas Health Science Center
PICU resources from the University of https://www.med.unc.edu/cmep/education/ Downloadable handbook, slide presentations,
North Carolina School of Medicine current-residents/rotation-information/ and links to key articles and procedural
pediatric-intensive-care-unit videos. Associated with the University of
North Carolina
PICUPedia http://picupedia.net/ Collections of links to educational materials,
journal articles, and text-based information
on topics in pediatric critical care medicine
Resources for health professionals from http://www.lhsc.on.ca/Health_Professionals/ Text-based information, quizzes, e-learning
the critical care trauma centre at the CCTC/ modules, drug monographs, and links to
London Health Sciences Centre external resources. Associated with the
London Health Sciences Centre
Resus Review https://resusreview.com/ FOAM website with text-based information,
original graphics, and podcasts for topics in
cardiology, critical care, and emergency
medicine
Video Library from the University of http://videos.med.wisc.edu/categories/31 Videos of presentations given at educational
Wisconsin School of Medicine and events, with a category for emergency
Public Health medicine and critical care. Associated with
the University of Wisconsin
Vinnie’s ICU https://icuvinnies.wordpress.com/ FOAM blog with text, videos, imaging, and an
online journal club
Western Sono https://westernsono.ca/ FOAM website with a blog, videos, and
tutorials for point-of-care ultrasound in
emergency medicine and critical care.
Associated with the University of Western
Ontario
Lower tertile, in alphabetical order
#ICURounds https://icurounds65.wordpress.com/ Blog with text, questions, and cases
AcidBase.org http://www.acidbase.org/ Module for analyzing a patient’s acid-base data
and links to acid-base and intensive care
resources
Clinical education from Medtronic http://www.covidien.com/pace/clinical-education Tutorials with text, graphics, and quizzes on
topics in intensive care and pediatric
intensive care. Requires registration
Crashing Patient http://crashingpatient.com/ Blog with text-based information on topics in
emergency medicine and critical care
(continued)
10 Journal of Intensive Care Medicine XX(X)

Table 2. (continued)

Website URL Description

Critical Care Perspectives in Emergency http://www.ccpem.com/ Podcast with discussions about critical care
Medicine and emergency medicine
Critical Insight https://criticalinsight.wordpress.com/ Blog and online journal club
Essential Critical Care http://www.essentialcriticalcare.com/ Blog with links to external podcasts
Expensive Care https://expensivecare.com/ Blog for end-of-life issues relating to critical
care
Free Emergency Medicine Talks http://www.freeemergencytalks.net/tag/critical- FOAM podcast for emergency medicine, with
care/ a specific tag for critical care
ICU Rounds http://burndoc.libsyn.com/ Podcast on critical care topics encountered in
the Burn ICU
Intensive Care Online Network http://www.intensivecareonline.com/ Past webinars on topics in critical care, device
(ICON) tutorials, and literature reviews. Requires
registration
Intensive Care Society Podcast http://icspodcast.libsyn.com/ Podcasts of educational events and interviews
International Sepsis Forum http://internationalsepsisforum.com Videos from the 2014 annual meeting
MICU lectures from the University of http://www.fammed.wisc.edu/category/media/ Video series covering medical ICU topics.
Wisconsin Department of Family micu/ Associated with the University of Wisconsin
Medicine
Mini lecture series from the University http://www.ccmpitt.com/minilecs/index.html Video lecture series. Associated with the
of Pittsburgh Critical Care Medicine University of Pittsburg
Notes from Dr RW http://doctorrw.blogspot.co.uk/search/label/ Blog for hospitalist medicine, with a specific
critical%20care category for critical care
Oxford Deanery Intensive Care https://oxicmblog.wordpress.com/about/ Blog and a link to the main site, which includes
Medicine an online journal club
Peds/PICU tools http://www.mverive.com/MedApps/ Tools for use in the PICU, including
PedsPicuTools/ calculators, guidelines, charts, and graphics
PICUInfo http://www.picuinfo.net/ Collection of links to resources, including
guidelines, websites, journal articles, medical
calculators, and videos
Prehospital and Retrieval Medicine https://prehospitalmed.com/category/intensive- Blog and podcast for prehospital and retrieval
(PHARM) care/ medicine, with a specific category for
intensive care
Propofology https://www.propofology.com/ FOAM website with graphic tutorials and a
podcast for anesthesia, critical care, and pain
medicine
Resus.Me http://resus.me/category/intensive-care/ Blog for resuscitation medicine education,
with a specific category for ICU
Resuscitationist’s Awesome Guide to http://ragepodcast.com/ FOAM podcast with videos and interviews
Everything (RAGE) covering topics in critical care
ScanCrit http://www.scancrit.com/ FOAM blog for anesthesia, intensive care, and
emergency medicine
Sheffield Teaching Hospitals Journal https://sthjournalclub.wordpress.com/ Blog with summaries and critiques of
Club anesthesia and critical care journal articles,
as well as slide presentations. Associated
with Sheffield Teaching Hospitals in the
United Kingdom
Social Media and Critical Care https://www.smacc.net.au/ FOAM website with videos, podcasts, and
(SMACC) summaries of the talks given at their
conferences
St. Emlyn’s http://stemlynsblog.org/category/emergency- FOAM blog and online journal club for
medicine/resus-crit-care/ emergency medicine, with a specific
category for resus and critical care
Sunderland ICCU Medical Education http://www.iccueducation.org.uk/ Blog with posts about topics in critical care and
links to external resources
The Resus Room http://theresusroom.co.uk/ Podcast and links to relevant papers for
resuscitation medicine, with a tag for critical
care
(continued)
Wolbrink et al 11

Table 2. (continued)

Website URL Description

Thinking Critical Care https://thinkingcriticalcare.com/ FOAM blog


Vent World http://www.ventworld.com/index.asp Case studies, links to articles, tools, and
medical calculators related to mechanical
ventilation
Wellington Intensive Care Unit http://www.wellingtonicu.com/ Study aids, examination notes, and links to
external resources. Associated with
Wellington Regional Hospital in New
Zealand
Wessex Intensive Care Society http://www.wessexics.com/ Blog with text-based summaries of talks.
Website of the Wessex Intensive Care
Society
Abbreviations: FOAM, Free Open Access Med(ical ed)ucation; ICM, intensive care medicine; ICU, intensive care unit.

summaries of essential topics in pediatric critical care


medicine. The text-based summaries contain graphics,
references, literature summaries, and self-study questions
with answers. The site also contains links to key articles
and quick references for medication dosing and equipment.
Medscape Critical Care (https://emedicine.medscape.com/
critical_care) contains a robust collection of critical care med-
icine education resources, written and reviewed by experts. The
eMedicine page features text-based information on pertinent
topics, with embedded videos, graphics, and tables. There are
also interactive continuing medical education activities with
videos and assessment questions, as well as articles relating
to news and literature in the field.
Merck Manual’s Critical Care Medicine page (http://
www.merckmanuals.com/professional/critical-care-medicine)
Figure 2. Percentages of the types of resources available on the CCM is part of the online version of the well-known reference book.
education websites. Text-based information is available by topic and also includes
relevant graphics, videos, and hyperlinked words that lead to
more information. The site maintains a transparent editorial
The Critical Care Project (CCP; http://ccproject.com/) is an review and revision process.
educational initiative associated with 4 institutions that share OPENPediatrics (www.openpediatrics.org) is an open-
their internal critical care education materials online. The access learning platform associated with Boston Children’s
Maryland CCP features video lectures with text summaries and Hospital. The website features a library of over 500 peer-
clinical cases with questions. The Tulane CCP also features reviewed educational videos on various critical care and
video lectures with summaries, as well as monthly collections pediatrics topics, authored by experts and edited with text and
of top critical care articles. The Penn CCP focuses on resusci- high-quality animations. Mechanical ventilation, hemodialysis,
tation, with clinical cases, text, and questions. The National and peritoneal dialysis simulators allow learners to interact
Institutes of Health CCP features video lectures. with those technologies and master important skills in a safe
Intensive Blog (http://intensiveblog.com/) is a FOAM- environment. Guided learning pathways allow learners to learn
affiliated website associated with The Alfred Hospital Inten- at their own pace, with pre-and post-including clinical scenar-
sive Care Unit in Australia. The site contains peer-reviewed ios with imaging studiesand self-assessment questions, critical
educational materials for intensive care medicine physicians appraisals test multiple-choice questions. The site also includes
and trainees, including clinical scenarios with imaging stud- medical calculators and summary documents/protocols for
ies and self-assessment questions, critical appraisals of lit- reference.
erature, and dedicated sections for echocardiography, PedsCCM.org (www.pedsccm.org) is a website associated
ultrasound, and extracorporeal membrane oxygenation. with the Laura P. and Leland K. Whittier Virtual Pediatric
They additionally post simulation scenarios and link to Intensive Care Unit. It serves as a comprehensive hub for
many relevant resources. pediatric critical care medicine professionals, with links to
LearnPICU () is a website associated with Stanford Uni- vetted clinical resources and organizations, as well as updates
versity Pediatric Critical Care. It features succinct on news and research in the field. The website hosts an online
12 Journal of Intensive Care Medicine XX(X)

Table 3. Average Scores for Each Domain for the Websites and Subgroups.

Top 10 FOAM
All Top 10 Top Middle Lower Websites FOAM Websites
Websites Websites Tertile Tertile Tertile Excluded Websites Excluded
Criteria (n ¼ 97) (n ¼ 10) (n ¼ 33) (n ¼ 31) (n ¼ 33) (n ¼ 87) (n ¼ 22) (n ¼ 75)

Content author disclosure 1.90 2.2 2.00 1.90 1.79 1.86 2.00 1.86
Author specialty 1.26 1.8 1.45 1.23 1.09 1.20 1.66 1.24
Content author institution disclosure 1.98 3 2.18 1.85 1.36 1.86 1.91 2.00
Is website domain educational, nonprofit, or 1.21 1.5 2.00 1.26 0.36 1.17 0.55 1.36
governmental
Editorial review process 0.53 2.4 1.36 0.10 0.09 0.31 0.41 0.56
General disclosure and privacy policy 0.38 0.7 0.64 0.39 0.12 0.34 0.27 0.41
References provided 1.52 2 1.82 1.48 1.25 1.47 1.17 1.49
E-mail or contact form 1.59 1.8 1.88 1.68 1.21 1.56 1.91 1.49
Advertising 3.05 3.7 3.52 1.51 2.52 2.98 3.18 3.01
Critical care medicine as intended subject scope 1.37 1.3 1.42 1.29 1.39 1.38 1.36 1.40
Material relevant to residents, fellows and/or 4.24 5 4.76 4.16 3.79 4.15 4.09 4.31
faculty in critical care
Comprehensiveness 3.32 5.9 4.94 3.52 1.52 3.02 2.95 3.45
Accuracy 5.63 6 6.00 5.61 5.27 5.59 5.05 5.80
Summary statements 0.85 0.8 0.79 0.84 0.91 0.85 1.00 0.80
Date of content creation/revision disclosed 0.84 0.9 0.85 0.77 0.88 0.83 0.91 0.81
When was the website/content last updated 1.40 2 1.73 1.10 1.36 1.33 1.73 1.31
Information found easily from homepage 0.79 1 1.00 0.87 0.52 0.77 0.82 0.80
Usable search engine or table of contents 1.75 2 2.00 1.68 1.58 1.72 2.00 1.71
Way to return to the homepage 0.79 0.9 0.82 0.74 0.82 0.78 0.73 0.80
Accessible in a timely manner 1.90 2 2.00 1.87 1.82 1.89 1.91 1.89
Accessible from main search engines 0.98 1 1.00 0.97 0.97 0.98 1.00 0.97
Access to information 0.80 1.6 1.21 0.84 0.36 0.71 0.50 0.91
Special hardware or software required 0.95 1 1.00 0.94 0.91 0.94 1.00 0.93
Interactive elements 1.61 3.6 2.73 1.16 0.91 1.38 1.09 1.72
Graphic/media elements present and 0.40 1.2 0.79 0.42 0.00 0.31 0.45 0.39
appropriately attributed
Graphic/media elements well integrated 0.71 0.9 0.85 0.81 0.48 0.69 0.91 0.67
Display of information clear and professional 0.84 1 0.97 0.87 0.67 0.82 0.73 0.87
User-friendly, intuitive, and logical 1.26 2 1.88 1.35 0.55 1.17 1.00 1.33
Links present 1.67 2 1.82 1.81 1.39 1.63 1.82 1.63
Links active 0.72 1 0.91 0.68 0.58 0.69 0.91 0.68
Total 46.20 62.2 56.30 45.87 36.39 44.36 45.23 46.55
Abbreviation: FOAM, Free Open Access Med(ical ed)ucation.

Evidence-Based Journal Club, containing nearly 1000 peer- weight-based reference tables for vital signs, medication dos-
reviewed reviews of pertinent clinical trials. ing, and equipment size for critical care. The information is
SurgicalCriticalCare.net (http://www.surgicalcriticalcare. well-referenced with clear authorship and a review process.
net/index.php) is a website associated with the Surgical Critical
Care and Acute Care Surgery Fellowship programs at Orlando
Regional Medical Center. The most thorough aspect of the Discussion
website is their evidence-based medicine guidelines, which are In this report, we reviewed 97 websites aimed at providing
a collection of downloadable PDFs containing recommenda- education for the critical care clinician, and describe in detail
tions, an overview and literature review on pertinent topics. the top 10 websites currently available in critical care medicine
The documents are all referenced, with clear disclosure of education. The top 10 websites represent websites that overall
authorship, editorial review, and revision date. The website adhere to the best practices in medical education website devel-
also contains medical calculators and videos. opment as outlined by critical appraisal tools, including the
WikEM (https://wikem.org/wiki/Category:Critical_Care), Health on the Net Code of Conduct.12 The top 10 websites
also known as The Global Emergency Medicine Wiki, is an more often included an editorial process, high-quality and
emergency medicine education resource with a specific cate- appropriately attributed graphics and multimedia, and scored
gory for critical care. The website contains pages organized by much higher for comprehensiveness and ease of access. Almost
topic, with text and hyperlinks for more information, as well as all of the top 10 websites include interactivity, whereas only
Wolbrink et al 13

one-third of the total websites include robust interactive experi- website, and thus, we may have missed some features. We
ences for the learner to learn and apply their knowledge. Only 1 attempted to review at least 1 resource in each of the sections
FOAM website was included in the list of the top 10 websites. on each website to try to limit this problem as much as possible.
This review differs from the most recent review from Klein-
pell et al in 2 important ways. First, the majority of the websites
that existed in 2011 and were still available to be reviewed Conclusion
were general medicine websites with some resources on critical There are many excellent resources for critical care medicine
care or were non-Additionally, many FOAM sites maintaina- education that exist at present and are only likely to continue to
critical care subspecialty websites with material that could also grow in number. This review should serve as a reference for
be applicable to the critical care clinician, such as interpreting residents, fellows, and attendings/consultants in critical care
radiology images or techniques for suturing. However, as many medicine seeking high-quality critical care websites to supple-
more websites designed specifically to provide educational ment their education. To maximize the awareness of these
resources for critical care medicine education exist now than resources among clinicians, we advocate a broad sharing of the
did in 2011, the majority of websites reviewed in this review table of critical care websites and encourage critical care web-
were targeted specifically for critical care clinicians. Second, sites to link to this article. Increasing the capability for inter-
the FOAM movement did not exist in 2011, and nearly one activity, promoting easier navigation, incorporating an editorial
quarter of the websites in this review were classified as FOAM process, and providing appropriate attribution for graphics and
websites. media are opportunities for improvement for many websites.
The FOAM movement has changed the landscape of med-
ical education, allowing anyone to access, share, and contribute
Authors’ Note
to resources online. It affords all learners the equal opportunity
OPENPediatrics is a not-for-profit entity in collaboration with the
to benefit from educational materials and supports the need for
World Federation of Pediatric Intensive and Critical Care Societies.
asynchronous learning in an age of increasing time demands on
PedsCCM.org is a non-profit website for Pediatric Critical Care Med-
physicians and trainees. Additionally, many FOAM sites main- icine, supported in part by The Virtual PICU (vpicu.org) and Anesthe-
tain a post-publication peer review process, either formally or siology Critical Care Medicine at Children’s Hospital Los Angeles.
informally, by allowing resources to be accessed by learners
and reviewed simultaneously.5 Our review highlights some
Acknowledgments
important ways that FOAM websites differ compared to other
The authors thank Meaghan Muir, MLIS, manager of library services
critical care medicine websites, especially the top 10 websites,
at Boston Children’s Hospital for her help with developing the liter-
and offers some opportunity for potentially increasing the cred-
ature and web search strategy, and Ms. Mollie Grunat and Ms. Eleanor
ibility of these websites including developing formal editorial Keller for their help with proofreading the manuscript.
processes, providing appropriate attribution for graphics and
media, and improving navigability.
Declaration of Conflicting Interests
Several limitations exist in our review. First, we did not
conduct a formal validation study of the CCMEWQET. Given The author(s) declared the following potential conflicts of interest
that this tool was based on 2 similar medical education tools with respect to the research, authorship, and/or publication of this
article: All of the authors are affiliated with websites that were eval-
that had been formally validated, and included all of the major
uated in the paper. T.W., L.R., and J.B. are affiliated with OPEN-
topics contained in most website evaluation tools, we felt that Pediatrics, and B.M. is affiliated with PedsCCM.org. No author
this modified tool should be able to discriminate the quality of reviewed his/her own paper.
CCM websites. However, despite ensuring that we included the
established criteria for evaluating blogs, we still observed that
Funding
most FOAM sites scored lower than traditional websites on the
CCMEWQET. Thus, perhaps our tool was not as well-suited The author(s) received no financial support for the research, author-
ship, and/or publication of this article
for evaluating FOAM websites, and we may need to consider
utilizing a more specialized FOAM evaluation tool for FOAM
websites. The second limitation is there are likely websites that References
contain content applicable for the critical care clinician that 1. Carlos WG, Goss K, Morad M. YouTube-based critical care edu-
have been missed in our website search. This is in part due to cational videos go viral. Med Educ. 2014;48(5):526.
the fact that many educational websites still exist behind hos- 2. Topps D, Helmer J, Ellaway R. YouTube as a platform for publish-
pital firewalls and are thus inaccessible. However, by searching ing clinical skills training videos. Acad Med. 2013;88(2):192-197.
all of the articles and websites identified in our PubMed and 3. Internet Live Stats. Total number of Websites. http://www.inter
Startpage search for additional websites through links, we netlivestats.com/total-number-of-websites/. Accessed December
believe we identified the key websites in critical care medicine 5, 2017.
education, especially as we repeatedly identified many web- 4. Olusanya O, Day J, Kirk-Bayley J, Szakmany T. Free Open
sites that were linked from multiple websites. Finally, it would Access Med(ical edu)cation for critical care practitioners. J Inten-
have been impossible to look at every resource on every sive Care Soc. 2017;18(1):2-7.
14 Journal of Intensive Care Medicine XX(X)

5. Nickson CP, Cadogan MD. Free Open Access Medical education 16. Michetti CP, Nakagawa TA, Malinoski D, Wright C, Swan-
(FOAM) for the emergency physician. Emerg Med Australas. son L. Organ donation education initiatives: a report of the
2014;26(1):76-83. donor management task force. J Critical Care. 2016;35:
6. Kleinpell R, Ely EW, Williams G, Liolios A, Ward N, Tisherman 24-28.
SA. Web-based resources for critical care education. Crit Care 17. Raine T, Thoma B, Chan TM, Lin M. FOAMSearch.net: a custom
Med. 2011;39(3):541-553. search engine for emergency medicine and critical care. Emerg
7. Cadogan M, Thoma B, Chan TM, Lin M. Free Open Access Meduca- Med Australas. 2015;27(4):363-365.
tion (FOAM): the rise of emergency medicine and critical care blogs 18. Albert TJ, Fassier T, Chhuoy M, et al. Bolstering medical educa-
and podcasts (2002-2013). Emerg Med J. 2014;31(e1):e76-e77. tion to enhance critical care capacity in Cambodia. Ann Am
8. Breckons M, Jones R, Morris J, Richardson J. What do evaluation Thorac Soc. 2015;12(4):491-497.
tools tell us about the quality of complementary medicine infor- 19. Thoma B, Sanders JL, Lin M, Paterson QS, Steeg J, Chan TM.
mation on the internet? J Med Internet Res. 2008;10(1):e3. The social media index: measuring the impact of emergency med-
9. Yang N, Hosseini S, Mascarella MA, et al. Identifying high qual- icine and critical care websites. West J Emerg Med. 2015;16(2):
ity medical education websites in Otolaryngology: a guide for 242-249.
medical students and residents. J Otolaryngol Head Neck Surg. 20. Pawlak M. New media and critical care ultrasound. J Ultrason.
2017;46(1):42. 2014;14(59):402-405.
10. Alyusuf RH, Prasad K, Abdel Satir AM, Abalkhail AA, Arora 21. Lin M, Wolbrink TA, Kissoon N, Burns JP. The development of
RK. Development and validation of a tool to evaluate the quality an internet-based knowledge exchange platform for pediatric crit-
of medical education websites in pathology. J Pathol Inform. ical care clinicians worldwide*. Emerg Med J. 2014;15(3):
2013;4:29. 197-205.
11. Thoma B, Chan TM, Paterson QS, Milne WK, Sanders JL, Lin M. 22. Sharma D, Bilotta F, Moore LE, et al. Web-based educational
Emergency medicine and critical care blogs and podcasts: estab- activities developed by the Society for Neuroscience in Anesthe-
lishing an international consensus on quality. Ann Emerg Med. siology and Critical Care (SNACC): the experience of process,
2015;66(4):396-402 e4. utilization, and expert evaluation. J Neurosurg Anesthesiol. 2014;
12. The HON Code of Conduct for medical and health web sites 26(1):4-10.
(HONcode). 2017; https://www.hon.ch/HONcode/Pro/Conduct. 23. Labeau SO. Is there a place for e-learning in infection prevention?
html. Accessed May 3, 2017. Aust Crit Care. Nov 2013;26(4):167-172.
13. LIDA. 2012; http://www.minervation.com/category/lida/. 24. Wolbrink TA, Burns JP. Internet-based learning and applications
Accessed October 2, 2012. for critical care medicine. J Intensive Care Med. 2012;27(5):
14. The DISCERN Tool. http://www.discern.org.uk/discern_tool. 322-332.
php. Accessed December 7, 2017. 25. Kissoon N, Carcillo JA, Espinosa V, Global sepsis initiative van-
15. Kleynhans AC, Oosthuizen AH, van Hoving DJ. Emergency med- guard center contributors, et al. world federation of pediatric
icine educational resource use in Cape Town: modern or tradi- intensive care and critical care societies: global sepsis initiative.
tional? Postgrad Med J. 2017;93(1099):250-255. Pediatr Crit Care Med. 2011;12(5):494-503.

You might also like