Professional Documents
Culture Documents
Teaching Clinical Reasoning and Critical Thinking: From Cognitive Theory to Practical
Application
PII: S0012-3692(20)31449-5
DOI: https://doi.org/10.1016/j.chest.2020.05.525
Reference: CHEST 3197
Please cite this article as: Richards JB, Hayes MM, Schwartzstein RM, Teaching Clinical Reasoning
and Critical Thinking: From Cognitive Theory to Practical Application, CHEST (2020), doi: https://
doi.org/10.1016/j.chest.2020.05.525.
This is a PDF file of an article that has undergone enhancements after acceptance, such as the addition
of a cover page and metadata, and formatting for readability, but it is not yet the definitive version of
record. This version will undergo additional copyediting, typesetting and review before it is published
in its final form, but we are providing this version to give early visibility of the article. Please note that,
during the production process, errors may be discovered which could affect the content, and all legal
disclaimers that apply to the journal pertain.
Copyright © 2020 Published by Elsevier Inc under license from the American College of Chest
Physicians.
1 Abstract word count: 237
4 Title: Teaching Clinical Reasoning and Critical Thinking: From Cognitive Theory to Practical
5 Application
6 Short title / running head: Teaching clinical reasoning and critical thinking
8 Author list: Jeremy B. Richards, MD, MA, Margaret M. Hayes, MD, Richard M. Schwartzstein,
9 MD
10 Affiliations: Center for Education, Shapiro Institute for Education and Research, Department of
11 Medicine, Beth Israel Deaconess Medical Center and Harvard Medical School
12
15 Email: rschwart@bidmc.harvard.edu
16
19
21
23
1 Abstract
3 environment of the Intensive Care Unit. Clinical reasoning is a complex process in which one
4 identifies and prioritizes pertinent clinical data to develop a hypothesis and a plan to confirm or
5 refute that hypothesis. Clinical reasoning is related to and dependent on critical thinking skills,
6 which are defined as one’s capacity to engage in higher cognitive skills such as analysis,
7 synthesis, and self-reflection. The authors review how an understanding of the cognitive
8 psychological principles that contribute to effective clinical reasoning have led to strategies for
9 teaching clinical reasoning in the ICU. With familiarity with System 1 and System 2 thinking,
10 which represent intuitive versus analytical cognitive processing pathways, respectively, the
11 clinical teacher can use this framework to identify cognitive patterns in clinical reasoning. In
12 addition, the authors describe how internal and external factors in the clinical environment can
13 affect students’ and trainees’ clinical reasoning abilities, as well as their capacity to understand
14 and incorporate strategies for effective critical thinking into their practice. Utilizing applicable
15 cognitive psychological theory, the relevant literature on teaching clinical reasoning is reviewed
16 and specific strategies to effectively teach clinical reasoning and critical thinking in the ICU and
17 other clinical settings are provided. Definitions, operational descriptions, and justifications for a
18 variety of teaching interventions are discussed, including the ‘one minute preceptor’ model, the
20
21
1 Introduction
2
3 Clinical reasoning is a complex process that involves identifying pertinent clinical data,
4 prioritizing these data to develop a hypothesis or conclusion, and developing a plan to confirm or
5 refute the clinical hypothesis.1,2 The ability to engage in effective clinical reasoning is influenced
6 by internal factors such as curiosity, motivation, fatigue, and burnout, as well as external factors
7 such as time constraints, environment, distractions, and team dynamics. Clinical reasoning is
8 both related to and informed by critical thinking skills, which describe one’s ability to employ
9 higher cognitive processes such as analysis, synthesis, and self-reflection – skills necessary to
11
12 In this review, we describe the foundational cognitive principles underlying critical thinking, the
13 context in which clinical reasoning occurs, and educational interventions designed to develop
14 learners’ clinical reasoning skills. Finally, we identify areas for further research into teaching
15 and assessing clinical reasoning. Although the focus is on clinical reasoning in the intensive care
16 unit (ICU), which offers a particularly rich environment to teach and practice inductive
17 reasoning, the educational interventions and skills described herein are applicable to all medical
19
20 Overview - Definitions
21 The terms “critical thinking” and “clinical reasoning” are used frequently in medical education,
22 often synonymously, but they are rarely explicitly defined. At a national conference in 2011,
23 teams from 9 medical schools defined critical thinking as “the ability to apply higher cognitive
24 skills (e.g., analysis, synthesis, self-reflection, perspective taking) and/or the disposition to be
1 deliberative about thinking (being open-minded or intellectually honest) that leads to action that
2 is logical and appropriate”.3 The elements of clinical reasoning, a less clearly defined construct,
3 include both the biomedical knowledge that is the foundation of clinical medicine, and a range of
4 thinking skills.4 While medical schools, particularly in the pre-clerkship curriculum, and
5 residency programs have historically focused largely on content transfer (knowledge) as the core
6 of their educational mission, thinking skills have not typically been explicitly addressed.
7 Memorization and recall of material have been highly prioritized, but not clinical reasoning. In
8 contrast, clinical reasoning was assumed to be acquired as part of the apprenticeship phase of
9 training; one learned clinical reasoning by taking care of patients and observing how mentors did
10 it.
11
12 The hypothetico-deductive approach to thinking has been the basis of medical school training for
14 which one deduces what one knows about each disease; aligning the patient’s symptoms,
15 physical findings, and laboratory data with diagnostic hypotheses. The best match is the answer.5
16 But what if the match isn’t that perfect? What if you only can think of two possible diagnoses?
17 What if something doesn’t fit? And what is the impact of the patient the trainee saw yesterday or
18 last week on the diagnostic hypotheses (i.e., is the trainee being influenced by cognitive biases or
20
21 In contrast, other professionals, such as engineers, who face daunting “diagnostic” problems, use
22 an inductive approach.7 Using inductive reasoning, one works with data (facts) to create
23 intermediate hypotheses that explain mechanisms of function, not immediately worrying about
1 the final answer. These hypotheses can be tested, and new hypotheses created, until a final
4 Probabilistic thinking also plays a role in medical decision-making. Bayesian analysis, making
5 use of data from clinical epidemiology, can be a useful instrument in one’s thinking toolkit in
6 many situations.8,9
9 deductive, inductive, and probabilistic approaches (Figure 1). Of these, medical educators have
10 taught both evidence-based medicine and Bayesian analysis most explicitly, but this approach is
11 limited in solving the most difficult or atypical cases, particularly when learners are struggling to
12 even understand the patient’s problem. Thus, the focus of this review will be on the cognitive
13 science underlying clinical reasoning and the approaches to teaching hypothetico-deductive and
15
17 Confronted with a new problem, the brain quickly scans the situation to see if it recognizes a
18 previously encountered pattern. This process is extremely fast (typically occurring within a
19 second or two), often unconscious, and frequently accurate. We get through our days, recognize
20 friends and family, and manage many tasks this way, using what is called System 1, or
21 ‘intuitive’, thinking.10 This system, along with the use of heuristics, or cognitive ‘rules of
22 thumb’, helps us navigate complex problems with uncertain probabilities, but can lead to
23 systematic errors.10 Neuroimaging studies suggest that when making decisions using System 1
1 thinking, such as quickly diagnosing chest radiographs, we utilize deeper portions of the brain
2 not associated with higher-order cognitive processing.11 There is minimal research about the role
3 of System 1 versus System 2 thinking in the ICU setting, and no studies of which we are aware
7 System 1 thinking does not have to be taught, per se; it evolves as the brain learns more patterns.
8 Its use is often facilitated in medical education by teaching “illness scripts,” which are
10 built knowledge through experience, and trusting that one’s knowledge is entirely sufficient to
11 address all future problems.13 In clinical medicine, “routine experts” have large stores of
12 knowledge in the form of illness scripts and can access these scripts quickly when presented with
13 a patient or problem.13 System 2 thinking, in contrast, must be developed by the learner, either
14 implicitly (e.g., when behavior is modeled but not described), or explicitly in sessions designed
15 to support specific thinking skills. Individuals who are able to apply System 2 reasoning can
16 solve problems and explain cases characterized by issues they have never encountered before.
17 This type of thinking is described as “adaptive expertise” and is characterized as flexible and
18 innovative.13
19
20 As System 2 thinking is analytical, deliberative, and conscious, the neurological loci for these
21 processes are believed to exist in the frontal cortex.10 Rather than being based primarily on
22 pattern recognition, System 2 thinking is, at its best, represented by inductive reasoning and the
2 rather than jumping immediately to a diagnosis. For example, a hypotensive patient with warm
3 extremities and normal capillary refill suggests high cardiac output and normal to low systemic
4 vascular resistance. Having made that formulation, one can consider diagnoses consistent with
5 that physiology, such as sepsis or neurogenic shock, and exclude other processes such as
6 hypovolemic or cardiogenic shock. While this thinking is “slow” compared to the intuitive,
7 almost immediate response provided by System 1 thinking, it can often be done in seconds to
8 minutes.
10 Simpler forms of System 2 thinking include a forced pause when evaluating a patient, sometimes
11 referred to as a “cognitive time out,”14,15 to ask, “what else could this be?” Such a forced pause
12 is intended to invoke System 2 thinking. Practicing physicians skilled in both types of thinking
13 will often move quickly back and forth between System 1 and 2. A qualitative and observational
14 study of 28 surgeons described how they transitioned from System 1 to System 2 behaviors in
15 the operating room.16 Surgeons described or were observed “stopping” or “fine-tuning” (e.g.,
16 slowing down both physically and cognitively) during challenging or effortful portions of the
17 operation.
18
20 Cognitive biases, are subconscious reflexes that influence conclusions, especially those reached
21 using System 1 thinking.16 Although first recognized in Medicine in the 1970s,17 cognitive biases
23 contribute to many of the errors associated with System 1 thinking and errors associated with
1 common teaching strategies used for clinical reasoning that rely on hypothetico-deductive
4 Cognitive biases have been shown to contribute to diagnostic errors in over 70% of cases, based
5 on studies assessing the role of cognitive errors and biases in malpractice claims.19–21 While over
6 100 biases have been described,22 the ones that are particularly prevalent in the ICU are
7 described in Table 1.23 These cognitive biases lead to thinking errors, which are translated to
10 Unaware of their influence on cognitive processing, many physicians do not appreciate the
11 impact of bias on their clinical decision making,27. Most people are not aware they are engaging
12 in heuristics or cognitive biases most of the time.28 These mental short cuts and superficial
13 assumptions may be adequate for making clinical decisions when one is confronted with
14 “typical” cases for which System 1 thinking is sufficient.24 However, when a clinician is faced
15 with an atypical case, which can be among the most challenging and high stakes clinical
16 scenarios, cognitive biases may be exposed. Therefore, it is important for physicians to have
18 consistently and effectively pursue inductive reasoning, even when a case may seem to be
20
21 De-biasing or cognitive forcing strategies are critical tools for eliminating the most common
22 thinking mistakes. Although these strategies require effort27, physicians can and should be taught
23 to monitor their thought processes for biases so that they can self-regulate.24 One of the most
1 useful de-biasing strategies is metacognition, which is defined as thinking about one’s thought
2 processes, e.g., “I might be considering diagnosis X is correct because I missed a case of this
3 last week.”27,29,30 Other de-biasing strategies include explicit efforts to acknowledge one’s
6 specific opportunity to clearly describe uncertainty to other providers, and can contribute to
7 creating a more accurate shared mental model of a patient’s clinical circumstances. In addition,
8 we encourage our trainees to use the word “hypothesis” instead of “diagnosis” since
9 “hypothesis” implies uncertainty about the proposed solution, which needs to be scrutinized and
10 tested; in contrast, the term “diagnosis” is often associated with a sense of finality. This semantic
11 substitution may lead to a reduction in anchoring; the more physicians can tolerate uncertainty,
12 the more comfortable they feel not having “one” right answer or “one” explanation.
13
14 Other strategies include a focus on accountability32 and feedback.22,23,33 In the face of duty hours,
15 shift work and frequent handoffs, outcomes of diagnostic and therapeutic hypotheses are not
16 always available to the clinician who formulated them. Furthermore, the time-pressured
17 environment in which handoffs frequently occur may increase the risk of diagnostic momentum
18 contributing to faulty reasoning. One strategy to decrease the risk of duty hours and handoffs
19 affecting clinical reasoning is for all physicians to ascertain the progress of patients for whom
20 they have provided care and seek feedback on whether or not one’s thought processes were
21 correct. In addition, quality improvement and assurance processes can influence and support
23 can complement the individual’s efforts to avoid cognitive biases and faulty clinical reasoning.
1
4 To foster clinical reasoning and critical thinking skills, faculty must help learners develop
5 analytic reasoning skills and habits of life-long self-directed learning. These skills are necessary
6 to identify, prioritize, and justify pertinent positive and negative data from a patient’s
7 presentation. While some authors have argued that critical thinking and clinical reasoning cannot
8 be taught,34 there is no definitive evidence supporting this claim, and others have demonstrated
9 the limitations of the studies on which these claims have been made.21 We contend that the
10 knowledge, skills, and attitudes necessary to learn and effectively engage in effective clinical
11 reasoning are transferrable. These skills will motivate the trainee to engage in effortful clinical
12 reasoning and critical thinking, as well as to independently formulate and answer key questions
14
15 Posing questions to learners is a general strategy for assessing and teaching critical thinking in
16 clinical settings. However, questions that begin with ‘what,’ (e.g., “what is the most common
17 cause of X?”), are generally perceived as threatening by learners, closed-ended in nature, and
18 frequently result in brief answers that do not explain the learner’s deeper understanding. In
19 contrast, prioritizing questions that begin with ‘why’ or ‘how’ will encourage learners to explain
21
23 reasoning is the ‘one minute preceptor’ technique (also referred to as the ‘microskills’ model of
1 clinical teaching).34,35 The ‘one minute preceptor’ has been well-described, and has been studied
2 in a variety of clinical settings (Table 2).34,35 In the ‘one minute preceptor’ model, the learner
3 must commit to a prioritized differential diagnosis for a patient’s clinical problem, allowing
4 educators to probe and analyze the learners’ clinical reasoning. This technique prioritizes
6 demonstrated to improve faculty’s ability to evaluate students’ reasoning abilities and to improve
7 the effectiveness of clinical teaching encounters.36 In addition, when done well, with probing
9 the ‘one minute preceptor’ technique teaches higher level concepts and prompts provision of
11
12 A modification of the ‘one minute preceptor’ is the SNAPPS model.38 SNAPPS is an acronym
13 for ‘Summarize, Narrow, Analyze, Probe, Plan, and Self-study’. Unlike the classic ‘one minute
15 responsible for each step in the SNAPPS protocol (Table 3). In this manner, the learner assumes
16 responsibility for the patient-centered discussion, developing autonomy, responsibility, and self-
17 directed learning skills. As with the one-minute preceptor, however, the student’s initial
18 diagnosis may be informed primarily by pattern recognition, and the self-initiated analysis and
19 probing elements of SNAPPS may become superficial and pro forma for many students over
20 time.
21
22 In a randomized trial conducted over an eight month period at a single academic medical center,
23 64 medical students on a compulsory, Family Medicine clerkship were assigned to either use
1 SNAPPS, a general feedback training approach, or “usual-and-customary instruction”. Students
2 who employed SNAPPS had more concise presentations, a greater number of diagnoses in the
3 differential and number of justifications, higher frequency of seeking information, and greater
6 For both the ‘one minute preceptor’ and SNAPPS, if not done properly, these techniques may
7 reinforce reliance on illness scripts, which may predispose individuals toward System 1 thinking,
8 which may be susceptible to cognitive biases. Furthermore, studies of the long-term impact of
10
11
13 Reflective exercises, and reflective writing in particular, are powerful educational tools for
14 developing medical learners’ metacognitive and clinical reasoning skills.39 Reflective writing is a
15 method for helping learners engage in meaningful consideration of their actions and thinking,
16 and leverages the innately human orientation towards storytelling as a means of sharing
17 information and learning from experiences.41 The act of writing requires one to process events
18 and experiences with the intent of relating them to others.42 Reflective writing is not intuitive; so
19 support and training is initially required for learners to be able to effectively engage in and get
20 the most of out of the exercise.39 We have used brief reflective writing exercises in the ICU,
21 including providing learners with time to reflect on and write down their personal learning
22 objectives for the rotation as well as using ‘one minute papers’ at the end of select teaching
23 sessions. We also use systematic team reflection to determine errors in clinical evaluation or
1 judgment we may have made when patients self-extubate and remain off mechanical ventilation
2 thereafter, i.e., why did we not determine the patient could have been extubated sooner? Was our
3 thinking flawed?
5 Reflective writing has been demonstrated to be well-received by medical students and residents,
6 and has been shown to improve students’ empathy,43 professionalism,44 and narrative reasoning
7 abilities.45 In addition, one study of 41 Internal Medicine residents who participated in reflective
8 writing exercises and small group discussions demonstrated that the residents were able to use
9 reflective writing to identify personal experiences with diagnostic errors and cognitive biases that
10 may have contributed to the errors.46 These effects of reflective writing on learners’ perspectives,
11 characteristics, and clinical reasoning performance underscore the potential role for reflective
12 writing in teaching clinical reasoning and critical thinking skills. For reflection to lead to
13 modifications in future behavior, however, instructors should guide students to develop explicit
15
17 Concept maps are visual representations of relationships between knowledge and principles. In
18 their classical form (Figure 2), they have a hierarchical structure with the largest or most general
19 form of the topic at the top of the map, and progressive levels of subtopics or component parts
20 are outlined below.48 This type of map assists learners as they organize new information. A
21 different form of concept map used in medical education (Figure 3), termed a mechanism map,
23 mechanisms.49,50
1
2 Mechanism maps help students develop inductive reasoning skills, by explicitly linking elements
3 of the history, physical exam, and laboratory data in an active and graphic manner.50–52 Rather
4 than ask the learner for a diagnosis, instructors push students to explain how pieces of the case fit
5 together pathophysiologically to account ultimately for all that is being observed. Intermediate
6 hypotheses can be created; anecdotally, we believe this leads to broader thinking and generation
7 of more potential diagnoses. When an element does not seem to fit, the learner is compelled to
8 create additional or new hypotheses to account for the data rather than ignore or jettison the
9 information. In this manner, various thinking errors and cognitive biases, such as premature
10 closure and confirmation bias, can be avoided in the initial analysis of a clinical problem.
11
12 Collaborative work among learners to create concept/mechanism maps mimics the way a clinical
13 team solves problems.51,53,54 Students are fully engaged and the creation of the map becomes a
14 focal point for group interactions. When students or residents struggle to “put a case together”,
15 creating a mechanism map gives them a place to start. By placing the “data” from the case on
16 paper or a screen and then creating links between data elements, foundational biomedical
17 knowledge is retrieved and reinforced, and an explanatory solution can be created, even one not
18 seen before, a characteristic of the adaptive expert.13 One is not attempting to discern a pattern or
19 recall an illness script; rather, the learner is truly “working the problem”, using conceptual
20 knowledge to truly explore the case. Constructing the map is a concrete strategy to explicitly
21 teach diagnostic reasoning. In the context of time-pressured work rounds, one may focus on a
22 portion of a map, such as one component of the patient’s problem, to reinforce analytical skills.
23 We use mechanism maps on rounds in a very targeted manner, both as a means of slowing down
1 (modeling to learners that we are prioritizing teaching and learning in the moment) and to
2 graphically demonstrate a concept or topic that is difficult for the learners. In the context of
3 rounds, emphasizing key mechanistic relationships (e.g., how a pulmonary embolism can cause
4 shock) with mechanism or concept maps can be done while ensuring that teaching is focused and
5 time-limited.
7 Role-modeling
8 Cognitive biases can impact students, trainees, and attending physicians. Attending physicians
9 can acknowledge the impact of cognitive biases and errors in reasoning, which can be a powerful
10 tool for demonstrating the need for a role of metacognition to students and trainees. “Thinking
11 out loud”, and articulating one’s own uncertainties and thought process, attending physicians can
13
15 Internal Context
16 The personal attributes, characteristics, perspectives, and behaviors of learners are critical
17 components of their readiness and motivation to engage in deeper learning and to participate in
18 effortful clinical reasoning. Specifically, curiosity and motivation are considered to positively
19 influence clinical reasoning and critical thinking skills,55–57 while burnout and fatigue negatively
21
2 and residents’ clinical reasoning abilities,58,59 as the effortful nature of engaging in critical
3 thinking is adversely affected by burnout, fatigue, and lack of motivation. Strategies to assess
4 and minimize burnout in medical students and residents may result in improved clinical
7 External Context
8 The environment in which learners operate influences critical thinking and clinical reasoning
9 skills. Factors ranging from distractions and interruptions to interpersonal and team-based issues
10 affect learners’ abilities to engage in clinical reasoning and the effectiveness of critical thinking
11 skills. The relationship between the external environment and cognitive capacity is described in
12 cognitive load theory, and specifically the concept of working memory.65 Working memory is
13 one’s capacity to process information, and it can be affected by internal factors, such as the
14 cognitive work of performing a task, and external factors, such as distractions, interruptions, and
15 system-based issues.
16
18 shortcuts and System 1 thinking.65 One study of Emergency Medicine physicians demonstrated
19 that these providers were interrupted every 3 to 6 minutes during clinical work.66 Interruptions
20 or distractions in the clinical setting result in increased multitasking and decreased focus and
21 attention on important clinical tasks or problems.67 Best practices for addressing workplace
22 interruptions and distractions are not well-described in the literature, although one single center
2 satisfaction and patients’ perceptions of the care they received.68 Clinical reasoning skills and
6 The cognitive theoretical topics and educational strategies we describe are particularly pertinent
7 to teaching medical learners in the ICU. The ICU is a complex clinical environment, and learners
8 are challenged to gather and process large amounts of complex information, including
9 physiological data that can support the use of inductive reasoning. Critical thinking skills are
10 necessary to engage in effective patient care in the ICU, and clinicians and educators can help
11 learners develop their reasoning skills by emphasizing the role of inductive reasoning in clinical
12 practice, asking effective questions (using ‘how’ and ‘why’), acknowledging the impact of
13 cognitive biases in clinical reasoning, and using concept or mechanism maps when teaching.
14 These and other strategies can leverage best practices in teaching critical thinking to help
16
17 Future Research
18 The literature describing effective educational interventions for addressing and improving
19 medical learners’ critical thinking and clinical reasoning skills is heterogeneous. Furthermore,
21 single cohort of learners at a single center. Some have argued that critical thinking and clinical
22 reasoning cannot be taught.69 The studies on which this conclusion is based, however, are fraught
2 reasoning and critical thinking skills are needed, as are confirmatory studies re-assessing the
5 Conclusion
6 Clinical reasoning is a complex cognitive process involving multiple steps, from gathering and
7 prioritizing data, to synthesizing and analyzing disparate information to reach a cogent clinical
8 hypothesis or conclusion. Clinical reasoning abilities are directly informed by and dependent on
9 critical thinking skills, and the cognitive processes of clinical reasoning and critical thinking are
11 role of System 1 and System 2 thinking to the impact of cognitive biases on critical thinking, can
2 1. Connor DM, Durning SJ, Rencic JJ. Clinical Reasoning as a Core Competency. Acad
3 Med J Assoc Am Med Coll. October 2019. doi:10.1097/ACM.0000000000003027
7 3. Huang GC, Newman LR, Schwartzstein RM. Critical thinking in health professions
8 education: summary and consensus statements of the Millennium Conference 2011. Teach Learn
9 Med. 2014;26(1):95-102. doi:10.1080/10401334.2013.857335
10 4. Kassirer JP. Teaching Clinical Reasoning: Case-Based and Coached: Acad Med.
11 2010;85(7):1118-1124. doi:10.1097/ACM.0b013e3181d5dd0d
12 5. Bowen JL. Educational strategies to promote clinical diagnostic reasoning. N Engl J Med.
13 2006;355(21):2217-2225. doi:10.1056/NEJMra054782
17 7. Prince MJ, Felder RM. Inductive Teaching and Learning Methods: Definitions,
18 Comparisons, and Research Bases. J Eng Educ. 2006;95(2):123-138. doi:10.1002/j.2168-
19 9830.2006.tb00884.x
20 8. Willis BH, Beebee H, Lasserson DS. Philosophy of science and the diagnostic process.
21 Fam Pract. 2013;30(5):501-505. doi:10.1093/fampra/cmt031
26 10. Kahneman D. Thinking, Fast and Slow. New York, NY, US: Farrar, Straus and Giroux;
27 2011.
28 11. Melo M, Scarpin DJ, Jr EA, et al. How Doctors Generate Diagnostic Hypotheses: A
29 Study of Radiological Diagnosis with Functional Magnetic Resonance Imaging. PLOS ONE.
30 2011;6(12):e28752. doi:10.1371/journal.pone.0028752
31 12. Custers EJFM. Thirty years of illness scripts: Theoretical origins and practical
32 applications. Med Teach. 2015;37(5):457-462. doi:10.3109/0142159X.2014.956052
1 13. Mylopoulos M, Regehr G. Cognitive metaphors of expertise and knowledge: prospects
2 and limitations for medical education. Med Educ. 2007;41(12):1159-1165. doi:10.1111/j.1365-
3 2923.2007.02912.x
4 14. Huang GC, Kriegel G, Wheaton C, et al. Implementation of diagnostic pauses in the
5 ambulatory setting. BMJ Qual Saf. 2018;27(6):492-497. doi:10.1136/bmjqs-2017-007192
6 15. Jones M, Butler J, Graber CJ, et al. Think twice: A cognitive perspective of an antibiotic
7 timeout intervention to improve antibiotic use. J Biomed Inform. 2017;71S:S22-S31.
8 doi:10.1016/j.jbi.2016.06.005
9 16. O’Sullivan ED, Schofield SJ. Cognitive bias in clinical medicine. J R Coll Physicians
10 Edinb. 2018;48(3):225-232. doi:10.4997/JRCPE.2018.306
11 17. Detmer DE, Fryback DG, Gassner K. Heuristics and biases in medical decision-making. J
12 Med Educ. 1978;53(8):682-683. doi:10.1097/00001888-197808000-00012
15 19. Saber Tehrani AS, Lee H, Mathews SC, et al. 25-Year summary of US malpractice
16 claims for diagnostic errors 1986-2010: an analysis from the National Practitioner Data Bank.
17 BMJ Qual Saf. 2013;22(8):672-680. doi:10.1136/bmjqs-2012-001550
18 20. Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern
19 Med. 2005;165(13):1493-1499. doi:10.1001/archinte.165.13.1493
20 21. Saposnik G, Redelmeier D, Ruff CC, Tobler PN. Cognitive biases associated with
21 medical decisions: a systematic review. BMC Med Inform Decis Mak. 2016;16(1):138.
22 doi:10.1186/s12911-016-0377-1
23 22. Elstein AS. Thinking about diagnostic thinking: a 30-year perspective. Adv Health Sci
24 Educ Theory Pract. 2009;14 Suppl 1:7-18. doi:10.1007/s10459-009-9184-0
25 23. Hayes MM, Chatterjee S, Schwartzstein RM. Critical Thinking in Critical Care: Five
26 Strategies to Improve Teaching and Learning in the Intensive Care Unit. Ann Am Thorac Soc.
27 2017;14(4):569-575. doi:10.1513/AnnalsATS.201612-1009AS
28 24. Royce CS, Hayes MM, Schwartzstein RM. Teaching Critical Thinking: A Case for
29 Instruction in Cognitive Biases to Reduce Diagnostic Errors and Improve Patient Safety. Acad
30 Med J Assoc Am Med Coll. 2019;94(2):187-194. doi:10.1097/ACM.0000000000002518
31 25. Schiff GD, Puopolo AL, Huben-Kearney A, et al. Primary care closed claims experience
32 of Massachusetts malpractice insurers. JAMA Intern Med. 2013;173(22):2063-2068.
33 doi:10.1001/jamainternmed.2013.11070
1 26. Gandhi TK, Kachalia A, Thomas EJ, et al. Missed and delayed diagnoses in the
2 ambulatory setting: a study of closed malpractice claims. Ann Intern Med. 2006;145(7):488-496.
3 doi:10.7326/0003-4819-145-7-200610030-00006
4 27. Croskerry P. From mindless to mindful practice--cognitive bias and clinical decision
5 making. N Engl J Med. 2013;368(26):2445-2448. doi:10.1056/NEJMp1303712
8 29. Croskerry P. Cognitive forcing strategies in clinical decisionmaking. Ann Emerg Med.
9 2003;41(1):110-120. doi:10.1067/mem.2003.22
10 30. Croskerry P, Petrie DA, Reilly JB, Tait G. Deciding about fast and slow decisions. Acad
11 Med J Assoc Am Med Coll. 2014;89(2):197-200. doi:10.1097/ACM.0000000000000121
14 32. Croskerry P. The importance of cognitive errors in diagnosis and strategies to minimize
15 them. Acad Med J Assoc Am Med Coll. 2003;78(8):775-780. doi:10.1097/00001888-200308000-
16 00003
17 33. Croskerry P. The feedback sanction. Acad Emerg Med Off J Soc Acad Emerg Med.
18 2000;7(11):1232-1238. doi:10.1111/j.1553-2712.2000.tb00468.x
22 35. Neher JO, Gordon KC, Meyer B, Stevens N. A five-step “microskills” model of clinical
23 teaching. J Am Board Fam Pract. 1992;5(4):419-424.
24 36. Aagaard E, Teherani A, Irby DM. Effectiveness of the one-minute preceptor model for
25 diagnosing the patient and the learner: proof of concept. Acad Med J Assoc Am Med Coll.
26 2004;79(1):42-49. doi:10.1097/00001888-200401000-00010
27 37. Farrell SE, Hopson LR, Wolff M, Hemphill RR, Santen SA. What’s the Evidence: A
28 Review of the One-Minute Preceptor Model of Clinical Teaching and Implications for Teaching
29 in the Emergency Department. J Emerg Med. 2016;51(3):278-283.
30 doi:10.1016/j.jemermed.2016.05.007
31 38. Wolpaw T, Papp KK, Bordage G. Using SNAPPS to facilitate the expression of clinical
32 reasoning and uncertainties: a randomized comparison group trial. Acad Med J Assoc Am Med
33 Coll. 2009;84(4):517-524. doi:10.1097/ACM.0b013e31819a8cbf
1 39. Sandars J. The use of reflection in medical education: AMEE Guide No. 44. Med Teach.
2 2009;31(8):685-695. doi:10.1080/01421590903050374
3 40. Burman NJ, Boscardin CK, Van Schaik SM. Career-long learning: relationship between
4 cognitive and metacognitive skills. Med Teach. 2014;36(8):715-723.
5 doi:10.3109/0142159X.2014.909010
11 43. DasGupta S, Charon R. Personal illness narratives: using reflective writing to teach
12 empathy. Acad Med J Assoc Am Med Coll. 2004;79(4):351-356. doi:10.1097/00001888-
13 200404000-00013
14 44. Braun UK, Gill AC, Teal CR, Morrison LJ. The utility of reflective writing after a
15 palliative care experience: can we assess medical students’ professionalism? J Palliat Med.
16 2013;16(11):1342-1349. doi:10.1089/jpm.2012.0462
17 45. Caeiro C, Cruz EB, Pereira CM. Arts, literature and reflective writing as educational
18 strategies to promote narrative reasoning capabilities among physiotherapy students. Physiother
19 Theory Pract. 2014;30(8):572-580. doi:10.3109/09593985.2014.928919
20 46. Ogdie AR, Reilly JB, Pang WG, et al. Seen through their eyes: residents’ reflections on
21 the cognitive and contextual components of diagnostic errors in medicine. Acad Med J Assoc Am
22 Med Coll. 2012;87(10):1361-1367. doi:10.1097/ACM.0b013e31826742c9
26 48. Daley BJ, Torre DM. Concept maps in medical education: an analytical literature review.
27 Med Educ. 2010;44(5):440-448. doi:10.1111/j.1365-2923.2010.03628.x
31 50. Veronese C, Richards JB, Pernar L, Sullivan AM, Schwartzstein RM. A randomized pilot
32 study of the use of concept maps to enhance problem-based learning among first-year medical
33 students. Med Teach. 2013;35(9):e1478-1484. doi:10.3109/0142159X.2013.785628
1 51. Torre DM, Durning SJ, Daley BJ. Concept Maps: Definition, Structure, and Scoring.
2 Acad Med J Assoc Am Med Coll. 2017;92(12):1802. doi:10.1097/ACM.0000000000001969
3 52. Torre DM, Durning SJ, Daley BJ. Twelve tips for teaching with concept maps in medical
4 education. Med Teach. 2013;35(3):201-208. doi:10.3109/0142159X.2013.759644
5 53. Fischer K, Sullivan AM, Krupat E, Schwartzstein RM. Assessing the Effectiveness of
6 Using Mechanistic Concept Maps in Case-Based Collaborative Learning. Acad Med J Assoc Am
7 Med Coll. 2019;94(2):208-212. doi:10.1097/ACM.0000000000002445
8 54. Peñuela-Epalza M, De la Hoz K. Incorporation and evaluation of serial concept maps for
9 vertical integration and clinical reasoning in case-based learning tutorials: Perspectives of
10 students beginning clinical medicine. Med Teach. 2019;41(4):433-440.
11 doi:10.1080/0142159X.2018.1487046
12 55. Dyche L, Epstein RM. Curiosity and medical education. Med Educ. 2011;45(7):663-668.
13 doi:10.1111/j.1365-2923.2011.03944.x
14 56. Pluck G, Johnson HL. Stimulating curiosity to enhance learning. GESJ Educ Sci Psychol.
15 2011;2 (19). http://gesj.internet-academy.org.ge/en/title_en.php?b_sec=edu. Accessed May 24,
16 2019.
17 57. Norman G. On competence, curiosity and creativity. Adv Health Sci Educ Theory Pract.
18 2012;17(5):611-613. doi:10.1007/s10459-012-9416-6
19 58. McBee E, Ratcliffe T, Picho K, et al. Contextual factors and clinical reasoning:
20 differences in diagnostic and therapeutic reasoning in board certified versus resident physicians.
21 BMC Med Educ. 2017;17(1):211. doi:10.1186/s12909-017-1041-x
22 59. Durning SJ, Costanzo M, Artino AR, et al. Functional Neuroimaging Correlates of
23 Burnout among Internal Medicine Residents and Faculty Members. Front Psychiatry.
24 2013;4:131. doi:10.3389/fpsyt.2013.00131
25 60. Ellaway RH. When I say … epistemic curiosity. Med Educ. 2014;48(2):113-114.
26 doi:10.1111/medu.12272
27 61. Litman J. Curiosity and the pleasures of learning: Wanting and liking new information.
28 Cogn Emot. 2005;19(6):793-814. doi:10.1080/02699930541000101
29 62. Renner B. Curiosity about people: the development of a social curiosity measure in
30 adults. J Pers Assess. 2006;87(3):305-316. doi:10.1207/s15327752jpa8703_11
4 65. Young JQ, Van Merrienboer J, Durning S, Ten Cate O. Cognitive Load Theory:
5 implications for medical education: AMEE Guide No. 86. Med Teach. 2014;36(5):371-384.
6 doi:10.3109/0142159X.2014.889290
7 66. Chisholm CD, Collison EK, Nelson DR, Cordell WH. Emergency department workplace
8 interruptions: are emergency physicians “interrupt-driven” and “multitasking”? Acad Emerg Med
9 Off J Soc Acad Emerg Med. 2000;7(11):1239-1243. doi:10.1111/j.1553-2712.2000.tb00469.x
10 67. Ratwani RM, Fong A, Puthumana JS, Hettinger AZ. Emergency Physician Use of
11 Cognitive Strategies to Manage Interruptions. Ann Emerg Med. 2017;70(5):683-687.
12 doi:10.1016/j.annemergmed.2017.04.036
13 68. Schneider A, Wehler M, Weigl M. Effects of work conditions on provider mental well-
14 being and quality of care: a mixed-methods intervention study in the emergency department.
15 BMC Emerg Med. 2019;19(1):1. doi:10.1186/s12873-018-0218-x
16 69. Norman GR, Monteiro SD, Sherbino J, Ilgen JS, Schmidt HG, Mamede S. The Causes of
17 Errors in Clinical Reasoning: Cognitive Biases, Knowledge Deficits, and Dual Process Thinking.
18 Acad Med J Assoc Am Med Coll. 2017;92(1):23-30. doi:10.1097/ACM.0000000000001421
19
20
21
1 Figure legends:
Of note, metacognition is an important strategy to ward off all the listed biases, and as such is not listed in the
Table. In addition to the strategies listed, one should always look for red flags such as data that doesn’t fit, only
one diagnosis coming to mind etc., in those cases one should be stimulated to use inductive reason as explained
Suggested
Cognitive Bias Description/Definition Clinical examples De-biasing
Strategies
A patient presents with headache, neck
stiffness, and fever. The physician begins Explicitly
Overconfidence Tendency to be confident in
treatment for meningitis, and decides not to acknowledge
Bias one’s diagnosis/hypothesis
perform a lumbar puncture because the uncertainty
diagnosis is “classic”
A physician diagnoses a patient with
Consider alternative
Anchoring on a certain pneumonia, and continues to treat the patient
diagnoses; explicitly
Anchoring Bias aspect of case early in the for pneumonia despite accumulating evidence
acknowledge
work- up that the patient has acute pulmonary edema
uncertainty
from congestive heart failure.
A physician admitted three patients with acute
pancreatitis last week. Today, a patient is
Judging a diagnosis or
being admitted with abdominal pain, nausea, Taking
Availability hypothesis more likely if it
and vomiting, and the physician immediately accountability for
Bias quickly and easily comes to
begins to treat the patient for acute diagnoses
mind
pancreatitis while diagnostic studies are
pending.
A physician calls a surgery consult, stating “I
have a homeless patient here who comes in all
the time. This time, he says he has abdominal
pain and tenderness. He might be a little
Organizing a case in a tender on exam, but it’s not impressive. If you
Consider alternative
Framing Effect particular way to influence could come see him and confirm it’s OK to
diagnoses
the leading diagnosis discharge him, that would be great.” The
surgeon sees the patient quickly and does not
perform her usual thorough evaluation,
because the consult was framed in a manner
that was dismissive of the patient’s symptoms.
A patient presents with wheezing and
shortness of breath, and the physician
Finalizing a diagnosis diagnoses and starts treating the patient for an Consider alternative
Premature before one has all the data; acute COPD exacerbation. When the patient diagnoses; seek
Closure closing one’s mind to other subsequently develops a fever, the physician feedback on
possible diagnoses does not pursue further work-up because the diagnoses
physician has settled on the diagnosis of
COPD.
A patient is evaluated in clinic for shortness
of breath. She is diagnosed with pneumonia,
Failure to revisit diagnostic
Diagnostic and sent to the ED. In the ED, the patient is Consider alternative
labels once they are
Momentum treated for pneumonia, and no further diagnoses
attached to a patient
diagnostic evaluations are pursued. The
patient is admitted to the hospital, and
treatment for pneumonia is continued. After
three days of treatment without improvement,
a chest CTA is ordered and the patient is
found to have a large pulmonary embolism.
A patient presents with chest pain, and the
physician diagnoses him with GERD. The
Selectively searching for patient subsequently undergoes an ECG,
Confirmation evidence to confirm a demonstrating inferior ST depressions which Acknowledging
Bias diagnosis rather than refute the physician discounts as artifact. The patient uncertainty
it subsequently develops nausea and abdominal
discomfort, which the physician interprets as
confirmation of the diagnosis of GERD.
Table 2. One minute preceptor (adopted from Neher, et al).35