Professional Documents
Culture Documents
net/publication/276918512
CITATIONS READS
5 1,011
2 authors:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Teresa Man-Yee Chan on 20 May 2015.
C Modular
Assessment
Program
Available for usage under the Creative Commons Attribution-
NonCommercial-NoDerivs 3.0 Unported License.
ISBN: 978-0-9907948-3-7
i
DEDICATION
ii
About The McMAP Project
Background
iii
around an essential task of an EM physician. For Each instrument has two main parts. The first
example, providing discharge instructions to a part includes the assessment matrix for the spe-
patient incorporates Medical Expert, Communica- cific McMAP task assigned for the shift. The sec-
tor, and Collaborator competencies. However, to ond part includes a daily global performance as-
the frontline user, this background curriculum sessment that allows the faculty member to as-
blueprinting is invisible, improving usability. sess and provide feedback on overall perform-
ance during the shift. Mandatory narrative com-
Each instrument uses choice architecture to pro-
ments are required for both elements.
vide “just-in-time” faculty guidance. Specifically,
checklists that deconstruct a task into simpler In our experience, making the narrative com-
sub-elements and criterion-based behavioural ments mandatory serves two purposes. First, it
anchors (e.g. clinical descriptions of various stan- serves as a force-function to promote verbal feed-
dards of performance) for scoring performance back between resident and faculty at the comple-
guide faculty towards a shared mental model of tion of a shift. This is one of the main goals of
the expected standard. McMAP. Second, the qualitative data from the
narrative comments helps shape the end-of-
For more information on the development and de-
rotation report, providing nuance about the per-
sign of McMAP check out the innovation report
formance of a resident.
manuscript in Academic Medicine:
McMAP also includes an exceptional events re-
Chan, T., & Sherbino, J. (2015). The McMaster
porting system. (See Appendix A) Faculty mem-
Modular Assessment Program (McMAP): A Theo-
bers can anonymously submit, on an ad hoc ba-
retically Grounded Work-Based Assessment Sys-
sis, a standardized form documenting outlier be-
tem for an Emergency Medicine Residency Pro-
haviour. This data is received by an independ-
gram. Academic medicine: journal of the Asso-
ent party (e.g., the chair of the assessment sub-
ciation of American Medical Colleges.
committee of the residency training committee),
DOI:10.1097/ACM.0000000000000707
who then determines the response to this excep-
PMID:25881648
tional event.
iv
of the resident’s performance during the shift, If you would like further details on how to host
typically requires five minutes. McMAP on an electronic platform, please con-
tact us. We currently use a secure, free, cloud-
Our experience suggests that it is best to allow
based platform that allows residents and faculty
the resident and faculty member to negotiate at
to access their digital passports via mobile de-
the beginning of a shift the task to be addressed
vices or computers.
that day. Some tasks are harder to complete than
others because of the need for specific patient For any inquiries, please contact us at:
presentations (e.g. lead a resuscitation). While mcmapem@univmail.cis.mcmaster.ca.
McMAP has been designed to be flexible to the
- Teresa Chan & Jonathan Sherbino,
unpredictability of EM practice, faculty and learn-
Editors & Project Leads
ers should be opportunistic in choosing a
McMAP task.
Using McMAP
v
SENIOR RESIDENT
DAILY GLOBAL RATING
Authors: Editors:
Jonathan Sherbino
Alim Pardhan
Karen Schiff
Teresa Chan
What is the Daily Global Rating? across many skills, the daily task ratings better clarify
the microskills required of an emergency resident at
At the culmination of each shift, assessors (staff physi- this level. This offloads the need to do detailed obser-
cians) are meant to complete a global rating of the resi- vations every day, and allows us to harness the
dent’s overall performance during that shift. A copy of teacher’s ‘gestalt’ regarding resident performance.
the global rating scale is attached.
Other notes
How do I use this sheet?
Raters should be encouraged to use the whole spec-
Raters need only choose one score (i.e. a single num- trum of the score, however, many residents are rather
ber from 1 to 7), however, the descriptions are present high-functioning since they have already spent signifi-
to clarify the various aspects of the CanMEDS roles cant time in the Emergency Department (ED) during
that are expected at various levels. clerkship and electives.
Some raters may find it useful to use each listed crite- Based on historical trends, residents often begin
rion to isolate areas of weakness or strength for the around a 3 or 4 (out of 7) in the beginning of the year,
resident, but only ONE number is needed to represent and over the course of a few blocks progress to a 6 or
1
the resident’s overall progress each day. 7 (out of 7).
Any of the following apply to the Most of the following apply to the Generally, the Senior Resident displays
Senior Resident: Senior Resident: mostly ALL of the below:
• Displays major areas of knowledge • Functioning proficiently and • Functioning proficiently and efficiently
in the ED environment (culture,
! deficit.*
! colleague(s).*
! rapport).
• Role models exceptional professional
! behaviour.*
• Cannot remedy knowledge gaps at
!
• Is consistently professional.
• Skilled at reflective practice and
*MUST comment below or flag this through the exceptional events system
COMMENTS/ CONCERNS/FEEDBACK
7
SENIOR MODULES
LEADERSHIP & TEAM MANAGEMENT
Authors: Editors:
ASSESSMENT INDEX
Prepares Learner - Determines if procedure is appropriate for learner; Orients, explains or reviews
procedure or key aspects of the approach to the LEARNER (including indications, risks, benefits,
complications)
Role Models or Ensures use of PPE - Uses and/or facilitates the use proper personal protective
equipment by all parties (e.g. safe practices by learner)
Ensures Safe Practices & Proper Procedural Technique - Watches for proper use of procedural
equipment; Ensures DISPOSAL of sharps; Uses SAFETY CHECKLIST if appropriate (e.g. central line
checklist)
Identifies when (and if) to step in / take over procedure from junior - Watches for difficulty,
complications, and/or impending problems and asks junior to step aside safely.
Ensures appropriate Aftercare instructions (including handouts) are provided to patient May delegate
this task to the junior, but MUST REVIEW with junior and be available to make clarifications
Debriefs & Provides Feedback after procedure - Provides constructive feedback (including suggestions
for ‘next steps’) and reviews any difficulties or suggestions after procedure
RATE THIS TASK | SELECT THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
1 7
Needs assistance 2 3 4 5 6 Independent Practice
Displays any of the following: • Does not clarify procedure nor • Prepares learner adequately • Prepares learner adequately
prepare junior learner (i.e. sets up (e.g. describes general • Stops junior resident if safety breach
• Puts patient at risk junior to fail) approach to the learner) occurs or is about to occur
• Observes learner completely • Proper attention to safety of patient,
• Does not allow Junior to attempt any • Does the bulk of the procedure (not • Needs a few reminders to let the learners, and self.
part of the procedure allowing junior to participate) junior attempt procedure
• Consistently accurate, proper Either:
• Fails to explain any aspect of the • Incompletely describes the attention to safety. 1) Explains if and why they need to
procedure to learner procedure to observing learner • Attempts to safely prompt or “take over” during the procedure &
assist junior during procedure then seemlessly explains while
• Awkward when supervising the (e.g. doesn’t just take over) performing the task. or
procedure • May or may not conduct debrief 2) Facilitates successful procedure.
of procedure with learner.
• Conducts debrief and reaffirms key
take home points with learner after
procedure.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the
above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
9
ME3.2 | Supervising Procedures - LEARNER FEEDBACK FORM
Instructions to the Attending: Please give this page to the Learner who is being taught and ask them to complete it.
They do not need to actually provide a score. Please record any feedback from this sheet into the online form as you
see fit.
The resident was able to explain all steps of the procedure to me (this can
be done before, during, or after the procedure)
The resident involved me or taught me about the documentation and orders
around this procedure.
The best thing the resident did while teaching me this procedure was…
What is one change that the Senior Resident could make? (Your feedback is very valuable!)
Please return this to the FACULTY MEMBER who was observing this procedure. The junior is NOT expected to
rate the SENIOR RESIDENT.
10
RESIDENT ______________ Name of Assessor_________________ Date:_________
THE ATTENDING SHOULD BRIEFLY QUIZ THE RESIDENT ABOUT PERTINENT DETAILS TO DE-
TERMINE HOW MUCH THEY RETAINED FROM THE ENCOUNTER (see items below)
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1 Independent Practice
2 3 4 5 6
Needs assistance
Resident displays any of the • Listens to handover, but • Actively listens and/or elicits Resident displays all of the
following or similar behaviours: does not elicit or recall key most of the key information following or similar behaviours:
information (e.g. vital signs, (e.g. vital signs, interventions
• Does not listen to paramedics interventions performed, performed, medications • Actively listens and/or elicits the
or elicit handover medications administered)* administered)* key information (e.g. abnormal
vital signs, interventions
• Unable to incorporate • Asks questions about • Recalls and DOCUMENTS performed, medications
paramedic information into information that was already all information from administered)*
initial patient assessment discussed by the paramedics
paramedics (e.g. displays • Recalls, ACTS UPON and
• Does not clarify points of inattention). • Ensures transition of DOCUMENTS all information
uncertainty prior to paramedic ongoing patient care (e.g. from paramedics
departure • Ensures transition of chest compressions,
ongoing patient care (e.g. assisted ventilation) but it • Ensures A SMOOTH transition
• Does not monitor for ongoing chest compressions, may be SLIGHTLY of ongoing patient care (e.g.
patient care (e.g. chest assisted ventilation) but this AWKWARD (e.g. very slight chest compressions, assisted
compressions, assisted process is VERY AWKWARD delay) ventilation)
ventilation) (e.g. periodic delay or • Does not delay handover or
halting) resuscitation
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another faculty
member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
11
RESIDENT ______________ Name of Assessor_________________ Date:_________
Works with charge nurse or other staff to free up resuscitation or assessment space (e.g.
considers which patients can be removed from cardiac monitors or out of resuscitation
spaces; considers non-ED resources)
EXAMPLE: Helps to make room for in-coming patient after receiving EMS Patch
Works with nurses or other staff in one area to facilitate flow (e.g. considers which patients
can wait in a non-assessment space to wait for investigations, consultations,
reassessments)
Integrates learners and other team members to facilitate flow and assessments
(e.g. considers how to efficiently see patients taking into account other learners and their
learning needs)
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1 Ready for
2 3 4 5 6
Needs assistance Independent Practice
Resident displays any of the • Uses a few strategies to • Uses several strategies to Resident displays any of the
following or similar behaviours: improve flow during shift, but improve flow during shift following or similar behaviours:
NEEDS CONSIDERABLE considering patient safety at all
• Relies on charge nurse or other ASSISTANCE and times. • Works proactively with other
staff exclusively (including the PROMPTING from attending staff to anticipate problems (e.g.
attending) to make all decisions physician • MAINTAINS CONSTANT regularly converses with Charge
on flow, even when it negatively COMMUNICATION with nursing Nurse to reassess bed situation)
affects patient care • DOES NOT MAINTAIN OPEN and administrative staff
COMMUNICATION with throughout shift. • Works with staff to solve
• Unable to formulate or execute nursing and administrative problems with available space
plan staff throughout the shift • ACTIVELY IDENTIFIES problems and prolonged wait times
and REQUESTS assistance from considering patient safety.
attending when necessary (e.g.
calling site chief; activating ED • ACTIVELY IDENTIFIES and
crowding protocols.) SOLVES PROBLEMS
independently (only reviewing
briefly with attending to keep
them up to date).
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence,
please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
12
RESIDENT ______________ Name of Assessor_________________ Date:_________
L3.7 | Time Management & Task Switching (“Multitasking”)
Instructions to Attending:
The senior resident should be taking on additional tasks beyond just seeing his/her own portfolio of pa-
tients (e.g. should be reviewing cases or managing administrative duties too). The attending will need to
observe the resident throughout the shift, bearing in mind the way he/she tends to do the following tasks:
1) switch between tasks (a.k.a. task-switch or multi-task);
2) handle interruptions;
3) delegate tasks;
4) juggle between new patients and reassessments.
Please also note any other behaviours that may impede or enhance the efficiency of the senior resident.
Note: Senior residents may not begin to achieve this competency until very late in residency and/or during
the first few months as a staff physician.
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1
2 3 4 5 6 Ready for
Needs assistance
Independent Practice
Resident displays any of the • Becomes highly focused • Functions independently as a Resident displays all of the following or
following or similar behaviours: on his/her patients only practitioner in managing his/her similar behaviours:
(e.g. loses situational own patients.
• Needs constant reminders to awareness, especially • Flow conscious with both his/her
reassess patients when handling critical • Maintains situational portfolio of patients AND the patients
patients) awareness, and recognizes under the care of his/her delegates.
• Inefficient with time in the limits (e.g. asks for help from
department • Needs a few reminders attending when reaching his/ • Maintains situational awareness
about patients her limits) throughout shift, even with critical
• Unable to delegate tasks patients.
appropriately (or fails to step in • Usually spontaneously • Consistently reassesses
when required) returns to reassess patients independently, but may • Efficiently sees multiple patients,
patients be slower than an attending juggling multiple critically ill patients at
• sees minimal number of patients once arriving at diagnosis and
during shift (i.e. is not able to • Infrequent delegation of • Able to delegate tasks, but may disposition plans in time-efficient
attend to minor care area tasks (or steps in to help fail to follow-up with junior manner
patients) with tasks only when learner when dispositioning or
suggested by attending) reassessing patients (e.g. refers • Remembers learners - discusses
• Is unprofessional with colleagues learner’s patient to medicine diagnosis and disposition plans
when interrupted (e.g. Becomes • When INTERRUPTED: without consulting the learner) together with junior learners
angry or annoyed at interruptions) Remains professional with
colleagues, but seems • When INTERRUPTED: Remains • Delegates appropriately and follows-
flustered or disorganized professional with colleagues, up in a timely fashion (incorporating
after the interruption but takes some time to regain learners into work flow)
his/her train of thought from
before the interruption (e.g. • When INTERRUPTED: Remains
continue reviewing, resuming professional with colleagues,
patient care) seamlessly resumes patient care or
teaching tasks from before the
interruption (i.e. goes right back to
teaching after a phone call from
radiology)
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another faculty
member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
13
RESIDENT ______________ Name of Assessor_________________ Date:_________
AT THE END OF SHIFT: The staff preceptor should elicit and incorporate feedback from the junior learner about the senior’s
performance.
NB: This is different from the Teaching & Scholarship block task, they were not required to balance patient care duties with
reviewing/supervising residents.
DONE BUT
N/A FOR
CHECKLIST DONE NEEDS NOT DONE
CASE
ATTENTION
Checks in / keeps track of the learner (e.g. time spent assessing patients, need for learner to complete patient
reassessments, time spent waiting to review patients, number of patients seen in shift)
Junior learner saw an appropriate number of patients during the shift (e.g. ~1-1.5 patients per hour)
Senior Resident saw an appropriate number of patients during the shift (e.g. around 2 patients per hour -
including learner’s patients)
Senior Resident provided education or teaching around each case (i.e at least on teaching point)
Senior Resident provided feedback on one or more CanMEDS Roles by the END OF THE SHIFT
Senior Resident provided constructive formative feedback during the shift and documents this on relevant
system (e.g. completes McMAP or end-of-shift evaluation for junior learner)
RATE THIS TASK | CIRCLE ONE THAT THAT BEST DESCRIBES PROFICIENCY LEVEL
1 7
2 3 4 5 6
Needs assistance Ready for Independent Practice
Resident displays any of the • Provides some learning • Balances educational needs Resident displays all of the
following or similar behaviours: experiences but struggles to of the junior learner with following or similar behaviours:
balance between managing own managing patient care
• Unable to supervise WHILE patients and the learning needs of • Balances educational needs with
managing patients the junior learner • May have some difficulty managing patients with finesse
with efficiency (e.g. number and ease
• Is condescending or • Does not always bear in mind the of patients seen or time for
neglectful of the junior junior learner’s role in the care of reassessments) • Requires no additional
learner the patient (e.g. discharges patients prompting
behind the junior’s back, forgets to • Provides specific feedback,
• Neglects patient safety call the to a resuscitation, ‘steals but is non-specific in • Provides specific, actionable
procedures’) suggestions for improvement feedback (e.g. next time, why
• Displays poor insight or • Requires (and requests) assistance (e.g. Read more) don’t you attempt…)
judgement (e.g. Does not by attending to manage patient
recognize own limits) and care and provide good supervision.
does not ask for help.
• Provides generic, non-specific
feedback (e.g. Good job!)
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another
faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
14
RESIDENT ______________ Name of Assessor_________________ Date:_________
ME3.1 | Team Leader Feedback
Today’s focus is Leading a Team.
Perform the role of Team Leader for a critically ill / injured patient and receive some preceptored multi-source feedback
from staff physicians, residents, nurses, and other allied team.
Note: Staff physician will need to gather feedback about the resident’s performance from other team members. This is ide-
ally accomplished immediately after a resuscitation. The staff physician can record the feedback numerically or by check
boxes directly into the checklist below.
COMMUNICATION - Plans and priorities clearly communicated; Tasks and orders easily understood
with clear direction
Ensures examination and assessment are clearly communicated to scribe/recorder & the rest of the
team
Maintains overall perspective (e.g. situational awareness) and avoids fixation error or diagnostic
momentum (esp. if patient deteriorates)
FEEDBACK FROM TEAM (Record at least one piece of feedback; may be GOOD or CONSTRUCTIVE)
RATE THIS TASK | SELECT THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for the next level
Needs assistance
Resident displays any of the Resident displays any of the following or Resident displays any of the following Resident displays any of the following or
following or similar behaviours: similar behaviours: or similar behaviours: similar behaviours:
• Several (>3) of the checklist items
were not done • Several (>3) of the checklist items • Most items were done; few (i.e. < 3 • Almost all items in checklist
need attention items) needed attention completed
• Resident did not have the
confidence of the staff members • Staff members were uncomfortable • Staff members seemed comfortable • Resident had complete control of the
during the resuscitation during the resuscitation (e.g. actively during the resuscitation (e.g. only room throughout the resuscitation
disagreed with management, and SOMETIMES looked to the
• Staff physician is compelled to sought attending’s opinion before attending for affirmation) • The attending did not need to be
take over the resuscitation proceeding) present
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another faculty
member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
15
RESIDENT ______________ Name of Assessor_____________ Date:_________
Example situations:
- consultant resident will not attend and see a patient, or is refusing to arrange a certain test (e.g.
CT-scan)
- delay in processing an urgent order
- consultant resident attempts to complete procedure with inadequate sedation and nurses are
alarmed
- Code White
Or other scenarios as deemed appropriate by resident or staff physician.
RATE THIS TASK | CIRCLE THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
7
1 Ready for the next level
2 3 4 5 6
Needs assistance
Resident displays any of the following or • Courteous and respectful to other Resident displays all of the following or
similar behaviours: parties but seemed awkward/ similar behaviours:
uncomfortable at times in the
• Unprofessional (e.g. loses temper, situation. • Courteous, respectful, calm &
engages in shouting match) approachable
• Answers patient or colleague(s)’s • Solicits and empathetically listens to
• Conflict Escalated Questions patient or colleague(s)’s perspectives
on the problem
• Did not convey relevant and/or crucial • Asks some questions to better
information (urgency, importance) understand the problem from the • Solicits and answers patient or
other person’s perspective colleague(s)’s questions
• Resident unwilling to compromise to
achieve best outcome for patient • Eventually arrived at a plan that was • Seems comfortable in the situation,
amenable to all parities or required and also puts others at ease
minor concessions be made by one
or more parties • Arrived at a plan that was amenable to
all parties
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another faculty
member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
16
RESIDENT ______________ Name of Assessor_____________ Date:_________
For the purposes of the handover to the EP, the resident should prepare one patient near the end of the shift to discuss
as a handover to the incoming attending. If the timing is not optimal, this may be a simulated handover of a patient to
the supervising attending physician (e.g. resident “hands-over” the a patient at the end of their shift to their attending
prior to going home.)
B Background – succinctly summarizes the relevant findings and labs gathered to date.
R Recommendation(s) – provides a plan for the in-coming team regarding patient care or further decision making.
(e.g. “If the CT is negative, then the plan is…”)
Notes handover on chart and completes adjunctive paperwork (e.g. out-patient referrals, Rx, patient instructions)
Explains handover process to patients and explains which doctor is assuming care
RATE THIS TASK | CIRCLE ONE THAT THAT BEST DESCRIBES PROFICIENCY LEVEL
7
1
2 3 4 5 6 Ready for
Needs assistance
Independent Practice
Any of the following: • Courteous and collegial • Hands over own patients well. • Courteous and collegial
• Unprofessional • Inefficient with time. • Courteous and collegial • Is able to give an overview of the entire
• Confusing to Consultant Colleague’s questions • Concise & Time Efficient. department
Colleague were answered. • Built a good rapport. • Able to answer questions about the
• Did not convey relevant • Eventually, arrived at a • Answered questions from plans for both his/her own patients,
and/or crucial information plan that was amenable colleague receiving handover. but also those of learners
(i.e. urgency, important to all parties. • Role models to learners the handover
• Arrived at a plan that was
management) • Does not discuss plan amenable to all parties easily. process.
• Was unwilling to with the patient. • Anticipates and answers all questions
• May or may not discuss plan
compromise with the patient. from
• Conflict arose and • Prepares all adjunctive materials to
escalated facilitate the care of the patient beyond
• Does not discuss plan with his/her time
the patient. • Attuned to potential cognitive errors
[Croskerry]
• Discusses handover with the patient.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another
faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
17
Name of Assessor_________________ Date:_________ PRECEPTOR SHIFT #____
If this reporting occurs with a case where the Senior Resident is supervising, they should be ready to teach around the
relevant policies and legislation. They should discuss with the learner the mechanisms and processes for reporting,
and also any potential pitfalls or barriers for reporting.
RATE THIS TASK | CIRCLE ONE THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6
Needs assistance Ready for the next level
• Incomplete preparation or unable to • Familiar with majority of policies and requirements, as well as the • Well versed with common policies/legislation, as
identify even 1 example patient relevant forms well as the relevant forms
• Unable to apply CPSO policy • Unfamiliar with specific details in policy or law • Able to recognize and apply to patients including
• Able to apply policy to common or frequently discussed situations rare and complicated situations
(e.g. MTO form)
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another
faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next
shift.
REFERENCES: Review CPSO Policy #6-12 - reference materials on Mandatory and Permissive Reporting
(https://www.cpso.on.ca/policies/policies/default.aspx?id=1860)
Also consider reviewing materials on: Child Abuse, Elder Abuse; Potential violence reporting; or other reportable
conditions.
18
RESIDENT ______________ Name of Assessor_________________ Date:_________
Example situations:
- identified a “near miss” and filled out the relevant reporting documentation
- assisted in a resuscitation at the request of a colleague (e.g. when asked by Nurse or Senior Medical Resident)
- identifies and assists with a scenario involving an admitted patient warranting intervention by emergency physi-
cian
Or other scenarios as deemed appropriate by resident or staff physician.
RATE THIS TASK | CIRCLE THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for the next level
Needs assistance
Resident displays any of the following or similar • Courteous and respectful to other parties but Resident displays all of the following or similar
behaviours: seemed awkward/uncomfortable at times in the behaviours:
situation.
• Unprofessional (e.g. loses temper, engages in • Respectful, calm & approachable
shouting match) • Provided timely and useful assistance in solving
the problem at hand • Expeditiously fact finds, soliciting perspectives from
• Conflict arose all relevant parties on the problem at hand
• Answers patient or colleague(s)’s Questions
• Did not convey relevant and/or crucial information • Provides an expert assessment and plan to solve
(urgency, importance) • Asks some questions to better understand the the problem a
problem from all relevant perspectives
• Resident unwilling to compromise to achieve best • Seems comfortable in the situation, and also puts
outcome for patient • Eventually arrived at a plan that was amenable to others at ease
all parities or required minor concessions be
made by one or more parties • Arrived at a plan that was amenable to all parties
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence,
please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
19
SENIOR MODULES
COMMUNICATION & COORDINATION
Authors: Editors:
ASSESSMENT INDEX
3
Breaking Bad News Advanced Chart Audit
Introduces self in a polite manner with all pertinent identifiers (Name, Rank, BHP #)
Introduce self in a receptive, collegial manner and offer assistance
Clarifies information
a) Clarify information
b) Acknowledge message received
Provides advice (or orders to paramedics) or education without condescension (as needed)
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1 Ready for
2 3 4 5 6
Needs assistance Independent Practice
CL3.1 The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to
ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her
next shift.
References
Kessler, C. S., Chan, T., Loeb, J. M., & Malka, S. T. (2013). I’m clear, you’re clear, we’re all clear: Improving consultation communication skills in
undergraduate medical education. Academic Medicine, 88(6), 753-758.
Apker, J., Mallak, LA & Gibson, SC (2007). Communicating in the “grey zone”: percpeptions about emergency physician hospitalist
handoffs and patient safety. Academic Emergency Medicine, 14(10). 884-89 21
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
Made connection [sitting position, eye contact, appropriate touch, used names]
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1 Ready for
2 3 4 5 6
Needs assistance Independent Practice
• Used medical language exclusively • Did not refer to patient (or • Prepared for interview (reflects on delivery
family members) by name and personal emotional state)
• Inappropriate setting (e.g. non-private) • Used patient (or family member) names
• Used some medical jargon seamlessly
• Uses plain language
• Poor explanation of situation
• Appeared uncomfortable or • Quiet private setting with all important
distracted and desired parties presented
• Did not address emotional needs • seated, attempted to make a connection
• Unable to answer all questions • Appeared comfortable
• Did not invite questions • Comforted patient or family
• Answered questions with ease
• Provided next steps
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure
another faculty member can quickly understand your rationale for the above score. Add enough details to ensure another faculty member can
quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence, please give one specific suggestion
(Education Prescription) for the resident to attempt during his/her next shift.
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her
next shift.
References
Back et al 2007 Breaking Bad News
Baile et al 2000 SPIKES—A Six-Step Protocol for Delivering Bad News: Application to the Patient with Cancer [PMID: 10964998]
Benenson et al 2003 Evaluation of Emergency Medicine Resident Death Notification Skills by Direct Observation
Sobczak 2013 The procedure for death notification — ”In Person, In Time…” Ann Int Ther [PMID: 24407903]
22
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
Instructions to Attending:
Focus is on observing the trainee debriefing after a critical incident [defined as as a case that has the
potential to cause significant psychologic distress [e.g. major trauma, unsuccessful resuscitation]
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1
2 3 4 5 6 Ready for
Needs assistance
Independent Practice
P3.5 The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure
another faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next
shift.
Reference: Everly, G. S., & Boyle, S. H. (1999). Critical incident stress debriefing (CISD): A meta-analysis. International Journal of
Emergency Mental Health, 3, 165–168. PMID 23586171
23
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
For the purposes of the handover to the EP, the resident should prepare one patient near the end of the shift to discuss as
a handover to the incoming attending. If the timing is not optimal, this may be a simulated handover of a patient to the
supervising attending physician (e.g. resident “hands-over” the a patient at the end of their shift to their attending prior to
going home.)
B Background – succinctly summarizes the relevant findings and labs gathered to date.
R Recommendation(s) – provides a plan for the in-coming team regarding patient care or further
decision making.
(e.g. “If the CT is negative, then the plan is…”)
Notes handover on chart and completes adjunctive paperwork (e.g. out-patient referrals, Rx, patient
instructions)
Explains handover process to patients and explains which doctor is assuming care
Raises alert for any situations that may warrant attention (i.e. patient who may pass away)
RATE THIS TASK | CIRCLE ONE THAT THAT BEST DESCRIBES PROFICIENCY LEVEL
7
1
2 3 4 5 6 Ready for
Needs assistance
Independent Practice
Any of the following: • Courteous and collegial • Hands over own patients well. • Courteous and collegial
• Unprofessional • Inefficient with time. • Courteous and collegial • Is able to give an overview of the entire
• Confusing to Consultant Colleague’s questions were • Concise & Time Efficient. department
Colleague answered. • Able to answer questions about the plans for
• Built a good rapport.
• Did not convey relevant and/or • Eventually, arrived at a plan both his/her own patients, but also those of
• Answered questions from colleague
crucial information (i.e. urgency, that was amenable to all learners
receiving handover.
important management) parties. • Role models to learners the handover
• Arrived at a plan that was amenable
• Was unwilling to compromise • Does not discuss plan with process.
to all parties easily.
• Conflict arose and escalated the patient. • Anticipates and answers all questions from
• May or may not discuss plan with
• Does not discuss plan with the the patient. • Prepares all adjunctive materials to facilitate
patient. the care of the patient beyond his/her time
• Attuned to potential cognitive errors
[Croskerry]
• Discusses handover with the patient.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to
ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during
his/her next shift.
24
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
The senior resident should participate in RECEIVING handover from colleagues. The optimal shift for this will be the be-
ginning of a morning shift.
Asks relevant and pertinent questions required to complete the patient care tasks
Introduces self to patient - confirming the anticipated plan and next steps (e.g.
anticipated wait for bloodwork, ultrasound etc..)
Charting - Makes formal note on chart about receiving handover
RATE THIS TASK | CIRCLE ONE THAT THAT BEST DESCRIBES PROFICIENCY LEVEL
1 7
2 3 4 5 6
Needs assistance Ready for Independent Practice
Any of the following: • Courteous and collegial • Courteous and collegial • Courteous and collegial
• Unprofessional • Inefficient with time. • Concise & Time Efficient. • Asked relevant questions from
• Confusing to Consultant Colleague’s questions were • Built a good rapport with colleague providing handover.
Colleague answered. colleague. • Fulfills all adjunctive tasks required by
• Was unwilling to compromise • Eventually, arrived at a plan • Asked relevant questions from colleague that is leaving
• Conflict arose and escalated that was amenable to all colleague providing handover. • Attuned to potential cognitive errors
parties. • Arrived at a plan that was [croskerry]
• Does not discuss plan with
the patient. • Does not discuss plan with the amenable to all parties easily. • Participates in discussions when
patient. • Participates in discussion, but may warranted; providing suggestions
seem terse or awkward when without condescension.
providing suggestions • Discusses plan with the patient.
• Discusses plan with the patient.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another faculty member
can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
25
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
Q Questions - Clear Clinical Question; Also is prepared to answer questions to facilitate seamless transition of
care (e.g. choice of anti-platelet therapy)
E Educational modifications - makes necessary educational modifications, taking into account the level of
training of consulting resident when appropriate
D Debriefing & discussion (if possible): Dngages in a debriefing or discussion with the consultant to learn more
about the case
Notes consultation on chart and completes adjunctive paperwork (e.g. out-patient referrals, Rx, patient instructions)
RATE THIS TASK | CIRCLE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for the next level
Needs assistance
Resident displayed any of the below: Resident’s actions are described by most of the Resident displays all of the below:
• Unprofessional below: • Courteous and Collegial
• Confusing to Consultant Colleague • Courteous and Collegial • Clear and concise
• Did not convey relevant and/or crucial information • Colleague’s questions were answered. • Built a good rapport.
(i.e. urgency, important management) • Eventually, arrived at a plan that was • Answered questions from consulted colleague.
• Was unwilling to compromise amenable to all parties.
• Arrived at a plan that was amenable to all parties
• Conflict arose and escalated easily.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another
faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
Reference: Chan, T., Orlich, D., Kulasegaram, K., & Sherbino, J. (2013). Understanding communication between emergency and consulting physicians: a
qualitative study that describes and defines the essential elements of the emergency department consultation-referral process for the junior learner.
CJEM, 15(1), 42-51. PMID: 23283122
26
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
CM 3.1 | Advanced Chart Audit
Today’s focus is on charting.
The attending physician should select TWO charts to audit (OPTIMALLY, ONE SHOULD BE ON A CRITICALLY ILL PA-
TIENT). Should take 5-6 minutes to complete. Please select ONE chart where the resident primarily assessed the patient
by him/herself (e.g. sicker patient); and then one where he/she was reviewing with a junior learner. BOTH charts should
contain all relevant points below.
HINT: If a patient is about to be taken to ICU, either the resident or attending should attempt to photocopy this chart for
the purposes of the chart audit. PLEASE ENSURE ANY COPIES ARE DISPOSED OF AFTER THE AUDIT.
CHART 1 CHART 2
CHECKLIST
DONE BUT NEEDS NOT DONE BUT NEEDS
DONE DONE NOT DONE
ATTENTION DONE ATTENTION
Information relevant
How wellto did
CC and
theHPI recordedperform
resident this task?
Physical Examination - relevant systems
Documents procedures e.g. type of closure, suture type, anesthetic - type and dose
RATE THIS TASK | CIRCLE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 2 3 4 5 6 7
Needs Assistance Requires significant charting by Requires minimal charting by Ready for Independent Practice
Requires extensive charting by attending to rectify charting. attending to clarify charting. Attending documents no additional
attending to compensate for or further information that is not
missing items. already contained in the chart.
Resident’s chart is described • Charting fails to provide a • Charting provides a Resident’s chart is described by
by ANY of the below: thorough narrative of the patient- complete narrative of the ALL of the below:
• Charting is incomplete and doctor encounter in the ED but patient-doctor encounter • Charting provides a thorough
missing key items (noted still incorporates all important in the ED. narrative of the patient-doctor
above). elements. • Confusing, but still is able encounter in the ED.
• Chart fails to provide a • Chart fails to provide a synthesis to convey the overall • Chart provides a succinct and
synthesis of the resident’s of the resident’s decision-making thinking process to nuanced synthesis that fully
decision-making and & thinking process. external reader. explains the resident’s decision-
thinking process. • Hard to read. • Efficient, legible making & thinking process.
• Inefficient/verbose, illegible documentation. • Efficient, legible documentation.
or incoherent
documentation.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another
faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next
shift.
27
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
RATE THIS TASK | CIRCLE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
Needs Assistance Ready for
2 3 4 5 6 Independent Practice
Resident displays any of the below: Resident displays some of the below: Resident displays ALL of the below:
• Disruptive • Professional • Professional
• Confusing to healthcare professional • Inefficient with time. • Time Efficient
• Was unwilling to compromise • Healthcare professional’s questions were • Answered questions from allied health care member;
• Conflict arose and escalated incompletely answered. acting as a resource when called up
• terse, hierarchical and one-sided • Arrived at a plan that required flexibility from • Provides clarification or education if knowledge gap
healthcare professional identified by either party
• Arrived at a plan that was easily amenable to all
parties.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another
faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
28
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
The patient may or may not be in extremis. If the patient is not competent or unstable, the resident should arrange to
discuss these matters with the appropriate substitute decision maker. The patient may be a stable patient who is be-
ing admitted to an in-patient service.
**NOTE**: If the situation warrants an expedited timeline (e.g. impending urgent airway intervention), please select N/
Ensures the pertinent participants in the discussion (i.e. relevant substitute decision makers;
patient; family)
Prepares participants for discussion; forecasts the topic; describes the goal of the talk, asks
permission **MAY NOT BE RELEVANT IN EMERGENT CASE**
Establishes the best possible environment - Select the right setting; Sits down if able; Provides
appropriate privacy within available resources. **MAY NOT BE RELEVANT IN EMERGENT
CASE**
RATE THIS TASK | CIRCLE ONE THAT THAT BEST DESCRIBES PROFICIENCY LEVEL
7
1 Ready for
2 3 4 5 6
Needs assistance Independent Practice
• Seems rushed or uncomfortable • Builds appropriate rapport and • Builds appropriate rapport and • Puts participants at ease.
• Poorly prepared for the demonstrates demonstrates • No requirement for attending
discussion. • Provides all options, but requires • Provides all options, and physician to participate.
• Required attending physician to moderate clarification for requires little clarification for • Identifies the limits of the
halt or redirect conversation. participants to understand plan participants to understand plan. discussion (e.g. reaches a
• Moderate role of attending • Minor role of attending conclusion or a neutral
physician to steer the course and physician clarify/affirm the plan decision point that may be
guide decision making. for implementation. decided later)
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another
faculty member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next
shift.
29
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
RESIDENT: Record the Area of Improvement Discussed (i.e. topic of specific feedback).
RATE THIS TASK | SELECT THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for Independent Practice
Needs assistance
Any of the following: • Identifies vague problem • Identifies specific problem • Identifies specific problem in
• Provides confusing or concert with the junior learner
contradictory feedback • Provides vague, non- • Provides at least one specific
specific one-way feedback feedback pieces of feedback • Empathetically listens to Junior’s
• Identifies a vague, non- (e.g. only suggests that the learner can act upon perspective on the problem
specific problem with no solutions, not interested in (encourages reflective practice)
suggested solution what junior feels/observes) • Does not involve junior
learner in developing a plan • Invites the junior learner to co-
• Provides feedback in a • Awkwardly and/or for change develop a plan for change
derogatory or shame-based paternalistically addresses
manner junior • Creates proper environment • Seems comfortable in the
for giving feedback situation, and also puts the junior
• Violates the privacy of the • Discusses feedback in at ease
junior learner (i.e. pries too front of other learners
much into their personal life; • Respects the privacy of the junior
discusses feedback in front learner (e.g. finds a private place to
of other learners) discuss; attending excepted)
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the
above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
30
RESIDENT ______________ Name of Assessor_________________ Date:_________
ME3.1 | Team Leader Feedback
Today’s focus is Leading a Team.
Perform the role of Team Leader for a critically ill / injured patient and receive some preceptored multi-source feedback from
staff physicians, residents, nurses, and other allied team.
Note: Staff physician will need to gather feedback about the resident’s performance from other team members. This is ideally
accomplished immediately after a resuscitation. The staff physician can record the feedback numerically or by check boxes
directly into the checklist below.
COMMUNICATION - Plans and priorities clearly communicated; Tasks and orders easily understood
with clear direction
Ensures examination and assessment are clearly communicated to scribe/recorder & the rest of the
team
Maintains overall perspective (e.g. situational awareness) and avoids fixation error or diagnostic
momentum (esp. if patient deteriorates)
FEEDBACK FROM TEAM (Record at least one piece of feedback; may be GOOD or CONSTRUCTIVE)
RATE THIS TASK | SELECT THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for the next level
Needs assistance
Resident displays any of the Resident displays any of the following or Resident displays any of the following Resident displays any of the following or
following or similar behaviours: similar behaviours: or similar behaviours: similar behaviours:
• Several (>3) of the checklist items
were not done • Several (>3) of the checklist items • Most items were done; few (i.e. < 3 • Almost all items in checklist
need attention items) needed attention completed
• Resident did not have the
confidence of the staff members • Staff members were uncomfortable • Staff members seemed comfortable • Resident had complete control of the
during the resuscitation during the resuscitation (e.g. actively during the resuscitation (e.g. only room throughout the resuscitation
disagreed with management, and SOMETIMES looked to the
• Staff physician is compelled to sought attending’s opinion before attending for affirmation) • The attending did not need to be
take over the resuscitation proceeding) present
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another faculty
member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
31
SENIOR MODULES
TEACHING AND SCHOLARSHIP
Authors: Editors:
ASSESSMENT INDEX
4
Supervising Procedures (LEARNER CARD) Feedback & Coaching
Prepares Learner - Determines if procedure is appropriate for learner; Orients, explains or reviews
procedure or key aspects of the approach to the LEARNER (including indications, risks, benefits,
complications)
Role Models or Ensures use of PPE - Uses and/or facilitates the use proper personal protective
equipment by all parties (e.g. safe practices by learner)
Ensures Safe Practices & Proper Procedural Technique - Watches for proper use of procedural
equipment; Ensures DISPOSAL of sharps; Uses SAFETY CHECKLIST if appropriate (e.g. central line
checklist)
Identifies when (and if) to step in / take over procedure from junior - Watches for difficulty,
complications, and/or impending problems and asks junior to step aside safely.
Ensures appropriate Aftercare instructions (including handouts) are provided to patient May delegate
this task to the junior, but MUST REVIEW with junior and be available to make clarifications
Debriefs & Provides Feedback after procedure - Provides constructive feedback (including suggestions
for ‘next steps’) and reviews any difficulties or suggestions after procedure
RATE THIS TASK | SELECT THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
1 7
Needs assistance 2 3 4 5 6 Independent Practice
Displays any of the following: • Does not clarify procedure nor • Prepares learner adequately • Prepares learner adequately
prepare junior learner (i.e. sets up (e.g. describes general • Stops junior resident if safety breach
• Puts patient at risk junior to fail) approach to the learner) occurs or is about to occur
• Observes learner completely • Proper attention to safety of patient,
• Does not allow Junior to attempt any • Does the bulk of the procedure (not • Needs a few reminders to let the learners, and self.
part of the procedure allowing junior to participate) junior attempt procedure
• Consistently accurate, proper Either:
• Fails to explain any aspect of the • Incompletely describes the attention to safety. 1) Explains if and why they need to
procedure to learner procedure to observing learner • Attempts to safely prompt or “take over” during the procedure &
assist junior during procedure then seemlessly explains while
• Awkward when supervising the (e.g. doesn’t just take over) performing the task. or
procedure • May or may not conduct debrief 2) Facilitates successful procedure.
of procedure with learner.
• Conducts debrief and reaffirms key
take home points with learner after
procedure.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the
above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
33
ME3.2 | Supervising Procedures - LEARNER FEEDBACK FORM
Instructions to the Attending: Please give this page to the Learner who is being taught and ask them to complete it.
They do not need to actually provide a score. Please record any feedback from this sheet into the online form as you
see fit.
The resident was able to explain all steps of the procedure to me (this can
be done before, during, or after the procedure)
The resident involved me or taught me about the documentation and orders
around this procedure.
The best thing the resident did while teaching me this procedure was…
What is one change that the Senior Resident could make? (Your feedback is very valuable!)
Please return this to the FACULTY MEMBER who was observing this procedure. The junior is NOT expected to
rate the SENIOR RESIDENT.
34
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
The Senior Resident discussed ONE KEY POINT, providing evidence where
appropriate and relevant.
The Senior Resident diagnosed the learner(s)’s knowledge of the topic
The Senior Resident organized the topic within the junior learner’s experience
(e.g. connected the topic to prior knowledge)
The Senior Resident used visual aids (e.g. ECGs, Imaging) as appropriate
The Senior Resident invited questions from the Learner
The Senior Resident provided next steps to the Learner (e.g. suggested further
reading, etc..)
RATE THIS TASK | SELECT THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1 Ready for
2 3 4 5 6
Needs assistance Independent Practice
• Was not prepared to teach • Prepared to teach • Diagnosed learner to tailor teaching
• Did not choose an appropriate • Attempted to customize lesson for (e.g. level, specialty of interest,
topic (i.e. too big to address; too Learner(s), but delivery rigid / canned previous rotations)
simple for learner) • Learner(s) not engaged by the senior • Tailored and customized topic for
• Did not create a supportive resident (e.g. Appeared learner
environment (e.g. intimidating or uncomfortable or distracted) • Engaged learner(s) and placed them at
frustrating) • Knew personal knowledge limits and ease
• Senior resident was inaccurate in admitted them; • Knew personal knowledge limits and
their teaching requiring the • when faced with a difficult question admitted them; role-modelled how to
attending to correct facts. turned to attending for help perform point-of-care research to find
answer independently.
• Appropriately ends teaching session
and resumes clinical care as • Appropriately ends teaching session
warranted. and resumes clinical care as warranted;
returns to the topic if possible (or
provides follow-up information via
email or handouts)
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based
on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
35
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
The Senior Resident assessed my experience with the topic and/or asked
me what I wanted to learn
The Senior Resident organized the topic within the junior learner’s
experience (e.g. connected the topic to prior knowledge)
The Senior Resident used visual aids (e.g. ECGs, Imaging) or drawings to
facilitate my learning.
What is one change that the Senior Resident could make? (Your feedback is very valuable!)
36
RESIDENT ______________ Name of Assessor_________________ Date:_________
A3.1 | Role Modelling Health Promotion (Pointing out the ‘Teachable Moment’)
Today’s task is to identify opportunities for advocacy and health promotion WITH PATIENTS for whom
they provide care AND TO ROLE MODEL THIS TO JUNIOR LEARNERS (IF LEARNERS ARE INVOLVED)
The resident should identify at least one patient in whom they intend to discuss ONE health promotion measure you could introduce with the pa-
tient at the time of disposition (e.g. discharge, admission).
The resident should ask the attending physician to observe them counseling the patient about health promotion measures.
Rationale: There is literature to suggest that the ED may be a possible venue for initiating change (e.g. 'teachable moment'):
1) Smoking cessation: http://www.ncbi.nlm.nih.gov/pubmed/19543095
2) Smoking counselling in pts with Acute Respiratory Illness: http://www.ncbi.nlm.nih.gov/pubmed/11162344
3) Half-life of EtOH counselling: http://www.ncbi.nlm.nih.gov/pubmed/15664722
4) McBride et al., 2003 - Heuristic model for Teachable Moments: http://her.oxfordjournals.org/content/18/2/156.full.pdf+html
A3.1 | RESIDENT: Teaching Worksheet (Based on McBride et al. 2003 - Heuristic model for Teachable Moments)
2. Identify the patient’s emotions/affect. How did/can you align your discussions to their state?
3. How can you reframe their self-concept (or social role) so as to encourage change? (e.g. “You are not just
the average smoker, you are now a parent of a child with asthma...”)
RATE THIS TASK | SELECT THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1 Ready for
2 3 4 5 6 Independent Practice
Needs assistance
• Unable to identify a teachable moment • Identified a common issue for health • Identified an important, interesting or less-
for health promotion. promotion obvious health promotion problem (e.g.
• Awkwardly discussed the issue with the • Was somewhat able to align his/her family planning)
patient patient educaiton to the patient’s • Explained the clinical significance of the
• Is unable to arrive at a plan for perspective health promotion moment to LEARNER (or
actionable change • Established a general (but non- to the attending, who would substitute for a
specific) plan for continued action by learner)
• Does not appreciate/align their
discussion with the emotional state of the patient or family member • Establish an achievable plan of action that
the patient the patient or family member feels is
immediately accomplishable
A3.1 The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above
evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
37
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
ME3.4 | Clinical Supervision
Instructions to Attending:
Identify this task at the beginning of the shift. The senior resident should be assigned at least one junior learner. See below for the targets for each
level of learner.
The senior resident should supervise one or more junior learner for part of today’s shift. They should act as ‘junior attending’ and review, chart, and
assume responsibility for teaching around the cases presented by the junior learner. The attending should observe these interactions, and NEAR THE
END OF THE SHIFT ask the junior resident for feedback (see Learner Feedback form on the next page)
How many learners did the senior resident supervise today? ________________(# of learners)
What level(s) were they (check all that apply): Clerk _____ R1_____ R2 ______
The senior resident provided the learner orientation and/or debriefing for most cases.
The senior resident NEVER left the junior unsupervised in an unsafe situation
The senior resident provided learner adequate independence to develop clinical decision making
appropriate to the learner’s level of training
The senior resident provided learner with SPECIFIC and USEFUL feedback throughout the shift
(i.e. during and between cases; hints to reassess patients)
The senior resident was mindful of patient care / flow regardless of the junior learner’s progress
(i.e. arranged to reassess patients WITH junior ASAP)
The senior resident completed a direct observation (e.g. McMAP) and/or filled out the end of
shift evaluation form
The senior resident asks questions to facilitate learning (e.g. relevant quizzing, coaching a
differential diagnosis, asking for CXR interpretation)
The senior resident answers questions and provides guidance
Completes relevant charting (or over-charting) to indicate they reviewed the case and saw the
patient, as well as any thinking processes that differed from the junior learner(s)’ (e.g. “I did not
think this patient was having aortic dissection for the following reasons…”)
RATE THIS TASK | SELECT THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
1 7
2 3 4 5 6
Needs assistance Ready for the next level
• Was not prepared to teach • Attempted to customize lesson for Learner(s) as • Assessed learner (level, specialty of interest,
• Did not attempt to customize learning appropriate previous rotations)
needs to junior • Learner(s) did not seem/feel engaged by the • Very prepared to teach around cases (e.g. one
• Did not create a supportive senior resident (e.g. Appeared uncomfortable or learning point per patient)
environment (e.g. intimidating or distracted) • identifying specific cases for specific learners
frustrating) • Knew own knowledge limits and admitted • Engaged learner(s) and placed them at ease
• Directed learner exclusively to do them; but when senior resident was unable to
• Knew own knowledge limits and admitted
‘grunt work’, but did not facilitate answer questions, and turned to attending for
them; role-modelled how to perform point-of-
learner or emphasize teaching help.
care research to find answer independently.
• Senior resident was inaccurate in their • Teaches appropriate amounts considering the
• Provides appropriate amounts of teaching and
teaching requiring attending to correct work-flow of the Emergency Department and
resumes clinical care as warranted
facts. other patient care needs (i.e. does not teach an
(considering work-flow of ED, patient care, and
entire lecture when there are 30 patients to be
learner’s needs)
seen)
• provides follow-up information via email or
handouts
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. If there was any feedback from the learner,
please transcribe below.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above
evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
38
ME3.4 | Clinical Supervision - LEARNER FEEDBACK FORM
Instructions to the Attending: Please give this page to the Learner who is being taught and ask them to complete it.
They do not need to actually provide a score. Please record any feedback from this sheet into the online form as you see
fit.
What is one change that the Senior Resident could make? (Your feedback is very valuable!)
39
ME3.4 | Clinical Supervision - LEARNER FEEDBACK FORM
Instructions to the Attending: Please give this page to the Learner who is being taught and ask them to complete
it. They do not need to actually provide a score. Please record any feedback from this sheet into the online form as
you see fit.
The senior resident provided learner with SPECIFIC and USEFUL feedback
throughout the shift (i.e. during and between cases; hints to reassess
patients)
The senior resident used questions (in a non-threatening way) to prompt
me to think. His/Her questions helped guide me to answers and facilitated
my learning.
The Senior Resident invited questions FROM me
What is one change that the Senior Resident could make? (Your feedback is very valuable!)
40
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
or
2) Role models effective utilization of tools available AND EXPLAINS TO JUNIOR LEARNER while doing
so
(e.g. Library database, Google Scholar, PubMed, EMBASE, Cochrane Review, etc..)
Provides at least one resource for further reading (i.e. prints or emails relevant paper for junior learner)
The senior resident taught the junior resident sufficiently that they were able to answer the attending’s
questions.
RATE THIS TASK | SELECT THE NUMBER THAT THAT BEST DESCRIBES PROFICIENCY LEVEL
1 7
2 3 4 5 6
Needs assistance Ready for Independent Practice
• Was unprepared to teach • Attempted to customize lesson for • Assessed learner (level, specialty of
• Did not tailor learning to junior Learner(s) as appropriate interest, previous rotations)
learner’s needs • Identified learning need • Identified the specific needs for specific
• Did not create a supportive • Learner(s) did not seem/feel engaged by learners
environment (e.g. intimidating or the senior resident (e.g. Appeared • Engaged learner(s) and placed them at
frustrating) uncomfortable or distracted) ease
• Directed learner exclusively to do • Senior resident knew his/her own • Knew own knowledge limits and admitted
‘grunt work’, but did not facilitate knowledge limits and admitted them; but them; role-modelled how to perform point-
learner or emphasize teaching when unable to answer questions, simply of-care research to find answer
• Senior resident was inaccurate in turned to attending for help. independently.
their teaching requiring attending • Teaches appropriate amounts considering • Provides appropriate amounts of teaching
to correct facts. the work-flow of the Emergency and resumes clinical care as warranted
Department and other patient care needs (considering work-flow of ED, patient care,
(i.e. does not teach an entire lecture when and learner’s needs)
inappropriate) • provides follow-up information via email or
handouts
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence,
please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
41
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
RATE THIS TASK | SELECT THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for the next level
Needs assistance
Rate Displayed any of the • Was able to useresources, • Finds resources in a Displayed all of the following
S following behaviours: but took a long time.(i.e. > relatively efficient time period behaviours:
E 10 minutes) (i.e. <10 min).
A
R
• Unable to find resources in • Efficiently finds resources (i.e.
C
a timely fashion. • Utilizes mostly secondary • Navigates internet databases < 5 minutes)
H sources (i.e. reviews of the or search engines awkwardly
• Exclusively utilizes and/or articles, or digests of to find primary sources. • Navigates internet databases
cites untrustworthy or articles) rather than or search engines effectively
incorrect sources. (i.e. articles themselves. to find primary sources.
random websites, etc..)
• Adjudicates quality of
sources (both primary &
secondary)
Rate • Displays poor insights into • Displays some insight into • Displays significant insight • Displays extensive insight
I own learning process. own learning process. into own learning process. into own learning process.
N
S
I
• Unable to identify area(s) for • Able to identify one area • Able to identify one key area • Able to identify and articulate
G further reading for further reading, but not for further learning. all area(s) for further reading.
H the most important area in
T
need of attention. • Unable to detail a clear plan
for further learning.
• Unable to make a sensible
plan for further learning.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above
evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
42
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
RESIDENT: Record the Area of Improvement Discussed (i.e. topic of specific feedback).
RATE THIS TASK | SELECT THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for Independent Practice
Needs assistance
Any of the following: • Identifies vague problem • Identifies specific problem • Identifies specific problem in
• Provides confusing or concert with the junior learner
contradictory feedback • Provides vague, non- • Provides at least one specific
specific one-way feedback feedback pieces of feedback • Empathetically listens to Junior’s
• Identifies a vague, non- (e.g. only suggests that the learner can act upon perspective on the problem
specific problem with no solutions, not interested in (encourages reflective practice)
suggested solution what junior feels/observes) • Does not involve junior
learner in developing a plan • Invites the junior learner to co-
• Provides feedback in a • Awkwardly and/or for change develop a plan for change
derogatory or shame-based paternalistically addresses
manner junior • Creates proper environment • Seems comfortable in the
for giving feedback situation, and also puts the junior
• Violates the privacy of the • Discusses feedback in at ease
junior learner (i.e. pries too front of other learners
much into their personal life; • Respects the privacy of the junior
discusses feedback in front learner (e.g. finds a private place to
of other learners) discuss; attending excepted)
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the
above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
43
RESIDENT ______________ Name of Assessor_________________ Date:_________
ME3.1 | Team Leader Feedback
Today’s focus is Leading a Team.
Perform the role of Team Leader for a critically ill / injured patient and receive some preceptored multi-source feedback
from staff physicians, residents, nurses, and other allied team.
Note: Staff physician will need to gather feedback about the resident’s performance from other team members. This is ide-
ally accomplished immediately after a resuscitation. The staff physician can record the feedback numerically or by check
boxes directly into the checklist below.
FEEDBACK FROM TEAM (Record at least one piece of feedback; may be GOOD or CONSTRUCTIVE)
RATE THIS TASK | SELECT THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for the next level
Needs assistance
Resident displays any of the Resident displays any of the following or Resident displays any of the following Resident displays any of the following or
following or similar behaviours: similar behaviours: or similar behaviours: similar behaviours:
• Several (>3) of the checklist items
were not done • Several (>3) of the checklist items • Most items were done; few (i.e. < 3 • Almost all items in checklist
need attention items) needed attention completed
• Resident did not have the
confidence of the staff members • Staff members were uncomfortable • Staff members seemed comfortable • Resident had complete control of the
during the resuscitation during the resuscitation (e.g. actively during the resuscitation (e.g. only room throughout the resuscitation
disagreed with management, and SOMETIMES looked to the
• Staff physician is compelled to sought attending’s opinion before attending for affirmation) • The attending did not need to be
take over the resuscitation proceeding) present
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another faculty
member can quickly understand your rationale for the above score. (MANDATORY)
The next step: Based on the above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
44
SENIOR MODULES
QUALITY & DECISION MAKING
Authors: Editor:
ASSESSMENT INDEX
5
Performance Improvement - Senior Level Obtaining Consent
Prepares Learner - Determines if procedure is appropriate for learner; Orients, explains or reviews
procedure or key aspects of the approach to the LEARNER (including indications, risks, benefits,
complications)
Role Models or Ensures use of PPE - Uses and/or facilitates the use proper personal protective
equipment by all parties (e.g. safe practices by learner)
Ensures Safe Practices & Proper Procedural Technique - Watches for proper use of procedural
equipment; Ensures DISPOSAL of sharps; Uses SAFETY CHECKLIST if appropriate (e.g. central line
checklist)
Identifies when (and if) to step in / take over procedure from junior - Watches for difficulty,
complications, and/or impending problems and asks junior to step aside safely.
Ensures appropriate Aftercare instructions (including handouts) are provided to patient May delegate
this task to the junior, but MUST REVIEW with junior and be available to make clarifications
Debriefs & Provides Feedback after procedure - Provides constructive feedback (including suggestions
for ‘next steps’) and reviews any difficulties or suggestions after procedure
RATE THIS TASK | SELECT THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
1 7
Needs assistance 2 3 4 5 6 Independent Practice
Displays any of the following: • Does not clarify procedure nor • Prepares learner adequately • Prepares learner adequately
prepare junior learner (i.e. sets up (e.g. describes general • Stops junior resident if safety breach
• Puts patient at risk junior to fail) approach to the learner) occurs or is about to occur
• Observes learner completely • Proper attention to safety of patient,
• Does not allow Junior to attempt any • Does the bulk of the procedure (not • Needs a few reminders to let the learners, and self.
part of the procedure allowing junior to participate) junior attempt procedure
• Consistently accurate, proper Either:
• Fails to explain any aspect of the • Incompletely describes the attention to safety. 1) Explains if and why they need to
procedure to learner procedure to observing learner • Attempts to safely prompt or “take over” during the procedure &
assist junior during procedure then seemlessly explains while
• Awkward when supervising the (e.g. doesn’t just take over) performing the task. or
procedure • May or may not conduct debrief 2) Facilitates successful procedure.
of procedure with learner.
• Conducts debrief and reaffirms key
take home points with learner after
procedure.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the
above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
46
ME3.2 | Supervising Procedures - LEARNER FEEDBACK FORM
Instructions to the Attending: Please give this page to the Learner who is being taught and ask them to complete it.
They do not need to actually provide a score. Please record any feedback from this sheet into the online form as you
see fit.
The resident was able to explain all steps of the procedure to me (this can
be done before, during, or after the procedure)
The resident involved me or taught me about the documentation and orders
around this procedure.
The best thing the resident did while teaching me this procedure was…
What is one change that the Senior Resident could make? (Your feedback is very valuable!)
Please return this to the FACULTY MEMBER who was observing this procedure. The junior is NOT expected to
rate the SENIOR RESIDENT.
47
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
Displays situational awareness regarding the entire department (e.g. how busy, how
many beds, etc..)
Takes into account differing learning needs of house-staff (e.g. medical student
needing more supervision than PGY2 resident)
Takes into account extenuating circumstances that may preclude optimal efficiency
(e.g. increased time to break bad news)
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
1 7
2 3 4 5 6
Needs assistance Ready for the next level
• Needs constant • Needs a few reminders • Is flow conscious with • Is flow conscious with ALL
reminders to reassess about patients. his/her portfolio of patients in the entire
patients. • Functions independently patients (assessments, department (including those of
• Inefficient with decision regarding patient reassessments, learners’)
making assessments and investigations).
• Returns to reassess reassessments • Efficiently sees multiple • Proactive with helping juniors
patients multiple times (> • Orders appropriate tests, patients, arriving at to execute management and
3 times) before arriving at reassess pts only 2-3 diagnosis/disposition in disposition
a plan times before arriving at a time-efficient manner. • Appropriately documents
• Fails to complete diagnosis and disposition • Appropriately efficiently and
necessary paperwork plan. documents efficiently, comprehensively, up to
• Appropriately documents up to medicolegal medico -legal standards
(including reassessments standards
and auxiliary forms) up to *Please take extenuating
medicolegal standards circumstances into account; list
below if applicable.
L3.1 | The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure
another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence, please give one
specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
48
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
By the end of this shift, the resident, with minimal preceptor guidance identifies a single area in which to im-
prove. It should be the area most in need of improvement based on recent performance (e.g. today’s shift). The
area and a brief plan for improvement is outlined in the following table:
The basis of this assessment tool is to encourage reflective practice and steer senior residents towards assessment-seeking. For futher
reading or justification for this task: Eva KW, Regehr G. Self-assessment in the health professions: a reformulation and research agenda. Acad
Med. 2005 Oct;80(10 Suppl):S46-54.
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1 Ready for the next level
2 3 4 5 6
Needs assistance
P3.2 | The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure
another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence, please give one
specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
49
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
Ensures Patient understands and appreciates the… The plan & option; Indications; Benefits, Risks, Alternatives
•TOTAL
RATE THIS TASK | CIRCLE ONE THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
7
1 Ready for the next level
2 3 4 5 6
Needs assistance
• Unable to build rapport • Builds rapport with patient or • Puts patient or SDM at ease.
with patient or SDM SDM • No requirement for attending
• Provides all options, but • Provides all options, and physician to participate.
explanation is confusing requires little clarification for • Identifies the limits of the
• Requires attending participants to understand discussion if disagreement
physician to steer the plan. occurs (e.g. reaches a
course and guide • Minor role of attending conclusion or a neutral
decision making. physician to clarify/affirm the decision point that may be
plan for implementation. decided later)
P3.4 | The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence,
please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
50
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
L3.3 | Quality Assurance
Today’s focus is quality assurance and/or disclosure of error.
Today, the senior resident should partake in an aspect of a quality assurance protocol (e.g. radiology discrepancy call backs;
Positive culture result) that routinely occurs in your department. If a call back is required, they should review all decisions for
these protocols with the attending and also any patient-care related calls should be observed/reviewed
Readings: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1924693/
https://geiselmed.dartmouth.edu/cfm/resources/ethics/chapter-12.pdf
Video: http://on.ted.com/Goldman
DONE BUT
N/A FOR
CHECKLIST DONE NEEDS NOT DONE
CASE
ATTENTION
Review Process
1) Reviews chart and new information (e.g. discrepancy, positive culture) and decides if a call back is required.
2) Determines the extent of error disclosure (e.g. reviews approach with attending).
Resident should complete ONE OF THE FOLLOWING TWO PART (i.e. A or B, not both)
5b) If requested, provides the names/numbers of individuals with whom patients and families can address concerns/
questions
1) Creates an adequate environment in which to address the rational for the callback
4b) If requested, provide the names/numbers of individuals with whom patients and families can address concerns/
questions
RATE THIS TASK | CIRCLE ONE THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
7
1 Ready for
2 3 4 5 6
Needs assistance Independent Practice
• Seems rushed or • Builds appropriate rapport • Builds appropriate rapport • Puts patient at ease.
uncomfortable • Provides all options, but and efficiently establishes • No requirement for attending
• Poorly prepared for requires moderate plan physician to participate.
the discussion. clarification for participants • Provides all options, and • Identifies the limits of the
• Required attending to understand plan requires little clarification for discussion if disagreement
physician to halt or • Moderate role of attending participants to understand occurs (e.g. reaches a
redirect conversation. physician to steer the course plan. conclusion or a neutral
and guide decision making. • Clear plan established, decision point that may be
• A bit confusing, requiring agreed upon by both parties. decided later)
further explanation
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the
above evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
51
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
The resident may read the triage notes of each of the patients in order to determine plan. The resident is ex-
pected to create and immediately implement this plan (including planning for delegation of tasks to juniors, at-
tending, nurses, etc..)
Instructor Hints
It is best to do this task on a routine day, not a day where there are hyper-acute patients (e.g. CTAS 1s) that require multiple
and ongoing rapid reassessment. You should consider having the senior resident designate patients to be seen by the at-
tending physician.
Takes into account patient factors (e.g. wait times, pain score) to determine order.
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for the next level
Needs assistance
Resident displays any of the Resident displays any of the following (or a Resident displays all of the
following (or a similar behaviour): similar behaviour): following (or a similar behaviour):
• Presents a disorganized plan for • Presents a plan that incorporates • Presents a plan to safely and
seeing the patients. CTAS scores, but also clinical efficiently triages patients in a
• Uses CTAS scores ONLY to judgment regarding time expected reasonable order (utilizing more
guide who to see next. with each patient than just CTAS score).
• Doesn’t follow initial plan. • Considers patient location • Takes into account department
• Becomes overwhelmed with executing physical layout and workflow to
own plan and requires intervention see patients.*
from the attending. • Realizes when # patients to be
• Partially involves other team members seen exceeds own capabilities;
• Asks for help when unable to execute incorporates this into the plan.
plan as efficiently as planned
M3.1 | The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above
evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
52
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
ATTENDING: The goal of this exercise is to provide residents with useful feedback about how well they were
able to reflectively incorporate patient feedback into their future practice. The CPSO and other provincial col-
leges are moving towards patient surveys as a method for assessing physicians in practice. The goal of this
activity is to ensure our residents are ready to integrate these methods into their own professional develop-
ment with your guidance and coaching
Question to ask:
Attending should ask the following question:
“Dr. _______________ is a senior emergency medicine resident, which means he/she is a short while away
from practicing without supervision. Do you have any feedback for them based on their interaction with you?”
RATE THIS TASK | CIRCLE THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
1 7
2 3 4 5 6
Needs assistance Ready for the next level
• Could not integrate patient feedback • Accepts feedback and displays • Empathetic & reflective about patient’s point of
into their future practice empathy for patient’s point of view. view
• Becomes angry or defensive when • Does not identify a clear plan for • Identifies clear plan for change in future cases.
given negative feedback change; or, requires extensive coaching
from attending to make a plan for
change
A3.2 The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to
ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence, please
give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
53
RESIDENT ______________ Name of Assessor_________________ Date:_________
A3.1 | Role Modeling Health Promotion (Pointing out the ‘Teachable Moment’)
Today’s task is to identify opportunities for advocacy and health promotion WITH PATIENTS for whom
they provide care AND TO ROLE MODEL THIS TO JUNIOR LEARNERS (IF LEARNERS ARE INVOLVED)
The resident should identify at least one patient in whom they intend to discuss ONE health promotion measure you could introduce with the pa-
tient at the time of disposition (e.g. discharge, admission).
The resident should ask the attending physician to observe them counseling the patient about health promotion measures.
Rationale: There is literature to suggest that the ED may be a possible venue for initiating change (e.g. 'teachable moment'):
1) Smoking cessation: http://www.ncbi.nlm.nih.gov/pubmed/19543095
2) Smoking counselling in pts with Acute Respiratory Illness: http://www.ncbi.nlm.nih.gov/pubmed/11162344
3) Half-life of EtOH counselling: http://www.ncbi.nlm.nih.gov/pubmed/15664722
4) McBride et al., 2003 - Heuristic model for Teachable Moments: http://her.oxfordjournals.org/content/18/2/156.full.pdf+html
A3.1 | RESIDENT: Teaching Worksheet (Based on McBride et al. 2003 - Heuristic model for Teachable Moments)
2. Identify the patient’s emotions/affect. How did/can you align your discussions to their state?
3. How can you reframe their self-concept (or social role) so as to encourage change? (e.g. “You are not just
the average smoker, you are now a parent of a child with asthma...”)
RATE THIS TASK | SELECT THE NUMBER THAT BEST DESCRIBES THE RESIDENT’S LEVEL OF PROFICIENCY
7
1 Ready for
2 3 4 5 6 Independent Practice
Needs assistance
• Unable to identify a teachable moment • Identified a common issue for health • Identified an important, interesting or less-
for health promotion. promotion obvious health promotion problem (e.g.
• Awkwardly discussed the issue with the • Was somewhat able to align his/her family planning)
patient patient educaiton to the patient’s • Explained the clinical significance of the
• Is unable to arrive at a plan for perspective health promotion moment to LEARNER (or
actionable change • Established a general (but non- to the attending, who would substitute for a
specific) plan for continued action by learner)
• Does not appreciate/align their
discussion with the emotional state of the patient or family member • Establish an achievable plan of action that
the patient the patient or family member feels is
immediately accomplishable
A3.1 The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating.
Add enough details to ensure another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above
evidence, please give one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
54
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
RATE THIS TASK | CIRCLE ONE THAT THAT BEST DESCRIBES PROFICIENCY LEVEL
1 7
2 3 4 5 6
Needs assistance Ready for Independent Practice
Resident demonstrates most of the • Resident demonstrates most of the Resident demonstrates most of the
following or an equivalent following or an equivalent behaviour: following or an equivalent behaviour:
behaviour: • Identifies an area for improvement • Identifies areas for improvement;
• Did not complete assignment • Is able to reflect about the case in an • Is able to reflect about the case in
• Could not demonstrate evidence objective manner. an objective manner.
of reflection and insight regarding • Identifies a specific learning objective • Identifies a specific learning
case and process (e.g. is from each patient with the help of the objective from each patient
defensive about a learning point attending physician. without the help of the attending
that the attending identifies) physician.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure
another faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence, please give
one specific suggestion (Education Prescription) for the resident to attempt during his/her next shift.
55
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
Example situations:
- identified a “near miss” and filled out the relevant reporting documentation
- assisted in a resuscitation at the request of a colleague (e.g. when asked by Nurse or Senior Medical Resident)
- identifies and assists with a scenario involving an admitted patient warranting intervention by emergency physi-
cian
Or other scenarios as deemed appropriate by resident or staff physician.
RATE THIS TASK | CIRCLE THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
7
1
2 3 4 5 6 Ready for the next level
Needs assistance
Resident displays any of the following or • Courteous and respectful to other Resident displays all of the following or
similar behaviours: parties but seemed awkward/ similar behaviours:
uncomfortable at times in the situation.
• Unprofessional (e.g. loses temper, engages • Respectful, calm & approachable
in shouting match) • Provided timely and useful assistance in
solving the problem at hand • Expeditiously fact finds, soliciting
• Conflict arose perspectives from all relevant parties on
• Answers patient or colleague(s)’s the problem at hand
• Did not convey relevant and/or crucial Questions
information (urgency, importance) • Provides an expert assessment and plan
• Asks some questions to better to solve the problem a
• Resident unwilling to compromise to understand the problem from all relevant
achieve best outcome for patient perspectives • Seems comfortable in the situation, and
also puts others at ease
• Eventually arrived at a plan that was
amenable to all parities or required • Arrived at a plan that was amenable to all
minor concessions be made by one or parties
more parties
• IF APPLICABLE: Debriefs relevant parties
with regards to the scenario; Provides
teaching to learners as needed.
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another faculty
member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence, please give one specific suggestion
(Education Prescription) for the resident to attempt during his/her next shift.
56
RESIDENT: ______________ Name of Assessor: _________________ Date:_________
RESIDENT: Record the Area of Improvement Discussed (i.e. topic of specific feedback).
RATE THIS TASK | SELECT THE NUMBER THAT THAT BEST DESCRIBES LEVEL OF PROFICIENCY
1 7
2 3 4 5 6 Ready for Independent Practice
Needs assistance
Any of the following: • Identifies vague problem • Identifies specific problem • Identifies specific problem in
• Provides confusing or concert with the junior learner
contradictory feedback • Provides vague, non- • Provides at least one specific
specific one-way feedback feedback pieces of feedback • Empathetically listens to Junior’s
• Identifies a vague, non- (e.g. only suggests that the learner can act upon perspective on the problem
specific problem with no solutions, not interested in (encourages reflective practice)
suggested solution what junior feels/observes) • Does not involve junior
learner in developing a plan • Invites the junior learner to co-
• Provides feedback in a • Awkwardly and/or for change develop a plan for change
derogatory or shame-based paternalistically addresses
manner junior • Creates proper environment • Seems comfortable in the
for giving feedback situation, and also puts the junior
• Violates the privacy of the • Discusses feedback in at ease
junior learner (i.e. pries too front of other learners
much into their personal life; • Respects the privacy of the junior
discusses feedback in front learner (e.g. finds a private place to
of other learners) discuss; attending excepted)
The Evidence: Please provide an example of the learner’s behaviour with an explanation that supports your rating. Add enough details to ensure another
faculty member can quickly understand your rationale for the above score. (MANDATORY) Also, based on the above evidence, please give one specific
suggestion (Education Prescription) for the resident to attempt during his/her next shift.
57
APPENDIX A
The exceptional events are any observed performances that suggest that a resident is performing in
an exceptional way. This can be either an especially good performance, or one that suggests that
they are in need of special assistance. Of note, this system has helped to flag residents who are both
outperforming peers (e.g. ran an exceptional resuscitation), and also underperforming or displaying
unprofessional behaviour.
Notably, this facet of the McMAP increases the sensitivity of the entire system, allowing the program
director to gather more information about
58
APPENDIX B
Below is the overall task index. Do note that some tasks are found in more than one level. These are
sometimes intentionally spaced to reaffirm concepts, and sometimes these tasks are named the
same but have different (increasingly difficult) anchors/rubrics.
Junior Medical Expert & Scholar Intermediate Medical Expert & Scholar Senior Scholarship & Teaching
• Chest Pain Hx / Px • History & Physical during a Resuscitation or • Supervising Procedures
• Acute Back Pain Hx / Px Trauma • Impromptu Didactic Teaching Session
• Mini Trauma • Procedural Teaching (Simple Task) • Clinical Supervision
• Simple procedure • Knowledge Gap Identification • Role Modeling Knowledge Translation
• Point of Care Research w/ Direction • Knowledge Translation • Feedback & Coaching (Also C&C)
• Knowledge Translation • Point of Care Research (Own Question) • Team Leader Feedback (Also QDM)
• Case Presentations • Performing Complex Procedure • Point of Care Research (Own Question)
• Ordering Investigations • Chest Pain History & Physical • Role Modeling Health Promotion (Also
• Ordering investigations QDM)
Junior Communicator & Collaborator Intermediate Communicator & Collaborator Senior Communication & Collaboration
• Observed History • Airway Management (Also see M&A) • Telephone Communication
• Observed Hx with Barrier • Discharge Instructions • Breaking Bad News
• Discharge Instructions • Delivery of Care plan to Family or Patient • Critical Incident Debriefing
• Chart Audit (Content) • Care Plan Discussion w/ RN or Allied Health • Providing Handover (SBAR) (Also L&TM)
• Chart Audit (Organization) • Documentation (Also seen in P+C block) • Receiving Handover
• Obtaining Consent • Multi-source Feedback • Feedback & Coaching (Also S&T)
• Consult Request • Mini-Chart Audit • Advanced Consultation Request / Out pa-
• Case Presentation
• Consultation Request (Intermediate ver.)
tient Referral
• Advanced Chart Audit
• Communication with Nursing or other Health-
care Professionals
• End of Life & Advanced Care Planning
• Team Leader Feedback (Also QDM)
Junior Professional & Communicator Intermediate Professional & Communicator Senior Quality Decision Making
• Observed History - modified SEGUE (a) • Modified SEGUE history (b) • Performance Improvement (Senior version)
• Capacity assessment • Obtaining Consent • ED Flow (Senior version)
• Obtaining Consent • Audit of In-patient outcome • Time Management (Senior version)
• Narcotic Prescription • End of Life & Advanced care planning • Patient Survey
• Mandatory Reporting • Mandatory Reporting • Team Leader Feedback (Also C&C)
• Chart Audit (Organization) • Capacity Assessment • Obtaining Consent
• Chart Audit (Content) • SBAR (Handover) • Quality Assurance
• Consult Request (Junior) • Documentation (also see C&C)
• Role Modeling Health Promotion
• Patient Safety Leadership (Also L&TM)
• Feedback and Coaching (Also S&T)
Junior Manager & Health Advocate Intermediate Manager & Health Advocate Senior Leadership & Team Management
• Performance Improvement Part 1 • Airway Management (Also see C&C block) • Receiving Handover from Paramedics
• Performance Improvement Part 2 • Performance Improvement Part 1 • ED crowding management
• Time Management • Performance Improvement Part 2 • Time Management & Task Switching
• Tech in the ED • Work/Life Balance (“Multi-tasking”)
• Work/Life Balance • ED Flow • Delegation and Team Management
• Determinants of Health • Time Management • Supervising Procedures (Also S&T)
• Patient Survey • Patient Survey • Team Leader Feedback
• Overcoming Barriers • Managing (Potential) Conflict Situations
• Providing Handover SBAR (Also C&C)
• Professional Obligations
• Patient Safety Leadership (Also QDM)
59