Using competency based assessment instruments
Chapter 4
04/29/2024 Training Facilitation Skills 1
Introduction
Why Knowledge, Skill and Attitude assessment is
important ?
04/29/2024 Training Facilitation Skills Cha_
Introduction
Assessment:
• Must be meaningful
• Must provide an accurate and reliable measure of learners
progress
• Shared responsibility among trainees and trainers
04/29/2024 Training Facilitation Skills Cha_
Chapter Objective
After completing this chapter, the participant will be able to:
• Use competency-based assessment tools
04/29/2024 Training Facilitation Skills Cha_
Enabling Objectives
• Discuss the principle of competency based assessment
• Use competency based assessment tools
• Administer competency-based assessments
• Use assessment results to improve learning
04/29/2024 Training Facilitation Skills Cha_
4.1. Principles of Competency Based Assessment
• Assessment seems an easy task
• Determine their mastery to perform the desired competencies
• Assessment methods should adhere to few key principles
04/29/2024 Training Facilitation Skills Ch-4
Principles of Competency Based Assessment
Validity Reliability Objectivity Feasibility
Measures what it Produces Free of Easy to
intends to consistent trainer administer
measure result biases
04/29/2024 Training Facilitation Skills Ch-4
Principles of Competency Based Assessment…
Formative assessment:
“assessment for learning”, - assess progress and development of
competency
Summative assessment:
“assessment of learning”- make decision about learners readiness to
progress
04/29/2024 Training Facilitation Skills Ch-4
Principles of Competency Based Assessment…
Effective assessment requires:
• Clear learning objectives(SMART)
• Use of a variety of appropriate assessment procedures
• Consistency among the learning objectives
04/29/2024 Training Facilitation Skills Ch-4
Principles of Competency Based Assessment…
Effective assessment requires…
• Procedures that are fair to everyone
• Clear criteria for judging successful performance
• Feedback to trainees
• Support of a comprehensive grading and reporting system
04/29/2024 Training Facilitation Skills Ch-4
Principles of Competency Based Assessment…
Individual Activity 4-1: Case study
Mr. X scored 85% in his final post – test exam and got competent on a certain IST course which
comprises knowledge, skills and attitude competencies. The exam administered was only
written type.
Do you think Mr. X is competent in the competencies taught in the course?
If your answer is ‘no’, what was the problem with the assessment?
What do you suggest to improve the assessment?
5 min
04/29/2024 Training Facilitation Skills Cha_
4.2. Use Competency Based Assessment
Methods
• Use a variety of assessment tools
• Better suited assessment tools (competency domains)
04/29/2024 Training Facilitation Skills Ch-4
Use Competency Based Assessment Methods
04/29/2024 Training Facilitation Skills Ch-4
Use Competency Based Assessment Methods…
Paper slip game:
Varity of Methods/tools for KSA knowledge
Page 73-74 table 4-1
Time: 20 minutes
04/29/2024 Training Facilitation Skills Ch-4
Use Competency Based Assessment Methods
• Determine an appropriate pass score
• Ensuring personal opinion does not affect the results
• Ensure that methods are feasible
04/29/2024 Training Facilitation Skills Ch-4
4.3. Administer Assessment
Administer a Knowledge Assessment
• Give directions before the examination
• Focus on how the trainee should complete the test
• knowledge assessment (Before, during and after training)
04/29/2024 Training Facilitation Skills Ch-4
Administer a skill Assessment
• Structure a clinical encounter that mimics a realistic situation
• Administered in an comfortable area
• OSCE
04/29/2024 Training Facilitation Skills Ch-4
Administer a skill Assessment…
Setting up OSCE
• Each station is numbered and the signal or bell checked
• Clearly marked movement from station to station
04/29/2024 Training Facilitation Skills Ch-4
4.4. Use of assessment result to improve
performance
• Formative assessments
- Help trainees decide what content areas they need to spend more
time
• Summative assessment:
- Determine if trainees are meeting the learning objectives
04/29/2024 Training Facilitation Skills Ch-4
Summary
• Trainer think about how to assess learners
• Importance of ongoing formative assessment
• Summative assessment evaluate progress towards
competency
04/29/2024 Training Facilitation Skills Cha_
Summary
• Assessment tools must be linked to desired competency
• Formative assessment is assessment for learning
• Summative assessment is assessment of learning
04/29/2024 Training Facilitation Skills Ch-4
