Professional Documents
Culture Documents
-1-
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Table of Contents
Packaging of Competency Standard (CS) and Curriculum, Training and Assessment Guide (CTAG) 11
-2-
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Principles of Assessment (POA) .................................................................................................. 24
Adult Educator (AE) Qualifications Requirements and Timelines for WSQ Approved Training
Organisations (ATO) ................................................................................................................... 25
How do These Changes to Competency Standard (CS) and Curriculum, Training and Assessment
Guide (CTAG) Affect my Assessment Plan Design? ...................................................................... 26
References................................................................................................................................. 50
-3-
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
BLANK PAGE
-4-
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Message from the Director of Quality Assurance Division
-5-
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Learner Profile
-6-
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Reflection on Learner Profiles
Draw up the profile of learners who attend your programmes. Pick the
appropriate characteristics.
Tech-Savvy Gen Y
24/7 connected
Multi-tasking
Easily bored
Articulate and confident
Learner Profile
Given your learner profile, how do we design assessments to match learner
needs and strengths?
-7-
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Will Technology-assisted, Work-based, Continuous Assessments
Work?
Discuss with your partner on the appropriateness of the three assessment
approaches for your learners. Tick the relevant boxes if the approaches provide
valid, sufficient, current and authentic evidence.
Validity of
evidence
Sufficiency of
evidence
Currency of
evidence
Authenticity of
evidence
Possible Takeaway
-8-
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Using Social Media-based E-Portfolios in Competency-based
Assessment
A pilot project by Institute for Adult Learning (Lee Wee Chee)
Background
IAL recently conducted a pilot run of a new design for four modules of
Advanced Certificate in Training and Assessment (ACTA). One of the new
methods that were tested was the use of social-media based e-portfolios for
continuous, formative and summative assessment.
Assessment Process
Assessment Framework
-9-
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Summative
Assessment
Learners meet with
assessor to review all Evidence Portfolio
Evidence Gathering Tools evidence for decision
on competence e-Portfolio using social
Smartphones, tablets
Formative Assessment media like blog hosts
With photo-taking and
Learners meet with assessor
(e.g. Wordpress) and
video-capturing to review evidence presented
so far to determine video hosts (e.g.
capability performance gaps and
actions to take to close the YouTube)
gaps
Informal Feedback
Trainers, assessors and fellow learners
give feedback on blog entries for
developmental purposes
Evidence Database
Application to own workplace practice: Reflective entries
on applicability of learning to workplace
Teaching and assessment skills: Videos of skills practices
in class or from the workplace + reflection
Construction of knowledge: Photographs and entries of
own learning + reflection
Professional development: Reflective entries on
professional practice based on self and peer feedback
1
Dannefer, E. F., and Henson, L. C. (2007). The portfolio approach to competency-based assessment at the Cleveland Clinic
Lerner College of Medicine. Academic medicine, 82(5), 493-501.
- 10 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
What is Competency?
A competency is a measurable set of knowledge, skills, and attitudes that a
person needs to perform a task effectively
- 11 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Competency Standard Template
- 12 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Key Changes to Competency Standard Template
Relevant Job
Retain
role(s)/occupation(s)
Performance Statements /
Competency Element / Retain and Enhance
Performance Criteria
- 13 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Revised Competency Standard Template
- 14 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Curriculum, Training and Assessment Guide (CTAG) Components
- 15 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Key Changes to CTAG Template
- 16 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Competency-based Assessment
A collection of evidence to demonstrate that a learner can perform or
behave according to specific standards
The assessment outcome that will allow the assessor to make judgment
with respect to the achievement or non-achievement of these outcomes
(i.e. competent / not yet competent)
- 17 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Types of Assessment
Diagnostic
Formative
Continuous
Summative
Skills Recognition
- 18 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Commonly Used Assessment Methods
Frequently used competency-based assessment methods may be categorised
into four broad groupings:
Knowledge-based Assessment Methods
1. Multiple-Choice Questions (MCQ)
Multiple-choice questions consist of a question, followed by a number of
options. One of the options is the correct answer. The other options, which
are incorrect, are called distracters.
Advantages Disadvantages
As there is minimal writing, a Validity of evidence blurred by the 25%
substantial amount of content can be (assuming 4-option MCQ) chance of
assessed in a relatively short time random success.
Advantages Disadvantage
- 19 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
3. Projects
Projects involve an assessment of a combination of subject knowledge,
process skills and transferable skills. Projects require learners to apply their
learning, encourage pro-activity and need an extended duration for
completion. The outcomes of a project may be presented through different
forms such as a report, portfolio, and/or presentation.
Advantages Disadvantages
4. Portfolio
A portfolio refers to a collection of evidence assembled by the learner to
demonstrate competence. The main purpose of using a portfolio would be
the collection of evidence to establish that the learner has demonstrated a
set of prescribed performance criteria. A key point to note is that evidence
that was accumulated many years ago may not be current and has to be in
line with current practices and standards.
Advantages Disadvantages
Flexible as learners take the initiative Challenging to some learners due to the
to decide on how the portfolio is to flexibility
be presented and organised.
May be difficult for assessors to map
Valid form of assessment as it is the portfolio to assessment criteria and
based on real task rather than a require a face-to-face interview to
series of educational tasks. ascertain competence
- 20 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
5. Written Assessment (Reports)
A report is a form of extended written assignment whereby information and
often recommendations for action are presented.
Advantage Disadvantage
6. Oral Questions
Oral Questioning require learners to articulate their understanding through
a verbal face-to-face question and answer (Q&A) process. This method is
useful when addressing a diverse group of learners with varying literacy
levels as the assessor is able to paraphrase questions to help the candidates
in understanding.
Advantage Disadvantage
- 21 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Performance-based Methods
7. Workplace Performance
This is arguably the best method to collect reliable and authentic evidence
of a learner’s actual competencies. This is because the assessment context
is set under actual work conditions that require demonstration of actual
occupational competencies and maximises the degree of realism in the
assessment process.
Advantages Disadvantages
8. Role-Play / Simulation
Role-playing or simulation provides an alternative for workplace
performance. It can be seen as an orchestrated scenario that seeks to
gather evidence on a learner’s competencies.
Advantages Disadvantages
- 22 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Attitudinal Evaluation Methods
9. Observations
This method involves observing the behaviour of learners, recording as
much as possible, or whatever appears to be useful, important, or unusual.
Once the data are recorded, the observers’ task is to make sense and draw
conclusions from it. Observation requires preparation time. It is necessary
to determine why you are observing, what you expect to see or think you
might see and how you will record what you see.
Advantages Disadvantages
- 23 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Principles of Assessment (POA)
Validity refers to the strength of assessment tasks and criteria to accurately
measure learners’ attainment of the intended competencies level (i.e. how
well the test really reflects the knowledge, skills and attitudes of the
Competency Standard). It includes content validity, construct validity, face
validity and predictive validity
Fairness refers to the equality in the conduct of assessment and does not
advantage or disadvantage particular learners (e.g. amount of assessed
work should be manageable).
Sufficient Evidence
Current Evidence
Authentic Evidence
- 24 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Adult Educator (AE) Qualifications Requirements and Timelines for
WSQ Approved Training Organisations (ATO)
In-House WSQ ATOs
Trainer and/or assessor At least 50% with At least 65% with At least 80% with
Workplace Trainer Workplace Trainer Workplace Trainer
Programme (WTP) or Programme (WTP) or Programme (WTP) or
equivalent equivalent equivalent
Master Trainer At least 1 master trainer* must attain full ACTA or equivalent by 1 Oct
2013
Curriculum Developer At least 1 developer* must attain full ACTA or equivalent by 1 Oct 2013
Note:
New ATOs or existing ATOs who are moving into new areas of training are required to meet
requirements in Phase I with immediate effect.
WSQ In-house ATOs are companies/organisations that train and/or assess their own staff
internally.
Figures are based on declaration during accreditation and deployment
* Can be the same person
Trainer and/or assessor At least 50% with full At least 65% with At least 80% with
Advanced Certificate in Advanced Certificate in Advanced Certificate in
Training and Training and Training and
Assessment (ACTA) or Assessment (ACTA) or Assessment (ACTA) or
equivalent equivalent equivalent
Curriculum Developer 100% with Diploma in Adult and Continuing Education (DACE) or
equivalent by 1 Oct 2015
Note:
New ATOs or existing ATOs who are moving into new areas of training are required to meet
requirements in Phase I with immediate effect.
WSQ ATOs are external training providers that are in the business of conducting training and/or
assessment
Today, curriculum developers of ATOs are already required to meet ACTA or its equivalent. They
will also be required to meet the new DACE requirement by 1 Oct 2015.
Figures are based on declaration during accreditation and deployment. ATOs are required to
ensure that its actual deployed AEs for each class delivery under each approved framework meet
the qualifications requirements
Partial Completion of DACE: Individuals who have already attained DACE competency units (CU)
C2, C3, C5, C6 and C7, may function as WSQ Trainers and Assessors at WSQ ATOs in lieu of
completing the ACTA Qualification. Such individuals are encouraged to complete the remaining
units of the DACE qualification as the full DACE qualification will enable them to practice as a
WSQ Curriculum Developer at WSQ ATOs.
- 25 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
How do These Changes to Competency Standard (CS) and Curriculum,
Training and Assessment Guide (CTAG) Affect my Assessment Plan
Design?
For Competency Standards (CS)
- 26 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
What is an Assessment Plan?
An Assessment Plan is a document that provides information on how the
assessment will be structured, what is involved and the assessment criteria
that candidates will be assessed against.
- 27 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
WSQ Requirements in Relation to Assessment Plans
Principles of Assessment (POA) are complied with
o Assessment tools are provided e.g. role play scripts, answers to written
tests
o Glossary provided
o Version control
- 28 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Common Shortcomings in Assessment Plan Design
Problem: This role play script does not provide valid evidence of competence as
the learners only needs to follow the script and the flow of the script. In a real
workplace situation, the learners will not be given such a script when providing
customer service. Learners should not be in the know of exactly what to expect
during each customer service provided.
A sample role play script developed to assess learner based on a real work
place situation is as follows:
Role Play Scenario
It is a Sunday morning and your department store is going to launch a new product called the
iRobot. Your organisation anticipates a huge demand for this new electronic item as shown by
the large sales figures in other countries.
- 29 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Common Shortcomings in Assessment Plan Design
Example:
Competency Standard: LPM-DEV-301C-0 Encourage People
Performance Criteria: Review team and organisational business plans to identify new
and emerging skill requirements
Assessment Method chosen: Written Assignment
Question set for this PC: Complete a 100-word essay on evaluating business plans and
how to identify emerging skill requirements
The question set only assesses the individual knowledge on how to evaluate
business plan and how to identify skill requirements. It does not assess how the
individual reviews team and organisational business plans with the objective of
identifying new and emerging skill requirements
General Advice: Be very clear about what the Performance Criteria expect as
Performance Criteria and Performance Statements require the learner to
demonstrate competence holistically, rather than in segments.
- 30 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Common Shortcomings in Assessment Plan Design
Description: The ATO only submitted the following table as part of the
assessment specifications. The rest of the assessment plan consists of the
matrix of assessment methods, observation checklist and a role play script.
- 31 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Assessor to candidate ratio
Conduct / provision of feedback
Conduct of assessment
Decision making on assessment outcome for the method and for the whole
assessment
Preparation for assessment (by the assessor and / or assessment centre)
Performance Statements / Performance Criteria and Underpinning
Knowledge covered
Special instructions (e.g. safety precautions, etc)
- 32 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Common Shortcomings in Assessment Plan Design
Problem: Users of the assessment plan may get confused as to what is the
correct assessment method/s and whether the assessment plan is of the correct
version. This may reduce the confidence of the user of the assessment tools and
create a sense of doubt in the assessment plan being used.
General Advice: Ensure that all sections in the assessment plan are consistent
and do not conflict with each other. Always do a check on whether there is any
information that may confuse the user.
Assessment Tools
Instructions to
Assessment
Candidates
Assessors
checklist
Performance Criteria Evidence Gathering Plan Method
ASSESSMENT CHECKLIST
Please Tick
Performance Criteria and
Assessment Criteria Remarks
Underpinning Knowledge
C NYC
1.2 Communicate the performance OQ13: Explain how to communicate the performance management
management system to employees system to employees and their roles and responsibilities in
and their roles and responsibilities performance management.
in performance management.
Suggested Answers: The assessment
Candidate is able to explain how to communicate the performance
checklist states that
management system to employees and their roles and responsibilities it
in performance management, which may include: is an oral question
As part of the performance appraisal
............................………….
............................………….
- 33 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Common Shortcomings in Assessment Plan Design
General Advice: Unless there are strict criteria for assessors, and specific
consequential actions (i.e. achievement of specific outcome from only one
specific process) being observed, it is advisable for assessment of practical
performance to be conducted on a one-to-one basis.
6 Assessment Set- A fully set-up restaurant. This includes providing all the
up Requirements relevant items found in a typical restaurant.
- 34 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Common Shortcomings in Assessment Plan Design
General Advice: Ensure that the developer of the assessment plan is clear and
well-qualified in developing a reliable MCQ Questionnaire. This will help ensure
that the assessment is in line with the rules of evidence. Some general tips for
designing MCQs include:
Measure important outcomes only
Write a clear question
Ensure that the grammar of the term matches that of the options
Avoid giving verbal clues in the question
Provide plausible distracters
Avoid ‘all of the above’ and ‘none of the above’
Vary the length of the correct answer
Vary the position of the correct answer
Avoid making the correct answer less definite
Example:
1. What is an attribute of a manager? (choose the one correct answer)
a. Able to communicate ideas to supervisors for implementation
b. Able to escape from all responsibilities
c. Able to change the world
d. Able to punish staff as and when he likes
- 35 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Common Shortcomings in Assessment Plan Design
- 36 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Selection of Assessment Methods
- 37 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Assessment Plan Validation
Purpose of validation
o To determine if assessment plan meets the Principles of Assessment and
Rules of Evidence, learners’ profile, and contextualisation (organisation,
industry and legal) and learners’ requirements
Who are the stakeholders
o Line managers/supervisors, training managers, subject matter experts
(SME), trainers, assessors
What to focus for validation
o Assessment criteria and evidence requirements
o Assessment environment
o Assessment methods and tools
o Principles of Assessment and Rules of Evidence
o Practicality
o Clarity of instructions
o Cost effectiveness
o Contextualisation (e.g. organisation, industry and legal) and learner
requirements
When should validation take place
o Before assessment
o During assessment
o After assessment
Follow up to validation
- 38 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Assessment Plan Validation Checklist
Purpose of Validation:
Stakeholders involved:
Areas of Focus:
Assessment criteria and evidence requirements
Assessment environment
Assessment methods and tools
Principles of Assessment / Rules of Evidence*
Practicality
Clarity of instructions
Cost effectiveness
Contextualisation (organisation, industry and legal) and learners’
requirements
______________________________________________________
______________________________________________________
Assessment Venue:
Follow up:
- 39 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
POA / ROE Validation Checklist
Compliance Mitigating Factor
Suggested areas to look into
Underlying Principle (if non-
(not limited to) Yes No
compliant)
Principle of Assessment - Validity
Assessment activities are Assessment criteria
based on actual Assessment specifications
workplace practices and Other assessment tools (where
contexts applicable): case study
scenarios, role play scripts,
scenarios, assessment
checklists, observation
checklists, etc
Assessment activities Assessment tools: case study
relates directly address scenarios, role play scripts,
the PS / PERFORMANCE scenarios, assessment
CRITERIA and UKs checklists, observation
checklists, etc
Assessment tools address Assessment tools: case study
the candidate’s ability to scenarios, role play scripts,
meet the level of scenarios, assessment
performance required by checklists, observation
the Competency Standard checklists, etc
Assessment activities Assessment methods
planned are holistic and Assessment criteria
integrated Other assessment tools (where
applicable): case study
scenarios, role play scripts,
scenarios, assessment
checklists, observation
checklists, etc
The assessment method Assessment methods
and tools developed are Assessment criteria
appropriate for the Other assessment tools (where
assessment system applicable): case study
specified by industry scenarios, role play scripts,
(where relevant) scenarios, assessment
checklists, observation
checklists, etc
All information in the Developer / co-developer
assessment Plan has been Validation panel
validated by an Subject matter expert
appropriate person (e.g.
master trainer, subject
matter expert, etc) with
expertise in the
competency/is being
assessed
- 40 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Compliance Mitigating Factor
Suggested areas to look into
Underlying Principle (if non-
(not limited to) Yes No
compliant)
Principle of Assessment - Reliability
Critical elements have Assessment specifications
been identified and Assessment tools: case study
sampling used to ensure scenarios, role play scripts,
that the most important scenarios, assessment
aspects are assessed. checklists, observation
checklists, etc
Clear assessment criteria Assessment / Observation
have been provided for Checklist/s
the assessor in the
assessment / observation
checklists (e.g. clear guide
to assess and individual
as ‘C’ or ‘NYC’)
Clear instructions have Instructions to assessors
been provided to ensure Assessment specifications
that assessors conduct Other assessment tools (where
the assessment activity applicable): case study
consistently and make scenarios, role play scripts,
consistent decisions over scenarios, assessment
time and with different checklists, observation
candidates checklists, etc
Where multiple assessors Assessment methods
are involved in Assessment criteria
conducting parallel Assessment tools: case study
assessment events, scenarios, role play scripts,
assessment strategies scenarios, assessment
and approaches are checklists, observation
consistent checklists, etc
Consistent instructions Instructions to candidates
are provided to learner/s
and procedures for
undertaking the
assessment
Where work samples are Instructions to assessors /
used, learners are candidates
provided with clear Assessment specifications
guidelines on Other assessment tools (where
requirements relating to applicable): case study
authenticity and currency scenarios, role play scripts,
of submissions scenarios, assessment
checklists, observation
checklists, etc
Where applicable, Assessment methods
assessment specifications Instructions to assessors /
and tools are able to candidates
produce consistent Assessment criteria
assessment outcomes Other assessment tools (where
conducted in different applicable): case study
contexts
- 41 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Compliance Mitigating Factor
Suggested areas to look into
Underlying Principle (if non-
(not limited to) Yes No
compliant)
scenarios, role play scripts,
scenarios, assessment
checklists, observation
checklists, etc
Principle of Assessment - Flexibility
The assessment approach Assessment methods
can be adapted to meet Instructions to assessors /
the needs of all candidates
candidates, workplaces Assessment criteria
and/or stakeholders. Other assessment tools (where
applicable): case study
scenarios, role play scripts,
scenarios, assessment
checklists, observation
checklists, etc
Wherever practical and Instructions to assessors /
appropriate, assessment candidates
can be negotiated and Other assessment tools (where
agreed between the applicable): case study
assessor and the scenarios, role play scripts,
candidate scenarios, assessment
checklists, observation
checklists, etc
The assessment strategy Assessment specifications
adequately covers both Assessment criteria
on and off the job Other assessment tools (where
components of the applicable): case study
training scenarios, role play scripts,
scenarios, assessment
checklists, observation
checklists, etc
Policies, procedures, Instructions to assessors /
guidelines and standards candidates
are put in place to Assessment specifications
support assessors in the
consistent application of
reasonable adjustment/s
where required
Principle of Assessment - Fairness
Candidates are given Instructions to assessors /
clear and timely candidates
information on Assessment specifications
assessment and what is
required.
Information provided to Instructions to candidates
candidate/s covers:
the assessment
method/s
assessment process
- 42 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Compliance Mitigating Factor
Suggested areas to look into
Underlying Principle (if non-
(not limited to) Yes No
compliant)
the criteria against
which they are being
assessed
when and how they
will receive feedback
appeal process
Assessment strategy Assessment methods
caters for and supports Instructions to assessors /
the language, literacy and candidates
numeracy needs of all Assessment criteria
candidates in accordance Other assessment tools (where
with the assumed skills applicable): case study
and knowledge provided scenarios, role play scripts,
in the CTAG (where scenarios, assessment
provided) checklists, observation
checklists, etc
Special needs (e.g.; Instructions to assessors /
geographical, financial, candidates
social) of the candidate/s Assessment specifications
have been considered in
the development and
conduct of the
assessment strategy.
Reasonable adjustment Instructions to assessors /
can be made to the candidates
assessment strategy to Assessment specifications
ensure equity for the
candidate/s, while
maintaining the integrity
of the outcomes.
Opportunities for Instructions to assessors /
feedback and review of candidates
all aspects will be Assessment specifications
provided to candidates.
Rule of Evidence – Validity
Assessment strategy and Assessment specifications
tools accurately address Assessment criteria
all PS / PERFORMANCE Other assessment tools (where
CRITERIA and UK to prove applicable): case study
competence of the scenarios, role play scripts,
learners scenarios, assessment
checklists, observation
checklists, etc
Rule of Evidence – Sufficiency
Enough / More than Assessment specifications
enough* evidence is Assessment criteria
provided to confirm that Other assessment tools (where
the learner is competent applicable): case study
in meeting all PS / scenarios, role play scripts,
- 43 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Compliance Mitigating Factor
Suggested areas to look into
Underlying Principle (if non-
(not limited to) Yes No
compliant)
PERFORMANCE CRITERIA scenarios, assessment
and UK checklists, observation
checklists, etc
* As a general guide,
there should be multiple
sources of evidence (e.g.
at least two methods per
assessment plan)
Rule of Evidence – Currency
Evidence collected is Instructions to assessors /
based on current candidates
situation and is not Assessment criteria
outdated. Other assessment tools (where
applicable): case study
scenarios, role play scripts,
scenarios, assessment
checklists, observation
checklists, etc
Evidence collected is not Instructions to assessors /
gathered across a period candidates
that is too long (e.g. six Assessment specifications
months)
Rule of Evidence – Authenticity
Evidence of competence Instructions to assessors /
provided by learners are candidates
produced by the learner Assessment specifications
himself / herself alone Assessment criteria
Other assessment tools (where
applicable): case study
scenarios, role play scripts,
scenarios, assessment
checklists, observation
checklists, etc
- 44 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
WSQ Curriculum Development and Pre-Accreditation Checklist
This Checklist serves as a self-assessment tool for the ATO to ascertain if their proposed
course is likely to meet WSQ course accreditation (CA) requirements.
Detailed descriptions of the criteria are provided to enable Curriculum Developers and ATOs
to determine if their proposed course meets the expectations of a WSQ course and if not, to
do the necessary revisions and enhancements before submitting the course to WDA for
accreditation.
After a course is submitted for accreditation, the ATO will be given up to 10 working days to
do any necessary revisions and enhancements. Thereafter, the application may be audited
based on the latest set of documents available to WDA.
It is therefore important that the ATO conducts a self-check before submitting the course for
accreditation.
The Checklist is a reference guide and added resource for Curriculum Developers and
ATOs. The Checklist does not need to be submitted with the CA application.
1.1.2 Mandatory learning strategies and requirements (if specified in CTAG) Yes No
- 45 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
o Are activities planned to have variety to sustain the learner’s interest,
engage and motivate them?
o Are activities planned to incorporate checkpoints for summary, recap of
learning etc to maximise learning retention?
Is the time allocated for learning and activities appropriate and sufficient?
1.1.5 Trainer Materials are complete, meet needs of trainer and comprise
Yes No
these documents :
Glossary provided
Version control
Is Validity ensured?
o evidence meets the specified criteria of the competency standards
Is Authenticity ensured?
o evidence produced is/can be/will be verified to be the candidate’s own
work
Is Sufficiency ensured?
o enough evidence is gathered to show competency against all specified
criteria of the standard/s
Is Currency ensured?
o Evidence to be gathered are current, relevant and applicable in today’s
context
- 47 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
In the absence of a specified / recommended ration, is the proposed ratio
appropriate?
Note:
ATO may be asked to justify and provide explanations if the proposed ratio
exceeds or do not meet specified / recommendations
Assessment tools are provided e.g. role play scripts, answers to written
tests
Glossary provided
Version control
If subject matter experts (SMEs) are used, the SME/s possess adequate:
o Domain industry experience
o Domain industry qualification
Note:
CVs of all SMEs to be submitted for reference and verification. ATO may be
further asked to provide copies of relevant certificates/scrolls/transcripts.
ATO is to also note that submission of profiles for SMEs is not sufficient.
- 48 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
1.4.1 Proposed facilities, equipment and other resources Yes No
1.4.2 Training and assessment site/s comply with all fire, health and safety
Yes No
requirements
- 49 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
References
Dannefer, E. F., and Henson, L. C. (2007). The portfolio approach to
competency-based assessment at the Cleveland Clinic Lerner College of
Medicine. Academic medicine, 82(5), 493-501.
- 50 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Useful Websites
CA self-assessment checklist -
http://app2.wda.gov.sg/data/ImgCont/948/WDA-WSQ-
Curriculum%20Development%20&%20Pre-
Accreditation%20Checklist(1Aug11)v1.pdf
- 51 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)
Version Control Record
Version Effective Date Changes Author/s
th
1.0 27 August 2012 Initial version QAD
th Inclusion of additional notes for
1.1 14 October 2012 QAD / IAL
CD workshop for Public ATO
- 52 -
Singapore Workforce Development Agency – Quality Assurance Division
Develop Competency-Based Assessment Plans
Version 1.1 (14 October 2012)