Professional Documents
Culture Documents
10. Confidence- based marking: towords deeper learning and better exams ,
Developing group learning through assessment
Have you ever been uncertain of an answer for a multiple-choice test question, so
guessed and got it right? It’s almost certain that you have – and therein lies the
problem with traditional multiple-choice assessment. The learner’s knowledge appears
to be sufficient for them to move on to a new area for learning, even though it’s not.
Certainty Based Marking, which we’ve introduced as part of the learning drills and
assessments on the Wranx platform, overcomes precisely this problem. Not only must
learners indicate which possible answer they think is correct, they must also indicate
how certain they are that their chosen answer is correct. So, for example, with three
levels of certainty offered – high, medium and low– this makes it possible to make the
following conclusions:
Correct answer, high certainty – the learner is sufficiently knowledgeable and
confidently so
Correct answer, medium certainty – the learner’s knowledge needs some
reinforcement
Correct answer, low certainty – the learner lacks knowledge and needs continued
teaching
Incorrect answer, low certainty – the learner lacks knowledge and needs continued
teaching
Incorrect answer, medium certainty – the learner lacks knowledge and needs
continued teaching, but believes they may be correct
Incorrect answer, high certainty – the learner lacks knowledge and needs continued
teaching, but believes they are correct
The benefits of Certainty Based Marking don’t stop there, though. It also encourages
employees to give more thought to how reliable their knowledge is, helps them to
understand underlying issues rather than just to react to a question and promotes
lateral thinking as means of validating or questioning an answer.
To encourage honesty from learners, Certainty Based Marking gives higher marks for
more confident correct answers. For the least confident incorrect answers, you won't
be penalised. The Wranx platform uses the standard CBM scoring scale for
assessments:
Correct answer, high certainty: +3 to your score
Correct answer, medium certainty: +2 to your score
Correct answer, low certainty: +1 to your score
Incorrect answer, low certainty: 0 to your score
Incorrect answer, medium certainty: –2 to your score
Incorrect answer, high certainty: -6 to your score
This approach means learners are less likely to risk losing marks if they’re uncertain. As
a result, organisations can be more confident that they are getting an accurate
reflection of a learner’s knowledge than they might otherwise. In addition, careful
thinkers who have not typically been very confident can gain in confidence and marking
is fairer by awarding more considered responses higher marks.
Fundamentally, Certainty Based Marking offers a more safeguarded approach to
employee learning for organisations. It helps employees to learn in a more
comprehensive and rounded way – and thus workforces to become more highly and
broadly skilled.
11. Flow assessment
Flow charts are one type of graphic organiser where students’ thinking can be made
visible. Creating a flow chart from oral, visual, and written texts can help students think,
and reflect on their thinking. Flow charts visually represent textual relationships that
are linked by time. In creating a flow chart, students describe a sequence of events,
stages, phases, or actions that lead to an outcome.
The theory
The use of graphic organisers has been found to improve reading comprehension at all
levels and across content areas. The National Reading Panel (2000) cited the use of
graphic organisers as being one of the seven most effective instruction strategies for
improving reading comprehension. Flowcharts were introduced in the 1940/50s and
popularised in the 1970s, particularly in the business sector.
When students create (or fill in a blank) flow chart, their thinking about the following
will be made explicit:
their understanding of the initiating event and subsequent events, ie., their ability to
rank;
their understanding of the stages in the process, i.e., their ability to order;
their understanding of how the stages are connected, i.e., their ability to link; and
their understanding of the goal or final outcome, i.e., their ability to conclude.