Universidad Técnica Particular de Loja

Language Testing

Scoring rubrics
and evaluation
Why do we use scoring rubrics when assessing
speaking and writing skills?
What is the difference between holistic and
analytic rubrics?

Diego Roblez Espinoza Teacher: Lisset Toro Gallardo

Scoring rubrics and evaluation

Rubrics
Rubrics are often considered as the most effective
grading devices
→
Stevens and Levi (2005) a rubric is a scoring tool that lays out
the specific expectations for an assignment.
Rubrics divide an assignment into its component parts and
provide a detailed description of what constitutes acceptable or
inacceptable levels of performance for each of those parts.

Research papers
Book critiques
Discussion participation
variety of
Laboratory reports
Portfolios
ge
Lar tasks
Group work
Oral presentations, and more
Scoring rubrics and evaluation

Why do we use scoring rubrics when

assessing speaking and writing skills?
When we want to evaluate our Ss’ ability to use the language in speaking or writing, we
generally need to elicit more language than we can obtain from limited production
responses. Therefore, we will use tasks that include prompts aimed at eliciting extended
production responses.
For scoring extended production responses, the criteria for evaluating the quality of Ss’
responses are defined as several levels on one or more rating scales or scoring rubrics
of language ability

Rubrics provide timely feedback

Rubrics prepare students to use detailed feedback

y reasons Rubrics encourage critical thinking

Six ke Rubrics facilitate communication with others

Rubrics help teachers to refine teaching methods
Rubrics level the playing field
Scoring rubrics and evaluation

What is the difference between

holistic and analytic rubrics?
Let's analyze each type
independently
Scoring rubrics and evaluation

Holistic rubric
Scoring rubric in which the Ss’ performance is rated
in terms of its GENERAL quality or level of ability
Contains a description of the highest level of performance expected for each
dimension, followed by room for scoring and describing in a “Comments” column just
how far the Ss has come towards achieving or not achieving that level

In most learning and teaching environments we are

ficiencies interested in assessing specific aspects of language

ability or specific learning objectives.

De Holistic rubrics provide only a single score, they are

not very useful for providing feedback to our Ss
Scoring rubrics and evaluation

Holistic rubric
Things we like doing the most
Task description: Each student will post a 2 to 3-minute audio clip on Padlet talking about hobbies since it has been said that as
human beings, we must find three hobbies we love: one to be creative, one to keep you in shape, and one to help you make money.
The students may focus the audio clip on just one type of hobby, but it is acceptable to choose two categories. The audio clip should
include task completion, comprehensibility, fluency, vocabulary, and language control or control of grammatical structures.
Scoring rubrics and evaluation

Holistic rubric
Scoring rubrics and evaluation

Analytic rubric
Rating scale in which the Ss’ performance is rated in terms of
MULTIPLE COMPONENTS, each of which is rated on a
separate scale
Analytic rubrics make it possible for us to include specific learning objectives in our
definition of the ability to be assessed.

They provide separate ratings or scores for each

trengths aspect of the ability

S They have more potential for providing feedback to

our students.
Scoring rubrics and evaluation

Analytic rubric
It is incredible how much I have changed since I was a child

Task description: Each student will write a 50 to 100-word paragraph about the most
noticeable aspects that they have changed since they were children. They should take into
account the idea that every single day we change a little bit, and that is part of growing up and
becoming adults. In order to write the paragraph, students should answer two core questions:
Do you remember how you used to be as a child? How much have you changed since you
were a little girl or boy?
Scoring rubrics and evaluation

Analytic rubric
Scoring rubrics and evaluation
Holistic rubric
Holistic rubric Analytic rubric
Comparison of
holistic and
analytic scales
Lower than analytic but still acceptable Higher than holistic
R e li a b i li t y

Cushing (2009) makes an interesting

Holistic scale assumes that all relevant Analytic scales take into consideration
comparison of holistic and analytic
t
scales on five qualities of test C o nstru c aspects of language ability develop at that different aspects of language skills
usefulness: v a li d i t y the same rate and can thus be develop at different rates
captured in a single score
Reliability
Construct validity
Practicality
Impact Relatively fast and easy Time-consuming and expensive
a c t i c a li t y
Authenticity Pr
 Holistic rubric
Holistic rubric Analytic rubric
Single score may mask an uneven skill More scales provide useful diagnostic

Comparison of Im p a c t
profile and may be misleading for
placement
information for placement and/or
instruction.

holistic and
analytic scales Reading holistically is a more natural Raters may read holistically and adjust
thenticity process than reading analytically analytic scores to match holistic
Au
impression
 Scoring rubrics and evaluation

Bibliographic references

Bachman, L., & Damböck, B. (2017). Language Assessment for Classroom Teachers.
Oxford University Press.
Cushing, S. (2009). Assessing Writing. Cambridge University Press.
Richards, J., & Schmidt, R. (2010). Dictionary of Language Teaching & Applied
Linguistics (Fourth ed.). Pearson Education.
Stevens, D., & Levi, A. (2005). Introduction to Rubrics: An Assessment Tool to Save
Grading Time, Convey Effective Feedback, and Promote Student Learning. Stylus
Publishing.
Language Testing
That's a Thank you
wrap!