Professional Documents
Culture Documents
Introduction
Good language teachers are constantly assessing their students’ performance
in class for a variety of objectives beyond achievement or evaluation pur-
poses. They notice and gather evidence in various forms on how learners
perform in interactive classroom activities, how they complete written and
spoken exercises, what vocabulary they seem to gain and what they struggle
with, what syntactic forms pose problems for them, and what aspects of the
target discourse they control or have difficulties with. For example, a teacher,
after a few weeks of class instruction, could probably assess one of the
students as follows:
James is quite good at understanding and producing spoken French, and his social
vocabulary is one of his strong points, but his use of formal vocabulary and grammar
are a bit weak, and his reading and writing skills are things we’ll have to work on.
Teachers may get the information for this type of assessment spontaneously and
rather casually through noticing during the progression of class activities, or
sometimes more intentionally as when reviewing a homework assignment with
a student or giving feedback on a class presentation. This type of language
assessment is useful for developing or revising lesson plans or for providing
support to learners to help them progress (Little & Erickson, 2015; Norris,
2016). However, there are a number of potential challenges with this type of
informal classroom assessment:
• First, it is heavily grounded in the moment and a specific context, and thus, it
is difficult to assess all learners in the class in the same way, that is, with equal
opportunities to demonstrate their proficiency. Moreover, this practice poses
a challenge of fairness and consistency in language assessment.
• Second, and related to the first issue, during informal assessment, it is
difficult to hold all learners to the same standard, which makes it proble-
matic to compare one with another against criteria that apply to all in the
same way.
107
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
108 Shahid Abrar-ul-Hassan and Dan Douglas
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
Assessment and Good Language Teachers 109
We will refer to these concepts later in the chapter. Two more basic concepts we
will introduce here and refer to later are the following:
• Summative assessments, which are usually carried out at the end of a unit or
course of study to measure achievement.
• Formative assessments, the purpose of which is to provide learners with
information about their progress that they can use to guide their continuing
learning, or to provide teachers with information that they can use to guide
course development and lesson planning.
We will turn now to a consideration of the practice of language assessment.
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
110 Shahid Abrar-ul-Hassan and Dan Douglas
In this test task, the learners have to read a passage, using their knowledge of
vocabulary and syntax, how texts are constructed in Norwegian, and cultural
information about libraries to make an inference that because the son likes stories
that make him smile, the correct answer is “c. Morsommehistorier (funny stories).”
This type of integrative test task is part of a family of language tests generally
known as communicative language tests. The idea behind communicative
language assessment is that even if learners control all the components of
a language – the phonology, the vocabulary, the syntax – they may still be
unable to communicate without an ability for language use (Douglas, 2010).
This ability includes knowledge of what functions the grammar can commu-
nicate (e.g., how to apologize, complain, congratulate) and what is socially
appropriate to say or write in a particular situation (e.g., whether one can use
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
Assessment and Good Language Teachers 111
a first name or must use a title and family name). Communicative tests involve
productive language used in specific contexts, as realistic input for learners to
comprehend and respond to, and/or as output produced by the learners. Reading
comprehension tasks, such as the one illustrated above, speaking tasks in
interview format, listening comprehension tasks in which test takers hear an
extended text and then must produce a summary, and writing tasks involving
filling in a personal information form are all examples of communicative
assessment tasks. Such tasks may be scored on a right/wrong basis, as in the
Norwegian task above, or rated according to a scale, either as a whole perfor-
mance (e.g., superior, good, average, poor) or as categories of language
knowledge with separate scores (say, three out of four, for example) for
grammar, vocabulary, usage, mechanics, style, and organization as well as
a total score.
Another approach to measuring learner progress is by task-based or perfor-
mance assessment (Norris, 2016). These two terms have somewhat different
origins and histories in language testing, but they will be used synonymously in
this chapter. As with integrative and communicative language testing, task-
based and performance assessment emphasize specific purpose, authentic, and
complex language use so that both learners’ knowledge of the language and
ability to accomplish communicative tasks with it can be assessed (Douglas,
2010; Norris, 2016). Performance tasks can range from the traditional written
essay or speaking task to more complex group projects in which learners have
to work together to solve a problem with a clear communicative goal. In rating
performance on such tasks, there is the problem of deciding whether successful
completion of the task itself is necessary or not. On the surface, it would seem
that task completion is essential, but tasks can be difficult to complete for
reasons that may be outside the test takers’ control – for example, in a task
where learners design a poster aimed at attracting tourists to their country, their
colored markers may run out of ink before they finish the actual poster. The
overriding concern in task-based assessment should be on the process, not the
outcome, and the focus should be on the language used rather than the correct
answer or response.
Tests are usually considered distinct procedures in which learners are given
instructions and input material that will elicit a language performance in
a measurable way to make an inference about the levels of language knowledge
and skill. However, there are other approaches to assessment that are perhaps
closer to evaluation, which seem less like tests. For example, conference
assessment usually involves teachers meeting one-on-one with learners to
review an assignment, give feedback, or make suggestions for revision
(Brown & Hudson, 1998). In this way, the instructor gets a clear picture of
how well learners are doing and what they may or may not understand.
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
112 Shahid Abrar-ul-Hassan and Dan Douglas
Moreover, talking about a particular piece of work with the teacher can help the
learner develop self-awareness and critical skills.
Closely related to conference assessment is portfolio language assessment
(Hamp-Lyons & Condon, 2000). This involves helping learners compile
a collection of their work, whether written (either on paper or in electronic
format, including blogs or email exchanges) or spoken language. Portfolio
assessment aims to help the learner tune into the learning process and see
progress over time. The instructor can gain diagnostic information about the
learner’s strengths and weaknesses, not only from examining the material in the
portfolio but also by interacting with the learner during the portfolio process.
Portfolios may contain samples of the learner’s best work over time (a show-
case portfolio), or examples of successive drafts of an extended assignment or
different assignments illustrating stages of learning and performance on dif-
ferent types of tasks (a progress portfolio). However, an obvious drawback to
both conference and portfolio language assessments is that they are time-
consuming and require extra resources, such as training, for consistency of
a measurement or reliability.
Another approach to helping learners become more self-aware and aware
of learning goals and criteria involves self- and peer-assessment (Lim,
2007; Turner & Purpura, 2015). This approach can enhance learner auton-
omy and self-motivation. There are two approaches to self- and peer-
assessment:
• Learners can be given, or work with the instructor or in groups, a set of
criteria to develop and then use these to evaluate their own or others’
work either during class or in communicative situations outside of class.
• Alternatively, learners may check can-do statements to self-evaluate com-
municative ability in various circumstances. Examples of can-do statements
include “Can go to a department store or other shop where goods are on
display and ask for what I want” and “Can ask for a refund or exchange of
faulty or unwanted goods” (ALTE, 2002).
Of course, the accuracy of self- or peer-assessments varies with the complexity
of the knowledge or skill being assessed. For example, it is more straightfor-
ward for learners to assess vocabulary knowledge than it is to assess rhetorical
effectiveness. Accuracy also varies according to how important the assessment
is for the learners – when they are rating themselves for the purpose of a class
discussion, modesty militates toward lower self-ratings, but when their assess-
ments might result in shortening a particular section of the curriculum, ratings
tend to be higher. It is important to give the learners plenty of practice with self-
and peer-assessment procedures before conducting them in earnest.
We will now discuss best practices in language assessment in the context of
a small survey of practitioners in the field.
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
Assessment and Good Language Teachers 113
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
114 Shahid Abrar-ul-Hassan and Dan Douglas
administrator in the lead role; he or she initiated as well as managed the process
with some contribution from the instructors who were invited to participate in the
process. Moreover, the role of practitioners varied and included, for example,
providing feedback in meetings, discussing tests, piloting a test, and contributing
to an assigned test project. One participant highlighted the process model, saying:
When a draft is finally completed, the exam goes through a piloting and item analysis
phase. Feedback from instructors is also collected . . . . It is then revised, piloted, and
item analyzed again before it is finally used.
And, similarly, another participant mentioned the management and the key
aspects of the process:
The program coordinator is responsible for all development in conjunction with the lead
teacher . . . for assessment; both individuals have the knowledge, skills, and experience
to lead the development. The program administrator has oversight over the development
and gives final approval.
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
Assessment and Good Language Teachers 115
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
116 Shahid Abrar-ul-Hassan and Dan Douglas
• First, their concerns emanated from their perceived low reliability, validity,
impact, or authenticity.
• Second, they expressed their apprehension regarding the overreliance on or
widespread popularity of traditional examinations among stakeholders, such
as instructors, administrators, and student guardians/sponsors.
Those who expressed some satisfaction based it on the fact that assessment
manifested “the process of multistep exam development and standardization.”
Moreover, the data presented a clear picture about a common practice of
utilizing assessment in isolation rather than as an embedded pedagogical
practice. This finding expands on the achievement focus of language assess-
ment as mentioned in the first section. One participant highlighted that:
from a critical pedagogical perspective, issues of fairness, judgment, and power rela-
tions come into play. Interaction between instructors and students should create roles in
which all voices are validated in assessment design and assessment is seen as negotiated.
Nevertheless, the data indicated some degree of satisfaction with the outcome
of assessment because the assessment was likely to be fair and power was
evenly distributed due to collaboration among instructors, such as using stan-
dard rubrics and maintaining some level of consistency.
The predominant sources of the participants’ assessment literacy were their
foundational graduate courses and experiential learning. The most effective learn-
ing opportunities were afforded through in-service workshops, online courses,
peer support, and hands-on project work. These opportunities, which were essen-
tially collaborative, proved to be customized learning zones and facilitated the
development of the participants’ tacit knowledge. Similarly, one participant found
that “longitudinal on-the-job training can potentially have maximal efficacy.” In
spite of having access to and utilization of a variety of learning opportunities, all
the participants were keen on enhancing their assessment literacy. In particular,
they identified specific areas of assessment literacy for further training, such as
developing scoring rubrics, designing task-based assessment, utilizing
a sociocultural approach in assessment, and expanding alternative assessment
options.
iv) Were you satisfied with the language assessment skills of practitioners
in the postsecondary setting, in general, including yours?
A key aspect of this reflective inquiry was to gain an understanding of the
participants’ self-realized assessment literacy level. Their length of profes-
sional experience ranged from nine to twenty-plus years of English language
education in postsecondary settings. The participants unanimously
expressed dissatisfaction with their own and other practitioners’ assessment
literacy. Although some were more empathic than others, they stressed that
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
Assessment and Good Language Teachers 117
optimized language assessment was the missing (or the weakest) link in
instructional practice. Reflecting on extensive experience, one participant
noted that:
there is generally a lack of assessment literacy; knowledge of key assessment principles
and skills in developing and analyzing assessment tools and procedures. . . . There is
a disconnect between instruction and assessment; what is taught, what is being tested
and learner goals.
This inadequacy of practitioners’ assessment literacy stems from several
factors:
• First, language assessment courses are not comprehensive and tend to focus
on testing.
• Second, these courses do not facilitate fully turning practitioners’ declarative
knowledge into procedural knowledge and then honing this procedural
knowledge through assessment projects.
• Third, language programs are teaching centered where assessment is primar-
ily limited to achievement purposes. A participant emphasized, “We all need
to receive more language assessment training in order to serve our students
better.”
In view of language assessment being relegated to a diminished role, “There is
a long way to go to upgrade the skills and knowledge of practitioners,”
according to one participant.
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
118 Shahid Abrar-ul-Hassan and Dan Douglas
student work, so that students can be primed to engage with and act on
feedback messages.
LOLA assumes that the primary goal of assessment in classroom contexts is to
promote learning processes and further successful learning outcomes, whether
this involves formal and planned or informal and spontaneous assessments
embedded in instruction (e.g., Katz, 2014). For instance, formal, planned
language assessment might include end-of-chapter tests that reflect the content
and style of learning activities to help learners see what they have learned and
where they would benefit from more practice. Planned assessments might also
involve regularly scheduled learner activities such as group discussions, indi-
vidual presentations, or team projects that give the instructor opportunities to
evaluate and comment on the performances, providing feedback that can be
used to motivate the learners and help them improve. Language assessment in
the classroom might also be more informal and unplanned, as when conducting
a vocabulary activity; for example, the teacher notices that the learners seem
not to grasp fully the meaning of an item and interrupts the activity to elaborate
on the meaning and deepen learners’ understanding. The goal of learning-
oriented language assessment is the development of knowledge, skills, and
abilities over time in the classroom through planned and unplanned assess-
ments and the provision of interactional feedback that facilitates learning
(Turner & Purpura, 2015) in a language teaching context.
Conclusion
This chapter has considered how good language teachers can assess their
students in terms of evaluation, measurement, and testing, and reasons have
been suggested for using more formal language tests, including providing for
fairness and consistency in evaluating learners’ progress, holding all learners to
the same standard, ensuring more complete coverage of what has been taught,
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
Assessment and Good Language Teachers 119
References
ALTE. (2002). The ALTE can do project. Cambridge: Association of Language Testers
in Europe. Retrieved from: www.cambridgeenglish.org/images/28906-alte-can-do-
document.pdf.
Brown, J. D., & Hudson, T. (1998). The alternatives in language assessment:
Advantages and disadvantages. TESOL Quarterly, 32(4), 653–675.
Carless, D. (2015). Exploring learning-oriented assessment processes. Higher
Education, 69(6), 963–976.
Cheng, L., & Fox, J. (2017). Assessment in the language classroom. London: Palgrave.
Creswell, J. (2014). Research design: Qualitative, quantitative, and mixed methods
approaches (4th ed.). Thousand Oaks, CA: Sage.
Douglas, D. (2010). Understanding language testing. London: Routledge.
Farrell, T., & Mom, V. (2015). Exploring teacher questions through reflective practice.
Reflective Practice, 16(6), 849–866.
Hamp-Lyons, L., & Condon, W. (2000). Assessing the portfolio: Principles for practice,
theory, and research. Cresskill, NJ: Hampton Press.
Johnson, K. (2009). Second language teacher education: A sociocultural perspective.
New York, NY: Routledge.
Katz, A. (2014). Assessment in second language classroom. In M. Celce-Murcia,
D. Brinton, & M. Snow (Eds.), Teaching English as a second or foreign language
(pp. 320–337). Boston, MA: National Geographic Learning.
Lim, H. (2007). A study of self- and peer-assessment of learners’ oral proficiency. In
N. Hilton, R. Arscott, K. Barden, A. Krishna, S. Shah, & M. Zellers (Eds.),
Proceedings for the Fifth Cambridge Postgraduate Conference in Linguistics (pp.
169–176). Cambridge: Cambridge Institute of Language Research.
Little, D., & Erickson, G. (2015). Learner identity, learner agency, and the assessment of
language proficiency: Some reflections prompted by the Common European
Framework of Reference for Languages. Annual Review of Applied Linguistics, 35,
120–139.
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012
120 Shahid Abrar-ul-Hassan and Dan Douglas
Norris, J. (2016). Current uses for task-based language assessment. Annual Review of
Applied Linguistics, 36, 230–244.
Stiggins, R. (1995). Assessment literacy for the 21st century. Phi Delta Kappan, 77(3),
238–245.
Turner, C., & Purpura, J. (2015). Learning-oriented assessment in the classroom. In
D. Tsagari & J. Banerjee (Eds.), Handbook of second language assessment
(pp. 255–272). Berlin: De Gruyter Mouton.
Weir, C. (2013). An overview of the influences on English language testing in the United
Kingdom 1913–2012. In C. Weir, I. Vidakovic, & D. Galaczi (Eds.), A history of
Cambridge English examinations (pp. 1–102). Cambridge: Cambridge University
Press.
Downloaded from https://www.cambridge.org/core. University of Southampton Library, on 10 Mar 2022 at 03:32:00, subject to the Cambridge
Core terms of use, available at https://www.cambridge.org/core/terms. https://doi.org/10.1017/9781108774390.012