Professional Documents
Culture Documents
Introduction In her influential article on testing and assessment, Clapham (2000: 150)
comments that: ‘[A]ssessment is used both as a general umbrella term to
cover all methods of testing and assessment and as a term to distinguish
alternative assessment from testing.’ Similarly, Clapham proposes a
distinction between ‘testers’ who design and deliver reliable and valid high-
stakes tests and ‘assessors’ who prepare real-life communicative tasks for
their students, even though she acknowledges that the two terms are often
used interchangeably by experts, herself included. If we accept Clapham’s
distinctions, classroom teachers fit more obviously into the category of
assessors concerned with assessment than of testers concerned with testing.
Effective assessment can support and promote learning, and therefore
a teacher’s ability to engage with a range of teaching, learning, and
assessment practices is essential. As Crusan, Plakans, and Gebril (2016)
suggest, it is the students who lose out if assessment practices are poor.
However, concerns have been expressed about the level and quality of
teacher training in assessment (Fulcher 2012; Crusan et al. 2016). In
general education, the term assessment literacy has been used to describe
the knowledge teachers should have about assessment. The term has been
adapted and adopted by experts in language assessment, with Malone
proposing the following definition of language assessment literacy:
This paper describes a project which sought to bring the voice of the
teacher into the debate concerning what teachers actually know, and
what they should know, about assessment. After a brief discussion of
how surveys and classroom observations have been used to research
assessment, this paper describes qualitative data collection and findings
on teachers’ voices concerning assessment.
Classroom research Stoynoff (2012:531) claims that ‘survey results need to be complemented
with other empirical evidence of the effect of teacher characteristics on
assessment practices’. Several studies have attempted to address this
statement either using mixed-methods or through classroom observation.
One example is Yin (2010), who conducted a series of observations and
interviews with two tutors of English for Academic Purposes. He found
that teachers had two sets of beliefs about classroom assessment. One set,
strategic cognitions, related to planning classroom activities. These were
based on the individual teacher’s beliefs about teaching and institutional
conditions such as the course syllabus. The other set, interactive cognitions,
were drawn on in the classroom. These were based on knowledge of level
and on experiences of working with particular groups of students. Although
Yin’s project did not focus on language assessment literacy as such, the
discussion of the teachers’ assessment practices suggests that they deployed
a range of assessment techniques (for thorough reviews of the literature on
the effect of teachers’ identity and beliefs on their assessment practices, see
Xu and Brown 2016; Looney, Cumming, van Der Kleij, and Harris 2017).
Methodology The aims of the study were twofold: (1) to gain a greater understanding of
Aims of the study teachers’ knowledge of assessment through actual observation of classroom
assessment practices and through focus group discussions; (2) to use the
knowledge gained from the observations and discussions to develop training
materials which meet teachers’ actual stated needs. The major focus of
Participants Participants in the study were teachers who were based in Europe at the
time of the project but many of them talked about work and training
experiences from beyond Europe in both state education and private
language schools. A total of 54 teachers participated in the study, 28 of
them female and 26 male, with ages ranging from 25 to 60 years. The
teachers had come into the profession through various routes and had
Research questions The following research questions (RQs) informed our project:
RQ1 What are teacher attitudes to assessment?
RQ2 How confident do teachers feel about engaging in assessment
activities?
RQ3 How confident do teachers feel about engaging in testing?
RQ4 What impact does assessment have on the classroom?
Data collection and We investigated teachers’ practices, beliefs, and attitudes towards
analysis assessment through a range of qualitatively orientated research methods,
Data collection which included individual interviews, classroom observations with
follow-up interviews, and focus group discussions. There were three
stages of data collection.
Stage 1
Stage 1 consisted of semi-structured interviews with three teachers
working in a UK university, which explored what assessment training they
had received and the impact of testing and assessment on their teaching
practice. The teachers were selected for their range of backgrounds and
experience (see Table 1).
Stage 2
Stage 2 comprised classroom observations and follow-up interviews with
three different teachers working at a study centre in a UK university to
determine what assessment practices teachers actually used in the classroom.
Although all the teachers who participated in this stage were British, their
ELT work experience differed considerably (see Table 2). An observation
schedule was used which was inspired by one created by Colby-Kelly and
Turner (2007). The schedule listed 16 types of assessment activities. We
ticked each time we observed any of the activities within a three-minute
period. Every three minutes a fresh observation sheet was started. The
Data analysis In addition to the observation sheets, the final data from the three stages of
data collection consisted of 16 hours of oral discussions. The oral data were
coded by two experienced researchers using the software package Atlas.ti,
version 7 (http://atlasti.com/). The framework used for data analysis was
Davies’ (2008: 335–41) components of assessment literacy: Skills (including
item writing, statistics, test analysis, and using software programmes for test
delivery and analysis) + Knowledge (including issues in measurement and
language description, different models of language learning, teaching, and
testing) + Principles (including the proper use of language tests, their fairness
and impact). A deductive approach was taken to data analysis with each
researcher coding independently, after which the two sets of codings were
compared. Any disagreements were discussed, and a consensus reached.
Results and analysis In this section we will first discuss the data from our classroom
observations and focus group discussions. Using these data, we will then
relate them to each of the four research questions.
Classroom practices Many teachers reported they had received little or no formal training
in assessment, so we were interested in exploring exactly how teachers
developed their assessment practices. One teacher stated: ‘You bring
Training experiences Participants in this study had come into the teaching profession through
a variety of routes. Some had undertaken a degree in English language
teaching, whereas others had taken shorter courses such as CELTA. Most
said that assessment had not been included in their initial training but were
happy with the training they had received. Comments such as: ‘We were
not planning and designing assessments, we were planning and delivering
Training materials Throughout the data-collection process, we asked teachers for their views
on training materials and what they considered to be relevant content for
a course designed to meet their needs. The responses we received focused
on practice-orientated training; theoretically-orientated training was not
requested. One focus group participant stated: ‘I would have liked more
practical elements in my training on assessment—more situation based.’
Another commented: ‘We’d like clear criteria for marking speaking and
writing.’ This indicates that teachers wanted activities they could readily apply
to their teaching. As teachers are busy, the appeal of ready-made activities
is obvious. These requests also support the notion that teachers have little
confidence in their ability to create what they understand assessments to be
and prefer to give responsibility to someone else or to an external agency.
Conclusions and The relationship between teaching, assessment, and testing as practised by
recommendations the participants in our study can be seen in Figure 1, where teaching is the
overall reason for teachers to be in the classroom, assessment in its many
forms is part of that teaching, and testing is only one facet of assessment,
although this is not necessarily how the teachers themselves understand it.
Testing and assessment have been found to have considerable impact
on the classroom. The participants in this project were observed to
successfully deploy a range of assessment techniques, although they did
not characterize them as assessment activities but considered them to be
part of good teaching practice. When they did discuss assessment, they
referred to it as ‘testing’ or, in some cases, as ‘exams’. They also expressed
concern that focusing on tests led to a superficial approach to learning.
The desire was expressed for ready-made materials and the reliance
on external testing agencies seems to be symptomatic of a lack of
confidence. This may be due to the lack of coverage of issues relating
to assessment in initial teacher training or it may be part of an ethical
conflict between both teaching and testing learners. There is evidence
to suggest that teachers develop their assessment practices through
engagement with a variety of teaching and learning experiences. These
Assessment
f i g u r e 1
Relationship between
teaching, assessment, and
testing.
There has been little research to date that relates teachers’ attitudes
to assessment to their actual classroom practice. We would argue that
more classroom-based research should be undertaken to gain a better
understanding of assessment practices and how teachers develop them.
It is clear from our research that teachers are continually engaging
in assessment activities and this should receive more recognition. In
Clapham’s (2000) terms, the teachers who participated in our study are
not ‘testers’ engaged in testing, but they most certainly are ‘assessors’