Professional Documents
Culture Documents
A universal standard?
The Common European
Framework of Reference
87
Multilingual Frameworks
Table 4.1 Summary of the development of the CEFR (from Cambridge ESOL
2011:8)
1960s and 1970s: The Council of Europe’s Modern Languages projects start in the 1960s
Emergence of and (following 1971 intergovernmental Symposium in Rüschlikon)
the functional/ include a European unit/credit scheme for adult education. It is in the
notional context of this project that the concept of a ‘threshold’ level first arises
approach (Bung 1973).
Publication of the Threshold Level (now Level B1 of the CEFR) (van
Ek 1975) and the Waystage level (van Ek and Alexander 1977) (now
Level A2 of the CEFR).
Publication of Un Niveau-seuil (Coste 1976), the French version of the
Threshold model.
1977 Ludwigshafen Symposium: David Wilkins speaks of a possible set
of seven ‘Council of Europe Levels’ to be used as part of the European
unit/credit scheme.
88
A universal standard? The Common European Framework of Reference
The CEFR levels did not suddenly appear from nowhere. They have
emerged in a gradual, collective recognition of what the late Peter
Hargreaves (Cambridge ESOL) described during the 1991 Rüschlikon
Symposium as ‘natural levels’ in the sense of useful curriculum and
examination levels. . . . The first time all these concepts were described
as a possible set of ‘Council of Europe levels’ was in a presentation
by David Wilkins (author of ‘The Functional Approach’) at the 1977
Ludwigshafen Symposium . . .’
89
Multilingual Frameworks
90
A universal standard? The Common European Framework of Reference
In defining the scales he explicitly sought to find a best fit to an existing notion
of levels. This was done:
• by referring to logit values in an attempt to create a scale of more or less
equal intervals
• by looking for patterns and clusters, and apparently natural gaps on the
vertical scale of descriptors which might indicate ‘thresholds’ between
levels
• by comparing such patterns to the intentions of the authors of the
source scales from which descriptors had been taken or edited, and to
the posited conventional or ‘natural levels’ (North 2000:272).
Thus both the Cambridge ESOL Common Scale and the CEFR’s Can Do
scales refer their levels to familiar cohorts of language learners. However,
the two approaches to scale construction are quite different, the former being
based on vertical linking of the objectively marked components of a suite of
exams, and the latter on the judgement of groups of teachers as to the ability
of their students relative to Can Do statements. Both use IRT, and it will be
useful to consider in a little more detail the nature of an IRT scale.
The measurement unit of an IRT scale is called a logit. A distance of one
logit between a task and a person represents a specific probability of the
person responding correctly to the task – that is, makes a specific predic-
tion about performance. Thus a difference of one logit entails a particular
observable difference in performance, which we might expect to be constant
across the ability continuum. Would we then expect the ‘natural levels’ to be
separated by roughly the same observable difference? As shown above, this
is how North’s original 9-level scale was defined. However, this 9-level scale
was adapted for the 6-level CEFR by combining levels, so that A2, B1 and
B2 contain ‘plus levels’ and are about twice as wide in logit terms as the other
levels.
The Cambridge ESOL Common Scale covered the range from KET to
CPE (A2 to C2), and Jones (2005a) used data from the Young Learner tests
to add a provisional A1 level. The lower Cambridge levels are significantly
wider than the higher: the logit interval defined below A2 is as wide as that
between the B1 and C2 thresholds.
There is agreement that higher levels generally take progressively more
effort or ‘learning hours’ than lower ones. Thus a given learning effort makes
a bigger observable difference at lower levels than at higher. Consistent with
our experience, this suggests that what is observable, and hence measurable,
in language proficiency is proportional gain. The difference in the Cambridge
logit bandwidths between lowest (Young Learner) and highest (CPE) levels
clearly reflects this (see too Figure 3.3 on page 73).
Figure 4.1 illustrates four scales defined according to different principles,
anchored at the A1 and C2 thresholds (against an arbitrary 10-unit scale).
91
Multilingual Frameworks
The linear scale is the simplest: all six thresholds are equidistant. This imple-
ments the ‘constant observable difference’ principle. North’s PhD study
(1996) defined a 9-level framework on this basis.
The highest curve in Figure 4.1 implements the ‘proportional gain’ model,
a hypothetical framework where the levels are separated by a constant
quantity of learning effort.
6
Scale units
5
Proportional gain
4
CEFR 6-level
3 Linear
approx. Cambridge
2
0
A1 A2 B1 B2 C1 C2
Levels
92
A universal standard? The Common European Framework of Reference
as a measurement scale must be careful to link like with like. The attempt
to link the ALTE Can Do project to the CEFR (Section 3.4) was valid to
the extent that the scales were constructed in similar ways; but to link cali-
brated objective test data directly to the CEFR’s Can Do scales would not be
meaningful.
93
Multilingual Frameworks
may be due to the very success of the illustrative descriptors, which as the
above-mentioned survey demonstrates, remain the best known component
of the CEFR. Intentionally the descriptors focus on observable outcomes of
learners’ competence – that is, on measurable Can Do terms – rather than
focusing on the processes underlying performance.
In developing the descriptive scales for the CEFR, North (1996, 2000)
selected Can Do statements from a wide range of existing sources, then
amended them through workshops with teachers. They were then used by
teachers to rate a total of 2,500 students, providing data for a Rasch analy-
sis to calibrate the statements. To this extent, the scales constructed from
the Can Do descriptors in the CEFR can be seen as empirical constructions
rather than armchair conjectures as to the nature of progression. However, it
has been suggested (Alderson 2007, Hulstijn 2007), that because of the proce-
dures adopted the descriptors reflect teacher perceptions of how learners pro-
gress rather than empirical observation of the learners themselves. Shohamy
(1996:146) argues that the scales only give the ‘illusion that they were based
on something scientific, on theory’.
These criticisms are perhaps insufficiently sympathetic to issues which
North (1996, 2000:2) is well aware of. The CEFR scaling project:
94
A universal standard? The Common European Framework of Reference
I don’t see, at the moment, any sign that much of the work which is cur-
rently being done in theoretical linguistics is in fact leading to our getting
greater control over the problems in the individual and in society; [. . .]
I become rather impatient with theoretical criticism which doesn’t actu-
ally provide anything to put in its place.
95
Multilingual Frameworks
CEFR on its own terms – it is not a case of applying the CEFR prescriptively
to every context. The CEFR is not presented as a bible, and it is ironic that its
severest critics often seem to perceive it as one. It is an area of ongoing work.
Thus Trim states:
What [the CEFR] ‘Can Do’ is stand as a central point of reference, itself
always open to amendment and further development, in an interactive
and international system of cooperating institutions . . . whose cumula-
tive experience and expertise produces a solid structure of knowledge,
understanding and practice shared by all (Trim in Green 2012:xli).
The CEFR states at the outset: ‘We have not set out to tell people what to
do or how to do it’ (Council of Europe 2001:1). However, we can imagine
many readers feeling disappointment at encountering this often-cited state-
ment, because explicit instruction is just what they would have appreciated.
And certainly, the CEFR is not neutral with respect to how it views the
purpose and value of language education. A conference held by the Council
of Europe in 2007, prompted by concerns that the CEFR text was in many
contexts being misunderstood or misused, was found to have served use-
fully to ‘clarify the status and the purpose of the CEFR – as a descriptive
rather than a standard-setting document it allows all users to analyse their
own situation and to make the choices which they deem most appropriate to
their circumstances, while adhering to certain key values’ (Council of Europe
2007:7). Byram and Parmenter (Eds) (2012:5) cite this extract to stress the
‘value-bearing’ nature of the CEFR text.
The need to provide support in understanding and using the CEFR has
been recognised by Cambridge English. While consistently stressing the open
and extensible nature of the CEFR, Cambridge has offered practical guide-
lines in the form of Using the CEFR: Principles of Good Practice (Cambridge
ESOL 2011).
96
A universal standard? The Common European Framework of Reference
The cited recommendations are also reasonably clear on telling people how
to do it:
97
Multilingual Frameworks
(Saville 2011). That evolution might yet take us much further. We can under-
stand why the Guide for the Development and Implementation of Curricula for
Plurilingual and Intercultural Education (Council of Europe 2010:29) might
assert that ‘language teaching in schools must go beyond the communication
competences specified on the various levels of the CEFR’. We can envisage
more complex conceptions of the goals of language education; in fact, each
country already has its own more complex conception, within which the pro-
motion of communicative competence may be only one priority. Certainly,
when we set out to advise a country on how to adopt the CEFR we should
be sensitive to such issues and ready with ideas on how to exploit the positive
synergies between developing communicative competence and other goals of
language education.
Thus the dynamic development of a broad community of practice con-
cerning the purposes of language study may naturally lead to convergence
on how to extend goals and outcomes beyond the CEFR’s narrower focus on
communicative language competence. That would represent a challenge for
language assessment, but one consistent with the spirit of the age. The frame-
works described in this volume all focus on assessment, specifically of lan-
guage ability. Generally, they stand outside educational processes. As exam
providers move to involve themselves more closely in learning, and we begin
to define our business as that of ‘language education’ rather than ‘proficiency
testing’, we will need different, broader frameworks. The concluding chapter
of this volume explores such possibilities in more detail.
98