Professional Documents
Culture Documents
147
c 1997 Kluwer Academic Publishers. Printed in the Netherlands.
Nomination:
‘Some expert judgements’ live on
MOGENS N. PEDERSEN
Odense University, Denmark
Reflections:
Revisiting expert judgements
PETER MAIR1 & FRANCIS G. CASTLES2
1 Leiden University, The Netherlands; 2 Australian National University
Our original article (Castles & Mair 1984) was conceived in the European
University Institute in Florence, where we were both involved in a relatively
undisciplined but eventually very fruitful and productive research project on
‘The Future of Party Government’, directed by the late Rudolf Wildenmann.
Indeed, the fact that it proved possible to plan and execute such an expert
survey at that time owed a great deal to the somewhat chaotic network of
international contacts spawned by Rudolf’s project, as well as to the more
formalized networks which had been created and nourished by the ECPR
over the previous decade or so.
151
Our mutual interest in generating the data on the left-right positioning
of parties was stimulated by two distinct concerns. On the one side, it had
become generally accepted that left-right differences between parties had a
major relevance for public policy outcomes, and a growing body of literature
in the late 1970s and early 1980s had been devoted precisely to the estimation
and measurement of this relationship (e.g. Hewitt 1978; Castles & McKinlay
1979; Cameron 1982; Castles 1982). On the other side, left-right differences
between parties were also seen as particularly relevant within the growing
policy-based coalition literature (e.g., de Swaan 1973), while variations in
the degree of polarization and ideological distancing were seen to be crucial
to the functioning of party systems more generally (Sartori 1976). At the same
time, however, as we pointed out in our original article, the various data from
which these differences could be assessed were remarkably inconsistent and
insensitive. They were either based on either sparse and often incomparable
survey data, or they rested on simple judgement calls, in which the individual
researcher would make an easy but often crude distinction between ‘a left’ and
‘a right’ or between one category of party family and another, and in which,
for example, all social-democratic parties could end up being assigned a
similar position in left-right terms regardless of the particular positions which
each adopted in practice.
What was needed, therefore, was a more systematic data base, in which
variations across a common cross-national scale could be compared, and in
which real differences between parties could be measured. Encouraged by
the international contacts available through both the EUI in Florence and the
ECPR, we therefore decided to elaborate such a data collection on the basis
of ‘expert’ judgements. The idea was simply to poll expert and experienced
political scientists on their own countries by use of a short questionnaire
which asked them to locate the various parties in their country on a common
left-right scale; that is, we would make the best of a bad lot by pooling as
many individual judgement calls as we could amass, and by ensuring that
those calls to be as precise as possible. The ultimate goal was to create a scale
which could be adapted for comparative cross-national research. Given the
paucity of comparable data which had existed up to then, most scholars who
needed to take account of left-right differences in different countries often
ended up by having to cull a very varied secondary literature, or by having to
write to various colleagues in pursuit of potentially idiosyncratic information.
The expert survey, on the other hand, could turn this sort of search into a finer
and more precise art, in which the same colleagues in the same countries
would locate the parties along the same scale, and thus provide the wider
community with a standardized set of judgements.
152
The approach was also reasonably novel at the time (see also Laver &
Schofield 1990: 246–248). As far as we knew, there had up to then been only
one other systematic attempt to collate expert judgments on party positions,
that carried out by Michael-John Morgan (1976) for a University of Michigan
PhD thesis, which we cited in the original article but to which we had no
access at the time. Since then, however, the procedure has become more
commonplace. Laver & Hunt (1992), for example, employed a very detailed
and comprehensive expert survey in order to probe the positions of party
leaders and party voters on a whole raft of issues, and also polled these
experts on the relative importance of the various different dimensions of policy
competition. More recently, Huber & Inglehart (1995) conducted a somewhat
more elaborated version of our own simple left-right survey across experts
in 42 countries, and here also an attempt was made to weight the various
dimensions of competition. Expert surveys have also since been employed on
a more limited basis to measure cross-national variation on themes ranging
from the extent of corporatism to party attitudes to European integration.
The growth in the use of expert surveys in the late 1980s and 1990s offers a
satisfying testimony to the validity of the approach which we adopted. what
has also been satisfying has been the extent to which the original data have
subsequently been employed in the scholarly literature, where, even now,
they are still regarded as providing an authoritative source for locating party
positions. Indeed, as is testified by its inclusion in this anniversary ‘roll of
honour’, the article eventually proved to have much more impact than we
could have imagined. Had we known it was likely to have had this impact,
however, and in much the same spirit as the parents of a one-time president
of the National Union of Students in Britain (who were once reported to have
said that ‘If we’d known he would become famous, we’d have called him
something different’), we would have done it somewhat differently. Or, at
least, we would have done it more carefully.
For example, and in this regard we have certainly been put to shame by the
recent exercise by Huber & Inglehart (1995), we simply did not make enough
effort to increase the number of countries/cases. Data for only 17 countries
are actually reported in the original article, with four countries on our original
list (Greece, Iceland, Portugal and Switzerland) being excluded because of
an insufficient response from local experts. In retrospect, more effort should
have been made to get sufficient data to include these missing cases, as well
as to include the various other competitive democracies for which we made
no effort at all (e.g., India, Israel, Japan, Malta, etc.). In addition, we also
mainly contented ourselves with too few experts. With the exceptions of
Germany, Sweden, Italy, and the UK, none of the country scores was based
on a double-figure response, and in some cases we received just four or five
153
responses. These numbers are actually very small, and given that the range of
scores per party in each country was sometimes quite extensive, and that not
all relevant parties were scored by all respondents, results were not perhaps
as authoritative as would be desired or as they have been subsequently taken
to be.1 Both of these problems could have been remedied by a greater effort
on our part. That said, and in our defense, it must be pointed out that the
sheer novelty of the exercise meant that we inevitably lacked experience, and
many of these problems were simply not appreciated at the time. Moreover,
while networks of scholars to whom we could turn certainly existed in 1983,
contacts were not so easily established as is now the case. Finally, we were
also limited by financial considerations, in that almost the entire cost of the
exercise was borne by the day-to-day services of the European University
Institute.2
Three other shortcomings can also be noted. First, the ‘questionnaire’ (it
was really just one question) which went out to the various experts did not
include a pre-defined list of parties. Rather, respondents were simply asked
to locate ‘the parties in their system’, or some such formula. This was a
mistake since, as noted above, a number of respondents missed out certain
parties, either because the ‘parties concerned were too small, or perhaps
even because they were too difficult to locate. Either way, for the sake of
authoritativeness and comprehensiveness, it would have been better had all
respondents attempted to locate all relevant parties, and this could have been
effected had we included our own definitive list. Second, being inexperienced
in these matters, we decided that a ‘10-point scale’ – the obvious measure to
use – should run from 0 to 10. In fact, and as has been subsequently pointed
out to us ad nauseum, it should have run from 1 to 10. Thus, for example,
comparability with the subsequent Huber-Inglehart scale requires one or other
of the data sets to be adjusted (see also below). Third, in order to facilitate
subsequent replication, we should have included a copy of the ‘questionnaire’
as an appendix to the article in the EJPR. We might even suggest that the then
journal editors, Mogens Pedersen and Derek Urwin, who were good enough
to promise to accept the piece almost sight unseen, should themselves have
insisted that a copy be published with the article.3
Having the questionnaire to hand might also have encouraged us to repeat
the study at a later stage. In retrospect, it would have proved very useful
to have updated the information at the end of the 1980s, although we were
discouraged from doing this by the knowledge that Laver and Hunt were
preparing a much more extensive expert survey at the time. And while we
were actually making plans to repeat the exercise in 1994 – more or less a
decade later – we discovered at the last moment that Huber and Inglehart had
just conducted a much more broadly-based equivalent. All of this is to the
154
good, and whether on a formally coordinated basis or not, it seems eminently
desirable to continue to have regular updates in the future. As the subsequent
citation of our own 1984 article confirms, these left-right placings clearly
constitute an invaluable resource across quite a wide variety of fields within
the discipline. At the same time, however, for the reasons cited above, as well
as because this was simply a snapshot survey, these data should perhaps be
cited more cautiously than is presently the case, and they should certainly
not be automatically accorded a validity which extends both long before,
and long after, their actual application. As noted elsewhere (Mair 1996: 325–
328), comparative political scientists have a tendency to fetishize whatever
few indicators happen to be available, and these particular data have certainly
not escaped that fate.
This opportunity to reflect once again on our original article has also afford-
ed us the chance to compare briefly the patterns in 1984 with those which
are now provided for the same set of countries in the 1995 data of Huber
and Inglehart. Summaries of the two sets of figures are reported in Table 1,
with the slightly different scales having been standardized to afford a direct
comparison. Two measures are reported in the table. The first is the degree
of polarization, which measures the distance between the most left-located
and most right-located parties in each country in each survey, and which
harks back to the original concerns of Sartori (1976); the second is the degree
of core divergence, which measures the distance between the two principal
protagonists (simply, the two biggest parties) in each system, and which taps
into many of the contemporary debates concerning the apparently centripetal
tendencies which exist within established party competition.4 Both measures
are reported as a proportion of the distance involved in each scale as a whole,
with values ranging from a minimum of 0 (the two relevant parties occupy
precisely the same position) to a maximum of 1 (the two relevant parties are
at completely opposite ends of the spectrum), and the Table also reports the
difference which was recorded in these measures between the two survey
points.
Two general observations can immediately be made about these data. In
the first place, as is readily apparent from the differences in the distances
separating the leftmost and rightmost parties, the extent of polarization has
more often increased rather than decreased with time. Indeed, of the seven-
teen countries for which comparable data are available, there are eleven cases
which record an increased distance between the extremes, and only five (Bel-
gium, Denmark, the Netherlands, Spain, and the UK) in which this distance
has been reduced. An additional country, Austria, has remained unchanged
over time. Moreover, in three of the countries (Canada, Germany, and New
Zealand) the increase in polarization is particularly pronounced. Second, in
155
a
Table 1. Polarization and core divergence in left-right distances, 1984 and 1995
Notes
1. The same criticism might also be levelled at the survey by Huber & Inglehart (1995),
where many of the multitude of party scores are based on just a handful of respondents.
2. The major exception was the input of the Open University’s Social Sciences cartographer,
John Hunt, whom we failed to acknowledge at the time. Figure 1 of the original article,
which spatially summarized the position of more than a 100 parties in 17 countries,
involved a major commitment of time and skill in an era when there were effectively no
computers to assist such endeavours.
3. By now, in fact, neither of us can actually lay our hands on a copy of the original
questionnaire, and we would delighted to be sent a copy if any of the present readers
might still happen to have one to hand.
4. While there are sometimes differences between the two surveys regarding which partic-
ular parties happen to be located at the extremes, the two core parties are regarded as
being the same in both surveys.
5. It should also be noted that neither the UK nor the USA are considered here in that the
principal protagonists are also the leftmost and rightmost parties, and hence no differential
dynamic can be discerned.
157
References
Barricelli, L.A. (1985). Considerations on a time-democratic electoral system, European Jour-
nal of Political Research 13(4): 379–386.
Cameron, D.R. (1982). On the limits of the public economy, Annals, AAPSSS, 459.
Castles, F.G., ed. (1982). The impact of parties. London: Sage.
Castles, F.G. (1994a). On religion and public policy: Does Catholicism make a difference?,
European Journal of Political Research 25(1): 19–40.
Castles, F.G. (1994b). On religion and public policy: The case for covariance. Reply to Göran
Therborn, European Journal of Political Research 26(1): 111–115.
Castles, F.G. & Mair, P. (1984). Left-Right political scales: Some ‘expert’ judgements, Euro-
pean Journal of Political Research 12(1): 73–88.
Castles, F.G. & McKinlay, R.D. (1979). Does politics matter? Public welfare commitment in
advanced democratic states, European Journal of Political Research 7(2): 169–186.
Hewitt, C. (1978). The effect of political democracy and social democracy on equality in
industrial societies: A cross-national comparison, American Sociological Review 42(3):
450–464.
Huber, I. & Inglehart, R. (1995). Expert interpretations of party space and party locations in
42 societies, Party Politics 1(1): 73–111.
Ignazi, P. (1992). The silent counter-revolution: Hypotheses on the emergence of extreme
right-wing parties in Europe, European Journal of Political Research 22(1): 3–34.
Inglehart, R. & Klingemann, H.D. (1976). Party identification, ideological preference and the
left-right dimension among Western mass publics. In I. Budge, I. Crewe & D. Fadie (eds.),
Party identification and beyond (pp. 243–273). New York: John Wiley.
Laver, M. & Hunt, B. (1992). Policy and party competition. New York. Routledge.
Laver, M. & Schofield, N. (1990). Multiparty government: The politics of coalition in Europe.
Oxford: Oxford University Press.
Lipset, S.M. (1960). Political man. London: Mercury Books.
Mair, P. (1996). Comparative politics: An overview. In R. Goodin & H.D. Klingemann (eds.),
A new handbook of political science (pp. 309–355). Oxford: Oxford University Press.
Morgan, M-J. (1976). The modelling of governmental coalition formations: A policy-based
approach with interval measurement. University of Michigan, PhD thesis.
Pedersen, M.N., Damgaard, E., & Nannestad Olsen, P. (1971). Party distances in the Danish
Folketing, 1945–1968, Scandinavian Political Studies 6/71: 87–106.
Sartori, G. (1976). Parties and party systems: A framework for analysis. Cambridge: Cambridge
University Press.
Sjöblom, G. (1977). The cumulation problem in political science: An essay on research strate-
gies, European Journal of Political Research 5(1): 1–32.
Swaan, A. de (1973). Coalition theories and cabinet formation. Amsterdam: Elsevier.
Weber, R.P. (1982). The long-term dynamics of societal problem-solving: A content-analysis
of British speeches from the Throne, 1689–1972, European Journal of Political Research
10(4): 387–405.