You are on page 1of 9

Literacy Volume 47 Number 2 July 2013 95

Literacy, media and multimodality: a


critical response
Cary Bazalgette and David Buckingham
Literacy

Abstract case for including media texts under the broad rubric
of literacy has become much more generally accepted
In recent years, literacy educators have increasingly in the past decade, not least because of the impact of
recognised the importance of addressing a broader new digital media. This more inclusive view of liter-
range of texts in the classroom. This article raises some acy obviously reflects the growing social and cultural
critical concerns about a particular approach to this is-
importance of the modern media, as well as the con-
sue that has been widely promoted in recent years –
the concept of ‘multimodality’. Multimodality theory
tinuing attempt to ensure that the curriculum remains
offers a broadly semiotic approach to analysing a range relevant to children’s changing experiences outside
of communicative forms. It has been widely taken up school.
by literacy educators, initially at an academic level,
and has begun to find its way into policy documents, As media educators, these are ideas we have been
teacher education and professional development and promoting for several decades, at the level of theory
classroom practice. This article presents some criti- and research, policy advocacy and classroom prac-
cisms, both of the theory itself and of the ways in which tice. In this article, we want to raise some concerns
it has been taken up within the wider context of cur- about a particular approach to these issues that has
riculum change. It argues that, in its popular usage, been widely promoted in recent years – the concept of
multimodality theory is being appropriated in a way
‘multimodality’. Multimodality theory offers a broadly
that merely reinforces a long-standing distinction be-
tween print and ‘non-print’ texts. This contributes in
semiotic approach to analysing most communicative
particular to a continuing neglect of the specificity of forms, including spoken and written language, still
moving image media – media that are central to the and moving images, sound, music, gesture, body pos-
learning and everyday life experiences of young chil- ture, movement and the use of space and so on (Jewitt,
dren. Drawing on recent classroom-based research, the 2009; Kress, 2010; Kress and van Leeuwen, 2001). The
article concludes by offering some brief indications of concept of multimodality has been widely taken up by
an alternative approach to these issues. literacy educators, initially at an academic level (e.g.
Bearne and Wolstonecroft, 2007; Fernandez-Cardenas,
Key words: media, multimodality, critical literacy, dig- 2009; Narey, 2008). More recently, it has begun to find
ital literacy/ies, Early Years, new literacies, popular its way into policy documents, teacher education and
culture
professional development and classroom practice. Our
concern is with the ways in which some proponents
Introduction of the theory have sought to account for and pre-
scribe classroom practice; and how these ideas have
In recent years, growing numbers of literacy educators been taken up within the politics of curriculum change.
have come to recognise the importance of addressing a Our contention is that, in its popular usage, the con-
broader range of texts in the classroom. Of course, me- cept of multimodality is being appropriated in a way
dia such as film, television, the press and advertising that merely reinforces a long-standing distinction be-
have been a concern for progressive English teachers tween print and ‘non-print’ texts. This contributes in
for at least half a century (Greiner, 1955). Many En- particular to schools’ continuing neglect of the speci-
glish teachers in the United Kingdom are also teach- ficity of moving image media – media that are cen-
ers of Media Studies, whose existence as a separate, tral to the learning and everyday life experiences of
optional examination subject dates back to the early young children. Our response is certainly critical, even
1970s. Media educators have also long argued for an polemical; but we write in the hope of provoking a
expanded conception of text and of literacy: the earliest wider debate about issues that seem to have been
arguments for ‘media literacy’ (or alternatively film, sidelined.
television or visual literacy) began to emerge in the
late 1970s, well before the term was taken up by New
Labour policy-makers (see Bazalgette, 1988; Bucking- Defining the field
ham, 1989; Great Britain, 2003). Although the history
of media education in primary schools is somewhat On one level, multimodality theory can be seen as an
more recent (see, for example, Bazalgette, 1989), the extension of linguistics, of the kind foreseen in the

Copyright 
C 2012 UKLA. Published by Blackwell Publishing, 9600 Garsington Road, Oxford OX4 2DQ, UK and 350 Main Street, Malden, MA 02148, USA.
96 Literacy, media and multimodality

early 20th century by Ferdinand de Saussure (1995 Writing for their book subtitled ‘Multimodal literacy
[1916]) and C. S. Peirce (1931–1935). The possibil- 5–11’ but also make the claim that:
ity of extending linguistic concepts and methods of
analysis to visual and audio-visual texts was not fully “Many everyday texts are now ‘multimodal’ combining
taken up until the 1950s and 1960s in France – and words with moving images, sound, colour and a range of
not translated into English until the 1970s – in the work photographic, drawn or digitally created visuals” (p. 1,
of semiologists such as Roland Barthes and Christian emphasis added).
Metz. While Metz (e.g. 1973) focused primarily on the
cinema, Barthes ranged more promiscuously across A significant conceptual leap has been made here,
media such as advertising, photography and film, as from multimodal analysis as a way of looking at texts,
well as extending the approach to areas such as food, to multimodal texts as a way of identifying and sin-
toys, sport and fashion (e.g. Barthes, 1972). There are gling out apparently new kinds of text. The impli-
theoretical differences between this structuralist form cation here is that, while ‘many’ everyday texts are
of semiotics and the ‘social semiotic’ theory on which ‘now multimodal’, there are many that are not, and
multimodality theory is based (to be discussed below), that in the past, texts were not multimodal. In fact,
although in many respects the ambition remains the multimodality theorists frequently insist that all texts
same. For example, in his recent textbook on multi- are and always have been multimodal – even print
modality, Gunther Kress (2010) considers advertise- texts, whose visual dimensions are apparent in as-
ments, street signs, children’s drawings, book illus- pects like the choice of fonts or the design of a
trations, food packaging, web pages and a range of page (Kress, 2010); or even in the choice of either a
other texts. Yet although Kress acknowledges the im- pencil or a pen for writing, a modal status distinc-
portance of computer games, film and television, he tion of which most children are keenly aware (Webb,
largely ignores these media, and retains a central em- 2011).
phasis on the printed page. Some of his most recent
work, for example, looks at the changing relationship Nevertheless, a thriving industry has started to grow
between verbal and visual material in school textbooks around the idea of ‘multimodal texts’ (as distinct from
(Bezemer and Kress, 2008): he draws attention to the multimodal analysis). The previous UK government’s
fact that print and visual images need not be sepa- National Strategies website offers this:
rately composed or separately read, but combine in
a single, multimodal communicative form – an argu- “Multimodal texts are now common on the Internet and
ment that has much in common with Barthes’ much pupils are used to texts that use more than one method
earlier analysis of the role of written captions on of communication. All over the web there are short
newspaper photographs and advertisements (Barthes, films, animations and combinations of words, sounds
1977). and images that convey ideas” (http://www.national
strategies.standards.dcsf.gov.uk/node/191938).
However, Kress and his colleagues have also used
multimodality theory to analyse teaching and learn- Here, multimodality seems to be reduced to a mere
ing in schools, in areas such as Science and English aggregation of ‘methods of communication’ – which
(Kress et al., 2001, 2005). The concept now informs is very different from the aim of multimodal anal-
approaches to the teaching of literacy, especially at pri- ysis, which is to investigate how the interaction be-
mary level (see, e.g., Bearne and Wolstonecroft, 2007; tween modes can produce meanings that are more
Neville, 2008). Inevitably, the theory has been simpli- than the sum of the parts. A further reductive ap-
fied in order to make it usable by classroom teachers proach can be seen in this Local Authority advice on
and attract the attention of policy-makers with neither ‘multimodal texts’, which simply equates them with
the time nor the inclination to read academic tomes. computer-based activity:
Yet these attempts to reach a wider audience with an
‘easier’ definition of the field can prove misleading. “ICT texts incorporating sound and images as well as
Thus, David Machin’s (2007) Introduction to Multimodal text can be a highly effective way of engaging children in
Analysis is described by its publisher as providing “a purposeful interactions with reading and writing” (http:
groundbreaking approach to visual analysis” (see, e.g., //www.eriding.net/english/multimodal writing.
http://www.whsmith.co.uk/CatalogAndSearch/ shtml).
ProductDetails.aspx?productID=9780340929384). This
appears to conflate the multimodal and the visual – In addition to separating multimodal from print (pre-
although in fact, while much of what multimodality sumably mono-modal?) texts, this advice implicitly al-
theorists deal with is visual, much of it is not, or com- locates them a lower status. ‘Multimodal texts’ in this
bines the visual with other modes. In the education scenario are just a way of getting children to do better
sector, a further distortion has appeared in the process at reading and writing: by implication, they have little
of trying to make the ideas more concrete and grasp- intrinsic value. At the level of marketing to education,
able. For example, Bearne and Wolstonecroft (2007) terms such as ’multimodal’, ’multimedia’ and ’digital’
not only chose the title Visual Approaches to Teaching seem to function merely as eye-catching ways to spice

Copyright 
C 2012 UKLA
Literacy Volume 47 Number 2 July 2013 97

up a promotion, rather than having any specific mean- the following section we aim to highlight a number of
ings, as in this advertising blurb from the published broad critical points that we feel are in need of further
Scholastic: debate.

“Multimodal texts: podcast – give your literacy lesson


some multimedia magic with our free digital text and Multimodality theory
activities” (http://www.education.scholastic.co.uk/
content/4902). The so-called ‘linguistic turn’ in the human and so-
cial sciences, at least in the anglophone world, dates
These examples demonstrate a confusion, not just of back to the 1970s. At that time, structuralism and semi-
terms but also of fundamental aims. Our many in- otics were widely proclaimed as all-encompassing the-
formal discussions and professional development ses- ories that could be used to interpret a whole range of
sions with teachers suggest that the adoption of the social and cultural phenomena in terms of language.
term ‘multimodal texts’ as a way of encouraging them Everything, it seemed, could be seen as a ‘text’ that
to bring non-print texts into the classroom has back- could be analysed and explained in linguistic terms:
fired: many teachers are either thoroughly confused by from popular culture to fashion to food, and from pol-
the term ‘multimodal’ or they interpret it (as Scholastic itics to the operations of the unconscious mind, it was
does) as something to do with digital stuff and having all about language. And these languages could all be
fun. understood as logical systems, with their own codes
and conventions and forms of grammar and syntax.
This confusion is exacerbated by the fact that, while Aside from anything else, these developments empow-
there may be a growing desire to bring non-print texts ered linguistics to see itself as some kind of master
into the classroom, there is also an anxiety about how discipline, offering a universal template that could be
to justify this. There may be an underlying fear that placed over a vast range of cultural practices.
someone – parents, press, head teachers, school inspec-
tors – may object to the apparent devaluing of print As a form of semiotics, multimodality theory repre-
texts that is implied if children spend time on films, TV sents the latest manifestation of this continuing project
or video games in the classroom. ‘Multimodal texts’ – although it has emerged at a time where the dream
sounds scientific and businesslike, and may be less of such an all-encompassing theory has largely faded.
likely to attract the opprobrium of the right-wing press Yet this does not seem to have quelled the ambition:
in the way that ‘Media Studies’ so consistently does for example, the promotional materials for Gunther
(Laughey, 2010). In the current climate of testing and Kress’ most recent book Multimodality (2010) proclaim
league tables these anxieties are understandable, but that it will “bring all modes of meaning-making to-
the contortions that are generated cause as many prob- gether under one theoretical roof” (http://routledge.
lems as they solve. The ultimate effect is to maintain customgateway.com/routledge-linguistics/multimod
a problematic distinction between the proper texts that ality/multimodality.html). What we are promised
are written or printed on paper and in books, and is both a theory and a set of analytical tools that
the other texts, whether they are labelled ‘multimodal’, can be applied in a scientific manner across seem-
‘digital’, ‘visual’ or ‘media’. This disregards the fact ingly disparate forms (or modes) of communication.
that much of what falls into the ‘other’ category is ac- This is often combined with the argument that this
tually written: websites, e-mail, e-books and SMS – not all-encompassing approach is now urgently needed
to mention newspapers, advertisements and (on many because digital technologies are making it easier to
occasions) films, television and games – all use written combine many modes in one text.
language. Of course, there are some interesting differ-
ences between words on paper and on screen, not least However, the realisation that communication may in-
relating to their cost and ease of distribution, but the volve a diversity of modes – visual, written, auditory,
basic decoding skills required to make sense of them musical, gestural and so on – is not new. There is a long
are broadly the same. tradition of visual analysis within fields such as art his-
tory and film studies; and media educators have been
We will refer later to this question of how, and whether, working with different modes and media for decades.
the landscape of texts may be usefully categorised and Standard film studies textbooks such as Bordwell and
divided. Initially, however, we consider in a little more Thompson’s Film Art: An Introduction (first published
detail where this term ‘multimodal’ comes from, what in 1979) have inducted generations of students into
kind of a theory it is based upon, and how useful it ways of analysing moving image texts, paying close
really is to literacy teaching. While the term is being attention to the interaction between image and sound,
increasingly widely used in some areas of education, and the role of editing, for example. In schools, the de-
there seems to have been relatively little critique – and tailed analysis of ‘media language’ (including aspects
in some cases, not even much acknowledgement – of such as bodily communication) has been a staple ele-
the theory on which it is based. Obviously, we cannot ment of Media Studies curricula for many decades (see
offer a detailed discussion of the theory here; but in Masterman, 1980).

Copyright 
C 2012 UKLA
98 Literacy, media and multimodality

These approaches to textual analysis are not, of course, in the case of work created by children in classrooms
set in stone: they should be open to change and re- – are dictated by economics, power, convenience and
newal. Yet unfortunately, much discussion of multi- perhaps assessability, as much as by the suitability of
modality seems to take us little further than the recog- mode to content. The theory appears to ignore the hap-
nition that there are indeed different modes, which hazard and improvised nature of much human com-
serve different functions, work in different ways, and munication, as well as its emotional dimensions. It is as
often operate in combination to generate meanings. if the scientific rationalism of the analyst has been vi-
In some instances, the approach seems to veer into a cariously transferred to the ordinary meaning-maker.
form of determinism that has much in common with
Marshall McLuhan’s ‘medium theory’ – crudely, the The notion of ‘design’ in its original usage in this con-
notion that the means (or mode) of communication text (New London Group, 1996) clearly applies to the
determines the form of thought or of social life full range of communicative forms. However, the fact
(McLuhan, 1964). McLuhan’s famous dictum “the that this term is drawn from the production processes
medium is the message” might be translated into mul- of print, illustration and graphics again reveals the the-
timodality theory as “the mode is the message”. Thus, ory’s inherent bias towards the printed page and ‘the
it is claimed that orality, literacy and visual media in visual’. To describe the meaning-making processes in-
themselves ‘afford’ different kinds of social relation- volved in film production, for example, as ‘design’
ships and social identities, irrespective of context or severely limits our understanding of the innumerable
purpose. For instance, Bezemer and Kress (2005) claim creative, logistical and economic decisions (and indeed
that a changing balance or relationship between image the many accidents or fortuitous discoveries) involved
and text, for example in school textbooks, necessarily re- in processes such as scripting, casting, performance,
sults in a different form of learning; while Kress et al. set and costume design, musical composition, sound
(2005) assert that in the classroom, the use of typewrit- design, special effects and the orchestration of all these
ten rather than handwritten text, or video clips rather and more into a single timeline. It also cuts off con-
than spoken text, in itself transforms the relationships sideration of the generic, institutional, technical, eco-
of authority between teachers and learners. The mode nomic and historical dimensions of these choices.
apparently “shapes both what is to be learnt (e.g. the
curriculum) and how it is to be learnt (the pedagogic Multimodality theory purports to be a social theory of
practices involved)” (Jewitt and Kress, 2010, p. 349, communication, and many of its key exponents are or
emphasis in original). were advocates of the broader field of ‘social semiotics’
(Hodge and Kress, 1988). Social semiotics sought to
When it comes to analysing classroom practice, this distinguish itself from previous semiotic approaches
produces a peculiarly thin and generalised account. by virtue of its concern with the lived reality of lan-
The revelation that English teachers use visual imagery guage use, as opposed to the abstract system or gram-
and digital media in their teaching (as they have been mar that underlies it. This approach drew on “sys-
doing for many decades) sanctions a rather breath- temic functional linguistics” (especially the work of
less account of the far-reaching changes in knowledge, Halliday, 1994) rather than the structuralist linguis-
learning and identity that have apparently ensued as tics of de Saussure (1995 [1916]). Communication, from
a result (Jewitt and Kress, 2010). Changes in the bal- this perspective, was socially motivated and situated,
ance and combination of modes, it is argued, are all it not merely the manifestation of an abstract system or
takes to erode boundaries, unsettle existing practices grammar. Yet it is doubtful whether ‘social’ semiotics
and forge new connections. Yet in the process, mul- or multimodality theory has ever escaped the formal-
timodality theorists barely address the actual content ism of structuralist semiotics; and as a social theory, it
of English teaching and the social and political contexts often seems to do little more than gesture towards the
in which teaching and learning take place. The funda- social dimensions of meaning-making.
mental historical transformations in English and liter-
acy pedagogy – and the complexity and ambivalence Thus, in practice, multimodality theory appears to
of those transformations – are largely reduced to ques- sanction a rigidly formalistic approach to analysis.
tions of textuality. Kress and van Leeuwen’s Grammar of Visual Design
(1996), for instance, proposes a way of reading vi-
A further difficulty here is in the theory’s account of sual imagery (such as advertisements and magazine
the process of meaning-making. One of the favoured layouts) in which the material at the left is known,
terms here is the concept of ‘design’, which appears to whereas that at the right is new; the top is what might
imply a view of communication as a wholly rational, be (the ideal), the bottom is what is (the real) and so
controlled process. The individual ‘sign-maker’ sits on. Needless to say, this approach works exception-
at the “multi-modal mixing desk” (Burn and Parker, ally well with the examples Kress and van Leeuwen
2003), making systematic choices about the mode that provide, but as is often the case, attempts to apply the
will best suit his or her intended meaning. While grammar to other examples do not work out so neatly.
this might partly describe the process by which pro- This careful selection of examples that appear to prove
fessional advertising agencies construct campaigns, the case is characteristic of texts on multimodality (and
modal choices in everyday communication – especially indeed linguistics more broadly): yet the principles on

Copyright 
C 2012 UKLA
Literacy Volume 47 Number 2 July 2013 99

which these examples are selected are hardly ever dis- olds identified television as their favourite media tech-
cussed. Here again, questions to do with content and nology, with computer/console games coming a long
context are dealt with in very limited terms. way behind at 25 per cent and other media practically
nowhere (Ofcom, 2011, p. 29). Forty-five per cent of 8-
If we compare a multimodal analysis of a media form to 11-year-olds cited TV as their favourite, with only
such as advertising with the kinds of analysis prac- 20 per cent of this age group preferring games and 15
tised in Media Studies, the limitations are immediately per cent naming the Internet (which means mainly so-
apparent. Media Studies would require us to analyse cial networking and virtual worlds). While these fig-
not only the text itself but also its production (work- ures do show a gradual increase in interest in games
ing practices, institutional contexts, commercial strate- and online media, it is still extremely important to note
gies and so on), and the ways in which it is used and how public excitement and moral panics about digi-
interpreted by different audiences. By contrast, a so- tal technologies have tended to overlook the continu-
cial semiotic analysis typically infers the intentions of ing importance of ‘old’ moving image media (televi-
the text’s producers and makes assumptions about its sion and film) in children’s formative years. We sus-
meaning based simply on an analysis of the text itself. pect that if Ofcom’s study looked at pre-schoolers, we
Some writers on multimodality have noted the impor- would see an even bigger preference for TV – and for
tance of developing “a political economy of transme- DVDs, which Ofcom does not ask about, since it does
dia signs” but have simply staked this out as a future not have responsibility for regulating them. Sheffield
task (Lemke, 2009, p. 150). And while there may be an University’s Digital Beginnings study showed that 59
in-principle recognition of the fact that readers inter- per cent of children have started looking at TV by the
pret texts in diverse ways, there is no attempt to inves- age of 6 months; and that by the age of two, 70 per cent
tigate this empirically. The text, it would seem, is the of children can (and probably do) turn on the TV set by
be-all and end-all of meaning. themselves (Marsh et al., 2005, p. 25).

The place of moving image It is thus worth giving some specific attention to the
role of moving image media in children’s literacy prac-
One of the problems with the distinction between writ- tices, especially since, as we have argued, multimodal-
ten and ‘multimodal’ texts is that it ignores the na- ity theory offers little to help educators think about
ture of people’s everyday textual practices and pref- the potential role of these media in the classroom.
erences. Multimodality theory, while it offers powerful For more than a century, but particularly since the
accounts of textuality, provides little insight into what widespread take-up of television in the 1950s, mov-
people actually do with texts in the contexts of their ing image media have been enormously important to
everyday lives. There is a striking contrast here with young children; and this has been even more the case
the more anthropological or sociological analysis prac- since the domestic VCR made it possible for them to
tised in Media and Cultural Studies – and indeed with view and re-view favourite bits of TV and film when-
the more situated approach of “new literacy studies” ever they wanted or were allowed to. Yet most educa-
(e.g. Street, 1995). For classroom teachers, this prob- tors have continued to be distracted by public concerns
lem is compounded by the fact that they may feel that relating to the possible harmful effects of these media.
they know little about their pupils’ textual practices,
because of the changes in communications technolo- We would like to suggest a different approach to chil-
gies that have taken place in recent years. When they dren’s moving image consumption. Given that chil-
seek help on this, they quickly encounter a popular dren start to engage with moving image media in their
rhetoric about ‘digital natives’ and ‘Web 2.0’ that has second year of life – often in contexts with little or no
helped to build up a mythology about the power and adult mediation – they must have acquired some un-
pervasiveness of new communications technologies – derstanding of the complex multimodal characteristics
although this is not itself an argument propounded of these media well before they start school: if they had
within multimodality theory itself (Thomas, 2011). It is not, they would not be able to enjoy them so much.
commonly assumed that all children and young people This should have immense implications for the early
are incessantly texting each other, using social media stages of conventional literacy learning. Many tend
and playing computer games, and that these practices to assume that, because children learn to understand
have driven out everything else. films and TV at an early age, these media must be sim-
ple – as in statements such as “the visual nature of film
The reality is somewhat more nuanced. While Ofcom’s makes its devices more accessible to a wider range of
annual series of “media literacy audits” may not tell children” (Simpson, 2011). But we do not assume that
us much about what media literacy actually is, they verbal language is simple just because children learn it
certainly provide a useful source of information about early in life.
changing trends in people’s textual practices and pref-
erences. Of importance to primary school teachers are Where multimodal analysis should help us is in iden-
the responses given by 5- to 11-year-olds when asked tifying the complexity and distinctiveness of mov-
what media technology they would miss most if it ing image media, and recognising that understanding
was taken away. In 2011, 52 per cent of 5- to 7-year- them must involve learning, even for very young chil-

Copyright 
C 2012 UKLA
100 Literacy, media and multimodality

dren. Yet this is something that, in our view, it has media, not only because of their obvious cultural im-
largely failed to do. A small number of theorists have portance, but also because of their significant role in
addressed this (Bateman and Schmidt, 2011; Burn and the very early cultural experiences of young children.
Parker, 2003; Van Leeuwen, 1998) but the textbooks we Our argument is not that moving-image media are ‘su-
have referred to conspicuously neglect moving image perior’ to print, although it might well be proposed
media such as television, film and computer games. By that film is ‘more multimodal’ than print, but simply
contrast, there is a large body of work in Media Studies that the important formal and institutional differences
that explores the nature of meaning-making in mov- between these two forms are worth learning about and
ing image media in considerable detail (e.g. Barker, understanding.
2000; Bordwell and Thompson, 1979; McKee, 2003). We
might identify three broad modes in operation here: We now want to explore the implications of these
an image mode that includes sub-modes such as fram- arguments for curriculum design and for pedagogy.
ing, movement, mise-en-scène, lighting, colour, graphics We would argue that the ‘ages and stages’ mod-
and animation style; a sound mode that includes voice, els that currently govern curriculum and pedagogy
music, sound effects and silence, each of which can be are based on learning progression models and cul-
broken down again into a multiplicity of modes; and tural hierarchies that are in turn grounded in print
a ‘performance’ mode that includes elements such as culture. But research – and an increasing body of
expression, movement, speech, song, appearance and anecdotal evidence – indicates that when children
costume. have opportunities to pay detailed critical attention
to non-print texts such as films, then notions of ‘abil-
However, there is a further, vitally important, mode ity’ may be disrupted, and assumptions about ‘readi-
that is almost always overlooked: time, which includes ness’ have to be rethought. For example, in our re-
duration, rhythm, sequence and transitions. Time in cent research (Bazalgette and Dean, 2011), even chil-
film and TV is different from the time required to read dren aged between 3 and 5 showed some under-
a book or scan through a website, which is under our standing of, and interest in, concepts such as au-
control. Time in moving-image media is an essential thorial intent, stylistic and generic expectations, and
part of the repertoire of creative choices available to ‘reality status’ – all normally thought of as appropri-
the film-maker, in the same way that it is essential to ate only at a much later stage). Similar findings in rela-
composers of music: changing the duration of a shot tion to creative work in animation have emerged in our
or a transition, or altering the sequence of shots, affects other recent research (Bazalgette and Bearne, 2010).
meaning just as much as changing the tempo of a piece
of music or changing a crochet to a minim (for further These findings should prompt us to review some es-
discussion see Bazalgette, 2011). Time in the reading tablished assumptions about learning progression and
of print texts works in different ways, and here we literacy. The default response to the research findings
could make useful distinctions between reading time described above tends to be an acceptance of film as
and story time, and indeed between story and plot a useful stimulus to traditional, print-based literacy
(see, e.g. Genette, 1980). Yet it is this kind of complexity learning – and no more than that. This is to ignore the
that is lost when all non-print (or indeed ‘multimodal’) gains in conceptual understanding that are achieved
texts are unthinkingly lumped together, whether for when print and moving-image texts are studied side
facile reasons or for more ideologically charged ones, by side, together with opportunities for creative work
such as defending the pre-eminence of print. in both media. If a relatively sophisticated understand-
ing of text can be achieved at a much earlier age than
we have previously believed, what justifies the exclu-
Beyond text: literacies and learning sive fixation on written text throughout the 5–14 liter-
progression acy curriculum?

Our account thus far has focused on the problems of In our other recent research in primary school class-
distinctions between print and non-print texts, and rooms (Buckingham et al., forthcoming), we have
placing the latter under the ‘multimodal’ heading. As found that from the age of 6, many children are able to
we have argued, multimodality theory itself has its start addressing complex questions about the produc-
limitations, but the simplified version currently avail- tion, circulation and use of media texts such as televi-
able to most primary teachers has generated even more sion news or celebrity images. Such areas form a signif-
significant problems: it ignores the specificity of differ- icant part of young children’s everyday cultural expe-
ent types of non-print texts; neglects the fact that print riences outside school, yet they are typically deemed to
texts are also multimodal; loses sight of the impor- be appropriate for study only by much older children
tant commonalities between print and non-print texts; (if at all). Our work includes many examples of chil-
and imposes a false, technologically determined uni- dren between the ages of 6 and 9 understanding the
formity on non-print texts. We have argued that if texts motivations and working practices of media compa-
need to be categorised, “print versus multimodal” is nies; critically analysing the selection and construction
unhelpful. To illustrate why this is so, we have argued of such texts and exploring how they are targeted at
for particular attention to be given to moving-image particular audiences, and how they are actually read.

Copyright 
C 2012 UKLA
Literacy Volume 47 Number 2 July 2013 101

What this suggests to us is that, certainly by Key debate in this area unfolds, we hope that the value and
Stage 2 (ages 7–11) and possibly earlier, the literacy limitations of multimodality theory will be more fully
curriculum could be more ambitious. Teachers could recognised and critically addressed in the context of lit-
be encouraging learners to move towards more rigor- eracy teaching and learning.
ous ways of understanding the contexts in which all
texts are produced, as well as realising and exploiting
new ways of making and circulating them. This would Acknowledgements
mean moving on from learning about how meanings
are constructed and defined, towards understanding The classroom research identified here was funded
how particular points of view can be conveyed, and by the Economic and Social Research Council UK as
ultimately, how broader assumptions and ideologies part of the project ‘Developing Media Literacy: To-
are sustained. It would include recognising and explor- wards a Model of Learning Progression’, 2009–2012.
ing the social, historical, economic, political and cul- The Persistence of Vision project described by Simp-
tural forces that shape and determine the production son (2011) was funded by the UK Film Council’s Film:
and consumption of texts and meanings. 21st Century Literacy project. The ‘Reframing Liter-
acy’ research on animation described in Bazalgette and
The crucial point here is that – unlike multimodality Bearne (2010) was funded by the Qualifications and
theory – these approaches do not remain at the level Curriculum Authority.
of the text: they also look beyond the text, to consider
how texts are actually produced, circulated and used in
everyday life. They do not foreclose, but rather encour- References
age, discussion of the complexity of these processes:
BARKER, M. (2000) From Antz to Titanic: Reinventing Film Analysis.
for example, they challenge simplistic understandings
London: Pluto.
of media power, and familiar stereotypes about how BARTHES, R. (1972) Mythologies. London: Cape (first published
different audiences use and interpret texts in all forms 1957).
of media. These activities may involve close textual BARTHES, R. (1977) ‘The photographic message’, in R. Barthes, Im-
analysis – and in that respect, multimodality theory age – Music – Text. Glasgow: Fontana/Collins, pp. 38–41 (first pub-
can provide useful approaches that sit alongside more lished 1961).
BATEMAN, J. and SCHMIDT, K. H. (2011) Multimodal Film Analysis.
established methods – but they also situate textual Abingdon: Routledge.
analysis within a broader account of the social produc- BAZALGETTE, C. (1988) ‘They changed the picture in the middle
tion of meaning. We would argue that this is as rel- of the fight: new kinds of literacy’, in M. Meek and C. Mills (eds.)
evant to the study of older textual forms such as the Language and Literacy in the Primary School. London: Falmer, pp.
211–224.
book as it is to newer ones.
BAZALGETTE, C. (Ed.) (1989) Primary Media Education: A Curricu-
lum Statement. London: British Film Institute.
BAZALGETTE, C. (2011) Rethinking texts. Available at
Conclusion http://www.ukla.org/downloads/UKLA Chester International
Conference Papers 2011.pdf
BAZALGETTE, C. and BEARNE, E. (2010) Beyond Words: Developing
Multimodality theory has been co-opted by literacy ed-
Children’s Responses to Multimodal Texts. Leicester: UKLA.
ucators with the best of intentions, as a way of broad- BAZALGETTE, C. and DEAN, G. (2011) Persistence of Vi-
ening the range of texts that primary school teachers sion Report. Available at http://themea.org/pov/volume-3-issue-
feel able to use in the classroom. But its inherent limita- 2/persistence-of-vision
tions, as well as some unfortunate oversimplifications, BEARNE, E. and WOLSTONECROFT, H. (2007) Visual Approaches
to Teaching Writing: Multimodal Literacy 5–11. London: Paul Chap-
have led to its recuperation and neutralisation. In an
man.
ideal world, we ought to be able to characterise, select BEZEMER, J. and KRESS, G. (2008) Writing in multimodal texts: a
and teach about a wide range of texts in the classroom social semiotic account of designs for learning. Written Communi-
on the basis of many different theories and methods. cation, 25.2, pp. 166–195.
In this scenario, multimodality theory would be just BORDWELL, D. and THOMPSON, K. (1979) Film Art: An Introduc-
tion. Reading, MA: Addison Wesley.
one of many approaches that might usefully inform
BUCKINGHAM, D. (1989) Television literacy: a critique, Radical Phi-
literacy learning and teaching. But multimodality the- losophy, 51, 12–25.
ory has not been taken up by educators within such a BUCKINGHAM, D., BURN, A., PARRY, B. and POWELL, M. (forth-
scenario. Rather, it has been taken up in a climate of coming) Developing Media Literacy: Culture, Creativity and Critique.
extreme political interference in education, when con- London: Routledge.
BURN, A. and PARKER, D. (2003) Analysing Media Texts. London:
servative forces in several countries are mounting a
Continuum Books.
cynical populist resistance to anything that smacks of GREAT BRITAIN (2003) Communications Act 2003. Chapter 21. Lon-
‘cultural relativism’. Much more deeply rooted educa- don: The Stationery Office.
tional and corporate ideologies continue to dominate FERNANDEZ-CARDENAS, J. M. (2009) Learning to Write Together:
choices about what may be studied in primary schools, Multimodal Literacy, Knowledge and Discourse. Saarbrucken: VDM
Verlag.
the methods that should be used and the outcomes that
GENETTE, G. (1980) Narrative Discourse. Oxford: Blackwell.
are to be expected. Teachers’ understandable confusion GREINER, G. (1955) Teaching Film. London: British Film Institute.
about what multimodality is and why it might be im- HALLIDAY, M. A. K. (1994) An Introduction to Functional Grammar,
portant can only help to sustain the status quo. As the 2nd edn. London: Edward Arnold.

Copyright 
C 2012 UKLA
102 Literacy, media and multimodality

HODGE, R. and KRESS, G. (1988) Social Semiotics. Cambridge: Polity. NEVILLE, M. (2008) Teaching Multimodal Literacy Using the Learning
JEWITT, C. (2009) Handbook of Multimodal Analysis. London: Rout- by Design Approach to Pedagogy. Melbourne: Common Ground.
ledge. NEW LONDON GROUP (1996) A pedagogy of multiliteracies: de-
JEWITT, C. and KRESS, G. (2010) ‘Multimodality, literacy and school signing social futures. Harvard Educational Review, 66.1, pp. 60–
English’, in D. Wyse, R. Andrews and J. Hoffman (Eds.) The Rout- 92.
ledge International Encyclopaedia of English, Language and Literacy OFCOM (2011) UK children’s media literacy. Available at http://
Teaching. London: Routledge, pp. 342–353. stakeholders.ofcom.org.uk/binaries/research/media-
KRESS, G. (2010) Multimodality: Exploring Contemporary Methods of literacy/media-lit11/childrens.pdf
Communication. London: Routledge. PEIRCE, C. S. (1931–1935) Collected Papers. Cambridge, MA: Harvard
KRESS, G., JEWITT, C., JONES, K., BOURNE, J., FRANKS, A. and University Press.
HARDCASTLE, J. (2005) English in Urban Classrooms. London: SAUSSURE, F. de (1995 [1916]) Course in General Linguistics, trans. R.
Routledge. Harris. London: Duckworth.
KRESS, G., JEWITT, C., OGBORN, J. and TSATSARELIS, C. (2001) SIMPSON, J. (2011) ‘Challenges for transferability’, in ‘Children
Multimodal Teaching and Learning. London: Continuum. and teachers talking’ – part of a report on the Persistence of
KRESS, G. and VAN LEEUWEN, T. (1996) Reading Images: A Grammar Vision project. Available at http://themea.org/pov/volume-3-
of Visual Design. London: Routledge. issue-2/persistence-of-vision/children-and-teachers-talking/.
KRESS, G. and VAN LEEUWEN, T. (2001) Multimodal Discourse. Lon- STREET, B. (1995) Social Literacies: Critical Approaches to Lit-
don: Arnold. eracy in Development, Ethnography and Education. London:
LAUGHEY, D. (2010) The Case for and Against Media Studies in the Longman.
UK Press. Paper Presented at ‘Media Literacy 2010’ Conference, THOMAS, M. (Ed.) (2011) Deconstructing Digital Natives. London:
London, 19–20 November. Routledge.
LEMKE, J. (2009) ’Multimodality, identity, and time’, in C. Jewitt VAN LEEUWEN, T. (1998) Speech, Music, Sound. London: Macmillan.
(Ed.) The Routledge Handbook of Multimodal Analysis. Abingdon: WEBB, R. (2011) Is this Like Art/Literacy? Exploring Multimodality
Routledge, pp. 140–150. with Year 5 Pupils. Paper Given at 47th UKLA International Con-
MACHIN, D. (2007) Introduction to Multimodal Analysis. London: ference, Chester, 15–17 July.
Bloomsbury Academic.
MARSH, J., BROOKS, G., HUGHES, J., RITCHIE, L., ROBERTS, S.
and WRIGHT, K. (2005) Digital Beginnings: Young Children’s Use of
Popular Culture, Media and New Technologies. Sheffield: University
of Sheffield. CONTACT THE AUTHORS
MASTERMAN, L. (1980) Teaching about Television. London: Cary Bazalgette, London Knowledge Lab, Insti-
Macmillan.
tute of Education, University of London, 23–29
MCKEE, A. (2003) Textual Analysis: A Beginner’s Guide. London: Sage.
MCLUHAN, M. (1964) Understanding Media: The Extensions of Man. Emerald Street, London WC1N 3QS, UK.
New York: McGraw Hill. e-mail: carybaz@gmail.com
METZ, C. (1973) Methodological propositions for the analysis of David Buckingham, Media and Communications,
film. Screen, 14.1–2, pp. 89–101. Loughborough University, Loughborough, UK.
NAREY, M. (Ed.) (2008) Making Meaning: Constructing Multimodal
e-mail: d.buckingham@ioe.ac.uk
Perspectives of Language, Literacy, and Learning through Arts-Based
Early Childhood Education. New York: Springer.

Copyright 
C 2012 UKLA
Copyright of Literacy is the property of Wiley-Blackwell and its content may not be copied or
emailed to multiple sites or posted to a listserv without the copyright holder's express written
permission. However, users may print, download, or email articles for individual use.

You might also like