Professional Documents
Culture Documents
Learning Outcome
Identify modes of multimodal literacy and types of multimodal texts.
PREVIEWING
1
MULTIMODALITY: WHY IT MATTERS
As a participant in a connected society, you have to know how to negotiate between words,
sounds, images, and gestures, and the spaces in which those exist, on a daily basis. Whether you
are tasked with giving an on-the-fly presentation about a report you wrote at work or you want
to use social media to share your vacation photos with your grandparents across the country,
you’re moving between and among different modes constantly.
What is a mode?
A mode, quite simply, is a means of communicating. A mode is different from a medium, which is
the substance through which a communication is conveyed. Examples of a visual medium, for
instance, would be photography, painting, or film.
When a given text makes use of more than one mode, the text can be characterized as multi-
modal.
Fig.1. This chart is based on a diagram created by the New London Group.
2
Modes and Media
A mode is a means of communicating. A medium is the channel or system through which com-
munications are conveyed. The plural form of medium is media. So, for example, if we want to
communicate in the linguistic mode, we might choose the medium of print. If we want to com-
municate in the aural mode, we might choose the medium of a podcast. Both print and pod-
casts are forms of media.
Visual
The visual mode refers to the images and characters that people see. It is sometimes possible to
find compositions that almost, if not completely, rely on a single mode. For instance, the toxic/
poison sign below has no alphabetic text and no sound. It relies on visual information for its
meaning.
3
Aural
The aural mode is focused on sound including, but not limited to, music, sound effects, ambi-
ent noises, silence, tone of voice in spoken language, volume of sound, emphasis, and accent.
An example of an aural mode is a recording used in listening quizzes. To try a listening quiz, go
to the following link : https://www.esl-lab.com/intermediate/healthy-lifestyle/
Gestural
The gestural mode “refers to the way movement is interpreted. Facial expressions, hand ges-
tures, body language, and interaction between people are all gestural modes. This has always
been important in face-to-face conversations and in theater, but it has become more apparent
on the web lately with the wide use of YouTube and other video players. The gestural mode
works with linguistic, visual, aural, and sometimes even spatial modes in order to create more
detail and convey it better to the consumer” .
The linguistic mode refers to written or spoken words. The mode includes word choice, the de-
livery of written or spoken text, the organization of words into sentences and paragraphs, and
the development and coherence of words and ideas. Linguistic is not always the most im-
portant mode; this depends on the other modes at play in the text, the type of text, and other
factors. Linguistic is probably the most widely used mode because it can be both read and
heard on both paper or audio. The linguistic mode is the best way to express details and list.
Spatial
The spatial mode, as the name implies, refers to the arrangement of elements in space. It in-
volves the organization of items and the physical closeness between people and objects. A
good example of the spatial mode might be the different ways in which chairs and desks are
arranged in a classroom.
Visual
The visual mode is conveyed through choices of visual resources and includes both still image
and moving images. Images may include diverse cultural connotations, symbolism and portray
different people, cultures and practices. Visual resources include framing, vectors, symbols,
perspective, gaze, point of view, color, texture, line, shape, distance, angles, contrast, lighting,
camera movement and subject movement.
4
Multimodal Texts
Multimodal texts mix modes in all sorts of combinations. While often one mode will predomi-
nate, more frequently, several modes combine to communicate a message or argument. In
this lesson we will look at several examples of multimodal texts.
5
Examples of Multimodal Texts
While the development of multimodal literacy is strongly associated with the growth of
digital communication technologies, multimodal is not synonymous with digital. The choice
of media for multimodal creation is therefore always an important consideration.
A multimodal text can be digital—from slide (power point) presentations, e-books, blogs, e-
posters, web pages, and social media, through to animation, film and video games.
And, a multimodal text can be transmedia—where the story is told using ‘multiple delivery
channels’ through a combination of media platforms, for example, book, comics, magazine,
film, web series, and video game mediums all working as part of the same story.
Creating a multimodal text, a digital animation, for example, is a complex meaning design
process requiring the strategic orchestration of a combination of modes such as image,
movement, sound, spatial design, gesture, and language. The process of constructing such
texts is also truly a cross-disciplinary literacy process, drawing on digital information
technologies and The Arts (media, music, drama, visual arts, design) to bring meaning to life.
English Stories that include text and images, newspaper articles, photographs,
memes, comic strips, dramatizations
Science Scientific illustrations or animations, 3D models, ‘How To’ guides with pic-
tures, museum exhibits