Multimodality

Introduction to Register and

Genre
 Group 5:
01 Anggi Pebrianti

02 Diana Febrianti

03 Mira Afriani
 01
Definition of
Multimodality
Multimodality is a concept that refers to the use of multiple modalities or channels
of communication in an interaction or experience. Modality refers to various
forms of communication or conveying information, such as spoken language,
writing, images, sounds, body movements, and so on. The concept of
multimodality is also relevant in the field of education and learning. Combining
various modalities such as text, images, video, sound, and direct interaction can
help increase students' understanding and involvement in the learning process.
Thus, multimodality involves the use of various modalities to enhance experience,
communication, and understanding in various contexts, both in human
communication, technology, and learning.
 02
Types of
multimodality
 Modes
Modes refer to the different ways that we can create meaning.
Gunther Kress1 defines a mode as:
'[...] a socially and culturally shaped resource for making meaning.
Image, writing, layout, speech, moving images are examples of
different modes'.
 1. Linguistic mode

The linguistic mode focuses on the meaning of written or

spoken language in communication. For example, this
includes: choice of words, vocabulary, grammar, structure etc.
 2. Visual mode
The visual mode focuses on the meaning of what can be seen
by a viewer. This includes: images, symbols, videos, signs,
etc. It also includes aspects of visual design, such as colour,
layout, font type and size, etc.
 3. Aural mode
The aural mode focuses on the meaning of what can be heard
by a listener. This includes: sound effects, music, voice. This
can be realised through tone, pitch, speed, volume, rhythm etc.
 4. Gestural mode
The gestural mode focuses on the meaning of communication
through movement. This includes: facial expressions, gestures,
body language, interactions between people. These are all
examples of non-verbal communication, as meaning is
conveyed without the use of speech.
 5. Spatial mode
The spatial mode focuses on the meaning of communication
through physical layout. This includes: position, spacing, the
distance between elements in a text, proximity between
people/objects, etc.
 Mediums
Another type of multimodality lies in mediums. Mediums
are the forms in which the different modes are carried, i.e.
the ways that modes can be accessed by people.
Modes are influenced by the type of medium they are
carried by. The medium of a text can determine the
purpose of a text and its target audience. Different types
of mediums include, but are not limited to:

- Books - Billboards
- Newspapers - Theatre
- Radio - Websites
- Television/Film - Social media posts
 03
Example of
multimodality
A sign is multimodal. Each mode
conveys different meanings.
What can this text tell us?

 The medium of this text is a sign; particularly a

road sign. This tells us that it is aimed at drivers, and
has the purpose of giving instruction to them.
What can this text tell us?

 The linguistic mode - the words ’slow down’ let us

know of the action to be taken by the driver. They
deliver a clear message in an imperative manner
(ordering the driver to do something).
What can this text tell us?

 The visual mode - the font of the text is large, bold and
evenly spaced out, making it easy to read for passing drivers.
This stands in contrast to the orange background of the sign,
which is bright and will grab the attention of the driver.
Orange could also be associated with a warning, to signify
caution.
What can this text tell us?

 The spatial mode - in terms of where the sign is in

relation to other objects, it is situated right by the road, so
will be visible to drivers and will be able to caution them to
avoid speeding or accidents on the road.
 04
How to analyze
multimodality
1. Identify the medium the text is in.

For example, is it a book? A sign? A film? This will give you

an idea of the function of the text and who it is aimed at.
2. Identify the different modes that make up the text and what
each mode communicates.

The modes convey a message that can be interpreted by looking at each

mode individually and also together; as communication doesn’t only
depend on a single mode.
Thank You!
Do you have any question?