UNIVERSIDADE FEDERAL DE SANTA CATARINA

CENTRO DE COMUNICAÇÃO E EXPRESSÃO

PROGRAMA DE PÓS-GRADUAÇÃO EM INGLÊS

PPGI/DLLE/UFSC
CPOURSE PLAN
SEMESTER 2020.2
PROFESSOR: Viviane M. Heberle

1. COURSE: Multimodalidade na Comunicação

Multimodality in Communication (4 credits)

Friday, from 8:30 to 612 AM, from November 2020 to March 2021

2. COURSE DESCRIPTION
In this course we will discuss the concept of multimodality, understood as a social semiotic approach to
contemporary communication, initially based on systemic functional linguistics. Multimodality can also be
seen as the use and integration of different semiotic resources in the design of a product or event. Studies
in multimodality include texts in several media in contemporary society, such as films, videos, videogames,
hypertexts and/or other digital technologies. Students will develop an understanding of the grammar of
visual design, spatial discourse analysis and the variety of semiotic resources used in contemporary
communication.

3. COURSE TOPICS
 Defining Multimodality as a social semiotic approach to contemporary communication

 The grammar of visual design: the three metafunctions

 The visual representation of social actors

 Spatial discourse analysis

4. EVALUATION
 Participation in class (20%)

 Oral presentations: summaries; article review; a multimodal analysis (40%)

 Article or book review (up to 700 words) and a final paper (5-6 pages) (40%)
 UNIVERSIDADE FEDERAL DE SANTA CATARINA
CENTRO DE COMUNICAÇÃO E EXPRESSÃO
PROGRAMA DE PÓS-GRADUAÇÃO EM INGLÊS

5. SCHEDULE

Nov 20: First class – Everyone together: Introduction of course and students

Nov 27 and Dec 4: home office: Watching the lectures and preparing critiques of four (4) of these events
for Dec 11 + reading the texts for Dec 18 and presenting 5 points on them to the class

Dec 11: Students’ oral presentations of the 4 critiques

Dec 18: Everyone together: Discussing the grammar of visual design and its relation to multimodality:
Discussion of Kress and Van Leeuwen’s Reading Images (Introduction + Chapter 1); Unsworth (Chapter 3) +
Callow (Chapter 1)

Feb 5: Everyone together: Continuing the discussion on the grammar of visual design + spatial discourse
analysis

Feb 12: Spatial Discourse Analysis

Feb 19: home office: selection of texts from different media and articles to present

Feb 26: Everyone together: Analysis of texts from different media

March 5: Everyone together: Students’ oral presentations of selected articles

March 12: Individual talk on the final paper

March 19: Everyone together: Last day of class General discussion of topics covered

6. REFERENCES (Obligatory marked with *)

Almeida, D. B. L. Novas Perspectivas em Análise Visual: Do Texto ao Contexto. 1. ed. Campinas, SP: Editora Mercado
das Letras, 2016.
Bezerra, F. A. S.; Nascimento, R. G.; Heberle, V. M. Análise multimodal de anúncios do programa Na Mão Certa".
Revista Letras (UFSM), v. 20(40), p. 9-26, 2010.
Bezemer, J.; Kress, G. Visualizing English: a social semiotic history of a school subject. Visual Communication, vol 8(3)
247-262, 2009.
Bezemer, Jeff, and Kress, G. (2016). Multimodality, Learning and Communication: A Social Semiotic Frame. London:
Routledge.
Blommaert, J. Ethnography, Superdiversity and Linguistic Landscapes: Chronicles of complexity. Bristol/Buffalo/
Toronto: Multilingual Matters, 2013.
Callow, J. (Ed.). Image matters: Visual texts in the classroom. Marrickville, NSW: Primary English Teaching
Association, 1999. (chapter 1)
Caldas-Coulthard, C. R. ; Leeuwen, T. v. Stunning, Shimmering, Iridescent: Toys as the Representatation of Gendered
Social Actors. In: L. Litosseleti; J. Sunderland. (Ed.). Gender Identity and Discourse Analysis. Amsterdam: John
Benjamins, 2002, pp. 91-110. 
Ensslin, Astrid. The language of gaming. London/ New York: Palgrave Macmillan, 2012.
Fairclough, N. Critical Discourse Analysis. (2 ed.). Abindon/New York: Routledge, 2010.
 UNIVERSIDADE FEDERAL DE SANTA CATARINA
CENTRO DE COMUNICAÇÃO E EXPRESSÃO
PROGRAMA DE PÓS-GRADUAÇÃO EM INGLÊS

Fuzer, C.; Cabral, S. R. S. Introdução à gramática sistêmico-funcional em língua portuguesa. Campinas: Mercado de
Letras, 2014.
Gauntlett, D. Media, Gender and Identity: An introduction. Londond/ New York: Routledge, 2002.
Halliday, M. A. K.; Matthiessen, C. Halliday’s Introduction to Functional Grammar. London/New York: Routledge,
2014.
Heberle, V. M. Multimodal literacy for teenage EFL students. Cadernos de Letras (UFRJ), v. 1, p. 1-12, 2010.
Heberle, V. M. Multimodalidade e multiletramentos: pelo estudo da linguagem como prática social multissemiótica.
In: Silva, K; Daniel, F; Marques, S. (Org.). A formação de professores de línguas: Novos olhares Volume II.
1ed.Campinas: Pontes, 2012, v. 2, p. 83-106.
Heberle, V. M. Estudos em multiletramentos e possíveis intersecções com o ensino de inglês no Brasil. In: M. B.
MOTA; A. R. CORSEUIL; M. S. BECK; C. H. S. TUMOLO (Orgs.). Língua e literatura na época da tecnologia.
Florianópolis: EdUFSC, 2015.
*Heberle, V., Veloso, F. O. D. (2013). (Eds.) Studies in Multimodality. Ilha do Desterro, vol. 64, Jan Jul, 2013.
https://periodicos.ufsc.br/index.php/desterro/issue/view/2014 (Introduction)
Heberle, V; Constanty, V. Meaning without words: analyzing the picture book Bárbaro through a social semiotic
perspective. Letras (UFSM), v. 26, p. 89-109, 2016.
Heberle, V. Linguística Aplicada, multimodalidade e multiletramentos. In: FinardI, Kyria; Tílio, R; Borges, V;
Dellagnelo, A; Ramos Filho, E. (Orgs.). Transitando e transpondo n(a) linguística aplicada. Campinas: Pontes, 2019,
p. 55-82.
Heberle, V. Apontamentos sobre linguística sistêmico-funcional, contexto de situação e transitividade com exemplos
de livros de literatura infantil. DELTA. DOCUMENTAÇÃO DE ESTUDOS EM LINGUÍSTICA TEÓRICA E APLICADA
(PUCSP. IMPRESSO), v. 34, p. 81-112, 2018.
Iedema, R. Multimodality, resemiotization: extending the analysis of discourse as multi-semiotic practice. Visual
Communication, 2(1), 29-57, 2003.
Jenkins, H. Convergence Culture: Where old and new media colide. New York/London: New York University Press,
2006.
Jewitt, C.; Kress, G. Multimodal literacy. New York: Peter Lang, 2008.
Jewitt C (Ed.) Routledge Handbook of Multimodal Analysis. Abingdon: Routledge, 2009.
*Kress G. Multimodality: A Social Semiotic Approach to Contemporary Communication. Routledge: London, 2010.
(Chapter 4)
*Kress, G.; Van Leeuwen, T. Reading images: The grammar of visual design. 2. ed. London: Routledge, 2006.
Kress, G. Literacy in the new media age. London: Routledge, 2003.
Kress, G; Van Leeuwen, T. Multimodal discourse: The modes and media of contemporary
communication. Londres: Arnold, 2001.
Motta-Roth, D.; Heberle, V. A short cartography of genre studies in Brazil. Journal of English for Academic Purposes,
2015, vol 19, p. 22-31.
Matthiessen, C. Ideas and new directions. In: Michael A.K. Halliday & Jonathan Webster. Eds. Continuum companion
to systemic functional linguistics. London/New York: Continuum, p. 12-58, 2009.
*Nascimento, R. G.; Bezerra, F. A. & Heberle, V. Multiletramentos: iniciação à análise de imagens. Linguagem &
Ensino, Pelotas, v.14, n.2, p. 529-552, jul./dez. 2011.
New Learning http://newlearningonline.com/
O'Toole, M. The language of displayed art. London: Leicester University Press, 1994.
Painter, C., Martin, J. R., & Unsworth, L. Reading visual narratives: inter-image analysis of children’s picture books.
London: Equinox, 2013.
Pasquetti, C.; Heberle, V. M. A multimodal study of the This is book series in its translation into Brazilian Portuguese.
In: Magali Sperling Beck; Maria Ester Moritz; Maria Lúcia Milléo Martins; Viviane Heberle. (Eds.). Echoes : further
reflections of language and literature. 1ed.Florianópolis, Santa Catarina,: Editora da UFSC, v. 2, p. 83-96, 2016.
 UNIVERSIDADE FEDERAL DE SANTA CATARINA
CENTRO DE COMUNICAÇÃO E EXPRESSÃO
PROGRAMA DE PÓS-GRADUAÇÃO EM INGLÊS

* Ravelli, L.; Heberle, V. M. Bringing a museum of language to life: the use of multimodal resources for interactional
engagement in the Museu da Língua Portuguesa, Brazil. Revista Brasileira de Linguística Aplicada, Belo
Horizonte, v. 16, n. 4, p. 521-546, 2016.
*Ravelli, L. Museum texts: communication frameworks. London/New York: Routledge, 2006 (Introduction + Chapter
6).
Ravelli, L.; McMurtruie, R. Multimodality in the built environment. New York/London: Routledge, 2016 (Chapter 1 –
Foundations).
Rojo, R. H. R. (Org.); Moura, E. (Org.) Multiletramentos na Escola. São Paulo, SP: Parábola, 2012.
*Rojo, R. Entre Plataformas, ODAs e Protótipos: Novos multiletramentos em tempos de WEB2. The ESPecialist, v. 38,
p. 1-20, 2017.
Royce,T.; Bowcher,W. (Eds) New Directions in the analysis of multimodal discourse. Mahwah, NJ: Lawrence
Erlbaum, 2007, pp361-403.
Salbego, N.; Heberle, V; Balem, M.G. A visual analysis of English textbooks: Multimodal scaffolded  learning.
Calidsocópio, vol. 13, n. 1, p. 5-13, jan/abr. 2015.
Sunderland, J; Mcglashan, M. Looking at picturebook covers multimodally: the case of two-Mum and two-Dad
picturebooks. Visual Communication, Vol 12(4): 473–496, 2013.
The New London Group. A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1),
60-91, 1996.
Unsworth, L. (2001). Teaching multiliteracies across the curriculum: Changing contexts of text and image in
classroom practice. Buckingham, UK: Open University. (Chapter 3)
Unsworth, L. Towards a metalanguage for multiliteracies education: Describing the meaning making resources of
language-image interaction. English Teaching: Practice and Critique, May 2006, Vol 5, Number 1 pp. 55-76.
http://education.waikato.ac.nz/research/files/etpc/2006v5n1art4.pdf.
Unsworth, L. (Ed.). Multimodal Semiotics: functional analysis in contexts of education. London, New York:
Continuum, 2008.
Unsworth, L.; Thomas, A. (Ed). English Teaching and New Literacies Pedagogy: Interpreting and authoring digital
multimedia narratives. New York: Peter Lang, 2014.
Van Leeuwen, T. Introducing Social Semiotics. London/New York: Routledge, 2005.
Van Leeuwen, T. Discourse and Practice: New tools for critical discourse analysis. Oxford/New York: Oxford
University Press, 2008 (Chapter 8).
*Zhao, S.; Djonov, E. Björkvall, A.; Boeriss, M. (Eds.). Advancing multimodal and critical discourse studies:
Interdisciplinary research inspired by Theo Van Leeuwen’s social semiotics. New York and London: Routledge,
2018 (Chapter 1).

Journals: Critical Discourse Studies; Calidsocópio, Delta, Discourse & Society, Discourse Studies, Linguagem em
(Dis)curso. Revista Brasileira de Linguística Aplicada, Trabalhos em Linguística Aplicada, Gender and Language,
Linguagem e Ensino, Letras & Letras, Tesol Quarterly, Linguistics and the Human Sciences, Text and Talk, Journal of
Pragmatics, Revista Bakhtiniana, Veredas, Ilha do Desterro, Fragmentos, Visual Communication...