Review of Research: Rereading the Signs: Multimodal Transformations in the Field of Literacy Education

Marjorie Siegel

DOI: https://doi.org/10.58680/la20065611

2006-09-01

Abstract:Siegel looks at what research on literacy has to say about multimodal transformations and what questions we might pursue to understand the possibilities such transformations hold for children’s learning and lives.

What problem does this paper attempt to address?

Multimodal Literacy: From Theories to Practices

Frank Serafini

DOI: https://doi.org/10.58680/la201527389

2015-07-01

Abstract:The creation of visual images and multimodal texts allows humans to communicate feelings and ideas across time and space, develop relationships with one another, and document the details of everyday experiences. With greater frequency, students are confronted with texts that include visual images and a variety of design features rather than texts that focus primarily on written language. The inclusion of multimodal features in addition to written language presents challenges to novice readers as they work within and across multiple sign systems to construct meaning. The purpose of this article is to offer a framework for bringing theories of multimodal literacies into the classroom, to reconsider the text as a visual object, semiotic resource, and sociocultural artifact, and to offer instructional approaches for developing students’ interpretive repertoires.
Reading the Visual: An Introduction to Teaching Multimodal Literacy

Rashad Ahmed

DOI: https://doi.org/10.56540/jesaf.v3i1.92

2024-03-11

Abstract:This is a book review of the book, Reading the Visual: An Introduction to Teaching Multimodal Literacy by Frank Serafini. It is a 189-page book published in 2014 by Teachers College Press. It discusses the evolving concept of literacy in the age of multimodality. Organized into three parts and framed by a prologue and an epilogue, the book begins with an introduction that sets the stage for understanding the multimodal world and its relevance to educators. The first part lays a theoretical foundation for multimodality, guiding educators in their instructional approaches. The second part presents a practical framework for engaging with multimodal texts, highlighting the significance of picture books in literacy education and exploring how students can interact with various multimodal formats both as consumers and producers. The final part examines ten distinct types of multimodal ensembles, including diverse formats like picture books (postmodern, wordless, historical fiction, informational), illustrated novels, graphic novels, cartoons, comics, advertisements, news reports, films, and digital media. In the closure, a helpful glossary provides readers with a comprehensive understanding of multimodal configurations and visual meaning-making systems.
Exploring reading in social semiotics: theory and methods

Jeff Bezemer,Kate Cowan

DOI: https://doi.org/10.1080/03004279.2020.1824706

2020-09-27

Abstract:<span>The aim of this paper is to critically review how social semiotics has contributed to the study of reading and to develop an agenda for further research. We consider the theoretical and methodological resources that social semiotics has developed to account for multimodal text in the contemporary semiotic landscape, and explore how they can be used to teach critical reading skills to young people to support their participation in different social domains. We reflect on the possibilities and limitations of different analytical frameworks, highlighting barriers and possibilities for advancing social semiotic scholarship on reading and beyond. We end with a sketch of a new research agenda for social semiotics, in the light of technological change and its implications for reading.</span>
Multimodal Literacy in a New Era of Educational Technology: Comparing Points of View in Animations of Children's and Adult Literature

Len Unsworth

DOI: https://doi.org/10.1177/20965311231179738

2023-06-15

ECNU Review of Education

Abstract:ECNU Review of Education, Ahead of Print. PurposeThe paper shows the interpretive impact of different constructions of the point of view available to the reader/viewer in book and animated movie versions of a children's picture book, a novel for pre-adolescents/early teenagers, and a graphic novel for adolescents and adults.Design/Approach/MethodsExcerpts from book and animated movie versions of the same story are compared using multimodal analysis of interpersonal meaning to show how the reader/viewer is positioned in relation to the characters in each version, complemented by analyses of ideational meaning to show the effect of point of view on interpretive possibilities.FindingsFocusing mainly on multimodal construction of point of view, the analyses show how interpretive possibilities of ostensibly the same story are significantly reconfigured in animated adaptations compared with book versions even when the verbal narrative remains substantially unchanged.Originality/ValueThe study shows that it is crucial to students' critical appreciation of, and their creative contribution to, their evolving digital literary culture that in this new era of educational technology, attention in literacy and literary education focuses on developing understandings of digital multimodal narrative art, and that animated movie adaptations are not presented pedagogically as isomorphic with, or simply adjunct to, corresponding book versions.
Interpreting old texts with new tools: Digital multimodal composition for a high school reading assignment

Jennifer M. Higgs,Grace MyHyun Kim

DOI: https://doi.org/10.1108/etpc-07-2020-0079

2021-10-25

Abstract:Purpose Research on nonschool settings suggests young people benefit from digital multimodal composition. Less is known about how digital composing can support students as they interpret required literary class texts. To understand the potential benefits and challenges of digitally composing for literary analysis, design interviews with two high school students were conducted to examine their processes as they designed digital multimodal compositions to interpret Anglo-Saxon poems. Grounded in the social semiotic theory of multimodality, this study aims to examine how students engaged in literary analysis and interpretive digital composition within secondary ELA. Design/methodology/approach Qualitative classroom data were collected through digital means over a six-week period: a whole-class student survey, focal student semistructured design interviews, emails, field notes, analytic memos and student-created digital artifacts. Findings Students’ print-based literary engagements and digital multimodal composition processes were mutually shaped. Additionally, digital multimodal composition offered entry points into challenging print-based literary texts, resulting in understandings enacted across multiple forms of mediation. Research limitations/implications The study focused on one cycle of multimodal composition. Additional studies of students’ digital multimodal composition processes in ELA classrooms over time could be beneficial to the field. Practical implications The study identifies an approach to digital multimodal composition that may help teachers address and integrate core disciplinary objectives. Originality/value This study contributes to scholarship concerned with how “new” technologies and “old” literacies co-exist in contexts requiring students to engage in expanded communication modes alongside specific academic literacies.
Composing meaning through multiliteracies and multimodality with adolescent and adult learners

Susan Holloway,Rasha Qaisi

DOI: https://doi.org/10.20360/langandlit29587

2022-08-19

Language and Literacy

Abstract:The research from this ongoing nationally funded study explores multiliteracies and multimodality in secondary schools and adult education settings including a museum, dance studio, and French language learning centre. There are 30 participants to date in the study. Using constructivist grounded theory methodology, the study draws upon data from face-to-face interviews, observations, document analysis, and original film footage of learning spaces. Social semiotics theory is used in this paper to articulate how a range of modes (visual, linguistic, and gestural) affect teaching and learning. The findings suggest that multiliteracies and multimodality foster creativity and criticality, engage marginalized learners, and provide greater versatility in meaning-making practices.
Multimodal literacy: Unfolding reading path in children’s picture book and its potential for EFL classrooms

Ika Lestari Damayanti,Yusnita Febrianti

DOI: https://doi.org/10.17509/ijal.v9i3.23212

2020-02-10

Indonesian Journal of Applied Linguistics

Abstract:This paper reports on an investigation into the reading path patterns in a children’s picture book. The primary investigation focused on the semiotic resources involved in the construction of meanings in picture books i.e. language and image elements. These semiotic resources provide insights into the unfolding of the storylines in the observed picture book. In order to detail the roles of these resources, a picture book entitled Tacky the Penguin (Lester, 1988) was selected and examined by employing two methods: Kress and Van Leeuwen’s (1996, 2006) structure of information value and Royce’s (1998) Intersemiotic Complementarity. The results of the analysis suggest that the whole picture book is built from a page-by-page reading path that allows for a linear and non-linear reading path. While each page presents a different layout of information value, the general pattern leads to a linear reading path from the beginning up to the end of the picture book. The mapping of the reading path is reinforced by the interrelated meanings between verbal and visual resources on the page. Drawing on the analysis results, this paper offers the delve into the flow of information from the language and image resources in the picture books that can be used to inform practical use of picture books in EFL classrooms.

English Else
Teaching Multimodal and Digital Literacy in L2 Settings: New Literacies, New Basics, New Pedagogies

Heather Lotherington,Jennifer Jenson

DOI: https://doi.org/10.1017/s0267190511000110

2011-03-01

Annual Review of Applied Linguistics

Abstract:Globalization and digitization have reshaped the communication landscape, affecting how and with whom we communicate, and deeply altering the terrain of language and literacy education. As children in urban contexts become socialized into communities of increasing cultural and communicational connectivity, complexity, and convergence (Jenkins, 2004), and funding for specialist second language (L2) support declines, classrooms have become linguistically heterogeneous spaces where every teacher is a teacher of L2 learners. This article has two purposes: The first is to give an overview of the concept of multimodal literacies, which utilize diverse media to represent visual, audio, gestural, spatial, and tactile dimensions of communication in addition to traditional written and oral forms (Cope & Kalantzis, 2009a). Since the New London Group's manifesto on multiliteracies in 1996, which merged language and literacy education agendas in L2 teaching, language arts, media literacy, and cultural studies, new basics have developed that apply to all classrooms and all learners. Second, this article reviews and reports on innovative pedagogical approaches to multimodal literacies involving L2 learners. These are grounded theoretically (Cope & Kalantzis, 2009a, 2009b; Kress, 2003, 2010; New London Group, 1996) and epistemologically (de Castell & Jenson, 2003; Gee, 2009, 2010; Kellner, 2004; Lankshear & Knobel, 2003, 2006).

linguistics
Visual and verbal intersections in picture books – multimodal assessment for middle years students

Jon Callow

DOI: https://doi.org/10.1080/09500782.2019.1689996

2020-01-27

Language and Education

Abstract:While literacy research in the area of multimodality includes a range of communication modes, the combination of the visual and verbal modes is arguably the most common multimodal text form used in classroom contexts from posters, charts and information texts to picture books and graphic novels. Assessment of students' understanding of visual and verbal modes as well as their combined meanings is a growing area of literacy research. Using data drawn from a larger case study, this article focusses on 11 middle years students (Grade 6) as they read then discussed a range of features from the award-winning picture book The Watertower by Gary Crew and Steve Woolman. This picture book includes visual and verbal intersections, where the meanings of each mode may be equivalent to each other, augment each other or at times apparently offer divergent or contradictory meanings. With a focus on assessing students' multimodal knowledge, comprehension and visual metalanguage, the study utilized assessment strategies which included discussion, questioning and a visual text making activity. The findings are discussed in terms of the suggested guidance for planning effective multimodal assessment strategies in the classroom.

education & educational research,linguistics
Possibilities and Challenges of Multimodal Literacy Practices in Teaching and Learning English as an Additional Language

Youngjoo Yi

DOI: https://doi.org/10.1111/lnc3.12076

2014-04-01

Language and Linguistics Compass

Abstract:I review a decade of empirical research specifically addressing possibilities and challenges of multimodal literacy practices in learning and teaching English as an additional language, particularly for adolescent multilingual English language learners (ELLs). Given the lack of empirical research and discussions about multimodal literacy practices of ELLs, this review focuses on the issues of multimodal literacy practices of ELLs and their teachers. Thus, I look mainly at the promise and potential of engaging ELLs in multimodal literacy practices and potential tensions of implementing multimodal literacies into classroom practices. Findings of this review suggest more empirical research related to how ELLs consume, interpret, and produce multimodal texts as well as some implications for pedagogy.
Creative and critical approaches to language learning and digital technology: findings from a multilingual digital storytelling project

Jim Anderson,Yu-Chiao Chung,Vicky Macleroy

DOI: https://doi.org/10.1080/09500782.2018.1430151

2018-01-30

Language and Education

Abstract:This article presents findings from the global literacy project, Critical Connections: Multilingual Digital Storytelling (MDST), which provides a means of nurturing and reflecting multiliteracies in practice. It recognises the power of storytelling and the space stories offer both for self-representation and for engaging with otherness. It draws on affordances of the digital medium for multimodal composition and for collaborative and dialogic ways of working and sharing across boundaries of home, school and community. It values and supports multilingual repertoires recognising that every language is a distinct medium with its own expressive resources, its own palette of colours, its own sounds and rhythms, all shaped by and representing history, culture, values and beliefs. The core argument is that greater attention needs to be given to the multilingual dimension within multiliteracies research. We outline the theoretical framework underpinning our research and the rationale for adopting a critical ethnographic approach. We explore the significance of MDST for young people and their learning; the effective pedagogical framework for carrying out MDST; and the implications for policy and teacher development. This research enabled us to demonstrate the importance of an integrated and inclusive approach towards languages within the multiliteracies framework.

education & educational research,linguistics
Everyone Has a Neil: Possibilities of Literacy Desiring in Writers’ Studio

Candace Tara R.Kuby L.Gutshall Rucker

DOI: https://doi.org/10.58680/la201527190

2015-05-01

Abstract:The aim of this article is to demonstrate the sophisticated and collaborative literacy desirings of children when they are given time, space, materials, and permission to create multimodally in Writers’ Studio. We share artifacts created by one second-grade student, Neil, for an in-depth look at the possibilities of writing as a creative construction. We use pedagogical documentation to visualize and better understand the processes of his writing. Thinking with poststructural ideas of becoming, fissures, and desire and the posthumanist idea of intra-activit-with-materials, we analyzed artifacts, videos of writing, conversations with students, photographs, and notes. Analyses helped us understand the processes of Neil’s literacy desiring, not simply the products. Even within a climate of mandates and standards being pushed on teachers, this type of multimodal teaching and learning can happen. As educators, we have to imagine the possibilities, trust students, and also give them permission to create other possibilities of writing.
Meaning Making With Picturebooks: Young Children’s Use of Semiotic Resources

Dani Kachorsky,Lindsey Moses,Frank Serafini,Megan Hoelting

DOI: https://doi.org/10.1080/19388071.2017.1304595

2017-04-17

Literacy Research and Instruction

Abstract:As part of a year-long, classroom-based research study examining literacy instruction and development, the research team observed emerging decoders draw from a range of semiotic resources while reading picturebooks. Utilizing a case study approach, the researchers selected eight first graders to act as a representative case, and examined their interactions with multimodal picturebooks. Analysis of students’ interactions led to the development of a typology of semiotic resources that students used to make meaning with picturebooks including typographical features, paralinguistic features, design features, illustrations, and background knowledge. Analysis also revealed that students articulated meaning in three distinct ways: explicitly, inferentially, and performatively. Findings suggests that traditional ways of assessing emerging decoders may not fully represent their meaning making practices.
Theories and Practices of Multimodal Education: The Instructional Dynamics of Picture Books and Primary Classrooms

Dawnene D. Hassett,Jen Scott Curwood

DOI: https://doi.org/10.1598/rt.63.4.2

2009-12-01

The Reading Teacher

Abstract:The imaginative and interactive modes of communication available for children today, above and beyond print, indicate a profound shift to the nature of reading education as a whole. This article reviews the theoretical landscape involved in multimodal education, and then examines the practices that make multimodal education feasible in the classroom. Using examples from a research project in which elementary school teachers designed and implemented literacy curricula that focused on multimodal reading and writing skills, we highlight the instructional dynamics that took place in these classrooms and outline the ways in which the teachers effectively oriented their students toward the kind of multimodal and sociocognitive work that is characteristic of a larger digital culture. In the end, the implications for reading instruction are framed in terms of a pedagogy of multiliteracies. تشير طرق المواصلات الخيالية والتعاونية المتوفرة للأولاد اليوم فوق المطبوعات ووراءها إلى التغير الجوهري في طبيعة تعليم القراءة ككل. لذا تراجع هذه المقالة التضاريس النظرية في التعليم ذي تعددية الطرق وثم تفحص الممارسات التي تسني التعليم ذا تعددية الطرق في غرفة الصف. وباستخدام أمثلة من مشروع بحثي فيه قد صمم مدرسو الابتدائية منهاجاً دراسياً مركزاً على مهارات تعددية الطرق في القراءة والكتابة نسلط الضوء على الديناميكيات التعليمية التي حدثت في غرف الصفوف هذه ونبين الطرق التي وجه فيها المعلمون طلابهم نحو نوع من العمل التعددي الطرق والاجتماع الذهني الذي يتمثل في الثقافة الرقمية الكبرى. وفي الختام يتم وضع أعقاب تعليم القراءة في إطار علم أصول التدريس من حيث تعددية المعارف. 今天可供孩子们使用的通信模式富创意性及互动性,远超越以往的打印模式,这表示阅读教育的性质在整体上有一个深远的转变。本文评论有关多模态教育的理论背景,并考查能使多模态教育在教室里成为可行的教学实践。在一项研究计划中,小学教师设计及实施以教授多模态读写技能为主的读写文化课程。作者使用该研究其中一些实例来凸显出这些教室里所产生的教学动力,并概述教师如何有效地指导学生以多模态及社会认知为目标的读写文化学习,而这些多模态及社会认知性读写文化工作正是一个更大的数位文化的特征。本文最后以多元媒体读写文化教学法的理论框架说明这项研究结果对阅读教学所带来的启示。 Les modalités de communication imaginatives et interactives dont disposent aujourd'hui les enfants, concernant l'écrit et au‐delà de celui‐ci, indiquent un profond changement de la nature de l'enseignement de la lecture dans son ensemble. Cet article fait un tour d'horizon du paysage théorique qu'inclut la pédagogie plurimodale, puis examine les pratiques qui rendent possible une pédagogie plurimodale dans la classe. En prenant des exemples dans un projet de recherche dans lequel les professeurs des écoles élémentaires préparent et réalisent des programmes de littératie centrés sur des compétences en lecture et écriture plurimodales, nous mettons en lumière la dynamique pédagogique qui se produit dans ces classes et mettons en évidence les modalités selon lesquelles les professeurs orientent véritablement les élèves vers le genre de travail plurimodal et sociocognitif qui caractérise une culture numérique plus large. On définit pour finir un cadre des implications pour un enseignement de la lecture en termes de pédagogie de multilittératie. Дети сегодня получают и передают информацию различными способами – не только посредством печатной или письменной речи, но также образно и интерактивно. Поэтому подходы к обучению чтению тоже должны коренным образом измениться. В статье предложен обзор теоретических работ по мультимодальному обучению и опыт конкретных учителей начальной школы, реализовавших этот подход на практике в рамках исследовательского проекта. Они разработали и апробировали программу по обучению грамотности, включавшую развитие навыков чтения и создания мультимодальных текстов. Авторы подробно описывают учебный процесс и методы, с помощью которых учителя успешно познакомили учащихся с теми видами мультимодальной и социально‐когнитивной деятельности, которые характерны для современной цифровой культуры. Предложенные выводы связаны с применением этих практик с целью развития мультиграмотности при обучении чтению. Los medios imaginativos e interactivos de comunicación disponible a los niños de hoy, más allá de lo impreso, indican un cambio profundo en la naturaleza de la alfabetización en su totalidad. Este artículo examina las teorías sobe la educación multimodal, y luego examina las prácticas que hacen la educación multimodal posible en las aulas. Usando ejemplos de un proyecto de investigación en el que maestros de escuela primaria diseñaron e implementaron planes de estudio de alfabetización enfocados en las destrezas multimodales de lectura y escritura, hacemos resaltar la dinámica docente que tomó lugar en estas aulas y hacemos un resumen de las maneras en que los maestros pudieron orientar eficazmente a sus estudiantes a hacer la clase de trabajo multimodal y sociocognoscitivo que caracteriza gran parte de la cultura digital. Al final, las implicaciones para la instrucción de lectura se enmarcan en términos de la pedagogía de multicompetencias.

education & educational research
Critical Issues: Reading and the New Literacy Studies: Reframing the National Academy of Sciences Report on Reading

James Paul Gee

DOI: https://doi.org/10.1080/10862969909548052

1999-09-01

Journal of Literacy Research

Abstract:This article is a reflection on the recent report from the National Academy of Sciences, Preventing Reading Difficulties in Young Children. This report, typical of many recent discussions of early reading instruction, centers on psycholinguistic aspects of reading having to do with phonological awareness, decoding, word recognition, and literal comprehension. I seek to reframe the report from the perspective of the New Literacy Studies, an interdisciplinary effort that takes a sociocultural approach to language and literacy. My approach is to stress tensions internal to the report itself as pressure points around which one could imagine a different sort of report being written, one more in the spirit of the New Literacy Studies. I take up issues such as whether or not there is a consensus in the reading field; the nature of the “literacy crisis”; relationships among reading, poverty, racism, and culture; whether or not technology leads to higher literacy demands; learning to read as against learning content; and the connections among phonological awareness, early language abilities, and the use of specific genres and registers in school.

education & educational research,psychology, educational
Ethical Dilemmas Within Online Literacy Research

Jen Scott Curwood,Alecia Marie Magnifico,Jayne C. Lammers,Amy Stornaiuolo

DOI: https://doi.org/10.1177/2381336919870264

2019-08-25

Abstract:As literacy researchers trace how people make meaning across multiple contexts and online environments, ethical complexities arise that require researchers to be culturally attuned, flexible, innovative, and reflexive. This article draws on a transliteracies perspective to argue that ethical issues related to accessibility, positionality, relationality, and temporality must drive literacy research in online spaces. It highlights international research situated in online environments to explore some of the ethical challenges, dilemmas, and opportunities that literacy researchers face as they conceptualize, conduct, and disseminate scholarship in a digital age. It seeks to move the literacy field forward by sharing guiding questions and provocations to inform digitally situated lines of inquiry and by offering recommendations for literacy researchers who seek to conduct ethical research in online spaces.
Literacy and signing deaf students: a multi-national scoping review

Hannah Dostal,Jessica Scott,Ana Gediel,Shirley Vilhalva,Camila Gasparin

DOI: https://doi.org/10.1093/jdsade/enae023

2024-09-20

Abstract:Many literature reviews or other types of reviews (e.g., meta-analyses, scoping reviews) in deaf education research are focused upon primarily or exclusively research that is performed in U.S. contexts or English-speaking contexts only. However, research that is conducted in non-English-speaking, non-U.S. settings that may be more likely to be multilingual, has value for our understanding of how deaf students using multiple languages may develop literacy skills. The objective of this review was to explore the literature on literacy development with deaf learners conducted outside of English-speaking contexts that has been published in English, Portuguese, or Spanish. We identified 13 English-language articles, 9 Portuguese-language articles, and 0 Spanish articles that met inclusion criteria. From these articles, we glean important insights into the reading process, including the teaching of subskills of reading, writing instruction, early literacy experiences, and the potential relationship between signed languages and literacy. We also note the need for multiple, converging sources of evidence and the value of an asset-driven approach to understanding deaf learners.
(Re)conceptualizing “Language” in CLIL

Jiajia Eve Liu,Angel M. Y. Lin

DOI: https://doi.org/10.1075/aila.21002.liu

2021-12-31

AILA Review

Abstract:Abstract CLIL focuses on the integration of content learning and additional language learning. However, it is increasingly recognized that the re/presentation and communication of discipline-specific content involve not only language, but also other semiotic modes (such as visuals and gestures). This is accelerated by the advancement of digital technologies and multiplicity of communication channels in recent years. This article points out the urgent need to revisit and reconceptualize the roles of “language” in CLIL. It argues that, to prepare students for the multimodal communication landscape in today’s societies and to truly value their linguistic and semiotic diversity in learning, the “language” dimension in CLIL needs to be reconceptualized as a multimodal dimension, and CLIL classroom practices need to adopt an updated pedagogy of multiliteracies ( New London Group, 1996 ) rather than focusing on “mere language” practice. The article reviews the recent development of theories and studies of multimodality and trans-semiotics and discusses their implications for what to teach and how to teach in today’s CLIL classrooms. It proposes the notions of translanguaging and trans-semiotizing to emphasize a dynamic and dialogic process of meaning (co)making process drawing on multiple linguistic and semiotic resources to enable students to both gain access to and critically engage in meaning/knowledge co-making/co-design. Ultimately, it aims at reconceiving CLIL to contribute to a more equitable school and classroom culture.
Learning about Culture, Language, and Power: Understanding Relationships among Personhood, Literacy Practices, and Intertextuality

Ann Egan-Robertson

DOI: https://doi.org/10.1080/10862969809548011

1998-12-01

Journal of Literacy Research

Abstract:This article theorizes about what the notions of personhood and intertextuality contribute to our conception of literacy teaching and learning. To do so, it provides definitions of key terms and a review of related literature from literacy studies, critical discourse analysis, and multicultural education. The article then presents an analytical framework for understanding interrelationships among personhood, literacy practices, and intertextuality. To elaborate on the theoretical ideas presented, the article draws on data from a study of an urban writing club in which a small group of eighth-grade female students used a number of research methods to explore issues of culture, language, and power that had importance to them. Analysis focuses on (a) the ways two students took up opportunities presented to them as they participated in the writing club for shaping and reshaping discourse practices about personhood along the dimensions of history, music, racial and ethnic identity, and womanhood, and (b) the significance of the framing of the study in providing opportunities for the students to make inter-textual links between their research studies and the literacy practices of community members.

education & educational research,psychology, educational
Critical Multimodal Studies of Popular Discourse

DOI: https://doi.org/10.4324/9780203104286

2013-09-23

Abstract:Studies of multimodality have significantly advanced our understanding of the potential of different semiotic resources—verbal, visual, aural, and kinetic—to make meaning and allow people to achieve various social purposes such as persuading, entertaining, and explaining. Yet little is known about the role that individual nonverbal resources and their interaction with language and with each other play in concealing and supporting, or drawing attention to and subverting, social boundaries and inequality, political or commercial agendas. This volume brings together contributions by rominent and emerging scholars that address this gap through the critical analysis of multimodality in popular culture texts and semiotic practices. It connects multimodal analysis to critical discourse analysis, demonstrating the value of different approaches to multimodality for building a better understanding of critical issues of central interest to discourse analysis, semiotics, applied linguistics, education, cultural and media studies.

Review of Research: Rereading the Signs: Multimodal Transformations in the Field of Literacy Education

Multimodal Literacy: From Theories to Practices

Reading the Visual: An Introduction to Teaching Multimodal Literacy

Exploring reading in social semiotics: theory and methods

Multimodal Literacy in a New Era of Educational Technology: Comparing Points of View in Animations of Children's and Adult Literature

Interpreting old texts with new tools: Digital multimodal composition for a high school reading assignment

Composing meaning through multiliteracies and multimodality with adolescent and adult learners

Multimodal literacy: Unfolding reading path in children’s picture book and its potential for EFL classrooms

Teaching Multimodal and Digital Literacy in L2 Settings: New Literacies, New Basics, New Pedagogies

Visual and verbal intersections in picture books – multimodal assessment for middle years students

Possibilities and Challenges of Multimodal Literacy Practices in Teaching and Learning English as an Additional Language

Creative and critical approaches to language learning and digital technology: findings from a multilingual digital storytelling project

Everyone Has a Neil: Possibilities of Literacy Desiring in Writers’ Studio

Meaning Making With Picturebooks: Young Children’s Use of Semiotic Resources

Theories and Practices of Multimodal Education: The Instructional Dynamics of Picture Books and Primary Classrooms

Critical Issues: Reading and the New Literacy Studies: Reframing the National Academy of Sciences Report on Reading

Ethical Dilemmas Within Online Literacy Research

Literacy and signing deaf students: a multi-national scoping review

(Re)conceptualizing “Language” in CLIL

Learning about Culture, Language, and Power: Understanding Relationships among Personhood, Literacy Practices, and Intertextuality

Critical Multimodal Studies of Popular Discourse