Abstract:In this information and consumer age, social and business exchanges have become visibly multimodal. Socially, we not only communicate using multiple platforms but we co-participate. Businesses engage customers multi-modally in order to cater and customise products and services to meet individual preferences. Faced with this multimodality in everyday life, how do our classrooms compare when attending to our students living in the age of consumerism? How do teachers respond and facilitate learning to meet the demands of today's digital age? This paper presents a multimodal teaching and learning framework for the classroom. Taking the cue from multi-modality in communication, this paper extends the notion of multimodal learning beyond multimodal text and expands the notions of multi-literacy into a pedagogical approach. The paper contends that unless our classroom teaching embraces an overtly multimodal learning approach, we risk disconnecting with and disadvantaging our students. The main research question is: how do teachers and students engage the various modes and mediums to share and make meaning in the classroom. Using an ethnographic study of 24 cases of classroom sessions in a Japanese university, this paper will demonstrate, from the findings, a typology of informational representations for a framework of multimodal teaching and learning. Specific examples on what and how both teachers and students use to communicate and make meaning will be presented. The research methods include observations, repeated video viewing, audio recordings, interviews and examinations of artefacts. Analysis of data was done using grounded theory methods for observation, video and interview data and conversational analysis for classroom audio data. This study will reveal that there are major categories for the image, text, and audio mediums with further three to five sub-groups. The paper will also show that there is a variety of verbal and nonverbal modes with a clear pattern of primary and subordinating modal relationships. The findings also include the range of social-cultural artefacts and technological platforms that the old and new media affords. It will also illustrate how the variety of modes that make meaning and the range of artefacts that represent information function in both space and time continuums. The paper concludes with suggestions on future directions to facilitate learning in this information and consumer age.

Composing meaning through multiliteracies and multimodality with adolescent and adult learners

Multimodal composing in the English classroom: recontextualising the curriculum to learning

Interpreting old texts with new tools: Digital multimodal composition for a high school reading assignment

Composing Across Media for Rhetorical and Idiosyncratic Purposes: Text‐Based Writing and Digital Multimodal Composing

Rethinking Composing in a Digital Age: Authoring Literate Identities Through Multimodal Storytelling

Empowering English as an Additional Language students through digital multimodal composing

Digital multimodal composing in post-secondary L2 settings: a review of the empirical landscape

The social drama of digital multimodal composing: A case study with emergent bi/multilingual newcomer students

A Multimodal Framework for Teaching and Learning : Case Study of a Japanese University Context

A Multimodal Analysis of the Online Translanguaging Practices of International Students Studying Chinese in a Chinese University

Teaching Multimodal and Digital Literacy in L2 Settings: New Literacies, New Basics, New Pedagogies

Digital Multimodal Composing in L2 Learning: Ideologies and Impact

Developing Multimodal Narrative Genres in Childhood: An Analysis of Pupils’ Written Texts Based on Systemic Functional Linguistics Theory

Children’s digital multimodal composing: implications for learning and teaching

Multimodal Composition in a College ESL Class: New Tools, Traditional Norms

The meaning making of digital multimodal texts by languages undergraduate students

The construction of translanguaging space through digital multimodal composing: A case study of students' creation of instructional videos

Exploring Multiliteracies and Multimodal Pedagogies in Chinese Language Teaching

A pedagogical framework for digital multimodal composing in the English Language classroom

A Multimodal Approach to Teaching Chinese as a Foreign Language (CFL) in the Digital World

Bringing plurilingual strategies into linguistically diverse classrooms: affordances of digital multimodal composing