Abstract:In this information and consumer age, social and business exchanges have become visibly multimodal. Socially, we not only communicate using multiple platforms but we co-participate. Businesses engage customers multi-modally in order to cater and customise products and services to meet individual preferences. Faced with this multimodality in everyday life, how do our classrooms compare when attending to our students living in the age of consumerism? How do teachers respond and facilitate learning to meet the demands of today's digital age? This paper presents a multimodal teaching and learning framework for the classroom. Taking the cue from multi-modality in communication, this paper extends the notion of multimodal learning beyond multimodal text and expands the notions of multi-literacy into a pedagogical approach. The paper contends that unless our classroom teaching embraces an overtly multimodal learning approach, we risk disconnecting with and disadvantaging our students. The main research question is: how do teachers and students engage the various modes and mediums to share and make meaning in the classroom. Using an ethnographic study of 24 cases of classroom sessions in a Japanese university, this paper will demonstrate, from the findings, a typology of informational representations for a framework of multimodal teaching and learning. Specific examples on what and how both teachers and students use to communicate and make meaning will be presented. The research methods include observations, repeated video viewing, audio recordings, interviews and examinations of artefacts. Analysis of data was done using grounded theory methods for observation, video and interview data and conversational analysis for classroom audio data. This study will reveal that there are major categories for the image, text, and audio mediums with further three to five sub-groups. The paper will also show that there is a variety of verbal and nonverbal modes with a clear pattern of primary and subordinating modal relationships. The findings also include the range of social-cultural artefacts and technological platforms that the old and new media affords. It will also illustrate how the variety of modes that make meaning and the range of artefacts that represent information function in both space and time continuums. The paper concludes with suggestions on future directions to facilitate learning in this information and consumer age.

The meaning making of digital multimodal texts by languages undergraduate students

Interpreting old texts with new tools: Digital multimodal composition for a high school reading assignment

Empowering English as an Additional Language students through digital multimodal composing

Composing meaning through multiliteracies and multimodality with adolescent and adult learners

Multilingual and multimodal mediation in online intercultural conversations: a translingual perspective

Digital multimodal composing in post-secondary L2 settings: a review of the empirical landscape

A review on digital multimodal composing in post-secondary EFL context: Practices and implications

Multimodal composing in the English classroom: recontextualising the curriculum to learning

Beyond Written-Linguistic Modes of Meanings: Multimodal Representations to Extend the Range of Literacy Learning in EMI Students

Multimodal Composition in a College ESL Class: New Tools, Traditional Norms

Digital Multimodal Composing in L2 Learning: Ideologies and Impact

STORYTELLING AND DIGITAL ART AS A MEANS TO IMPROVE MULTILINGUAL SKILLS

The construction of translanguaging space through digital multimodal composing: A case study of students' creation of instructional videos

A Multimodal Framework for Teaching and Learning : Case Study of a Japanese University Context

Developing Multimodal Narrative Genres in Childhood: An Analysis of Pupils’ Written Texts Based on Systemic Functional Linguistics Theory

The social drama of digital multimodal composing: A case study with emergent bi/multilingual newcomer students

A pedagogical framework for digital multimodal composing in the English Language classroom

Using Digital Books and Comics in English Teaching and Learning Activities

Composing Across Media for Rhetorical and Idiosyncratic Purposes: Text‐Based Writing and Digital Multimodal Composing

Teaching Multimodal and Digital Literacy in L2 Settings: New Literacies, New Basics, New Pedagogies

Engaging English language learners in digital multimodal composing: pre-service teachers’ perspectives and experiences