Abstract:In this information and consumer age, social and business exchanges have become visibly multimodal. Socially, we not only communicate using multiple platforms but we co-participate. Businesses engage customers multi-modally in order to cater and customise products and services to meet individual preferences. Faced with this multimodality in everyday life, how do our classrooms compare when attending to our students living in the age of consumerism? How do teachers respond and facilitate learning to meet the demands of today's digital age? This paper presents a multimodal teaching and learning framework for the classroom. Taking the cue from multi-modality in communication, this paper extends the notion of multimodal learning beyond multimodal text and expands the notions of multi-literacy into a pedagogical approach. The paper contends that unless our classroom teaching embraces an overtly multimodal learning approach, we risk disconnecting with and disadvantaging our students. The main research question is: how do teachers and students engage the various modes and mediums to share and make meaning in the classroom. Using an ethnographic study of 24 cases of classroom sessions in a Japanese university, this paper will demonstrate, from the findings, a typology of informational representations for a framework of multimodal teaching and learning. Specific examples on what and how both teachers and students use to communicate and make meaning will be presented. The research methods include observations, repeated video viewing, audio recordings, interviews and examinations of artefacts. Analysis of data was done using grounded theory methods for observation, video and interview data and conversational analysis for classroom audio data. This study will reveal that there are major categories for the image, text, and audio mediums with further three to five sub-groups. The paper will also show that there is a variety of verbal and nonverbal modes with a clear pattern of primary and subordinating modal relationships. The findings also include the range of social-cultural artefacts and technological platforms that the old and new media affords. It will also illustrate how the variety of modes that make meaning and the range of artefacts that represent information function in both space and time continuums. The paper concludes with suggestions on future directions to facilitate learning in this information and consumer age.

Orchestrating multimodal resources in English language teaching: a critical study of an online English teaching video

The construction of translanguaging space through digital multimodal composing: A case study of students' creation of instructional videos

Multilingual and multimodal mediation in online intercultural conversations: a translingual perspective

A Multimodal Discourse Analysis of Second Language Instruction Videos

Adapting and extending multimodal (inter)action analysis to investigate synchronous multimodal online language teaching

A pedagogical framework for digital multimodal composing in the English Language classroom

Discourse Analysis and Multimodal Meaning Making in a Science Classroom: Meta-Methodological Insights from Three Theoretical Perspectives

Teacher engagement with digital multimodal composing in a Chinese tertiary EFL curriculum

Digital Multimodal Composing in L2 Learning: Ideologies and Impact

Multimodal Resemiotization and Authorial Agency in an L2 Writing Classroom

Translanguaging/trans-semiotizing in teacher-learner interactions on social media: Making learner agency visible and achievable

A Multimodal Approach to Teaching Chinese as a Foreign Language (CFL) in the Digital World

Embedding Digital Literacies in English Language Teaching: Students' Digital Video Projects as Multimodal Ensembles

Digital multimodal composing as a translanguaging space

A Systemic Functional Multimodal Discourse Analysis of English Micro-lectures

Exploring Multiliteracies and Multimodal Pedagogies in Chinese Language Teaching

Multimodal Scaffolding Teaching: Role-Taking or Role-Creating in an English as a Foreign Language (EFL) Oral Communication Class in Japan

Digital multimodal composing as translanguaging assessment in CLIL classrooms

Problematizing translanguaging as an inclusive pedagogical strategy in deaf education

A Multimodal Framework for Teaching and Learning : Case Study of a Japanese University Context

Pedagogical Translanguaging and Trans-Semiotizing in a LOTE Arabic Classroom: the Coordination of Semiotic Resources in Alphabetic Teaching and Learning