Abstract:BackgroundWith the development of computational literacy, there has been a surge in both research and practice application of text-based and block-based modalities within the field of computer programming education. Despite this trend, little work has actually examined how learners engaging in programming process when utilizing these two major programming modalities, especially in the context of secondary education settings.ObjectivesTo further compare programming effects between and within text-based and block-based modalities, this research conducted a quasi-experimental research in China's secondary school.MethodsAn online programming platform, Code4all, was developed to allow learners to program in text-based and block-based modalities. This research collected multimodal data sources, including programming platform data, process data, and performance data. This research further utilized multiple learning analytics approaches (i.e., clustering analysis, click stream analysis, lag-sequential analysis and statistics) to compare learners' programming features, behavioural patterns and knowledge gains under two modalities.Results and ConclusionsThe results indicated that learners in text-based modality tended to write longer lines of code, encountered more syntactical errors, and took longer to attempt debugging. In contrast, learners in block-based modality spent more time operating blocks and attempt debugging, achieving better programming knowledge performances compared to their counterparts. Further analysis of five clusters from the two modalities revealed discrepancies in programming behavioural patterns.ImplicationsThree major pedagogical implications were proposed based on empirical research results. Furthermore, this research contributed to the learning analytics literature by integrating process-oriented and summative analysis to reveal learners' programming learning quality. What is currently known about the subject matterThe implications of study findings for practitionersProgramming has the potential to improve learners' higher-order thinking skills.Block-based and text-based modalities are two major instructional methods.There has been a growing interest to understand how learning occurs in two modes.Most previous work has evaluated two modalities based on learners' knowledge, skills, and attitudes.What this paper addsCode4all allows learners to programming in text-based and block-based modalities.Quasi-experimental research was conducted to examine block-based and text-based programming modalities.Multimodal learning analytics were used to compare programming under two modalities.Learners' programming features, behaviouralbehavioral patterns, and knowledge gains were identified under two modalities.Instructors should integrate text-based and block-based modalities into programming courses.Process-oriented assessment should be integrated with summative assessment.Adaptive, timely scaffoldings should be provided with the external support (this should be marked like above two points).Instructors should integrate text-based and block-based modalities into programming courses.Process-oriented assessment should be integrated with summative assessment.Adaptive, timely scaffoldings should be provided with the external support (this should be marked like above two points).

multimodal analysis on a vocational English book and its effect on students’ English proficiency

Using Multimodal Learning Analytics to Understand Effects of Block-Based and Text-Based Modalities on Computer Programming

EXPLORING THE BENEFITS OF MULTIMODAL LITERACY IN ENGLISH TEACHING: ENGAGING STUDENTS THROUGH VISUAL, AUDITORY, AND DIGITAL MODES

Multimodal-Based Learning Improves Students' Reading Ability in Perspective of Systemic Functional Linguistics

The Use of A Digital Multimodal Textbook to Foster Students’ English Proficiency

Using Digital Books and Comics in English Teaching and Learning Activities

Developing Students’ Multimodal Communicative Competence Through Multiliteracies Pedagogy

Digitalization: Improving the Literacy of Foreign Language Learners through Multimodal Texts

Pre-service teachers’ perceptions towards the implementation of multimodal texts in microteaching classes

Multimodal Teaching in EFL Context: A Literature Review

The Effect of Using Multimodal Approaches of Language Teaching and Learning on Sawa Private University English Department Students’ Reading Abilities

Multimodal immersion in English language learning in higher education: A systematic review

HOW TO TEACH ENGLISH CONVERSATION? AN IMPLEMENTATION OF A MULTIMODAL DISCOURSE ANALYSIS THROUGH IMAGES

An English Teacher's Autobiography of Using Digital Multimodal Composing in Teaching Writing to Vocational Students

Enhancing Reading Instruction through Multimodality: A Pathway to Success

Multimodal Learning Material in An English-Speaking Class in Kampung Baluwarti

Multimodal Discourse Analysis of Figures Used in the English Textbook “Get Smart Plus”

Indonesian EFL Students and Teachers Perceptions of Multimodal Teaching Approach in Writing Skills

Multimodal literacy: Unfolding reading path in children’s picture book and its potential for EFL classrooms

College English Multimodal Teaching Based on Digital Information Technology