Abstract:PurposeCritical thinking is considered important in psychological science because it enables students to make effective decisions and optimizes their performance. Aiming at the challenges and issues of understanding the student's critical thinking, the objective of this study is to analyze online discussion data through an advanced multi-feature fusion modeling (MFFM) approach for automatically and accurately understanding the student's critical thinking levels.Design/methodology/approachAn advanced MFFM approach is proposed in this study. Specifically, with considering the time-series characteristic and the high correlations between adjacent words in discussion contents, the long short-term memory–convolutional neural network (LSTM-CNN) architecture is proposed to extract deep semantic features, and then these semantic features are combined with linguistic and psychological knowledge generated by the LIWC2015 tool as the inputs of full-connected layers to automatically and accurately predict students' critical thinking levels that are hidden in online discussion data.FindingsA series of experiments with 94 students' 7,691 posts were conducted to verify the effectiveness of the proposed approach. The experimental results show that the proposed MFFM approach that combines two types of textual features outperforms baseline methods, and the semantic-based padding can further improve the prediction performance of MFFM. It can achieve 0.8205 overall accuracy and 0.6172 F1 score for the “high” category on the validation dataset. Furthermore, it is found that the semantic features extracted by LSTM-CNN are more powerful for identifying self-introduction or off-topic discussions, while the linguistic, as well as psychological features, can better distinguish the discussion posts with the highest critical thinking level.Originality/valueWith the support of the proposed MFFM approach, online teachers can conveniently and effectively understand the interaction quality of online discussions, which can support instructional decision-making to better promote the student's knowledge construction process and improve learning performance.

Assessment of Higher-order Thinking Skills in Conversation Situation

Learning experience assessment through players chat content in multiplayer online games

Many are the ways to learn identifying multi-modal behavioral profiles of collaborative learning in constructivist activities

An Analysis of Interaction of Cognitive and Social Aspects During Collaborative Problem Solving.

Assessing Students' Computational Thinking In A Learning By Modeling Environment

An Integrated Observing Technic for Collaborative Learning: The Multimodal Learning Analytics Based on the Video Coding and EEG Data Mining

Automatic Coding of Collective Creativity Dialogues in Collaborative Problem Solving Based on Deep Learning Models.

ASSESSMENT INTELLIGENCE IN SMALL GROUP LEARNING

Analyzing Online Discussion Data for Understanding the Student's Critical Thinking

Towards triggering higher-order thinking behaviors in MOOCs

An Artificial Intelligence driven Learning Analytics Method to Examine the Collaborative Problem solving Process from a Complex Adaptive Systems Perspective

A Novel Method for Cross-Modal Collaborative Analysis and Evaluation in the Intelligence Era

Assessment of Collaborative Problem Solving Based on Process Stream Data: A New Paradigm for Extracting Indicators and Modeling Dyad Data

Collaborative Learning Team Formation: AźCognitive Modeling Perspective

Fail or Pass? Investigating Learning Experiences and Interactive Roles in MOOC Discussion Board

Recognizing Patterns of Student's Modeling Behaviour Patterns Via Process Mining.

Assessing Collaborative Process in CSCL with an Intelligent Content Analysis Toolkit

Beyond words: investigating non-verbal indicators of collaborative engagement in a virtual synchronous CSCL environment

Personality-aware Student Simulation for Conversational Intelligent Tutoring Systems

Heterogenous Network Analytics of Small Group Teamwork: Using Multimodal Data to Uncover Individual Behavioral Engagement Strategies

Social Life Simulation for Non-Cognitive Skills Learning