Abstract:PurposeCritical thinking is considered important in psychological science because it enables students to make effective decisions and optimizes their performance. Aiming at the challenges and issues of understanding the student's critical thinking, the objective of this study is to analyze online discussion data through an advanced multi-feature fusion modeling (MFFM) approach for automatically and accurately understanding the student's critical thinking levels.Design/methodology/approachAn advanced MFFM approach is proposed in this study. Specifically, with considering the time-series characteristic and the high correlations between adjacent words in discussion contents, the long short-term memory–convolutional neural network (LSTM-CNN) architecture is proposed to extract deep semantic features, and then these semantic features are combined with linguistic and psychological knowledge generated by the LIWC2015 tool as the inputs of full-connected layers to automatically and accurately predict students' critical thinking levels that are hidden in online discussion data.FindingsA series of experiments with 94 students' 7,691 posts were conducted to verify the effectiveness of the proposed approach. The experimental results show that the proposed MFFM approach that combines two types of textual features outperforms baseline methods, and the semantic-based padding can further improve the prediction performance of MFFM. It can achieve 0.8205 overall accuracy and 0.6172 F1 score for the “high” category on the validation dataset. Furthermore, it is found that the semantic features extracted by LSTM-CNN are more powerful for identifying self-introduction or off-topic discussions, while the linguistic, as well as psychological features, can better distinguish the discussion posts with the highest critical thinking level.Originality/valueWith the support of the proposed MFFM approach, online teachers can conveniently and effectively understand the interaction quality of online discussions, which can support instructional decision-making to better promote the student's knowledge construction process and improve learning performance.

The Development of a Content Analysis Model for Assessing Students’ Cognitive Learning in Asynchronous Online Discussions

Investigating Learners' Behaviors and Discourse Content in MOOC Course Reviews.

A Learning Analytics System for Cognition Analysis in Online Learning Community.

Research on the Evaluation Model of Online Cognitive Level from the Perspective of Learning Analytics

The Contents of an Online Discussion Forum: An Analysis

Designing an Online Discussion Strategy with Learning Analytics Feedback on the Level of Cognitive Presence and Student Interaction in an Online Learning Community

Investigating Students' Interaction Patterns and Dynamic Learning Sentiments in Online Discussions

Exploring Students' Discussion in Face to Face and Online Synchronous Learning.

Learning Analytics for Online Discussions

Student Online Learning Behavior Characteristics Based on Multidimensional Cognitive Model

A Review of Content Analysis Researches on Asynchronous Transcripts in Domestic Higher Education

Analyzing Online Discussion Data for Understanding the Student's Critical Thinking

Learning Analytics for Online Discussions: Embedded and Extracted Approaches

A Study of Users’ Reactions to a Mixed Online Discussion Model: A Lag Sequential Analysis Approach

The Dynamics of Social Performance and Cognitive Depth Between Students and Teacher in Online Discussion Forums with the SNA and LDA Approach

Education Practice and Analysing Behaviour of Students in a Web-based Learning Environment: an Exploratory Study from China.

Research on a quantification model of online learning cognitive load based on eye-tracking technology

Cognitive model construction and assessment of data analysis ability based on CDA

Predicting Cognitive Presence in At-Scale Online Learning: MOOC and For-Credit Online Course Environments

Using Socratic Questioning to Promote Critical Thinking Skills Through Asynchronous Discussion Forums in Distance Learning Environments

Affective State Analysis During Online Learning Based on Learning Behavior Data