Abstract:PurposeCritical thinking is considered important in psychological science because it enables students to make effective decisions and optimizes their performance. Aiming at the challenges and issues of understanding the student's critical thinking, the objective of this study is to analyze online discussion data through an advanced multi-feature fusion modeling (MFFM) approach for automatically and accurately understanding the student's critical thinking levels.Design/methodology/approachAn advanced MFFM approach is proposed in this study. Specifically, with considering the time-series characteristic and the high correlations between adjacent words in discussion contents, the long short-term memory–convolutional neural network (LSTM-CNN) architecture is proposed to extract deep semantic features, and then these semantic features are combined with linguistic and psychological knowledge generated by the LIWC2015 tool as the inputs of full-connected layers to automatically and accurately predict students' critical thinking levels that are hidden in online discussion data.FindingsA series of experiments with 94 students' 7,691 posts were conducted to verify the effectiveness of the proposed approach. The experimental results show that the proposed MFFM approach that combines two types of textual features outperforms baseline methods, and the semantic-based padding can further improve the prediction performance of MFFM. It can achieve 0.8205 overall accuracy and 0.6172 F1 score for the “high” category on the validation dataset. Furthermore, it is found that the semantic features extracted by LSTM-CNN are more powerful for identifying self-introduction or off-topic discussions, while the linguistic, as well as psychological features, can better distinguish the discussion posts with the highest critical thinking level.Originality/valueWith the support of the proposed MFFM approach, online teachers can conveniently and effectively understand the interaction quality of online discussions, which can support instructional decision-making to better promote the student's knowledge construction process and improve learning performance.

A Framework to process Text Data of Web Discussion Forums A Study of LisLinks

Incorporating Site-Level Knowledge to Extract Structured Data from Web Forums.

Requirements Knowledge Acquisition from Online User Forums.

QuaLLM: An LLM-based Framework to Extract Quantitative Insights from Online Forums

A Framework for Capturing and Analyzing Unstructured and Semi-structured Data for a Knowledge Management System

Template-Independent Wrapper For Web Forums

A Framework for Finding and Summarizing Product Defects, and Ranking Helpful Threads from Online Customer Forums Through Machine Learning

Automatically Mining Review Records from Forum Web Sites.

A Responsive Framework for Research Portals Data using Semantic Web Technology

A framework to simplify pre-processing location-based social media big data for sustainable urban planning and management

A Distributed Text Mining System for Online Web Textual Data Analysis

Harvest -- An Open Source Toolkit for Extracting Posts and Post Metadata from Web Forums

Automatic Data Extraction from Web Discussion Forums

An Analytical Framework for Understanding Knowledge-Sharing Processes in Online Q&A Communities

PDF Text Sentiment Analysis

What to expect, and how to improve online discussion forums: the instructors’ perspective

Analyzing Trends and Patterns Across the Educational Technology Communities Using Fontana Framework

Identification of social scientifically relevant topics in an interview repository: a natural language processing experiment

A Methodology to Handle Social Media Posts in Brazilian Portuguese for Text Mining Applications

Text as Data Methods for Education Research

Analyzing Online Discussion Data for Understanding the Student's Critical Thinking