Abstract:Contribution: Exploring the interpretive effects, by adopting SHapley Additive exPlanations (SHAP), of online behaviors and background information on the dropout for overall learners and an individual learner in online Science, Technology, Engineering and Mathematics (STEM) courses. The research findings help provide the general guidance for reducing the dropout rate and improve the performance of specific learners in personalized learning. Background: The widespread use of machine learning in education field lacks intuitive explanations to the predication outcomes of black box models. It is vital to analyze visually the relations between influence factors such as behaviors and background information and prediction outcomes of learner dropout in a human understanding way, which help enhance the trustworthiness of predicted models and take the corresponding measures to reduce learner dropout in online STEM courses. Research Questions: 1) How do learners' behaviors and background information individually and interactively influence the dropout of online STEM courses as a whole? 2) How are intuitive and understandable explanations to dropout provided for an individual learner in online STEM courses? Methodology: Data of STEM courses which contains six behavior features and five background information features is extracted from Open University Learning Analytics Dataset (OULAD). Focusing on the impact of behaviors and background information on dropout prediction for overall learners and an individual learner, a SHAP based interpretive study is conducted based on the best model selected from eXtreme Gradient Boosting (XGBoost), Multi Layer Perceptron (MLP), Support Vector Machine (SVM) and Logit Regression (LR). Findings: For the dropout of STEM courses, oucontent, subpage, resourse, ouwiki, education, forumng, age, url, credits, gender and attempts are ordered decreasingly by feature importance, and the magnitude of feature value corresponds to negative or positive influence to the dropout risk. In addition, groups of learners are hierarchically clustered via similar explanation and feature importance, and there also exist interactions to some extent between some of the above factors. Finally, the degrees of impacts imposed by the negative and positive factors on the dropout vary with different individual learners.

Stem-ming the Tide: Predicting STEM attrition using student transcript data

Predicting Student Dropout in Higher Education

Using machine learning to predict student retention from socio-demographic characteristics and app-based engagement metrics

Students Success Modeling: Most Important Factors

Interpretive Analyses of Learner Dropout Prediction in Online STEM Courses

Reducing dropout rate through a deep learning model for sustainable education: long-term tracking of learning outcomes of an undergraduate cohort from 2018 to 2021

Predicting Long-Term Student Outcomes from Short-Term EdTech Log Data

Retention and Attrition in U.S. STEM Education with the Help of Computer Technology and Curriculum Development

AI-Driven Strategies for Reducing Student Withdrawal -- A Study of EMU Student Stopout

Incorporating Features Learned by an Enhanced Deep Knowledge Tracing Model for STEM/Non-STEM Job Prediction

Temporal and Between-Group Variability in College Dropout Prediction

Predictive modelling of student dropout risk: Practical insights from a South Korean distance university

Predicting STEM Major Choice: a Machine Learning Classification and Regression Tree Approach

Why Do Students Drop Out? University Dropout Prediction and Associated Factor Analysis Using Machine Learning Techniques

Predicting Community College Student’s Intention to Transfer and Major in STEM: Does Student Engagement Matter?

Retention in STEM: Factors Influencing Student Persistence and Employment

A Machine Learning Approach for Tracking and Predicting Student Performance in Degree Programs

A Case Study on the Data Mining-Based Prediction of Students' Performance for Effective and Sustainable E-Learning

Predicting first-time-in-college students’ degree completion outcomes

Determinants of Student Attrition in an Undergraduate Sport and Exercise Science Degree

Evaluating Splitting Approaches in the Context of Student Dropout Prediction