Explainable Multi-Layer Dynamic Ensemble Framework Optimized for Depression Detection and Severity Assessment

Dillan Imans,Tamer Abuhmed,Meshal Alharbi,Shaker El-Sappagh
DOI: https://doi.org/10.3390/diagnostics14212385
IF: 3.6
2024-10-26
Diagnostics
Abstract:Depression is a common mental health issue, especially among older adults, and early detection is critical to effective intervention and treatment. This study proposes an explainable multilayer dynamic ensemble framework optimized for detecting depression and predicting its severity. Using data from real individuals from the National Social Life, Health, and Aging Project (NSHAP), the framework integrates classical machine learning models, static ensemble techniques, and dynamic ensemble selection (DES) approaches to build a two-stage framework. The depression detection process is performed in the first stage, and the depression severity is predicted in the second stage only for depressed patients. Among the models evaluated, the FIRE-KNOP DES algorithm exhibited the highest performance, achieving 88.33% accuracy in detecting depression and 83.68% accuracy in predicting depression severity. A key innovation of this study is the incorporation of explainable AI (XAI) techniques to enhance model interpretability, making the framework more suitable for clinical applications. We explore different global and local XAI features. Model explainability highlights the significance of medically relevant mental and non-mental health features in improving the model's performance, which enhances the trustworthiness of the domain experts in the model decisions. These findings offer a promising foundation for future applications of dynamic ensemble frameworks in mental health assessments.
medicine, general & internal
What problem does this paper attempt to address?