Research on a machine learning-based adaptive and efficient screening model for psychological symptoms of community correctional prisoners

Zhifei Xu,Zhigeng Pan,Yan Wang,Yichao Zhang,Pengfei Leng

DOI: https://doi.org/10.1038/s41598-024-60181-9

IF: 4.6

2024-05-02

Scientific Reports

Abstract:Community correction institutions in China frequently employ the Symptom Checklist-90 (SCL-90) and the health survey brief (SF-12) as primary tools for psychological assessment of community correctional prisoners. However, in practical application, the SCL-90 Checklist faces issues such as complex item numbers, overall low cultural level of the subjects, and insufficient professional level of the administrators. The SF-12 health survey brief, as a preliminary screening tool, although only has 12 questions, to some extent simplifies the evaluation process and improves work efficiency, it is prone to missed screening. The research team collected 17-dimensional basic characteristic data and corresponding SCL-90 and SF-12 data from 25,480 samples of community correctional prisoners in Zhejiang Province, China. This study explored the application of multi-label multi-classification algorithms and oversampling techniques in building machine learning models to delve into the correlation between the psychological health risks of community correctional prisoners and their characteristic data. Inspired by computerized adaptive testing (CAT), we constructed an adaptive and efficient screening model for community correctional prisoners through experimental comparisons, based on the binary relevance algorithm with sample oversampling. This screening model personalize the assessment process by dynamically matching participants with the most relevant subset (s) of the nine dimensions of the SCL-90 based on their individual characteristics. Thus, adaptive dynamic simplification and personalized recommendation of the SCL-90 scale between question groups were achieved for the specific group of community correctional prisoners. As a screening tool for psychological symptoms of community correctional prisoners, this model significantly simplifies the number of questions compared to SCL-90, with a simplification rate of up to 65%. However, it achieves this simplification while maintaining excellent performance. The accuracy reached 0.66, with a sensitivity of 0.754, and an F1 score of 0.649. This innovation simplified the assessment process, reduced the assessment time, improved work efficiency, and enhanced the ability to judge the specificity of community correctional prisoners population. Compared to the SF-12, although the simplification rate and accuracy of the model are slightly lower than those of the SF-12, the sensitivity increased by 42.26%, and the F1 score improved by 15.28%. This means the model greatly reduces the possibility of missed screening, effectively preventing prisoners with abnormal psychological or mental states from losing control due to missed screening, and even committing suicide, self injury, or injuring others.

multidisciplinary sciences

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the practical difficulties encountered by community correction institutions during psychological assessment, especially the problems when using traditional psychological scales such as SCL - 90 and SF - 12. Specifically:

1. **Problems with the SCL - 90 scale**:
- **Large and complex number of items**: The SCL - 90 contains 90 items, and it is very difficult for community - corrected individuals with a lower educational level to understand and complete these items.
- **Insufficient professional level**: The professional levels of managers vary, which affects the accuracy and objectivity of the assessment.
- **Time - consuming**: A large number of items lead to a long assessment process, affecting work efficiency.

2. **Problems with the SF - 12 scale**:
- **High omission screening rate**: Although the SF - 12 has only 12 items, which simplifies the assessment process, it is prone to omission screening, resulting in some psychological problems that need attention being ignored.

To solve these problems, the research team collected 17 - dimensional basic feature data of 25,480 community - corrected individuals in Zhejiang province and their corresponding SCL - 90 and SF - 12 data. Through multi - label classification algorithms and over - sampling techniques, an adaptive and efficient screening model was constructed. This model can dynamically match participants with the most relevant SCL - 90 sub - dimensions, thereby achieving personalized assessment. Specific contributions include:

1. **Improving assessment efficiency and accuracy**:
- This model significantly simplifies the number of assessment items, with a simplification rate as high as 65%, while maintaining relatively high accuracy (0.66), sensitivity (0.754), and F1 - score (0.649).
- Compared with SF - 12, although the simplification rate and accuracy are slightly lower, the sensitivity is increased by 42.26% and the F1 - score is increased by 15.28%.

2. **Reducing the omission screening rate**:
- By increasing sensitivity, the possibility of omission screening is greatly reduced, effectively preventing suicide, self - harm or harm to others caused by omission screening.

3. **Enhancing group specificity**:
- The correlation between the mental health risks of community - corrected individuals and their demographic characteristics was deeply explored, providing more personalized and effective rehabilitation solutions.

In conclusion, this study aims to develop an adaptive and efficient screening model through machine learning techniques to improve the psychological assessment work of community correction institutions, improve the accuracy and efficiency of assessment, reduce the omission screening rate, and thus better safeguard social security.