Item reduction of the "Support Intensity Scale" for people with intellectual disabilities, using machine learning

Félix González‐Carrasco,Felipe Espinosa Parra,Izaskun Álvarez‐Aguado,Sebastián Ponce Olguín,Vanessa Vega Córdova,Miguel Roselló‐Peñaloza
DOI: https://doi.org/10.1111/bld.12616
2024-08-21
British Journal of Learning Disabilities
Abstract:Background The study focuses on the need to optimise assessment scales for support needs in individuals with intellectual and developmental disabilities. Current scales are often lengthy and redundant, leading to exhaustion and response burden. The goal is to use machine learning techniques, specifically item‐reduction methods and selection algorithms, to develop shorter and more efficient scales. Methods A data set of 93 participants was analysed using the Supports Needs Scale. Five feature‐selection algorithms were evaluated to create a shortened questionnaire. For each algorithm, a Random Forest model was trained, and performance was assessed using metrics like accuracy, precision, recall and F1‐score to measure how well each model predicted support needs. Findings The "Select from Model" algorithm successfully identified key items that could predict the level of Support Needs using the Random Forest model. Only 51 variables, out of the original 147, were needed to maintain predictive accuracy. The reduced questionnaire maintained good reliability and internal consistency compared to the original instrument, with a strong F1 score indicating excellent predictive performance. Conclusions The study demonstrates that machine learning techniques are effective in reducing the length of support needs questionnaires while preserving their psychometric properties. These methods can help institutions provide more efficient access to information about support needs without compromising validity or reliability, potentially leading to better resource allocation and improved care for individuals with intellectual disabilities.
education, special
What problem does this paper attempt to address?