A Heuristic Sparsification Method to Improve the Performance of Neural Networks on Autism Spectrum Disorder Identification Tasks

Fangyu Zhang,Yi Pan,Yanjie Wei,Jin Liu,Zhenli Lin
DOI: https://doi.org/10.1109/ICIST59754.2023.10367095
2023-01-01
Abstract:Deep learning (DL) has been widely used in the detection of neurological diseases such as Autism spectrum disorder (ASD). Most studies in this field manually designed and adjusted the hyperparameters of DL models, but due to the huge search space, few studies have attempted to optimize the topology of neural networks which is another important factor related to the performance of DL models. This paper proposes a heuristic sparsification method named the Evolutionary Connection Sparsification Algorithm (ECSA) which is used to optimize the topology of fully connected neural networks (FC-NNs) and generate the corresponding sparsely connected neural networks (SC-NNs). The algorithm is based on the workflow of the genetic algorithm but with improved coding strategy, fitness evaluation approach, crossover and mutation operator, and including an effective convergence acceleration strategy. Experiments show that the SC-NNs generated by ECSA significantly outperform the original FC-NNs in terms of accuracy, F1-score, and AUC, and the model complexities are greatly reduced.
What problem does this paper attempt to address?