A Novel Classification of Macular Split Based on Multi-modal Fusion of SLO and OCT

Yihuan Wang,Peiwu Qin,Zhide Li,Yuhan Dong
DOI: https://doi.org/10.1109/cisp-bmei60920.2023.10373313
2023-01-01
Abstract:Myopia has emerged as a prevalent ocular concern worldwide. Among its complications, pathological myopia stands out as one of the primary causes of blindness, with myopic maculopathy being particularly problematic. To enhance the accuracy of classifying lesions in the macular region, this study introduces a multimodal feature fusion approach that integrates both OCT and SLO images. This method employs a dual-branch ResNet-50 architecture, the atrous spatial pyramid pooling (ASPP) module, squeeze and excitation block (SE) attention mechanism, and a cross-attention fusion module for comprehensive feature extraction and fusion. Experimental results validate the superiority of the proposed method superior in ophthalmic image classification tasks. Specifically, it has achieved an accuracy rate of 93.92% in differentiating normal eyes and macular split in Task 1, and 89.92% accuracy in the four-category classification of Task 2, which includes inner layer hole, outer layer hole, inner and outer layer hole and full-thickness macular hole.
What problem does this paper attempt to address?