Attention-based 3D Convolutional Networks for Detection of Geographic Atrophy from Optical Coherence Tomography Scans

Amr Elsawy,Tiarnan D. Keenan,Qingyu Chen,Xiaoshuang Shi,Emily Y. Chew,Zhiyong Lu
DOI: https://doi.org/10.1117/12.2654487
2023-01-01
Abstract:Geographic atrophy (GA) is the defining lesion of advanced atrophic age-related macular degeneration (AMD). GA can be detected and characterized most accurately using spectral-domain optical coherence tomography (SDOCT), which provides detailed 3D information about changes in multiple retinal layers. Existing methods are limited to 2D convolutional neural networks (CNNs). Therefore, they do not capture the 3D context between adjacent 2D slices of the OCT scan and also require a large inference time. We propose 3D CNNs with 3D attention mechanisms for the automated detection of GA on SDOCT scans using scan-level labels. The best network achieved an accuracy of 88%, and its visualizations suggest the interpretability of its predictions.
What problem does this paper attempt to address?