Simultaneous Classification and Segmentation of Subretinal Lesions on ICGA Images

Ming-Wen Kuan,Wei-Yang Lin,Chia-Ling Tsai,Shih-Jen Chen,Paisan Ruamviboonsuk,Dong-Jie Jiang
DOI: https://doi.org/10.1109/mipr62202.2024.00096
2024-01-01
Abstract:Choroidal neovascularization (CNV) and polypoidal choroidal vasculopathy (PCV) are macula diseases occurred in the subretinal region. Indocyanine green angiography (ICGA) is a technique to examine the blood circulation of this region. This paper presents a novel end-to-end architecture for both classification and segmentation of both disease conditions on ICGA images. Our proposed network consists of two modules, i.e., classification and segmentation modules. The classification module uses transformer blocks to effectively combine local and global features. Furthermore, we employ weakly supervised learning that can significantly reduce annotation cost to train our segmentation module. In our experimental validation, we have collected 1, 345 ICGA images from multiple sources, i.e., EVEREST dataset, Taipei Veteran General Hospital, and Thailand. Experimental results on a multi-institution dataset demonstrate the effectiveness of our proposed method. Our proposed method achieves promising results on our collected dataset.
What problem does this paper attempt to address?