Dual-Branch Retinal OCT Anomaly Detection Based on Knowledge Distillation and Reconstruction

Minghui Zhai,Xing Wu,Zhongshi He,ChengLiang Wang,Haidong Wang,Peng Wang
DOI: https://doi.org/10.1109/ijcnn60899.2024.10650088
2024-01-01
Abstract:Currently, anomaly detection methods for retinal OCT images can be mainly divided into two types: reconstruction-based and knowledge distillation-based. The former has weak inter-class descriptiveness and unclear feature boundaries as it is trained with normal images only, and without comparing with abnormal images. The latter is insensitive to rare diseases and lacks a pretrained model with high-performance. In previous works, these two methods are used independently, thus unable to address the innate limitations of the model effectively. Therefore, we proposed a dual-branch model named DRTNet_AD. The two branches are connected through a student network (Encoder) serving as an intermediary bridge. The knowledge distillation network branch learns descriptive features through a pretrained model, while the reconstruction network branch enhances the model’s sensitivity to rare diseases by learning the distribution of normal images. Furthermore, in order to obtain a pretrained model with good feature extraction and descriptive abilities, we proposed a strategy to construct pseudo-anomaly and a layer structure context-aware module (LCAM). DRTNet_AD achieves the SOTA performance on public dataset SpectralisOCT with AUC scores of 98.25%
What problem does this paper attempt to address?