Abstract:Optical Coherence Tomography Angiography (OCTA) is a crucial tool in the clinical screening of retinal diseases, allowing for accurate 3D imaging of blood vessels through non-invasive scanning. However, the hardware-based approach for acquiring OCTA images presents challenges due to the need for specialized sensors and expensive devices. In this paper, we introduce a novel method called TransPro, which can translate the readily available 3D Optical Coherence Tomography (OCT) images into 3D OCTA images without requiring any additional hardware modifications. Our TransPro method is primarily driven by two novel ideas that have been overlooked by prior work. The first idea is derived from a critical observation that the OCTA projection map is generated by averaging pixel values from its corresponding B-scans along the Z-axis. Hence, we introduce a hybrid architecture incorporating a 3D adversarial generative network and a novel Heuristic Contextual Guidance (HCG) module, which effectively maintains the consistency of the generated OCTA images between 3D volumes and projection maps. The second idea is to improve the vessel quality in the translated OCTA projection maps. As a result, we propose a novel Vessel Promoted Guidance (VPG) module to enhance the attention of network on retinal vessels. Experimental results on two datasets demonstrate that our TransPro outperforms state-of-the-art approaches, with relative improvements around 11.4% in MAE, 2.7% in PSNR, 2% in SSIM, 40% in VDE, and 9.1% in VDC compared to the baseline method. The code is available at: <a class="link-external link-https" href="https://github.com/ustlsh/TransPro" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problems that this paper attempts to solve mainly focus on two aspects: 1. **Limitations of existing OCT - to - OCTA image conversion methods**: - Existing methods usually only focus on 2D B - scan images or 2D projection maps, which leads to the neglect of the continuity between 3D volume images during the conversion process, thus affecting the conversion quality. - Current methods do not specifically consider vascular information when converting OCTA projection maps, resulting in poor quality in the vascular area. 2. **Improving the quality of OCT - to - OCTA image conversion**: - The paper proposes a new method - TransPro, aiming to solve the above problems through the following two innovations: - **Heuristic Contextual Guidance (HCG)**: By using the context information of 2D OCTA projection maps, ensure the consistency between the generated OCTA projection maps and 3D volume images. - **Vessel Promoted Guidance (VPG)**: By using a pre - trained vessel segmentation model, enhance the network's attention to the vascular area, thereby improving the quality of the vascular area. ### Specific problems and solutions 1. **Consistency between 3D volume images and projection maps**: - **Problem**: Existing OCT - to - OCTA conversion methods usually only focus on 2D B - scan images or 2D projection maps, which leads to the neglect of the continuity between 3D volume images during the conversion process, thus affecting the conversion quality. - **Solution**: The paper proposes a hybrid network architecture, including a 3D Generative Adversarial Network (3D GAN) and a 2D Generative Adversarial Network (2D GAN). The 3D GAN is responsible for generating 3D OCTA volume images, while the 2D GAN generates 2D OCTA projection maps. By introducing the HCG module, minimize the difference between the output of the 2D network and the projection map generated by the 3D network to ensure the consistency between the generated OCTA projection maps and 3D volume images. 2. **Improving the quality of the vascular area**: - **Problem**: Current methods do not specifically consider vascular information when converting OCTA projection maps, resulting in poor quality in the vascular area. - **Solution**: The paper introduces a VPG module. By using a pre - trained 2D retinal vessel segmentation model, extract the semantic information of the vascular area, and minimize the difference between the generated OCTA projection map and the real OCTA projection map through the L1 distance, thereby improving the quality of the vascular area. ### Experimental results The paper conducted experiments on two subsets (OCTA - 3M and OCTA - 6M) of the OCTA - 500 dataset to evaluate the quality of the converted OCTA images. The experimental results show that the TransPro method outperforms the existing state - of - the - art methods in multiple evaluation metrics, especially in vascular - specific metrics such as Vascular Density Error (VDE) and Vascular Density Correlation (VDC). In conclusion, by introducing the HCG and VPG modules, this paper effectively solves the limitations in the existing OCT - to - OCTA image conversion methods and improves the quality of the converted OCTA images, especially the quality of the vascular area.

Vessel-Promoted OCT to OCTA Image Translation by Heuristic Contextual Constraints

High Performance OCTA Enabled by Combining Features of Shape, Intensity, and Complex Decorrelation

Dive into Plane: Lightweight & Modular Linear Projection Cross-dimensional Network for Retinal Vessel Segmentation in OCTA Images.

Segmentation of Low-Light Optical Coherence Tomography Angiography Images under the Constraints of Vascular Network Topology

The Quest for Early Detection of Retinal Disease: 3D CycleGAN-based Translation of Optical Coherence Tomography into Confocal Microscopy

Visualization and Quantization of 3D Retinal Vessels in OCTA Images.

Quantitative Characterization of Retinal Features in Translated OCTA

VET: Vasculature Extraction Transformer for Single-Scan Optical Coherence Tomography Angiography

OCT2Former: A retinal OCT-angiography vessel segmentation transformer

Deep-Learning-based Vasculature Extraction for Single-Scan Optical Coherence Tomography Angiography

OCTA-500: A Retinal Dataset for Optical Coherence Tomography Angiography Study

OCT2Confocal: 3D CycleGAN based Translation of Retinal OCT Images to Confocal Microscopy

3D Vessel Reconstruction in OCT-Angiography via Depth Map Estimation

Transformer and convolutional based dual branch network for retinal vessel segmentation in OCTA images

Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotations

Complex Correlated Phase Gradient Variance Based Optical Coherence Tomography Angiography

Digital Resolution Enhancement in Low Transverse Sampling Optical Coherence Tomography Angiography Using Deep Learning

OVS-Net: an Effective Feature Extraction Network for Optical Coherence Tomography Angiography Vessel Segmentation.

TPOT: Topology Preserving Optimal Transport in Retinal Fundus Image Enhancement

System Calibration and Pose Optimization for Robotic-Arm-assisted Optical Coherence Tomography

A Deep Learning Based Pipeline for Optical Coherence Tomography Angiography