Wide shadow inpainting in retinal OCT images based on recursive sparse representation

Jiali Liu,Fukang Lv,Ni He,Liming Li,Cuixia Dai

DOI: https://doi.org/10.1364/oe.541165

IF: 3.8

2024-12-08

Optics Express

Abstract:Jiali Liu, Fukang Lv, Ni He, Liming Li, Cuixia Dai Shadow artifacts caused by high scattering of the superficial vessels will cause structural and vascular discontinuities in optical ... [Opt. Express 32, 46273-46289 (2024)]

optics

What problem does this paper attempt to address?

Multi-scale Sparse Representation-Based Shadow Inpainting for Retinal OCT Images

Yaoqi Tang,Yufan Li,Hongshan Liu,Jiaxuan Li,Peiyao Jin,Yu Gan,Yuye Ling,Yikai Su

DOI: https://doi.org/10.48550/arXiv.2202.11377

2022-02-23

Abstract:Inpainting shadowed regions cast by superficial blood vessels in retinal optical coherence tomography (OCT) images is critical for accurate and robust machine analysis and clinical diagnosis. Traditional sequence-based approaches such as propagating neighboring information to gradually fill in the missing regions are cost-effective. But they generate less satisfactory outcomes when dealing with larger missing regions and texture-rich structures. Emerging deep learning-based methods such as encoder-decoder networks have shown promising results in natural image inpainting tasks. However, they typically need a long computational time for network training in addition to the high demand on the size of datasets, which makes it difficult to be applied on often small medical datasets. To address these challenges, we propose a novel multi-scale shadow inpainting framework for OCT images by synergically applying sparse representation and deep learning: sparse representation is used to extract features from a small amount of training images for further inpainting and to regularize the image after the multi-scale image fusion, while convolutional neural network (CNN) is employed to enhance the image quality. During the image inpainting, we divide preprocessed input images into different branches based on the shadow width to harvest complementary information from different scales. Finally, a sparse representation-based regularizing module is designed to refine the generated contents after multi-scale feature aggregation. Experiments are conducted to compare our proposal versus both traditional and deep learning-based techniques on synthetic and real-world shadows. Results demonstrate that our proposed method achieves favorable image inpainting in terms of visual quality and quantitative metrics, especially when wide shadows are presented.

Computer Vision and Pattern Recognition,Image and Video Processing
Eliminating Shadow Artifacts via Generative Inpainting Networks to Quantify Vascular Changes of the Choroid

Huihong Zhang,Jianlong Yang,Kang Zhou,Fei Li,Yan Hu,Shenghua Gao,Xiulan Zhang,Jiang Liu

DOI: https://doi.org/10.48550/arXiv.1907.01271

2019-10-03

Abstract:Shadow artifacts from retinal vessels hinder the development of quantitative choroidal biomarkers in Optical Coherence Tomography (OCT), which limits the clinical applications of the choroidal OCT to the measures of layer thickness. In this paper, we present a novel framework that could eliminate the retinal shadows and realize the quantification of choroidal vasculature. Different from existing methods, we convert the shadow elimination into an object removal task, which can be handled by image inpainting techniques. We adopt and finetune a two-stage generative inpainting network which connects the edges of the vessels ahead of refilling the shadow-contaminated areas. It shows surpassing performance in repairing the choroidal vasculature compared with traditional inpainting algorithms. We further verify the feasibility of the proposed frame using a prospective observational study, which detects the choroidal vascular changes related to the Intra-Ocular Pressure (IOP) elevation of 34 healthy volunteers. As the average IOP increases from $15.84\pm1.99$ mmHg to $34.48\pm5.35$ mmHg, we achieve the decreases of the choroidal vessel density and flow index from $0.491\pm0.020$ to $0.463\pm0.019$ and from $0.336\pm0.025$ to $0.300\pm0.019$, respectively.

Medical Physics,Image and Video Processing
Improved Sparse Representation Algorithm for Optical Coherence Tomography Images

Hanyuan Miao,Xiaohong Zhou,Wei Wang,Weiliang Jiang,Tao Jin

DOI: https://doi.org/10.1002/ima.22711

IF: 2.177

2022-01-01

International Journal of Imaging Systems and Technology

Abstract:An improved sparse representation algorithm is proposed for reducing speckle noise in optical coherence tomography (OCT) images. To reduce the dictionary training time, the orthogonal matching pursuit algorithm (OMP) is replaced by a piecewise orthogonal matching pursuit algorithm (ST-OMP), and a threshold standard is set to train multiple atoms simultaneously to improve the tracking efficiency. Normal, diabetic macular edema, and fundus neovascularization membrane retina OCT images were tested using the proposed algorithm and other denoising algorithms. The results show that the proposed algorithm exhibits an excellent denoising ability. The details and edge information in the OCT images were well preserved by the proposed algorithm. Meanwhile, the image processing time was reduced by half with the proposed algorithm compared with the traditional K-SVD algorithm.
Physics-based Optical Coherence Tomography Angiography (OCTA) Image Correction for Shadow Compensation

Guangxu Li,Kang Wang,Yining Dai,Dongping Zheng,Kailu Wang,Lizhen Zhang,Tohru Kamiya

DOI: https://doi.org/10.1109/TBME.2024.3478384

2024-10-11

Abstract:Optical coherence tomography (OCT) is being widely applied in clinical studies to investigate insight into the retina under the retinal pigment epithelium. Optical coherence tomography angiography (OCTA) is one of the functional extensions of OCT, for visualizing retinal circulation. Due to obstruction of light propagation, such as vitreous floaters or pupil boundaries, OCTA remains challenged by shadow artifacts that can disrupt volumetric data. Detecting and removing these shadow artifacts are crucial when quantifying indicators of retinal disease progression. We simplified an optical attenuation model of shadow formation in OCTA to a linear illumination transformation. And learn its parameters using an adversarial neural network. Our framework also consists of a sub-network for shadows automatic detection. We experimented our method on 28 OCTA images of normal eyes and compared the non-perfusion area (NPA), an index to measure retinal vascularity. The results showed that the NPA adjusted to a reasonable range after image processing using our method. Furthermore, we tested 150 OCTA images of synthesis artifacts, and the mean absolute error(MAE) values reached 0.83 after shadow removal.
Inpainting for Saturation Artifacts in Optical Coherence Tomography Using Dictionary-Based Sparse Representation

Hongshan Liu,Shengting Cao,Yuye Ling,Yu Gan

DOI: https://doi.org/10.1109/jphot.2021.3056574

IF: 2.4

2021-01-01

IEEE Photonics Journal

Abstract:Saturation artifacts in optical coherence tomography (OCT) occur when received signal exceeds the dynamic range of spectrometer. Saturation artifact shows a streaking pattern and could impact the quality of OCT images, leading to inaccurate medical diagnosis. In this paper, we automatically localize saturation artifacts and propose an artifact correction method via inpainting. We adopt a dictionary-based sparse representation scheme for inpainting. Experimental results demonstrate that, in both case of synthetic artifacts and real artifacts, our method outperforms interpolation method and Euler's elastica method in both qualitative and quantitative results. The generic dictionary offers similar image quality when applied to tissue samples which are excluded from dictionary training. This method may have the potential to be widely used in a variety of OCT images for the localization and inpainting of the saturation artifacts.
DeshadowGAN: A Deep Learning Approach to Remove Shadows from Optical Coherence Tomography Images.

Haris Cheong,Sripad Krishna Devalla,Tan Hung Pham,Liang Zhang,Tin Aung Tun,Xiaofei Wang,Shamira Perera,Leopold Schmetterer,Tin Aung,Craig Boote,Alexandre Thiery,Michael J. A. Girard

DOI: https://doi.org/10.1167/tvst.9.2.23

2020-01-01

Translational Vision Science & Technology

Abstract:Purpose:To remove blood vessel shadows from optical coherence tomography (OCT) images of the optic nerve head (ONH).Methods:Volume scans consisting of 97 horizontal B-scans were acquired through the center of the ONH using a commercial OCT device for both eyes of 13 subjects. A custom generative adversarial network (named DeshadowGAN) was designed and trained with 2328 B-scans in order to remove blood vessel shadows in unseen B-scans. Image quality was assessed qualitatively (for artifacts) and quantitatively using the intralayer contrast-a measure of shadow visibility ranging from 0 (shadow-free) to 1 (strong shadow). This was computed in the retinal nerve fiber layer (RNFL), the inner plexiform layer (IPL), the photoreceptor (PR) layer, and the retinal pigment epithelium (RPE) layer. The performance of DeshadowGAN was also compared with that of compensation, the standard for shadow removal.Results:DeshadowGAN decreased the intralayer contrast in all tissue layers. On average, the intralayer contrast decreased by 33.7 ± 6.81%, 28.8 ± 10.4%, 35.9 ± 13.0%, and 43.0 ± 19.5% for the RNFL, IPL, PR layer, and RPE layer, respectively, indicating successful shadow removal across all depths. Output images were also free from artifacts commonly observed with compensation.Conclusions:DeshadowGAN significantly corrected blood vessel shadows in OCT images of the ONH. Our algorithm may be considered as a preprocessing step to improve the performance of a wide range of algorithms including those currently being used for OCT segmentation, denoising, and classification.Translational Relevance:DeshadowGAN could be integrated to existing OCT devices to improve the diagnosis and prognosis of ocular pathologies.
Depth-Aided Inpainting for Disocclusion Restoration of Multi-View Images Using Depth-Image-Based Rendering

Kai Luo,Dong-xiao Li,Ya-mei Feng,Ming Zhang

DOI: https://doi.org/10.1631/jzus.a0820806

2009-01-01

Abstract:A new algorithm is proposed for restoring disocclusion regions in depth-image-based rendering (DIBR) warped images. Current solutions include layered depth image (LDI), pre-filtering methods, and post-processing methods. The LDI is complicated, and pre-filtering of depth images causes noticeable geometrical distortions in cases of large baseline warping. This paper presents a depth-aided inpainting method which inherits merits from Criminisi's inpainting algorithm. The proposed method features incorporation of a depth cue into texture estimation. The algorithm efficiently handles depth ambiguity by penalizing larger Lagrange multipliers of filling points closer to the warping position compared with the surrounding existing points. We perform morphological operations on depth images to accelerate the algorithm convergence, and adopt a luma-first strategy to adapt to various color sampling formats. Experiments on test multi-view sequence showed that our method has superiority in depth differentiation and geometrical loyalty in the restoration of warped images. Also, peak signal-to-noise ratio (PSNR) statistics on non-hole regions and whole image comparisons both compare favorably to those obtained by state of the art techniques.
Vessel Segmentation and Quantification in Ultra-Wide-field OCTA Images

qiang xiyao,xiangning wang,qiang wu,guogang cao,jiaqing zhao,cuixia dai

DOI: https://doi.org/10.1117/12.2683002

2023-01-01

Abstract:Early detection of retinopathy in the periphery of the macula is an important step in preventing severe vision loss. Some morphological parameters about the extensive retina can be obtained through ultra-wide-field OCTA images. Based on small-scale fundus OCTA vessel segmentation, accurate diagnosis can already be obtained by means of deep learning. However, no similar research of segmentation of peripheral blood vessels is reported. In this study, blood vessels of retina were segmented, and blood vessel centerlines were extracted in ultra-wide-field OCTA images. Quantification of the segmented images was performed to explore features of blood vessel. We used a U-shaped neural network that performs well on small samples to cope with the problem of limited data sets. Scale compression and slice segmentation were used to apply the trained network model to vessel segmentation and centerline extraction in ultra-wide-field OCTA images which is of size at 21mm×21mm. Based on the results of the segmentation of blood vessels, the diameter index of blood vessels and vascular tortuousness were calculated, which proved to be associated with some eye diseases. These results and parameters can be helpful for the early screening of some ophthalmic diseases.
Deep Learning Based Retinal Layer Segmentation in Optical Coherence Tomography Scans of Patients with Inherited Retinal Diseases

Franziska Eckardt,Robin Mittas,Nastassya Horlava,Johannes Schiefelbein,Ben Asani,Stylianos Michalakis,Maximilian Gerhardt,Claudia Priglinger,Daniel Keeser,Nikolaos Koutsouleris,Siegfried Priglinger,Fabian Theis,Tingying Peng,Benedikt Schworm

DOI: https://doi.org/10.1055/a-2227-3742

2024-01-01

Abstract:Background In optical coherence tomography (OCT) scans of patients with inherited retinal diseases (IRDs), the measurement of the thickness of the outer nuclear layer (ONL) has been well established as a surrogate marker for photoreceptor preservation. Current automatic segmentation tools fail in OCT segmentation in IRDs, and manual segmentation is time-consuming. Methods and Material Patients with IRD and an available OCT scan were screened for the present study. Additionally, OCT scans of patients without retinal disease were included to provide training data for artificial intelligence (AI). We trained a U-net-based model on healthy patients and applied a domain adaption technique to the IRD patients' scans. Results We established an AI-based image segmentation algorithm that reliably segments the ONL in OCT scans of IRD patients. In a test dataset, the dice score of the algorithm was 98.7%. Furthermore, we generated thickness maps of the full retinal thickness and the ONL layer for each patient. Conclusion Accurate segmentation of anatomical layers on OCT scans plays a crucial role for predictive models linking retinal structure to visual function. Our algorithm for segmentation of OCT images could provide the basis for further studies on IRDs.
Adaptive Feature Enhancement of Retinal Vascular Images Using Wavelet-Based Multiresolution Analysis

L Xu,XX Zheng,YJ Yu,HY Zhang

DOI: https://doi.org/10.1117/12.323584

1998-01-01

Abstract:The goal of this research is to put forward a high efficient method that can generate clinically useful images with improved visualization of retinal vascular image features. Methods: 1) Multiresolution decomposition of an original retinal image into subband images via 2-D wavelet transformation(WT). 2) At s = 2(1), the LLMMSE4 estimate algorithm that is applicable for nonstationary image model is used in wavelet domain to reduce noise. At s = 2(2), soft thresholding wavelet shrinkage technique is used in wavelet domain to reduce noise. At s greater than or equal to 2(3), semisoft wavelet shrinkage technique is applied in wavelet domain to further reduce noise. 3) Opening of a gray-scale A(1)(d) (f) over cap subband image by a gray-scale circular structuring element can generate a background image. Enhancement is achieved by using this opened image as a unsharp mask and then applying morphological spatial filtering technique to enhance vessel contrast. 4) Reconstruction of retinal image from modified subband images via inverse 2-DWT, Experimental results show that the proposed approach is able to adaptively enhance subtle vascular features, suppress noise and improve global visualization of retinal vascular images.
Deep Learning-Based Inpainting of Saturation Artifacts in Optical Coherence Tomography Images

Muyun Hu,Zhuoqun Yuan,Di Yang,Jingzhu Zhao,Yanmei Liang

DOI: https://doi.org/10.1142/s1793545823500268

IF: 2.396

2024-01-01

Journal of Innovative Optical Health Sciences

Abstract:Limited by the dynamic range of the detector, saturation artifacts usually occur in optical coherence tomography (OCT) imaging for high scattering media. The available methods are difficult to remove saturation artifacts and restore texture completely in OCT images. We proposed a deep learning-based inpainting method of saturation artifacts in this paper. The generation mechanism of saturation artifacts was analyzed, and experimental and simulated datasets were built based on the mechanism. Enhanced super-resolution generative adversarial networks were trained by the clear–saturated phantom image pairs. The perfect reconstructed results of experimental zebrafish and thyroid OCT images proved its feasibility, strong generalization, and robustness.
Imaging Artifacts and Quality Evaluation with Ultrawide-Field Swept-Source OCTA in Diabetic Retinopathy

Xiang-ning Wang,Shuting Li,Xuan Cai,Tingting Li,Da Long,Qiang Wu

DOI: https://doi.org/10.1080/02713683.2023.2296362

2024-01-01

Current Eye Research

Abstract:Purpose: To evaluate the prevalence and types of artifacts in ultrawide-field swept-source optical coherence tomography angiography (SS-OCTA) scans of diabetic retinopathy (DR) patients.Methods: This study was a prospective, observational study conducted from May 2022 to October 2022. Participants comprised individuals with proliferative diabetic retinopathy (PDR), nonproliferative diabetic retinopathy (NPDR), no diabetic retinopathy, and healthy controls. SS-OCTA imaging was performed, and a 5-scan composite with a larger field of view (23.5 mm x 17.5 mm) was captured using built-in software. Two experienced ophthalmologists analyzed the images independently, and the image quality and artifact prevalence were recorded and analyzed.Results: The study included 70 eyes (16 with PDR, 24 with NPDR, 12 eyes of diabetic patients without DR, and 18 healthy eyes) in 70 subjects. Imaging artifacts were observed in a high percentage of eyes, with 98.57% of eyes presenting at least one type of artifact. A significant proportion of eyes (58.57%) exhibited a severe degree of artifacts. The most prevalent artifacts were loss of signal in 63 eyes (90%) and displacement artifact and masking artifact in 43 eyes (61.4%). Patients with more severe stages of DR had higher artifact scores (p < 0.05). Multivariate regression analysis indicated that DR severity was the most important factor influencing artifact scores (p < 0.05).Conclusions: In OCTA photos, various artifacts arise at different frequencies. It is crucial to qualitatively evaluate the images to ensure their quality. The results demonstrate that DR severity has a significant correlation with artifact scores.
Inpainting Saturation Artifact in Anterior Segment Optical Coherence Tomography

Jie Li,He Zhang,Xiaoli Wang,Haoming Wang,Jingzi Hao,Guanhua Bai

DOI: https://doi.org/10.3390/s23239439

IF: 3.9

2023-11-28

Sensors

Abstract:The cornea is an important refractive structure in the human eye. The corneal segmentation technique provides valuable information for clinical diagnoses, such as corneal thickness. Non-contact anterior segment optical coherence tomography (AS-OCT) is a prevalent ophthalmic imaging technique that can visualize the anterior and posterior surfaces of the cornea. Nonetheless, during the imaging process, saturation artifacts are commonly generated due to the tangent of the corneal surface at that point, which is normal to the incident light source. This stripe-shaped saturation artifact covers the corneal surface, causing blurring of the corneal edge, reducing the accuracy of corneal segmentation. To settle this matter, an inpainting method that introduces structural similarity and frequency loss is proposed to remove the saturation artifact in AS-OCT images. Specifically, the structural similarity loss reconstructs the corneal structure and restores corneal textural details. The frequency loss combines the spatial domain with the frequency domain to ensure the overall consistency of the image in both domains. Furthermore, the performance of the proposed method in corneal segmentation tasks is evaluated, and the results indicate a significant benefit for subsequent clinical analysis.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Structure-preserving multi-scale decompositions for skin and retinal OCT image

annan li,jun cheng,damon wing kee wong,hong liang tey,jiang liu

DOI: https://doi.org/10.1109/IECBES.2014.7047465

2014-01-01

Abstract:Optical coherence tomography (OCT) is an emerging technique for imaging skin and retina. However, severe noise and incompatible dynamic range between OCT image and display devices make OCT image analysis a challenging task. To address these problems, we present a structure-preserving multi-scale decomposition approach. Instead of outputting single image, it represents an OCT image by a set of images in multiple scales while preserved structures. Experimental results demonstrate that skin and retina structures can be well separated from noises and illuminations based on such decompositions.
Controlling for Artifacts in Widefield Optical Coherence Tomography Angiography Measurements of Non-Perfusion Area

Lucas R. De Pretto,Eric M. Moult,A. Yasin Alibhai,Oscar M. Carrasco-Zevallos,Siyu Chen,ByungKun Lee,Andre J. Witkin,Caroline R. Baumal,Elias Reichel,Anderson Zanardi de Freitas,Jay S. Duker,Nadia K. Waheed,James G. Fujimoto

DOI: https://doi.org/10.1038/s41598-019-43958-1

IF: 4.6

2019-06-24

Scientific Reports

Abstract:AbstractThe recent clinical adoption of optical coherence tomography (OCT) angiography (OCTA) has enabled non-invasive, volumetric visualization of ocular vasculature at micron-scale resolutions. Initially limited to 3 mm × 3 mm and 6 mm × 6 mm fields-of-view (FOV), commercial OCTA systems now offer 12 mm × 12 mm, or larger, imaging fields. While larger FOVs promise a more complete visualization of retinal disease, they also introduce new challenges to the accurate and reliable interpretation of OCTA data. In particular, because of vignetting, wide-field imaging increases occurrence of low-OCT-signal artifacts, which leads to thresholding and/or segmentation artifacts, complicating OCTA analysis. This study presents theoretical and case-based descriptions of the causes and effects of low-OCT-signal artifacts. Through these descriptions, we demonstrate that OCTA data interpretation can be ambiguous if performed without consulting corresponding OCT data. Furthermore, using wide-field non-perfusion analysis in diabetic retinopathy as a model widefield OCTA usage-case, we show how qualitative and quantitative analysis can be confounded by low-OCT-signal artifacts. Based on these results, we suggest methods and best-practices for preventing and managing low-OCT-signal artifacts, thereby reducing errors in OCTA quantitative analysis of non-perfusion and improving reproducibility. These methods promise to be especially important for longitudinal studies detecting progression and response to therapy.

multidisciplinary sciences
Inter-frame information based choroid segmentation in enhanced optical coherence tomography images

Xueqing Liu,Xinghao Jiang,Yan Sun,Ajing Xu,Haotian Lu

DOI: https://doi.org/10.1109/BMEI.2014.7002772

2014-01-01

Abstract:Optical coherence tomography (OCT) has become a famous ophthalmic diagnostic technique recent years. It is a non-invasive imaging method and causes no damage to the eyes. Among the information OCT is able to provide, the thickness of choroid, especially epichoroidal space can reflect many diseases of the retina, which makes it a very important basis for diagnosing. However, up to now, there are few researches on it. In this paper, an automatic segmentation algorithm to detect epichoroidal space and methods for enhancing the images are presented. Since original OCT images are normally with severe noise, a new sparsity-based image denoising method is proposed against it. To remove the vascular shadows and improve the visibility of OCT image, proposed a noise-estimation assisted compensating algorithm is proposed. This is the first time that the effects of noise are taken into consideration in compensation. With the pre-processed images, Inter-frame Information is first used in developing choroid segmentation method.
3D Vessel Reconstruction in OCT-Angiography via Depth Map Estimation

Shuai Yu,Jianyang Xie,Jinkui Hao,Yalin Zheng,Jiong Zhang,Yan Hu,Jiang Liu,Yitian Zhao

DOI: https://doi.org/10.48550/arXiv.2102.13588

2021-02-27

Abstract:Optical Coherence Tomography Angiography (OCTA) has been increasingly used in the management of eye and systemic diseases in recent years. Manual or automatic analysis of blood vessel in 2D OCTA images (en face angiograms) is commonly used in clinical practice, however it may lose rich 3D spatial distribution information of blood vessels or capillaries that are useful for clinical decision-making. In this paper, we introduce a novel 3D vessel reconstruction framework based on the estimation of vessel depth maps from OCTA images. First, we design a network with structural constraints to predict the depth of blood vessels in OCTA images. In order to promote the accuracy of the predicted depth map at both the overall structure- and pixel- level, we combine MSE and SSIM loss as the training loss function. Finally, the 3D vessel reconstruction is achieved by utilizing the estimated depth map and 2D vessel segmentation results. Experimental results demonstrate that our method is effective in the depth prediction and 3D vessel reconstruction for OCTA images.% results may be used to guide subsequent vascular analysis

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Computational Retinal Microvascular Biomarkers from an OCTA Image in Clinical Investigation

Bingwen Lu,Yiming Li,Like Xie,Kin Chiu,Xiaofeng Hao,Jing Xu,Jie Luo,Pak-Chung Sham

DOI: https://doi.org/10.3390/biomedicines12040868

IF: 4.757

2024-04-15

Biomedicines

Abstract:Retinal structural and functional changes in humans can be manifestations of different physiological or pathological conditions. Retinal imaging is the only way to directly inspect blood vessels and their pathological changes throughout the whole body non-invasively. Various quantitative analysis metrics have been used to measure the abnormalities of retinal microvasculature in the context of different retinal, cerebral and systemic disorders. Recently developed optical coherence tomography angiography (OCTA) is a non-invasive imaging tool that allows high-resolution three-dimensional mapping of the retinal microvasculature. The identification of retinal biomarkers from OCTA images could facilitate clinical investigation in various scenarios. We provide a framework for extracting computational retinal microvasculature biomarkers (CRMBs) from OCTA images through a knowledge-driven computerized automatic analytical system. Our method allows for improved identification of the foveal avascular zone (FAZ) and introduces a novel definition of vessel dispersion in the macular region. Furthermore, retinal large vessels and capillaries of the superficial and deep plexus can be differentiated, correlating with retinal pathology. The diagnostic value of OCTA CRMBs was demonstrated by a cross-sectional study with 30 healthy subjects and 43 retinal vein occlusion (RVO) patients, which identified strong correlations between OCTA CRMBs and retinal function in RVO patients. These OCTA CRMBs generated through this "all-in-one" pipeline may provide clinicians with insights about disease severity, treatment response and prognosis, aiding in the management and early detection of various disorders.

biochemistry & molecular biology,medicine, research & experimental,pharmacology & pharmacy
OCT-GAN: Single Step Shadow and Noise Removal from Optical Coherence Tomography Images of the Human Optic Nerve Head

Haris Cheong,Sripad Krishna Devalla,Thanadet Chuangsuwanich,Tin A. Tun,Xiaofei Wang,Tin Aung,Leopold Schmetterer,Martin L. Buist,Craig Boote,Alexandre H. Thiéry,Michaël J. A. Girard

DOI: https://doi.org/10.48550/arXiv.2010.11698

2020-10-06

Abstract:Speckle noise and retinal shadows within OCT B-scans occlude important edges, fine textures and deep tissues, preventing accurate and robust diagnosis by algorithms and clinicians. We developed a single process that successfully removed both noise and retinal shadows from unseen single-frame B-scans within 10.4ms. Mean average gradient magnitude (AGM) for the proposed algorithm was 57.2% higher than current state-of-the-art, while mean peak signal to noise ratio (PSNR), contrast to noise ratio (CNR), and structural similarity index metric (SSIM) increased by 11.1%, 154% and 187% respectively compared to single-frame B-scans. Mean intralayer contrast (ILC) improvement for the retinal nerve fiber layer (RNFL), photoreceptor layer (PR) and retinal pigment epithelium (RPE) layers decreased from 0.362 \pm 0.133 to 0.142 \pm 0.102, 0.449 \pm 0.116 to 0.0904 \pm 0.0769, 0.381 \pm 0.100 to 0.0590 \pm 0.0451 respectively. The proposed algorithm reduces the necessity for long image acquisition times, minimizes expensive hardware requirements and reduces motion artifacts in OCT images.

Image and Video Processing,Computer Vision and Pattern Recognition
Clinical significance of signal shadowing during intraoperative optical coherence tomography-assisted vitreoretinal surgery

Erick Carlos Reyna,Melisa Öztek,Goran Petrovski,Susanne Binder,Knut Stieger,Lyubomyr Lytvynchuk

DOI: https://doi.org/10.1038/s41598-024-56125-y

IF: 4.6

2024-03-07

Scientific Reports

Abstract:This study aimed to analyze the clinical significance of signal shadowing during intraoperative optical coherence tomography (iOCT)-assisted vitreoretinal surgery caused by vitreoretinal instruments, tissue dyes, and vitreous substitutes, and to objectively quantify its impact on iOCT imaging. This is a retrospective observational study of postoperative image analysis from one hundred seventeen (117) patients who underwent iOCT-assisted vitrectomy. The image data were divided into three groups: vitreoretinal instruments, tissue dyes, and vitreous substitutes. The data was then processed using graphic software to measure the grade of picture quality distortion and compared to paired image controls without clinically perceptive interference, then analyzed statistically. The intraocular portion of all studied vitreoretinal instruments caused a high average gray level interference compared to controls ranging from 32 to 68% reduction, obscuring the area of interest significantly. The tips of the instruments produced low-grade shadowing, allowing the underlying tissue to be distinguished. The analyzed dyes demonstrated a wide interference range: ICG (− 75.12%), and triamcinolone (− 26.13%) showed dose-dependent high shadowing, while VITREODYNETM (49.3%) and brilliant blue G (14.06%) exhibited no perceived distortions whilst increasing average gray levels. All analyzed vitreous substitutes (air, SF 6 , C 3 F 8 , PFCL, and silicone oil) showed an insignificant shadowing effect on iOCT. Certain dyes and vitreous substitutes produce a negligible shadowing effect compared to controls and other dyes, providing an advantage during real-time iOCT imaging. All analyzed vitreoretinal instruments showed a significant interference that should prompt the development of new imaging techniques or the implementation of materials with low-grade interference to overcome a clinically relevant shadowing effect on iOCT, maximizing the technology's visual accuracy and surgical diagnostic aid proficiency.

multidisciplinary sciences

Wide shadow inpainting in retinal OCT images based on recursive sparse representation

Multi-scale Sparse Representation-Based Shadow Inpainting for Retinal OCT Images

Eliminating Shadow Artifacts via Generative Inpainting Networks to Quantify Vascular Changes of the Choroid

Improved Sparse Representation Algorithm for Optical Coherence Tomography Images

Physics-based Optical Coherence Tomography Angiography (OCTA) Image Correction for Shadow Compensation

Inpainting for Saturation Artifacts in Optical Coherence Tomography Using Dictionary-Based Sparse Representation

DeshadowGAN: A Deep Learning Approach to Remove Shadows from Optical Coherence Tomography Images.

Depth-Aided Inpainting for Disocclusion Restoration of Multi-View Images Using Depth-Image-Based Rendering

Vessel Segmentation and Quantification in Ultra-Wide-field OCTA Images

Deep Learning Based Retinal Layer Segmentation in Optical Coherence Tomography Scans of Patients with Inherited Retinal Diseases

Adaptive Feature Enhancement of Retinal Vascular Images Using Wavelet-Based Multiresolution Analysis

Deep Learning-Based Inpainting of Saturation Artifacts in Optical Coherence Tomography Images

Imaging Artifacts and Quality Evaluation with Ultrawide-Field Swept-Source OCTA in Diabetic Retinopathy

Inpainting Saturation Artifact in Anterior Segment Optical Coherence Tomography

Structure-preserving multi-scale decompositions for skin and retinal OCT image

Controlling for Artifacts in Widefield Optical Coherence Tomography Angiography Measurements of Non-Perfusion Area

Inter-frame information based choroid segmentation in enhanced optical coherence tomography images

3D Vessel Reconstruction in OCT-Angiography via Depth Map Estimation

Computational Retinal Microvascular Biomarkers from an OCTA Image in Clinical Investigation

OCT-GAN: Single Step Shadow and Noise Removal from Optical Coherence Tomography Images of the Human Optic Nerve Head

Clinical significance of signal shadowing during intraoperative optical coherence tomography-assisted vitreoretinal surgery