[Interpretation of phosphatemic modifications in liver diseases].

P. Leonardi,G. De Sandre

Abstract:

What problem does this paper attempt to address?

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Yun Jiang,Wenhuan Liu,Chao Wu,Huixiao Yao

DOI: https://doi.org/10.3390/sym13030365

2021-01-01

Symmetry

Abstract:The accurate segmentation of retinal images is a basic step in screening for retinopathy and glaucoma. Most existing retinal image segmentation methods have insufficient feature information extraction. They are susceptible to the impact of the lesion area and poor image quality, resulting in the poor recovery of contextual information. This also causes the segmentation results of the model to be noisy and low in accuracy. Therefore, this paper proposes a multi-scale and multi-branch convolutional neural network model (multi-scale and multi-branch network (MSMB-Net)) for retinal image segmentation. The model uses atrous convolution with different expansion rates and skip connections to reduce the loss of feature information. Receiving domains of different sizes captures global context information. The model fully integrates shallow and deep semantic information and retains rich spatial information. The network embeds an improved attention mechanism to obtain more detailed information, which can improve the accuracy of segmentation. Finally, the method of this paper was validated on the fundus vascular datasets, DRIVE, STARE and CHASE datasets, with accuracies/F1 of 0.9708/0.8320, 0.9753/0.8469 and 0.9767/0.8190, respectively. The effectiveness of the method in this paper was further validated on the optic disc visual cup DRISHTI-GS1 dataset with an accuracy/F1 of 0.9985/0.9770. Experimental results show that, compared with existing retinal image segmentation methods, our proposed method has good segmentation performance in all four benchmark tests.
Generative Adversarial Network Combined with SE-ResNet and Dilated Inception Block for Segmenting Retinal Vessels

Chen Yue,Mingquan Ye,Peipei Wang,Daobin Huang,Xiaojie Lu

DOI: https://doi.org/10.1155/2022/3585506

IF: 3.12

2022-08-30

Computational Intelligence and Neuroscience

Abstract:This study develops an accurate method based on the generative adversarial network (GAN) that targets the issue of the current discontinuity of micro vessel segmentation in the retinal segmentation images. The processing of images has become increasingly efficient since the advent of deep learning method. We have proposed an improved GAN combined with SE-ResNet and dilated inception block for the segmenting retinal vessels (SAD-GAN). The GAN model has been improved with respect to the following points. (1) In the generator, the original convolution block is replaced with SE-ResNet module. Furthermore, SE-Net can extract the global channel information, while concomitantly strengthening and weakening the key features and invalid features, respectively. The residual structure can alleviate the issue of gradient disappearance. (2) The inception block and dilated convolution are introduced into the discriminator, which enhance the transmission of features and expand the acceptance domain for improved extraction of the deep network features. (3) We have included the attention mechanism in the discriminator for combining the local features with the corresponding global dependencies, and for highlighting the interdependent channel mapping. SAD-GAN performs satisfactorily on public retina datasets. On DRIVE dataset, ROC_AUC and PR_AUC reach 0.9813 and 0.8928, respectively. On CHASE_DB1 dataset, ROC_AUC and PR_AUC reach 0.9839 and 0.9002, respectively. Experimental results demonstrate that the generative adversarial model, combined with deep convolutional neural network, enhances the segmentation accuracy of the retinal vessels far above that of certain state-of-the-art methods.

mathematical & computational biology,neurosciences
Exploiting multi-granularity visual features for retinal layer segmentation in human eyes

Xiang He,Yiming Wang,Fabio Poiesi,Weiye Song,Quanqing Xu,Zixuan Feng,Yi Wan

DOI: https://doi.org/10.3389/fbioe.2023.1191803

IF: 5.7

2023-06-01

Frontiers in Bioengineering and Biotechnology

Abstract:Accurate segmentation of retinal layer boundaries can facilitate the detection of patients with early ophthalmic disease. Typical segmentation algorithms operate at low resolutions without fully exploiting multi-granularity visual features. Moreover, several related studies do not release their datasets that are key for the research on deep learning-based solutions. We propose a novel end-to-end retinal layer segmentation network based on ConvNeXt, which can retain more feature map details by using a new depth-efficient attention module and multi-scale structures. In addition, we provide a semantic segmentation dataset containing 206 retinal images of healthy human eyes (named NR206 dataset), which is easy to use as it does not require any additional transcoding processing. We experimentally show that our segmentation approach outperforms state-of-the-art approaches on this new dataset, achieving, on average, a Dice score of 91.3% and mIoU of 84.4%. Moreover, our approach achieves state-of-the-art performance on a glaucoma dataset and a diabetic macular edema (DME) dataset, showing that our model is also suitable for other applications. We will make our source code and the NR206 dataset publicly available at (https://github.com/Medical-Image-Analysis/Retinal-layer-segmentation).

multidisciplinary sciences
RV-GAN: Segmenting Retinal Vascular Structure in Fundus Photographs Using a Novel Multi-scale Generative Adversarial Network

Sharif Amit Kamran,Khondker Fariha Hossain,Alireza Tavakkoli,Stewart Lee Zuckerbrod,Kenton M. Sanders,Salah A. Baker

DOI: https://doi.org/10.1007/978-3-030-87237-3_4

2021-01-01

Abstract:High fidelity segmentation of both macro and microvascular structure of the retina plays a pivotal role in determining degenerative retinal diseases, yet it is a difficult problem. Due to successive resolution loss in the encoding phase combined with the inability to recover this lost information in the decoding phase, autoencoding based segmentation approaches are limited in their ability to extract retinal microvascular structure. We propose RV-GAN, a new multi-scale generative architecture for accurate retinal vessel segmentation to alleviate this. The proposed architecture uses two generators and two multi-scale autoencoding discriminators for better microvessel localization and segmentation. In order to avoid the loss of fidelity suffered by traditional GAN-based segmentation systems, we introduce a novel weighted feature matching loss. This new loss incorporates and prioritizes features from the discriminator’s decoder over the encoder. Doing so combined with the fact that the discriminator’s decoder attempts to determine real or fake images at the pixel level better preserves macro and microvascular structure. By combining reconstruction and weighted feature matching loss, the proposed architecture achieves an area under the curve (AUC) of 0.9887, 0.9914, and 0.9887 in pixel-wise segmentation of retinal vasculature from three publicly available datasets, namely DRIVE, CHASE-DB1, and STARE, respectively. Additionally, RV-GAN outperforms other architectures in two additional relevant metrics, mean intersection-over-union (Mean-IOU) and structural similarity measure (SSIM).
RGC-Net: an Automatic Reconstruction and Quantification Algorithm for Retinal Ganglion Cells Based on Deep Learning.

Rui Ma,Lili Hao,Yudong Tao,Ximena Mendoza,Mohamed Khodeiry,Yuan Liu,Mei-Ling Shyu,Richard K. Lee

DOI: https://doi.org/10.1167/tvst.12.5.7

2023-01-01

Translational Vision Science & Technology

Abstract:Purpose:The purpose of this study was to develop a deep learning-based fully automated reconstruction and quantification algorithm which automatically delineates the neurites and somas of retinal ganglion cells (RGCs).Methods:We trained a deep learning-based multi-task image segmentation model, RGC-Net, that automatically segments the neurites and somas in RGC images. A total of 166 RGC scans with manual annotations from human experts were used to develop this model, whereas 132 scans were used for training, and the remaining 34 scans were reserved as testing data. Post-processing techniques removed speckles or dead cells in soma segmentation results to further improve the robustness of the model. Quantification analyses were also conducted to compare five different metrics obtained by our automated algorithm and manual annotations.Results:Quantitatively, our segmentation model achieves average foreground accuracy, background accuracy, overall accuracy, and dice similarity coefficient of 0.692, 0.999, 0.997, and 0.691 for the neurite segmentation task, and 0.865, 0.999, 0.997, and 0.850 for the soma segmentation task, respectively.Conclusions:The experimental results demonstrate that RGC-Net can accurately and reliably reconstruct neurites and somas in RGC images. We also demonstrate our algorithm is comparable to human manually curated annotations in quantification analyses.Translational Relevance:Our deep learning model provides a new tool that can trace and analyze the RGC neurites and somas efficiently and faster than manual analysis.
Film interpretation session: Radiological Society of North America. Sixty-sixth scientific assembly and annual meeting, November 1980. Summary of discussion and diagnoses.

E. Singleton,J. S. Dunbar,R. G. Fraser,H. Goldstein,T. Keats,T. Meaney

DOI: https://doi.org/10.1148/RADIOLOGY.137.3.7444072

IF: 19.7

1980-12-01

Radiology

Abstract:
Retinal Vessel Segmentation in Medical Diagnosis using Multi-scale Attention Generative Adversarial Networks

Minqiang Yang,Yinru Ye,Kai Ye,Wei Zhou,Xiping Hu,Bin Hu

DOI: https://doi.org/10.1007/s11036-023-02110-0

2023-07-09

Mobile Networks and Applications

Abstract:With the advancement of medical technology, the demand for efficient and precise medical diagnosis is growing. Retinal vessel segmentation using artificial intelligence techniques is vital for medical diagnosis of degenerative retinal diseases. In this paper, we introduce a multi-scale generative adversarial network with class activation mapping, which can effectively improve the efficiency and accuracy of vessel segmentation using artificial intelligence. The task of vessel segmentation is better achieved due to our proposed architecture, which incorporates an attention mechanism and a multi-scale discrimination. It not only strengthens the ability to locate and segment fine retinal vessels, but also enables the model to have the ability to discriminate different receptive fields. To tackle the instability problem caused by unsupervised learning of generative adversarial networks, we introduce a supervised segmentation loss to improve model stability and convergence speed. And we propose a data augmentation method by reconstructing and combining fundus images to make the model obtain better generalization ability. We compare our method with previous models by several metrics and perform ablation study on each component of the model, demonstrating the superiority and effectiveness of the model.

computer science, information systems,telecommunications, hardware & architecture
A Deep Learning Model for Segmentation of Geographic Atrophy to Study Its Long-Term Natural History

Bart Liefers,Johanna M Colijn,Cristina González-Gonzalo,Timo Verzijden,Jie Jin Wang,Nichole Joachim,Paul Mitchell,Carel B Hoyng,Bram van Ginneken,Caroline C W Klaver,Clara I Sánchez,Johanna M. Colijn,Carel B. Hoyng,Caroline C.W. Klaver,Clara I. Sánchez

DOI: https://doi.org/10.1016/j.ophtha.2020.02.009

IF: 14.277

2020-08-01

Ophthalmology

Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Purpose</h3><p>To develop and validate a deep learning model for the automatic segmentation of geographic atrophy (GA) in color fundus images (CFIs) and its application to study growth rate of GA.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Design</h3><p>Prospective, multicenter, natural history study with up to 15 years of follow up.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Participants</h3><p>409 CFIs of 238 eyes with GA from the Rotterdam Study (RS) and the Blue Mountain Eye Study (BMES) for model development, and 3,589 CFIs of 376 eyes from the Age-Related Eye Disease Study (AREDS) for analysis of GA growth rate.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Methods</h3><p>A deep learning model based on an ensemble of encoder-decoder architectures was implemented and optimized for the segmentation of GA in CFIs. Four experienced graders delineated, in consensus, GA in CFIs from RS and BMES. These manual delineations were used to evaluate the segmentation model using 5-fold cross-validation. The model was further applied to CFIs from the AREDS to study the growth rate of GA. Linear regression analysis was used to study associations between structural biomarkers at baseline and GA growth rate. A general estimate of the progression of GA area over time was made by combining growth rates of all eyes with GA from the AREDS set.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Main Outcome Measures</h3><p>Automatically segmented GA and GA growth rate.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>The model obtained an average Dice coefficient of 0.72 ± 0.26 on the BMES and RS set while comparing the automatically segmented GA area to the graders' manual delineations. An intraclass correlation coefficient of 0.83 was reached between the automatically estimated GA area and the graders' consensus measures. Nine automatically calculated structural biomarkers (area, filled area, convex area, convex solidity, eccentricity, roundness, foveal involvement, perimeter and circularity) were significantly associated with growth rate. Combining all growth rates indicated that GA area grows quadratically up to an area of around 12 mm<sup>2</sup>, after which growth rate stabilizes or decreases.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion</h3><p>The presented deep learning model allowed for fully automatic and robust segmentation of GA in CFIs. These segmentations can be used to extract structural characteristics of GA that predict its growth rate.</p>

ophthalmology
Validation of a deep learning model for automatic detection and quantification of five OCT critical retinal features associated with neovascular age-related macular degeneration

Federico Ricardi,Jonathan Oakley,Daniel Russakoff,Giacomo Boscia,Paolo Caselgrandi,Francesco Gelormini,Andrea Ghilardi,Giulia Pintore,Tommaso Tibaldi,Paola Marolo,Francesco Bandello,Michele Reibaldi,Enrico Borrelli

DOI: https://doi.org/10.1136/bjo-2023-324647

2024-03-14

British Journal of Ophthalmology

Abstract:Purpose To develop and validate a deep learning model for the segmentation of five retinal biomarkers associated with neovascular age-related macular degeneration (nAMD). Methods 300 optical coherence tomography volumes from subject eyes with nAMD were collected. Images were manually segmented for the presence of five crucial nAMD features: intraretinal fluid, subretinal fluid, subretinal hyperreflective material, drusen/drusenoid pigment epithelium detachment (PED) and neovascular PED. A deep learning architecture based on a U-Net was trained to perform automatic segmentation of these retinal biomarkers and evaluated on the sequestered data. The main outcome measures were receiver operating characteristic curves for detection, summarised using the area under the curves (AUCs) both on a per slice and per volume basis, correlation score, enface topography overlap (reported as two-dimensional (2D) correlation score) and Dice coefficients. Results The model obtained a mean (±SD) AUC of 0.93 (±0.04) per slice and 0.88 (±0.07) per volume for fluid detection. The correlation score (R 2 ) between automatic and manual segmentation obtained by the model resulted in a mean (±SD) of 0.89 (±0.05). The mean (±SD) 2D correlation score was 0.69 (±0.04). The mean (±SD) Dice score resulted in 0.61 (±0.10). Conclusions We present a fully automated segmentation model for five features related to nAMD that performs at the level of experienced graders. The application of this model will open opportunities for the study of morphological changes and treatment efficacy in real-world settings. Furthermore, it can facilitate structured reporting in the clinic and reduce subjectivity in clinicians’ assessments.

ophthalmology
Automatic Segmentation of Diabetic Macular Edemas and ILM-RPE Layers in Retinal OCT Images Based on MFANet.

Shuang Liu,Jun Wu,Zhitao Xiao,Lei Geng,Fang Zhang

DOI: https://doi.org/10.1145/3594315.3594640

2023-01-01

Abstract:Aiming at the problems of blurred boundary and low segmentation accuracy of existing retinal OCT image segmentation methods, this paper designs a MFANet semantic segmentation model based on encode-decoder for the purpose of accurate segmentation of diabetic macular edemas and ILM-RPE layers, and proposes an automatic retinal OCT image segmentation method based on this model. This method takes the DeepLabV3+ network as the main body and improves the dilated convolution part, which can fully extract the multiscale features of the lesions and obtain a large enough receptive field to effectively balance the local and global information of the retina; the decoder increases the attention feature integration module, reduces information reduction and enlarges the global dimension interaction feature. The introduced global attention effectively strengthens the model's learning of important features of retinal image. The experimental results show that the proposed method has better segmentation effect than the existing methods, and the MIoU reaches 85.82%. It can extract the macular edema regions quickly and accurately, identify the boundary information better, and provide a quantitative analysis tool for clinical diagnosis and treatment.
Retinal Image Synthesis from Multiple-Landmarks Input with Generative Adversarial Networks.

Zekuan Yu,Qing Xiang,Jiahao Meng,Caixia Kou,Qiushi Ren,Yanye Lu

DOI: https://doi.org/10.1186/s12938-019-0682-x

2019-01-01

BioMedical Engineering OnLine

Abstract:BACKGROUND:Medical datasets, especially medical images, are often imbalanced due to the different incidences of various diseases. To address this problem, many methods have been proposed to synthesize medical images using generative adversarial networks (GANs) to enlarge training datasets for facilitating medical image analysis. For instance, conventional methods such as image-to-image translation techniques are used to synthesize fundus images with their respective vessel trees in the field of fundus image.METHODS:In order to improve the image quality and details of the synthetic images, three key aspects of the pipeline are mainly elaborated: the input mask, architecture of GANs, and the resolution of paired images. We propose a new preprocessing pipeline named multiple-channels-multiple-landmarks (MCML), aiming to synthesize color fundus images from a combination of vessel tree, optic disc, and optic cup images. We compared both single vessel mask input and MCML mask input on two public fundus image datasets (DRIVE and DRISHTI-GS) with different kinds of Pix2pix and Cycle-GAN architectures. A new Pix2pix structure with ResU-net generator is also designed, which has been compared with the other models.RESULTS AND CONCLUSION:As shown in the results, the proposed MCML method outperforms the single vessel-based methods for each architecture of GANs. Furthermore, we find that our Pix2pix model with ResU-net generator achieves superior PSNR and SSIM performance than the other GANs. High-resolution paired images are also beneficial for improving the performance of each GAN in this work. Finally, a Pix2pix network with ResU-net generator using MCML and high-resolution paired images are able to generate good and realistic fundus images in this work, indicating that our MCML method has great potential in the field of glaucoma computer-aided diagnosis based on fundus image.
Deep Att-ResGAN: A Retinal Vessel Segmentation Network for Color Fundus Images

Jie Zhao,Qianjin Feng

DOI: https://doi.org/10.18280/ts.380505

2021-01-01

Abstract:Retinal vessel segmentation plays a significant role in the diagnosis and treatment of ophthalmological diseases. Recent studies have proved that deep learning can effectively segment the retinal vessel structure. However, the existing methods have difficulty in segmenting thin vessels, especially when the original image contains lesions. Based on generative adversarial network (GAN), this paper proposes a deep network with residual module and attention module (Deep Att-ResGAN). The network consists of four identical subnetworks. The output of each subnetwork is imported to the next subnetwork as contextual features that guide the segmentation. Firstly, the problems of the original image, namely, low contrast, uneven illumination, and data insufficiency, were solved through image enhancement and preprocessing. Next, an improved U-Net was adopted to serve as the generator, which stacks the residual and attention modules. These modules optimize the weight of the generator, and enhance the generalizability of the network. Further, the segmentation was refined iteratively by the discriminator, which contributes to the performance of vessel segmentation. Finally, comparative experiments were carried out on two public datasets: Digital Retinal Images for Vessel Extraction (DRIVE) and Structured Analysis of the Retina (STARE). The experimental results show that Deep Att-ResGAN outperformed the equivalent models like U-Net and GAN in most metrics. Our network achieved accuracy of 0.9565 and F1 of 0.829 on DRIVE, and accuracy of 0.9690 and F1 of 0.841 on STARE.
A Refined Equilibrium Generative Adversarial Network for Retinal Vessel Segmentation

Yukun Zhou,Zailiang Chen,Hailan Shen,Xianxian Zheng,Rongchang Zhao,Xuanchu Duan

DOI: https://doi.org/10.48550/arXiv.1909.11936

2019-12-18

Abstract:Objective: Recognizing retinal vessel abnormity is vital to early diagnosis of ophthalmological diseases and cardiovascular events. However, segmentation results are highly influenced by elusive vessels, especially in low-contrast background and lesion region. In this work, we present an end-to-end synthetic neural network, containing a symmetric equilibrium generative adversarial network (SEGAN), multi-scale features refine blocks (MSFRB), and attention mechanism (AM) to enhance the performance on vessel segmentation. Method: The proposed network is granted powerful multi-scale representation capability to extract detail information. First, SEGAN constructs a symmetric adversarial architecture, which forces generator to produce more realistic images with local details. Second, MSFRB are devised to prevent high-resolution features from being obscured, thereby merging multi-scale features better. Finally, the AM is employed to encourage the network to concentrate on discriminative features. Results: On public dataset DRIVE, STARE, CHASEDB1, and HRF, we evaluate our network quantitatively and compare it with state-of-the-art works. The ablation experiment shows that SEGAN, MSFRB, and AM both contribute to the desirable performance. Conclusion: The proposed network outperforms the mature methods and effectively functions in elusive vessels segmentation, achieving highest scores in Sensitivity, G-Mean, Precision, and F1-Score while maintaining the top level in other metrics. Significance: The appreciable performance and computational efficiency offer great potential in clinical retinal vessel segmentation application. Meanwhile, the network could be utilized to extract detail information in other biomedical issues

Image and Video Processing,Computer Vision and Pattern Recognition
Segmentation of Laser Marks of Diabetic Retinopathy in the Fundus Photographs Using Lightweight U-Net

Yukang Jiang,Jianying Pan,Ming Yuan,Yanhe Shen,Jin Zhu,Yishen Wang,Yewei Li,Ke Zhang,Qingyun Yu,Huirui Xie,Huiting Li,Xueqin Wang,Yan Luo

DOI: https://doi.org/10.1155/2021/8766517

IF: 4.0608

2021-10-19

Journal of Diabetes Research

Abstract:Diabetic retinopathy (DR) is a prevalent vision-threatening disease worldwide. Laser marks are the scars left after panretinal photocoagulation, a treatment to prevent patients with severe DR from losing vision. In this study, we develop a deep learning algorithm based on the lightweight U-Net to segment laser marks from the color fundus photos, which could help indicate a stage or providing valuable auxiliary information for the care of DR patients. We prepared our training and testing data, manually annotated by trained and experienced graders from Image Reading Center, Zhongshan Ophthalmic Center, publicly available to fill the vacancy of public image datasets dedicated to the segmentation of laser marks. The lightweight U-Net, along with two postprocessing procedures, achieved an AUC of 0.9824, an optimal sensitivity of 94.16%, and an optimal specificity of 92.82% on the segmentation of laser marks in fundus photographs. With accurate segmentation and high numeric metrics, the lightweight U-Net method showed its reliable performance in automatically segmenting laser marks in fundus photographs, which could help the AI assist the diagnosis of DR in the severe stage.

endocrinology & metabolism,medicine, research & experimental
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization

Guilherme C. Oliveira,Gustavo H. Rosa,Daniel C. G. Pedronette,João P. Papa,Himeesh Kumar,Leandro A. Passos,Dinesh Kumar

DOI: https://doi.org/10.1016/j.bspc.2024.106263

2024-04-04

Abstract:Deep learning applications for assessing medical images are limited because the datasets are often small and imbalanced. The use of synthetic data has been proposed in the literature, but neither a robust comparison of the different methods nor generalizability has been reported. Our approach integrates a retinal image quality assessment model and StyleGAN2 architecture to enhance Age-related Macular Degeneration (AMD) detection capabilities and improve generalizability. This work compares ten different Generative Adversarial Network (GAN) architectures to generate synthetic eye-fundus images with and without AMD. We combined subsets of three public databases (iChallenge-AMD, ODIR-2019, and RIADD) to form a single training and test set. We employed the STARE dataset for external validation, ensuring a comprehensive assessment of the proposed approach. The results show that StyleGAN2 reached the lowest Frechet Inception Distance (166.17), and clinicians could not accurately differentiate between real and synthetic images. ResNet-18 architecture obtained the best performance with 85% accuracy and outperformed the two human experts (80% and 75%) in detecting AMD fundus images. The accuracy rates were 82.8% for the test set and 81.3% for the STARE dataset, demonstrating the model's generalizability. The proposed methodology for synthetic medical image generation has been validated for robustness and accuracy, with free access to its code for further research and development in this field.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Synthesizing New Retinal Symptom Images by Multiple Generative Models

Yi-Chieh Liu,Hao-Hsiang Yang,Chao-Han Huck Yang,Jia-Hong Huang,Meng Tian,Hiromasa Morikawa,Yi-Chang James Tsai,Jesper Tegner

DOI: https://doi.org/10.48550/arXiv.1902.04147

2019-02-12

Abstract:Age-Related Macular Degeneration (AMD) is an asymptomatic retinal disease which may result in loss of vision. There is limited access to high-quality relevant retinal images and poor understanding of the features defining sub-classes of this disease. Motivated by recent advances in machine learning we specifically explore the potential of generative modeling, using Generative Adversarial Networks (GANs) and style transferring, to facilitate clinical diagnosis and disease understanding by feature extraction. We design an analytic pipeline which first generates synthetic retinal images from clinical images; a subsequent verification step is applied. In the synthesizing step we merge GANs (DCGANs and WGANs architectures) and style transferring for the image generation, whereas the verified step controls the accuracy of the generated images. We find that the generated images contain sufficient pathological details to facilitate ophthalmologists' task of disease classification and in discovery of disease relevant features. In particular, our system predicts the drusen and geographic atrophy sub-classes of AMD. Furthermore, the performance using CFP images for GANs outperforms the classification based on using only the original clinical dataset. Our results are evaluated using existing classifier of retinal diseases and class activated maps, supporting the predictive power of the synthetic images and their utility for feature extraction. Our code examples are available online.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
High-quality Retinal Vessel Segmentation Using Generative Adversarial Network with a Large Receptive Field

Hanli Zhao,Xiaqing Qiu,Wanglong Lu,Hui Huang,Xiaogang Jin

DOI: https://doi.org/10.1002/ima.22428

IF: 2.177

2020-01-01

International Journal of Imaging Systems and Technology

Abstract:Retinal vessel segmentation is of great significance for assisting doctors in diagnosis of ophthalmological diseases such as diabetic retinopathy, macular degeneration and glaucoma. This article proposes a new retinal vessel segmentation algorithm using generative adversarial learning with a large receptive field. A generative network maps an input retinal fundus image to a realistic vessel image while a discriminative network differentiates between images drawn from the database and the generative network. Firstly, the proposed generative network combines shallow features with the upsampled deep features to assemble a more precise vessel image. Secondly, the residual module in the proposed generative and discriminative networks can effectively help deep nets easy to optimize. Moreover, the dilated convolutions in the proposed generative network effectively enlarge the receptive field without increasing the amount of computations. A number of experiments are conducted on two publicly available datasets (DRIVE and STARE) achieving the segmentation accuracy rates of 95.63% and 96.84%, and the average areas under the ROC curve of 98.12% and 98.53%. Performance results show that the proposed automatic retinal vessel segmentation algorithm outperforms state-of-the-art algorithms in many validation metrics. The proposed algorithm can not only detect small tiny blood vessels but also capture large-scale high-level semantic vessel features.
Retinal Vessel Segmentation Using Multi-Scale Residual Convolutional Neural Network (MSR-Net) Combined with Generative Adversarial Networks

Mithun Kumar Kar,Debanga Raj Neog,Malaya Kumar Nath

DOI: https://doi.org/10.1007/s00034-022-02190-5

2023-02-04

Abstract:Retinal fundus images provide valuable diagnostic and clinical information in the diagnosis of ophthalmologic diseases. Retinal blood vessel analysis provides important diagnostic information about thinning of the retinal nerve fiber layer and alteration in the structural appearance of the optic nerve head. Here, an accurate retinal vessel detection method is proposed from fundus images using a generative adversarial network (GAN) utilizing multiple loss functions. The proposed GAN architecture consists of the generator as a segmentation network and the discriminator as a classification network. The generator is a multi-scale residual convolutional neural network with skip connection and up-sampling, while the discriminator is a vision transformer that acts as a binary classifier. The inception module extracts multi-scale features of vessel segments from different scales and captures fine vessel segments. The discriminator consists of stacked self-attention networks and position-wise fully connected feed-forward networks inferring two-class output. The attention mechanism in the transformer is competent to preserve both global and local information while acting as a discriminator. The proposed GAN model segments the blood vessels more accurately through the adversarial learning process to produce state-of-the-art results. In the preprocessing stage, the contrast of blood vessels is enhanced by contrast-limited adaptive histogram equalization algorithm. The robustness and efficacy of the proposed method have been evaluated on publicly available DRIVE, STARE, CHASE_DB1, HRF, ARIA, IOSTAR, and RC-SLO databases. Different performance measures like accuracy, sensitivity, precision, intersection of union, and F1Score are adopted to compare the proposed method with the existing methods available in the literature. The proposed method attains an accuracy of 0.9873 for CHASE_DB1 database, 0.9742 for DRIVE database, 0.9773 for HRF database, and 0.9628 for ARIA database.

engineering, electrical & electronic
GlanceSeg: Real-time microaneurysm lesion segmentation with gaze-map-guided foundation model for early detection of diabetic retinopathy

Hongyang Jiang,Mengdi Gao,Zirong Liu,Chen Tang,Xiaoqing Zhang,Shuai Jiang,Wu Yuan,Jiang Liu

2023-11-14

Abstract:Early-stage diabetic retinopathy (DR) presents challenges in clinical diagnosis due to inconspicuous and minute microangioma lesions, resulting in limited research in this area. Additionally, the potential of emerging foundation models, such as the segment anything model (SAM), in medical scenarios remains rarely explored. In this work, we propose a human-in-the-loop, label-free early DR diagnosis framework called GlanceSeg, based on SAM. GlanceSeg enables real-time segmentation of microangioma lesions as ophthalmologists review fundus images. Our human-in-the-loop framework integrates the ophthalmologist's gaze map, allowing for rough localization of minute lesions in fundus images. Subsequently, a saliency map is generated based on the located region of interest, which provides prompt points to assist the foundation model in efficiently segmenting microangioma lesions. Finally, a domain knowledge filter refines the segmentation of minute lesions. We conducted experiments on two newly-built public datasets, i.e., IDRiD and Retinal-Lesions, and validated the feasibility and superiority of GlanceSeg through visualized illustrations and quantitative measures. Additionally, we demonstrated that GlanceSeg improves annotation efficiency for clinicians and enhances segmentation performance through fine-tuning using annotations. This study highlights the potential of GlanceSeg-based annotations for self-model optimization, leading to enduring performance advancements through continual learning.

Image and Video Processing,Computer Vision and Pattern Recognition,Human-Computer Interaction
High-accuracy 3D segmentation of wet age-related macular degeneration via multi-scale and cross-channel feature extraction and channel attention

Meixuan Li,Yadan Shen,Renxiong Wu,Shaoyan Huang,Fei Zheng,Sizhu Chen,Rong Wang,Wentao Dong,Jie Zhong,Guangming Ni,Yong Liu

DOI: https://doi.org/10.1364/boe.513619

IF: 3.4

2024-01-26

Biomedical Optics Express

Abstract:Wet age-related macular degeneration (AMD) is the leading cause of visual impairment and vision loss in the elderly, and optical coherence tomography (OCT) enables revolving biotissue three-dimensional micro-structure widely used to diagnose and monitor wet AMD lesions. Many wet AMD segmentation methods based on deep learning have achieved good results, but these segmentation results are two-dimensional, and cannot take full advantage of OCT's three-dimensional (3D) imaging characteristics. Here we propose a novel deep-learning network characterizing multi-scale and cross-channel feature extraction and channel attention to obtain high-accuracy 3D segmentation results of wet AMD lesions and show the 3D specific morphology, a task unattainable with traditional two-dimensional segmentation. This probably helps to understand the ophthalmologic disease and provides great convenience for the clinical diagnosis and treatment of wet AMD.

radiology, nuclear medicine & medical imaging,biochemical research methods,optics

[Interpretation of phosphatemic modifications in liver diseases].

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Generative Adversarial Network Combined with SE-ResNet and Dilated Inception Block for Segmenting Retinal Vessels

Exploiting multi-granularity visual features for retinal layer segmentation in human eyes

RV-GAN: Segmenting Retinal Vascular Structure in Fundus Photographs Using a Novel Multi-scale Generative Adversarial Network

RGC-Net: an Automatic Reconstruction and Quantification Algorithm for Retinal Ganglion Cells Based on Deep Learning.

Film interpretation session: Radiological Society of North America. Sixty-sixth scientific assembly and annual meeting, November 1980. Summary of discussion and diagnoses.

Retinal Vessel Segmentation in Medical Diagnosis using Multi-scale Attention Generative Adversarial Networks

A Deep Learning Model for Segmentation of Geographic Atrophy to Study Its Long-Term Natural History

Validation of a deep learning model for automatic detection and quantification of five OCT critical retinal features associated with neovascular age-related macular degeneration

Automatic Segmentation of Diabetic Macular Edemas and ILM-RPE Layers in Retinal OCT Images Based on MFANet.

Retinal Image Synthesis from Multiple-Landmarks Input with Generative Adversarial Networks.

Deep Att-ResGAN: A Retinal Vessel Segmentation Network for Color Fundus Images

A Refined Equilibrium Generative Adversarial Network for Retinal Vessel Segmentation

Segmentation of Laser Marks of Diabetic Retinopathy in the Fundus Photographs Using Lightweight U-Net

Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization

Synthesizing New Retinal Symptom Images by Multiple Generative Models

High-quality Retinal Vessel Segmentation Using Generative Adversarial Network with a Large Receptive Field

Retinal Vessel Segmentation Using Multi-Scale Residual Convolutional Neural Network (MSR-Net) Combined with Generative Adversarial Networks

GlanceSeg: Real-time microaneurysm lesion segmentation with gaze-map-guided foundation model for early detection of diabetic retinopathy

High-accuracy 3D segmentation of wet age-related macular degeneration via multi-scale and cross-channel feature extraction and channel attention