[Newly onset non-Hodgkin's lymphomas presenting as WAIHA: a clinical and laboratory analysis of 6 cases].

Bo-ting Wu,Feng Li,Wei-guang Wang

Abstract:

What problem does this paper attempt to address?

Infrared Image Super Resolution Using Gan With Infrared Image Prior

Shaowen Liu,Yifan Yang,Qi Li,Huajun Feng,Zhihai Xu,Yueting Chen,Lei Liu

DOI: https://doi.org/10.1109/SIPROCESS.2019.8868566

2019-01-01

Abstract:Super-resolution reconstruction technology based on deep-learning is rarely used in the field of infrared image. This paper will apply the Generative Adversarial Network super resolution approach to the infrared super-resolution task. The natural image gradient prior is introduced into the super resolution algorithm, and the visible image of the corresponding scene and the field of view is innovatively used as the style map, and the corresponding shallow network perceptual loss and deep network perceptual loss are added to the super-resolution objective function. The reconstructed image is more abundant and more detailed in the subjective visual reconstruction of the image texture than the existing algorithm in the simulation experiment.
Retinal fundus image super-resolution based on generative adversarial network guided with vascular structure prior

Yanfei Jia,Guangda Chen,Haotian Chi

DOI: https://doi.org/10.1038/s41598-024-74186-x

IF: 4.6

2024-10-03

Scientific Reports

Abstract:Many ophthalmic and systemic diseases can be screened by analyzing retinal fundus images. The clarity and resolution of retinal fundus images directly determine the effectiveness of clinical diagnosis. Deep learning methods based on generative adversarial networks are used in various research fields due to their powerful generative capabilities, especially image super-resolution. Although Real-ESRGAN is a recently proposed method that excels in processing real-world degraded images, it suffers from structural distortions when super-resolving retinal fundus images are rich in structural information. To address this shortcoming, we first process the input image using a pre-trained U-Net model to obtain a structural segmentation map of the retinal vessels and use the segmentation map as the structural prior. The spatial feature transform layer is then used to better integrate the structural prior into the generation process of the generator. In addition, we introduce channel and spatial attention modules into the skip connections of the discriminator to emphasize meaningful features and accordingly enhance the discriminative power of the discriminator. Based on the original loss functions, we introduce the L1 loss function to measure the pixel-level differences between the segmentation maps of retinal vascular structures in the high-resolution images and the super-resolution images to further constrain the super-resolution images. Simulation results on retinal image datasets show that our improved algorithm results have a better visual performance by suppressing structural distortions in the super-resolution images.

multidisciplinary sciences
Retinal fundus image superresolution generated by optical coherence tomography based on a realistic mixed attention GAN

Chunhao Tian,Jian Yang,Peng Li,Shaochong Zhang,Shengli Mi

DOI: https://doi.org/10.1002/mp.15580

IF: 4.506

2022-03-30

Medical Physics

Abstract:PURPOSE: Optical coherence tomography (OCT) is widely used to diagnose retinal diseases. However, due to the limited resolution of OCT imaging systems, the quality of fundus images displayed is not satisfactory, which hinders the diagnosis of patients by ophthalmologists. This is an inevitable problem of OCT imaging systems, but few people have given attention to it. We attempt to solve this problem through deep learning methods.METHODS: In this paper, we propose a single-image superresolution (SISR) model that is based on a generative adversarial network (GAN) for restoring low-resolution (LR) OCT fundus images to high-resolution (HR) counterparts. To obtain more realistic images, we craft the training data set by obtaining the real blur kernels of the LR images instead of using the bicubic interpolation kernel. The baseline of our generator is similar to that of an enhanced superresolution generative adversarial network (ESRGAN), but we creatively propose a mixed attention block (MAB). In contrast to other superresolution (SR) tasks, to adapt to the characteristics of OCT imaging systems, our network can reconstruct LR images with different upscaling factors in the height and width directions.RESULTS: The results of qualitative and quantitative experiments prove that our model is capable of reconstructing retinal fundus images clearly and accurately.CONCLUSIONS: We propose a new GAN model for enhancing the quality of displayed OCT retinal fundus images and achieve state-of-the-art results.

radiology, nuclear medicine & medical imaging
RIRGAN: an End-to-end Lightweight Multi-Task Learning Method for Brain MRI Super-Resolution and Denoising

Miao Yu,Miaomiao Guo,Shuai Zhang,Yuefu Zhan,Mingkang Zhao,Thomas Lukasiewicz,Zhenghua Xu

DOI: https://doi.org/10.1016/j.compbiomed.2023.107632

IF: 7.7

2023-01-01

Computers in Biology and Medicine

Abstract:A common problem in the field of deep-learning-based low-level vision medical images is that most of the research is based on single task learning (STL), which is dedicated to solving one of the situations of low resolution or high noise. Our motivation is to design a model that can perform both SR and DN tasks simultaneously, in order to cope with the actual situation of low resolution and high noise in low-level vision medical images. By improving the existing single image super-resolution (SISR) network and introducing the idea of multi-task learning (MTL), we propose an end-to-end lightweight MTL generative adversarial network (GAN) based network using residual-in-residual-blocks (RIR-Blocks) for feature extraction, RIRGAN, which can concurrently accomplish super-resolution (SR) and denoising (DN) tasks. The generator in RIRGAN is composed of several residual groups with a long skip connection (LSC), which can help form a very deep network and enable the network to focus on learning high-frequency (HF) information. The introduction of a discriminator based on relativistic average discriminator (RaD) greatly improves the discriminator’s ability and makes the generated image have more realistic details. Meanwhile, the use of hybrid loss function not only ensures that RIRGAN has the ability of MTL, but also enables RIRGAN to give a more balanced attention between quantitative evaluation of metrics and qualitative evaluation of human vision. The experimental results show that the quality of the restoration image of RIRGAN is superior to the SR and DN methods based on STL in both subjective perception and objective evaluation metrics when processing medical images with low-level vision. Our RIRGAN is more in line with the practical requirements of medical practice.
Image enhancement of wide-field retinal optical coherence tomography angiography by super-resolution angiogram reconstruction generative adversarial network

Xing Yuan,Yanping Huang,Lin An,Jia Qin,Gongpu Lan,Haixia Qiu,Bo Yu,Haibo Jia,Shangjie Ren,Haishu Tan,Jingjiang Xu,Xing Yuan,Yanping Huang,Lin An,Jia Qin,Gongpu Lan,Haixia Qiu,Bo Yu,Haibo Jia,Shangjie Ren,Haishu Tan,Jingjiang Xu

DOI: https://doi.org/10.1016/j.bspc.2022.103957

IF: 5.1

2022-09-01

Biomedical Signal Processing and Control

Abstract:Wide-field retinal optical coherence tomography angiography (OCTA) usually suffers from low image resolution in clinical practice because of insufficient lateral sampling. In this study, we develop a deep-learning-based method named super-resolution angiogram reconstruction generative adversarial network (SAR-GAN) to enhance the en face OCTA image quality. A sophisticated home-made spectral-domain OCTA system is employed to capture the data of retinal angiograms with different scanning protocols. High-resolution 3 × 3 mm2 OCTA images and low-resolution (LR) 6 × 6 mm2 OCTA images are utilised in training the network. We propose an improved loss function for SAR-GAN for the reconstruction of perceptually enhanced super-resolution images. The well-trained network is utilized to processing the LR OCTA images with a field of view (FOV) of 3 × 3 mm2, 6 × 6 mm2 and as large as 9 × 9 mm2. The qualitative and quantitative comparisons show that SAR-GAN provides perceptually better visualization and significantly enhances the image quality in terms of noise intensity, contrast-to-noise ratio and vessel connectivity. Moreover, it demonstrates superior image enhancement for retinal OCTA with small or large FOVs, compared with other traditional and deep-learning based methods. The SAR-GAN has great potential to improve the clinical assessment by wide-field OCTA.

engineering, biomedical
Super-resolution reconstruction method of the optical synthetic aperture image using generative adversarial network

Jing Chen,Aileen Tian,Ding Chen,Meng Guo,Dan He,Yuwen Liu

DOI: https://doi.org/10.1515/phys-2023-0194

2024-01-01

Open Physics

Abstract:Abstract In order to solve the contradiction between large aperture elements and high-resolution images, in this study, we propose an improved image-resolution method based on generative adversarial network (GAN). First, we analyze the imaging principle of the optical synthetic aperture. Further, we improve a super-resolution GAN; especially, this network uses a multi-scale convolutional cascade to obtain global features of the image, and a multi-scale receptive field block and residual in residual dense block are built to obtain image details. In addition, this study uses the Mish function as the activation function of the discriminator to solve the problems of neuron extreme, gradient explosion, and poor generalization ability of the model. Through simulation, the results show that the proposed method can achieve a peak signal-to-noise ratio (PSNR) of 30 dB compared with traditional image super-resolution reconstruction methods for synthetic aperture image. The method proposed has an improvement of 2 dB in the PSNR and 0.016 in structure similarity index measure compared with the original super-resolution GAN. Therefore, this method can effectively reduce the image distortion and improve the quality of image reconstruction.

physics, multidisciplinary
An improved generative adversarial networks for remote sensing image super-resolution reconstruction via multi-scale residual block

Fuzhen Zhu,Chen Wang,Bing Zhu,Ce Sun,Chengxiao Qi

DOI: https://doi.org/10.1016/j.ejrs.2022.12.008

2023-01-11

Abstract:Existing image super-resolution algorithms still suffer from the problems of not extracting rich image features and losing realistic high-frequency details. In order to solve these problems, this paper proposes an improved generative adversarial network algorithm for super-resolution reconstruction of remote sensing images by multi-scale residual blocks. The original generative adversarial network (GAN) structure is improved and multi-scale residual blocks are introduced in the generator to fuse features at different scales. After extracting the parallel information of multi-scale features, information is exchanged between multi-resolution information streams to obtain contextual information through spatial and channel attention mechanisms, and multi-scale features are fused according to the attention mechanism. In the discriminator, the concept of relative average GAN (RaGAN) is introduced, and the loss function of the network is redesigned so that the discriminator can predict relative probabilities instead of absolute probabilities thus enabling clear learning of edge and texture details. Experimental results show that the proposed method in this paper significantly outperforms state-of-the-art (SOTA) methods in terms of both subjective and objective metrics.In three test datasets, compared with SOTA methods, the Peak Signal to Noise Ratio(PSNR) is improved by a maximum of 1.18 dB, 0.84 dB and 1.29 dB respectively, and the Structural Similarity Index (SSIM) is improved by 0.0264, 0.0077 and 0.0109 respectively in scale of 2, 3 and 4 times images super-resolution.The model proposed in this paper effectively improved the super-resolution re-construction results of remote sensing images.

environmental sciences,remote sensing
Infrared image super-resolution reconstruction by using generative adversarial network with an attention mechanism

Qing-Ming Liu,Rui-Sheng Jia,Yan-Bo Liu,Hai-Bin Sun,Jian-Zhi Yu,Hong-Mei Sun

DOI: https://doi.org/10.1007/s10489-020-01987-8

IF: 5.3

2020-10-23

Applied Intelligence

Abstract:Due to the limitations of infrared imaging principles and imaging systems, many problems are typically encountered with collected infrared images, such as low resolution, insufficient detail information, and blurred edges. In response to these problems, a method of infrared image super-resolution reconstruction that uses recursive attention and is based on a generative adversarial network is proposed. First, according to the characteristics of low-resolution infrared images such as uniform pixel distributions, low contrast, and poor perceived quality, a deep generator structure with a recursive-attention network is designed in this article. The recursive-attention module is used to extract high-frequency information from the feature maps, suppress useless information, and enhance the expressiveness of the features, which facilitates the reconstruction of texture details of infrared images. Then, to better distinguish the reconstructed images from the original high-resolution images, we designed a discriminator that was composed of a deep convolutional neural network. In addition, targeted improvements were made to the content loss function of GAN. We used the pre-trained VGG-19 network features before activation to calculate the perceptual loss, which helps recover the texture details of the infrared images. The experimental results on infrared image datasets demonstrated that the reconstruction performance of the proposed method is higher than those of several typical methods, and it realizes higher image visual quality.

computer science, artificial intelligence
VSG-GAN: A high-fidelity image synthesis method with semantic manipulation in retinal fundus image

Junjie Liu,Shixin Xu,Ping He,Sirong Wu,Xi Luo,Yuhui Deng,Huaxiong Huang

DOI: https://doi.org/10.1016/j.bpj.2024.02.019

2024-09-03

Abstract:In recent years, advancements in retinal image analysis, driven by machine learning and deep learning techniques, have enhanced disease detection and diagnosis through automated feature extraction. However, challenges persist, including limited data set diversity due to privacy concerns and imbalanced sample pairs, hindering effective model training. To address these issues, we introduce the vessel and style guided generative adversarial network (VSG-GAN), an innovative algorithm building upon the foundational concept of GAN. In VSG-GAN, a generator and discriminator engage in an adversarial process to produce realistic retinal images. Our approach decouples retinal image generation into distinct modules: the vascular skeleton and background style. Leveraging style transformation and GAN inversion, our proposed hierarchical variational autoencoder module generates retinal images with diverse morphological traits. In addition, the spatially adaptive denormalization module ensures consistency between input and generated images. We evaluate our model on MESSIDOR and RITE data sets using various metrics, including structural similarity index measure, inception score, Fréchet inception distance, and kernel inception distance. Our results demonstrate the superiority of VSG-GAN, outperforming existing methods across all evaluation assessments. This underscores its effectiveness in addressing data set limitations and imbalances. Our algorithm provides a novel solution to challenges in retinal image analysis by offering diverse and realistic retinal image generation. Implementing the VSG-GAN augmentation approach on downstream diabetic retinopathy classification tasks has shown enhanced disease diagnosis accuracy, further advancing the utility of machine learning in this domain.
Superresolution reconstruction of optical remote sensing images based on a multiscale attention adversarial network

Qi Zhang,Rui-Sheng Jia,Zeng-Hu Li,Yong-Chao Li,Hong-Mei Sun

DOI: https://doi.org/10.1007/s10489-022-03548-7

IF: 5.3

2022-04-06

Applied Intelligence

Abstract:Due to the influence of imaging equipment and environmental conditions on optical remote sensing image acquisition, image resolution is generally low. Superresolution reconstruction technology is an important way to improve image quality. However, the existing optical remote sensing image superresolution reconstruction methods have some problems, such as insufficient feature extraction, blurred texture details of reconstructed images, and excessive network accumulation. To solve the above problems, a superresolution reconstruction method for optical remote sensing images based on a multiscale attention adversarial network is proposed in this paper. The method takes a generative adversarial network (GAN) as the basic framework. The generator uses four multiscale attention residual blocks (MSARBs) to extract image multiscale feature information and carries out feature fusion through a binary feature fusion structure (BFFS) to generate more realistic images. The discriminator uses a depth convolution network to distinguish the differences between real images and superresolution images. In the aspect of loss function construction, the perceptual loss and adversarial loss are combined to improve the perceptual quality of the images. Experimental results show that this method is superior to the compared algorithm in regard to the objective evaluation metrics of peak signal-to-noise ratio (PSNR) and structural similarity (SSIM), and its reconstructed images have better visual effect.

computer science, artificial intelligence
IESRGAN: Enhanced U-Net Structured Generative Adversarial Network for Remote Sensing Image Super-Resolution Reconstruction

Xiaohan Yue,Danfeng Liu,Liguo Wang,Jón Atli Benediktsson,Linghong Meng,Lei Deng

DOI: https://doi.org/10.3390/rs15143490

IF: 5

2023-07-12

Remote Sensing

Abstract:With the continuous development of modern remote sensing satellite technology, high-resolution (HR) remote sensing image data have gradually become widely used. However, due to the vastness of areas that need to be monitored and the difficulty in obtaining HR images, most monitoring projects still rely on low-resolution (LR) data for the regions being monitored. The emergence of remote sensing image super-resolution (SR) reconstruction technology effectively compensates for the lack of original HR images. This paper proposes an Improved Enhanced Super-Resolution Generative Adversarial Network (IESRGAN) based on an enhanced U-Net structure for a 4× scale detail reconstruction of LR images using NaSC-TG2 remote sensing images. In this method, in-depth research has been performed and consequent improvements have been made to the generator and discriminator within the GAN network. Specifically, before introducing Residual-in-Residual Dense Blocks (RRDB), in the proposed method, input images are subjected to reflective padding to enhance edge information. Meanwhile, a U-Net structure is adopted for the discriminator, incorporating spectral normalization to focus on semantic and structural changes between real and fake images, thereby improving generated image quality and GAN performance. To evaluate the effectiveness and generalization ability of our proposed model, experiments were conducted on multiple real-world remote sensing image datasets. Experimental results demonstrate that IESRGAN exhibits strong generalization capabilities while delivering outstanding performance in terms of PSNR, SSIM, and LPIPS image evaluation metrics.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
GAN-based Super-Resolution and Segmentation of Retinal Layers in Optical coherence tomography Scans

Paria Jeihouni,Omid Dehzangi,Annahita Amireskandari,Ali Rezai,Nasser M. Nasrabadi

DOI: https://doi.org/10.48550/arXiv.2206.13740

2022-06-28

Image and Video Processing

Abstract:In this paper, we design a Generative Adversarial Network (GAN)-based solution for super-resolution and segmentation of optical coherence tomography (OCT) scans of the retinal layers. OCT has been identified as a non-invasive and inexpensive modality of imaging to discover potential biomarkers for the diagnosis and progress determination of neurodegenerative diseases, such as Alzheimer's Disease (AD). Current hypotheses presume the thickness of the retinal layers, which are analyzable within OCT scans, can be effective biomarkers. As a logical first step, this work concentrates on the challenging task of retinal layer segmentation and also super-resolution for higher clarity and accuracy. We propose a GAN-based segmentation model and evaluate incorporating popular networks, namely, U-Net and ResNet, in the GAN architecture with additional blocks of transposed convolution and sub-pixel convolution for the task of upscaling OCT images from low to high resolution by a factor of four. We also incorporate the Dice loss as an additional reconstruction loss term to improve the performance of this joint optimization task. Our best model configuration empirically achieved the Dice coefficient of 0.867 and mIOU of 0.765.
PRO-SSRGAN: stable super-resolution generative adversarial network based on parameter reconstructive optimization on Gaofen-5 remote-sensing images

Boyu Pang,Yin-Nian Liu

DOI: https://doi.org/10.1080/01431161.2024.2339205

IF: 3.531

2024-04-25

International Journal of Remote Sensing

Abstract:Advances in hardware capabilities and big data technologies over the past decade have enabled the application of deep learning techniques to address the challenge of super-resolution in remote-sensing images. Recently, while deep-learning-based methods have outperformed traditional methods, the abundance of information in remote-sensing images creates an imbalance between performance and computational resource consumption in current deep-learning-based methods. This paper introduces a stable super-resolution algorithm based on parameter reconstructive optimization to address these issues. First, based on the stable super-resolution generative adversarial network (SSRGAN), the algorithm employs a generator with networks using residual connections to reconstruct images with enhanced resolution. Next, it extracts content, adversarial, and regularization losses using the discriminator from a stable super-resolution generative adversarial network, which in turn guides the training of the network. Finally, upon completion of training, structural re-parameterization is conducted to optimize the multi-branch trained network into a plain inference network. This inference network can serve as an individual new generator. The results of qualitative and quantitative experimental comparisons with the models Bicubic, super-resolution convolutional neural network, very deep super-resolution convolutional network, deep recursive residual network, super-resolution generative adversarial network (SRGAN), enhanced SRGAN, and stable SRGAN on the Gaofen-5 AHSI satellite dataset suggest that this algorithm achieves improved evaluation indices with a 4× magnification ratio, reaching a peak signal-to-noise ratio of 30.7207 dB and structural similarity index measure of 0.8178. Compared with the trained but unconverted generator, which can also work independently, implementing re-parameterization results in approximately a 10% reduction in the number of parameters, indicating lower resource consumption, while the reconstruction effect is minimally influenced. Furthermore, the super-resolution results exhibit richer detail, increased contrast, and better scene adaptability.

imaging science & photographic technology,remote sensing
[Effect of hydrogen-rich water on the CD34 expression in lesion boundary brain tissue of rats with traumatic brain injury].

Y. Liu,Q. Lan,Di-fen Wang,Xianjun Chen,Jia-Bing Yuan,Hailing Zhang

DOI: https://doi.org/10.3760/cma.j.issn.2095-4352.2017.03.013

2017-03-01

Abstract:OBJECTIVE To observe the effect of hydrogen-rich water on the CD34 expression and angiogenesis in lesion boundary brain tissue of rats with traumatic brain injury (TBI). METHODS A total of 54 adult male Sprague-Dawley (SD) rats were divided into three groups by random number table: namely sham-operated group (sham group), trauma group (TBI group), and trauma + hydrogen-rich water group (TBI+HW group), the rats in each group were subdivided into 1, 3 and 7 days subgroups according to the time points after trauma, with 6 rats in each subgroup. The TBI model was reproduced by using a modified Feency method for free fall impact, and the rats in sham group were not given brain impact after craniotomy. The rats in TBI+HW group were given intraperitoneal injection of hydrogen-rich water (5 mL/kg) after TBI model reproduction, and then once a day until being sacrificed, and the rats in sham group and TBI group were given the same amount of normal saline. The neurological severity scores (NSS) for neurologic deficits were calculated at corresponding time points, and then the rats were sacrificed for brain tissue at 3 mm around lesion boundary. After hematoxylin-eosin (HE) staining, the pathological changes in lesion boundary brain tissue were observed under light microscope. The expression of CD34+ cells was observed by immunohistochemical analysis, which markers were used to count the newborn blood capillary sprouts around the traumatic brain tissue. The protein expression of CD34 was determined by Western Blot. RESULTS NSS scores at all time points in sham group were 0. NSS scores in TBI and TBI+HW groups showed a decreased tendency with time prolongation after TBI, which showed more significant in TBI+HW group, NSS scores at 3 days and 7 days were significantly lower than those of TBI group (3 day: 8.67±0.52 vs. 11.56±1.94, 7 days: 7.33±0.52 vs. 8.17±0.98, both P < 0.05). Under light microscope, the brain tissue of rats in sham group was normal. After injury, pathological changes in lesion boundary brain tissue in TBI group were characterized by obvious hemorrhagic necrosis, severe brain edema, a large number of degeneration and necrosis of nerve cells and inflammatory cell infiltration, and the pathological changes were more obvious at 3 days. The edema area in TBI+HW group was slightly smaller than that of TBI group, and the surrounding edema was slightly reduced. It was shown by immunohistochemistry that only a very small number of neoformative capillaries were found in sham group. The number of neoformative capillaries in lesion boundary brain tissue was gradually increased with time prolongation in TBI group. The number of neoformative capillaries in TBI+HW group was more significantly, which was significantly higher than that of TBI group at 3 days and 7 days after injury (cells/HP: 10.59±1.88 vs. 8.61±1.22 at 3 days, 23.20±3.16 vs. 17.01±2.64 at 7 days, both P < 0.05). It was shown by Western Blot that the expression of CD34 protein at all time points in TBI group was significantly increased as compared with that of sham group. The expression of CD34 protein at 1 day and 3 days in TBI+HW group was slightly increased as compared with that of TBI group without significant difference, but it was significantly up-regulated at 7 days after injury, which was significantly higher than that of TBI group (gray value: 1.36±0.36 vs. 0.74±0.08, P < 0.05). CONCLUSIONS Hydrogen-rich water promote CD34+ cells home to the site of injured tissue in rats with TBI, is involved in angiogenesis, and improve clinical outcomes during brain functional recovery.
Forest Single-Frame Remote Sensing Image Super-Resolution Using GANs

Yafeng Zhao,Shuai Zhang,Junfeng Hu

DOI: https://doi.org/10.3390/f14112188

IF: 3.282

2023-11-04

Forests

Abstract:Generative Adversarial Networks (GANs) possess remarkable fitting capabilities and play a crucial role in the field of computer vision. Super-resolution restoration is the process of converting low-resolution images into high-resolution ones, providing more detail and information. This is of paramount importance for monitoring and managing forest resources, enabling the surveillance of vegetation, wildlife, and potential disruptive factors in forest ecosystems. In this study, we propose an image super-resolution model based on Generative Adversarial Networks. We incorporate Multi-Scale Residual Blocks (MSRB) as the core feature extraction component to obtain image features at different scales, enhancing feature extraction capabilities. We introduce a novel attention mechanism, GAM Attention, which is added to the VGG network to capture more accurate feature dependencies in both spatial and channel domains. We also employ the adaptive activation function Meta ACONC and Ghost convolution to optimize training efficiency and reduce network parameters. Our model is trained on the DIV2K and LOVEDA datasets, and experimental results indicate improvements in evaluation metrics compared to SRGAN, with a PSNR increase of 0.709/2.213 dB, SSIM increase of 0.032/0.142, and LPIPS reduction of 0.03/0.013. The model performs on par with Real-ESRGAN but offers significantly improved speed. Our model efficiently restores single-frame remote sensing images of forests while achieving results comparable to state-of-the-art methods. It overcomes issues related to image distortion and texture details, producing forest remote sensing images that closely resemble high-resolution real images and align more closely with human perception. This research has significant implications on a global scale for ecological conservation, resource management, climate change research, risk management, and decision-making processes.

forestry
Improved SRCNN for Super-Resolution Reconstruction of Retinal Images

Yan Lv,Hui Ma

DOI: https://doi.org/10.1109/icsp51882.2021.9408850

2021-01-01

Abstract:Image super-resolution reconstruction means to recover high resolution image from low resolution image. It is widely used in satellite image, city monitoring, medical treatment and other fields. Medical image processing usually requires a high level of image detail. We designed an improved SRCNN for super-resolution reconstruction of retinal images (ISRCNN). In the image reconstruction part of this network, deconvolution was adopted for up-sampling to reconstruct high-resolution retinal images. Secondly, we deepened the layers of the network and adopted dense connections to improve the ability of network feature extraction. Finally, we adopted ReZero residue learning method, which could not only avoid the gradient disappearance or explosion caused by excessively deep network, but also help to reconstruct the detailed information of retinal image. We test models on DRIVE data sets, the results showed that our approach was effective in reconstructing retinal images.
A Residual Dense Attention Generative Adversarial Network for Microscopic Image Super-Resolution

Sanya Liu,Xiao Weng,Xingen Gao,Xiaoxin Xu,Lin Zhou

DOI: https://doi.org/10.3390/s24113560

IF: 3.9

2024-05-31

Sensors

Abstract:With the development of deep learning, the Super-Resolution (SR) reconstruction of microscopic images has improved significantly. However, the scarcity of microscopic images for training, the underutilization of hierarchical features in original Low-Resolution (LR) images, and the high-frequency noise unrelated with the image structure generated during the reconstruction process are still challenges in the Single Image Super-Resolution (SISR) field. Faced with these issues, we first collected sufficient microscopic images through Motic, a company engaged in the design and production of optical and digital microscopes, to establish a dataset. Secondly, we proposed a Residual Dense Attention Generative Adversarial Network (RDAGAN). The network comprises a generator, an image discriminator, and a feature discriminator. The generator includes a Residual Dense Block (RDB) and a Convolutional Block Attention Module (CBAM), focusing on extracting the hierarchical features of the original LR image. Simultaneously, the added feature discriminator enables the network to generate high-frequency features pertinent to the image's structure. Finally, we conducted experimental analysis and compared our model with six classic models. Compared with the best model, our model improved PSNR and SSIM by about 1.5 dB and 0.2, respectively.

engineering, electrical & electronic,instruments & instrumentation,chemistry, analytical
Csrgan: medical image super-resolution using a generative adversarial network

Yongpei Zhu,Zicong Zhou,Guojun Liao,Kehong Yuan

DOI: https://doi.org/10.1109/isbiworkshops50223.2020.9153436

2020-01-01

Abstract:Super-resolution medical image is vital for doctor's diagnosis and quantitative analysis. In this work we propose a novel super-resolution generative adversarial network which combine conditional GAN (CGAN) and SRGAN, refer to it as CSRGAN to generate super-resolution (SR) images. We use differential geometric information including Jacobian determinant (JD) and curl vector (CV) as conditional inputs of both the discriminator and generator of SRGAN, which make full use of the idea of using GANs to learn a mapping from one manifold to another. In addition, we proposed a content loss motivated by CV feature information instead of VGG loss in SRGAN. We trained our model on a large-scale dataset CelebFaces Attributes, tested it on medical ultrasound image dataset. The experimental results show the method can achieve better performance in SR image generation with higher average peak signal-to-noise ratio (PSNR), Structural Similarity (SSIM) and Mean Opinion Score (MOS) compared with SRGAN.
Generative Adversarial Network Combined with SE-ResNet and Dilated Inception Block for Segmenting Retinal Vessels

Chen Yue,Mingquan Ye,Peipei Wang,Daobin Huang,Xiaojie Lu

DOI: https://doi.org/10.1155/2022/3585506

IF: 3.12

2022-08-30

Computational Intelligence and Neuroscience

Abstract:This study develops an accurate method based on the generative adversarial network (GAN) that targets the issue of the current discontinuity of micro vessel segmentation in the retinal segmentation images. The processing of images has become increasingly efficient since the advent of deep learning method. We have proposed an improved GAN combined with SE-ResNet and dilated inception block for the segmenting retinal vessels (SAD-GAN). The GAN model has been improved with respect to the following points. (1) In the generator, the original convolution block is replaced with SE-ResNet module. Furthermore, SE-Net can extract the global channel information, while concomitantly strengthening and weakening the key features and invalid features, respectively. The residual structure can alleviate the issue of gradient disappearance. (2) The inception block and dilated convolution are introduced into the discriminator, which enhance the transmission of features and expand the acceptance domain for improved extraction of the deep network features. (3) We have included the attention mechanism in the discriminator for combining the local features with the corresponding global dependencies, and for highlighting the interdependent channel mapping. SAD-GAN performs satisfactorily on public retina datasets. On DRIVE dataset, ROC_AUC and PR_AUC reach 0.9813 and 0.8928, respectively. On CHASE_DB1 dataset, ROC_AUC and PR_AUC reach 0.9839 and 0.9002, respectively. Experimental results demonstrate that the generative adversarial model, combined with deep convolutional neural network, enhances the segmentation accuracy of the retinal vessels far above that of certain state-of-the-art methods.

mathematical & computational biology,neurosciences
Super-Resolution Reconstruction of Cell Images Based on Generative Adversarial Networks

Bin Pan,Yifeng Du,Xiaoming Guo

DOI: https://doi.org/10.1109/access.2024.3402535

IF: 3.9

2024-05-28

IEEE Access

Abstract:In this study, we introduce Light-ESRGAN, a novel cellular image super-resolution reconstruction model utilizing Generative Adversarial Networks (GANs). High-resolution (HR) cellular images are pivotal in pathological research; however, how to caputer critical features such as cell edges during microscopic imaging presents challenges due to hardware limitations and environmental factors. These factors frequently introduce noise and interference. Rapid advancements in deep learning have significantly enhanced the field of image super-resolution reconstruction, demonstrating substantial potential in cellular image processing. Our Light-ESRGAN employs a random degradation modeling process to leverage the GAN architecture for more accurate simulations of real-world degradation. We have also incorporated the Convolutional Block Attention Module (CBAM) into the residual blocks of the generator, thereby enhancing its ability to reconstruct image edges and textures through the fusion of channel and spatial attentions. For the discriminator, a lightweight U-Net structure is adopted, which not only reduces the model's parameter size but also improves its discriminative capacity. Compared to Real-ESRGAN and A-ESRGAN, Light-ESRGAN has reduced model parameters by 34.7% and 66.4%, respectively. It has demonstrated improved performance on publicly available cellular images, increasing the average Peak Signal-to-Noise Ratio (PSNR) by 1.174 dB and 1.992 dB, the Structural Similarity Index (SSIM) by an average of 1.5% and 9.1%, and reducing the Normalized Root Mean Square Error (NRMSE) by an average of 0.005 and 0.009.

computer science, information systems,telecommunications,engineering, electrical & electronic

[Newly onset non-Hodgkin's lymphomas presenting as WAIHA: a clinical and laboratory analysis of 6 cases].

Infrared Image Super Resolution Using Gan With Infrared Image Prior

Retinal fundus image super-resolution based on generative adversarial network guided with vascular structure prior

Retinal fundus image superresolution generated by optical coherence tomography based on a realistic mixed attention GAN

RIRGAN: an End-to-end Lightweight Multi-Task Learning Method for Brain MRI Super-Resolution and Denoising

Image enhancement of wide-field retinal optical coherence tomography angiography by super-resolution angiogram reconstruction generative adversarial network

Super-resolution reconstruction method of the optical synthetic aperture image using generative adversarial network

An improved generative adversarial networks for remote sensing image super-resolution reconstruction via multi-scale residual block

Infrared image super-resolution reconstruction by using generative adversarial network with an attention mechanism

VSG-GAN: A high-fidelity image synthesis method with semantic manipulation in retinal fundus image

Superresolution reconstruction of optical remote sensing images based on a multiscale attention adversarial network

IESRGAN: Enhanced U-Net Structured Generative Adversarial Network for Remote Sensing Image Super-Resolution Reconstruction

GAN-based Super-Resolution and Segmentation of Retinal Layers in Optical coherence tomography Scans

PRO-SSRGAN: stable super-resolution generative adversarial network based on parameter reconstructive optimization on Gaofen-5 remote-sensing images

[Effect of hydrogen-rich water on the CD34 expression in lesion boundary brain tissue of rats with traumatic brain injury].

Forest Single-Frame Remote Sensing Image Super-Resolution Using GANs

Improved SRCNN for Super-Resolution Reconstruction of Retinal Images

A Residual Dense Attention Generative Adversarial Network for Microscopic Image Super-Resolution

Csrgan: medical image super-resolution using a generative adversarial network

Generative Adversarial Network Combined with SE-ResNet and Dilated Inception Block for Segmenting Retinal Vessels

Super-Resolution Reconstruction of Cell Images Based on Generative Adversarial Networks