Characterization of microcarrier cultures of neurons and astrocytes from cerebral cortex and cerebellum

N. Westergaard,U. Sonnewald,S. Petersen,A. Schousboe

DOI: https://doi.org/10.1007/BF00965542

IF: 4.4

1991-08-01

Neurochemical Research

Abstract:

What problem does this paper attempt to address?

Infrared Image Super Resolution Using Gan With Infrared Image Prior

Shaowen Liu,Yifan Yang,Qi Li,Huajun Feng,Zhihai Xu,Yueting Chen,Lei Liu

DOI: https://doi.org/10.1109/SIPROCESS.2019.8868566

2019-01-01

Abstract:Super-resolution reconstruction technology based on deep-learning is rarely used in the field of infrared image. This paper will apply the Generative Adversarial Network super resolution approach to the infrared super-resolution task. The natural image gradient prior is introduced into the super resolution algorithm, and the visible image of the corresponding scene and the field of view is innovatively used as the style map, and the corresponding shallow network perceptual loss and deep network perceptual loss are added to the super-resolution objective function. The reconstructed image is more abundant and more detailed in the subjective visual reconstruction of the image texture than the existing algorithm in the simulation experiment.
Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Yifan Yang,Qi Li,Chenwei Yang,Yannian Fu,Huajun Feng,Zhihai Xu,Yueting Chen

DOI: https://doi.org/10.1109/access.2020.3017819

IF: 3.9

2020-01-01

IEEE Access

Abstract:Due to the limitation of hardware, infrared (IR) images have low-resolution (LR) and poor visual quality. Image super-resolution (SR) is a good solution to this problem. In this paper, we present a new convolution network (CNN) to improve the spatial resolution of infrared (IR) images. Our network is able to restore fine details by decomposing the input image into low-frequency and high-frequency domains. In low-frequency domains, we reconstruct image structure by deep networks. In high frequency domains, we reconstruct IR image details. Furthermore, we proposed another network to remove artifacts. Additionally, we propose a new loss function using visible (VIS) images to enhance the details of IR images. In training phase, we use VIS images to guide IR image restoration and in testing phase we get SR IR images with LR IR images input only. We optimize our deep network with a targeted function which penalizes images at different semantic levels using the corresponding terms. Besides, we build a dataset where paired LR-VIS images on the same scene are captured by a camera with both infrared and visible light sensors which both sensors have the same optical axis. Extensive experiments demonstrate that the proposed algorithm achieves superior performance and visual improvements against the state-of-the-arts.
Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Zewei He,Siliang Tang,Jiangxin Yang,Yanlong Cao,Michael Ying Yang,Yanpeng Cao

DOI: https://doi.org/10.1109/tcsvt.2018.2864777

IF: 5.859

2019-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Infrared images have a wide range of military and civilian applications, including night vision, surveillance, and robotics. However, high-resolution infrared detectors are difficult to fabricate and their manufacturing cost is expensive. In this paper, we present a cascaded architecture of deep neural networks with multiple receptive fields to increase the spatial resolution of infrared images by a large scale factor (x8). Instead of reconstructing a high-resolution image from its low-resolution version using a single complex deep network, the key idea of our approach is to set up a mid-point (scale x2) between scale x1 and x8 such that lost information can be divided into two components. Lost information within each component contains similar patterns thus can be more accurately recovered even using a simpler deep network. In our proposed cascaded architecture, two consecutive deep networks with different receptive fields are jointly trained through a multi-scale loss function. The first network with a large receptive field is applied to recover large-scale structure information, while the second one uses a relatively smaller receptive field to reconstruct small-scale image details. Our proposed method is systematically evaluated using realistic infrared images. Compared with state-of-the-art super-resolution methods, our proposed cascaded approach achieves improved reconstruction accuracy using significantly fewer parameters.
Infrared image super-resolution reconstruction by using generative adversarial network with an attention mechanism

Qing-Ming Liu,Rui-Sheng Jia,Yan-Bo Liu,Hai-Bin Sun,Jian-Zhi Yu,Hong-Mei Sun

DOI: https://doi.org/10.1007/s10489-020-01987-8

IF: 5.3

2020-10-23

Applied Intelligence

Abstract:Due to the limitations of infrared imaging principles and imaging systems, many problems are typically encountered with collected infrared images, such as low resolution, insufficient detail information, and blurred edges. In response to these problems, a method of infrared image super-resolution reconstruction that uses recursive attention and is based on a generative adversarial network is proposed. First, according to the characteristics of low-resolution infrared images such as uniform pixel distributions, low contrast, and poor perceived quality, a deep generator structure with a recursive-attention network is designed in this article. The recursive-attention module is used to extract high-frequency information from the feature maps, suppress useless information, and enhance the expressiveness of the features, which facilitates the reconstruction of texture details of infrared images. Then, to better distinguish the reconstructed images from the original high-resolution images, we designed a discriminator that was composed of a deep convolutional neural network. In addition, targeted improvements were made to the content loss function of GAN. We used the pre-trained VGG-19 network features before activation to calculate the perceptual loss, which helps recover the texture details of the infrared images. The experimental results on infrared image datasets demonstrated that the reconstruction performance of the proposed method is higher than those of several typical methods, and it realizes higher image visual quality.

computer science, artificial intelligence
A deep learning framework for morphologic detail beyond the diffraction limit in infrared spectroscopic imaging

Kianoush Falahkheirkhah,Kevin Yeh,Shachi Mittal,Luke Pfister,Rohit Bhargava

DOI: https://doi.org/10.48550/arXiv.1911.04410

2019-12-20

Abstract:Infrared (IR) microscopes measure spectral information that quantifies molecular content to assign the identity of biomedical cells but lack the spatial quality of optical microscopy to appreciate morphologic features. Here, we propose a method to utilize the semantic information of cellular identity from IR imaging with the morphologic detail of pathology images in a deep learning-based approach to image super-resolution. Using Generative Adversarial Networks (GANs), we enhance the spatial detail in IR imaging beyond the diffraction limit while retaining their spectral contrast. This technique can be rapidly integrated with modern IR microscopes to provide a framework useful for routine pathology.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
A novel generative adversarial network‐based super‐resolution approach for face recognition

Amit Chougule,Shreyas Kolte,Vinay Chamola,Amir Hussain

DOI: https://doi.org/10.1111/exsy.13564

IF: 3.3

2024-02-22

Expert Systems

Abstract:Face recognition is an essential feature required for a range of computer vision applications such as security, attendance systems, emotion detection, airport check‐in, and many others. The super‐resolution of subject images is an important and challenging element in numerous scenarios. At times the images are low resolution and need to be processed through super‐resolution techniques to gain more accurate results. For the problem of image super‐resolution, deep learning‐based face recognition systems have been explored in recent years; however, low‐resolution face recognition remains an arduous task. Generative adversarial network (GAN) based models are a promising approach to address this challenge. However, conventional GAN‐based models may generate images that differ significantly from an original high‐resolution image in the test set to the point that the identity of the target face may be changed. To address this shortcoming, we propose a novel U‐Net style generator architecture, where skip‐connections between the encoder and decoder layer can help in preserving the facial characteristics of the input image in the generated image, thus curbing the generator's ability to generate an entirely new image and training it to generate an image more similar in characteristics to the original image. In addition to statistical metrics like structural similarity index measure and Fréchet inception distance, we compute the pixel‐wise distance between the original and model‐generated images to ascertain that our model generates as close to the original images as possible. While we train the model for 4× super‐resolution (64 × 64 images to 256 × 256), our architecture can also be trained for an arbitrary resizing scale. Finally, the number of faces detected over high‐resolution images generated by our model is shown to be higher than state‐of‐the‐art high‐resolution image creation models for face recognition tasks.

computer science, artificial intelligence, theory & methods
Deep learning-based super-resolution in coherent imaging systems

Tairan Liu,Kevin de Haan,Yair Rivenson,Zhensong Wei,Xin Zeng,Yibo Zhang,Aydogan Ozcan

DOI: https://doi.org/10.1038/s41598-019-40554-1

2018-10-16

Abstract:We present a deep learning framework based on a generative adversarial network (GAN) to perform super-resolution in coherent imaging systems. We demonstrate that this framework can enhance the resolution of both pixel size-limited and diffraction-limited coherent imaging systems. We experimentally validated the capabilities of this deep learning-based coherent imaging approach by super-resolving complex images acquired using a lensfree on-chip holographic microscope, the resolution of which was pixel size-limited. Using the same GAN-based approach, we also improved the resolution of a lens-based holographic imaging system that was limited in resolution by the numerical aperture of its objective lens. This deep learning-based super-resolution framework can be broadly applied to enhance the space-bandwidth product of coherent imaging systems using image data and convolutional neural networks, and provides a rapid, non-iterative method for solving inverse image reconstruction or enhancement problems in optics.

Computer Vision and Pattern Recognition,Machine Learning,Applied Physics,Optics
Super-Resolution Generative Adversarial Network Based on the Dual Dimension Attention Mechanism for Biometric Image Super-Resolution

Chi-En Huang,Yung-Hui Li,Muhammad Saqlain Aslam,Ching-Chun Chang

DOI: https://doi.org/10.3390/s21237817

IF: 3.9

2021-11-24

Sensors

Abstract:There exist many types of intelligent security sensors in the environment of the Internet of Things (IoT) and cloud computing. Among them, the sensor for biometrics is one of the most important types. Biometric sensors capture the physiological or behavioral features of a person, which can be further processed with cloud computing to verify or identify the user. However, a low-resolution (LR) biometrics image causes the loss of feature details and reduces the recognition rate hugely. Moreover, the lack of resolution negatively affects the performance of image-based biometric technology. From a practical perspective, most of the IoT devices suffer from hardware constraints and the low-cost equipment may not be able to meet various requirements, particularly for image resolution, because it asks for additional storage to store high-resolution (HR) images, and a high bandwidth to transmit the HR image. Therefore, how to achieve high accuracy for the biometric system without using expensive and high-cost image sensors is an interesting and valuable issue in the field of intelligent security sensors. In this paper, we proposed DDA-SRGAN, which is a generative adversarial network (GAN)-based super-resolution (SR) framework using the dual-dimension attention mechanism. The proposed model can be trained to discover the regions of interest (ROI) automatically in the LR images without any given prior knowledge. The experiments were performed on the CASIA-Thousand-v4 and the CelebA datasets. The experimental results show that the proposed method is able to learn the details of features in crucial regions and achieve better performance in most cases.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Infrared Image Super-Resolution via GAN

Yongsong Huang,Shinichiro Omachi

2023-12-02

Abstract:The ability of generative models to accurately fit data distributions has resulted in their widespread adoption and success in fields such as computer vision and natural language processing. In this chapter, we provide a brief overview of the application of generative models in the domain of infrared (IR) image super-resolution, including a discussion of the various challenges and adversarial training methods employed. We propose potential areas for further investigation and advancement in the application of generative models for IR image super-resolution.

Image and Video Processing,Computer Vision and Pattern Recognition
Enhancement of Infrared Imagery through Low‐Light Image Guidance Leveraging Deep Learning Techniques

Yong Gan,Yuefeng Wang

DOI: https://doi.org/10.1155/2024/8574836

IF: 8.993

2024-07-26

International Journal of Intelligent Systems

Abstract:Addressing challenges in infrared imaging, such as low contrast, blurriness, and detail scarcity due to environmental limitations and the target's limited radiative capacity, this research introduces a novel infrared image enhancement approach using low‐light image guidance. Initially, the Cbc‐SwinIR model (coordinate‐based convolution‐ image restoration using Swin Transformer) is applied for super‐resolution reconstruction of both shimmer and infrared images, improving their resolution and clarity. Next, the MAXIM model (multiaxis MLP for image processing) enhances the visibility of low‐light images under low illumination. Finally, the AILI (adaptive infrared and low‐light)‐fusion algorithm fuses the processed low‐light image with the infrared image, achieving comprehensive visual enhancement. The enhanced infrared image exhibits significant improvements: a 0.08 increase in fractal dimension (FD), 0.094 rise in information entropy, 0.00512 elevation in mean square error (MSE), and a 12.206 reduction in peak signal‐to‐noise ratio (PSNR). These advancements in FD and information entropy highlight a substantial improvement in the complexity and diversity of the infrared image's features. Despite a decrease in PSNR and an increase in MSE, this indicates that the newly introduced information enhances contrast and enriches texture details in the infrared images, resulting in pixel‐level variations. This methodology demonstrates considerable improvements in visual content and analytical value, proving relevant, innovative, and efficient in infrared image enhancement with broad application prospects.

computer science, artificial intelligence
Infrared Image Super-Resolution Network Utilizing the Enhanced Transformer and U-Net

Feng Huang,Yunxiang Li,Xiaojing Ye,Jing Wu

DOI: https://doi.org/10.3390/s24144686

IF: 3.9

2024-07-19

Sensors

Abstract:Infrared images hold significant value in applications such as remote sensing and fire safety. However, infrared detectors often face the problem of high hardware costs, which limits their widespread use. Advancements in deep learning have spurred innovative approaches to image super-resolution (SR), but comparatively few efforts have been dedicated to the exploration of infrared images. To address this, we design the Residual Swin Transformer and Average Pooling Block (RSTAB) and propose the SwinAIR, which can effectively extract and fuse the diverse frequency features in infrared images and achieve superior SR reconstruction performance. By further integrating SwinAIR with U-Net, we propose the SwinAIR-GAN for real infrared image SR reconstruction. SwinAIR-GAN extends the degradation space to better simulate the degradation process of real infrared images. Additionally, it incorporates spectral normalization, dropout, and artifact discrimination loss to reduce the potential image artifacts. Qualitative and quantitative evaluations on various datasets confirm the effectiveness of our proposed method in reconstructing realistic textures and details of infrared images.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
GAN-Based Synthetic Data Augmentation for Infrared Small Target Detection

Jun-Hyung Kim,Youngbae Hwang

DOI: https://doi.org/10.1109/tgrs.2022.3179891

IF: 8.2

2022-06-19

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Recently, convolutional neural networks (CNNs) have achieved state-of-the-art performance in infrared small target detection. However, the limited number of public training data restricts the performance improvement of CNN-based methods. To handle the scarcity of training data, we propose a method that can generate synthetic training data for infrared small target detection. We adopt the generative adversarial network framework where synthetic background images and infrared small targets are generated in two independent processes. In the first stage, we synthesize infrared images by transforming visible images into infrared ones. In the second stage, target masks are implanted on the transformed images. Then, the proposed intensity modulation network synthesizes realistic target objects that can be diversely generated from further image processing. Experimental results on the recent public dataset show that, when we train various detection networks using the dataset composed of both real and synthetic images, detection networks yield better performance than using real data only.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Deep GAN-Based Cross-Spectral Cross-Resolution Iris Recognition

Moktari Mostofa,Salman Mohamadi,Jeremy Dawson,Nasser M. Nasrabadi

DOI: https://doi.org/10.1109/tbiom.2021.3102736

2021-10-01

Abstract:In recent years, cross-spectral iris recognition has emerged as a promising biometric approach to establish the identity of individuals. However, matching iris images acquired at different spectral bands (i.e., matching a visible (VIS) iris probe to a gallery of near-infrared (NIR) iris images or vice versa) shows a significant performance degradation when compared to intraband NIR matching. Hence, in this paper, we have investigated a range of deep convolutional generative adversarial network (DCGAN) architectures to further improve the accuracy of cross-spectral iris recognition methods. Moreover, unlike the existing works in the literature, we introduce a resolution difference into the classical cross-spectral matching problem domain. We have developed two different novel techniques using the conditional generative adversarial network (cGAN) as a backbone architecture for cross-spectral iris matching. In the first approach, we simultaneously address the cross-resolution and cross-spectral matching problem by training a cGAN that jointly translates cross-resolution as well as cross-spectral tasks to the same resolution and within the same spectrum. In the second approach, we design a coupled generative adversarial network (cpGAN) architecture consisting of a pair of cGAN modules that project the VIS and NIR iris images into a low-dimensional embedding domain to ensure maximum pairwise similarity between the feature vectors from the two iris modalities of the same subject. To assure the efficacy of our methods, we perform several experiments considering multiple real-life scenarios on three publicly-available cross-spectral iris datasets. Our best experimental results obtained from the cpGAN network outperform the existing benchmark convolutional neural network (CNN) with a supervised discrete hashing (SDH) approach [1] by as much as 1.67%, and 2.22% GAR at FAR of 0.01, while our cGAN provides recognition accuracy with significantly lower EER value of 1.5%, and 1.54% for PolyU bi-spectral dataset, and Cross-eyed-cross-spectral iris recognition database, respectively. It indicates the superiority of our approaches over results previously published in the literature.
Enhancing Upscaled Image Resolution Using Hybrid Generative Adversarial Network-Enabled Frameworks

R. Geetha,G. Belshia Jebamalar,S. Arumai Shiney,Nhu-Ngoc Dao,Hyeonjoon Moon,Sungrae Cho

DOI: https://doi.org/10.1109/access.2024.3367763

IF: 3.9

2024-03-02

IEEE Access

Abstract:Upscaling images typically depends on facial features, such as facial geometry details or references, to rebuild reasonable details. The low-quality input images cannot offer accurate geometric details, and the high-quality details are obscure, limiting performance in practical conditions. This work addresses the problem using an enhanced version of the generative adversarial network (GAN) model that uses rich and varied facial features incorporated into the pretrained StyleGAN2 for face restoration. The generated facial features are integrated into the facial restoration process using spatial feature transform layers to achieve facial details and color quality to improve reliability. In particular, the image background is upsampled using a modified enhanced super-resolution GAN trained in parallel to remove noise while recreating a high-resolution image from low-quality input. The upscale image resolution GAN is used to enlarge the image for a clear view without sacrificing the original image quality. Finally, by combining the upscaled background and restored faces, the hybrid GAN-enabled framework can obtain high-resolution upscaled images. An experimental comparison has been conducted using the Flickr-Faces-HQ Dataset collected from Kaggle. The findings indicate that the suggested framework outperforms existing methods in terms of reconstruction, adversarial, and facial component loss metrics as well as similarity indexes.

computer science, information systems,telecommunications,engineering, electrical & electronic
Design and Implementation of an Infrared Image Generative Model

Changjin Li,Jian Cao,Xing Zhang

DOI: https://doi.org/10.1109/ICAICA50127.2020.9182563

2020-01-01

Abstract:Night vision technology provides an important means for night observation by using infrared radiation of the target as the imaging basis. Recently, artificial neural network (ANN) has become a research hotspot. Realizing the classification and recognition of infrared images by ANN is helpful to the intelligent development of night vision technology, as well as improve the accurate judgment of the surrounding environment by unmanned vehicles at night, and better ensure the safety of people and vehicles. However, the existing infrared image data set contains a small number of images, and the types of scenes and targets presented in the images are single, which cannot support the training of ANN. ANN cannot obtain the classification function of infrared images through full learning. In this paper, an infrared image generative model based on generative adversarial network (GAN) is proposed, which can convert the existing visible light data set into the infrared version of the data set in a short time, and then solve the problem of lack of infrared image data sets. To train ResNet by infrared version data set can realize its classification function for infrared images. The model with the existing image generative model is compared through several evaluation indexes. The results show that the model is more effective in generative infrared images. Inputting ImageNet data set into this model can generate ImageNet infrared version data set. ResNet trained by this data set has a classification and recognition accuracy of 91.28%, which is higher than the experimental results of existing image generative models. The design and implementation of infrared image generative model in this paper promote the application of artificial intelligence and depth learning in night vision technology and other fields.
FEGAN: A Feature-Oriented Enhanced GAN for Enhancing Thermal Image Super-Resolution

Linzhen Zhu,Renjie Wu,Boon-Giin Lee,Lionel Nkenyereye,Wan-Young Chung,Gen Xu

DOI: https://doi.org/10.1109/lsp.2024.3356751

2024-02-10

IEEE Signal Processing Letters

Abstract:Infrared thermal imaging presents significant potential in various domains. However, the widespread development of this technology is hindered by the high cost associated with acquiring high-quality thermal imaging sensors. To overcome this challenge, super-resolution techniques have emerged as a viable solution for extracting valuable information from low-resolution thermal images. While generative adversarial networks (GANs) have been widely adopted for thermal imaging super-resolution, their performance is limited by the inherent lack of detail in low-resolution training images, resulting in reduced fidelity and accuracy in generating high-resolution reconstructions. To tackle this challenge, this letter introduces FEGAN, a novel approach that enhances the performance of GANs by incorporating a feature-oriented enhanced (FE) mechanism within the generative network (GN). The FE plays a pivotal role in extracting high-frequency texture and edge details from low-resolution inputs and reconstructing them into enhanced images. This process substantially improves textures and edges within the training set of thermal images. Furthermore, refinements have been applied to both the GN and the discriminative network (DN) to enhance feature extraction efficiency. The experimental findings unequivocally demonstrate the superior performance of FEGAN compared to state-of-the-art methods. FEGAN achieves impressive performance metrics, including PSNR of 27.18, SSIM of 0.6523, FSIM of 0.5500, and LPIPS of 0.1221, highlighting its remarkable capabilities in the realm of thermal image super-resolution.

engineering, electrical & electronic
Thermal Image Generation for Robust Face Recognition

Vicente Pavez,Gabriel Hermosilla,Francisco Pizarro,Sebastián Fingerhuth,Daniel Yunge

DOI: https://doi.org/10.3390/app12010497

2022-01-05

Applied Sciences

Abstract:This article shows how to create a robust thermal face recognition system based on the FaceNet architecture. We propose a method for generating thermal images to create a thermal face database with six different attributes (frown, glasses, rotation, normal, vocal, and smile) based on various deep learning models. First, we use StyleCLIP, which oversees manipulating the latent space of the input visible image to add the desired attributes to the visible face. Second, we use the GANs N’ Roses (GNR) model, a multimodal image-to-image framework. It uses maps of style and content to generate thermal imaging from visible images, using generative adversarial approaches. Using the proposed generator system, we create a database of synthetic thermal faces composed of more than 100k images corresponding to 3227 individuals. When trained and tested using the synthetic database, the Thermal-FaceNet model obtained a 99.98% accuracy. Furthermore, when tested with a real database, the accuracy was more than 98%, validating the proposed thermal images generator system.
Adaptive Multiple Layer Retinex-Enabled Color Face Enhancement for Deep Learning-Based Recognition

Duong Binh Giap,Tuyen Ngoc Le,Jing-Wein Wang,Chia-Nan Wang

DOI: https://doi.org/10.1109/access.2021.3136093

IF: 3.9

2021-01-01

IEEE Access

Abstract:Face image captured under uncontrolled illumination conditions is one of the most significant challenges for real-world human face recognition systems. To overcome this problem, we proposed a novel method called adaptive multiple-layer retinex-based color face enhancement (AMRF) to enhance the face images. Firstly, we use an associative filter to decompose a color face image into illumination and reflectance components at multiple layers. Then, the illumination components in each layer are adjusted automatically by multiplying with corresponded illumination compensation coefficients calculated through a referenced Gaussian template. The enhanced color face image is finally obtained by composing the compensated illumination components with the integrated reflectance component based on the Retinex theory. The experiment was performed on four popular color face datasets: LFW, IJB-C, CMU Multi-PIE, and CMU-PIE. Our proposed method makes face images more precise, natural, and smooth. The experiment results show that AMRF’s image quality assessment scores are significantly better than the original and other enhanced methods’ images. Furthermore, AMRF considerably improves the recognition accuracy of deep learning-based face recognition models, such as FaceNet, and ArcFace. Finally, our proposed method also saves computational time comparing the other techniques.

computer science, information systems,telecommunications,engineering, electrical & electronic
InfraGAN: A GAN architecture to transfer visible images to infrared domain

Mehmet Akif Özkanoğlu,Sedat Ozer

DOI: https://doi.org/10.1016/j.patrec.2022.01.026

IF: 4.757

2022-03-01

Pattern Recognition Letters

Abstract:Utilizing both visible and infrared (IR) images in various deep learning based computer vision tasks has been a recent trend. Consequently, datasets having both visible and IR image pairs are desired in many applications. However, while large image datasets taken at the visible spectrum can be found in many domains, large IR-based datasets are not easily available in many domains. The lack of IR counterparts of the available visible image datasets limits existing deep algorithms to perform on IR images effectively. In this paper, to overcome with that challenge, we introduce a generative adversarial network (GAN) based solution and generate the IR equivalent of a given visible image by training our deep network to learn the relation between visible and IR modalities. In our proposed GAN architecture (InfraGAN), we introduce using structural similarity as an additional loss function. Furthermore, in our discriminator, we do not only consider the entire image being fake or real but also each pixel being fake or real. We evaluate our comparative results on three different datasets and report the state of the art results over five metrics when compared to Pix2Pix and ThermalGAN architectures from the literature. We report up to +16% better performance in Structural Similarity Index Measure (SSIM) over Pix2Pix and +8% better performance over ThermalGAN for VEDAI dataset. Further gains on different metrics and on different datasets are also reported in our experiments section.

computer science, artificial intelligence

Characterization of microcarrier cultures of neurons and astrocytes from cerebral cortex and cerebellum

Infrared Image Super Resolution Using Gan With Infrared Image Prior

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Infrared image super-resolution reconstruction by using generative adversarial network with an attention mechanism

A deep learning framework for morphologic detail beyond the diffraction limit in infrared spectroscopic imaging

A novel generative adversarial network‐based super‐resolution approach for face recognition

Deep learning-based super-resolution in coherent imaging systems

Super-Resolution Generative Adversarial Network Based on the Dual Dimension Attention Mechanism for Biometric Image Super-Resolution

Infrared Image Super-Resolution via GAN

Enhancement of Infrared Imagery through Low‐Light Image Guidance Leveraging Deep Learning Techniques

Infrared Image Super-Resolution Network Utilizing the Enhanced Transformer and U-Net

GAN-Based Synthetic Data Augmentation for Infrared Small Target Detection

Deep GAN-Based Cross-Spectral Cross-Resolution Iris Recognition

Enhancing Upscaled Image Resolution Using Hybrid Generative Adversarial Network-Enabled Frameworks

Design and Implementation of an Infrared Image Generative Model

FEGAN: A Feature-Oriented Enhanced GAN for Enhancing Thermal Image Super-Resolution

Thermal Image Generation for Robust Face Recognition

Adaptive Multiple Layer Retinex-Enabled Color Face Enhancement for Deep Learning-Based Recognition

InfraGAN: A GAN architecture to transfer visible images to infrared domain