ISRnet: Compressed Image Inpainting Based on Generative Adversarial Network
Junjian Huang,Mao Zheng,Zhizhang Li,Xing He,Shiping Wen
DOI: https://doi.org/10.1109/tetci.2024.3446690
2024-01-01
IEEE Transactions on Emerging Topics in Computational Intelligence
Abstract:In recent years, significant advancements have been made in the domain of image restoration, particularly in the context of repairing damaged images and super-resolution reconstruction, primarily owing to the emergence of deep learning techniques. However, during the course of transmission across various media devices, the original image quality may deteriorate due to factors such as the network environment, hardware constraints, and related conditions. Moreover, the restoration process becomes increasingly challenging when the original image quality is low or compromised. Presently, prevailing methods involve repairing the image prior to performing super-resolution reconstruction. However, this methodology typically relies on the utilization of multiple autonomous models, where the efficacy and time efficiency are not optimal. In light of this, we propose a novel neural network model based on GAN, termed ISRnet, designed to repair damaged compressed images. Our method is the first to leverage GAN networks specifically for compressed image restoration. ISRnet integrates the principles of image inpainting and super-resolution reconstruction, enabling the transformation of low-resolution images into high-resolution counterparts during the restoration process, thereby achieving superior restoration outcomes. Despite the partial increase in bias, this approach counteracts the variability inherent in a singularly trained neural network model. Compared to a single neural network model trained on the same dataset, our model demonstrates reduced variance and diminished sensitivity to data, thereby achieving optimal restoration quality and expedited repair speeds for damaged compressed images. Consequently, our proposed methodology presents a promising avenue for the utilization of neural networks in repairing damaged compressed images.