Abstract:Purpose: This paper presents a deep learning (DL) based method called TextureWGAN. It is designed to preserve image texture while maintaining high pixel fidelity for computed tomography (CT) inverse problems. Over-smoothed images by postprocessing algorithms have been a well-known problem in the medical imaging industry. Therefore, our method tries to solve the over-smoothing problem without compromising pixel fidelity. Approach: The TextureWGAN extends from Wasserstein GAN (WGAN). The WGAN can create an image that looks like a genuine image. This aspect of the WGAN helps preserve image texture. However, an output image from the WGAN is not correlated to the corresponding ground truth image. To solve this problem, we introduce the multitask regularizer (MTR) to the WGAN framework to make a generated image highly correlated to the corresponding ground truth image so that the TextureWGAN can achieve high-level pixel fidelity. The MTR is capable of using multiple objective functions. In this research, we adopt a mean squared error (MSE) loss to maintain pixel fidelity. We also use a perception loss to improve the look and feel of result images. Furthermore, the regularization parameters in the MTR are trained along with generator network weights to maximize the performance of the TextureWGAN generator. Results: The proposed method was evaluated in CT image reconstruction applications in addition to super-resolution and image-denoising applications. We conducted extensive qualitative and quantitative evaluations. We used PSNR and SSIM for pixel fidelity analysis and the first-order and the second-order statistical texture analysis for image texture. The results show that the TextureWGAN is more effective in preserving image texture compared with other well-known methods such as the conventional CNN and nonlocal mean filter (NLM). In addition, we demonstrate that TextureWGAN can achieve competitive pixel fidelity performance compared with CNN and NLM. The CNN with MSE loss can attain high-level pixel fidelity, but it often damages image texture. Conclusions: TextureWGAN can preserve image texture while maintaining pixel fidelity. The MTR is not only helpful to stabilize the TextureWGAN's generator training but also maximizes the generator performance.

A Texture Detail-Oriented Generative Adversarial Network: Motion Deblurring for Multi-Textured Images

MND-GAN: A Research on Image Deblurring Algorithm Based on Generative Adversarial Network

Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection

MBD-GAN: Model-based Image Deblurring with a Generative Adversarial Network.

Texture Compensation with Multi-Scale Dilated Residual Blocks for Image Denoising.

Efficient Generative Model for Motion Deblurring

Research on Image Motion Deblurring Based on Generative Adversarial Networks

Structure-Aware Motion Deblurring Using Multi-Adversarial Optimized CycleGAN

Multi-scale Progressive Blind Face Deblurring

Edge Heuristic GAN for Non-uniform Blind Deblurring

Joint Motion Deblurring and Super-Resolution for Single Image Using Diffusion Model and GAN

TDEGAN: A Texture-Detail-Enhanced Dense Generative Adversarial Network for Remote Sensing Image Super-Resolution

Super-resolution Reconstruction of Image Based on Generative Adversarial Network with Attention Module

Image Text Deblurring Method Based on Generative Adversarial Network

Non-stationary texture synthesis by adversarial expansion

Image Deblurring using GAN

Aggregated Dilated Convolutions for Efficient Motion Deblurring

Perception Driven Texture Generation

TextureWGAN: texture preserving WGAN with multitask regularizer for computed tomography inverse problems

Distinguishing Computer-Generated Images from Photographic Images: a Texture-Aware Deep Learning-Based Method

Fine Detailed Texture Learning for 3D Meshes with Generative Models