Abstract:Image rescaling is a commonly used bidirectional operation, which first downscales high-resolution images to fit various display screens or to be storage- and bandwidth-friendly, and afterward upscales the corresponding low-resolution images to recover the original resolution or the details in the zoom-in images. However, the non-injective downscaling mapping discards high-frequency contents, leading to the ill-posed problem for the inverse restoration task. This can be abstracted as a general image degradation–restoration problem with information loss. In this work, we propose a novel invertible framework to handle this general problem, which models the bidirectional degradation and restoration from a new perspective, i.e. invertible bijective transformation. The invertibility enables the framework to model the information loss of pre-degradation in the form of distribution, which could mitigate the ill-posed problem during post-restoration. To be specific, we develop invertible models to generate valid degraded images and meanwhile transform the distribution of lost contents to the fixed distribution of a latent variable during the forward degradation. Then restoration is made tractable by applying the inverse transformation on the generated degraded image together with a randomly-drawn latent variable. We start from image rescaling and instantiate the model as Invertible Rescaling Network, which can be easily extended to the similar decolorization–colorization task. We further propose to combine the invertible framework with existing degradation methods such as image compression for wider applications. Experimental results demonstrate the significant improvement of our model over existing methods in terms of both quantitative and qualitative evaluations of upscaling and colorizing reconstruction from downscaled and decolorized images, and rate-distortion of image compression. Code is available at https://github.com/pkuxmq/Invertible-Image-Rescaling.

Invertible Image Rescaling

Invertible Rescaling Network and Its Extensions

Invertible Residual Rescaling Models

Scale-arbitrary Invertible Image Downscaling

Self-Asymmetric Invertible Network for Compression-Aware Image Rescaling

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Enhancing Image Rescaling using Dual Latent Variables in Invertible Neural Network

HQ-IRN: Quantizing High-frequency Features for Image Rescaling

Invertible Image Decolorization

Towards Extreme Image Rescaling with Generative Prior and Invertible Prior

Iterative Network for Image Super-Resolution

Raising The Limit Of Image Rescaling Using Auxiliary Encoding

Invertible Image Signal Processing

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Invertible Sharpening Network for MRI Reconstruction Enhancement

Recovering Realistic Details for Magnification-Arbitrary Image Super-Resolution

Hrnet: hamiltonian rescaling network for image downscaling

Invertible ResNets for Inverse Imaging Problems: Competitive Performance with Provable Regularization Properties

One-step Generative Diffusion for Realistic Extreme Image Rescaling

InverseNet: Solving Inverse Problems of Multimedia Data with Splitting Networks.

Enhancing Underwater Images Via Asymmetric Multi-Scale Invertible Networks