Abstract:Image rescaling is a commonly used bidirectional operation, which first downscales high-resolution images to fit various display screens or to be storage- and bandwidth-friendly, and afterward upscales the corresponding low-resolution images to recover the original resolution or the details in the zoom-in images. However, the non-injective downscaling mapping discards high-frequency contents, leading to the ill-posed problem for the inverse restoration task. This can be abstracted as a general image degradation–restoration problem with information loss. In this work, we propose a novel invertible framework to handle this general problem, which models the bidirectional degradation and restoration from a new perspective, i.e. invertible bijective transformation. The invertibility enables the framework to model the information loss of pre-degradation in the form of distribution, which could mitigate the ill-posed problem during post-restoration. To be specific, we develop invertible models to generate valid degraded images and meanwhile transform the distribution of lost contents to the fixed distribution of a latent variable during the forward degradation. Then restoration is made tractable by applying the inverse transformation on the generated degraded image together with a randomly-drawn latent variable. We start from image rescaling and instantiate the model as Invertible Rescaling Network, which can be easily extended to the similar decolorization–colorization task. We further propose to combine the invertible framework with existing degradation methods such as image compression for wider applications. Experimental results demonstrate the significant improvement of our model over existing methods in terms of both quantitative and qualitative evaluations of upscaling and colorizing reconstruction from downscaled and decolorized images, and rate-distortion of image compression. Code is available at https://github.com/pkuxmq/Invertible-Image-Rescaling.

Bidirectional Translation Between UHD-HDR and HD-SDR Videos

Multi-Curve Translator for Real-Time High-Resolution Image-to-Image Translation

Dual Inverse Degradation Network for Real-World SDRTV-to-HDRTV Conversion

A New Journey from SDRTV to HDRTV

Towards Robust SDRTV-to-HDRTV via Dual Inverse Degradation Network

FastHDRNet: A new efficient method for SDR-to-HDR Translation

Towards Efficient SDRTV-to-HDRTV by Learning from Image Formation

Beyond Feature Mapping GAP: Integrating Real HDRTV Priors for Superior SDRTV-to-HDRTV Conversion

Bidirectional Transformer for Video Deblurring

Learning a Practical SDR-to-HDRTV Up-conversion using New Dataset and Degradation Models

EffiHDR: An Efficient Framework for HDRTV Reconstruction and Enhancement in UHD Systems

Video Rescaling Networks with Joint Optimization Strategies for Downscaling and Upscaling

Global priors guided modulation network for joint super-resolution and SDRTV-to-HDRTV

TRRHA: A two-stream re-parameterized refocusing hybrid attention network for synthesized view quality enhancement

Asynchronous Bidirectional Decoding for Neural Machine Translation.

HDR Video Reconstruction with a Large Dynamic Dataset in Raw and sRGB Domains

BT-HRSCD: High-Resolution Feature Is What You Need for a Semantic Change Detection Network With a Triple-Decoding Branch

Invertible Rescaling Network and Its Extensions

A Dual-Network Based Super-Resolution for Compressed High Definition Video.

Video Vectorization via Bipartite Diffusion Curves Propagation and Optimization