Abstract:With the development of high-definition display devices, the practical scenario of Super-Resolution (SR) usually needs to super-resolve large input like 2K to higher resolution (4K/8K). To reduce the computational and memory cost, current methods first split the large input into local patches and then merge the SR patches into the output. These methods adaptively allocate a subnet for each patch. Quantization is a very important technique for network acceleration and has been used to design the subnets. Current methods train an MLP bit selector to determine the propoer bit for each layer. However, they uniformly sample subnets for training, making simple subnets overfitted and complicated subnets underfitted. Therefore, the trained bit selector fails to determine the optimal bit. Apart from this, the introduced bit selector brings additional cost to each layer of the SR network. In this paper, we propose a novel method named Content-Aware Bit Mapping (CABM), which can remove the bit selector without any performance loss. CABM also learns a bit selector for each layer during training. After training, we analyze the relation between the edge information of an input patch and the bit of each layer. We observe that the edge information can be an effective metric for the selected bit. Therefore, we design a strategy to build an Edge-to-Bit lookup table that maps the edge score of a patch to the bit of each layer during inference. The bit configuration of SR network can be determined by the lookup tables of all layers. Our strategy can find better bit configuration, resulting in more efficient mixed precision networks. We conduct detailed experiments to demonstrate the generalization ability of our method. The code will be released.

Deep Reconstruction of Least Significant Bits for Bit-Depth Expansion

Lighter but Efficient Bit-Depth Expansion Network

Blind Video Bit-Depth Expansion

Learning Weighting Map for Bit-Depth Expansion Within a Rational Range

LWRN: Light-Weight Residual Network for Edge Detection

From 2D Extrapolation to 1D Interpolation: Content Adaptive Image Bit-Depth Expansion

Diffusion-Based Bit-Depth Expansion

Depth-Aware Blind Image Decomposition for Real-World Adverse Weather Recovery

Multi-channel Residual Network Model for Accurate Estimation of Spatially-Varying and Depth-Dependent Defocus Kernels.

Spatio-temporal progressive optimization network for video bit depth enhancement

Super-resolution Reconstruction of Depth Image Based on Edge-Selected Deep Residual Network.

Deep Bilateral Retinex for Low-Light Image Enhancement

High Bit-Depth Image Acquisition Framework Using Embedded Quantization Bias

CABM: Content-Aware Bit Mapping for Single Image Super-Resolution Network with Large Input

Band Representation-Based Semi-Supervised Low-Light Image Enhancement: Bridging the Gap Between Signal Fidelity and Perceptual Quality

Deep retinex decomposition network for underwater image enhancement

Low-light-level image enhancement algorithm based on integrated networks

BP-DIP: A Backprojection based Deep Image Prior

From Fidelity to Perceptual Quality: A Semi-Supervised Approach for Low-Light Image Enhancement

Image Guided Depth Enhancement Via Deep Fusion And Local Linear Regularization