Abstract:Recent advances of deep neural networks (DNNs) promote low-level vision applications in real-world scenarios, e.g. , image enhancement, dehazing. Nevertheless, DNN-based methods encounter challenges in terms of high computational and memory requirements, especially when deployed on real-world devices with limited resources. Quantization is one of effective compression techniques that significantly reduces computational and memory requirements by employing low-bit parameters and bit-wise operations. However, low-bit quantization for computational imaging ( Q-Imaging ) remains largely unexplored and usually suffer from a significant performance drop compared with the real-valued counterparts. In this work, through empirical analysis, we identify the main factor responsible for such significant performance drop underlies in the large gradient estimation error from non-differentiable weight quantization methods, and the activation information degeneration along with the activation quantization. To address these issues, we introduce a differentiable quantization search (DQS) method to learn the quantized weights and an information boosting module (IBM) for network activation quantization. Our DQS method allows us to treat the discrete weights in a quantized neural network as variables that can be searched. We achieve this end by using a differential approach to accurately search for these weights. In specific, each weight is represented as a probability distribution across a set of discrete values. During training, these probabilities are optimized, and the values with the highest probabilities are chosen to construct the desired quantized network. Moreover, our IBM module can rectify the activation distribution before quantization to maximize the self-information entropy, which retains the maximum information during the quantization process. Extensive experiments across a range of image processing tasks, including enhancement, super-resolution, denoising and dehazing, validate the effectiveness of our Q-Imaging along with superior performances compared to a variety of state-of-the-art quantization methods. In particular, the method in Q-Imaging also achieves a strong generalization performance when composing a detection network for the dark object detection task.

Enhanced Quantified Local Implicit Neural Representation for Image Compression

RQAT-INR: Improved Implicit Neural Image Compression

Breaking the Barriers of One-to-One Usage of Implicit Neural Representation in Image Compression: A Linear Combination Approach with Performance Guarantees

Enhancing Perception Quality in Remote Sensing Image Compression via Invertible Neural Network

Approximately Invertible Neural Network for Learned Image Compression

VQNeRV: Vector Quantization Neural Representation for Video Compression

Neural Image Compression with Quantization Rectifier

Hybrid Implicit Neural Image Compression with Subpixel Context Model and Iterative Pruner

Enhanced Invertible Encoding for Learned Image Compression

Streaming Neural Images

Releasing the Parameter Latency of Neural Representation for High-Efficiency Video Compression

LVQAC: Lattice Vector Quantization Coupled with Spatially Adaptive Companding for Efficient Learned Image Compression

Near-lossless L-infinity Constrained Multi-rate Image Decompression Via Deep Neural Network

Learning Accurate Low-bit Quantization towards Efficient Computational Imaging

Learning Optimal Lattice Vector Quantizers for End-to-end Neural Image Compression

Implicit Neural Image Field for Biological Microscopy Image Compression

Ultra High Fidelity Image Compression with $\ell_\infty$-constrained Encoding and Deep Decoding

An Efficient Implicit Neural Representation Image Codec Based on Mixed Autoregressive Model for Low-Complexity Decoding

Soft then Hard: Rethinking the Quantization in Neural Image Compression

NVRC: Neural Video Representation Compression

Invertible Resampling-Based Layered Image Compression.