Abstract:Recent advances of deep neural networks (DNNs) promote low-level vision applications in real-world scenarios, e.g. , image enhancement, dehazing. Nevertheless, DNN-based methods encounter challenges in terms of high computational and memory requirements, especially when deployed on real-world devices with limited resources. Quantization is one of effective compression techniques that significantly reduces computational and memory requirements by employing low-bit parameters and bit-wise operations. However, low-bit quantization for computational imaging ( Q-Imaging ) remains largely unexplored and usually suffer from a significant performance drop compared with the real-valued counterparts. In this work, through empirical analysis, we identify the main factor responsible for such significant performance drop underlies in the large gradient estimation error from non-differentiable weight quantization methods, and the activation information degeneration along with the activation quantization. To address these issues, we introduce a differentiable quantization search (DQS) method to learn the quantized weights and an information boosting module (IBM) for network activation quantization. Our DQS method allows us to treat the discrete weights in a quantized neural network as variables that can be searched. We achieve this end by using a differential approach to accurately search for these weights. In specific, each weight is represented as a probability distribution across a set of discrete values. During training, these probabilities are optimized, and the values with the highest probabilities are chosen to construct the desired quantized network. Moreover, our IBM module can rectify the activation distribution before quantization to maximize the self-information entropy, which retains the maximum information during the quantization process. Extensive experiments across a range of image processing tasks, including enhancement, super-resolution, denoising and dehazing, validate the effectiveness of our Q-Imaging along with superior performances compared to a variety of state-of-the-art quantization methods. In particular, the method in Q-Imaging also achieves a strong generalization performance when composing a detection network for the dark object detection task.

Design of High-Resolution Quantization Scheme with Exp-Golomb Code Applied to Compression of Special Images.

Strategy for compression of medical image in real time with bit-plane runlength coding

High-Quality Color Image Compression by Quantization Crossing Color Spaces.

Lossy And Lossless Compression For Color-Quantized Images

Medical Image Compression With Structure-Preserving Adaptive Quantization

Quality Adaptive Low-Rank Based JPEG Decoding with Applications

Super-High-Fidelity Image Compression via Hierarchical-ROI and Adaptive Quantization

Learning Lossless Compression for High Bit-Depth Medical Imaging

Algorithm for satellite remote sensing image compression with adaptive quantization based on global restrictions

Compression of hyper-spectral images based on coded quantization

High-Quality Image Compression Algorithm Design Based on Unsupervised Learning

An Efficient Medical Image Compression Scheme

Rate-distortion Optimized Color Quantization for Compound Image Compression

An optimized JPEG-XT-based algorithm for the lossy and lossless compression of 16-bit depth medical image

A Medical Image Compression Scheme Based on Low Order Linear Predictor and Most-likely Magnitude Huffman Code

Joint Lossless Compression and Encryption for Medical Images

Modelling and Analysis of Hybrid Transformation for Lossless Big Medical Image Compression

A Lossless Compression Method for Multi-Component Medical Images Based on Big Data Mining

Lossy Image Compression with Stochastic Quantization

Learning Accurate Low-bit Quantization towards Efficient Computational Imaging

Low Bit Rate Wavelet-Based Image and Video Compression with Adaptive Quantization, Coding and Postprocessing