Abstract:Recent advances of deep neural networks (DNNs) promote low-level vision applications in real-world scenarios, e.g. , image enhancement, dehazing. Nevertheless, DNN-based methods encounter challenges in terms of high computational and memory requirements, especially when deployed on real-world devices with limited resources. Quantization is one of effective compression techniques that significantly reduces computational and memory requirements by employing low-bit parameters and bit-wise operations. However, low-bit quantization for computational imaging ( Q-Imaging ) remains largely unexplored and usually suffer from a significant performance drop compared with the real-valued counterparts. In this work, through empirical analysis, we identify the main factor responsible for such significant performance drop underlies in the large gradient estimation error from non-differentiable weight quantization methods, and the activation information degeneration along with the activation quantization. To address these issues, we introduce a differentiable quantization search (DQS) method to learn the quantized weights and an information boosting module (IBM) for network activation quantization. Our DQS method allows us to treat the discrete weights in a quantized neural network as variables that can be searched. We achieve this end by using a differential approach to accurately search for these weights. In specific, each weight is represented as a probability distribution across a set of discrete values. During training, these probabilities are optimized, and the values with the highest probabilities are chosen to construct the desired quantized network. Moreover, our IBM module can rectify the activation distribution before quantization to maximize the self-information entropy, which retains the maximum information during the quantization process. Extensive experiments across a range of image processing tasks, including enhancement, super-resolution, denoising and dehazing, validate the effectiveness of our Q-Imaging along with superior performances compared to a variety of state-of-the-art quantization methods. In particular, the method in Q-Imaging also achieves a strong generalization performance when composing a detection network for the dark object detection task.

Image Quality Recovery in Binary Ghost Imaging by Adding Random Noise.

Threshold-optimized Dithering Technique for High-quality 3D Shape Measurement

Detail reconstruction in binary ghost imaging by using point-by-point method

Binarization Threshold Optimization of Ghost Imaging

Genetic Method to Optimize Dithering Technique in Phase Domain for High-quality Binary Fringe Generation

Optimized dithering technique in frequency domain for high-quality three-dimensional depth data acquisition

Computational Ghost Imaging Using a Dynamic Scattering Medium by the Point-by-Point Compensation Method

Compressive sensing ghost imaging based on image gradient

High-quality Image Restoration from Partial Mixed Adaptive-Random Measurements

Quality Adaptive Low-Rank Based JPEG Decoding with Applications

Improving the Image Quality of Ghost Imaging Based on Wiener Filtering

Image quality enhancement in low-light-level ghost imaging using modified compressive sensing method

Effect of the ratio of black speckle on computational ghost imaging

Over Exposed Image Information Recovery Via Stochastic Resonance

Learning Accurate Low-bit Quantization towards Efficient Computational Imaging

Distortion-Controlled Dithering with Reduced Recompression Rate

Model-Based Iterative Restoration for Binary Document Image Compression with Dictionary Learning

Combined optimization ghost imaging based on random speckle field

Suppressing Shot Noise Using Quadratic Variable Step-Size Quantization for the Initial Acquisition of Camera-Raw Image Data

Optimizing Ghost Imaging via Analysis and Design of Speckle Patterns

Noise-Robust One-Bit Diffraction Tomography and Optimal Dose Fractionation