DeepHQ: Learned Hierarchical Quantizer for Progressive Deep Image Coding

Jooyoung Lee,Se Yoon Jeong,Munchurl Kim

2024-08-22

Abstract:Unlike fixed- or variable-rate image coding, progressive image coding (PIC) aims to compress various qualities of images into a single bitstream, increasing the versatility of bitstream utilization and providing high compression efficiency compared to simulcast compression. Research on neural network (NN)-based PIC is in its early stages, mainly focusing on applying varying quantization step sizes to the transformed latent representations in a hierarchical manner. These approaches are designed to compress only the progressively added information as the quality improves, considering that a wider quantization interval for lower-quality compression includes multiple narrower sub-intervals for higher-quality compression. However, the existing methods are based on handcrafted quantization hierarchies, resulting in sub-optimal compression efficiency. In this paper, we propose an NN-based progressive coding method that firstly utilizes learned quantization step sizes via learning for each quantization layer. We also incorporate selective compression with which only the essential representation components are compressed for each quantization layer. We demonstrate that our method achieves significantly higher coding efficiency than the existing approaches with decreased decoding time and reduced model size.

Image and Video Processing,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The paper aims to address the following issues:

1. **Problems with existing methods**: Current Progressive Image Coding (PIC) methods based on neural networks (NN) mainly rely on manually designed quantization hierarchies, leading to suboptimal compression efficiency. Specifically, these methods use fixed quantization interval partitioning at different quantization layers, ignoring the characteristics of the representation components, thereby affecting the Rate-Distortion (R-D) performance.

2. **Proposed new method**: To overcome the above issues, the paper proposes a novel learning quantizer named DeepHQ. This method optimizes the quantization process by learning the quantization step size for each quantization layer and compresses only the necessary representation elements in each quantization layer, thereby further improving compression efficiency.

3. **Performance improvement**: Experimental results show that DeepHQ significantly improves compression efficiency compared to most existing NN-based PIC methods and traditional codecs, with a smaller model size and shorter decoding time. Compared to the current state-of-the-art methods, which use multiple sub-networks, DeepHQ achieves similar coding efficiency with just a single model.

In summary, the main goal of this paper is to improve the performance of NN-based progressive image coding methods by introducing learning-based quantization steps and selective compression techniques.