Abstract:Recently, learning-based image compression model has attracted much attention due to its impressive performance and ease of optimization, compared with traditional DCT and wavelet-based image compression standards. Most learning-based image compression models are trained to minimize joint rate-distortion (RD) loss on one single RD trade-off point. However, in many multimedia applications, due to communication constraints, or display adaptation needs for different spatial formats, bit rates or power, it is necessary to provide a variety of image versions for different client devices. To fulfill this requirement, typical end-to-end image compression methods have to compress an image into several bit streams independently by a number of pre-trained networks, which are resource-consuming because of redundancy among these streams. To address this problem, inspired by traditional scalable video coding framework, we propose a learning-based end-to-end quality and spatial scalable image compression (QSSIC) model in multi-layer structure, in which each layer could generate one bitstream corresponding to a specified resolution and image fidelity. This scalability is achieved by exploring the potential of feature-domain representation prediction and reuse. To be specific, firstly, bitstreams of previous layers are used to predict the current layer representations which contains the enhancement information, and then only prediction residuals need to be coded in enhancement layers. Secondly, previous bitstreams are reused in image reconstruction in higher layers to provide basic information. The proposed model could be optimized in an end-to-end manner. Extensive experiments show that our method outperforms state-of-art deep neural networks (DNN)-based auto-encoders in simulcast scenarios. In addition, our method has a better performance than the traditional scalable image compression method scalable extension of H.264/AVC (SVC) and is comparable to scalable extension of H.265/- EVC (SHVC).

Compression Ratio Learning and Semantic Communications for Video Imaging

Increasing Compression Ratio of Low Complexity Compressive Sensing Video Encoder with Application-Aware Configurable Mechanism

Semantic-Aware Image Compression Architecture for Semantic Communication

Learning Image and Video Compression through Spatial-Temporal Energy Compaction

Semantics-to-Signal Scalable Image Compression with Learned Revertible Representations

Collaborative Scalable Visual Compression for Human-Centered Videos.

Learning-Based Video Compression Framework With Implicit Spatial Transform for Applications in the Internet of Things

Key Frames Assisted Hybrid Encoding for High-Quality Compressive Video Sensing

Key frames assisted hybrid encoding for photorealistic compressive video sensing

Reinforcement Learning for Adaptive Video Compressive Sensing

Semantics-Guided and Saliency-Focused Learning of Perceptual Video Compression

Semantic-Aware Visual Decomposition for Image Coding

Compressed learning based onboard semantic compression for remote sensing platforms

Research on Image Compression Technique by Deep Learning Algorithm with Semantic Coding and Decoding

Learned Image Compression for Machine Perception

Learning-Based Scalable Image Compression With Latent-Feature Reuse and Prediction

A Knowledge Base Driven Task-Oriented Image Semantic Communication Scheme

Semantically-Disentangled Progressive Image Compression for Deep Space Communications: Exploring the Ultra-low Rate Regime

A Learning-Based Framework for Low Bit-Rate Image and Video Coding

Image Compression Using Novel View Synthesis Priors

Memory-Efficient Network for Large-scale Video Compressive Sensing