Abstract:The effective receptive field (ERF) plays an important role in transform coding, which determines how much redundancy can be removed during transform and how many spatial priors can be utilized to synthesize textures during inverse transform. Existing methods rely on stacks of small kernels, whose ERFs remain insufficiently large, or heavy non-local attention mechanisms, which limit the potential of high-resolution image coding. To tackle this issue, we propose Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compression (LLIC). Specifically, for the first time in the learned image compression community, we introduce a few large kernelbased depth-wise convolutions to reduce more redundancy while maintaining modest complexity. Due to the wide range of image diversity, we further propose a mechanism to augment convolution adaptability through the self-conditioned generation of weights. The large kernels cooperate with non-linear embedding and gate mechanisms for better expressiveness and lighter pointwise interactions. Our investigation extends to refined training methods that unlock the full potential of these large kernels. Moreover, to promote more dynamic inter-channel interactions, we introduce an adaptive channel-wise bit allocation strategy that autonomously generates channel importance factors in a self-conditioned manner. To demonstrate the effectiveness of the proposed transform coding, we align the entropy model to compare with existing transform methods and obtain models LLIC-STF, LLIC-ELIC, and LLIC-TCM. Extensive experiments demonstrate that our proposed LLIC models have significant improvements over the corresponding baselines and reduce the BD-Rate by 9.49%, 9.47%, 10.94% on Kodak over VTM-17.0 Intra, respectively. Our LLIC models achieve state-of-the-art performances and better trade-offs between performance and complexity.

Towards real-time practical image compression with lightweight attention

High-Efficiency Lossy Image Coding Through Adaptive Neighborhood Information Aggregation

Analyzing Time Complexity of Practical Learned Image Compression Models

Learned Image Compression with Enhanced Dynamic Spatial Aggregation and Asymmetric Entropy Model

Efficient Lightweight Attention Based Learned Image Compression.

LLIC: Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compression

AsymLLIC: Asymmetric Lightweight Learned Image Compression

MIXLIC: Mixing Global and Local Context Model for learned Image Compression.

Fully Integerized End-to-End Learned Image Compression

NLIC: Non-uniform Quantization Based Learned Image Compression

Learned Image Compression with Mixed Transformer-CNN Architectures

Causal Context Adjustment Loss for Learned Image Compression

Another Way to the Top: Exploit Contextual Clustering in Learned Image Coding

End-to-End Learned Image Compression with Quantized Weights and Activations

Window-based Channel Attention for Wavelet-enhanced Learned Image Compression

Lightweight Image Compression Based on Deep Learning

Q-LIC: Quantizing Learned Image Compression with Channel Splitting

Learned Image Compression With Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modules

Learned Image Compression with Inception Residual Blocks and Multi-Scale Attention Module.