Abstract:The effective receptive field (ERF) plays an important role in transform coding, which determines how much redundancy can be removed during transform and how many spatial priors can be utilized to synthesize textures during inverse transform. Existing methods rely on stacks of small kernels, whose ERFs remain insufficiently large, or heavy non-local attention mechanisms, which limit the potential of high-resolution image coding. To tackle this issue, we propose Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compression (LLIC). Specifically, for the first time in the learned image compression community, we introduce a few large kernelbased depth-wise convolutions to reduce more redundancy while maintaining modest complexity. Due to the wide range of image diversity, we further propose a mechanism to augment convolution adaptability through the self-conditioned generation of weights. The large kernels cooperate with non-linear embedding and gate mechanisms for better expressiveness and lighter pointwise interactions. Our investigation extends to refined training methods that unlock the full potential of these large kernels. Moreover, to promote more dynamic inter-channel interactions, we introduce an adaptive channel-wise bit allocation strategy that autonomously generates channel importance factors in a self-conditioned manner. To demonstrate the effectiveness of the proposed transform coding, we align the entropy model to compare with existing transform methods and obtain models LLIC-STF, LLIC-ELIC, and LLIC-TCM. Extensive experiments demonstrate that our proposed LLIC models have significant improvements over the corresponding baselines and reduce the BD-Rate by 9.49%, 9.47%, 10.94% on Kodak over VTM-17.0 Intra, respectively. Our LLIC models achieve state-of-the-art performances and better trade-offs between performance and complexity.

Improved Line-Based Image Coding by Exploiting Long-Distance Correlations

Line-based image coding using adaptive prediction filters

Enhanced line-based intra prediction with fixed interpolation filtering

Hash-Based Line-by-Line Template Matching for Lossless Screen Image Coding

Enhanced intra coding with joint line and pixel prediction

LLIC: Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compression

Intra Prediction Using Multiple Reference Lines for Video Coding

Highly parallel image coding for many cores

Piecewise Linear Model Based Local Illumination Compensation Inter Prediction for Video Coding

High-Efficiency Lossy Image Coding Through Adaptive Neighborhood Information Aggregation

Linear Distance Coding for Image Classification

Position Dependent Linear Intra Prediction for Image Coding

Efficient Multiple-Line-Based Intra Prediction for HEVC.

Highly Parallel Line-Based Image Coding for Many Cores

Enhanced intra prediction and transform for video coding

Joint Local and Nonlocal Progressive Prediction for Versatile Video Coding

An Efficient Coding Framework For Compact Descriptors Extracted From Video Sequence

A Learning-Based Framework for Low Bit-Rate Image and Video Coding

A Universal Optimization Framework for Learning-based Image Codec

Fully Connected Network-Based Intra Prediction for Image Coding.

Adapting Learned Image Codecs to Screen Content via Adjustable Transformations