Abstract:Recently, learned image compression has achieved impressive performance. The entropy model, which estimates the distribution of the latent representation, plays a crucial role in enhancing rate-distortion performance. However, existing global context modules rely on computationally intensive quadratic complexity computations to capture global correlations. This quadratic complexity imposes limitations on the potential of high-resolution image coding. Moreover, effectively capturing local, global, and channel-wise contexts with acceptable even linear complexity within a single entropy model remains a challenge. To address these limitations, we propose the Linear Complexity Multi-Reference Entropy Model (MEM++). MEM++ effectively captures the diverse range of correlations inherent in the latent representation. Specifically, the latent representation is first divided into multiple slices. When compressing a particular slice, the previously compressed slices serve as its channel-wise contexts. To capture local contexts without sacrificing performance, we introduce a novel checkerboard attention module. Additionally, to capture global contexts, we propose the linear complexity attention-based global correlations capturing by leveraging the decomposition of the softmax operation. The attention map of the previously decoded slice is implicitly computed and employed to predict global correlations in the current slice. Based on MEM++, we propose image compression model MLIC++. Extensive experimental evaluations demonstrate that our MLIC++ achieves state-of-the-art performance, reducing BD-rate by 13.39% on the Kodak dataset compared to VTM-17.0 in PSNR. Furthermore, MLIC++ exhibits linear GPU memory consumption with resolution, making it highly suitable for high-resolution image coding. Code and pre-trained models are available at <a class="link-external link-https" href="https://github.com/JiangWeibeta/MLIC" rel="external noopener nofollow">this https URL</a>.

Mixed Entropy Model Enhanced Residual Attention Network for Remote Sensing Image Compression

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Enhanced Remote Sensing Image Compression Method Using Large Network with Sparse Extracting Strategy

Learned Image Compression with Large Capacity and Low Redundancy of Latent Representation

Spatial-Channel Context-Based Entropy Modeling for End-to-end Optimized Image Compression

Content-Adaptive Residual Learning and Context-Aware Entropy Model for SAR Image Compression

Probability Prediction Network With Checkerboard Prior for Lossless Remote Sensing Image Compression

An Extended Context-Based Entropy Hybrid Modeling for Image Compression.

Learned image compression via neighborhood-based attention optimization and context modeling with multi-scale guiding

Remote Sensing Image Compression Based on High-Frequency and Low-Frequency Components

Learning Context-Based Non-local Entropy Modeling for Image Compression

High-Resolution Remote Sensing Image Semantic Segmentation Method Based on Improved Encoder-Decoder Convolutional Neural Network

Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modules

Learning Context-Based Nonlocal Entropy Modeling for Image Compression

MLIC: Multi-Reference Entropy Model for Learned Image Compression

Learned Image Compression with Inception Residual Blocks and Multi-Scale Attention Module.

Efficient and Effective Context-Based Convolutional Entropy Modeling for Image Compression.

Multihead Global Attention and Spatial Spectral Information Fusion for Remote Sensing Image Compression

MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compression

MLIC++: Linear Complexity Attention-based Multi-Reference Entropy Modeling for Learned Image Compression