Abstract:Linear block transform coding remains a fundamental component of image and video compression. Although the Discrete Cosine Transform (DCT) is widely employed in all current compression standards, its sub-optimality has sparked ongoing research into discovering more efficient alternative transforms even for fields where it represents a consolidated tool. In this paper, we introduce a novel linear block transform called the Rate Distortion Learned Transform (RDLT), a data-driven transform specifically designed to minimize the rate-distortion (RD) cost when approximating residual blocks. Our approach builds on the latest end-to-end learned compression frameworks, adopting back-propagation and stochastic gradient descent for optimization. However, unlike the nonlinear transforms used in variational autoencoder (VAE)-based methods, the goal is to create a simpler yet optimal linear block transform, ensuring practical integration into existing image and video compression standards. Differently from existing data-driven methods that design transforms based on sample covariance matrices, such as the Karhunen-Loève Transform (KLT), the proposed RDLT is directly optimized from an RD perspective. Experimental results show that this transform significantly outperforms the DCT or other existing data-driven transforms. Additionally, it is shown that when simulating the integration of our RDLT into a VVC-like image compression framework, the proposed transform brings substantial improvements. All the code used in our experiments has been made publicly available at [1].

The Discrete Cosine Transform and Its Impact on Visual Compression: Fifty Years From Its Invention

Discrete Cosine Transform in JPEG Compression

New Transforms Tightly Bounded by DCT and KLT.

In Search of “Better-Than-dct” Unitary Transforms for Encoding of Residual Signals

Graph Transform Optimization with Application to Image Compression

Compression, Restoration, Re-sampling, Compressive Sensing: Fast Transforms in Digital Imaging

Extensions on low-complexity DCT approximations for larger blocklengths based on minimal angle similarity

A novel high performance discrete cosine transform algorithm based on the stochastic computation

Discrete Cosine Transform Coefficients Based Scan Format Conversion

Quantum Discrete Cosine Transform for Image Compression

A Novel Embedded Coding Algorithm Based on the Reconstructed DCT Coefficients.

On Energy Compaction of 2D Saab Image Transforms

Low-complexity Image and Video Coding Based on an Approximate Discrete Tchebichef Transform

Learning Optimal Linear Block Transform by Rate Distortion Minimization

Directional Discrete Cosine Transforms: A Theoretical Analysis

Low-complexity 8-point DCT Approximation Based on Angle Similarity for Image and Video Coding

Hybrid Model-based / Data-driven Graph Transform for Image Coding

Directional Discrete Cosine Transforms—A New Framework for Image Coding

A Study On Quantization Effects Of Dct Based Compression

A Study on the Optimal Attributes of Transform Domain Vector Quantization for Image and Video Compression

Enhanced Multiple Transform for Video Coding