Abstract:Block-based discrete cosine transform (DCT) has been successfully adopted into several international image/video coding standards, e.g., MPEG-2, H.264/AVC, as it can achieve a good tradeoff between performance and complexity. Although DCT theoretically approximates the optimum Karhunen–Loève transform under first-order Markov conditions, one fixed set of transform basis functions (TBF) cannot handle all the cases efficiently due to the non-stationary nature of video contents. To further improve the performance of block-based transform coding, in this paper, we present the design of rate-distortion optimized transform (RDOT) which contributes to both intraframe and interframe coding. The most important property which makes a difference between RDOT and the conventional DCT is that, in the proposed method, transform is implemented with multiple TBF candidates which are obtained from off-line training. With this feature, for coding each residual block, the encoder is capable to select the optimal set of TBF in terms of rate-distortion performance, and better energy compaction is achieved in the transform domain. To obtain an optimum group of candidate TBF, we have developed a two-step iterative optimization technique for the off-line training, with which the TBF candidates are refined at each iteration until the training process becomes converged. Moreover, analysis on the optimal group of candidate TBF is also presented in this paper, with a detailed description of a practical implementation for the proposed algorithm on the latest VCEG key technical area software platform. Extensive experimental results show that, compared with the conventional DCT-based transform scheme adopted into the state-of-the-art H.264/AVC video coding standard, significant improvement of coding performance has been achieved for both intraframe and interframe coding with our proposed method.

In Search of “Better-Than-dct” Unitary Transforms for Encoding of Residual Signals

New Transforms Tightly Bounded by DCT and KLT.

Effective Inter Transform Method Based on QTBT Structure for Future Video Coding.

Enhanced Multiple Transform for Video Coding

High Efficiency Intra Video Coding Based on Data-Driven Transform

Directional Discrete Cosine Transforms—A New Framework for Image Coding

Extensions on low-complexity DCT approximations for larger blocklengths based on minimal angle similarity

Directional Discrete Cosine Transforms: A Theoretical Analysis

Design of low-complexity, non-separable 2-D transforms based on butterfly structures

Mode-dependent Transforms Based on Elliptical Model for High Efficiency Video Coding.

Internal-video Mode Dependent Directional Transform.

Scene-based KLT for Intra Coding in HEVC

Singular vector decomposition based adaptive transform for motion compensation residuals

The Training of Karhunen–Loève Transform Matrix and Its Application for H.264 Intra Coding

Video Coding with Rate-Distortion Optimized Transform

Adaptive Online Learning of Separable Path Graph Transforms for Intra-prediction

A Comparative Study of Image Correlation Models for Directional Two-Dimensional Sources.

The Discrete Cosine Transform and Its Impact on Visual Compression: Fifty Years From Its Invention

Explainable Machine Learning based Transform Coding for High Efficiency Intra Prediction

Low-complexity 8-point DCT Approximation Based on Angle Similarity for Image and Video Coding

Learning Optimal Linear Block Transform by Rate Distortion Minimization