Abstract:In the fourth generation Audio Video coding Standard (AVS4), the Inter Prediction Filter (INTERPF) reduces discontinuities between prediction and adjacent reconstructed pixels in inter prediction. The paper proposes a low complexity learning-based inter prediction (LLIP) method to replace the traditional INTERPF. LLIP enhances the filtering process by leveraging a lightweight neural network model, where parameters can be exported for efficient inference. Specifically, we extract pixels and coordinates utilized by the traditional INTERPF to form the training dataset. Subsequently, we export the weights and biases of the trained neural network model and implement the inference process without any third-party dependency, enabling seamless integration into video codec without relying on Libtorch, thus achieving faster inference speed. Ultimately, we replace the traditional handcraft filtering parameters in INTERPF with the learned optimal filtering parameters. This practical solution makes the combination of deep learning encoding tools with traditional video encoding schemes more efficient. Experimental results show that our approach achieves 0.01%, 0.31%, and 0.25% coding gain for the Y, U, and V components under the random access (RA) configuration on average.

Enhanced line-based intra prediction with fixed interpolation filtering

Novel intra prediction via position-dependent filtering

Intra Prediction Using Multiple Reference Lines for Video Coding

Enhanced intra coding with joint line and pixel prediction

Enhanced intra prediction and transform for video coding

Efficient Multiple-Line-Based Intra Prediction for HEVC.

Position Dependent Linear Intra Prediction for Image Coding

Improved Intra Boundary Filters for HEVC

Enhanced intra prediction for inter pictures

A Fast H.264 Intra Prediction Algorithm Using All Zero Block Detection and Texture Feature

Texture and Correlation Based Fast Intra Prediction Algorithm for HEVC

Optimization for HEVC Intra Prediction

Advanced Learning-Based Inter Prediction for Future Video Coding

An Efficient Coding Method For Intra Prediction Mode Information

Fully Connected Network-Based Intra Prediction for Image Coding.

High-Order Intra Prediction for Future Video Coding

Bi-Intra Prediction for Versatile Video Coding

Intra Prediction Using Fully Connected Network for Video Coding

Two-Step Progressive Intra Prediction for Versatile Video Coding

The Intra Prediction Based On Sub Block

A Fast Intra Prediction Method for H.264 Video Coding