Abstract:This is a revised version of the authors' manuscript, which proposes a lightweight VFI network based on multiple lightweight convolutional units and the three‐scale encoding‐decoding structure. The proposed model learns features in an adaptive method to ensure an effective inference of motion information. Moreover, the authors design a lightweight convolutional unit S_RRCU to decrease the model parameters. Video frame interpolation (VFI) is a technique that synthesises intermediate frames between adjacent original video frames to enhance the temporal super‐resolution of the video. However, existing methods usually rely on heavy model architectures with a large number of parameters. The authors introduce an efficient VFI network based on multiple lightweight convolutional units and a Local three‐scale encoding (LTSE) structure. In particular, the authors introduce a LTSE structure with two‐level attention cascades. This design is tailored to enhance the efficient capture of details and contextual information across diverse scales in images. Secondly, the authors introduce recurrent convolutional layers (RCL) and residual operations, designing the recurrent residual convolutional unit to optimise the LTSE structure. Additionally, a lightweight convolutional unit named separable recurrent residual convolutional unit is introduced to reduce the model parameters. Finally, the authors obtain the three‐scale decoding features from the decoder and warp them for a set of three‐scale pre‐warped maps. The authors fuse them into the synthesis network to generate high‐quality interpolated frames. The experimental results indicate that the proposed approach achieves superior performance with fewer model parameters.

Variation Learning Guided Convolutional Network For Image Interpolation

Deep Pyramid Variation Learning for Image Interpolation.

Weighted Encoding Based Image Interpolation With Nonlocal Linear Regression Model

Variational Single Image Interpolation with Time-Varying Regularization

High-quality Image Interpolation Via Local Autoregressive and Nonlocal 3-D Sparse Regularization

Deep Network Interpolation for Continuous Imagery Effect Transition

Image Interpolation Via Graph-Based Bayesian Label Propagation

Interpolation variable rate image compression

Improved CNN-based Learning of Interpolation Filters for Low-Complexity Inter Prediction in Video Coding

Video frame interpolation via spatial multi‐scale modelling

One-for-All: Grouped Variation Network-Based Fractional Interpolation in Video Coding

Image interpolation based on non-local geometric similarities

Image Interpolation Via Regularized Local Linear Regression

Autoregressive Image Interpolation Via Context Modeling and Multiplanar Constraint

A Group Variational Transformation Neural Network for Fractional Interpolation of Video Coding

A Hvs-Guided Approach For Real-Time Image Interpolation

Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation

Video Frame Interpolation via Adaptive Convolution

MSEConv: A Unified Warping Framework for Video Frame Interpolation

Improved autoregressive image model estimation for directional image interpolation

Similarity modulated block estimation for image interpolation