Abstract:Video frame interpolation is an important low-level task in the field of image processing, which is widely applied to video image restoration enhancement, media players and display devices. In this work, we design an optical flow module, termed TFA block, for temporal feature alignment based on spatial-temporal modeling for fast and accurate video frame interpolation. It first matches adjacent input frames into spatial location roughly, then uses spatial-temporal modeling to align spatial features with time domain, and finally merges in time domain dimension to obtain optical flow between input continuous frames and objective frame. TFA block does not need complex network structure or relying on the pre-trained optical flow network, but obtain the task-oriented bidirectional intermediate optical flow from output frame to given inputs for backward warping. Compared to the state-of-the-art (SOTA) algorithms, our network achieves demonstrates both excellent performance improvement and fast inference speed

TFA Block: Temporal Feature Alignment Block for Video Frame Interpolation