Optical Flow Field Generation Method Based on Video Compression Information
Ziyi Tian,Hongwei Lin,Qicai Jia,Chuang Wang,Kunyu Gao,Haijiao Ren
DOI: https://doi.org/10.1109/iccasit58768.2023.10351510
2023-01-01
Abstract:In computer vision, optical flow is widely used in tasks such as action recognition and video super-resolution. Traditional optical flow calculations need each frames of the original video which restored from video compressed information to calculate the fine motion information between neighboring frames of the video. Reconstruction original video is time-consuming in practical applications. In video compression, motion vector(MV) and residual(RES) are generated. Both MV and optical flow can represent motion information between two frames, but MV are more coarse. Directly using the compression information to generate optical flow can save the time of generating original video in traditional optical flow calculation. Therefore, in order to solve the time-consuming problem in traditional optical flow reconstruction. In this paper, we propose a method to generate the optical flow by directly using the video compression information, the information is first extracted and fused in our network, then using the fused information to generation optical flow. The experimental results show that the proposed method consumes less time and achieves higher accuracy than traditional methods.