Frame Rate Up-Conversion Using Multiresolution Critical Point Filters with Occlusion Refinement
Yi-xiong Zhang,Wei-dong Wang,Peng Liu,Qing-dong Yao
DOI: https://doi.org/10.1631/jzus.a0820200
2008-01-01
Journal of Zhejiang University SCIENCE A
Abstract:In this paper, multiresolution critical-point filters (CPFs) are employed to image matching for frame rate up-conversion (FRUC). By CPF matching, the dense motion field can be obtained for representing object motions accurately. However, the elastic motion model does not hold in the areas of occlusion, thus resulting in blur artifacts in the interpolated frame. To tackle this problem, we propose a new FRUC scheme using an occlusion refined CPF matching interpolation (ORCMI). In the proposed approach, the occlusion refinement is based on a bidirectional CPF mapping. And the intermediate frames are generated by the bidirectional interpolation for non-occlusion pixels combined with unidirectional projection for the occlusion pixels. Experimental results show that ORCMI improves the visual quality of the interpolated frames, especially at the occlusion regions. Compared to the block matching based FRUC algorithm, ORCMI can achieve 1∼2 dB PSNR gain for standard video sequences.