Research on Cylindrical Panoramic Video Stitching and AR Perspective Observation Algorithm

Jie Chen,Xiao Yu
DOI: https://doi.org/10.1109/icvrv.2018.00020
2018-01-01
Abstract:In this paper, a cylindrical panoramic video stitching method based on template frame is proposed to realize 360°panoramic stitching, and based on AR device to realize perspective observation. Firstly, the template frame image is collected. Then the SURF feature points extraction and rough matching of template images are carried out, and then the feature points of mismatching are eliminated by the efficient feature point filtering method. Then, the exact matching feature points are projected on the cylinder, and the transformation matrix between two images is calculated in advance for subsequent video frame image fusion. Finally, image fusion is carried out after the cylinder projection of the subsequent video image. In addition, in order to improve the algorithm speed to meet the real-time requirements, CUDA platform is adopted for GPU parallel processing when implement the image cylinder projection and fusion. Experiments show that, real-time video stitching with 30 frames per second is realized.
What problem does this paper attempt to address?