Three-Dimensional Scene Capturing For The Virtual Reality Display

Jingsheng Dong,Xinzhu Sang,Nan Guo,Duo Chen,Binbin Yan,Kuiru Wang,Wenhua Dou,Liquan Xiao
DOI: https://doi.org/10.1117/12.2246169
2017-01-01
Abstract:A virtual reality shooting and display system based on multiple degrees of freedom camera is designed and demonstrated. Three-dimensional scene display and the wide angle display can be achieved easily and quickly through the construction with the proposed system. The range of the viewing scene can be broaden with the image stitching process, and the display in the demonstrated system can achieve the effect of wide angle for applications of image mosaic. In the meantime, the system can realize 3D scene display, which can effectively reduce the complexity of the 3D scene generation, and provide a foundation for adding interactive characteristics for the 3D scene in the future. The system includes an adjustable bracket, computer software, and a virtual reality device. Multiple degrees of freedom of the adjustable bracket are developed to obtain 3D scene source images and mosaic source images easily. 5 degrees of freedom are realized, including rotation, lifting, translation, convergence and pitching. To realize the generation and display of three-dimensional scenes, two cameras are adjusted into a parallel state. With the process of image distortion eliminating and calibration, the image is transferred to the virtual reality device for display. In order to realize wide angle display, the cameras are adjusted into "V" type. The preprocessing includes image matching and fusion to realize image stitching. The mosaic image is transferred for virtual reality display with its image reading and display functions. The wide angle 3D scene display is realized by adjusting different states.
What problem does this paper attempt to address?