Abstract:With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed. Combined with the real-time processing algorithm of multi detector mosaic panoramic stereo imaging image, a panoramic stereo real-time imaging system is developed. Firstly, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed, and the space coordinate calibration platform of ultra-high precision panoramic camera based on theodolite angle compensation function is constructed. The projection matrix of adjacent cameras is obtained by solving the imaging principle of binocular stereo vision. Then, a real-time registration algorithm of multi-detector mosaic image and Lucas-Kanade optical flow method based on image segmentation are proposed to realize stereo matching and depth information estimation of panoramic imaging, and the estimation results are analyzed effectively. Experimental results show that the stereo matching time of panoramic imaging is 30 ms, the registration accuracy is 0.1 pixel, the edge information of depth map is clearer, and it can meet the imaging requirements of different lighting conditions.

Engineering Method for the Capturing of Depth Map Using Digiclops Stereo Vision System

Real-Time 3D Map-Building Based on Stereo Vision

A Present and Development of Catadioptric Panoramic Stereo Imaging Technique

Design of Panoramic Stereo Imaging with Single Optical System

Human-Computer Interaction System Based on Binocular Stereo Vision

Research progress of depth detection in vision measurement: A novel project of bifocal imaging system for 3D measurement

Stereo Vision and Fourier Transform Profilometry for 3D Measurement

High-Quality Depth Recovery Via Interactive Multi-view Stereo

Hardware Solution of Real-Time Depth Estimation Based on Stereo Vision

Depth Extraction Method Based on Multi-view Stereo Matching

Real-time Depth Extraction and Multi-View Rendering Algorithm Based on Kinect

Panoramic Stereo Imaging Using Hyperboloid Catadioptric Cameras

A Method for the 3D Reconstruction Based on Edge Detection and Feature Extraction.

Depth Measurement by Co-Axial Stereo Vision

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

3d Stereoscopic Image Generation From Monocular View In Structured Environments

Three-dimensional Data-Acquiring System Fusing Active Projection and Stereo Vision

A depth map estimation approach for trinocular stereo

3d Data Acquiring System Fusing Active Projection And Stereo Vision

Research on Monocular Depth Sensing Method Based on Liquid Zoom Imaging

A Self-Calibrated Photo-Geometric Depth Camera