Abstract:With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed. Combined with the real-time processing algorithm of multi detector mosaic panoramic stereo imaging image, a panoramic stereo real-time imaging system is developed. Firstly, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed, and the space coordinate calibration platform of ultra-high precision panoramic camera based on theodolite angle compensation function is constructed. The projection matrix of adjacent cameras is obtained by solving the imaging principle of binocular stereo vision. Then, a real-time registration algorithm of multi-detector mosaic image and Lucas-Kanade optical flow method based on image segmentation are proposed to realize stereo matching and depth information estimation of panoramic imaging, and the estimation results are analyzed effectively. Experimental results show that the stereo matching time of panoramic imaging is 30 ms, the registration accuracy is 0.1 pixel, the edge information of depth map is clearer, and it can meet the imaging requirements of different lighting conditions.

Research of real-time wide field image merging based on multi-cameras

Multi-image-distance Imaging System for Extending Depth-of-field

Texture Aware Learning-based Image Fusion Method for Fixed Focal-length Cameras

Joint Focusing Method Based on Optimal Image-Distance Interval for Multi-Image-distance Imaging System

Stitching Video from Webcams

Multi-face Real-Time Tracking Based on Dual Panoramic Camera for Full-Parallax Light-Field Display

Omnidirectional Dense SLAM for Back-to-back Fisheye Cameras

Multi-Camera System: Imaging Enhancement and Application

Real-time and ultrahigh accuracy image synthesis algorithm for full field of view imaging system

K-nearest Neighborhood Based Integration of Time-of-flight Cameras and Passive Stereo for High-Accuracy Depth Maps.

Multi-Viewpoint Panorama Construction with Wide-Baseline Images

Two-Stage Multi-Camera Constrain Mapping Pipeline for Large-Scale 3D Reconstruction

Real-Time 3d Image Fusion Based on Wavelet Transform in Microscope Auto-Focusing System

Real Time Aerial Video Stitching Via Sensor Refinement And Priority Scan

Multi-camera Panoramic Stitching with Real-time Chromatic Aberration Correction

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

Simultaneous Synchronization and Calibration for Wide-baseline Stereo Event Cameras

A Real-time Image Capture and Processing System for a Wide-area Aerial Camera

Panoramic Stereo Imaging Using Hyperboloid Catadioptric Cameras

A Flexible Multi-view Multi-modal Imaging System for Outdoor Scenes

An Aerial Composite Imaging Method with Multiple Upright Cameras Based on Axis-Shift Theory