Abstract:3D scene reconstruction of binocular fisheye obstacle camera for lunar rover is challenging. This paper presents a large field of view (FOV) scene reconstruction method based on fisheye lens. To overcome the problems of the large imaging distortion of large FOV fisheye lens and the existence of information loss when converting to perspective image, we studied the calibration method of spherical model and spherical stereo vision in-depth. Based on unified spherical model, we further propose the generalized unified model and design a complete calibration method, which improves the calibration precision of fisheye wide-angle camera. Large FOV stereo vision method proposed in this paper uses spherical imaging model to describe the stereo camera, and defines the concept of depth reconstruction and the corresponding disparity for spherical model. In order to more effectively carry out the search of corresponding pixels in the spherical curve, spherical model is expanded into latitude and longitude image using conformal projection transformation. Then according to the characteristics of the latitude and longitude image, Semi-Global Matching algorithm is used for solving spherical disparity. Finally, the 3D data of continuous multi frame reconstruction is registered and fused to have a wider range of scene information. The experimental results from simulative lunar surface environment show that, our algorithm can calculate near 180° of the disparity result of the front scene, and recover the 3D information of a wider range of scene compared with the traditional methods. At the same time, the accuracy for the close-up objects which wide FOV lens aim at is fairly high.

Measurable Panorama Construction Based on Binocular Spherical Projective Geometry

A Three Dimensional Measurement Approach and Experiment Based on Spherical Panorama

A 360-Degree Panoramic Stereo Scanning Measurement System Based on a Panoramic Annular Lens and Omnidirectional Ring Structured Light

Design of Panoramic Stereo Imaging with Single Optical System

Stereo Calibration and Rectification for Omnidirectional Multi-Camera Systems

Unwrapping and Stereo Rectification for Omnidirectional Images

A 3D Spherical Panorama Modeling Method Based on Double Projective Geometry

Terrain Reconstruction of Lunar Surface Based on Binocular Fisheye Camera

Multi-Viewpoint Panorama Construction with Wide-Baseline Images

High-speed 360 3D shape measurement based on visual stereo phase unwrapping method

Panoramic Three-Dimensional Optical Digitization System Assisted by a Bi-Mirror.

Design of a single-sensor gazing panoramic stereo imaging system with no central blind area

High-speed 360° 3D shape measurement based on virtual stereo phase unwrapping method

Distance Measurement In Panorama

Omnidirectional 3D Reconstruction Using Stereo Multi-Perspective Panoramas

Panoramic 3d Reconstruction Using Stereo Multi-Perspective Panorama

Panoramic 3D Reconstruction Using Rotational Stereo Camera with Simple Epipolar Constraints

A Method of 3D-Gis Application Aided with Stereo Panorama Technology

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

A Method of Generating Measurable Panoramic Image for Indoor Mobile Measurement System

Distance measurement in panoramic video