Abstract:3D scene reconstruction of binocular fisheye obstacle camera for lunar rover is challenging. This paper presents a large field of view (FOV) scene reconstruction method based on fisheye lens. To overcome the problems of the large imaging distortion of large FOV fisheye lens and the existence of information loss when converting to perspective image, we studied the calibration method of spherical model and spherical stereo vision in-depth. Based on unified spherical model, we further propose the generalized unified model and design a complete calibration method, which improves the calibration precision of fisheye wide-angle camera. Large FOV stereo vision method proposed in this paper uses spherical imaging model to describe the stereo camera, and defines the concept of depth reconstruction and the corresponding disparity for spherical model. In order to more effectively carry out the search of corresponding pixels in the spherical curve, spherical model is expanded into latitude and longitude image using conformal projection transformation. Then according to the characteristics of the latitude and longitude image, Semi-Global Matching algorithm is used for solving spherical disparity. Finally, the 3D data of continuous multi frame reconstruction is registered and fused to have a wider range of scene information. The experimental results from simulative lunar surface environment show that, our algorithm can calculate near 180° of the disparity result of the front scene, and recover the 3D information of a wider range of scene compared with the traditional methods. At the same time, the accuracy for the close-up objects which wide FOV lens aim at is fairly high.

Using Vanishing Points to Estimate Parameters of Fisheye Camera

Estimating Radial Distortion for Fish-eye Lens Based on Collinear Constraint

Stereo Camera Motion Estimation Based on Euclidean Reconstruction

Calibration of Fisheye Cameras Based on the Viewing Sphere

Camera lens radial distortion correction using two-view projective invariants.

Linear fitting interpolation based on FOV division for correcting wide angle fish-eye lens distortion

Simultaneous Vanishing Point Detection And Camera Calibration From Single Images

Approximate model of fisheye camera based on the optical refraction

Terrain Reconstruction of Lunar Surface Based on Binocular Fisheye Camera

Optimal Vanishing Point Estimation with Performance Evaluation

Distortion correction of fisheye lenses using a nonparametric imaging model

Orthorectification of Fisheye Image under Equidistant Projection Model

Two distortion correcting methods for fisheye images

Estimation Of Fisheye Camera External Parameter Based On Second-Order Cone Programming

Fisheye lenses calibration using straight-line spherical perspective projection constraint

Efficient and robust camera extrinsic parameters calibration algorithm

Fish-eye image correction method and technique based on geometrical imaging model

Depth Estimation Analysis of Orthogonally Divergent Fisheye Cameras with Distortion Removal

Pixel-variant Local Homography for Fisheye Stereo Rectification Minimizing Resampling Distortion

Extraction of Feature Point Pseudo-Neighborhood for High-Accuracy of Fisheye Image Matching

Neural-Network-Based Model-Free Calibration Method for Stereo Fisheye Camera