Abstract:3D scene reconstruction of binocular fisheye obstacle camera for lunar rover is challenging. This paper presents a large field of view (FOV) scene reconstruction method based on fisheye lens. To overcome the problems of the large imaging distortion of large FOV fisheye lens and the existence of information loss when converting to perspective image, we studied the calibration method of spherical model and spherical stereo vision in-depth. Based on unified spherical model, we further propose the generalized unified model and design a complete calibration method, which improves the calibration precision of fisheye wide-angle camera. Large FOV stereo vision method proposed in this paper uses spherical imaging model to describe the stereo camera, and defines the concept of depth reconstruction and the corresponding disparity for spherical model. In order to more effectively carry out the search of corresponding pixels in the spherical curve, spherical model is expanded into latitude and longitude image using conformal projection transformation. Then according to the characteristics of the latitude and longitude image, Semi-Global Matching algorithm is used for solving spherical disparity. Finally, the 3D data of continuous multi frame reconstruction is registered and fused to have a wider range of scene information. The experimental results from simulative lunar surface environment show that, our algorithm can calculate near 180° of the disparity result of the front scene, and recover the 3D information of a wider range of scene compared with the traditional methods. At the same time, the accuracy for the close-up objects which wide FOV lens aim at is fairly high.

Model and calibration of underwater stereo vision based on the light field

Underwater Refractive Stereo Vision Measurement and Simulation Imaging Model Based on Optical Path

A dense stereo matching method based on optimized direction-information images for the real underwater measurement environment

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

Analysis of the Influence of Refraction-Parameter Deviation on Underwater Stereo-Vision Measurement with Flat Refraction Interface

An automatic calibration algorithm for endoscopic structured light sensors in cylindrical environment

Stereo Calibration and Rectification for Omnidirectional Multi-Camera Systems

A physical based underwater imaging model and camera calibration method

View-based Underwater SLAM Using a Stereo Camera

Terrain Reconstruction of Lunar Surface Based on Binocular Fisheye Camera

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Binocular Structured Light 3-D Reconstruction System for Low-Light Underwater Environments: Design, Modeling, and Laser-Based Calibration

Underwater stereo image enhancement using a new physical model

Underwater Optical 3-D Reconstruction of Photometric Stereo Considering Light Refraction and Attenuation

A Calibration Tool for Refractive Underwater Vision

Underwater Camera Calibration Based on Double Refraction

An Underwater Structured Light Vision Calibration Method Considering Unknown Refractive Index Based on Aquila Optimizer

A novel monocular calibration method for underwater vision measurement

Underwater Stereo Using Refraction-Free Image Synthesized From Light Field Camera

Light Field-Based Underwater 3D Reconstruction Via Angular Resampling

Development, Calibration, and Image Processing of Underwater Structured Light Vision System: A Survey