Abstract:Depth estimation is one of the key technologies in some fields such as autonomous driving and robot navigation. However, the traditional method of using a single sensor is inevitably limited by the performance of the sensor. Therefore, a precision and robust method for fusing the LiDAR and stereo cameras is proposed. This method fully combines the advantages of the LiDAR and stereo camera, which can retain the advantages of the high precision of the LiDAR and the high resolution of images respectively. Compared with the traditional stereo matching method, the texture of the object and lighting conditions have less influence on the algorithm. Firstly, the depth of the LiDAR data is converted to the disparity of the stereo camera. Because the density of the LiDAR data is relatively sparse on the y-axis, the converted disparity map is up-sampled using the interpolation method. Secondly, in order to make full use of the precise disparity map, the disparity map and stereo matching are fused to propagate the accurate disparity. Finally, the disparity map is converted to the depth map. Moreover, the converted disparity map can also increase the speed of the algorithm. We evaluate the proposed pipeline on the KITTI benchmark. The experiment demonstrates that our algorithm has higher accuracy than several classic methods.

A Fused Estimation Method of Depth Based on Depth from Stereo and Depth from Focus

Reliable Fusion of ToF and Stereo Data Based on Joint Depth Filter

A Novel Depth Recovery Approach from Multi-View Stereo Based Focusing

K-nearest Neighborhood Based Integration of Time-of-flight Cameras and Passive Stereo for High-Accuracy Depth Maps.

K-nearestneighborhood Basedintegrationoftime-of-flight Camerasandpassivestereoforhigh-Accuracydepthmaps ∗

High quality depth maps from stereo matching and ToF camera.

High-Quality Depth Recovery Via Interactive Multi-view Stereo

Improveing Depth Estimation Through Fusion of Stereo and TOF

Expanding Sparse LiDAR Depth and Guiding Stereo Matching for Robust Dense Depth Estimation

3D reconstruction from bifocus imaging

Depth Super-resolution by Fusing Depth Imaging and Stereo Vision with Structural Determinant Information Inference

Depth Extraction Method Based on Multi-view Stereo Matching

Matching Cost Fusion in Dense Depth Recovery for Camera-Array Via Global Optimization

Sparse LIDAR Measurement Fusion with Joint Updating Cost for Fast Stereo Matching

Depth Estimation Via Light Field Camera with a Hybrid Stereo Matching Method

Depth-Preserving Stereo Image Retargeting Based on Pixel Fusion

A NEW DEPTH RECOVERY ALGORITHM BASED ON DEFOCUS IMAGE

Depth Fused from Intensity Range and Blur Estimation for Light-Field Cameras

Depth Estimation Based on Adaptive Support Weight and SIFT for Multi-Lenslet Cameras

Robustness of ToF and Stereo Fusion for High-Accuracy Depth Map

Robust and accurate depth estimation by fusing LiDAR and Stereo