Abstract:Current monocular 3D object detection algorithms generally suffer from inaccurate depth estimation, which leads to reduction of detection accuracy. The depth error from image-to-image generation for the stereo view is insignificant compared with the gap in single-image generation. Therefore, a novel pseudo-monocular 3D object detection framework is proposed, which is called Pseudo-Mono. Particularly, stereo images are brought into monocular 3D detection. Firstly, stereo images are taken as input, then a lightweight depth predictor is used to generate the depth map of input images. Secondly, the left input images obtained from stereo camera are used as subjects, which generate enhanced visual feature and multi-scale depth feature by depth indexing and feature matching probabilities, respectively. Finally, sparse anchors set by the foreground probability maps and the multi-scale feature maps are used as reference points to find the suitable initialization approach of object query. The encoded visual feature is adopted to enhance object query for enabling deep interaction between visual feature and depth feature. Compared with popular monocular 3D object detection methods, Pseudo-Mono is able to achieve richer fine-grained information without additional data input. Extensive experimental results on the datasets of KITTI, NuScenes, and MS-COCO demonstrate the generalizability and portability of the proposed method. The effectiveness and efficiency of Pseudo-Mono have been demonstrated by extensive ablation experiments. Experiments on a real vehicle platform have shown that the proposed method maintains high performance in complex real-world environments.

Depth Calculation and Object Detection Using Stereo Vision with Subpixel Disparity and HOG Feature

Performance evaluation of feature detection and matching in stereo visual odometry.

Object Distance Estimation Based On Stereo Vision And Color Segmentation With Region Matching

Object segmentation using stereo images

Object Detection and Localization Using Stereo Cameras

High-Quality Depth Recovery Via Interactive Multi-view Stereo

Distance Measurement of Objects using Stereo Vision

Stereo visual pedestrian detection based on Stixel-world and feature fusion

Stereo vision based road scene segment and vehicle detection

Object-Centric Stereo Matching for 3D Object Detection

The Head Detection Method Based on Binocular Stereo Vision

A Method for the 3D Reconstruction Based on Edge Detection and Feature Extraction.

Pseudo-Stereo for Monocular 3D Object Detection in Autonomous Driving

Multi-object Detection Based on Binocular Stereo Vision.

Research on Human Head Detection Based on Stereo Vision

Stereo Matching Algorithm Based on 2D Delaunay Triangulation

Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving

Stereo Matching Based on Two Cameras and One 3D Image Sensor.

Object Detection with Depth Information in Road Scenes

Exploiting Simplified Depth Estimation for Stereo-based 2D Object Detection

Pseudo-Mono for Monocular 3D Object Detection in Autonomous Driving