Abstract:Binocular vision target detection algorithms generally require selection of a large number of keypoints, which result in a heavy computational effort for online calculation and the lack of ability to utilize spatial semantic information to full advantage. This paper proposed a stereo priori RCNN based car detection method on point level for autonomous driving. The algorithm combines traditional Region Proposal Network (RPN) with a Mask-branch mechanism, which improves the accuracy of 3D target detection through minimizing luminosity errors, and employs RGB images to provide semantic information for spatial point-clouds. Firstly, the proposed algorithm obtains bounding boxes of left and right images through RPN and classification networks. Then, the prior information of vehicles and branched convolutional neural networks are used to extract wheel features from a feature map. Therefore, the coordinates and orientation of vehicles on bird eye map can be fitted. Afterward, by predicting the keypoints, a 3D bounding box of each vehicle is roughly restored. Then Region of Interest (ROI) is applied on both sides of left and right cameras to minimize the photometric error, so that the precise position and the size of the detection frame are obtained. In the meantime, a Mask-branch mechanism is adopted to achieve a precise semantic segmentation of each ROI. Finally, a 3D bounding box of vehicles is used for point-cloud segmentation, and the semantic information provided by the Mask-branch is exploited to improve the segmentation accuracy. Extensive numerical experiments are conducted on the Kitti dataset and nuScenes dataset to demonstrate the efficiency and effectiveness of the proposed algorithm.

Three-Dimensional Vehicle Detection Algorithm Based on Binocular Vision

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

Stereo R-CNN based 3D Object Detection for Autonomous Driving

Stereo priori RCNN based car detection on point level for autonomous driving

Monocular 3-D Vehicle Detection Using a Cascade Network for Autonomous Driving

Object Detection Based on Binocular Vision with Convolutional Neural Network

Monocular 3D Detection for Autonomous Vehicles by Cascaded Geometric Constraints and Depurated Using 3D Results

Stereo CenterNet-based 3D object detection for autonomous driving

Stereo CenterNet based 3D Object Detection for Autonomous Driving

Stereo RGB and Deeper LIDAR-Based Network for 3D Object Detection in Autonomous Driving.

A 3-D Detection Method of Moving Traffic Loads Based on the Stereo Vision

A multi-task Faster R-CNN method for 3D vehicle detection based on a single image

Inter-Vehicle Distance Estimation Method Based on Monocular Vision Using 3D Detection

Monocular 3D Object Detection for Distant Objects

Stereo RGB and Deeper LIDAR Based Network for 3D Object Detection

An Efficient 3D Object Detection Method Based on Fast Guided Anchor Stereo RCNN

3D object detection and state estimation method based on stereo vision and LIDAR fusion

Vehicle Object Detection Based on RGB-Camera and Radar Sensor Fusion

Image Guidance Based 3D Vehicle Detection in Traffic Scene.

3D Detection and Pose Estimation of Vehicle in Cooperative Vehicle Infrastructure System

An Algorithm on Monocular 3D Object Detection Based on Depth Estimation