Abstract:Binocular vision target detection algorithms generally require selection of a large number of keypoints, which result in a heavy computational effort for online calculation and the lack of ability to utilize spatial semantic information to full advantage. This paper proposed a stereo priori RCNN based car detection method on point level for autonomous driving. The algorithm combines traditional Region Proposal Network (RPN) with a Mask-branch mechanism, which improves the accuracy of 3D target detection through minimizing luminosity errors, and employs RGB images to provide semantic information for spatial point-clouds. Firstly, the proposed algorithm obtains bounding boxes of left and right images through RPN and classification networks. Then, the prior information of vehicles and branched convolutional neural networks are used to extract wheel features from a feature map. Therefore, the coordinates and orientation of vehicles on bird eye map can be fitted. Afterward, by predicting the keypoints, a 3D bounding box of each vehicle is roughly restored. Then Region of Interest (ROI) is applied on both sides of left and right cameras to minimize the photometric error, so that the precise position and the size of the detection frame are obtained. In the meantime, a Mask-branch mechanism is adopted to achieve a precise semantic segmentation of each ROI. Finally, a 3D bounding box of vehicles is used for point-cloud segmentation, and the semantic information provided by the Mask-branch is exploited to improve the segmentation accuracy. Extensive numerical experiments are conducted on the Kitti dataset and nuScenes dataset to demonstrate the efficiency and effectiveness of the proposed algorithm.

Region of Interest Constrained Negative Obstacle Detection and Tracking With a Stereo Camera

Monocular Vision Based Obstacle Detection for Robot Navigation in Unstructured Environment

Obstacle Detection In Unstructured Environment With A Single Camera And Linear Method

Real-time dynamic obstacle detection and tracking using 3D Lidar

Stereo R-CNN based 3D Object Detection for Autonomous Driving

Real-time Monocular 3D People Localization and Tracking on Embedded System

A Stereovision Method for Obstacle Detection and Tracking in Non-Flat Urban Environments

3D object detection and state estimation method based on stereo vision and LIDAR fusion

Obstacle detection using stereo vision to enhance safety of autonomous machines

Stereo priori RCNN based car detection on point level for autonomous driving

Monocular Visual Object 3D Localization in Road Scenes

Computer vision based obstacle detection and target tracking for autonomous vehicles

On-road multiple obstacles detection using color images and LiDAR point clouds

Fast, Accurate Thin-Structure Obstacle Detection for Autonomous Mobile Robots

Scene-Adaptive Off-Road Detection Using a Monocular Camera

Significant Obstacle Location with Ultra-Wide FOV LWIR Stereo Vision System

A Single Camera Stereo System for Obstacle Detection

Accurate and Robust Object-oriented SLAM with 3D Quadric Landmark Construction in Outdoor Environment

Onboard dynamic-object detection and tracking for autonomous robot navigation with RGB-D camera

Real-time 3D Traffic Cone Detection for Autonomous Driving

Real-time obstacle detection by stereo vision and ultrasonic data fusion