Abstract:Stereo cameras are widely used in autonomous vehicles as environmental perception sensors because of their availability and low cost. However, efficiently utilizing the obtained disparity images to generate a desirable local path for the vehicle still remains a challenging problem. In this paper, we present a novel navigation framework for autonomous vehicles equipped with stereo cameras, featuring finishing all of the perception and path planning tasks directly within the disparity space. Comparing with the popular 3-D counterpart, disparity is a projected geometric space that contains more primitive information directly computed from the stereo images. Furthermore, disparity image is a more compact representation for large field of 3-D Cartesian space, which makes perception and path finding in longer distance possible. The proposed framework is composed of three modules, namely, local disparity map building, slope analysis and obstacle detection, and path planning. Two important properties concerning the motion and slope in disparity space are presented for the first time, i.e., the motion model and the slope model in disparity space. With the motion model, the framework first fuses consecutive disparity maps to construct a more reliable and complete local map. Then, a novel slope analysis method called V-Intercept is developed based on the slope model. It can efficiently analyze slopes and obstacles, generating a reasonable cost map directly from the disparity image. Finally, the obstacles in the cost map are expanded properly, and a customized A* search algorithm is performed to find a reasonable path in disparity space. The experimental results show that our framework works well under various kinds of environments. The resulting system can efficiently perceive and plan on a much larger range and react to obstacles further beyond the traditional Cartesian-based method.

Stereo Vision Based Road Free Space Detection

Stereo Visual Odometry from Disparity Space in Dynamic Environments

Integrating Visual and Range Data for Road Detection.

Free Space Detection Using Stereo Confidence Metrics and Obstacle Position Probability Maps

Stixel Based Urban Scene Representation by Stereo Vision

Vision-Based Passenger Flow Estimation Method Based on Regional Disparity Extraction

A Reinforced Road Detection Method in Complicated Environment

Stereo Vision Based SLAM in Outdoor Environments

A Joint 3D-2D based Method for Free Space Detection on Roads

A Stereovision Method for Obstacle Detection and Tracking in Non-Flat Urban Environments

A New Method of Unstructured Road Detection Based on HSV Color Space and Road Features

3D object detection and state estimation method based on stereo vision and LIDAR fusion

Research on vanishing point detection of unstructured road scene combined with stereo vision

Perception in Disparity: an Efficient Navigation Framework for Autonomous Vehicles with Stereo Cameras

Vanishing Point Estimation for Challenging Road Images.

Freespace Optical Flow Modeling for Automated Driving

Region of Interest Constrained Negative Obstacle Detection and Tracking With a Stereo Camera

Vision Based Real Time Obstacle Detection in Unstructured Environment

A Stereo Vision SLAM with Moving Vehicles Tracking in Outdoor Environment

Research on Stereo Vision Based Obstacle Detection Algorithm

Real-time Road Detection with Image Texture Analysis-Based Vanishing Point Estimation