Abstract:Stereo cameras are widely used in autonomous vehicles as environmental perception sensors because of their availability and low cost. However, efficiently utilizing the obtained disparity images to generate a desirable local path for the vehicle still remains a challenging problem. In this paper, we present a novel navigation framework for autonomous vehicles equipped with stereo cameras, featuring finishing all of the perception and path planning tasks directly within the disparity space. Comparing with the popular 3-D counterpart, disparity is a projected geometric space that contains more primitive information directly computed from the stereo images. Furthermore, disparity image is a more compact representation for large field of 3-D Cartesian space, which makes perception and path finding in longer distance possible. The proposed framework is composed of three modules, namely, local disparity map building, slope analysis and obstacle detection, and path planning. Two important properties concerning the motion and slope in disparity space are presented for the first time, i.e., the motion model and the slope model in disparity space. With the motion model, the framework first fuses consecutive disparity maps to construct a more reliable and complete local map. Then, a novel slope analysis method called V-Intercept is developed based on the slope model. It can efficiently analyze slopes and obstacles, generating a reasonable cost map directly from the disparity image. Finally, the obstacles in the cost map are expanded properly, and a customized A* search algorithm is performed to find a reasonable path in disparity space. The experimental results show that our framework works well under various kinds of environments. The resulting system can efficiently perceive and plan on a much larger range and react to obstacles further beyond the traditional Cartesian-based method.

Stereovision-based 3D Field Recognition for Automatic Guidance System of Off-Road Vehicle

Stereovision-based Vegetable Row Recognition Algorithm for Agricultural Vehicles

3-D Surround View for Advanced Driver Assistance Systems.

Stereo Vision Based SLAM in Outdoor Environments

A robust stereo feature-aided semi-direct SLAM system

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

Autonomous Guidance of a Corn Harvester using Stereo Vision

A Moment-Based Ridge Detection Approach for Agricultural Robot Using Stereovision

Development of a 3D ego-motion estimation system for an autonomous agricultural vehicle

Toward real-time and accurate dense 3D mapping of crop fields for combine harvesters using a stereo camera

Headland Turning Path Planning for Agricultural Vehicles Based on Panoramic Surround View Images

A Method for the 3D Reconstruction Based on Edge Detection and Feature Extraction.

Perception in Disparity: an Efficient Navigation Framework for Autonomous Vehicles with Stereo Cameras

Accurate and Robust Stereo Direct Visual Odometry for Agricultural Environment

Vision-Based Moving Obstacle Detection and Tracking in Paddy Field Using Improved Yolov3 and Deep SORT

Binocular stereovision omnidirectional motion handling robot

A Stereovision Method for Obstacle Detection and Tracking in Non-Flat Urban Environments

Obstacle detection using stereo vision to enhance safety of autonomous machines

RBF-Based Monocular Vision Navigation for Small Vehicles in Narrow Space below Maize Canopy

Stereo-vision-based crop height estimation for agricultural robots

Online Stereovision Calibration Using On-Road Markings