Abstract:Background: Autonomous driving is a growing research area that brings benefits in science, economy, and society. Although there are several studies in this area, currently there is no a fully autonomous vehicle, particularly, for off-road navigation. Autonomous vehicle (AV) navigation is a complex process based on application of multiple technologies and algorithms for data acquisition, management and understanding. Particularly, a self-driving assistance system supports key functionalities such as sensing and terrain perception, real time vehicle mapping and localization, path prediction and actuation, communication and safety measures, among others. Methods: In this work, an original approach for vehicle autonomous driving in off-road environments that combines semantic segmentation of video frames and subsequent real-time route planning is proposed. To check the relevance of the proposal, a modular framework for assistive driving in off-road scenarios oriented to resource-constrained devices has been designed. In the scene perception module, a deep neural network is used to segment Red-Green-Blue (RGB) images obtained from camera. The second traversability module fuses Light Detection And Ranging (LiDAR) point clouds with the results of segmentation to create a binary occupancy grid map to provide scene understanding during autonomous navigation. Finally, the last module, based on the Rapidly-exploring Random Tree (RRT) algorithm, predicts a path. The Freiburg Forest Dataset (FFD) and RELLIS-3D dataset were used to assess the performance of the proposed approach. The theoretical contributions of this article consist of the original approach for image semantic segmentation fitted to off-road driving scenarios, as well as adapting the shortest route searching A* and RRT algorithms to AV path planning. Results: The reported results are very promising and show several advantages compared to previously reported solutions. The segmentation precision achieves 85.9% for FFD and 79.5% for RELLIS-3D including the most frequent semantic classes. While compared to other approaches, the proposed approach is faster regarding computational time for path planning.

A Supervised Learning Model for AGV Perception in Unstructured Environment

From One To Many: Unsupervised Traversable Area Segmentation In Off-Road Environment

ColAG: A Collaborative Air-Ground Framework for Perception-Limited UGVs' Navigation

Self-Adaptive Road Detection Method Based on Vision and Cluster Analysis

A Multimodal Perception-Driven Self Evolving Autonomous Ground Vehicle

Distance-based confidence generation and aggregation of classifier for unstructured road detection

Research on AGV path tracking method based on global vision and reinforcement learning

Learning Visual Navigation System in Simulation for Autonomous Ground Vehicles in Real World

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Navigating Unstructured Space: Deep Action Learning-Based Obstacle Avoidance System for Indoor Automated Guided Vehicles

Effective Free-Driving Region Detection for Mobile Robots by Uncertainty Estimation Using RGB-D Data

Surrogate Evaluation Model for Assessing Lane Detection Reliability of Automated Vehicles in Complex Road Environments

A Multiobjective Reinforcement Learning Approach for AGV Task Clustering

A Machine Learning approach for collision avoidance and path planning of mobile robot under dense and cluttered environments

Deep Reinforcement Learning for Autonomous Ground Vehicle Exploration Without A-Priori Maps

Abnormal Driving Area Detection Using Multiple Vehicle Dynamic Model-Based Filter: Design and Experimental Validation

Real-time path planning for autonomous vehicle off-road driving

Intelligent Decision and Path Planning Algorithm of AGV Vehicle based on Deep Learning

Unstructured road detection using co-learning

Safe Driving Of Autonomous Vehicles Through Improved Deep Reinforcement Learning

Scene terrain classification for autonomous vehicle navigation based on semantic segmentation method