Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Yang Ou,Yiyi Cai,Youming Sun,Tuanfa Qin

DOI: https://doi.org/10.3390/s24123895

IF: 3.9

2024-06-17

Sensors

Abstract:In the domain of mobile robot navigation, conventional path-planning algorithms typically rely on predefined rules and prior map information, which exhibit significant limitations when confronting unknown, intricate environments. With the rapid evolution of artificial intelligence technology, deep reinforcement learning (DRL) algorithms have demonstrated considerable effectiveness across various application scenarios. In this investigation, we introduce a self-exploration and navigation approach based on a deep reinforcement learning framework, aimed at resolving the navigation challenges of mobile robots in unfamiliar environments. Firstly, we fuse data from the robot's onboard lidar sensors and camera and integrate odometer readings with target coordinates to establish the instantaneous state of the decision environment. Subsequently, a deep neural network processes these composite inputs to generate motion control strategies, which are then integrated into the local planning component of the robot's navigation stack. Finally, we employ an innovative heuristic function capable of synthesizing map information and global objectives to select the optimal local navigation points, thereby guiding the robot progressively toward its global target point. In practical experiments, our methodology demonstrates superior performance compared to similar navigation methods in complex, unknown environments devoid of predefined map information.

engineering, electrical & electronic,instruments & instrumentation,chemistry, analytical

What problem does this paper attempt to address?

### The Problem Addressed by the Paper

This paper primarily addresses the issue of autonomous navigation for mobile robots in unknown and complex environments. Specifically, traditional path planning algorithms rely on predefined rules and map information, which have significant limitations when dealing with unknown and complex environments. By combining sensor data fusion and deep reinforcement learning techniques (particularly the Soft Actor-Critic network), this study proposes a new method for autonomous exploration and navigation.

#### Main Contributions:
1. **Algorithm Based on Soft Actor-Critic (SAC) Network**: Designed and implemented a continuous action output algorithm for a four-wheeled mobile robot, enabling it to navigate to local target points.
2. **Heuristic Evaluation Function**: Proposed a heuristic evaluation function integrated into the four-wheeled mobile robot navigation system to evaluate navigation path points and guide the robot gradually towards the global target point.
3. **Bird's-Eye View (BEV) Mapping and Data-Level Fusion**: Introduced a data fusion method of 2D LiDAR and camera, improving the robot's ability to recognize obstacles of different heights in the environment.

### Summary
This paper aims to solve the problem of efficient autonomous navigation for mobile robots in unknown environments. By integrating multiple sensor data (such as LiDAR and camera) and utilizing deep reinforcement learning techniques, it enhances the robot's navigation capability and robustness in complex environments. This method does not require prior map information and can effectively avoid local optima in unknown environments, achieving efficient navigation from the current position to the global target point.