Abstract:Utilizing LiDAR as a sensor and collecting point cloud data for simultaneous localization and mapping (SLAM) remains the predominant mapping approach, widely applied in various industrial and service scenarios. In laser SLAM, the algorithm estimates the front-end odometer through raw LiDAR data, facilitating the construction of a map environment. Active SLAM is an essential technique in mobile robotics that enables autonomous robot operation, with its primary objective being to autonomously construct a map of an unknown environment without human intervention. Given the absence of human guidance, active SLAM relies on actively perceiving environmental information through LiDAR sensors. After sensing environmental information through LiDAR sensors, active SLAM also needs to implement SLAM, decision-making, and navigation, where the decision-making module typically determines the next goal to facilitate map construction using deep reinforcement learning(DRL). Despite offering greater flexibility than traditional methods, most DRL-based decision-making approaches suffer from low efficiency or slow convergence due to inadequate consideration of action space or sparse rewards. Hence, to address these challenges, we propose employing 2D LiDAR as the environmental perception sensor and introducing a goal decision-making model based on DRL driven by intrinsic reward. Specifically, we consider all cells on the occupancy grid map as potential goals to overcome limitations caused by solely relying on frontiers in previous studies. Additionally, we utilize Shannon entropy reduction within a fixed range centered around each goal as an intrinsic reward mechanism to motivate the robot’s navigation towards areas with higher information entropy. We validate our proposed method across different environments and demonstrate superior performance in terms of achieving higher rewards within shorter distances and time consumption.

Deep-Reinforcement-Learning-Based Autonomous Establishment of Local Positioning Systems in Unknown Indoor Environments

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Asynchronous Localization for Underwater Acoustic Sensor Networks: A Continuous Control Deep Reinforcement Learning Approach

Deep Reinforcement Learning (DRL): Another Perspective for Unsupervised Wireless Localization

Autonomous Navigation of UAVs in Large-Scale Complex Environments: A Deep Reinforcement Learning Approach

Multi-Agent Exploration of an Unknown Sparse Landmark Complex via Deep Reinforcement Learning

Deep Reinforcement Learning for Localizability-Enhanced Navigation in Dynamic Human Environments

A Path Planning Algorithm Based on Deep Reinforcement Learning for Mobile Robots in Unknown Environment

Demonstration of Three-Dimensional Indoor Visible Light Positioning with Multiple Photodiodes and Reinforcement Learning

Goal-Driven Autonomous Exploration Through Deep Reinforcement Learning

Mapless Path Planning of Multi-robot Systems in Complex Environments Via Deep Reinforcement Learning

Learning to Navigate in Indoor Environments: from Memorizing to Reasoning

Goal Decision-making in Active SLAM Using 2D Lidar Based on DRL Driven by Intrinsic Rewards

Laser Based Navigation in Asymmetry and Complex Environment

A UAV Navigation Approach Based on Deep Reinforcement Learning in Large Cluttered 3D Environments

Placement Optimization of Aerial Base Stations with Deep Reinforcement Learning

End-to-End Autonomous Exploration for Mobile Robots in Unknown Environments through Deep Reinforcement Learning

Deep Reinforcement Learning-based Large-scale Robot Exploration

Autonomous Navigation for Cellular-Connected UAV in Highly Dynamic Environments: A Deep Reinforcement Learning Approach

Infrastructure-Free Hierarchical Mobile Robot Global Localization in Repetitive Environments

An Extensible Positioning System For Locating Mobile Robots In Unfamiliar Environments