Passivity analysis for switched generalized neural networks with time-varying delay and uncertain output

Manfeng Hu,Jinde Cao,Yongqing Yang,Aihua Hu

DOI: https://doi.org/10.1093/imamci/dns031

2013-09-01

IMA Journal of Mathematical Control and Information

Abstract:

What problem does this paper attempt to address?

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Wenzhou Chen,Shizheng Zhou,Zaisheng Pan,Huixian Zheng,Yong Liu

DOI: https://doi.org/10.3390/app9204198

2019-01-01

Applied Sciences

Abstract:Compared with the single robot system, a multi-robot system has higher efficiency and fault tolerance. The multi-robot system has great potential in some application scenarios, such as the robot search, rescue and escort tasks, and so on. Deep reinforcement learning provides a potential framework for multi-robot formation and collaborative navigation. This paper mainly studies the collaborative formation and navigation of multi-robots by using the deep reinforcement learning algorithm. The proposed method improves the classical Deep Deterministic Policy Gradient (DDPG) to address the single robot mapless navigation task. We also extend the single-robot Deep Deterministic Policy Gradient algorithm to the multi-robot system, and obtain the Parallel Deep Deterministic Policy Gradient (PDDPG). By utilizing the 2D lidar sensor, the group of robots can accomplish the formation construction task and the collaborative formation navigation task. The experiment results in a Gazebo simulation platform illustrates that our method is capable of guiding mobile robots to construct the formation and keep the formation during group navigation, directly through raw lidar data inputs.
Efficient Autonomous Exploration of Unknown Environment Using Regions Segmentation and VRP

Chaoyu Xue,Tianhao Zhao,Anhuan Xie,Qiuguo Zhu,Jun Wu,Rong Xiong

DOI: https://doi.org/10.1007/978-981-99-6498-7_40

2023-01-01

Abstract:Autonomous exploration of unknown environments is a critical application scenario in robotics. However, existing studies have strived to generate an efficient tour plan that enables the robots to fully explore the environment. This is due to the greedy strategies and the lack of utilizing the information of the unexplored area. To address the above issues, we propose a new exploration strategy. Our approach involves partitioning the unexplored area into distinct regions and utilizing their estimated workload and spatial structure to construct a region graph. Subsequently, a VRP (Vehicle Routing Problem) planner allocates regions to robots and generates a global tour for each robot in a coordinated manner, which is then refined and provided to the robot’s navigation module. Experimental results demonstrate that that our method outperforms existing approaches in terms of exploration speed, total distance, and overlap ratio.
An Enhanced Hierarchical Planning Framework for Multi-Robot Autonomous Exploration

Gengyuan Cai,Luosong Guo,Xiangmao Chang

2024-10-25

Abstract:The autonomous exploration of environments by multi-robot systems is a critical task with broad applications in rescue missions, exploration endeavors, and beyond. Current approaches often rely on either greedy frontier selection or end-to-end deep reinforcement learning (DRL) methods, yet these methods are frequently hampered by limitations such as short-sightedness, overlooking long-term implications, and convergence difficulties stemming from the intricate high-dimensional learning space. To address these challenges, this paper introduces an innovative integration strategy that combines the low-dimensional action space efficiency of frontier-based methods with the far-sightedness and optimality of DRL-based approaches. We propose a three-tiered planning framework that first identifies frontiers in free space, creating a sparse map representation that lightens data transmission burdens and reduces the DRL action space's dimensionality. Subsequently, we develop a multi-graph neural network (mGNN) that incorporates states of potential targets and robots, leveraging policy-based reinforcement learning to compute affinities, thereby superseding traditional heuristic utility values. Lastly, we implement local routing planning through subsequence search, which avoids exhaustive sequence traversal. Extensive validation across diverse scenarios and comprehensive simulation results demonstrate the effectiveness of our proposed method. Compared to baseline approaches, our framework achieves environmental exploration with fewer time steps and a notable reduction of over 30% in data transmission, showcasing its superiority in terms of efficiency and performance.

Robotics
Asymmetric Information Enhanced Mapping Framework for Multirobot Exploration based on Deep Reinforcement Learning

Jiyu Cheng,Junhui Fan,Xiaolei Li,Paul L. Rosin,Yibin Li,Wei Zhang

2024-11-15

Abstract:Despite the great development of multirobot technologies, efficiently and collaboratively exploring an unknown environment is still a big challenge. In this paper, we propose AIM-Mapping, a Asymmetric InforMation Enhanced Mapping framework. The framework fully utilizes the privilege information in the training process to help construct the environment representation as well as the supervised signal in an asymmetric actor-critic training framework. Specifically, privilege information is used to evaluate the exploration performance through an asymmetric feature representation module and a mutual information evaluation module. The decision-making network uses the trained feature encoder to extract structure information from the environment and combines it with a topological map constructed based on geometric distance. Utilizing this kind of topological map representation, we employ topological graph matching to assign corresponding boundary points to each robot as long-term goal points. We conduct experiments in real-world-like scenarios using the Gibson simulation environments. It validates that the proposed method, when compared to existing methods, achieves great performance improvement.

Multiagent Systems
An improved frontier-based robot exploration strategy combined with deep reinforcement learning

Rui Wang,Jie Zhang,Ming Lyu,Cheng Yan,Yaowei Chen

DOI: https://doi.org/10.1016/j.robot.2024.104783

IF: 3.7

2024-08-19

Robotics and Autonomous Systems

Abstract:The map of the environment is the basis for autonomous robot navigation. This paper introduces an improved approach to frontier-based exploration by utilizing deep reinforcement learning to select target points. This study proposes a novel approach for map sampling and developing a corresponding neural network architecture. Our method aims to adapt effectively to unfamiliar environments with varying dimensions and diverse action spaces while reducing the loss of information caused by map sampling. We train and validate the neural network in a simulation environment. The results show that our proposed method can stably explore unknown environments of different sizes, while the distance traveled to complete the exploration is shorter than other methods. In addition, we conducted experiments on a real robot, and the results show that our method can be easily transferred from the simulation environment to the real environment.

robotics,automation & control systems,computer science, artificial intelligence
Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

Wang Qisheng,Wang Qichao,Li Xiao

DOI: https://doi.org/10.1609/aaai.v34i10.7247

2020-04-03

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Exploration efficiency challenges for multi-agent reinforcement learning (MARL), as the policy learned by confederate MARL depends on the interaction among agents. Less informative reward also restricts the learning speed of MARL in comparison with the informative label in supervised learning. This paper proposes a novel communication method which helps agents focus on different exploration subarea to guide MARL to accelerate exploration. We propose a predictive network to forecast the reward of current state-action pair and use the guidance learned by the predictive network to modify the reward function. An improved prioritized experience replay is employed to help agents better take advantage of the different knowledge learned by different agents. Experimental results demonstrate that the proposed algorithm outperforms existing methods in cooperative multi-agent environments.
Deep Reinforcement Learning-based Large-scale Robot Exploration

Yuhong Cao,Rui Zhao,Yizhuo Wang,Bairan Xiang,Guillaume Sartoretti

2024-03-16

Abstract:In this work, we propose a deep reinforcement learning (DRL) based reactive planner to solve large-scale Lidar-based autonomous robot exploration problems in 2D action space. Our DRL-based planner allows the agent to reactively plan its exploration path by making implicit predictions about unknown areas, based on a learned estimation of the underlying transition model of the environment. To this end, our approach relies on learned attention mechanisms for their powerful ability to capture long-term dependencies at different spatial scales to reason about the robot's entire belief over known areas. Our approach relies on ground truth information (i.e., privileged learning) to guide the environment estimation during training, as well as on a graph rarefaction algorithm, which allows models trained in small-scale environments to scale to large-scale ones. Simulation results show that our model exhibits better exploration efficiency (12% in path length, 6% in makespan) and lower planning time (60%) than the state-of-the-art planners in a 130m x 100m benchmark scenario. We also validate our learned model on hardware.

Robotics
Active Neural Topological Mapping for Multi-Agent Exploration

Xinyi Yang,Yuxiang Yang,Chao Yu,Jiayu Chen,Jingchen Yu,Haibing Ren,Huazhong Yang,Yu Wang

2023-11-01

Abstract:This paper investigates the multi-agent cooperative exploration problem, which requires multiple agents to explore an unseen environment via sensory signals in a limited time. A popular approach to exploration tasks is to combine active mapping with planning. Metric maps capture the details of the spatial representation, but are with high communication traffic and may vary significantly between scenarios, resulting in inferior generalization. Topological maps are a promising alternative as they consist only of nodes and edges with abstract but essential information and are less influenced by the scene structures. However, most existing topology-based exploration tasks utilize classical methods for planning, which are time-consuming and sub-optimal due to their handcrafted design. Deep reinforcement learning (DRL) has shown great potential for learning (near) optimal policies through fast end-to-end inference. In this paper, we propose Multi-Agent Neural Topological Mapping (MANTM) to improve exploration efficiency and generalization for multi-agent exploration tasks. MANTM mainly comprises a Topological Mapper and a novel RL-based Hierarchical Topological Planner (HTP). The Topological Mapper employs a visual encoder and distance-based heuristics to construct a graph containing main nodes and their corresponding ghost nodes. The HTP leverages graph neural networks to capture correlations between agents and graph nodes in a coarse-to-fine manner for effective global goal selection. Extensive experiments conducted in a physically-realistic simulator, Habitat, demonstrate that MANTM reduces the steps by at least 26.40% over planning-based baselines and by at least 7.63% over RL-based competitors in unseen scenarios.

Robotics,Machine Learning,Multiagent Systems
Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

Qian Haofu,Zhang Haoyang,Shao Jun,Zhang Jiatao,Gu Jason,Song Wei,Zhu Shiqiang

DOI: https://doi.org/10.1109/icra57147.2024.10611076

2024-01-01

Abstract:Multi-task learning has expanded the boundaries of robotic manipulation, enabling the execution of increasingly complex tasks. However, policies learned through reinforcement learning frequently exhibit limited generalization and narrow distributions, which restrict their effectiveness in multi-task training. Addressing the challenge of obtaining policies with generalization and stability represents a non-trivial problem. To tackle this issue, we propose a planning-guided reinforcement learning method. It leverages a task-evoked planner(TEP) and a reinforcement learning approach with planner's guidance. TEP utilizes reusable samples as the source, with the aim of learning reachability information across different task scenarios. Then in reinforcement learning, TEP assesses and guides the Actor towards better outputs and smoothly enhances the performance in multi-task benchmarks. We evaluate this approach within the Meta-World framework and compare it with other typical multi-task algorithms in terms of learning efficiency and effectiveness. Depending on experimental results, our method has more efficiency, higher success rates, and demonstrates more realistic behavior.
A new method of multi-robot cooperative exploration

Yanqing Wang,Yongquan Li,Wenjun Lu

DOI: https://doi.org/10.1504/IJMIC.2022.127104

2022-11-24

International Journal of Modelling, Identification and Control

Abstract:This paper aims at the task of the map fusion and environmental exploration method. The multi-robot collaborative map creation is based on the local map by each individual robot, and the nodes in the local map are matched to obtain the association between multiple maps. Multi-robot task allocation is also a process of maximising the benefits of resource utilisation. How to allocate resources reasonably so that each robot can quickly complete the corresponding tasks in coordination, and how to solve the problem of the heavy tasks for individual robots or few tasks for individual robots, multitask allocation based on market law can be a solution. The new topological scene map in this paper is used to represent the environment and carry out robot exploration. It can be seen that multi-robot cooperative exploration is more efficient efficiency.
Control Transformer: Robot Navigation in Unknown Environments through PRM-Guided Return-Conditioned Sequence Modeling

Daniel Lawson,Ahmed H. Qureshi

DOI: https://doi.org/10.48550/arXiv.2211.06407

2023-07-13

Abstract:Learning long-horizon tasks such as navigation has presented difficult challenges for successfully applying reinforcement learning to robotics. From another perspective, under known environments, sampling-based planning can robustly find collision-free paths in environments without learning. In this work, we propose Control Transformer that models return-conditioned sequences from low-level policies guided by a sampling-based Probabilistic Roadmap (PRM) planner. We demonstrate that our framework can solve long-horizon navigation tasks using only local information. We evaluate our approach on partially-observed maze navigation with MuJoCo robots, including Ant, Point, and Humanoid. We show that Control Transformer can successfully navigate through mazes and transfer to unknown environments. Additionally, we apply our method to a differential drive robot (Turtlebot3) and show zero-shot sim2real transfer under noisy observations.

Robotics,Artificial Intelligence,Machine Learning
Learning Efficient Multi-Agent Cooperative Visual Exploration

Chao Yu,Xinyi Yang,Jiaxuan Gao,Huazhong Yang,Yu Wang,Yi Wu

DOI: https://doi.org/10.48550/arXiv.2110.05734

2021-10-12

Computer Vision and Pattern Recognition

Abstract:We tackle the problem of cooperative visual exploration where multiple agents need to jointly explore unseen regions as fast as possible based on visual signals. Classical planning-based methods often suffer from expensive computation overhead at each step and a limited expressiveness of complex cooperation strategy. By contrast, reinforcement learning (RL) has recently become a popular paradigm for tackling this challenge due to its modeling capability of arbitrarily complex strategies and minimal inference overhead. In this paper, we extend the state-of-the-art single-agent visual navigation method, Active Neural SLAM (ANS), to the multi-agent setting by introducing a novel RL-based planning module, Multi-agent Spatial Planner (MSP).MSP leverages a transformer-based architecture, Spatial-TeamFormer, which effectively captures spatial relations and intra-agent interactions via hierarchical spatial self-attentions. In addition, we also implement a few multi-agent enhancements to process local information from each agent for an aligned spatial representation and more precise planning. Finally, we perform policy distillation to extract a meta policy to significantly improve the generalization capability of final policy. We call this overall solution, Multi-Agent Active Neural SLAM (MAANS). MAANS substantially outperforms classical planning-based baselines for the first time in a photo-realistic 3D simulator, Habitat. Code and videos can be found at https://sites.google.com/view/maans.
Exploration in Deep Reinforcement Learning: From Single-Agent to Multiagent Domain

Jianye Hao,Tianpei Yang,Hongyao Tang,Chenjia Bai,Jinyi Liu,Zhaopeng Meng,Peng Liu,Zhen Wang

DOI: https://doi.org/10.1109/tnnls.2023.3236361

IF: 14.255

2023-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Deep reinforcement learning (DRL) and deep multiagent reinforcement learning (MARL) have achieved significant success across a wide range of domains, including game artificial intelligence (AI), autonomous vehicles, and robotics. However, DRL and deep MARL agents are widely known to be sample inefficient that millions of interactions are usually needed even for relatively simple problem settings, thus preventing the wide application and deployment in real-industry scenarios. One bottleneck challenge behind is the well-known exploration problem, i.e., how efficiently exploring the environment and collecting informative experiences that could benefit policy learning toward the optimal ones. This problem becomes more challenging in complex environments with sparse rewards, noisy distractions, long horizons, and nonstationary co-learners. In this article, we conduct a comprehensive survey on existing exploration methods for both single-agent RL and multiagent RL. We start the survey by identifying several key challenges to efficient exploration. Then, we provide a systematic survey of existing approaches by classifying them into two major categories: uncertainty-oriented exploration and intrinsic motivation-oriented exploration. Beyond the above two main branches, we also include other notable exploration methods with different ideas and techniques. In addition to algorithmic analysis, we provide a comprehensive and unified empirical comparison of different exploration methods for DRL on a set of commonly used benchmarks. According to our algorithmic and empirical investigation, we finally summarize the open problems of exploration in DRL and deep MARL and point out a few future directions.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
DTPPO: Dual-Transformer Encoder-based Proximal Policy Optimization for Multi-UAV Navigation in Unseen Complex Environments

Anning Wei,Jintao Liang,Kaiyuan Lin,Ziyue Li,Rui Zhao

2024-10-20

Abstract:Existing multi-agent deep reinforcement learning (MADRL) methods for multi-UAV navigation face challenges in generalization, particularly when applied to unseen complex environments. To address these limitations, we propose a Dual-Transformer Encoder-based Proximal Policy Optimization (DTPPO) method. DTPPO enhances multi-UAV collaboration through a Spatial Transformer, which models inter-agent dynamics, and a Temporal Transformer, which captures temporal dependencies to improve generalization across diverse environments. This architecture allows UAVs to navigate new, unseen environments without retraining. Extensive simulations demonstrate that DTPPO outperforms current MADRL methods in terms of transferability, obstacle avoidance, and navigation efficiency across environments with varying obstacle densities. The results confirm DTPPO's effectiveness as a robust solution for multi-UAV navigation in both known and unseen scenarios.

Multiagent Systems
Multi-Robot Environmental Coverage With a Two-Stage Coordination Strategy via Deep Reinforcement Learning

Lina Zhu,Jiyu Cheng,Hao Zhang,Wei Zhang,Yuehu Liu

DOI: https://doi.org/10.1109/tits.2023.3333409

IF: 8.5

2024-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Multi-robot environmental coverage can be widely used in many applications like search and rescue. However, it is challenging to coordinate the robot team for high coverage efficiency. In this paper, we propose a Two-Stage Coordination (TSC) strategy, which consists of a high-level leader module and a low-level action executor. The former provides the robots with the topology and geometry of the environment, which are crucial for robots to learn “where” they should go and avoid invalid coverage. Based on the observed information and the environmental topology, the latter module takes primitive action to reach the sub-goal. To facilitate cooperation among the robots, we aggregate local perception information of neighbors from different hops based on graph neural networks. We compare our method with state-of-the-art multi-robot coverage approaches. Experiments and supporting ablation studies show the superior efficiency, scalability, and generalization of our algorithm especially in unseen style and scale of scenes, and an unseen number of robots.

engineering, electrical & electronic,transportation science & technology, civil
Robot Exploration Based on Small Areas Priority Strategy

Chao Wei,Meng Xu,Jikai Wang,Zonghai Chen

DOI: https://doi.org/10.1145/3529763.3529765

2022-01-01

Abstract:We present a method for robot exploration in complex three-dimensional environments. We prove that when facing multiple path branches, it is a necessary condition for optimal robot exploration to explore the branches connecting independent areas first, so we propose a local exploration strategy based on small areas priority. In order to realize this strategy, our method models lidar points and builds a prediction map covering more spatial information obtained by the sensor at the expense of accuracy. This method evaluates the potential explorable area of the unexplored space through ray-casting and the path tree, and decides which of the explorable path branches is the optimal choice in the local range. The method is compared to existing state-of-the-art methods in two corridor simulation scenes and three simulation scenes replicated from the real world. Experiment comparisons show that our method is more efficient in exploring space and closer to the global optimal trajectory.
Distributed multi-robot potential-field-based exploration with submap-based mapping and noise-augmented strategy

Khattiya Pongsirijinda,Zhiqiang Cao,Kaushik Bhowmik,Muhammad Shalihan,Billy Pik Lik Lau,Ran Liu,Chau Yuen,U-Xuan Tan

DOI: https://doi.org/10.1016/j.robot.2024.104752

2024-07-10

Abstract:Multi-robot collaboration has become a needed component in unknown environment exploration due to its ability to accomplish various challenging situations. Potential-field-based methods are widely used for autonomous exploration because of their high efficiency and low travel cost. However, exploration speed and collaboration ability are still challenging topics. Therefore, we propose a Distributed Multi-Robot Potential-Field-Based Exploration (DMPF-Explore). In particular, we first present a Distributed Submap-Based Multi-Robot Collaborative Mapping Method (DSMC-Map), which can efficiently estimate the robot trajectories and construct the global map by merging the local maps from each robot. Second, we introduce a Potential-Field-Based Exploration Strategy Augmented with Modified Wave-Front Distance and Colored Noises (MWF-CN), in which the accessible frontier neighborhood is extended, and the colored noise provokes the enhancement of exploration performance. The proposed exploration method is deployed for simulation and real-world scenarios. The results show that our approach outperforms the existing ones regarding exploration speed and collaboration ability.

Robotics
Autonomous and Adaptive Role Selection for Multi-robot Collaborative Area Search Based on Deep Reinforcement Learning

Lina Zhu,Jiyu Cheng,Hao Zhang,Zhichao Cui,Wei Zhang,Yuehu Liu

2023-12-04

Abstract:In the tasks of multi-robot collaborative area search, we propose the unified approach for simultaneous mapping for sensing more targets (exploration) while searching and locating the targets (coverage). Specifically, we implement a hierarchical multi-agent reinforcement learning algorithm to decouple task planning from task execution. The role concept is integrated into the upper-level task planning for role selection, which enables robots to learn the role based on the state status from the upper-view. Besides, an intelligent role switching mechanism enables the role selection module to function between two timesteps, promoting both exploration and coverage interchangeably. Then the primitive policy learns how to plan based on their assigned roles and local observation for sub-task execution. The well-designed experiments show the scalability and generalization of our method compared with state-of-the-art approaches in the scenes with varying complexity and number of robots.

Robotics
Imagine, Initialize, and Explore: An Effective Exploration Method in Multi-Agent Reinforcement Learning

Zeyang Liu,Lipeng Wan,Xinrui Yang,Zhuoran Chen,Xingyu Chen,Xuguang Lan

2024-03-01

Abstract:Effective exploration is crucial to discovering optimal strategies for multi-agent reinforcement learning (MARL) in complex coordination tasks. Existing methods mainly utilize intrinsic rewards to enable committed exploration or use role-based learning for decomposing joint action spaces instead of directly conducting a collective search in the entire action-observation space. However, they often face challenges obtaining specific joint action sequences to reach successful states in long-horizon tasks. To address this limitation, we propose Imagine, Initialize, and Explore (IIE), a novel method that offers a promising solution for efficient multi-agent exploration in complex scenarios. IIE employs a transformer model to imagine how the agents reach a critical state that can influence each other's transition functions. Then, we initialize the environment at this state using a simulator before the exploration phase. We formulate the imagination as a sequence modeling problem, where the states, observations, prompts, actions, and rewards are predicted autoregressively. The prompt consists of timestep-to-go, return-to-go, influence value, and one-shot demonstration, specifying the desired state and trajectory as well as guiding the action generation. By initializing agents at the critical states, IIE significantly increases the likelihood of discovering potentially important under-explored regions. Despite its simplicity, empirical results demonstrate that our method outperforms multi-agent exploration baselines on the StarCraft Multi-Agent Challenge (SMAC) and SMACv2 environments. Particularly, IIE shows improved performance in the sparse-reward SMAC tasks and produces more effective curricula over the initialized states than other generative methods, such as CVAE-GAN and diffusion models.

Machine Learning,Artificial Intelligence,Multiagent Systems
Topological Map-Based Autonomous Exploration in Large-Scale Scenes for Unmanned Vehicles

Ziyu Cao,Zhihui Du,Jianhua Yang

DOI: https://doi.org/10.3390/drones8040124

IF: 5.532

2024-03-27

Drones

Abstract:Robot autonomous exploration is a challenging and valuable research field that has attracted widespread research interest in recent years. However, existing methods often encounter problems such as incomplete exploration, repeated exploration paths, and low exploration efficiency when facing large-scale scenes. Considering that many indoor and outdoor scenes usually have a prior topological map, such as road navigation maps, satellite road network maps, indoor computer-aided design (CAD) maps, etc., this paper incorporated this information into the autonomous exploration framework and proposed an innovative topological map-based autonomous exploration method for large-scale scenes. The key idea of the proposed method is to plan exploration paths with long-term benefits by tightly merging the information between robot-collected and prior topological maps. The exploration path follows a global exploration strategy but prioritizes exploring scenes outside the prior information, thereby preventing the robot from revisiting explored areas and avoiding the duplication of any effort. Furthermore, to improve the stability of exploration efficiency, the exploration path is further refined by assessing the cost and reward of each candidate viewpoint through a fast method. Simulation experimental results demonstrated that the proposed method outperforms state-of-the-art autonomous exploration methods in efficiency and stability and is more suitable for exploration in large-scale scenes. Real-world experimentation has also proven the effectiveness of our proposed method.

Passivity analysis for switched generalized neural networks with time-varying delay and uncertain output

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Efficient Autonomous Exploration of Unknown Environment Using Regions Segmentation and VRP

An Enhanced Hierarchical Planning Framework for Multi-Robot Autonomous Exploration

Asymmetric Information Enhanced Mapping Framework for Multirobot Exploration based on Deep Reinforcement Learning

An improved frontier-based robot exploration strategy combined with deep reinforcement learning

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

Deep Reinforcement Learning-based Large-scale Robot Exploration

Active Neural Topological Mapping for Multi-Agent Exploration

Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

A new method of multi-robot cooperative exploration

Control Transformer: Robot Navigation in Unknown Environments through PRM-Guided Return-Conditioned Sequence Modeling

Learning Efficient Multi-Agent Cooperative Visual Exploration

Exploration in Deep Reinforcement Learning: From Single-Agent to Multiagent Domain

DTPPO: Dual-Transformer Encoder-based Proximal Policy Optimization for Multi-UAV Navigation in Unseen Complex Environments

Multi-Robot Environmental Coverage With a Two-Stage Coordination Strategy via Deep Reinforcement Learning

Robot Exploration Based on Small Areas Priority Strategy

Distributed multi-robot potential-field-based exploration with submap-based mapping and noise-augmented strategy

Autonomous and Adaptive Role Selection for Multi-robot Collaborative Area Search Based on Deep Reinforcement Learning

Imagine, Initialize, and Explore: An Effective Exploration Method in Multi-Agent Reinforcement Learning

Topological Map-Based Autonomous Exploration in Large-Scale Scenes for Unmanned Vehicles