Abstract:Equipping drones with target search capabilities is highly desirable for applications in disaster rescue and smart warehouse delivery systems. Multiple intelligent drones that can collaborate with each other and maneuver among obstacles show more effectiveness in accomplishing tasks in a shorter amount of time. However, carrying out collaborative target search (CTS) without prior target information is extremely challenging, especially with a visual drone swarm. In this work, we propose a novel data-efficient deep reinforcement learning (DRL) approach called adaptive curriculum embedded multistage learning (ACEMSL) to address these challenges, mainly 3-D sparse reward space exploration with limited visual perception and collaborative behavior requirements. Specifically, we decompose the CTS task into several subtasks including individual obstacle avoidance, target search, and inter-agent collaboration, and progressively train the agents with multistage learning. Meanwhile, an adaptive embedded curriculum (AEC) is designed, where the task difficulty level (TDL) can be adaptively adjusted based on the success rate (SR) achieved in training. ACEMSL allows data-efficient training and individual-team reward allocation for the visual drone swarm. Furthermore, we deploy the trained model over a real visual drone swarm and perform CTS operations without fine-tuning. Extensive simulations and real-world flight tests validate the effectiveness and generalizability of ACEMSL. The project is available at <a class="link-external link-https" href="https://github.com/NTU-UAVG/CTS-visual-drone-swarm.git" rel="external noopener nofollow">this https URL</a>.

Collaborative robotics and adaptive machines laboratory – research advances in autonomous systems, advanced manufacturing, and healthcare

Liberating Humanity from Heavy Labor: Dual-Arm Coordination and Teleoperation Control for an Assistive Robot

AdaSharing: Adaptive Data Sharing in Collaborative Robots

Research Report -- Persistent Autonomy and Robot Learning Lab

Development of LiDAR operated inventory control and assistance robot

Collaborative robot monitoring and control for enhanced sustainability

State-of-the-art in Robot Learning for Multi-Robot Collaboration: A Comprehensive Survey

A Review on the Effectiveness of Machine Learning and Deep Learning Algorithms for Collaborative Robot

A Survey of Robot Learning Strategies for Human-Robot Collaboration in Industrial Settings

Collaborating for Success: Optimizing System Efficiency and Resilience Under Agile Industrial Settings

Collaborative Target Search with a Visual Drone Swarm: An Adaptive Curriculum Embedded Multistage Reinforcement Learning Approach

DRACo-SLAM: Distributed Robust Acoustic Communication-efficient SLAM for Imaging Sonar Equipped Underwater Robot Teams

Internet of Things (Iot)-Based Collaborative Control of a Redundant Manipulator for Teleoperated Minimally Invasive Surgeries

Knowledge Sharing enabled Multi-Robot Collaboration for Preventive Maintenance in Mixed Model Assembly

Collaborative Perception in Multi-Robot Systems: Case Studies in Household Cleaning and Warehouse Operations

Enhancing Surgical Robots with Embodied Intelligence for Autonomous Ultrasound Scanning

An Augmented Discrete-Time Approach for Human-Robot Collaboration

Multi-Modal Autonomous Ultrasound Scanning for Efficient Human–Machine Fusion Interaction

Modular, Resilient, and Scalable System Design Approaches -- Lessons learned in the years after DARPA Subterranean Challenge

Collaborative robots can augment human cognition in regret-sensitive tasks

Progress and prospects of the human–robot collaboration