Abstract:Object transportation could be a challenging problem for a single robot due to the oversize and/or overweight issues. A multi-robot system can take the advantage of increased driving power and more flexible configuration to solve such a problem. However, increased number of individuals also changed the dynamics of the system which makes control of a multi-robot system more complicated. Even worse, if the whole system is sitting on a centralized decision making unit, the data flow could be easily overloaded due to the upscaling of the system. In this research, we propose a decentralized control scheme on a multi-robot system with each individual equipped with a deep Q-network (DQN) controller to perform an oversized object transportation task. DQN is a deep reinforcement learning algorithm thus does not require the knowledge of system dynamics, instead, it enables the robots to learn appropriate control strategies through trial-and-error style interactions within the task environment. Since analogous controllers are distributed on the individuals, the computational bottleneck is avoided systematically. We demonstrate such a system in a scenario of carrying an oversized rod through a doorway by a two-robot team. The presented multi-robot system learns abstract features of the task and cooperative behaviors are observed. The decentralized DQN-style controller is showing strong robustness against uncertainties. In addition, We propose a universal metric to assess the cooperation quantitatively.

Distributed Collaborative Control of Redundant Robots under Weight-Unbalanced Directed Graphs

Neural Dynamics for Cooperative Control of Redundant Robot Manipulators

Perturbed Manipulability Optimization in a Distributed Network of Redundant Robots

Distributed Neurodynamic Optimization for Coordination of Redundant Robots

An Overview of Multi-task Control for Redundant Robot Based on Quadratic Programming

Revisiting QP-based Control Schemes for Redundant Robotic Systems with Different Emphases

A distributed approach to load balance for multi-robot task allocation

Decentralized kinematic control of a class of collaborative redundant manipulators via recurrent neural networks

A Distributed Approach to Robust Control of Multi-Robot Systems

Load Distribution and Joint Trajectory Planning of Coordinated Manipulation for Two Redundant Robots

A DECENTRALIZED AUTONOMOUS CONTROL ALGORITHM FOR HIGHLY REDUNDANT ROBOT MANIPULATORS

Distributed Cooperative Control of Redundant Mobile Manipulators With Safety Constraints

Decentralized Control of Collaborative Redundant Manipulators with Partial Command Coverage Via Locally Connected Recurrent Neural Networks

Dynamic Neural Networks Aided Distributed Cooperative Control of Manipulators Capable of Different Performance Indices.

Distributed Optimization for the Multi-Robot System Using a Neurodynamic Approach.

Distributed Task Allocation of Multiple Robots: A Control Perspective.

Distributed Region Reaching Consensus Control for Uncertain Networked Multi‐robot Systems

A Redundancy Resolution Method for Robot with Multi-Constraints Based on the Varied Weighted Least-Norm Principle

Multi-robot Cooperative Object Transportation using Decentralized Deep Reinforcement Learning

Hybrid Control of Orientation and Position for Redundant Manipulators Using Neural Network.

Optimal control of redundant robots with local degrees of freedom