Abstract:Highlights • Propose an approximate dynamic programming (ADP) based online optimal coordination methodology for second-order multi-robot network with guaranteed collision avoidance and robustness. • Design new local variables for robots through incorporating the gradient of collision penalty into robots' tracking error, such that the computational complexity does not grows with increasing number of robots, i.e., the control strategy scales well. • A novel value function approximation approach and critic-only NN learning law achieves rigorous safety and control efficiency. • Adaptive control methods, different with other robust approaches for ADP, only requires the boundedness of uncertainties. This paper investigates the approximate optimal coordination for nonlinear uncertain second-order multi-robot systems with guaranteed safety (collision avoidance) Through constructing novel local error signals, the collision-free control objective is formulated into an coordination optimization problem for nominal multi-robot systems. Based on approximate dynamic programming technique, the optimal value functions and control policies are learned by simplified critic-only neural networks (NNs). Then, the approximated optimal controllers are redesigned using adaptive law to handle the effects of robots' uncertain dynamics. It is shown that the NN weights estimation errors are uniformly ultimately bounded under proper conditions, and safe coordination of multiple robots can be achieved regardless of model uncertainties. Numerical simulations finally illustrate the effectiveness of the proposed controller.

A Learning-Based Decentralized Optimal Control Method for Modular and Reconfigurable Robots with Uncertain Environment

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Decentralized Adaptive Iterative Learning Control for Interconnected Systems with Uncertainties

Decentralized robust optimal control for modular robot manipulators via critic-identifier structure-based adaptive dynamic programming

Decentralized Model Reference Adaptive Control Design for Modular and Reconfigurable Robots

Inverse optimal stabilization of cooperative control in networked multi-agent systems

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Value Iteration-Based Adaptive Fuzzy Backstepping Optimal Control of Modular Robot Manipulators via Integral Reinforcement Learning

Decentralized approximated optimal control for modular robot manipulations with physical human–robot interaction: a cooperative game-based strategy

Direct Optimization Based Compensation Adaptive Robust Control of Nonlinear Systems with State and Input Constraints

Learning-Based Neural Dynamic Surface Predictive Control for MMC

A Distributed Model Predictive Control for Multiple Mobile Robots with the Model Uncertainty

Decentralized Robust Control of Uncertain Robots with Backlash and Flexibility at Joints

Reinforcement learning-based decentralized fault tolerant control for constrained interconnected nonlinear systems

Approximate optimal and safe coordination of nonlinear second-order multirobot systems with model uncertainties

Barrier-critic-disturbance approximate optimal control of nonzero-sum differential games for modular robot manipulators

Adaptive fuzzy decentralized optimal control for interconnected nonlinear systems with unmodeled dynamics via mixed data and event driven method

Digital Watermarking for Medical Images

Stochastic Model Predictive Control with Optimal Linear Feedback for Mobile Robots in Dynamic Environments

Nonzero-sum game-based decentralized approximate optimal control of modular robot manipulators with coordinate operation tasks using value iteration

Decentralized Robust Tracking Control for Robots with Uncertain Parameters