Abstract:In modern industrial environments, robots are expected to work close to human operators collaborating with them in completing various tasks, e.g., collaborative assembly or delivery of objects. However, it is difficult to take task optimization into account under the premise of ensuring safety in a human-involved dynamic environment. Therefore, a real-time hierarchical control method containing two hierarchical optimal controllers with complementary functions is proposed to tackle the above problems. The upper-layer Model Predictive Controller aims at performing primary tasks, such as end-effector pose tracking, singularity, and joint limit avoidance. It is formulated as a Bayesian Inference problem with a Gaussian process prior and an exponential likelihood function. The resulting maximum a posteriori estimation problem can be solved efficiently using the Matrix-Scaled Stein Variational Gradient Descent and GPU. The upper-layer optimal controller aims at performing primary tasks, such as end-effector pose tracking, singularity, and joint limit avoidance. The lower-layer safety-critical controller, formulated as a constrained quadratic programming problem, is responsible for tracking the output interpolation of the higher-layer controller while respecting the safety constraints constructed in the form of Stochastic Control Barrier Functions. Both of the optimal controllers run repeatedly but with different frequencies (upper-layer controller: 20Hz, lower-layer controller: 40Hz). The proposed method provides a solution to deal with both collision avoidance and task constraints. Lastly, we conducted real-time simulation and experimental tests on a Doosan robot, and the test results validated the effectiveness of the proposed method.

Actor-Critic-Identifier Structure-Based Decentralized Neuro-Optimal Control of Modular Robot Manipulators with Environmental Collisions

Decentralized robust optimal control for modular robot manipulators via critic-identifier structure-based adaptive dynamic programming

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Decentralized approximated optimal control for modular robot manipulations with physical human–robot interaction: a cooperative game-based strategy

Dynamic Event-Triggered Strategy-Based Optimal Control of Modular Robot Manipulator: A Multiplayer Nonzero-Sum Game Perspective

Modeling and Control Architecture for the Competitive Networked Robot System Based on POMDP

Adaptive Neural-Network Boundary Control for a Flexible Manipulator with Input Constraints and Model Uncertainties

Barrier-critic-disturbance approximate optimal control of nonzero-sum differential games for modular robot manipulators

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Value Iteration-Based Adaptive Fuzzy Backstepping Optimal Control of Modular Robot Manipulators via Integral Reinforcement Learning

IRL-based event-triggered optimal tracking control for MRMs via NZS game

Nonzero-sum game-based decentralized approximate optimal control of modular robot manipulators with coordinate operation tasks using value iteration

Decentralized Model Reference Adaptive Control Design for Modular and Reconfigurable Robots

Approximate optimal and safe coordination of nonlinear second-order multirobot systems with model uncertainties

Robust Neurooptimal Control for a Robot Via Adaptive Dynamic Programming

Adaptive Neural Network Control of Manipulators with Uncertain Kinematics and Dynamics

Adaptive Critic Based Optimal Kinematic Control for a Robot Manipulator

Active Fault-Tolerant Control Integrated with Reinforcement Learning Application to Robotic Manipulator

A Real-Time Hierarchical Control Method for Safe Human–robot Coexistence

Safety-Critical Optimal Control for Robotic Manipulators in A Cluttered Environment