Digital Watermarking for Medical Images

M. Milanova,Charles Ford,R. Kountchev,R. Kountcheva

Abstract:

What problem does this paper attempt to address?

Event-triggered-based cooperative game optimal tracking control for modular robot manipulator with constrained input

Yuanchun Li,Chongyang Wei,Tianjiao An,Bing Ma,Bo Dong

DOI: https://doi.org/10.1007/s11071-022-07603-3

IF: 5.741

2022-06-24

Nonlinear Dynamics

Abstract:In this paper, a cooperative game optimal tracking control method based on event-triggered mechanism for constrained input modular robot manipulators (MRMs) system is introduced. According to the joint torque feedback technique, the dynamics model of the constrained input subsystem is established and the global state space equation is derived. The control inputs of n joints in the MRM system with constrained input are taken as n participants of cooperative game, and the tracking control problem of the manipulator system is transformed into the optimal control problem based on the cooperative game. Next, a fusion function containing position and velocity errors is defined to construct the performance index function. In order to improve the control performance and robustness of the manipulator system, part of the known model information is used to devise controller, the model uncertainty is dealt by the neural network (NN) observer, and the optimal compensation control strategy is used to deal with internal disturbance such as sensor measurement error and transmission ripple due to power fluctuations, electromagnetic effects, noise and vibration. Based on the adaptive dynamic programming algorithm and event-triggered mechanism, the optimal tracking control strategy is obtained by approximately solving the event-triggered Hamilton-Jacobi-Bellman equation with the critic NN. The Lyapunov theory proves that trajectory tracking error of MRM system with constrained input is uniformly ultimately bounded. Finally, the experimental results demonstrate the effectiveness of the proposed control method.

engineering, mechanical,mechanics
Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

Wei Li,Rong Xiong

DOI: https://doi.org/10.1109/access.2019.2925428

IF: 3.9

2019-01-01

IEEE Access

Abstract:Task-constrained motion planning (TCMP) is involved in many practical applications, such as opening the door, opening the drawer, twisting the screw, and so on. Because of the trend of man-machine collaboration and the existence of dynamic in environments, planning the collision-free motions for task-constrained manipulation is a significative problem. This paper explores the TCMP issue for mobile manipulation, which uses a mobile base to enhance the working range and flexibility but simultaneously makes the problem harder than that of single manipulation because of the additional degrees of freedom (dofs). We propose an optimization-based method to plan the obstacle avoidance motion in real-time. First, the global robotic Jacobian matrix that combines the omnidirectional base and the robotic arm is derived. Second, model predictive control is used to plan the control rule in order to maximize the closest distance between the obstacles and the mobile manipulator and minimize the velocities of null space at the same time. We have deduced the model with four differential equations that represent the law of the distance over time. Third, the distances are calculated and sent to the model to calculate the velocity of each joint of the arm and the base using ACADO that is an open-source toolkit. Using the velocities, the mobile manipulator can move away from the approaching people while still fixing the end of the arm to manipulate tool at the same time. Our method is verified on the mobile manipulator that consists of four Mecanum wheels, a base, a UR10 arm, and four kinect cameras in Gazebo simulation with using the ROS operation.
IRL-based event-triggered optimal tracking control for MRMs via NZS game

Bo Dong,Zhendong Ding,Tianjiao An,Yiming Cui,Xinye Zhu

DOI: https://doi.org/10.1088/1361-6501/ad50f8

IF: 2.398

2024-05-30

Measurement Science and Technology

Abstract:Under the event-triggered mechanism, a non-zero-sum game optimal tracking control method for modular robot manipulators (MRMs) system with input constraints is proposed by using the adaptive dynamic programming (ADP) method based on integral reinforcement learning (IRL). First, the dynamic model of MRMs system, based on joint torque feedback (JTF) technology, consists of n joint subsystem which is related to interconnected dynamic coupling (IDC). Second, we design the robust compensation controller to handle the model known term and optimal compensation controller to deal with the uncertainty term caused by the IDC and friction, respectively. In addition, a nonlinear disturbance observer is established to dispose the negative effect caused by uncertain sensor output disturbance. Third, based on differential game theory, we transform the optimal tracking control problem of MRMs system into an n-player NZS game problem. Then, the IRL-based ADP method is adopted that relax the need for system partial unknown dynamic information and only critic neural network (NN) is used to solve the coupled Hamilton-Jacobi (HJ) equation, so as to obtain the optimal control policy. Then by Lyapunov theory, the tracking error of MRMs system is demonstrated to be uniformly ultimately bounded (UUB). Finally, the effectiveness and superiority of the proposed algorithm are verified through experiments.

engineering, multidisciplinary,instruments & instrumentation
Nonzero-sum game-based decentralized approximate optimal control of modular robot manipulators with coordinate operation tasks using value iteration

Bo Dong,Yuhang Gao,Tianjiao An,Hucheng Jiang,Bing Ma

DOI: https://doi.org/10.1088/1361-6501/ad880d

IF: 2.398

2024-10-19

Measurement Science and Technology

Abstract:Accurate trajectory tracking and appropriate contact force are crucial for the coordinated operation-oriented control of modular robot manipulators (MRMs). Considering the practical need for precision in system control, resource optimization, and disturbance compensation within the context of MRMs coordinated operation tasks (COTs), this paper employs a value iteration (VI) technique to devise a decentralized approximate optimal control strategy grounded in nonzero-sum game (NZSG) theory. To obtain more accurate, reliable, and safe control, the dynamic model of MRM is established using the joint torque feedback (JTF) technology, then, the problem of optimal control for MRM systems focused on coordinated operation-oriented is reformulated as an NZSG involving multiple subsystems. The present study grounded on the theoretical framework of the adaptive dynamic programming (ADP) algorithm employs an event-triggered NZSG strategy, utilizing VI to resolve the coupled Hamilton-Jacobian (HJ) equations, culminating in the derivation of the Nash equilibrium solutions. Through stringent stability analysis, it is established that the trajectory tracking error for the closed-loop MRM system engaged in COTs is uniformly ultimately bounded (UUB). The proposed method's efficacy is subsequently corroborated through experimental validation.

engineering, multidisciplinary,instruments & instrumentation
Optimal Task-Space Tracking with Minimum Manipulator Reconfiguration

Tong Yang,Jaime Valls Miro,Yue Wang,Rong Xiong

DOI: https://doi.org/10.1109/lra.2022.3153725

IF: 5.2

2022-01-01

IEEE Robotics and Automation Letters

Abstract:An optimal solution to the task-space tracking problem using a non-redundant manipulator is proposed. This is a recurring occurrence in automated manufacturing settings, e.g. welding, deburring, painting, or quality control inspections. Given a pre-defined path for the end-effector to follow, there may not exist a joint-space continuous solution for task-space tracking when the non-linear manipulator kinematics and collision avoidance with obstacles in the workcell are considered. This introduces undesirable manipulator reconfigurations where the end-effector is required to deviate temporarily from the pre-defined path. The unwanted motion results in pausing task-space tracking, often incurring not only ineffective time and energy demands but potentially compromising the quality of the task at hand due to the additional discontinuities. An algorithm is proposed that provides a globally optimal perspective to the choice of suitable joint-space connected segments so that the minimum number of manipulator reconfigurations during task-space tracking is guaranteed. By carefully selecting the inverse kinematic solutions, all sequences ensuring minimum reconfigurability are proven collected by Dynamic Programming. Moreover, a faster greedy strategy is suggested to increase the computational efficiency of the tracker whilst still preserving global optimality and completeness. The effectiveness of the proposed algorithm is validated against traditional sampling-based solvers in simulation and illustrated on challenging real-world tracking experimentation with a Universal Robotics manipulator and a curved-surface object, depicted also in an accompanying video. An open-source implementation has also been provided for the benefit of the robotics community.
Dynamic event-triggered robust optimal tracking control for multi-player nonzero-sum games with mismatched uncertainties and asymmetric constrained inputs

Haoming Zou,Guoshan Zhang,Wanquan Liu,Zhiguo Yan

DOI: https://doi.org/10.1016/j.ins.2024.120177

IF: 8.1

2024-01-21

Information Sciences

Abstract:In this paper, a novel dynamic event-triggered robust optimal tracking control method is proposed for multi-player nonzero-sum game problem with mismatched uncertainties and asymmetric constrained inputs. First, the original asymmetric constrained-input multi-player system is transformed into a new multi-player system with symmetric constrained inputs implemented by the state-space transformation technique, and an augmented system is established based on the new system and the desired trajectory. Next, an auxiliary augmentation system is constructed to handle the robust tracking control problem. Then, a critic neural network with a novel modified weight updating law is established for each player to solve the event-triggered coupled Hamilton–Jacobi equations, which relaxes the restrictions of initial admissible control and persistence of excitation condition. Furthermore, efficient communication and computing are obtained by the newly established dynamic event-triggered mechanism, and the Zeno behavior can be excluded by introducing an exponential term. The uniformly ultimately bounded properties of all signals are proved. Finally, two numerical examples verify the effectiveness of the designed method.

computer science, information systems
Barrier-critic-disturbance approximate optimal control of nonzero-sum differential games for modular robot manipulators

Bo Dong,Xinye Zhu,Tianjiao An,Hucheng Jiang,Bing Ma

DOI: https://doi.org/10.1016/j.neunet.2024.106880

IF: 7.8

2024-11-24

Neural Networks

Abstract:In this paper, for addressing the safe control problem of modular robot manipulators (MRMs) system with uncertain disturbances, an approximate optimal control scheme of nonzero-sum (NZS) differential games is proposed based on the control barrier function (CBF). The dynamic model of the manipulator system integrates joint subsystems through the utilization of joint torque feedback (JTF) technique, incorporating interconnected dynamic coupling (IDC) effects. By integrating the cost functions relevant to each player with the CBF, the evolution of system states is ensured to remain within the safe region. Subsequently, the optimal tracking control problem for the MRM system is reformulated as an NZS game involving multiple joint subsystems. Based on the adaptive dynamic programming (ADP) algorithm, a cost function approximator for solving Hamilton–Jacobi (HJ) equation using only critic neural networks (NN) is established, which promotes the feasible derivation of the approximate optimal control strategy. The Lyapunov theory is utilized to demonstrate that the tracking error is uniformly ultimately bounded (UUB). Utilizing the CBF's state constraint mechanism prevents the robot from deviating from the safe region, and the application of the NZS game approach ensures that the subsystems of the MRM reach a Nash equilibrium. The proposed control method effectively addresses the problem of safe and approximate optimal control of MRM system under uncertain disturbances. Finally, the effectiveness and superiority of the proposed method are verified through simulations and experiments.

computer science, artificial intelligence,neurosciences
Decentralized approximated optimal control for modular robot manipulations with physical human–robot interaction: a cooperative game-based strategy

Tianjiao An,Xinye Zhu,Bing Ma,Mingchao Zhu,Bo Dong

DOI: https://doi.org/10.1007/s11071-024-09437-7

IF: 5.741

2024-03-14

Nonlinear Dynamics

Abstract:Major challenges of controlling physical human–robot interaction (pHRI)-oriented modular robot manipulator (MRM) include performance optimization and solving the coupling effect between the human and the robot as well as MRM subsystems. In this paper, a cooperative game-based decentralized optimal control approach is developed for MRMs with pHRI. The joint torque feedback (JTF) technique is utilized to form the MRM dynamic model, then, the major objective of optimal control with pHRI is transformed into approximating Pareto equilibrium by adopting cooperative game governed between the human and the MRM that are regarded as players with different tasks and optimization criteria in interaction process. On the basis of adaptive dynamic programming (ADP) algorithm, the decentralized approximate optimal control strategy with pHRI is developed by a critic neural network (NN)-based cooperative game manner for solving the coupled Hamilton–Jacobian–Bellman (HJB) equation. The position tracking error under pHRI is verified to be ultimately uniformly bounded (UUB). Experiment results have been presented, which exhibit the superiority of the proposed method.

engineering, mechanical,mechanics
Adaptive model-based dynamic event-triggered output feedback control of a robotic manipulator with disturbance

Jie Gao,Erlong Kang,Wei He,Hong Qiao

DOI: https://doi.org/10.1016/j.isatra.2021.04.023

IF: 7.3

2022-03-01

ISA Transactions

Abstract:This paper focuses on the stable tracking control of the manipulator with constrained communication, unmeasurable velocity, and nonlinear uncertainties. An NN observer-depended output feedback scheme in the discrete-time domain is developed by virtue of the model-based dynamic event-triggered backstepping technique in the channel of sensor to controller. For generalizing the zero-order-holder (ZOH) implementation, a plant model is built to approximate the triggered states in the time flow, and according to which, the control law is fabricated. Based on model-based error events, we construct a dead-zone triggered condition with a dynamically adjustable threshold, making the threshold evolve with the system performance, to achieve flexible communication scheduling and avoid the accumulation of triggers in small tracking errors. The internal and external nonlinear uncertainties are online compensated by the neural network, and the aperiodic adaptive law is derived in the sense of control stability to save the computation. Finally, the conditions for semi-global ultimate uniform bounded (SGUUB) of all variables are given via impulse Lyapunov analysis, and a positive lower bound in the time interval between consecutive executions to guarantee the Zeno free behavior is obtained. Simulations are conducted on a three-link manipulator to illustrate the effectiveness of our method.

automation & control systems,instruments & instrumentation,engineering, multidisciplinary
Fast and Accurate Tracking Control of Robotic Manipulators Subject to State Constraints and Input Saturation by Effectively Integrating Planning Strategies

Jinna Fu,Xingyi Liu,Yingqiang Liu,Zheng Chen,Bin Yao

DOI: https://doi.org/10.1016/j.isatra.2024.04.012

IF: 7.3

2024-01-01

ISA Transactions

Abstract:This paper presents a two-loop control framework for robotic manipulator systems subject to state constraints and input saturation, which effectively integrates planning and control strategies. Namely, a stability controller is designed in the inner loop to address uncertainties and nonlinearities; an optimization-based generator is constructed in the outer loop to ensure that state and input constraints are obeyed while concurrently minimizing the convergence time. Furthermore, to dramatically the computational burden, the optimization-based generator in the outer loop is switched to a direct model-based generator when the tracking errors are sufficiently small. In this way, both a high tracking accuracy and fast dynamic response are obtained for constrained robotic manipulator systems with considerably lower computational burden. The superiority and effectiveness of the proposed structure are illustrated through comparative simulations and experiments.
Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Yinjie Lin,Zheng Chen,Bin Yao

DOI: https://doi.org/10.1109/tmech.2021.3081594

2021-01-01

Abstract:With the developments of intelligent and autonomous robotic technology, robots are usually designed to confront sophisticated tasks such as automated assembly, which requires both high-speed positioning capabilities and compliance with unknown contact environments. As we know, a high-performance motion tracking control in free space can achieve efficient and accurate positioning, while impedance or force control shows superior performance in terms of sensitive force and compliance with unknown contact environments. However, it is still challenging to achieve both high-performance motion tracking and compliance within one single control framework, especially in unknown contact environments. To this end, in this article, a unified motion/force/impedance approach for unknown contact environments is proposed by robust model-reaching control with dynamic trajectory adaptation. Specifically, the overall control scheme includes two loops: the outer loop replans the trajectories of motion and force in real time to meet the environmental constraints, which are estimated by the recursive least squares estimation law; in the inner loop, the robust model-reaching control law is proposed to realize a target model, which is designed to establish a dynamic relationship between the motion and force tracking errors of the replanned trajectories. Then, by changing the matrices of the target model, the compromise between motion tracking and force tracking can be achieved, as well as different control objectives. Experiments are conducted on a seven-degree-of-freedom manipulator to validate the advantages of the proposed scheme.
Decentralized robust optimal control for modular robot manipulators via critic-identifier structure-based adaptive dynamic programming

Bo Dong,Fan Zhou,Keping Liu,Yuanchun Li

DOI: https://doi.org/10.1007/s00521-018-3714-8

2018-09-21

Neural Computing and Applications

Abstract:This paper presents a decentralized robust optimal control method for modular robot manipulators (MRMs) via a critic-identifier structure-based adaptive dynamic programming (ADP) scheme. The robust control problem of MRMs is transformed into an optimal compensation control issue, which consists of model-based compensation control, identifier-based learning control and ADP-based optimal control. The dynamic model of MRMs is deployed for each joint module where the local dynamic information is utilized to design the model compensation controller. A neural network (NN) identifier is established to approximate the interconnected dynamic coupling. Based on ADP and local online policy iteration algorithm, the Hamiltonian–Jacobi–Bellman equation is solved by constructing a critic NN, and then the approximate optimal control policy derivation is possible. The closed-loop robotic system is asymptotic stable by the implementation of a set of developed decentralized control policies. Simulations are presented to demonstrate the effectiveness of the proposed method.

computer science, artificial intelligence
Value Iteration-Based Adaptive Fuzzy Backstepping Optimal Control of Modular Robot Manipulators via Integral Reinforcement Learning

Bo Dong,Hucheng Jiang,Yiming Cui,Xinye Zhu,Tianjiao An

DOI: https://doi.org/10.1007/s40815-023-01670-3

IF: 4.085

2024-02-20

International Journal of Fuzzy Systems

Abstract:An adaptive fuzzy backstepping optimal control method is developed for modular robot manipulators (MRMs) via value iteration (VI). This paper adopts joint torque feedback (JTF) technique to construct subsystem dynamics model, and the state space description is deduced. According to fusion function which contains the error in joint angular velocity and position, the cost function is established. The integral reinforcement learning (IRL) is integrated into the VI algorithm, which solves the optimal tracking control issue without system drift dynamics. For purpose of improving the control effect, the optimal tracking control issue of manipulator can be reconsidered as the optimal compensation issue which adopting the local dynamics information. Then the uncertainty in the model can be compensated by an adaptive fuzzy backstepping compensation controller which is constructed by fuzzy logic system (FLS) and backstepping control method. The optimal compensation control strategy is adopted to deal with the interconnected dynamic coupling (IDC), which contains global information about each joint. Based on the VI algorithm and adaptive dynamic programming (ADP) method, an effective solution of Hamiltonian-Jacobi-Bellman (HJB) equation is presented. According to Lyapunov theorem, the trajectory tracking error is uniformly ultimately bounded (UUB) by using the adaptive fuzzy backstepping optimal control method. Finally, the effectiveness of the proposed method is verified by experiments.

computer science, information systems,automation & control systems, artificial intelligence
A Novel Framework for Game-Based Optimal Event-Triggered Control of Multi-Input Nonlinear Systems

Wenqi Xu,Tong Wang,Jianbin Qiu,Xiaoping Liu

DOI: https://doi.org/10.1109/tac.2024.3358986

IF: 6.549

2024-01-01

IEEE Transactions on Automatic Control

Abstract:This paper concentrates on the game-based optimal event-triggered control problem for a class of multi-input nonlinear continuous-time systems. The main objective is to improve the system performance. Furthermore, the optimal eventtriggered conditions are derived to maximize the intersampling intervals. To simultaneously consider the optimality of control signals and event-triggered conditions, a novel two-layer game framework with redefined cost functions is developed. In the first layer, the continuous control and the threshold of the eventtriggered condition are regarded as two players of the zerosum differential game due to contrary benefits. In the second layer, event-based players game with others to reach the Nashsaddle equilibrium point in the framework of graphical game is studied. Furthermore, to tackle the issue that the analytical solution of Hamilton-Jacobian-Isaac (HJI) equation is intractable to be obtained, an adaptive dynamic programming (ADP)-based scheme using critic-only neural networks (NNs) is considered following by a zeno-free behavior proof. Finally, a simulation example is displayed to validate the theoretical results.

automation & control systems,engineering, electrical & electronic
Event-Triggered Robust Optimal Control for PMSM With Unknown Internal Dynamics, Disturbances, and Constrained Inputs

Luy Nguyen Tan,Thanh Pham Cong,Duy Pham Cong

DOI: https://doi.org/10.1109/access.2024.3352647

IF: 3.9

2024-01-01

IEEE Access

Abstract:In industry, for driving a permanent magnet synchronous motor (PMSM), it is more favorable to optimize control performances and reduce computational complexity and communication waste from a controller to actuators. For that reason, this paper employs an event-triggering mechanism to design a robust optimal control strategy for PMSM. Firstly, the PMSM model is presented as a strict-feedback nonlinear system with unknown internal dynamics, disturbances, and constrained inputs. Then, an event-triggered (ET) feedforward control strategy is introduced to convert the separated speed and current dynamics into an augmented system. Secondly, an ET-robust optimal feedback control strategy and an ET disturbance compensation strategy are designed using adaptive dynamic programming (ADP) and zero-sum game theory. All controller parameters are tuned online without identifying unknown dynamics or using a persistent excitation condition. It is shown that system stability and the exclusion of Zeno’s behavior are fulfilled. Finally, compared with the existing time-triggering control strategies in simulation and experiments with TMS320F28335 of Texas Instruments, the proposed strategy is more effective in reducing the burden of computation bandwidth and communication load.

computer science, information systems,telecommunications,engineering, electrical & electronic
Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism

Chaoxu Mu,Ke Wang

DOI: https://doi.org/10.1007/s11071-018-4713-0

IF: 5.741

2018-12-13

Nonlinear Dynamics

Abstract:This paper investigates the optimization problem of two-player zero-sum differential game with control constraints in the framework of event triggering. Relying on reinforcement learning, an adaptive dynamic programming algorithm is developed to approximate the optimal solution of zero-sum game, i.e., the saddle-point equilibrium. A single-network structure is adopted, wherein a critic neural network (NN) evaluates the action. First, the constrained Hamilton–Jacobi–Isaacs equation is mathematically derived in the presence of control constraints; the event-triggering mechanism is then incorporated to reduce calculations and actions. Then, based on the gradient-descent technique, a novel weight updating law is designed for the critic NN, which ensures the solution can converge to the optimal value online. Moreover, the stability of closed-loop system is guaranteed and the unfavorable Zeno behavior is excluded by calculating the theoretical minimum triggering interval. Finally, two numerical examples are provided to verify the reliability and effectiveness of proposed algorithm.

engineering, mechanical,mechanics
Enhanced Robust Motion Control based on Unknown System Dynamics Estimator for Robot Manipulators

Xinyu Jia,Jun Yang,Kaixin Lu,Yongping Pan,Haoyong Yu

2024-02-24

Abstract:To achieve high-accuracy manipulation in the presence of unknown disturbances, we propose two novel efficient and robust motion control schemes for high-dimensional robot manipulators. Both controllers incorporate an unknown system dynamics estimator (USDE) to estimate disturbances without requiring acceleration signals and the inverse of inertia matrix. Then, based on the USDE framework, an adaptive-gain controller and a super-twisting sliding mode controller are designed to speed up the convergence of tracking errors and strengthen anti-perturbation ability. The former aims to enhance feedback portions through error-driven control gains, while the latter exploits finite-time convergence of discontinuous switching terms. We analyze the boundedness of control signals and the stability of the closed-loop system in theory, and conduct real hardware experiments on a robot manipulator with seven degrees of freedom (DoF). Experimental results verify the effectiveness and improved performance of the proposed controllers, and also show the feasibility of implementation on high-dimensional robots.

Robotics
Optimal design of model predictive controller based on transient search optimization applied to robotic manipulators

Xingjia Li,Jinan Gu,Zedong Huang,Wenbo Wang,Jing Li

DOI: https://doi.org/10.3934/mbe.2022436

2022-06-27

Abstract:Due to nonlinearity and uncertainty of the robotic manipulator, the design of the robot controller has a crucial impact on its performance of motion and trajectory tracking. In this paper, the linear parameter varying (LPV) - model predictive controller (MPC) of a two-link robot manipulator is established and then the controller's optimal parameters are determined via a newly developed meta-heuristic algorithm, transient search optimization (TSO). The proposed control method is verified by set point and nonlinear trajectory tracking. In the test of set-point tracking, the LPV-MPC scheme optimized by TSO has better performance compared to the computed torque controller (CTC) schemes tuned by TSO or other metaheuristic algorithms. In addition, good performances can also be observed in the tests of nonlinear trajectory tracking via the LPV-MPC scheme by TSO. Moreover, the robustness of the method to structural uncertainty is verified by setting a large system parameter deviation. Results reveal that we achieved some improvements in the optimization of MPC of the robot manipulator by employing the proposed method.
Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

Qinglai Wei,Liao Zhu,Ruizhuo Song,Pinjia Zhang,Derong Liu,Jun Xiao

DOI: https://doi.org/10.1109/tnnls.2020.3030127

IF: 14.255

2022-02-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:In this article, an online adaptive optimal control algorithm based on adaptive dynamic programming is developed to solve the multiplayer nonzero-sum game (MP-NZSG) for discrete-time unknown nonlinear systems. First, a model-free coupled globalized dual-heuristic dynamic programming (GDHP) structure is designed to solve the MP-NZSG problem, in which there is no model network or identifier. Second, in order to relax the requirement of systems dynamics, an online adaptive learning algorithm is developed to solve the Hamilton–Jacobi equation using the system states of two adjacent time steps. Third, a series of critic networks and action networks are used to approximate value functions and optimal policies for all players. All the neural network (NN) weights are updated online based on real-time system states. Fourth, the uniformly ultimate boundedness analysis of the NN approximation errors is proved based on the Lyapunov approach. Finally, simulation results are given to demonstrate the effectiveness of the developed scheme.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Fully-Actuated System Approach-Based Dynamic Event-Triggered Control With Guaranteed Transient Performance of Flexible-Joint Robot: Experiment

Chengyuan Yan,Jianwei Xia,Ju H. Park,Jun-e Feng,Xiangpeng Xie

DOI: https://doi.org/10.1109/tcsii.2024.3367180

2024-01-01

Abstract:This study presents an adaptive fuzzy dynamic event-triggered tracking control scheme with guaranteed transient performance for flexible-joint (FJ) robot system. Unlike traditional backstepping control method, we approach the control problem for second-order systems based on fully actuated system approach, which greatly reduces the computational complexity. A dynamic event-triggered mechanism (DETM) is proposed that not only saves resources but also adjusts the number of triggers flexibly. In addition, we design a new time-varying smooth segmentation function and normalized function which removes the constraints on the performance function as well as achieving tracking accuracy in the desired time. At the same time, it is proved by Lyapunov stability theory that the proposed control strategy ensures that all signals of the closed-loop system are bounded and the Zeno behavior can be avoided. Finally, the proposed control strategy is applied to the 2-link FJ robot on hardware experiment platform and the feasibility and superiority of the scheme are verified.

engineering, electrical & electronic

Digital Watermarking for Medical Images

Event-triggered-based cooperative game optimal tracking control for modular robot manipulator with constrained input

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

IRL-based event-triggered optimal tracking control for MRMs via NZS game

Nonzero-sum game-based decentralized approximate optimal control of modular robot manipulators with coordinate operation tasks using value iteration

Optimal Task-Space Tracking with Minimum Manipulator Reconfiguration

Dynamic event-triggered robust optimal tracking control for multi-player nonzero-sum games with mismatched uncertainties and asymmetric constrained inputs

Barrier-critic-disturbance approximate optimal control of nonzero-sum differential games for modular robot manipulators

Decentralized approximated optimal control for modular robot manipulations with physical human–robot interaction: a cooperative game-based strategy

Adaptive model-based dynamic event-triggered output feedback control of a robotic manipulator with disturbance

Fast and Accurate Tracking Control of Robotic Manipulators Subject to State Constraints and Input Saturation by Effectively Integrating Planning Strategies

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Decentralized robust optimal control for modular robot manipulators via critic-identifier structure-based adaptive dynamic programming

Value Iteration-Based Adaptive Fuzzy Backstepping Optimal Control of Modular Robot Manipulators via Integral Reinforcement Learning

A Novel Framework for Game-Based Optimal Event-Triggered Control of Multi-Input Nonlinear Systems

Event-Triggered Robust Optimal Control for PMSM With Unknown Internal Dynamics, Disturbances, and Constrained Inputs

Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism

Enhanced Robust Motion Control based on Unknown System Dynamics Estimator for Robot Manipulators

Optimal design of model predictive controller based on transient search optimization applied to robotic manipulators

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

Fully-Actuated System Approach-Based Dynamic Event-Triggered Control With Guaranteed Transient Performance of Flexible-Joint Robot: Experiment