Abstract:Automating complex industrial robots requires precise nonlinear control and efficient energy management. This paper introduces a data-driven nonlinear model predictive control (NMPC) framework to optimize control under multiple objectives. To enhance the prediction accuracy of the dynamic model, we design a single-shot multi-step prediction (SSMP) model based on long short-term memory (LSTM) and multilayer perceptrons (MLP), which can directly obtain the predictive horizon without iterative repetition and reduce computational pressure. Moreover, we combine offline and online models to address disturbances stemming from environmental interactions, similar to the superposition of the robot's free and forced responses. The online model learns the system's variations from the prediction mismatches of the offline model and updates its weights in real time. The proposed hybrid predictive model simplifies the relationship between inputs and outputs into matrix multiplication, which can quickly obtain the derivative. Therefore, the solution for the control signal sequence employs a gradient descent method with an adaptive learning rate, allowing the NMPC cost function to be formulated as a convex function incorporating critical states. The learning rate is dynamically adjusted based on state errors to counteract the inherent prediction inaccuracies of neural networks. The controller outputs the average value of the control signal sequence instead of the first value. Simulations and experiments on a 22-ton hydraulic excavator have validated the effectiveness of our method, showing that the proposed NMPC approach can be widely applied to industrial systems, including nonlinear control and energy management.

Long short-term memory (LSTM) model-based reinforcement learning for nonlinear mass spring damper system control

Nonlinear Model Predictive Control Based on Variable Gain

Learning-Based Neural Dynamic Surface Predictive Control for MMC

Online Reinforcement Learning Neural Network Controller Design for Nanomanipulation

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Reinforcement learning based MPC with neural dynamical models

Safe control of nonlinear systems in LPV framework using model-based reinforcement learning

Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning

Support Vector Regression Based Nonlinear Model Reference Adaptive Control

An Adaptive Nonlinear Model Predictive Control Based On Online Svm Regression Algorithm

Control of an active suspension system based on long short-term memory (LSTM) learning

Suspension Regulation of Medium-low-speed Maglev Trains via Deep Reinforcement Learning

Data-Driven Multi-step Nonlinear Model Predictive Control for Industrial Heavy Load Hydraulic Robot

Novel Model-free Optimal Active Vibration Control Strategy Based on Deep Reinforcement Learning

Neural-Network-Based Nonlinear Model Predictive Control of Suspension Gravity Offload System

A Deep Reinforcement Learning-Based Controller for Magnetorheological-Damped Vehicle Suspension

Robust Model Predictive Controller Using Recurrent Neural Networks for Input–Output Linear Parameter Varying Systems

Adaptive resilient containment control using reinforcement learning for nonlinear stochastic multi-agent systems under sensor faults

Adaptive Estimation and Control of Nonlinear Suspension Systems With Natural Logarithm Sliding Mode Control

Learning-based Nonlinear Model Predictive Control of Articulated Soft Robots using Recurrent Neural Networks