Learning‐based Robust Control Methodologies under Information Constraints
Hamid Reza Karimi,Ning Wang,Zhihong Man
DOI: https://doi.org/10.1002/rnc.5973
IF: 3.8973
2022-01-01
International Journal of Robust and Nonlinear Control
Abstract:International Journal of Robust and Nonlinear ControlVolume 32, Issue 5 p. 2467-2471 GUEST EDITORIALFree Access Learning-based robust control methodologies under information constraints Hamid Reza Karimi, Corresponding Author Hamid Reza Karimi [email protected] Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy Correspondence Hamid Reza Karimi, Department of Mechanical Engineering, Politecnico di Milano, via La Masa 1, 20156 Milan, Italy. Email: [email protected]Search for more papers by this authorNing Wang, Ning Wang School of Marine Engineering, Dalian Maritime University, Dalian, People's Republic of ChinaSearch for more papers by this authorZhihong Man, Zhihong Man Faculty of Science, Engineering and Technology, Swinburne University of Technology, Hawthorn, Victoria, AustraliaSearch for more papers by this author Hamid Reza Karimi, Corresponding Author Hamid Reza Karimi [email protected] Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy Correspondence Hamid Reza Karimi, Department of Mechanical Engineering, Politecnico di Milano, via La Masa 1, 20156 Milan, Italy. Email: [email protected]Search for more papers by this authorNing Wang, Ning Wang School of Marine Engineering, Dalian Maritime University, Dalian, People's Republic of ChinaSearch for more papers by this authorZhihong Man, Zhihong Man Faculty of Science, Engineering and Technology, Swinburne University of Technology, Hawthorn, Victoria, AustraliaSearch for more papers by this author First published: 26 January 2022 https://doi.org/10.1002/rnc.5973Citations: 1 Funding information: Italian Ministry of Education, University and Research, Equipment Pre-Research Fund of Key Laboratory, 6142215200106; Liaoning Revitalization Talents Program, XLYC1807013 AboutSectionsPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL 1 INTRODUCTION This editorial is dealing with the collection and report of some recent advances in learning-based robust control methodologies under information constraints. Both theoretical and practical contributions focusing on this theme are partly addressed in this special issue. Particularly, the latest progress of learning-based control in autonomous systems, large-scale systems, interconnected systems, robotics, industrial mechatronics, transportation and variously broad applications are introduced to the literature through this special issue. Within the past decade, various learning-based control technologies have prosperously emerged in both academic and industrial communities, and have expectantly performed remarkable superiority in terms of intelligence, autonomy, conciseness, reliability, resilience, and so forth. At the early stage, neural/fuzzy learning architectures have been widely deployed to online capture complex unknowns including unmodeled dynamics, uncertainties, and disturbances pertaining to the plant which might be a nonlinear system addressing the vehicles, robotics, transportations, mechatronics, informatics, circuits, and so forth. Recently, fruitful machine learning-based approaches, for example, reinforcement learning, deep learning, brain-inspired learning, have been incrementally promoted to innovate traditional learning-based intelligent control methodologies in both theoretical and practical sides. Especially, promising applications have also been developed to autonomous systems and robotics. In addition to booming advances in learning-based control philosophy, within a complex system, unexpected constraints would be inevitably involved, for instance, communication delays, sensor failures/noises, actuator nonlinearities, nonholonomic/underactuated dynamics, and so forth, especially within distributed systems. 2 HIGHLIGHTS OF THE SPECIAL ISSUE With a stringent peer review process, there are 34 papers finally included in this Special Issue, which are covering the following aspects: (1) Learning-based control methodologies over network; (2) Estimation and fault detection under information constraints; and (3) Case studies. A brief summary of the accepted papers is discussed in the following. Learning-based control methodologies over network The authors in Reference 1 studied the parameter learning problem for stochastic Boolean networks. Then, a numerical experiment is presented to show the usefulness of the designed parameter learning algorithm. In Reference 2, the authors investigated a distributed online learning problem with privacy preservation, in which the learning nodes in a distributed network aims to minimize the sum of local loss functions over finite-time horizon. The authors in Reference 3 studied the sliding mode control of Markovian jump systems under communication constraints subject to unavailable states and deception attack and a dynamic event-triggered scheme. In Reference 4, the authors designed a sliding mode control for the discrete-time interval type-2 fuzzy singularly perturbed systems under a component-based dynamic event-triggering scheme. The authors in Reference 5 developed an observer-based proportional integral derivative security control for a networked system subject to aperiodic denial-of-service attacks. In Reference 6, the authors investigated the finite-time tracking control problem for nonstrict feedback nonlinear systems subject to full state constraints. Then, an example of the electromechanical system is given to verify the applicability of the purposed method. In Reference 7, the problem of stability analysis is investigated for a class of switched nonlinear systems whose control inputs include time delay and sampling. The authors in Reference 8 studied the finite-iteration tracking control problem for discrete-time linear systems in repetitive process setting with external disturbances based on the robust iterative learning control scheme. In Reference 9, the authors designed a set of dual-mode feedback controllers for a class of Markovian jump Lur'e systems in the framework of efficient model predictive control to make a nice tradeoff among the online computation burden, the initial feasible region, and the control performance. In Reference 10, the authors studied the optimal control problem via reinforcement learning for a class of nonlinear discrete-time systems. Then, a new learning-based algorithm, T-step heuristic dynamic programming with eligibility traces (T-sHDP( λ )) is proposed to tackle the optimal control problem. The authors in Reference 11, the authors proposed a method to compute a control Lyapunov function for nonlinear dynamics based on a deep learning robust neuro-control strategy. An estimation of the region of attraction is produced for advanced stability analysis as well. In Reference 12, a reinforcement learning based approach is proposed for model-free robust optimal regulation of continuous-time nonlinear systems. Specifically, incremental adaptive dynamic programming is utilized to allow the design of the approximate optimal incremental control strategy, stabilizing the controlled system incrementally under model uncertainties, environmental disturbances, and input saturation. In addition, the authors in Reference 13 developed a reinforcement learning-based robust control strategy for uncertain heterogeneous multi-agent systems based on a fully distributed adaptive observer. On the other hand, in Reference 14, the authors developed a new proportional-integral-derivative-based tracking control for uncertain Euler–Lagrange systems subject to actuation failures and saturation. In Reference 15, the authors proposed a novel adaptive neural network control scheme to resolve the tracking control problem for flexible-joint robots with random noises. In addition, the command filtered technology is applied to the adaptive neural network design framework. Moreover, the authors in Reference 16 developed a control scheme with deferred and asymmetric full-state constraints based on an asymmetric barrier Lyapunov function. In addition, radial basis function neural network and an antiwindup compensator are adopted for the problems of uncertainties and input saturation. Meanwhile, the authors in Reference 17 proposed a neural network-based control for unknown discrete-time nonlinear systems with a denial-of-service attack and an adaptive event-triggered mechanism. Estimation and fault detection under information constraints The authors in Reference 18 investigated the problem of simultaneous estimation of states and uncertainties by using limited information based on a sampled-data learning observer scheme. It is shown that the uncertainty estimation is performed by a learning equation with only simple addition operations, which is particularly suitable for actual digital system scenarios. Moreover, the authors in Reference 19 proposed a distributed security filtering scheme for networked switched systems under the round-robin protocol and a cyber attack scenario. The authors in Reference 20 proposed a data-stream-driven event-triggered control strategy using evolving fuzzy models learned by granulation of input-output samples for nonlinear systems with unknown time-varying dynamics. The estimation of the parameters of the fuzzy information granules by using a novel Fuzzy Weighted Recursive Least Squares with Variable-Direction Forgetting. In Reference 21, the authors proposed a single-hidden-layer feedforward network aided fault-tolerant control scheme for a class of nonlinear systems subject to actuator faults. In addition, a sliding mode control approach is presented to allow for prompt corrective reactions, with explicit consideration of multivariable conditions and control input constraints. Finally, a nonlinear Boeing 747 aircraft model is used to demonstrate the effectiveness of the proposed fault-tolerant control scheme. The authors in Reference 22 proposed an adaptive second-order sliding mode control for attitude regulation of spacecraft. In the presence of actuation fault, inertial uncertainties, external disturbances, and input saturation, the problem of finite time attitude stabilization is ensured. Moreover, the authors in Reference 23 proposed a cooperative time-varying formation control scheme for heterogeneous multi-agent systems with unknown actuator faults and external disturbances. Case studies The authors in Reference 24 proposed the finite-time formation tracking control for a multi-agent system with obstacle avoidance based on the artificial potential field. The results are validated by simulating multiple autonomous underwater vehicles system and it is shown that the obstacle avoidance with high-precision tracking and formation performance will be achieved under the formation trajectory tracking controller. Moreover, in Reference 25, the authors addressed the problem of cooperative learning from adaptive neural formation control for a group of underactuated unmanned surface vehicles with modeling uncertainties. On the other hand, the authors in Reference 26 designed the finite-time global trajectory tracking control for autonomous underwater vehicles in presence of input saturation constraints, actuator faults, unknown dynamics, and external disturbances. The authors in Reference 27 proposed a self-learning-based optimal tracking control for an unmanned surface vehicle based on the actor-critic reinforcement learning mechanism and backstepping technique. Then, applicability of the proposed method is illustrated through a prototype of unmanned surface vehicle. In Reference 28, the authors developed a neural-network based backstepping control for autonomous marine vehicles perturbed by external disturbances. Moreover, in Reference 29, the authors proposed a neural-network-based adaptive finite-time output constraint control scheme for attitude stabilization of rigid spacecrafts based on a singularity-free terminal sliding mode variable. Moreover, in Reference 30, the problem of leader-following consensus is addressed for a group of spacecraft systems with uncertain inertia matrices subject to unknown bounded disturbance over switching communication networks. In Reference 31, the authors developed an adaptive backstepping flight controller under angle of attack constraints for hypersonic flight vehicles based on the asymmetric integral barrier Lyapunov function. Then, the neural networks and disturbance observer are applied in the controller to deal with the model uncertainty and external disturbance. Moreover, in Reference 32, the authors proposed a novel asynchronous advantage actor-critic learning-based dynamic event-triggered mechanism for the decentralized load frequency regulation to alleviate the local-area communication burden and influence of the load fluctuations. In the proposed algorithm framework, the long short-term memory network is used to estimate the policy function and value function. In Reference 33, the authors proposed an adaptive robust barrier-based control for a three-dimensional riser system subject to system uncertainties and output constraints. In addition, in Reference 34, the authors developed an adaptive fuzzy fixed-time controller for the permanent magnet synchronous motors based on the fixed-time stability theory, adaptive control, fuzzy control, and backstepping algorithm. ACKNOWLEDGMENTS We really appreciate all the authors and anonymous reviewers who contributed to this Special Issue. Meanwhile, we would like to thank the supports from the Editor-in-Chief and Editorial Staff to our Special Issue. This work was partially supported by the Italian Ministry of Education, University and Research through the Project "Department of Excellence LIS4.0-Lightweight and Smart Structures for Industry 4.0," the Equipment Pre-Research Fund of Key Laboratory (6142215200106), and the Liaoning Revitalization Talents Program (under Grant XLYC1807013). CONFLICT OF INTEREST The authors declare that they have no conflicts of interest. REFERENCES 1 Chen H, Shen B. Parameter learning of stochastic Boolean networks. Int J Robust Nonlinear Control. 2022; 32:2472–2484. 2 Han D, Liu K, Lin Y, Xia Y. Differentially private distributed online learning over time-varying digraphs via dual averaging. Int J Robust Nonlinear Control. 2022;32:2485–2499. 3 Chen B, Zou Y, Niu Y. Dynamic event-triggered sliding mode security control for Markovian jump systems: learning-based iteration optimization method. Int J Robust Nonlinear Control. 2022;32:2500–2517. 4 Yang Y, Niu Y, Karimi HR. Dynamic learning control design for interval type-2 fuzzy singularly perturbed systems: a component-based event-triggering protocol. Int J Robust Nonlinear Control. 2022;32:2518–2535. 5 Wu J, Peng C. Observer-based adaptive event-triggered pid control for networked systems under aperiodic DoS attacks. Int J Robust Nonlinear Control. 2022;32:2536–2550. 6 Wang Y, Zong G, Dong Y, Shi K. Finite-time adaptive tracking control for a class of nonstrict feedback nonlinear systems with full state constraints. Int J Robust Nonlinear Control. 2022;32:2551–2569. 7Wang Y-E, Wu D, Karimi HR. Robust stability of switched nonlinear systems with delay and sampling. Int J Robust Nonlinear Control. 2022;32:2570–2584. 8 Yang R, Gong Y, Liu G-P. Robust finite-iteration tracking of discrete-time systems in repetitive process setting via ILC scheme. Int J Robust Nonlinear Control. 2022;32:2585–2602. 9 Zhang B, Song Y. Efficient model predictive control for Markovian jump systems with Lur'e nonlinear term: a dual-mode control scheme. Int J Robust Nonlinear Control. 2022;32:2603–2623. 10 Yu L, Liu W, Liu Y, Alsaadi FE. Learning-based T-sHDP( λ ) for optimal control of a class of nonlinear discrete-time systems. Int J Robust Nonlinear Control. 2022;32:2624–2643. 11 Rego RC, de Araújo FM. Learning-based Robust Neuro-Control: a method to compute control Lyapunov functions. Int J Robust Nonlinear Control. 2022;32:2644–2661. 12Cong Li, Yongchao Wang, Fangzhou Liu, Qingchen Liu, Martin Buss. Model-free incremental adaptive dynamic programming based approximate robust optimal regulation. Int J Robust Nonlinear Control. 2022;32:2662–2682. 13 Yan B, Shi P, Lim C-C, Shi Z. Optimal robust formation control for heterogeneous multi-agent systems based on reinforcement learning. Int J Robust Nonlinear Control. 2022;32:2683–2704. 14 Liu H, Gao Z, Cao L, Jiang Z, Zhang J, Song Y. Tracking control of uncertain Euler-Lagrange systems with fading and saturating actuations: a low-cost neuroadaptive learning PID solution. Int J Robust Nonlinear Control. 2022;32:2705–2721. 15 Diao S, Sun W, Su S-F. Neural-based adaptive event-triggered tracking control for flexible-joint robots with random noises. Int J Robust Nonlinear Control. 2022;32:2722–2740. 16 Sun Y, Li C, Qin H, Deng Z, Chen Z. Robust neural network-based tracking control for unmanned surface vessels under deferred asymmetric constraints. Int J Robust Nonlinear Control. 2022;32:2741–2759. 17 Wang X, Ding D, Ge X, Han Q-L. Neural-network-based control for discrete-time nonlinear systems with denial-of-service attack: the adaptive event-triggered case. Int J Robust Nonlinear Control. 2022;32:2760–2779. 18 Ran D, Zhang C, Xiao B. Limited-information learning observer for simultaneous estimation of states and parameters. Int J Robust Nonlinear Control. 2022;32:2780–2790. 19 Shang H, Zong G, Shi K. Neural-network-based distributed security filtering for networked switched systems. Int J Robust Nonlinear Control. 2022;32:2791–2804. 20Luiz AQ, Cordovil Jr, Pedro H. S. Coutinho, Iury Bessa, Márcia L. C. Peixoto. Learning event-triggered control based on evolving data-driven fuzzy granular models. Int J Robust Nonlinear Control. 2022;32:2805–2827. 21 Guo K, Lyu S, Yu X, Qiao J, Guo L, Zhang Y. Fault-Tolerant control design for a class of nonlinear systems with actuator malfunctions. Int J Robust Nonlinear Control. 2022;32:2828–2844. 22Syed Muhammad Amrr, Rajasree Sarkar, Arunava Banerjee, Abdelaziz Salah Saidi, Mashuq un Nabi, Fault-tolerant finite-time adaptive higher order sliding mode control with optimized parameters for attitude stabilization of spacecraft. Int J Robust Nonlinear Control. 2022;32:2845–2863. 23 Ren Y, Zhang K, Jiang B, Cheng W, Ding Y. Distributed fault-tolerant time-varying formation control of heterogeneous multi-agent systems. Int J Robust Nonlinear Control. 2022;32:2864–2882. 24 Shou Y, Xu B, Lu H, Zhang A, Mei T. Finite-time formation control and obstacle avoidance of multi-agent system with application. Int J Robust Nonlinear Control. 2022;32:2883–2901. 25 He S, Dong C, Dai S-L, Zou T. Cooperative deterministic learning and formation control for underactuated USVs with prescribed performance. Int J Robust Nonlinear Control. 2022;32:2902–2924. 26 Cheng Z, Huang B, Yumin S, Zheng Y, Zheng S. Finite-time rotation-matrix-based tracking control for autonomous underwater vehicle with input saturation and actuator faults. Int J Robust Nonlinear Control. 2022;32:2925–2949. 27Wang N, Gao Y, Liu Y, Li K. Self-learning-based optimal tracking control of an unmanned surface vehicle with pose and velocity constraint. 2021. 2022;32:2950–2968. 28 Ma M, Wang T, Guo R, Qiu J. Neural network-based tracking control of autonomous marine vehicles with unknown actuator dead-zone. Int J Robust Nonlinear Control. 2022;32:2969–2982. 29 Xie S, Tao M, Chen Q, Tao L. Neural-network-based adaptive finite-time output constraint control for rigid spacecrafts. Int J Robust Nonlinear Control. 2022;32:2983–3000. 30Tianqi Wang, Jie Huang. Leader-following consensus of multiple spacecraft systems with disturbance rejection over switching networks by adaptive learning control. Int J Robust Nonlinear Control. 2022;32:3001–3020. 31Guo Y, Yan T, Xu B, Tao C, Sun S. Asymmetric integral BLF based state-constrained flight control using NN and DOB. 2022;32:3021–3038. 32 Chen P, Liu S, Zhang D, Yu L. A deep asynchronous actor-critic learning based event-triggered decentralized load frequency control of power systems with communication delays. Int J Robust Nonlinear Control. 2022;32:3039–3061. 33 Ma G, Tan Z, Liu Y, Zhao Z, Zou T. Adaptive robust barrier-based control of a 3d flexible riser system subject to boundary displacement constraints. Int J Robust Nonlinear Control. 2022;32:3062–3077. 34 Yue H, Wang H, Wang Y. Adaptive fuzzy fixed-time tracking control for permanent magnet synchronous motor. Int J Robust Nonlinear Control. 2022;32:3078–3095. Citing Literature Volume32, Issue5Special Issue: Learning‐based Robust Control Methodologies under Information Constraints25 March 2022Pages 2467-2471 ReferencesRelatedInformation