End-to-End Deep Fault Tolerant Control

Daulet Baimukashev,Bexultan Rakhim,Matteo Rubagotti,Huseyin Atakan Varol
DOI: https://doi.org/10.1109/TMECH.2021.3100150
2021-12-01
Abstract:PUBLISHED ON IEEE/ASME TRANSACTIONS ON MECHATRONICS, DOI: <a class="link-https link-external" data-doi="10.1109/TMECH.2021.3100150" href="https://doi.org/10.1109/TMECH.2021.3100150" rel="external noopener nofollow">https://doi.org/10.1109/TMECH.2021.3100150</a>. Ideally, accurate sensor measurements are needed to achieve a good performance in the closed-loop control of mechatronic systems. As a consequence, sensor faults will prevent the system from working correctly, unless a fault-tolerant control (FTC) architecture is adopted. As model-based FTC algorithms for nonlinear systems are often challenging to design, this paper focuses on a new method for FTC in the presence of sensor faults, based on deep learning. The considered approach replaces the phases of fault detection and isolation and controller design with a single recurrent neural network, which has the value of past sensor measurements in a given time window as input, and the current values of the control variables as output. This end-to-end deep FTC method is applied to a mechatronic system composed of a spherical inverted pendulum, whose configuration is changed via reaction wheels, in turn actuated by electric motors. The simulation and experimental results show that the proposed method can handle abrupt faults occurring in link position/velocity sensors. The provided supplementary material includes a video of real-world experiments and the software source code.
Systems and Control,Robotics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to achieve fault - tolerant control (FTC) through deep learning methods in electromechanical systems when sensors fail. Specifically, traditional fault - tolerant control methods usually rely on an accurate model of the system and need to perform fault detection and isolation (FDI) and controller design in stages. However, the design of these methods in nonlinear systems is often very complex and difficult to implement. Therefore, this paper proposes a new method based on deep learning, which can handle sensor faults end - to - end without explicitly performing fault detection and isolation or reconfiguring the controller. ### Main contributions of the paper 1. **End - to - end deep fault - tolerant control (DFTC)**: - A new end - to - end deep learning method is proposed, which uses a single recurrent neural network (RNN) to replace the traditional FDI and controller design steps. - The input is the sensor measurements in the past period of time, and the output is the current control variable. 2. **No need for system model**: - This method does not require an accurate model of the system, only a simulator or an actual system to generate training data. - This makes the method suitable for complex systems where it is difficult to establish an accurate model. 3. **Real - time application**: - A complete deep learning pipeline is provided, including dataset generation, data augmentation, model training, and actual deployment. - This method can achieve real - time closed - loop control in actual systems. ### Application case In the paper, a two - axis reaction wheel inverted pendulum system is used as a case study to demonstrate the effectiveness of the proposed DFTC method. This system has strong nonlinear characteristics, and sensors may suddenly fail. The experimental results show that the proposed DFTC method can effectively handle sensor faults and maintain the stability and performance of the system. ### Method overview 1. **System modeling**: - The state equation and output equation of the system are respectively: \[ \dot{x} = f(x, u) \] \[ y = g(x, u) \] - Where \( x \in \mathbb{R}^{n_x} \) is the system state, \( u \in \mathbb{R}^{n_u} \) is the control input, and \( y \in \mathbb{R}^{n_y} \) is the system output. 2. **Baseline controller**: - The baseline controller \( k(x) \) is a nonlinear state - feedback control strategy used to regulate the system state to the origin. 3. **DFTC controller**: - The DFTC controller \( k_{\text{ft}}(Y_T) \) is implemented using RNN, with the input being the sensor measurements \( Y_T \) in the past period of time and the output being the control variable \( u \). - During the training process, the goal of the RNN is to minimize the difference between the control input of the baseline controller in the fault - free case and the control input of the DFTC controller in the faulty case. 4. **Data generation and augmentation**: - Generate a dataset in the fault - free case by simulating the system. - Augment the dataset by introducing synthetic sensor faults. 5. **Model training and deployment**: - Use the supervised learning method to train the RNN. - Deploy the trained model to the actual system to achieve real - time control. ### Conclusion The paper proposes an end - to - end fault - tolerant control method based on deep learning, which can maintain the stability and performance of the system when sensors fail. Verified by experiments on the two - axis reaction wheel inverted pendulum system, the effectiveness and practicality of this method are proved.