Multi-label Decoupling Diagnosis for Compound Faults by Improved Deep Q-network

Yi Qin,Xiwen Liu,Yongfang Mao
DOI: https://doi.org/10.1109/tim.2024.3450088
IF: 5.6
2024-01-01
IEEE Transactions on Instrumentation and Measurement
Abstract:In complex mechanical systems, compound faults generally result in more serious accidents than single faults. Deep reinforcement learning (DRL), which integrates the feature extraction capability and the decision-making ability, can autonomously conduct multilabel decoupling diagnosis under the guidance of the reward function. The existing fault diagnosis methods based on DRL use simple positive and negative rewards to guide the agent, which fails to fully recognize various single-fault types within compound faults. A new reward function is proposed to assign different weights to reward or punishment values of different single-fault types based on their diagnostic difficulty. For identifying the single-fault types by DRL, the state space needs to change with the variance of action for the same sample. To improve the identification accuracy of multiple labels, an evolvable observed state containing the single-fault information determined by the agent and the signal features is constructed. With the new reward function and evolvable observed state, an improved deep Q-network (DQN) is proposed for achieving the precise diagnosis of compound faults. Finally, the effectiveness and advantage of the proposed method are verified by several types of bearing fault diagnosis tasks.
What problem does this paper attempt to address?