Contrastive-based Bi-update Class Incremental Model and Its Application in Fault Diagnosis

Xuerui Zhang,Bojian Chen,Yue Zhuo,Zhihuan Song,Xinmin Zhang
DOI: https://doi.org/10.1109/jsen.2024.3462741
IF: 4.3
2024-01-01
IEEE Sensors Journal
Abstract:Numerous methodologies have been proposed to tackle the pervasive issue of catastrophic forgetting. However, most current methods tend to segregate the historical and current information during the training process. In contrast, we acknowledge the significance of global properties throughout the entire incremental learning process to consolidate memory. We propose a feature-level bi-update mechanism that facilitates concurrent learning and revision by fostering mutual awareness between learning and revising. To learn new knowledge, we design a cross-session contrastive learning function. This function benefits from contrastive learning, facilitating the acquisition of robust representations and inherently avoiding collapse. Notably, it accomplishes this without necessitating asymmetric network architectures or relying on data augmentation techniques. To revise prior knowledge, we propose a prototype update approach. This method involves the dynamic interaction between previous semantic representations and the ongoing learning process, thus aligning decision boundaries and promoting coherence. In addition, a novel classification method compatible with the aforementioned objectives is introduced. Extensive experiments have been conducted to validate the proposed method, and the results show that the proposed method reaches new state-of-the-art levels.
What problem does this paper attempt to address?