Generalization on Unseen Domains via Model-Agnostic Learning for Intelligent Fault Diagnosis

Huanjie Wang,Xiwei Bai,Sihan Wang,Jie Tan,Chengbao Liu
DOI: https://doi.org/10.1109/tim.2022.3152316
IF: 5.6
2022-01-01
IEEE Transactions on Instrumentation and Measurement
Abstract:Machine learning-based diagnosis methods have achieved remarkable success under the assumption that the training and test data are identically distributed. However, a critical requirement of these methods is the generalization capability to unseen domains when deployed to actual diagnosis scenarios. We introduce the challenging problem of domain generalization, i.e., learning from multiple source domains to produce a model that can directly generalize to unseen domains without target information. We adopt a model-agnostic learning produce that maximizes the dot product of gradients between the source domains. Such a gradient alignment objective encourages finding a common optimization path for all source domains, which helps to focus on invariant representations. Furthermore, we propose two feature regularizations that explicitly regularize the feature space. Global feature regularization aligns class relationships between different domains to preserve the domain-invariant knowledge. Local feature regularization encourages the model to learn domain-agnostic class-specific representations with intraclass compactness and interclass separability. The effectiveness of the proposed method is demonstrated with generalization experiments on two benchmarks.
engineering, electrical & electronic,instruments & instrumentation
What problem does this paper attempt to address?