Abstract:Data-driven deep learning technology has gained many achievements in the field of motor fault diagnosis and prognostics. However, the application objects of those previous studies are commonly limited to the faulty data sharing the similar distribution under unvarying stable working condition. Unfortunately, this limitation is nearly invalid in the real-world scenario, where the working condition is complicated and changes invariably, resulting in the unfavourable situation that the deep representation learning methods of the previous studies always fail in extracting the effective representations for fault diagnosis in real applications. To tackle this issue, inspired by f -divergence estimation, this work takes a different route and proposes an unsupervised deep representation learning approach, named Deep Mutual Information Maximization (DMIM), using variational divergence estimation approach to maximize mutual information (MI) between the input and output of a deep neural network. Meanwhile the representation distribution is automatically tuned by matching to a prior distribution with the same philosophy of Variational Autoencoder. Opposite to previous works which learn representations basically with supervised feedback regulation or unsupervised reconstruction, the proposed unsupervised MI maximization framework aims to make representational characteristics like independence play a bigger role to capture the most unique representations. To verify the effectiveness of our proposal, faulty motor data from the motor tests under European driving cycle for simulating the real working scenario, are collected for validation. It turns out that DMIM outperforms many popular unsupervised and fully-supervised learning methods. It opens new avenues for unsupervised learning of representations for motor fault diagnosis.

DeepMI: A Mutual Information Based Framework For Unsupervised Deep Learning of Tasks

A robust estimator of mutual information for deep learning interpretability

Dissecting Deep Learning Networks—Visualizing Mutual Information

Improving Deep Learning on Point Cloud by Maximizing Mutual Information Across Layers

L_DMI: A Novel Information-theoretic Loss Function for Training Deep Nets Robust to Label Noise

Approximating mutual information of high-dimensional variables using learned representations

Data-Efficient Mutual Information Neural Estimator

Reviewing Evolution of Learning Functions and Semantic Information Measures for Understanding Deep Learning

An Adversarial Training-Based Mutual Information Constraint Method

A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets

Neural Topic Modeling with Deep Mutual Information Estimation

Deep Metric Learning Based on Meta-Mining Strategy With Semiglobal Information

Mi-elm

Mutual Information-Based Dropout: Learning Deep Relevant Feature Representation Architectures

Deep Multi-Metric Learning for Text-Independent Speaker Verification

A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification

Deep Fusion Feature Learning Network for MI-EEG Classification.

Mutual information neural estimation for unsupervised multi-modal registration of brain images

Structure Learning via Mutual Information

L_DMI: An Information-theoretic Noise-robust Loss Function

Unsupervised Deep Representation Learning for Motor Fault Diagnosis by Mutual Information Maximization