Abstract:Transfer learning generally addresses to reduce the distribution distance between source-domain and target-domain. However, it is unreasonable to use a distribution to represent the life-cycle signals as they are always time-varying, and the improper assumption affects the efficacy of transfer remaining useful life (RUL) prediction. To fill this gap, this research proposes a micro transfer learning mechanism for multiple differentiated distributions, and a transfer RUL prediction model is constructed. First, a multi-cellular long short-term memory (MCLSTM) neural network is applied to obtain multiple differentiated distributions of the monitoring data at some point. Then the domain adversarial mechanism is used to achieve the knowledge transfer of multiple differentiated distributions at the cell level. Furthermore, an active screen mechanism is designed for weighting the domain discrimination losses of multiple differentiated distributions. Through the transfer RUL prediction experiments on aero-engines and actual wind turbine gearboxes, the superiority of this model over the advanced transfer prediction models is verified. Note to Practitioners—The work is motivated by the accuracy reduction problem caused by the time-varying characteristics of life-cycle data in the cross domain equipment RUL prediction scenario, where a fixed single distribution is difficult to cover the full life-cycle data. This article proposes a micro transfer learning mechanism containing multiple differentiated distributions, and a novel transfer RUL prediction model based on the mechanism is constructed for solving the problem caused by the time-varying characteristics of life-cycle data. There are four steps for implementing this method in practice: 1) collecting the full-life cycle signals of historical equipment; 2) modeling the degradation curves of equipment by MCLSTM; 3) solving the cross domain RUL prediction by narrowing the distributions of degradation curves by the micro transfer learning mechanism; and 4) making prognostics for new equipment. The novelty is that the proposed mechanism can self-adaptively align multiple differentiated subspaces of the source domain and the target domain, that is, it can adaptively extract the domain invariant features over time. As a result, the proposed method has two main advantages: 1) capable of characterizing the degradation processes of different equipment; and 2) superior prognostic results on cross domain RUL prediction.

Domain Perceptive-Pruning and Fine-Tuning the Pre-Trained Model for Heterogeneous Transfer Learning in Cross Domain Prediction

Selective Transfer with Reinforced Transfer Network for Partial Domain Adaptation.

Transfer Learning and Deep Domain Adaptation

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains.

Short-term Traffic Prediction with Deep Neural Networks and Adaptive Transfer Learning

TLT: Recurrent fine-tuning transfer learning for water quality long-term prediction

A Temporal Partial Domain Adaptation Network for Transferable Prognostics Across Working Conditions with Insufficient Data

Hierarchical Domain Adaptation with Local Feature Patterns

Auxiliary Knowledge-Based Fine-Tuning Mechanism for Industrial Time-Lag Parameter Prediction

A Two-Stage Multi-Target Domain Adaptation Framework for Prediction of Key Performance Indicators Based on Adversarial Network

Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning

Effective Domain Knowledge Transfer with Soft Fine-tuning

Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Data

Enhancing Cross-domain Pre-Trained Decision Transformers with Adaptive Attention

Pre-training enhanced unsupervised contrastive domain adaptation for industrial equipment remaining useful life prediction

Micro Transfer Learning Mechanism for Cross-Domain Equipment RUL Prediction

An Improved Hybrid Transfer Learning-Based Deep Learning Model for PM2.5 Concentration Prediction

Domain Adaptive Transfer Learning with Specialist Models

Transfer Learning-Driven Hourly PM2.5 Prediction Based on a Modified Hybrid Deep Learning

CityTrans: Domain-Adversarial Training with Knowledge Transfer for Spatio-Temporal Prediction Across Cities

Adaptive multi-source domain collaborative fine-tuning for transfer learning