Abstract:With powerful parallel computing GPUs and massive user data, neural-network-based deep learning can well exert its strong power in problem modeling and solving, and has archived great success in many applications such as image classification, speech recognition and machine translation etc. While deep learning has been increasingly popular, the problem of privacy leakage becomes more and more urgent. Given the fact that the training data may contain highly sensitive information, e.g., personal medical records, directly sharing them among the users (i.e., participants) or centrally storing them in one single location may pose a considerable threat to user privacy. In this paper, we present a practical privacy-preserving collaborative deep learning system that allows users to cooperatively build a collective deep learning model with data of all participants, without direct data sharing and central data storage. In our system, each participant trains a local model with their own data and only shares model parameters with the others. To further avoid potential privacy leakage from sharing model parameters, we use functional mechanism to perturb the objective function of the neural network in the training process to achieve $\epsilon $ -differential privacy. In particular, for the first time, we consider the existence of unreliable participants , i.e., the participants with low-quality data, and propose a solution to reduce the impact of these participants while protecting their privacy. We evaluate the performance of our system on two well-known real-world datasets for regression and classification tasks. The results demonstrate that the proposed system is robust against unreliable participants, and achieves high accuracy close to the model trained in a traditional centralized manner while ensuring rigorous privacy protection.

Collaborative deep learning framework for fault diagnosis in distributed complex systems

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Class-Imbalance and Client-Imbalance Federated Learning for Fault Diagnosis

Deep transfer network with joint distribution adaptation: A new intelligent fault diagnosis framework for industry application

Federated learning for machinery fault diagnosis with dynamic validation and self-supervision

Deep Learning Neural Network For Power System Fault Diagnosis

Deep continual transfer learning with dynamic weight aggregation for fault diagnosis of industrial streaming data under varying working conditions

Deep Transfer Network With Multi-Kernel Dynamic Distribution Adaptation for Cross-Machine Fault Diagnosis

Self-paced decentralized federated transfer framework for rotating machinery fault diagnosis with multiple domains

A Sequential and Asynchronous Federated Learning Framework for Railway Point Machine Fault Diagnosis With Imperfect Data Transmission

DecFFD: A Personalized Federated Learning Framework for Cross-Location Fault Diagnosis

A novel approach of multisensory fusion to collaborative fault diagnosis in maintenance

Asynchronous Decentralized Federated Learning for Collaborative Fault Diagnosis of PV Stations

Cloud-edge collaborative transfer fault diagnosis of rotating machinery via federated fine-tuning and target self-adaptation

A federated learning approach to mixed fault diagnosis in rotating machinery

Data-Driven Fault Detection for Dynamic Systems With Performance Degradation: A Unified Transfer Learning Framework

Joint adaptive transfer learning network for cross-domain fault diagnosis based on multi-layer feature fusion

A New Framework Based on Supervised Joint Distribution Adaptation for Bearing Fault Diagnosis across Diverse Working Conditions

SRTFD: Scalable Real-Time Fault Diagnosis through Online Continual Learning

Fault diagnosis based on deep learning by extracting inherent common feature of multi-source heterogeneous data