Abstract:With powerful parallel computing GPUs and massive user data, neural-network-based deep learning can well exert its strong power in problem modeling and solving, and has archived great success in many applications such as image classification, speech recognition and machine translation etc. While deep learning has been increasingly popular, the problem of privacy leakage becomes more and more urgent. Given the fact that the training data may contain highly sensitive information, e.g., personal medical records, directly sharing them among the users (i.e., participants) or centrally storing them in one single location may pose a considerable threat to user privacy. In this paper, we present a practical privacy-preserving collaborative deep learning system that allows users to cooperatively build a collective deep learning model with data of all participants, without direct data sharing and central data storage. In our system, each participant trains a local model with their own data and only shares model parameters with the others. To further avoid potential privacy leakage from sharing model parameters, we use functional mechanism to perturb the objective function of the neural network in the training process to achieve $\epsilon $ -differential privacy. In particular, for the first time, we consider the existence of unreliable participants , i.e., the participants with low-quality data, and propose a solution to reduce the impact of these participants while protecting their privacy. We evaluate the performance of our system on two well-known real-world datasets for regression and classification tasks. The results demonstrate that the proposed system is robust against unreliable participants, and achieves high accuracy close to the model trained in a traditional centralized manner while ensuring rigorous privacy protection.

Privacy-Preserving Cloud-Aided Broad Learning System

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Self-balancing Incremental Broad Learning System with privacy protection

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

Poster: Nebula: an Industrial-purpose Privacy-preserving Machine Learning System

Privacy-preserving vertical federated broad learning system for artificial intelligence generated image content

Broad Learning System for Semi-Supervised Learning.

Broad learning system with manifold regularized sparse features for semi-supervised classification

Multiparty Secure Broad Learning System for Privacy Preserving

Multi-party Secure Broad Learning System for Privacy Preserving

Analysis and Variants of Broad Learning System

BLSHF: Broad Learning System with Hybrid Features.

Machine Learning on Cloud with Blockchain: A Secure, Verifiable and Fair Approach to Outsource the Linear Regression for Data Analysis

Deep Optimized Broad Learning System for Applications in Tabular Data Recognition

Progressive Ensemble Kernel-Based Broad Learning System for Noisy Data Classification

Privacy-Preserving Outsourcing Algorithm for Solving Large Systems of Linear Equations

CloudBI: Practical Privacy-Preserving Outsourcing of Biometric Identification in the Cloud

A Lightweight and Accuracy-Lossless Privacy-Preserving Method in Federated Learning

Privacy-Preserving Outsourcing of Large-Scale Nonlinear Programming to the Cloud

Pslp: Privacy-Preserving Single-Layer Perceptron Learning For E-Healthcare

Broad Learning With Reinforcement Learning Signal Feedback: Theory and Applications