Abstract:The field of neuroimaging can greatly benefit from building machine learning models to detect and predict diseases, and discover novel biomarkers, but much of the data collected at various organizations and research centers is unable to be shared due to privacy or regulatory concerns (especially for clinical data or rare disorders). In addition, aggregating data across multiple large studies results in a huge amount of duplicated technical debt and the resources required can be challenging or impossible for an individual site to build. Training on the data distributed across organizations can result in models that generalize much better than models trained on data from any of organizations alone. While there are approaches for decentralized sharing, these often do not provide the highest possible guarantees of sample privacy that only cryptography can provide. In addition, such approaches are often focused on probabilistic solutions. In this paper, we propose an approach that leverages the potential of datasets spread among a number of data collecting organizations by performing joint analyses in a secure and deterministic manner when only encrypted data is shared and manipulated. The approach is based on secure multiparty computation which refers to cryptographic protocols that enable distributed computation of a function over distributed inputs without revealing additional information about the inputs. It enables multiple organizations to train machine learning models on their joint data and apply the trained models to encrypted data without revealing their sensitive data to the other parties. In our proposed approach, organizations (or sites) securely collaborate to build a machine learning model as it would have been trained on the aggregated data of all the organizations combined. Importantly, the approach does not require a trusted party (i.e. aggregator), each contributing site plays an equal role in the process, and no site can learn individual data of any other site. We demonstrate effectiveness of the proposed approach, in a range of empirical evaluations using different machine learning algorithms including logistic regression and convolutional neural network models on human structural and functional magnetic resonance imaging datasets.

ArchNet: Data Hiding Model in Distributed Machine Learning System

ArchNet: A data hiding design for distributed machine learning systems

GELU-Net: A Globally Encrypted, Locally Unencrypted Deep Neural Network for Privacy-Preserved Learning.

CHEETAH: An Ultra-Fast, Approximation-Free, and Privacy-Preserved Neural Network Framework based on Joint Obscure Linear and Nonlinear Computations

Industrial Scale Privacy Preserving Deep Neural Network

Crypto-Nets: Neural Networks over Encrypted Data

Novel asymmetric CNN-based and adaptive mean predictors for reversible data hiding in encrypted images

Reversible Data Hiding in Encrypted Images Based on a Multi-Granularity Adaptive Classification Mechanism.

Data Security Utilizing a Memristive Coupled Neural Network in 3D Models

NeuraCrypt: Hiding Private Health Data via Random Neural Networks for Public Training

Optimization of a Deep Learning Algorithm for Security Protection of Big Data from Video Images

NeuroCrypt: Machine Learning Over Encrypted Distributed Neuroimaging Data

Novel data encryption scheme and its application to secure multi-party communication

2P-DNN : Privacy-Preserving Deep Neural Networks Based on Homomorphic Cryptosystem

Privacy-preserving Decentralized Deep Learning with Multiparty Homomorphic Encryption

An efficient spatial transformation-based entropy retained reversible data hiding scheme in encrypted images

Privacy-Preserving Distributed Machine Learning Made Faster.

Anonymous and Efficient Authentication Scheme for Privacy-Preserving Distributed Learning

DeepEDN: A Deep-Learning-Based Image Encryption and Decryption Network for Internet of Medical Things

Demystifying Arch-hints for Model Extraction: An Attack in Unified Memory System

MSCryptoNet: Multi-Scheme Privacy-Preserving Deep Learning in Cloud Computing.