Abstract:Abstract The successful training of deep learning models for diagnostic deployment in medical imaging applications requires large volumes of data. Such data cannot be procured without consideration for patient privacy, mandated both by legal regulations and ethical requirements of the medical profession. Differential privacy (DP) enables the provision of information-theoretic privacy guarantees to patients and can be implemented in the setting of deep neural network training through the differentially private stochastic gradient descent (DP-SGD) algorithm. We here present deepee , a free-and-open-source framework for differentially private deep learning for use with the PyTorch deep learning framework. Our framework is based on parallelised execution of neural network operations to obtain and modify the per-sample gradients. The process is efficiently abstracted via a data structure maintaining shared memory references to neural network weights to maintain memory efficiency. We furthermore offer specialised data loading procedures and privacy budget accounting based on the Gaussian Differential Privacy framework, as well as automated modification of the user-supplied neural network architectures to ensure DP-conformity of its layers. We benchmark our framework’s computational performance against other open-source DP frameworks and evaluate its application on the paediatric pneumonia dataset , an image classification task and on the Medical Segmentation Decathlon Liver dataset in the task of medical image segmentation. We find that neural network training with rigorous privacy guarantees is possible while maintaining acceptable classification performance and excellent segmentation performance. Our framework compares favourably to related work with respect to memory consumption and computational performance. Our work presents an open-source software framework for differentially private deep learning, which we demonstrate in medical imaging analysis tasks. It serves to further the utilisation of privacy-enhancing techniques in medicine and beyond in order to assist researchers and practitioners in addressing the numerous outstanding challenges towards their widespread implementation.

Dopamine: Differentially Private Federated Learning on Medical Data

Federated Learning Model with Adaptive Differential Privacy Protection in Medical IoT

DP-FL: a Novel Differentially Private Federated Learning Framework for the Unbalanced Data

A novel decentralized federated learning approach to train on globally distributed, poor quality, and protected private medical data

Differentially Private Client Selection and Resource Allocation in Federated Learning for Medical Applications Using Graph Neural Networks

Medical imaging deep learning with differential privacy

Differentially private federated deep learning for multi-site medical image segmentation

FLOP: Federated Learning on Medical Datasets using Partial Networks

Differential Privacy for Adaptive Weight Aggregation in Federated Tumor Segmentation

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing

Locally Differentially Private Distributed Deep Learning via Knowledge Distillation

Differentially Private Federated Learning with an Adaptive Noise Mechanism

Towards Privacy-Preserving Medical Imaging: Federated Learning with Differential Privacy and Secure Aggregation Using a Modified ResNet Architecture

Distributed Federated Learning-Based Deep Learning Model for Privacy MRI Brain Tumor Detection

Personalized Retrogress-Resilient Federated Learning Toward Imbalanced Medical Data

Differential Privacy-enabled Federated Learning for Sensitive Health Data

Adaptive Differential Privacy in Federated Learning: A Priority-Based Approach

Institutionally Distributed Deep Learning Networks

Client-Level Differential Privacy via Adaptive Intermediary in Federated Medical Imaging

Federated Learning and Differential Privacy Techniques on Multi-hospital Population-scale Electrocardiogram Data

Balancing Centralized and Local Differential Privacy in Pneumonia Diagnosis