Abstract:Abstract The successful training of deep learning models for diagnostic deployment in medical imaging applications requires large volumes of data. Such data cannot be procured without consideration for patient privacy, mandated both by legal regulations and ethical requirements of the medical profession. Differential privacy (DP) enables the provision of information-theoretic privacy guarantees to patients and can be implemented in the setting of deep neural network training through the differentially private stochastic gradient descent (DP-SGD) algorithm. We here present deepee , a free-and-open-source framework for differentially private deep learning for use with the PyTorch deep learning framework. Our framework is based on parallelised execution of neural network operations to obtain and modify the per-sample gradients. The process is efficiently abstracted via a data structure maintaining shared memory references to neural network weights to maintain memory efficiency. We furthermore offer specialised data loading procedures and privacy budget accounting based on the Gaussian Differential Privacy framework, as well as automated modification of the user-supplied neural network architectures to ensure DP-conformity of its layers. We benchmark our framework’s computational performance against other open-source DP frameworks and evaluate its application on the paediatric pneumonia dataset , an image classification task and on the Medical Segmentation Decathlon Liver dataset in the task of medical image segmentation. We find that neural network training with rigorous privacy guarantees is possible while maintaining acceptable classification performance and excellent segmentation performance. Our framework compares favourably to related work with respect to memory consumption and computational performance. Our work presents an open-source software framework for differentially private deep learning, which we demonstrate in medical imaging analysis tasks. It serves to further the utilisation of privacy-enhancing techniques in medicine and beyond in order to assist researchers and practitioners in addressing the numerous outstanding challenges towards their widespread implementation.

A Deep Learning-based Data Usability Enhancement Scheme for Differential Privacy

DPMLBench: Holistic Evaluation of Differentially Private Machine Learning

Evaluating the Usability of Differential Privacy Tools with Data Practitioners

DP-Image: Differential Privacy for Image Data in Feature Space

Not one but many Tradeoffs: Privacy Vs. Utility in Differentially Private Machine Learning

Rethinking Improved Privacy-Utility Trade-off with Pre-existing Knowledge for DP Training

When Deep Learning Meets Differential Privacy: Privacy,Security, and More

DPAdapter: Improving Differentially Private Deep Learning through Noise Tolerance Pre-training

Medical imaging deep learning with differential privacy

Scalable Differential Privacy Mechanisms for Real-Time Machine Learning Applications

How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy

Deep Learning with Differential Privacy

Towards Effective Differential Privacy Communication for Users' Data Sharing Decision and Comprehension

DPIS: An Enhanced Mechanism for Differentially Private SGD with Importance Sampling

Data Level Privacy Preserving: A Stochastic Perturbation Approach based on Differential Privacy

Wasserstein Differential Privacy

Toward Training at ImageNet Scale with Differential Privacy

RDP: Ranked Differential Privacy for Facial Feature Protection in Multiscale Sparsified Subspace

Human-Unrecognizable Differential Private Noised Image Generation Method

Enhancing DP-SGD through Non-monotonous Adaptive Scaling Gradient Weight

Pre-Pruning and Gradient-Dropping Improve Differentially Private Image Classification