Abstract:Deep learning (DL) has immense potential to revolutionize healthcare. Several Federated DL solutions have been proposed to access massive repositories of private data, without transferring subject data from the host devices. There remain concerns about potential privacy violation via "reconstructing" individually-identifiable subject data by exploiting model weights from one host. We propose a methodology for federated DL that addresses this risk through cloud-server architecture design. The study is a fully federated replication of a previous DM classifier derived on 300 head-and-neck cancer patients. Only CTs (1 slice from mid-tumor) from a The Cancer Imaging Archive public collection was used. Two hospital cohorts were used for training, and 2 other cohorts were used as validation. A "privacy-by-architecture" federated DL prototype was developed by extending an open-source distributed learning system VANTAGE6. An authenticated researcher submitted a learning task to a master server, that distributed a DL network to be trained to data hosts. Host devices were Ubuntu machines with 1 GPU each and data stored in its local XNAT repository. Training and validation were randomly split across both data hosts. The DL model consisted of 3 fully-connected convolutional blocks and 1 sigmoid output layer. In each iteration of training, synchronous averaging and update of model weights were managed through a separate aggregation server connected to each data host via a key and encrypted web interfaces. The aggregation server prevented direct connections between hosts, researcher and master server while training, so that none could peek at interim model weights generated by others. When finished, final globally-averaged weights were stored on the master server for retrieval by the researcher, but aggregator contents were erased. We demonstrated functional equivalence of a federated DL classifier to its centralized version, without transferring any subject-level data from data host machines. Further, by preventing access to interim model weights, we added an additional layer of privacy protection which we call "privacy-by-architecture". The centralized learning and federated learning models delivered statistically equivalent performance in terms of accuracy, loss and area under receiver-operator curve. 5-fold cross validation mean AUC/accuracy of centralized and federated DL models are 0.88 vs 0.85 and 0.88 vs 0.86 respectively. We demonstrated a privacy-preserving federated DL methodology that enhances privacy protection by preventing visibility of model weights during training; globally-averaged model weights reduce the risk of privacy violation by " reconstruction" attacks on the data hosts. Our architecture may be further enhanced by adding differential privacy and encryption in future.

Towards a privacy-preserving distributed cloud service for preprocessing very large medical images

Towards Privacy-, Budget-, and Deadline-Aware Service Optimization for Large Medical Image Processing across Hybrid Clouds

PriCE: Privacy-Preserving and Cost-Effective Scheduling for Parallelizing the Large Medical Image Processing Workflow over Hybrid Clouds

Parallel Versus Distributed Data Access for Gigapixel-Resolution Histology Images: Challenges and Opportunities

Developing image analysis pipelines of whole-slide images: Pre- and post-processing

Sharing of Larger Medical Dicom Imaging Data-Sets in Cloud Computing

Parallel Multiple Instance Learning for Extremely Large Histopathology Image Analysis.

ComPRePS: An Automated Cloud-based Image Analysis tool to democratize AI in Digital Pathology

FedDP: Privacy-preserving method based on federated learning for histopathology image segmentation

Federated learning for computational pathology on gigapixel whole slide images

High-throughput Analysis of Large Microscopy Image Datasets on CPU-GPU Cluster Platforms

A General Computationally-Efficient 3D Reconstruction Pipeline for Multiple Images with Point Clouds

Feasibility of Privacy-Preserving Federated Deep Learning on Medical Images

Automated Curation and AI Workflow Management System for Digital Pathology

Scalable, reproducible, and cost-effective processing of large-scale medical imaging datasets

Gigapixel Whole-Slide Images Classification using Locally Supervised Learning

Privacy-Preserving Image Processing in the Cloud.

Semantic Segmentation Based Quality Control of Histopathology Whole Slide Images

Rethinking Histology Slide Digitization Workflows for Low-Resource Settings

Privacy-preserving Image Search (PPIS): Secure Classification and Searching Using Convolutional Neural Network over Large-Scale Encrypted Medical Images

Characterizing browser-based medical imaging AI with serverless edge computing: towards addressing clinical data security constraints