Mentoring dialogue: critical questions and answers.

P. Hofmann,J. Noblin

2002-11-01

Abstract:

What problem does this paper attempt to address?

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

Xicong Shen,Ying Liu,Zhaoyang Zhang

DOI: https://doi.org/10.1109/jiot.2022.3189361

IF: 10.6

2022-01-01

IEEE Internet of Things Journal

Abstract:Federated learning (FL), which enables multiple distributed devices (clients) to collaboratively train a global model without transmitting their private data, has attracted much attention in the Internet of Things (IoT) domain. Compared with centralized learning, FL has obvious privacy advantages because it can protect the clients’ raw data from direct access by adversaries. Furthermore, to prevent the adversaries from inferring private information from the transmitted parameters, several FL algorithms based on differential privacy (DP) have been proposed, where the clients add artificial noise to their local parameters for privacy protection. Nevertheless, the added noise would disrupt the learning process and degrade the performance of the trained model. Considering this, in this article, we develop a performance-enhanced DP-based FL (PEDPFL) algorithm, where a classifier-perturbation regularization method is proposed to improve the robustness of the trained model against DP-injected noise. We derive the theoretical privacy and convergence analysis of the proposed algorithm, and also demonstrate the influence of some hyperparameters on the convergence performance. Simulation results on real-world data sets show that the proposed algorithm has better classification performance than the existing DP-based FL algorithms at the same level of privacy protection, and thus, it is more applicable to IoT applications.
DPMLBench: Holistic Evaluation of Differentially Private Machine Learning

Chengkun Wei,Minghu Zhao,Zhikun Zhang,Min Chen,Wenlong Meng,Bo Liu,Yuan Fan,Wenzhi Chen

DOI: https://doi.org/10.1145/3576915.3616593

2023-01-01

Abstract:Differential privacy (DP), as a rigorous mathematical definition quantifying privacy leakage, has become a well-accepted standard for privacy protection. Combined with powerful machine learning (ML) techniques, differentially private machine learning (DPML) is increasingly important. As the most classic DPML algorithm, DP-SGD incurs a significant loss of utility, which hinders DPML's deployment in practice. Many studies have recently proposed improved algorithms based on DP-SGD to mitigate utility loss. However, these studies are isolated and cannot comprehensively measure the performance of improvements proposed in algorithms. More importantly, there is a lack of comprehensive research to compare improvements in these DPML algorithms across utility, defensive capabilities, and generalizability. We fill this gap by performing a holistic measurement of improved DPML algorithms on utility and defense capability against membership inference attacks (MIAs) on image classification tasks. We first present a taxonomy of where improvements are located in the ML life cycle. Based on our taxonomy, we jointly perform an extensive measurement study of the improved DPML algorithms, over twelve algorithms, four model architectures, four datasets, two attacks, and various privacy budget configurations. We also cover state-of-the-art label differential privacy (Label DP) algorithms in the evaluation. According to our empirical results, DP can effectively defend against MIAs, and sensitivity-bounding techniques such as per-sample gradient clipping play an important role in defense. We also explore some improvements that can maintain model utility and defend against MIAs more effectively. Experiments show that Label DP algorithms achieve less utility loss but are fragile to MIAs. ML practitioners may benefit from these evaluations to select appropriate algorithms. To support our evaluation, we implement a modular re-usable software, DPMLBench,(1) which enables sensitive data owners to deploy DPML algorithms and serves as a benchmark tool for researchers and practitioners.
Federated Learning Model with Adaptive Differential Privacy Protection in Medical IoT

Lina Ni,Peng Huang,Yongshan Wei,Minglei Shu,Jinquan Zhang

DOI: https://doi.org/10.1155/2021/8967819

2021-11-22

Wireless Communications and Mobile Computing

Abstract:With the proliferation of intelligent services and applications authorized by artificial intelligence, the Internet of Things has penetrated into many aspects of our daily lives, and the medical field is no exception. The medical Internet of Things (MIoT) can be applied to wearable devices, remote diagnosis, mobile medical treatment, and remote monitoring. There is a large amount of medical information in the databases of various medical institutions. Nevertheless, due to the particularity of medical data, it is extremely related to personal privacy, and the data cannot be shared, resulting in data islands. Federated learning (FL), as a distributed collaborative artificial intelligence method, provides a solution. However, FL also involves multiple security and privacy issues. This paper proposes an adaptive Differential Privacy Federated Learning Medical IoT (DPFL-MIoT) model. Specifically, when the user updates the model locally, we propose a differential privacy federated learning deep neural network with adaptive gradient descent (DPFLAGD-DNN) algorithm, which can adaptively add noise to the model parameters according to the characteristics and gradient of the training data. Since privacy leaks often occur in downlink, we present differential privacy federated learning (DP-FL) algorithm where adaptive noise is added to the parameters when the server distributes the parameters. Our method effectively reduces the addition of unnecessary noise, and at the same time, the model has a good effect. Experimental results on real-world data show that our proposed algorithm can effectively protect data privacy.

computer science, information systems,telecommunications,engineering, electrical & electronic
Enhancing IoT Security: A Novel Approach with Federated Learning and Differential Privacy Integration

Aziz Ullah Karimy,P Chandrasekhar Reddy

DOI: https://doi.org/10.5121/ijcnc.2024.16401

2024-07-29

International journal of Computer Networks & Communications

Abstract:The Internet of Things (IoT) has expanded to a diverse network of interconnected electronic components, including processors, sensors, actuators, and software throughout several sectors such as healthcare, agriculture, smart cities, other industries. Despite offering simplified solutions, it introduces significant challenges, specifically data security and privacy. Machine Learning (ML), particularly the Federated Learning (FL) framework has demonstrated a promising approach to handle these challenges, specifically by enabling collaborative model training for Intrusion Detection Systems (IDS). However, FL faces some security and privacy issues, including adversarial attacks, poisoning attacks, and privacy leakages during model updates. Since the encryption, mechanisms poses issues like computational overheads and communication costs. Hence, there is need for exploring of alternative mechanism such as Differential Privacy (DP). In this research, we demonstrate an experimental study aiming exploring of FL with DP to secure IoT environment. This study analyzes the effectiveness of DP in horizontal FL setup under Independent and Identically Distributed (IID) pattern. Results on MNIST dataset show promising outcomes; FL with and without employing DP mechanism achieve an accuracy of 98.92% and 98.2%, respectively. Furthermore, the accuracy rate achieved with complex cybersecurity dataset is 93% and 91% before and after employing the DP mechanism. These findings outlines the efficiency of DP in FL framework for improving security and privacy in IoT environment.
Privacy-Preserving Edge Federated Learning for Intelligent Mobile-Health Systems

Amin Aminifar,Matin Shokri,Amir Aminifar

DOI: https://doi.org/10.1016/j.future.2024.07.035

2024-09-13

Abstract:Machine Learning (ML) algorithms are generally designed for scenarios in which all data is stored in one data center, where the training is performed. However, in many applications, e.g., in the healthcare domain, the training data is distributed among several entities, e.g., different hospitals or patients' mobile devices/sensors. At the same time, transferring the data to a central location for learning is certainly not an option, due to privacy concerns and legal issues, and in certain cases, because of the communication and computation overheads. Federated Learning (FL) is the state-of-the-art collaborative ML approach for training an ML model across multiple parties holding local data samples, without sharing them. However, enabling learning from distributed data over such edge Internet of Things (IoT) systems (e.g., mobile-health and wearable technologies, involving sensitive personal/medical data) in a privacy-preserving fashion presents a major challenge mainly due to their stringent resource constraints, i.e., limited computing capacity, communication bandwidth, memory storage, and battery lifetime. In this paper, we propose a privacy-preserving edge FL framework for resource-constrained mobile-health and wearable technologies over the IoT infrastructure. We evaluate our proposed framework extensively and provide the implementation of our technique on Amazon's AWS cloud platform based on the seizure detection application in epilepsy monitoring using wearable technologies.

Machine Learning,Cryptography and Security
Exploratory Analysis of Federated Learning Methods with Differential Privacy on MIMIC-III

Aron N. Horvath,Matteo Berchier,Farhad Nooralahzadeh,Ahmed Allam,Michael Krauthammer

DOI: https://doi.org/10.48550/arXiv.2302.04208

2023-02-09

Abstract:Background: Federated learning methods offer the possibility of training machine learning models on privacy-sensitive data sets, which cannot be easily shared. Multiple regulations pose strict requirements on the storage and usage of healthcare data, leading to data being in silos (i.e. locked-in at healthcare facilities). The application of federated algorithms on these datasets could accelerate disease diagnostic, drug development, as well as improve patient care. Methods: We present an extensive evaluation of the impact of different federation and differential privacy techniques when training models on the open-source MIMIC-III dataset. We analyze a set of parameters influencing a federated model performance, namely data distribution (homogeneous and heterogeneous), communication strategies (communication rounds vs. local training epochs), federation strategies (FedAvg vs. FedProx). Furthermore, we assess and compare two differential privacy (DP) techniques during model training: a stochastic gradient descent-based differential privacy algorithm (DP-SGD), and a sparse vector differential privacy technique (DP-SVT). Results: Our experiments show that extreme data distributions across sites (imbalance either in the number of patients or the positive label ratios between sites) lead to a deterioration of model performance when trained using the FedAvg strategy. This issue is resolved when using FedProx with the use of appropriate hyperparameter tuning. Furthermore, the results show that both differential privacy techniques can reach model performances similar to those of models trained without DP, however at the expense of a large quantifiable privacy leakage. Conclusions: We evaluate empirically the benefits of two federation strategies and propose optimal strategies for the choice of parameters when using differential privacy techniques.

Machine Learning
Federated Learning for Privacy Preservation of Healthcare Data From Smartphone-Based Side-Channel Attacks

Abdul Rehman,Imran Razzak,Guandong Xu

DOI: https://doi.org/10.1109/JBHI.2022.3171852

Abstract:Federated learning (FL) has recently emerged as a striking framework for allowing machine and deep learning models with thousands of participants to have distributed training to preserve the privacy of users' data. Federated learning comes with the pros of allowing all participants the possibility of creating robust models even in the absence of sufficient training data. Recently, smartphone usage has increased significantly due to its portability and ability to perform many daily life tasks. Typing on a smartphone's soft keyboard generates vibrations that could be abused to detect the typed keys, aiding side-channel attacks. Such data can be collected using smartphone hardware sensors during the entry of sensitive information such as clinical notes, personal medical information, username, and passwords. This study proposes a novel framework based on federated learning for side-channel attack detection to secure this information. We collected a dataset from 10 Android smartphone users who were asked to type on the smartphone soft keyboard. We convert this dataset into two windows of five users to make two clients training local models. The federated learning-based framework aggregates model updates contributed by two clients and trained the Deep Neural Network (DNN) model individually on the dataset. To reduce the over-fitting factor, each client examines the findings three times. Experiments reveal that the DNN model achieves an accuracy of 80.09%, showing that the proposed framework has the potential to detect side-channel attacks.
Breaking the Data Value-Privacy Paradox in Mobile Mental Health Systems Through User-Centered Privacy Protection: A Web-Based Survey Study

Dongsong Zhang,Jaewan Lim,Lina Zhou,Alicia A Dahl

DOI: https://doi.org/10.2196/31633

2021-12-24

JMIR Mental Health

Abstract:Background Mobile mental health systems (MMHS) have been increasingly developed and deployed in support of monitoring, management, and intervention with regard to patients with mental disorders. However, many of these systems rely on patient data collected by smartphones or other wearable devices to infer patients’ mental status, which raises privacy concerns. Such a value-privacy paradox poses significant challenges to patients’ adoption and use of MMHS; yet, there has been limited understanding of it. Objective To address the significant literature gap, this research aims to investigate both the antecedents of patients’ privacy concerns and the effects of privacy concerns on their continuous usage intention with regard to MMHS. Methods Using a web-based survey, this research collected data from 170 participants with MMHS experience recruited from online mental health communities and a university community. The data analyses used both repeated analysis of variance and partial least squares regression. Results The results showed that data type (P=.003), data stage (P<.001), privacy victimization experience (P=.01), and privacy awareness (P=.08) have positive effects on privacy concerns. Specifically, users report higher privacy concerns for social interaction data (P=.007) and self-reported data (P=.001) than for biometrics data; privacy concerns are higher for data transmission (P=.01) and data sharing (P<.001) than for data collection. Our results also reveal that privacy concerns have an effect on attitude toward privacy protection (P=.001), which in turn affects continuous usage intention with regard to MMHS. Conclusions This study contributes to the literature by deepening our understanding of the data value-privacy paradox in MMHS research. The findings offer practical guidelines for breaking the paradox through the design of user-centered and privacy-preserving MMHS.

psychiatry
Client-Level Differential Privacy via Adaptive Intermediary in Federated Medical Imaging

Meirui Jiang,Yuan Zhong,Anjie Le,Xiaoxiao Li,Qi Dou

2024-01-16

Abstract:Despite recent progress in enhancing the privacy of federated learning (FL) via differential privacy (DP), the trade-off of DP between privacy protection and performance is still underexplored for real-world medical scenario. In this paper, we propose to optimize the trade-off under the context of client-level DP, which focuses on privacy during communications. However, FL for medical imaging involves typically much fewer participants (hospitals) than other domains (e.g., mobile devices), thus ensuring clients be differentially private is much more challenging. To tackle this problem, we propose an adaptive intermediary strategy to improve performance without harming privacy. Specifically, we theoretically find splitting clients into sub-clients, which serve as intermediaries between hospitals and the server, can mitigate the noises introduced by DP without harming privacy. Our proposed approach is empirically evaluated on both classification and segmentation tasks using two public datasets, and its effectiveness is demonstrated with significant performance improvements and comprehensive analytical studies. Code is available at: <a class="link-external link-https" href="https://github.com/med-air/Client-DP-FL" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Artificial Intelligence
Federated Learning and Differential Privacy Techniques on Multi-hospital Population-scale Electrocardiogram Data

Vikhyat Agrawal,Sunil Vasu Kalmady,Venkataseetharam Manoj Malipeddi,Manisimha Varma Manthena,Weijie Sun,Saiful Islam,Abram Hindle,Padma Kaul,Russell Greiner

2024-05-15

Abstract:This research paper explores ways to apply Federated Learning (FL) and Differential Privacy (DP) techniques to population-scale Electrocardiogram (ECG) data. The study learns a multi-label ECG classification model using FL and DP based on 1,565,849 ECG tracings from 7 hospitals in Alberta, Canada. The FL approach allowed collaborative model training without sharing raw data between hospitals while building robust ECG classification models for diagnosing various cardiac conditions. These accurate ECG classification models can facilitate the diagnoses while preserving patient confidentiality using FL and DP techniques. Our results show that the performance achieved using our implementation of the FL approach is comparable to that of the pooled approach, where the model is trained over the aggregating data from all hospitals. Furthermore, our findings suggest that hospitals with limited ECGs for training can benefit from adopting the FL model compared to single-site training. In addition, this study showcases the trade-off between model performance and data privacy by employing DP during model training. Our code is available at

Signal Processing,Cryptography and Security,Machine Learning
Nikolai N. Anichkov and his theory of atherosclerosis.

I. Konstantinov,Nicolai Mejevoi,N. M. Anichkov

Texas Heart Institute Journal

Abstract:Nikolai N. Anichkov (1885-1964) first demonstrated the role of cholesterol in the development of atherosclerosis. His classic experiments in 1913 paved the way to our current understanding of the role of cholesterol in cardiovascular disease. Anichkov's research is often cited among the greatest discoveries of the 20th century; however, little is known about Anichkov and his team. Herein, we give a detailed historical account of Anichkov's work, his personality, his research team, and their pioneering effort.
Not one but many Tradeoffs: Privacy Vs. Utility in Differentially Private Machine Learning

Benjamin Zi Hao Zhao,Mohamed Ali Kaafar,Nicolas Kourtellis

DOI: https://doi.org/10.1145/3411495.3421352

2020-09-15

Abstract:Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of differential privacy (DP), and measure their ability to fend off real-world privacy attacks, in addition to measuring their core goal of providing accurate classifications. We establish an evaluation framework to ensure each of these implementations are fairly evaluated. Our selection of DP implementations add DP noise at different positions within the framework, either at the point of data collection/release, during updates while training of the model, or after training by perturbing learned model parameters. We evaluate each implementation across a range of privacy budgets, and datasets, each implementation providing the same mathematical privacy guarantees. By measuring the models' resistance to real world attacks of membership and attribute inference, and their classification accuracy. we determine which implementations provide the most desirable tradeoff between privacy and utility. We found that the number of classes of a given dataset is unlikely to influence where the privacy and utility tradeoff occurs. Additionally, in the scenario that high privacy constraints are required, perturbing input training data does not trade off as much utility, as compared to noise added later in the ML process.

Cryptography and Security
Using Decentralized Aggregation for Federated Learning with Differential Privacy

Hadeel Abd El-Kareem,Abd El-Moaty Saleh,Ana Fernández-Vilas,Manuel Fernández-Veiga,asser El-Sonbaty

DOI: https://doi.org/10.1145/3551663.3558682

2023-11-28

Abstract:Nowadays, the ubiquitous usage of mobile devices and networks have raised concerns about the loss of control over personal data and research advance towards the trade-off between privacy and utility in scenarios that combine exchange communications, big databases and distributed and collaborative (P2P) Machine Learning techniques. On the other hand, although Federated Learning (FL) provides some level of privacy by retaining the data at the local node, which executes a local training to enrich a global model, this scenario is still susceptible to privacy breaches as membership inference attacks. To provide a stronger level of privacy, this research deploys an experimental environment for FL with Differential Privacy (DP) using benchmark datasets. The obtained results show that the election of parameters and techniques of DP is central in the aforementioned trade-off between privacy and utility by means of a classification example.

Machine Learning,Cryptography and Security
A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems

Xin Gu,Fariza Sabrina,Zongwen Fan,Shaleeza Sohail

DOI: https://doi.org/10.3390/ijerph20156539

2023-08-07

Abstract:Federated learning (FL) provides a distributed machine learning system that enables participants to train using local data to create a shared model by eliminating the requirement of data sharing. In healthcare systems, FL allows Medical Internet of Things (MIoT) devices and electronic health records (EHRs) to be trained locally without sending patients data to the central server. This allows healthcare decisions and diagnoses based on datasets from all participants, as well as streamlining other healthcare processes. In terms of user data privacy, this technology allows collaborative training without the need of sharing the local data with the central server. However, there are privacy challenges in FL arising from the fact that the model updates are shared between the client and the server which can be used for re-generating the client's data, breaching privacy requirements of applications in domains like healthcare. In this paper, we have conducted a review of the literature to analyse the existing privacy and security enhancement methods proposed for FL in healthcare systems. It has been identified that the research in the domain focuses on seven techniques: Differential Privacy, Homomorphic Encryption, Blockchain, Hierarchical Approaches, Peer to Peer Sharing, Intelligence on the Edge Device, and Mixed, Hybrid and Miscellaneous Approaches. The strengths, limitations, and trade-offs of each technique were discussed, and the possible future for these seven privacy enhancement techniques for healthcare FL systems was identified.
Navigating the Privacy-Accuracy Tradeoff: Federated Survival Analysis with Binning and Differential Privacy

Varsha Gouthamchand,Johan van Soest,Giovanni Arcuri,Andre Dekker,Andrea Damiani,Leonard Wee

DOI: https://doi.org/10.1101/2024.10.09.24315159

2024-10-09

Abstract:Federated learning (FL) offers a decentralized approach to model training, allowing for data-driven insights while safeguarding patient privacy across institutions. In the Personal Health Train (PHT) paradigm, it is local model gradients from each institution, aggregated over a sample size of its own patients that are transmitted to a central server to be globally merged, rather than transmitting the patient data itself. However, certain attacks on a PHT infrastructure may risk compromising sensitive data. This study delves into the privacy-accuracy tradeoff in federated Cox Proportional Hazards (CoxPH) models for survival analysis by assessing two Privacy-Enhancing Techniques (PETs) added on top of the PHT approach. In one, we implemented a Discretized Cox model by grouping event times into finite bins to hide individual time-to-event data points. In another, we explored Local Differential Privacy by introducing noise to local model gradients. Our results demonstrate that both strategies can effectively mitigate privacy risks without significantly compromising numerical accuracy, reflected in only small variations of hazard ratios and cumulative baseline hazard curves. Our findings highlight the potential for enhancing privacy-preserving survival analysis within a PHT implementation and suggest practical solutions for multi-institutional research while mitigating the risk of re-identification attacks.

Health Informatics
Atherosclerotic disease in axial spondyloarthritis: increased frequency of carotid plaques.

J. Rueda-Gotor,A. Corrales,R. Blanco,P. Fuentevilla,V. Portilla,R. Expósito,C. Mata,T. Pina,C. González-Juanatey,J. Llorca,M. González-Gay

2015-05-01

Clinical and Experimental Rheumatology

Abstract:OBJECTIVES To establish whether subclinical atherosclerosis is increased in patients with axial spondyloarthritis (ax-SpA). METHODS A set of 149 consecutive patients with no history of cardiovascular disease that fulfilled the Assessment of SpondyloArthritis International Society classification criteria for ax-SpA was studied by carotid ultrasonography. Carotid intima-media thickness (cIMT) and plaques were assessed. A series of 181 community-based controls with no cardiovascular disease were studied for comparison. To establish whether ax-SpA might have a direct effect on the risk of carotid plaques or an indirect effect via its putative influence on hypertension, dyslipidaemia or obesity, we obtained adjusted odds ratios (OR) for each clinical factor by the development of adjusted models. RESULTS cIMT was increased in patients (0.621±0.123 mm) when compared to controls (0.607±0.117 mm) but the difference was not significant (p=0.30). Nevertheless, carotid plaques were more commonly observed in patients with ax-SpA than in controls (41.6% vs. 26.4%; p=0.003). Patients with plaques had longer duration of the disease than those without plaques (20.5±11.2 years vs. 12.0±8.6 years; p<0.001). Plaques were more frequent in patients with hip involvement (crude odds ratio 3.15, 95% confidence interval [CI] 1.02-9.75; p=0.05), syndesmophytes (crude OR 4.94, 95% CI 2.14-11.4; p<0.001), in patients with higher functional limitation and mobility index measured by BASFI (crude OR 1.16, 95% CI 1.02-1.33; p=0.03) and BASMI (crude OR 1.45, 95% CI 1.19-1.77; p<0.001), and in those with psoriasis (crude OR 3.94, 95% CI 1.31-11.84; p=0.02. However, except for psoriasis that continued being a strong risk factor for plaques after adjustment, the relationship between other clinical features of ax-SpA and carotid plaques disappeared in the adjusted models. CONCLUSIONS Our results confirm the presence of subclinical atherosclerosis in patients with ax-SpA.
Enabling Humanitarian Applications with Targeted Differential Privacy

Nitin Kohli,Joshua Blumenstock

2024-08-24

Abstract:The proliferation of mobile phones in low- and middle-income countries has suddenly and dramatically increased the extent to which the world's poorest and most vulnerable populations can be observed and tracked by governments and corporations. Millions of historically "off the grid" individuals are now passively generating digital data; these data, in turn, are being used to make life-altering decisions about those individuals -- including whether or not they receive government benefits, and whether they qualify for a consumer loan. This paper develops an approach to implementing algorithmic decisions based on personal data, while also providing formal privacy guarantees to data subjects. The approach adapts differential privacy to applications that require decisions about individuals, and gives decision makers granular control over the level of privacy guaranteed to data subjects. We show that stronger privacy guarantees typically come at some cost, and use data from two real-world applications -- an anti-poverty program in Togo and a consumer lending platform in Nigeria -- to illustrate those costs. Our empirical results quantify the tradeoff between privacy and predictive accuracy, and characterize how different privacy guarantees impact overall program effectiveness. More broadly, our results demonstrate a way for humanitarian programs to responsibly use personal data, and better equip program designers to make informed decisions about data privacy.

Cryptography and Security
FedDroidMeter: A Privacy Risk Evaluator for FL-Based Android Malware Classification Systems

Changnan Jiang,Chunhe Xia,Zhuodong Liu,Tianbo Wang

DOI: https://doi.org/10.3390/e25071053

2023-07-12

Abstract:In traditional centralized Android malware classifiers based on machine learning, the training sample uploaded by users contains sensitive personal information, such as app usage and device security status, which will undermine personal privacy if used directly by the server. Federated-learning-based Android malware classifiers have attracted much attention due to their privacy-preserving and multi-party joint modeling. However, research shows that indirect privacy inferences from curious central servers threaten this framework. We propose a privacy risk evaluation framework, FedDroidMeter, based on normalized mutual information in response to user privacy requirements to measure the privacy risk in FL-based malware classifiers. It captures the essential cause of the disclosure of sensitive information in classifiers, independent of the attack model and capability. We performed numerical assessments using the Androzoo dataset, the baseline FL-based classifiers, the privacy-inferred attack model, and the baseline methodology of privacy evaluation. The experimental results show that FedDroidMeter can measure the privacy risks of the classifiers more effectively. Meanwhile, by comparing different models, FL, and privacy parameter settings, we proved that FedDroidMeter could compare the privacy risk between different use cases equally. Finally, we preliminarily study the law of privacy risk in classifiers. The experimental results emphasize the importance of providing a systematic privacy risk evaluation framework for FL-based malware classifiers and provide experience and a theoretical basis for studying targeted defense methods.
Gradient Mechanism to Preserve Differential Privacy and Deter Against Model Inversion Attacks in Healthcare Analytics

Alexander Krall,Daniel Finke,Hui Yang

DOI: https://doi.org/10.1109/EMBC44109.2020.9176834

Abstract:Advanced sensing technologies, driven by the Internet of Things, have caused a sharp increase in data availability within the healthcare system. The newfound availability of data offers an unprecedented opportunity to develop new analytical methods to improve the quality of patient care. Data availability, however, is a double-edged sword. Malicious attacks and data breaches are increasingly seen in the healthcare field, which result in costly disruptions to operations. Adversaries exploit analytic models to infer participation in a dataset or estimate sensitivity attributes about a target patient. This paper is aimed at developing a differentially private gradient-based mechanism and assessing its utility in mitigating the impact of these attack risks within the context of the intensive care units. Experimental results showed that this methodology is capable of greatly reducing the risk of model inversion while retaining model accuracy. Thus, health systems that employ this technique can be given more peace of mind that high-quality services can be delivered in such a way that privacy is preserved.
Protection Against Reconstruction and Its Applications in Private Federated Learning

Abhishek Bhowmick,John Duchi,Julien Freudiger,Gaurav Kapoor,Ryan Rogers

DOI: https://doi.org/10.48550/arXiv.1812.00984

2019-06-03

Abstract:In large-scale statistical learning, data collection and model fitting are moving increasingly toward peripheral devices---phones, watches, fitness trackers---away from centralized data collection. Concomitant with this rise in decentralized data are increasing challenges of maintaining privacy while allowing enough information to fit accurate, useful statistical models. This motivates local notions of privacy---most significantly, local differential privacy, which provides strong protections against sensitive data disclosures---where data is obfuscated before a statistician or learner can even observe it, providing strong protections to individuals' data. Yet local privacy as traditionally employed may prove too stringent for practical use, especially in modern high-dimensional statistical and machine learning problems. Consequently, we revisit the types of disclosures and adversaries against which we provide protections, considering adversaries with limited prior information and ensuring that with high probability, ensuring they cannot reconstruct an individual's data within useful tolerances. By reconceptualizing these protections, we allow more useful data release---large privacy parameters in local differential privacy---and we design new (minimax) optimal locally differentially private mechanisms for statistical learning problems for \emph{all} privacy levels. We thus present practicable approaches to large-scale locally private model training that were previously impossible, showing theoretically and empirically that we can fit large-scale image classification and language models with little degradation in utility.

Machine Learning

Mentoring dialogue: critical questions and answers.

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

DPMLBench: Holistic Evaluation of Differentially Private Machine Learning

Federated Learning Model with Adaptive Differential Privacy Protection in Medical IoT

Enhancing IoT Security: A Novel Approach with Federated Learning and Differential Privacy Integration

Privacy-Preserving Edge Federated Learning for Intelligent Mobile-Health Systems

Exploratory Analysis of Federated Learning Methods with Differential Privacy on MIMIC-III

Federated Learning for Privacy Preservation of Healthcare Data From Smartphone-Based Side-Channel Attacks

Breaking the Data Value-Privacy Paradox in Mobile Mental Health Systems Through User-Centered Privacy Protection: A Web-Based Survey Study

Client-Level Differential Privacy via Adaptive Intermediary in Federated Medical Imaging

Federated Learning and Differential Privacy Techniques on Multi-hospital Population-scale Electrocardiogram Data

Nikolai N. Anichkov and his theory of atherosclerosis.

Not one but many Tradeoffs: Privacy Vs. Utility in Differentially Private Machine Learning

Using Decentralized Aggregation for Federated Learning with Differential Privacy

A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems

Navigating the Privacy-Accuracy Tradeoff: Federated Survival Analysis with Binning and Differential Privacy

Atherosclerotic disease in axial spondyloarthritis: increased frequency of carotid plaques.

Enabling Humanitarian Applications with Targeted Differential Privacy

FedDroidMeter: A Privacy Risk Evaluator for FL-Based Android Malware Classification Systems

Gradient Mechanism to Preserve Differential Privacy and Deter Against Model Inversion Attacks in Healthcare Analytics

Protection Against Reconstruction and Its Applications in Private Federated Learning