Abstract:Machine learning (ML) is extensively used in fields involving sensitive data, data holders are seeking to protect the privacy of data and build the ML models with high-quality utility. Differential privacy provides a feasible solution for them. However, there is a mutual constraint on the privacy and utility of the models under this solution. Therefore, how to improve (or even maximize) the utility of the model while preserving privacy becomes an urgent problem. To resolve this problem, we apply unscented Kalman filter (UKF) to various implementations of differential privacy (DP)-enabled ML (DPML). We propose a UKF-based DP-enabled ML (UKF-DPML) framework that achieves higher model utility with the given privacy budget . An evaluation module is included in the framework to ensure a fair estimation of DPML models. We validate the effectiveness of this framework through mathematical reasoning, followed by empirical evaluation of various implementations of UKF-DPML and DPML respectively. In the evaluation, we measure the ability of withstanding real-world privacy attacks and providing accurate classification, thus assessing the privacy and utility of the model. We conduct a range of privacy budgets and implementations on three datasets, each of which provides the same mathematical privacy guarantees. By measuring the resistance of UKF-DPML and DPML models to membership and attribute inference attacks and their classification accuracy, we obtain that applying UKF to the aggregates perturbed by DP noises results in higher utility with the same privacy budget and the effect of improved utility is related to the stage where UKF is applied.

Differentially Private Kalman Filtering

Privacy Preserving via Secure Summation in Distributed Kalman Filtering

On Differentially Private Filtering for Event Streams

Differentially Private Distributed Estimation and Learning

Differentially Private Formation Control

Differentially Private Variational Inference for Non-conjugate Models

Differentially private consensus algorithm for continuous-time heterogeneous multi-agent systems

Reconciling privacy and utility: an unscented Kalman filter-based framework for differentially private machine learning

An Elementary Introduction to Kalman Filtering

On Differential Privacy and Traffic State Estimation Problem for Connected Vehicles

On Differentially Private U Statistics

Differentially Private Formation Control: Privacy and Network Co-Design

Design of Privacy-Preserving Dynamic Controllers

Kalman Filtering of Distributed Time Series

Deep Kalman Filters Can Filter

Kalman filter demystified: from intuition to probabilistic graphical model to real case in financial markets

Privacy-Preserving Set-Based Estimation Using Differential Privacy and Zonotopes

Learning Privately from Multiparty Data

Outlier-Insensitive Kalman Filtering: Theory and Applications

Minimax Filter: Learning to Preserve Privacy from Inference Attacks

Differentially Private State Estimation in Distribution Networks with Smart Meters