Abstract:Model averaging approach is an effective technique in alleviating the risk of misspecification and improving prediction accuracy for datasets with high dimension. When the datasets consist of sensitive information, it is nature to extend traditional model averaging approach to protect individual privacy while permitting utility. Specifically, we provide a modified Frank-Wolfe algorithm, which applies the objective perturbation in each iteration of finding the optimal descent directions to attain the model weight. It is easy to implement and feasible. Furthermore, we theoretically prove the new algorithm can achieve privacy and utility guarantee. Extensive experiments on both simulated and real world datasets are carried out to back up the theory, demonstrating the encouraging performances of the proposed method in managing the inherent tradeoff between privacy and accuracy.

Model Averaging with Privacy-Preserving.