Abstract:Deep learning (DL) models are used in a variety of real-world applications but are often vulnerable to privacy attacks. Nevertheless, this DL model is attacked by membership inference attacks, model inversion attacks, reconstruction attacks, model extraction attacks, gradient leakage attacks, correlation attacks, and white box attacks (inference attacks). In order to mitigate this issue, various existing research has attempted to design an effective privacy mechanism. However, the existing schemes failed to obtain higher security in DL because of several limitations like computational complexity, lower efficiency, difficult-to-select parameters, cumulative privacy loss, etc. Recently, the auto-encoder-based deep learning model has become more popular due to its great ability, and its variants have achieved notable success in various fields such as medicine, healthcare and NLP (Natural Language Programming). However, the privacy of the auto-encoder model is affected because of the vulnerable attacks. Thus, to avoid this issue, the proposed study prefers the differential privacy (DP) method for securing the deep auto-encoder model. DP is a privacy-preserving technique that can be used to protect deep learning models from the aforementioned attacks. In this paper, a Differential Privacy-Improved Stochastic Gradient Descent (DP-ISGD) algorithm is proposed to improve the privacy and utility of the Deep Autoencoder method by adding Gaussian noise to the gradients before the clipping process. Thus, the convergence speed and accuracy of the proposed algorithm are enhanced. The experimentation is conducted in the Python platform, and metrics like convergence, accuracy and TPVD (Total Parameters Value Difference) are evaluated to measure the performance of the proposed study. The comparative analysis is performed for the no privacy, privacy with SGD, privacy with batch gradient descent (BGD) and mini-batch gradient descent (MBGD) models. The proposed approach is evaluated against six datasets, Pima Indians Diabetes (PID), Adult, MNIST, CIFAR-10, MovieLens 20 M and CD-FSL, with improved accuracy results of 98.6%, 98.6%, 98.3%, 98.14%, 97.92% and 98.17% for each dataset at the epsilon ( ) value of 0.2. The comparison analysis showed that the proposed algorithm achieves better accuracy than other privacy protection methods. Thus, the significant findings in the proposed work state that the proposed privacy model is suitable for several applications, including medical fields, algorithm development, education and awareness, by affording strong privacy guarantees.

Adjustable Privacy using Autoencoder-based Learning Structure

Private Knowledge Transfer via Model Distillation with Generative Adversarial Networks

Better accuracy with quantified privacy: representations learned via reconstructive adversarial network.

Deep feature Results Mobile User Service Provider Encoder Tea bag Classifier

Privacy-Preserving Autoencoder for Collaborative Object Detection

Privacy-preserving Collaborative Learning with Scalable Image Transformation and Autoencoder.

RISE : Privacy preserved data analytics using Regularized Inference Specific autoEncoder

Learning to Conceal: A Deep Learning Based Method for Preserving Privacy and Avoiding Prejudice

Privacy Preserving Deep Learning with Distributed Encoders.

A New Noise Generating Method Based on Gaussian Sampling for Privacy Preservation

Inductive learning and local differential privacy for privacy-preserving offloading in mobile edge intelligent systems

Efficient Privacy Preserving Edge Computing Framework for Image Classification

Enabling Inference Privacy with Adaptive Noise Injection

Privacy-preserving with Flexible Autoencoder for Video Coding for Machines

Differentially Private Recommender System with Autoencoders

Inverse optimization strategy for improved differential privacy in deep auto encoder

Private‐encoder: Enforcing Privacy in Latent Space for Human Face Images

Privacy-Preserving High-dimensional Data Collection with Federated Generative Autoencoder

Privacy Adversarial Network: Representation Learning for Mobile Data Privacy

Recommender Systems Based On Autoencoder And Differential Privacy