Abstract:With the increasing prevalence of cloud computing platforms, ensuring data privacy during the cloud-based image related services such as classification has become crucial. In this study, we propose a novel privacypreserving image classification scheme that enables the direct application of classifiers trained in the plaintext domain to classify encrypted images, without the need of retraining a dedicated classifier. Moreover, encrypted images can be decrypted back into their original form with high fidelity (recoverable) using a secret key. Specifically, our proposed scheme involves utilizing a feature extractor and an encoder to mask the plaintext image through a newly designed Noise-like Adversarial Example (NAE). Such an NAE not only introduces a noise-like visual appearance to the encrypted image but also compels the target classifier to predict the ciphertext as the same label as the original plaintext image. At the decoding phase, we adopt a Symmetric Residual Learning (SRL) framework for restoring the plaintext image with minimal degradation. Extensive experiments demonstrate that 1) the classification accuracy of the classifier trained in the plaintext domain remains the same in both the ciphertext and plaintext domains; 2) the encrypted images can be recovered into their original form with an average PSNR of up to 51+ dB for the SVHN dataset and 48+ dB for the VGGFace2 dataset; 3) our system exhibits satisfactory generalization capability on the encryption, decryption and classification tasks across datasets that are different from the training one; and 4) a high-level of security is achieved against three potential threat models. The code is available at <a class="link-external link-https" href="https://github.com/csjunjun/RIC.git" rel="external noopener nofollow">this https URL</a>.

Privacy-Preserving Deep Neural Networks with Pixel-Based Image Encryption Considering Data Augmentation in the Encrypted Domain

GELU-Net: A Globally Encrypted, Locally Unencrypted Deep Neural Network for Privacy-Preserved Learning.

Industrial Scale Privacy Preserving Deep Neural Network

On the Security of Pixel-Based Image Encryption for Privacy-Preserving Deep Neural Networks

Block Scrambling Image Encryption Used in Combination with Data Augmentation for Privacy-Preserving DNNs

Dropping Activation Outputs with Localized First-Layer Deep Network for Enhancing User Privacy and Data Security

Privacy-Preserving Image Classification Using Isotropic Network

Privacy-Preserving Deep Learning With Learnable Image Encryption on Medical Images

A Pixel-based Encryption Method for Privacy-Preserving Deep Learning Models

A novel image encryption algorithm with deep neural network

Masked image: Visually protected image dataset privacy-preserving scheme for convolutional neural networks

Color-NeuraCrypt: Privacy-Preserving Color-Image Classification Using Extended Random Neural Networks

Attacks on Image Encryption Schemes for Privacy-Preserving Deep Neural Networks

Privacy-Preserving Deep Learning Using Deformable Operators for Secure Task Learning

PrivyNet: A Flexible Framework for Privacy-Preserving Deep Neural Network Training

2P-DNN : Privacy-Preserving Deep Neural Networks Based on Homomorphic Cryptosystem

Recoverable Privacy-Preserving Image Classification through Noise-like Adversarial Examples

Human-imperceptible, Machine-recognizable Images

Towards Scalable and Privacy-Preserving Deep Neural Network via Algorithmic-Cryptographic Co-design

Toward Scalable and Privacy-preserving Deep Neural Network Via Algorithmic-Cryptographic Co-design

Color Image Encryption Based on Deep Learning and Block Embedding