Abstract:Convolutional Neural Networks (CNNs) possess extensive applicability across diverse domains, particularly in the realm of image recognition. In light of the advent of machine learning as a service, the utilization of a well-trained CNN model by servers to execute image classification based on user queries has become a significant service, catering to a wide array of applications. Nevertheless, this convenience is accompanied by the inherent risk of data privacy and model privacy disclosure, which can have severe ramifications, particularly in the context of specialized scenarios like medical images and location images. Hence, how to perform classification for CNN with privacy protection emerges as a crucial research concern. Furthermore, the nonlinearity of CNN's activation function renders it unsuitable for homomorphic cryptosystems. In order to address these challenges, we put forth a privacy-preserving CNN classification scheme employing a distributed two trapdoors public-key cryptosystem (DT-PKC). Initially, we introduce a security protocol toolkit encompassing protocols for secure multiplication, secure activation function computing, and average pooling. In addition, we propose a novel continuous and derivative Tanhplus function as an approximation of the Relu function, aiming to enhance the accuracy of classification results. The secure activation function computing protocol utilizes the aforementioned Tanhplus function in conjunction with the proposed homogenization algorithm to compute the activation function. This protocol guarantees more precise and accurate output in the activation function calculation of CNN when operating under ciphertext. Furthermore, the adoption of the DT-PKC cryptosystem not only ensures privacy protection for CNN classification but also provides support for lightweight users and multiple keys. Finally, security analysis and performance evaluations demonstrate that the proposed scheme is secure, practicable, and efficient with high accuracy.

Intelligent Beta-Based Polynomial Approximation of Activation Functions for a Robust Data Encryption System

CryptoDL: Deep Neural Networks over Encrypted Data

Self-learning activation functions to increase accuracy of privacy-preserving Convolutional Neural Networks with homomorphic encryption

Highly Accurate CNN Inference Using Approximate Activation Functions over Homomorphic Encryption

Privacy-Preserving Convolutional Neural Networks Using Homomorphic Encryption

Efficient CNN Building Blocks for Encrypted Data

A Secure Convolutional Neural Network Inference Model Based on Homomorphic Encryption

Privacy-Preserving Machine Learning With Fully Homomorphic Encryption for Deep Neural Network

Secure Convolution Neural Network Inference Based on Homomorphic Encryption

Efficient optimisation framework for convolutional neural networks with secure multiparty computation

Logistic regression model training based on the approximate homomorphic encryption

SHE: A Fast and Accurate Deep Neural Network for Encrypted Data

Anti-leakage method of network sensitive information data based on homomorphic encryption

Towards the AlexNet Moment for Homomorphic Encryption: HCNN, theFirst Homomorphic CNN on Encrypted Data with GPUs

Toward Practical Privacy-Preserving Convolutional Neural Networks Exploiting Fully Homomorphic Encryption

Optimized Layerwise Approximation for Efficient Private Inference on Fully Homomorphic Encryption

Batch-oriented Element-wise Approximate Activation for Privacy-Preserving Neural Networks

A Homomorphic Encryption Framework for Privacy-Preserving Spiking Neural Networks

CHE: Channel-Wise Homomorphic Encryption for Ciphertext Inference in Convolutional Neural Network

Optimized Privacy-Preserving CNN Inference With Fully Homomorphic Encryption

Privacy-Preserving Convolutional Neural Network Classification Scheme With Multiple Keys