Abstract:Recent studies have explored the deployment of privacy-preserving deep neural networks utilizing homomorphic encryption (HE), especially for private inference (PI). Many works have attempted the approximation-aware training (AAT) approach in PI, changing the activation functions of a model to low-degree polynomials that are easier to compute on HE by allowing model retraining. However, due to constraints in the training environment, it is often necessary to consider post-training approximation (PTA), using the pre-trained parameters of the existing plaintext model without retraining. Existing PTA studies have uniformly approximated the activation function in all layers to a high degree to mitigate accuracy loss from approximation, leading to significant time consumption. This study proposes an optimized layerwise approximation (OLA), a systematic framework that optimizes both accuracy loss and time consumption by using different approximation polynomials for each layer in the PTA scenario. For efficient approximation, we reflect the layerwise impact on the classification accuracy by considering the actual input distribution of each activation function while constructing the optimization problem. Additionally, we provide a dynamic programming technique to solve the optimization problem and achieve the optimized layerwise degrees in polynomial time. As a result, the OLA method reduces inference times for the ResNet-20 model and the ResNet-32 model by 3.02 times and 2.82 times, respectively, compared to prior state-of-the-art implementations employing uniform degree polynomials. Furthermore, we successfully classified CIFAR-10 by replacing the GELU function in the ConvNeXt model with only 3-degree polynomials using the proposed method, without modifying the backbone model.

Efficient Privacy-Preserving KAN Inference Using Homomorphic Encryption

Optimized Privacy-Preserving CNN Inference With Fully Homomorphic Encryption

Optimized Layerwise Approximation for Efficient Private Inference on Fully Homomorphic Encryption

Privacy Preserving Inference for Deep Neural Networks: Optimizing Homomorphic Encryption for Efficient and Secure Classification

A Revolutionary Neural Network Architecture with Interpretability and Flexibility Based on Kolmogorov–Arnold for Solar Radiation and Temperature Forecasting

Efficient and Privacy-Preserving Tree-Based Inference via Additive Homomorphic Encryption

A Secure Convolutional Neural Network Inference Model Based on Homomorphic Encryption

DP-KAN: Differentially Private Kolmogorov-Arnold Networks

Faster CryptoNets: Leveraging Sparsity for Real-World Encrypted Inference

Secure Convolution Neural Network Inference Based on Homomorphic Encryption

Highly Accurate CNN Inference Using Approximate Activation Functions over Homomorphic Encryption

MOFHEI: Model Optimizing Framework for Fast and Efficient Homomorphically Encrypted Neural Network Inference

Batch-oriented Element-wise Approximate Activation for Privacy-Preserving Neural Networks

Accurate Low-Degree Polynomial Approximation of Non-polynomial Operators for Fast Private Inference in Homomorphic Encryption

Hardware Acceleration of Kolmogorov-Arnold Network (KAN) for Lightweight Edge Inference

PyHENet: A Generic Framework for Privacy-Preserving DL Inference Based on Fully Homomorphic Encryption

KAN: Kolmogorov-Arnold Networks

F-KANs: Federated Kolmogorov-Arnold Networks

Joint Linear and Nonlinear Computation Across Functions for Efficient Privacy-Preserving Neural Network Inference

Self-learning activation functions to increase accuracy of privacy-preserving Convolutional Neural Networks with homomorphic encryption

THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption