Abstract:Recently cloud-based graph convolutional network (GCN) has demonstrated great success and potential in many privacy-sensitive applications such as personal healthcare and financial systems. Despite its high inference accuracy and performance on cloud, maintaining data privacy in GCN inference, which is of paramount importance to these practical applications, remains largely unexplored. In this paper, we take an initial attempt towards this and develop $\textit{CryptoGCN}$--a homomorphic encryption (HE) based GCN inference framework. A key to the success of our approach is to reduce the tremendous computational overhead for HE operations, which can be orders of magnitude higher than its counterparts in the plaintext space. To this end, we develop an approach that can effectively take advantage of the sparsity of matrix operations in GCN inference to significantly reduce the computational overhead. Specifically, we propose a novel AMA data formatting method and associated spatial convolution methods, which can exploit the complex graph structure and perform efficient matrix-matrix multiplication in HE computation and thus greatly reduce the HE operations. We also develop a co-optimization framework that can explore the trade offs among the accuracy, security level, and computational overhead by judicious pruning and polynomial approximation of activation module in GCNs. Based on the NTU-XVIEW skeleton joint dataset, i.e., the largest dataset evaluated homomorphically by far as we are aware of, our experimental results demonstrate that $\textit{CryptoGCN}$ outperforms state-of-the-art solutions in terms of the latency and number of homomorphic operations, i.e., achieving as much as a 3.10$\times$ speedup on latency and reduces the total Homomorphic Operation Count by 77.4\% with a small accuracy loss of 1-1.5$\%$.

Fast Permutation Architecture on Encrypted Data for Secure Neural Network Inference

CHEETAH: An Ultra-Fast, Approximation-Free, and Privacy-Preserved Neural Network Framework based on Joint Obscure Linear and Nonlinear Computations

Efficient Homomorphic Convolution Designs on FPGA for Secure Inference

Privacy preserving Neural Network Inference on Encrypted Data with GPUs

Privacy-Preserving DNN Training with Prefetched Meta-Keys on Heterogeneous Neural Network Accelerators

XNET: A Real-Time Unified Secure Inference Framework Using Homomorphic Encryption.

FastSecNet: An Efficient Cryptographic Framework for Private Neural Network Inference

A Multi-Layer Parallel Hardware Architecture for Homomorphic Computation in Machine Learning

MOFHEI: Model Optimizing Framework for Fast and Efficient Homomorphically Encrypted Neural Network Inference

An Efficient Convolution Core Architecture For Privacy-Preserving Deep Learning

TDPP: 2-D Permutation-Based Protection of Memristive Deep Neural Networks

Enabling Secure In-Memory Neural Network Computing by Sparse Fast Gradient Encryption

Faster CryptoNets: Leveraging Sparsity for Real-World Encrypted Inference

HyPHEN: A Hybrid Packing Method and Optimizations for Homomorphic Encryption-Based Neural Networks

Toward Practical Privacy-Preserving Convolutional Neural Networks Exploiting Fully Homomorphic Encryption

Joint Linear and Nonlinear Computation Across Functions for Efficient Privacy-Preserving Neural Network Inference

PrivCirNet: Efficient Private Inference via Block Circulant Transformation

THE-V: Verifiable Privacy-Preserving Neural Network Via Trusted Homomorphic Execution

CryptoGCN: Fast and Scalable Homomorphically Encrypted Graph Convolutional Network Inference

ENIGMA: Low-Latency and Privacy-Preserving Edge Inference on Heterogeneous Neural Network Accelerators

A Secure Convolutional Neural Network Inference Model Based on Homomorphic Encryption