Abstract:Relying on the rapidly increasing capacity of computing clusters and hardware, convolutional neural networks (CNNs) have been successfully applied in various fields and achieved state-of-the-art results. Despite these exciting developments, the huge memory cost is still involved in training and inferring a large-scale CNN model and makes it hard to be widely used in resource-limited portable devices. To address this problem, we establish a training framework for three-dimensional convolutional neural networks (3DCNNs) named QTTNet that combines tensor train (TT) decomposition and data quantization together for further shrinking the model size and decreasing the memory and time cost. Through this framework, we can fully explore the superiority of TT in reducing the number of trainable parameters and the advantage of quantization in decreasing the bit-width of data, particularly compressing 3DCNN model greatly with little accuracy degradation. In addition, due to the low bit quantization to all parameters during the inference process including TT-cores, activations, and batch normalizations, the proposed method naturally takes advantage in memory and time cost. Experimental results of compressing 3DCNNs for 3D object and video recognition on ModelNet40, UCF11, and UCF50 datasets verify the effectiveness of the proposed method. The best compression ratio we have obtained is up to nearly 180× with competitive performance compared with other state-of-the-art researches. Moreover, the total bytes of our QTTNet models on ModelNet40 and UCF11 datasets can be 1000× lower than some typical practices such as MVCNN.

Quantized Tensor Neural Network

Quantum-enhanced neural networks in the neural tangent kernel framework

QTTNet: Quantized Tensor Train Neural Networks for 3D Object and Video Recognition.

Tensor Ring Optimized Quantum-Enhanced Tensor Neural Networks

Quantum-Train with Tensor Network Mapping Model and Distributed Circuit Ansatz

Quantum-Classical Machine learning by Hybrid Tensor Networks

Toward Trainability of Quantum Neural Networks

Variational Quantum Tensor Networks Classifiers

Tensorial Neural Networks: Generalization of Neural Networks and Application to Model Compression

QFCNN: Quantum Fourier Convolutional Neural Network

QTN-VQC: An End-to-End Learning framework for Quantum Neural Networks

CTRQNets & LQNets: Continuous Time Recurrent and Liquid Quantum Neural Networks

A Quantum-Implementable Neural Network Model

Quantum Fourier Convolutional Network

Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations

Quantization Networks

Pre-training Tensor-Train Networks Facilitates Machine Learning with Variational Quantum Circuits

QTN-MLP: Quantum Tensor Network-enhanced MLP for Medical Image Classification

$\mathbb{Z}_2\times \mathbb{Z}_2$ Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networks

Quantum Neural Network and Its Applications

Tensor-view Topological Graph Neural Network