Toward Trainability of Quantum Neural Networks

Kaining Zhang,Min-Hsiu Hsieh,Liu Liu,Dacheng Tao
DOI: https://doi.org/10.48550/arxiv.2011.06258
2020-01-01
Abstract: Quantum Neural Networks (QNNs) have been recently proposed as generalizations of classical neural networks to achieve the quantum speed-up. Despite the potential to outperform classical models, serious bottlenecks exist for training QNNs; namely, QNNs with random structures have poor trainability due to the vanishing gradient with rate exponential to the input qubit number. The vanishing gradient could seriously influence the applications of large-size QNNs. In this work, we provide a first viable solution with theoretical guarantees. Specifically, we prove that QNNs with tree tensor architectures have gradients that vanish polynomially with the qubit number. Moreover, our result holds irrespective of which encoding methods are employed. We numerically demonstrate QNNs with tree tensor structures for the application of binary classification. Simulations show faster convergent rates and better accuracy compared to QNNs with random structures.
What problem does this paper attempt to address?