Abstract:Quantum machine learning models based on parametrized quantum circuits, also called quantum neural networks (QNNs), are considered to be among the most promising candidates for applications on near-term quantum devices. Here we explore the expressivity and inductive bias of QNNs by exploiting an exact mapping from QNNs with inputs $x$ to classical perceptrons acting on $x \otimes x$ (generalised to complex inputs). The simplicity of the perceptron architecture allows us to provide clear examples of the shortcomings of current QNN models, and the many barriers they face to becoming useful general-purpose learning algorithms. For example, a QNN with amplitude encoding cannot express the Boolean parity function for $n\geq 3$, which is but one of an exponential number of data structures that such a QNN is unable to express. Mapping a QNN to a classical perceptron simplifies training, allowing us to systematically study the inductive biases of other, more expressive embeddings on Boolean data. Several popular embeddings primarily produce an inductive bias towards functions with low class balance, reducing their generalisation performance compared to deep neural network architectures which exhibit much richer inductive biases. We explore two alternate strategies that move beyond standard QNNs. In the first, we use a QNN to help generate a classical DNN-inspired kernel. In the second we draw an analogy to the hierarchical structure of deep neural networks and construct a layered non-linear QNN that is provably fully expressive on Boolean data, while also exhibiting a richer inductive bias than simple QNNs. Finally, we discuss characteristics of the QNN literature that may obscure how hard it is to achieve quantum advantage over deep learning algorithms on classical data.

Randomness-Enhanced Expressivity of Quantum Neural Networks

Randomness-enhanced expressivity of quantum neural networks

Predictive Modelling of Quantum Process with Neural Networks

Enhancing the expressivity of quantum neural networks with residual connections

A Quantum-Implementable Neural Network Model

Quantum Algorithms for Feedforward Neural Networks

State Classification via a Random-Walk-Based Quantum Neural Network

Maximising Quantum-Computing Expressive Power through Randomised Circuits

Training-efficient density quantum machine learning

Machine-Learning-Assisted Quantum Control in a Random Environment

Statistical Analysis of Quantum State Learning Process in Quantum Neural Networks

Building Quantum Neural Networks Based on a Swap Test

Reduction of finite sampling noise in quantum neural networks

Quantum-inspired activation functions and quantum Chebyshev-polynomial network

Exploiting the equivalence between quantum neural networks and perceptrons

Quantum Pointwise Convolution: A Flexible and Scalable Approach for Neural Network Enhancement

The Expressivity of Classical and Quantum Neural Networks on Entanglement Entropy

Quantum-inspired activation functions in the convolutional neural network

Quantum Neural Network for Quantum Neural Computing

Toward Trainability of Quantum Neural Networks