Abstract:The feasibility of variational quantum algorithms, the most popular correspondent of neural networks on noisy, near-term quantum hardware, is highly impacted by the circuit depth of the involved parametrized quantum circuits (PQCs). Higher depth increases expressivity, but also results in a detrimental accumulation of errors. Furthermore, the number of parameters involved in the PQC significantly influences the performance through the necessary number of measurements to evaluate gradients, which scales linearly with the number of parameters. Motivated by this, we look at deep equilibrium models (DEQs), which mimic an infinite-depth, weight-tied network using a fraction of the memory by employing a root solver to find the fixed points of the network. In this work, we present Quantum Deep Equilibrium Models (QDEQs): a training paradigm that learns parameters of a quantum machine learning model given by a PQC using DEQs. To our knowledge, no work has yet explored the application of DEQs to QML models. We apply QDEQs to find the parameters of a quantum circuit in two settings: the first involves classifying MNIST-4 digits with 4 qubits; the second extends it to 10 classes of MNIST, FashionMNIST and CIFAR. We find that QDEQ is not only competitive with comparable existing baseline models, but also achieves higher performance than a network with 5 times more layers. This demonstrates that the QDEQ paradigm can be used to develop significantly more shallow quantum circuits for a given task, something which is essential for the utility of near-term quantum computers. Our code is available at <a class="link-external link-https" href="https://github.com/martaskrt/qdeq" rel="external noopener nofollow">this https URL</a>.

TorchDEQ: A Library for Deep Equilibrium Models

Quantum Deep Equilibrium Models

Efficient Training of Deep Equilibrium Models

A Closer Look at the Adversarial Robustness of Deep Equilibrium Models

CerDEQ: Certifiable Deep Equilibrium Model.

Improving Adversarial Robustness of DEQs with Explicit Regulations Along the Neural Dynamics

Positive concave deep equilibrium models

Improving Adversarial Robustness of Deep Equilibrium Models with Explicit Regulations along the Neural Dynamics

TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions

torchdistill: A Modular, Configuration-Driven Framework for Knowledge Distillation

A Unified Perspective on Deep Equilibrium Finding

One-Step Diffusion Distillation via Deep Equilibrium Models

XuanCe: A Comprehensive and Unified Deep Reinforcement Learning Library

Two Sides of The Same Coin: Bridging Deep Equilibrium Models and Neural ODEs via Homotopy Continuation

TorchRL: A data-driven decision-making library for PyTorch

Global Convergence of Over-parameterized Deep Equilibrium Models

Deep Equilibrium Models Meet Federated Learning

Tianshou: A Highly Modularized Deep Reinforcement Learning Library

GEQ: Gaussian Kernel Inspired Equilibrium Models

torchdistill Meets Hugging Face Libraries for Reproducible, Coding-Free Deep Learning Studies: A Case Study on NLP

TorchMD: A deep learning framework for molecular simulations