On Neural Quantum Support Vector Machines

Lars Simon,Manuel Radons

2023-11-24

Abstract:In \cite{simon2023algorithms} we introduced four algorithms for the training of neural support vector machines (NSVMs) and demonstrated their feasibility. In this note we introduce neural quantum support vector machines, that is, NSVMs with a quantum kernel, and extend our results to this setting.

Quantum Physics,Machine Learning

What problem does this paper attempt to address?

Quantum Algorithms for Feedforward Neural Networks

Jonathan Allcock,Chang-Yu Hsieh,Iordanis Kerenidis,Shengyu Zhang

DOI: https://doi.org/10.1145/3411466

2020-01-01

ACM Transactions on Quantum Computing

Abstract:Quantum machine learning has the potential for broad industrial applications, and the development of quantum algorithms for improving the performance of neural networks is of particular interest given the central role they play in machine learning today. We present quantum algorithms for training and evaluating feedforward neural networks based on the canonical classical feedforward and backpropagation algorithms. Our algorithms rely on an efficient quantum subroutine for approximating inner products between vectors in a robust way, and on implicitly storing intermediate values in quantum random access memory for fast retrieval at later stages. The running times of our algorithms can be quadratically faster in the size of the network than their standard classical counterparts since they depend linearly on the number of neurons in the network, and not on the number of connections between neurons. Furthermore, networks trained by our quantum algorithm may have an intrinsic resilience to overfitting, as the algorithm naturally mimics the effects of classical techniques used to regularize networks. Our algorithms can also be used as the basis for new quantum-inspired classical algorithms with the same dependence on the network dimensions as their quantum counterparts but with quadratic overhead in other parameters that makes them relatively impractical.
Enhancing Quantum Support Vector Machines through Variational Kernel Training

Nouhaila Innan,Muhammad Al-Zafar Khan,Biswaranjan Panda,Mohamed Bennai

DOI: https://doi.org/10.1007/s11128-023-04138-3

2023-05-11

Abstract:Quantum machine learning (QML) has witnessed immense progress recently, with quantum support vector machines (QSVMs) emerging as a promising model. This paper focuses on the two existing QSVM methods: quantum kernel SVM (QK-SVM) and quantum variational SVM (QV-SVM). While both have yielded impressive results, we present a novel approach that synergizes the strengths of QK-SVM and QV-SVM to enhance accuracy. Our proposed model, quantum variational kernel SVM (QVK-SVM), leverages the quantum kernel and quantum variational algorithm. We conducted extensive experiments on the Iris dataset and observed that QVK-SVM outperforms both existing models in terms of accuracy, loss, and confusion matrix indicators. Our results demonstrate that QVK-SVM holds tremendous potential as a reliable and transformative tool for QML applications. Hence, we recommend its adoption in future QML research endeavors.

Quantum Physics,Machine Learning
A Quantum Extension of SVM-perf for Training Nonlinear SVMs in Almost Linear Time

Jonathan Allcock,Chang-Yu Hsieh

DOI: https://doi.org/10.22331/q-2020-10-15-342

2020-01-01

Quantum

Abstract:We propose a quantum algorithm for training nonlinear support vector machines (SVM) for feature space learning where classical input data is encoded in the amplitudes of quantum states. Based on the classical SVM-perf algorithm of Joachims \cite{joachims2006training}, our algorithm has a running time which scales linearly in the number of training examples m (up to polylogarithmic factors) and applies to the standard soft-margin ℓ1-SVM model. In contrast, while classical SVM-perf has demonstrated impressive performance on both linear and nonlinear SVMs, its efficiency is guaranteed only in certain cases: it achieves linear m scaling only for linear SVMs, where classification is performed in the original input data space, or for the special cases of low-rank or shift-invariant kernels. Similarly, previously proposed quantum algorithms either have super-linear scaling in m, or else apply to different SVM models such as the hard-margin or least squares ℓ2-SVM which lack certain desirable properties of the soft-margin ℓ1-SVM model. We classically simulate our algorithm and give evidence that it can perform well in practice, and not only for asymptotically large data sets.
Quantum support vector machine based on regularized Newton method

Rui Zhang,Jian Wang,Nan Jiang,Hong Li,Zichen Wang

DOI: https://doi.org/10.1016/j.neunet.2022.03.043

IF: 7.8

2022-07-01

Neural Networks

Abstract:An elegant quantum version of least-square support vector machine, which is exponentially faster than the classical counterpart, was given by Rebentrost et al. using the matrix inversion algorithm (HHL). However, the application of the HHL algorithm is restricted when the structure of the input matrix is not well. The iteration algorithms such as the Newton method are widespread in training the classical support vector machine. This paper demonstrates a quantum support vector machine based on the regularized Newton method (RN-QSVM), which achieves an exponential speed-up over classical algorithm. At first, the regularized quantum Newton algorithm is proposed to get rid of the constraint of input matrix. Then we train the RN-QSVM by using the regularized quantum Newton algorithm and classify a query sample by constructing the quantum state. Experiments demonstrate that RN-QSVM respectively provides advantages in terms of accuracy, robustness, and complexity compared to QSLS-SVM, LS-QSVM, and the classical method.

computer science, artificial intelligence,neurosciences
Quantum support vector machine without iteration

Rui Zhang,Jian Wang,Nan Jiang,Zichen Wang

DOI: https://doi.org/10.1016/j.ins.2023.03.106

IF: 8.1

2023-03-29

Information Sciences

Abstract:Quantum algorithms can enhance machine learning in different aspects. The quantum support vector machine was proposed to improve the performance, in which the Swap Test plays a crucial role in realizing the classification. However, as the Swap Test is destructive, the quantum support vector machine must be repeated in preparing qubits and manipulating operations. This paper proposes a quantum support vector machine based on the amplitude estimation (AE-QSVM) which gets rid of the constraint of repetitive process and saves the quantum resources. At first, a generalized quantum amplitude estimation is introduced in which the initial state can be arbitrary instead of being |0〉. Then, AE-QSVM is trained by the quantum singular value decomposition and a query sample is classified by the generalized quantum amplitude estimation. In AE-QSVM, a high accuracy can be achieved by adding auxiliary qubits instead of repeating the algorithm. The time and space complexity of AE-QSVM are reduced compared with other algorithms. Finally, we ran experiments on the IBM's quantum computer and experimental results demonstrate that classification with a 95% probability of success only uses 12 qubits.

computer science, information systems
Experimental Realization of a Quantum Support Vector Machine.

Zhaokai Li,Xiaomei Liu,Nanyang Xu,Jiangfeng Du

DOI: https://doi.org/10.1103/physrevlett.114.140504

IF: 8.6

2015-01-01

Physical Review Letters

Abstract:The fundamental principle of artificial intelligence is the ability of machines to learn from previous experience and do future work accordingly. In the age of big data, classical learning machines often require huge computational resources in many practical cases. Quantum machine learning algorithms, on the other hand, could be exponentially faster than their classical counterparts by utilizing quantum parallelism. Here, we demonstrate a quantum machine learning algorithm to implement handwriting recognition on a four-qubit NMR test bench. The quantum machine learns standard character fonts and then recognizes handwritten characters from a set with two candidates. Because of the wide spread importance of artificial intelligence and its tremendous consumption of computational resources, quantum speedup would be extremely attractive against the challenges of big data.
Quantum-Inspired Support Vector Machine

Chen Ding,Tian-Yi Bao,He-Liang Huang

DOI: https://doi.org/10.1109/tnnls.2021.3084467

IF: 14.255

2021-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Support vector machine (SVM) is a particularly powerful and flexible supervised learning model that analyzes data for both classification and regression, whose usual algorithm complexity scales polynomially with the dimension of data space and the number of data points. To tackle the big data challenge, a quantum SVM algorithm was proposed, which is claimed to achieve exponential speedup for least squares SVM (LS-SVM). Here, inspired by the quantum SVM algorithm, we present a quantum-inspired classical algorithm for LS-SVM. In our approach, an improved fast sampling technique, namely indirect sampling, is proposed for sampling the kernel matrix and classifying. We first consider the LS-SVM with a linear kernel, and then discuss the generalization of our method to nonlinear kernels. Theoretical analysis shows our algorithm can make classification with arbitrary success probability in logarithmic runtime of both the dimension of data space and the number of data points for low rank, low condition number, and high dimensional data matrix, matching the runtime of the quantum SVM.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Adiabatic Quantum Support Vector Machines

Prasanna Date,Dong Jun Woun,Kathleen Hamilton,Eduardo A. Coello Perez,Mayanka Chandra Shekhar,Francisco Rios,John Gounley,In-Saeng Suh,Travis Humble,Georgia Tourassi

2024-01-23

Abstract:Adiabatic quantum computers can solve difficult optimization problems (e.g., the quadratic unconstrained binary optimization problem), and they seem well suited to train machine learning models. In this paper, we describe an adiabatic quantum approach for training support vector machines. We show that the time complexity of our quantum approach is an order of magnitude better than the classical approach. Next, we compare the test accuracy of our quantum approach against a classical approach that uses the Scikit-learn library in Python across five benchmark datasets (Iris, Wisconsin Breast Cancer (WBC), Wine, Digits, and Lambeq). We show that our quantum approach obtains accuracies on par with the classical approach. Finally, we perform a scalability study in which we compute the total training times of the quantum approach and the classical approach with increasing number of features and number of data points in the training dataset. Our scalability results show that the quantum approach obtains a 3.5--4.5 times speedup over the classical approach on datasets with many (millions of) features.

Machine Learning,Artificial Intelligence,Quantum Physics
Machine Learning in the Quantum Age: Quantum vs. Classical Support Vector Machines

Davut Emre Tasar,Kutan Koruyan,Ceren Ocal Tasar

2023-10-17

Abstract:This work endeavors to juxtapose the efficacy of machine learning algorithms within classical and quantum computational paradigms. Particularly, by emphasizing on Support Vector Machines (SVM), we scrutinize the classification prowess of classical SVM and Quantum Support Vector Machines (QSVM) operational on quantum hardware over the Iris dataset. The methodology embraced encapsulates an extensive array of experiments orchestrated through the Qiskit library, alongside hyperparameter optimization. The findings unveil that in particular scenarios, QSVMs extend a level of accuracy that can vie with classical SVMs, albeit the execution times are presently protracted. Moreover, we underscore that augmenting quantum computational capacity and the magnitude of parallelism can markedly ameliorate the performance of quantum machine learning algorithms. This inquiry furnishes invaluable insights regarding the extant scenario and future potentiality of machine learning applications in the quantum epoch. Colab: <a class="link-external link-https" href="https://t.ly/QKuz0" rel="external noopener nofollow">this https URL</a>

Machine Learning
Quantum support vector machines for classification and regression on a trapped-ion quantum computer

Teppei Suzuki,Takashi Hasebe,Tsubasa Miyazaki

2024-05-01

Abstract:Quantum machine learning is a rapidly growing field at the intersection of quantum computing and machine learning. In this work, we examine our quantum machine learning models, which are based on quantum support vector classification (QSVC) and quantum support vector regression (QSVR). We investigate these models using a quantum-circuit simulator, both with and without noise, as well as the IonQ Harmony quantum processor. For the QSVC tasks, we use a dataset containing fraudulent credit card transactions and image datasets (the MNIST and the Fashion-MNIST datasets); for the QSVR tasks, we use a financial dataset and a materials dataset. For the classification tasks, the performance of our QSVC models using 4 qubits of the trapped-ion quantum computer was comparable to that obtained from noiseless quantum-circuit simulations. The result is consistent with the analysis of our device-noise simulations with varying qubit-gate error rates. For the regression tasks, applying a low-rank approximation to the noisy quantum kernel, in combination with hyperparameter tuning in {\epsilon}-SVR, improved the performance of the QSVR models on the near-term quantum device. The alignment, as measured by the Frobenius inner product between the noiseless and noisy quantum kernels, can serve as an indicator of the relative prediction performance on noisy quantum devices in comparison with their ideal counterparts. Our results suggest that the quantum kernel, as described by our shallow quantum circuit, can be effectively used for both QSVC and QSVR tasks, indicating its resistance to noise and its adaptability to various datasets.

Quantum Physics,Chemical Physics
Variational Quantum-Neural Hybrid Eigensolver.

Shi-Xin Zhang,Zhou-Quan Wan,Chee-Kong Lee,Chang-Yu Hsieh,Shengyu Zhang,Hong Yao

DOI: https://doi.org/10.1103/physrevlett.128.120502

IF: 8.6

2022-01-01

Physical Review Letters

Abstract:The variational quantum eigensolver (VQE) is one of the most representative quantum algorithms in the noisy intermediate-scale quantum (NISQ) era, and is generally speculated to deliver one of the first quantum advantages for the ground-state simulations of some nontrivial Hamiltonians. However, short quantum coherence time and limited availability of quantum hardware resources in the NISQ hardware strongly restrain the capacity and expressiveness of VQEs. In this Letter, we introduce the variational quantum-neural hybrid eigensolver (VQNHE) in which the shallow-circuit quantum Ansatz can be further enhanced by classical post-processing with neural networks. We show that the VQNHE consistently and significantly outperforms the VQE in simulating ground-state energies of quantum spins and molecules given the same amount of quantum resources. More importantly, we demonstrate that, for arbitrary postprocessing neural functions, the VQNHE only incurs a polynomial overhead of processing time and represents the first scalable method to exponentially accelerate the VQE with nonunitary postprocessing that can be efficiently implemented in the NISQ era.
Quantum Methods for Neural Networks and Application to Medical Image Classification

Jonas Landman,Natansh Mathur,Yun Yvonna Li,Martin Strahm,Skander Kazdaghli,Anupam Prakash,Iordanis Kerenidis

DOI: https://doi.org/10.22331/q-2022-12-22-881

2022-12-23

Quantum

Abstract:Quantum 6, 881 (2022). https://doi.org/10.22331/q-2022-12-22-881 Quantum machine learning techniques have been proposed as a way to potentially enhance performance in machine learning applications. In this paper, we introduce two new quantum methods for neural networks. The first one is a quantum orthogonal neural network, which is based on a quantum pyramidal circuit as the building block for implementing orthogonal matrix multiplication. We provide an efficient way for training such orthogonal neural networks; novel algorithms are detailed for both classical and quantum hardware, where both are proven to scale asymptotically better than previously known training algorithms. The second method is quantum-assisted neural networks, where a quantum computer is used to perform inner product estimation for inference and training of classical neural networks. We then present extensive experiments applied to medical image classification tasks using current state of the art quantum hardware, where we compare different quantum methods with classical ones, on both real quantum hardware and simulators. Our results show that quantum and classical neural networks generates similar level of accuracy, supporting the promise that quantum methods can be useful in solving visual tasks, given the advent of better quantum hardware.

physics, multidisciplinary,quantum science & technology
An Independent Implementation of Quantum Machine Learning Algorithms in Qiskit for Genomic Data

Navneet Singh,Shiva Raj Pokhrel

2024-05-16

Abstract:In this paper, we explore the power of Quantum Machine Learning as we extend, implement and evaluate algorithms like Quantum Support Vector Classifier (QSVC), Pegasos-QSVC, Variational Quantum Circuits (VQC), and Quantum Neural Networks (QNN) in Qiskit with diverse feature mapping techniques for genomic sequence classification.

Machine Learning,Artificial Intelligence
Quantum Machine Learning: Quantum Kernel Methods

Sanjeev Naguleswaran

2024-05-03

Abstract:Quantum algorithms based on quantum kernel methods have been investigated previously [1]. A quantum advantage is derived from the fact that it is possible to construct a family of datasets for which, only quantum processing can recognise the intrinsic labelling patterns, while for classical computers the dataset looks like noise. This is due to the algorithm leveraging inherent efficiencies in the computation of logarithms in a cyclic group. The discrete log

Quantum Physics,Machine Learning
Neural-network-encoded variational quantum algorithms

Jiaqi Miao,Chang-Yu Hsieh,Shi-Xin Zhang

DOI: https://doi.org/10.1103/physrevapplied.21.014053

IF: 4.6

2024-01-27

Physical Review Applied

Abstract:We introduce a general framework called neural-network- (NN) encoded variational quantum algorithms (VQAs), or NNVQA for short, to address the challenges of implementing VQAs on noisy intermediate-scale quantum (NISQ) computers. Specifically, NNVQA feeds input (such as parameters of a Hamiltonian) from a given problem to a neural network and uses its outputs to parameterize an ansatz circuit for the standard VQA. Combining the strengths of NN and parameterized quantum circuits, NNVQA can accelerate the training process of VQAs and handle a broad family of related problems with varying input parameters with the pretrained NN. To concretely illustrate the merits of NNVQA, we present results on a NN variational quantum eigensolver (VQE) for solving the ground state of parameterized XXZ spin models in one and two dimensions. Our results demonstrate that NNVQE is able to estimate the ground-state energies of parameterized Hamiltonians with high precision without fine tuning, and significantly reduce the overall training cost to estimate ground-state properties across the phases of the given Hamiltonian. We also employ an active learning strategy to further increase the training efficiency while maintaining prediction accuracy. These encouraging results demonstrate that NNVQAs offer an alternative hybrid quantum-classical paradigm to utilize NISQ resources for solving more realistic and challenging computational problems. https://doi.org/10.1103/PhysRevApplied.21.014053 © 2024 American Physical Society

physics, applied
The complexity of quantum support vector machines

Gian Gentinetta,Arne Thomsen,David Sutter,Stefan Woerner

DOI: https://doi.org/10.22331/q-2024-01-11-1225

2024-01-08

Abstract:Quantum support vector machines employ quantum circuits to define the kernel function. It has been shown that this approach offers a provable exponential speedup compared to any known classical algorithm for certain data sets. The training of such models corresponds to solving a convex optimization problem either via its primal or dual formulation. Due to the probabilistic nature of quantum mechanics, the training algorithms are affected by statistical uncertainty, which has a major impact on their complexity. We show that the dual problem can be solved in $O(M^{4.67}/\varepsilon^2)$ quantum circuit evaluations, where $M$ denotes the size of the data set and $\varepsilon$ the solution accuracy compared to the ideal result from exact expectation values, which is only obtainable in theory. We prove under an empirically motivated assumption that the kernelized primal problem can alternatively be solved in $O(\min \{ M^2/\varepsilon^6, \, 1/\varepsilon^{10} \})$ evaluations by employing a generalization of a known classical algorithm called Pegasos. Accompanying empirical results demonstrate these analytical complexities to be essentially tight. In addition, we investigate a variational approximation to quantum support vector machines and show that their heuristic training achieves considerably better scaling in our experiments.

Quantum Physics,Machine Learning
Neural Networks for Programming Quantum Annealers

Samuel Bosch,Bobak Kiani,Rui Yang,Adrian Lupascu,Seth Lloyd

2023-08-14

Abstract:Quantum machine learning has the potential to enable advances in artificial intelligence, such as solving problems intractable on classical computers. Some fundamental ideas behind quantum machine learning are similar to kernel methods in classical machine learning. Both process information by mapping it into high-dimensional vector spaces without explicitly calculating their numerical values. We explore a setup for performing classification on labeled classical datasets, consisting of a classical neural network connected to a quantum annealer. The neural network programs the quantum annealer's controls and thereby maps the annealer's initial states into new states in the Hilbert space. The neural network's parameters are optimized to maximize the distance of states corresponding to inputs from different classes and minimize the distance between quantum states corresponding to the same class. Recent literature showed that at least some of the "learning" is due to the quantum annealer, connecting a small linear network to a quantum annealer and using it to learn small and linearly inseparable datasets. In this study, we consider a similar but not quite the same case, where a classical fully-fledged neural network is connected with a small quantum annealer. In such a setting, the fully-fledged classical neural-network already has built-in nonlinearity and learning power, and can already handle the classification problem alone, we want to see whether an additional quantum layer could boost its performance. We simulate this system to learn several common datasets, including those for image and sound recognition. We conclude that adding a small quantum annealer does not provide a significant benefit over just using a regular (nonlinear) classical neural network.

Quantum Physics,Artificial Intelligence
Variational Quantum Linear Solver enhanced Quantum Support Vector Machine

Jianming Yi,Kalyani Suresh,Ali Moghiseh,Norbert Wehn

2023-09-14

Abstract:Quantum Support Vector Machines (QSVM) play a vital role in using quantum resources for supervised machine learning tasks, such as classification. However, current methods are strongly limited in terms of scalability on Noisy Intermediate Scale Quantum (NISQ) devices. In this work, we propose a novel approach called the Variational Quantum Linear Solver (VQLS) enhanced QSVM. This is built upon our idea of utilizing the variational quantum linear solver to solve system of linear equations of a least squares-SVM on a NISQ device. The implementation of our approach is evaluated by an extensive series of numerical experiments with the Iris dataset, which consists of three distinct iris plant species. Based on this, we explore the practicality and effectiveness of our algorithm by constructing a classifier capable of classification in a feature space ranging from one to seven dimensions. Furthermore, by strategically exploiting both classical and quantum computing for various subroutines of our algorithm, we effectively mitigate practical challenges associated with the implementation. These include significant improvement in the trainability of the variational ansatz and notable reductions in run-time for cost calculations. Based on the numerical experiments, our approach exhibits the capability of identifying a separating hyperplane in an 8-dimensional feature space. Moreover, it consistently demonstrated strong performance across various instances with the same dataset.

Quantum Physics,Artificial Intelligence,Machine Learning
Quantum kernel estimation-based quantum support vector regression

Yu, Jieyao,Tan, Junfan,Jiang, Ting

DOI: https://doi.org/10.1007/s11128-023-04231-7

IF: 1.965

2024-01-24

Quantum Information Processing

Abstract:Quantum machine learning endeavors to exploit quantum mechanical effects like superposition, entanglement, and interference to enhance the capabilities of classical machine learning methods. One of the most researched quantum machine learning methodologies presently is the quantum support vector machine (QSVM). Researchers have now developed quantum support vector classifiers and substantiated their potential for accelerating computation and enhancing classification accuracy in practical contexts through experimentation. Nevertheless, the utility of QSVM in regression tasks remains a relatively uncharted territory. In light of this, we introduce a quantum kernel estimation-based quantum support vector regression (QKE-QSVR) model for completing regression tasks. Within this proposed model, classical inputs are encoded as quantum feature vectors using the designed quantum feature map circuit with a variable parameter. The inner product between quantum feature vectors give rise to a trainable quantum kernel, which is subject to optimization through our proposed quantum kernel alignment-based regression (QKAR) algorithm, thereby bolstering the model's predictive accuracy when applied to a specific dataset. Subsequently, the trained quantum kernel is incorporated into the classical support vector regression process to construct the decision function and provide predictions for new data points. In this study, we validate the efficacy of the proposed model using three illustrative examples. Experimental findings underscore that, in comparison to the classical support vector machine model, our proposed model demonstrates superior predictive accuracy.

physics, multidisciplinary,quantum science & technology, mathematical

On Neural Quantum Support Vector Machines

Quantum Algorithms for Feedforward Neural Networks

Enhancing Quantum Support Vector Machines through Variational Kernel Training

A Quantum Extension of SVM-perf for Training Nonlinear SVMs in Almost Linear Time

Quantum support vector machine based on regularized Newton method

Quantum support vector machine without iteration

Experimental Realization of a Quantum Support Vector Machine.

Quantum-Inspired Support Vector Machine

Adiabatic Quantum Support Vector Machines

Machine Learning in the Quantum Age: Quantum vs. Classical Support Vector Machines

Quantum support vector machines for classification and regression on a trapped-ion quantum computer

Variational Quantum-Neural Hybrid Eigensolver.

Quantum Methods for Neural Networks and Application to Medical Image Classification

An Independent Implementation of Quantum Machine Learning Algorithms in Qiskit for Genomic Data

Quantum Machine Learning: Quantum Kernel Methods

Neural-network-encoded variational quantum algorithms

The complexity of quantum support vector machines

Neural Networks for Programming Quantum Annealers

Variational Quantum Linear Solver enhanced Quantum Support Vector Machine

Quantum kernel estimation-based quantum support vector regression