Quantum Algorithms for Anomaly Detection Using Amplitude Estimation

Mingchao Guo,Hailing Liu,Yongmei Li,Wenmin Li,Fei Gao,Su‐Juan Qin,Qiaoyan Wen

DOI: https://doi.org/10.2139/ssrn.4092653

2022-01-01

SSRN Electronic Journal

Abstract:Download This Paper Open PDF in Browser Add Paper to My Library Share: Permalink Using these links will ensure access to this page indefinitely Copy URL Copy DOI

What problem does this paper attempt to address?

Quantum Algorithm for Unsupervised Anomaly Detection

MingChao Guo,ShiJie Pan,WenMin Li,Fei Gao,SuJuan Qin,XiaoLing Yu,XuanWen Zhang,QiaoYan Wen

DOI: https://doi.org/10.1016/j.physa.2023.129018

2023-04-18

Abstract:Anomaly detection, an important branch of machine learning, plays a critical role in fraud detection, health care, intrusion detection, military surveillance, etc. As one of the most commonly used unsupervised anomaly detection algorithms, the Local Outlier Factor algorithm (LOF algorithm) has been extensively studied. This algorithm contains three steps, i.e., determining the k-distance neighborhood for each data point x, computing the local reachability density of x, and calculating the local outlier factor of x to judge whether x is abnormal. The LOF algorithm is computationally expensive when processing big data sets. Here we present a quantum LOF algorithm consisting of three parts corresponding to the classical algorithm. Specifically, the k-distance neighborhood of x is determined by amplitude estimation and minimum search; the local reachability density of each data point is calculated in parallel based on the quantum multiply-adder; the local outlier factor of each data point is obtained in parallel using amplitude estimation. It is shown that our quantum algorithm achieves exponential speedup on the dimension of the data points and polynomial speedup on the number of data points compared to its classical counterpart. This work demonstrates the advantage of quantum computing in unsupervised anomaly detection.

Quantum Physics
Quantum Algorithm for Anomaly Detection of Sequences

Ming-Chao Guo,Hai-Ling Liu,Shi-Jie Pan,Wen-Min Li,Su-Juan Qin,Xin-Yi Huang,Fei Gao,Qiao-Yan Wen

DOI: https://doi.org/10.1002/qute.202300082

2022-01-01

Advanced Quantum Technologies

Abstract: Anomaly detection of sequences is a hot topic in data mining. Anomaly Detection using Piecewise Aggregate approximation in the Amplitude Domain (called ADPAAD) is one of the widely used methods in anomaly detection of sequences. The core step in the classical algorithm for performing ADPAAD is to construct an approximate representation of the subsequence, where the elements of each subsequence are divided into several subsections according to the amplitude domain and then the average of the subsections is computed. It is computationally expensive when processing large-scale sequences. In this paper, we propose a quantum algorithm for ADPAAD, which can divide the subsequence elements and compute the average in parallel. Our quantum algorithm can achieve polynomial speedups on the number of subsequences and the length of subsequences over its classical counterpart.
Quantum Machine Learning For Quantum Anomaly Detection

Nana Liu,Patrick Rebentrost

DOI: https://doi.org/10.1103/PhysRevA.97.042315

IF: 2.971

2018-01-01

Physical Review A

Abstract:Anomaly detection is used for identifying data that deviate from "normal" data patterns. Its usage on classical data finds diverse applications in many important areas such as finance, fraud detection, medical diagnoses, data cleaning, and surveillance. With the advent of quantum technologies, anomaly detection of quantum data, in the form of quantum states, may become an important component of quantum applications. Machine-learning algorithms are playing pivotal roles in anomaly detection using classical data. Two widely used algorithms are the kernel principal component analysis and the one-class support vector machine. We find corresponding quantum algorithms to detect anomalies in quantum states. We show that these two quantum algorithms can be performed using resources that are logarithmic in the dimensionality of quantum states. For pure quantum states, these resources can also be logarithmic in the number of quantum states used for training the machine-learning algorithm. This makes these algorithms potentially applicable to big quantum data applications.
Quantum Machine Learning Algorithms for Anomaly Detection: a Review

Sebastiano Corli,Lorenzo Moro,Daniele Dragoni,Massimiliano Dispenza,Enrico Prati

2024-12-06

Abstract:The advent of quantum computers has justified the development of quantum machine learning algorithms , based on the adaptation of the principles of machine learning to the formalism of qubits. Among such quantum algorithms, anomaly detection represents an important problem crossing several disciplines from cybersecurity, to fraud detection to particle physics. We summarize the key concepts involved in quantum computing, introducing the formal concept of quantum speed up. The review provides a structured map of anomaly detection based on quantum machine learning. We have grouped existing algorithms according to the different learning methods, namely quantum supervised, quantum unsupervised and quantum reinforcement learning, respectively. We provide an estimate of the hardware resources to provide sufficient computational power in the future. The review provides a systematic and compact understanding of the techniques belonging to each category. We eventually provide a discussion on the computational complexity of the learning methods in real application domains.

Quantum Physics
Quantum Anomaly Detection with Density Estimation and Multivariate Gaussian Distribution

Jin-Min Liang,Shu-Qian Shen,Ming Li,Lei Li

DOI: https://doi.org/10.1103/physreva.99.052310

2019-01-01

Abstract:We study quantum anomaly detection with density estimation and multivariate Gaussian distribution. Both algorithms are constructed using the standard gate-based model of quantum computing. Compared with the corresponding classical algorithms, the resource complexities of our quantum algorithm are logarithmic in the dimensionality of quantum states and the number of training quantum states. We also present a quantum procedure for efficiently estimating the determinant of any Hermitian operators A is an element of R-NxN with time complexity O(poly log N), which forms an important subroutine in our quantum anomaly detection with multivariate Gaussian distribution. Finally, our results also include the modified quantum kernel principal component analysis (PCA) and the quantum one-class support vector machine (SVM) for detecting classical data.
Long-lived Particles Anomaly Detection with Parametrized Quantum Circuits

Simone Bordoni,Denis Stanev,Tommaso Santantonio,Stefano Giagu

DOI: https://doi.org/10.3390/particles6010016

2023-12-07

Abstract:We investigate the possibility to apply quantum machine learning techniques for data analysis, with particular regard to an interesting use-case in high-energy physics. We propose an anomaly detection algorithm based on a parametrized quantum circuit. This algorithm has been trained on a classical computer and tested with simulations as well as on real quantum hardware. Tests on NISQ devices have been performed with IBM quantum computers. For the execution on quantum hardware specific hardware driven adaptations have been devised and implemented. The quantum anomaly detection algorithm is able to detect simple anomalies like different characters in handwritten digits as well as more complex structures like anomalous patterns in the particle detectors produced by the decay products of long-lived particles produced at a collider experiment. For the high-energy physics application, performance is estimated in simulation only, as the quantum circuit is not simple enough to be executed on the available quantum hardware. This work demonstrates that it is possible to perform anomaly detection with quantum algorithms, however, as amplitude encoding of classical data is required for the task, due to the noise level in the available quantum hardware, current implementation cannot outperform classic anomaly detection algorithms based on deep neural networks.

Quantum Physics,High Energy Physics - Experiment
Quantum-inspired anomaly detection, a QUBO formulation

Julien Mellaerts

2023-11-07

Abstract:Anomaly detection is a crucial task in machine learning that involves identifying unusual patterns or events in data. It has numerous applications in various domains such as finance, healthcare, and cybersecurity. With the advent of quantum computing, there has been a growing interest in developing quantum approaches to anomaly detection. After reviewing traditional approaches to anomaly detection relying on statistical or distance-based methods, we will propose a Quadratic Unconstrained Binary Optimization (QUBO) model formulation of anomaly detection, compare it with classical methods, and discuss its scalability on current Quantum Processing Units (QPU).

Quantum Physics
Qsco: A Quantum Scoring Module for Open-set Supervised Anomaly Detection

Yifeng Peng,Xinyi Li,Zhiding Liang,Ying Wang

2024-12-17

Abstract:Open set anomaly detection (OSAD) is a crucial task that aims to identify abnormal patterns or behaviors in data sets, especially when the anomalies observed during training do not represent all possible classes of anomalies. The recent advances in quantum computing in handling complex data structures and improving machine learning models herald a paradigm shift in anomaly detection methodologies. This study proposes a Quantum Scoring Module (Qsco), embedding quantum variational circuits into neural networks to enhance the model's processing capabilities in handling uncertainty and unlabeled data. Extensive experiments conducted across eight real-world anomaly detection datasets demonstrate our model's superior performance in detecting anomalies across varied settings and reveal that integrating quantum simulators does not result in prohibitive time complexities. Our study validates the feasibility of quantum-enhanced anomaly detection methods in practical applications.

Machine Learning
Quantum multi-anomaly detection

Santiago Llorens,Gael Sentís,Ramon Muñoz-Tapia

DOI: https://doi.org/10.22331/q-2024-08-28-1452

2024-08-31

Quantum

Abstract:Quantum 8, 1452 (2024). https://doi.org/10.22331/q-2024-08-28-1452 A source assumed to prepare a specified reference state sometimes prepares an anomalous one. We address the task of identifying these anomalous states in a series of preparations with anomalies. We analyze the minimum-error protocol and the zero-error (unambiguous) protocol and obtain closed expressions for the success probability when both reference and anomalous states are known to the observer and anomalies can appear equally likely in any position of the preparation series. We find the solution using results from association schemes theory, thus establishing a connection between graph theory and quantum hypothesis testing. In particular, we use the Johnson association scheme which arises naturally from the Gram matrix of this problem. We also study the regime of large and obtain the expression of the success probability that is non-vanishing. Finally, we address the case in which the observer is blind to the reference and the anomalous states. This scenario requires a universal protocol for which we prove that in the asymptotic limit, the success probability corresponds to the average of the known state scenario.

physics, multidisciplinary,quantum science & technology
Applying Quantum Autoencoders for Time Series Anomaly Detection

Robin Frehner,Kurt Stockinger

2024-10-09

Abstract:Anomaly detection is an important problem with applications in various domains such as fraud detection, pattern recognition or medical diagnosis. Several algorithms have been introduced using classical computing approaches. However, using quantum computing for solving anomaly detection problems in time series data is a widely unexplored research field. This paper explores the application of quantum autoencoders to time series anomaly detection. We investigate two primary techniques for classifying anomalies: (1) Analyzing the reconstruction error generated by the quantum autoencoder and (2) latent representation analysis. Our simulated experimental results, conducted across various ansaetze, demonstrate that quantum autoencoders consistently outperform classical deep learning-based autoencoders across multiple datasets. Specifically, quantum autoencoders achieve superior anomaly detection performance while utilizing 60-230 times fewer parameters and requiring five times fewer training iterations. In addition, we implement our quantum encoder on real quantum hardware. Our experimental results demonstrate that quantum autoencoders achieve anomaly detection performance on par with their simulated counterparts.

Machine Learning,Artificial Intelligence,Emerging Technologies,Quantum Physics
Quantum similarity learning for anomaly detection

A. Hammad,Mihoko M. Nojiri,Masahito Yamazaki

2024-11-15

Abstract:Anomaly detection is a vital technique for exploring signatures of new physics Beyond the Standard Model (BSM) at the Large Hadron Collider (LHC). The vast number of collisions generated by the LHC demands sophisticated deep learning techniques. Similarity learning, a self-supervised machine learning, detects anomalous signals by estimating their similarity to background events. In this paper, we explore the potential of quantum computers for anomaly detection through similarity learning, leveraging the power of quantum computing to enhance the known similarity learning method. In the realm of noisy intermediate-scale quantum (NISQ) devices, we employ a hybrid classical-quantum network to search for heavy scalar resonances in the di-Higgs production channel. In the absence of quantum noise, the hybrid network demonstrates improvement over the known similarity learning method. Moreover, we employ a clustering algorithm to reduce measurement noise from limited shot counts, resulting in $9\%$ improvement in the hybrid network performance. Our analysis highlights the applicability of quantum algorithms for LHC data analysis, where improvements are anticipated with the advent of fault-tolerant quantum computers.

High Energy Physics - Phenomenology,High Energy Physics - Experiment,Quantum Physics
Exploring Unsupervised Anomaly Detection with Quantum Boltzmann Machines in Fraud Detection

Jonas Stein,Daniëlle Schuman,Magdalena Benkard,Thomas Holger,Wanja Sajko,Michael Kölle,Jonas Nüßlein,Leo Sünkel,Olivier Salomon,Claudia Linnhoff-Popien

DOI: https://doi.org/10.5220/0012326100003636

2024-01-17

Abstract:Anomaly detection in Endpoint Detection and Response (EDR) is a critical task in cybersecurity programs of large companies. With rapidly growing amounts of data and the omnipresence of zero-day attacks, manual and rule-based detection techniques are no longer eligible in practice. While classical machine learning approaches to this problem exist, they frequently show unsatisfactory performance in differentiating malicious from benign anomalies. A promising approach to attain superior generalization than currently employed machine learning techniques are quantum generative models. Allowing for the largest representation of data on available quantum hardware, we investigate Quantum Annealing based Quantum Boltzmann Machines (QBMs) for the given problem. We contribute the first fully unsupervised approach for the problem of anomaly detection using QBMs and evaluate its performance on an EDR inspired synthetic dataset. Our results indicate that QBMs can outperform their classical analog (i.e., Restricted Boltzmann Machines) in terms of result quality and training steps in special cases. When employing Quantum Annealers from D-Wave Systems, we conclude that either more accurate classical simulators or substantially more QPU time is needed to conduct the necessary hyperparameter optimization allowing to replicate our simulation results on quantum hardware.

Quantum Physics,Emerging Technologies
Quantum anomaly detection in the latent space of proton collision events at the LHC

Kinga Anna Woźniak,Vasilis Belis,Ema Puljak,Panagiotis Barkoutsos,Günther Dissertori,Michele Grossi,Maurizio Pierini,Florentin Reiter,Ivano Tavernelli,Sofia Vallecorsa

DOI: https://doi.org/10.48550/arXiv.2301.10780

2023-01-25

Quantum Physics

Abstract:We propose a new strategy for anomaly detection at the LHC based on unsupervised quantum machine learning algorithms. To accommodate the constraints on the problem size dictated by the limitations of current quantum hardware we develop a classical convolutional autoencoder. The designed quantum anomaly detection models, namely an unsupervised kernel machine and two clustering algorithms, are trained to find new-physics events in the latent representation of LHC data produced by the autoencoder. The performance of the quantum algorithms is benchmarked against classical counterparts on different new-physics scenarios and its dependence on the dimensionality of the latent space and the size of the training dataset is studied. For kernel-based anomaly detection, we identify a regime where the quantum model significantly outperforms its classical counterpart. An instance of the kernel machine is implemented on a quantum computer to verify its suitability for available hardware. We demonstrate that the observed consistent performance advantage is related to the inherent quantum properties of the circuit used.
Quantum support vector data description for anomaly detection

Hyeondo Oh,Daniel K. Park

2023-10-10

Abstract:Anomaly detection is a critical problem in data analysis and pattern recognition, finding applications in various domains. We introduce quantum support vector data description (QSVDD), an unsupervised learning algorithm designed for anomaly detection. QSVDD utilizes a shallow-depth quantum circuit to learn a minimum-volume hypersphere that tightly encloses normal data, tailored for the constraints of noisy intermediate-scale quantum (NISQ) computing. Simulation results on the MNIST and Fashion MNIST image datasets demonstrate that QSVDD outperforms both quantum autoencoder and deep learning-based approaches under similar training conditions. Notably, QSVDD offers the advantage of training an extremely small number of model parameters, which grows logarithmically with the number of input qubits. This enables efficient learning with a simple training landscape, presenting a compact quantum machine learning model with strong performance for anomaly detection.

Quantum Physics
Hyperspectral Anomaly Detection Using Quantum Potential Clustering

Bing Tu,Zhi Wang,Xianchang Yang,Jun Li,Antonio Plaza

DOI: https://doi.org/10.1109/tim.2022.3218561

IF: 5.6

2022-11-19

IEEE Transactions on Instrumentation and Measurement

Abstract:Quantum machine learning has attracted significant attention in recent years due to its capacity to reflect a particle's aggregation in the quantum domain. In this work, quantum machine learning is used to perform anomaly detection in hyperspectral images (HSIs) by considering pixels as particles in the quantum domain, and using the quantum potential to cluster the anomalies and background. Specifically, a new anomaly detection method is proposed based on quantum potential by first reformulating and applying quantum potential concepts to traditional HSI anomaly detection. Then, by using the weight matrix (also called distance matrix), the original wave function is modified to improve the anomaly detection accuracy. Finally, by considering the similarities between anomaly detection and human vision in the task of highlighting targets, an unsupervised salient strategy is also defined to achieve the final detection results. Through this method, we build the internal relationship between quantum potential energy clustering and hyperspectral anomaly detection (HAD). Our experimental results on four real HSIs reveal that the proposed method compares favorably with regards to other anomaly detection methods. Specially, the proposed method called quantum potential anomaly detection (QPAD) obtains a 0.2% increase on the average of the background suppression ability indicator.

engineering, electrical & electronic,instruments & instrumentation
Quantum Patch-Based Autoencoder for Anomaly Segmentation

Maria Francisca Madeira,Alessandro Poggiali,Jeanette Miriam Lorenz

2024-04-26

Abstract:Quantum Machine Learning investigates the possibility of quantum computers enhancing Machine Learning algorithms. Anomaly segmentation is a fundamental task in various domains to identify irregularities at sample level and can be addressed with both supervised and unsupervised methods. Autoencoders are commonly used in unsupervised tasks, where models are trained to reconstruct normal instances efficiently, allowing anomaly identification through high reconstruction errors. While quantum autoencoders have been proposed in the literature, their application to anomaly segmentation tasks remains unexplored. In this paper, we introduce a patch-based quantum autoencoder (QPB-AE) for image anomaly segmentation, with a number of parameters scaling logarithmically with patch size. QPB-AE reconstructs the quantum state of the embedded input patches, computing an anomaly map directly from measurement through a SWAP test without reconstructing the input image. We evaluate its performance across multiple datasets and parameter configurations and compare it against a classical counterpart.

Quantum Physics,Machine Learning
Quantum density estimation with density matrices: Application to quantum anomaly detection

Diego H. Useche,Oscar A. Bustos-Brinez,Joseph A. Gallego-Mejia,Fabio A. González

DOI: https://doi.org/10.1103/PhysRevA.109.032418

2024-03-18

Abstract:Density estimation is a central task in statistics and machine learning. This problem aims to determine the underlying probability density function that best aligns with an observed data set. Some of its applications include statistical inference, unsupervised learning, and anomaly detection. Despite its relevance, few works have explored the application of quantum computing to density estimation. In this article, we present a novel quantum-classical density matrix density estimation model, called Q-DEMDE, based on the expected values of density matrices and a novel quantum embedding called quantum Fourier features. The method uses quantum hardware to build probability distributions of training data via mixed quantum states. As a core subroutine, we propose a new algorithm to estimate the expected value of a mixed density matrix from its spectral decomposition on a quantum computer. In addition, we present an application of the method for quantum-classical anomaly detection. We evaluated the density estimation model with quantum random and quantum adaptive Fourier features on different data sets on a quantum simulator and a real quantum computer. An important result of this work is to show that it is possible to perform density estimation and anomaly detection with high performance on present-day quantum computers.

Quantum Physics
Quantum Generative Adversarial Networks For Anomaly Detection In High Energy Physics

Elie Bermot,Christa Zoufal,Michele Grossi,Julian Schuhmacher,Francesco Tacchino,Sofia Vallecorsa,Ivano Tavernelli

DOI: https://doi.org/10.1109/QCE57702.2023.00045

2023-12-07

Abstract:The standard model (SM) of particle physics represents a theoretical paradigm for the description of the fundamental forces of nature. Despite its broad applicability, the SM does not enable the description of all physically possible events. The detection of events that cannot be described by the SM, which are typically referred to as anomalous, and the related potential discovery of exotic physical phenomena is a non-trivial task. The challenge becomes even greater with next-generation colliders that will produce even more events with additional levels of complexity. The additional data complexity motivates the search for unsupervised anomaly detection methods that do not require prior knowledge about the underlying models. In this work, we develop such a technique. More explicitly, we employ a quantum generative adversarial network to identify anomalous events. The method learns the background distribution from SM data and, then, determines whether a given event is characteristic for the learned background distribution. The proposed quantum-powered anomaly detection strategy is tested on proof-of-principle examples using numerical simulations and IBM Quantum processors. We find that the quantum generative techniques using ten times fewer training data samples can yield comparable accuracy to the classical counterpart for the detection of the Graviton and Higgs particles. Additionally, we empirically compute the capacity of the quantum model and observe an improved expressivity compared to its classical counterpart.

Quantum Physics,High Energy Physics - Experiment
Quantum intrusion detection system using outlier analysis

Tae Hoon Kim,S. Madhavi

DOI: https://doi.org/10.1038/s41598-024-78389-0

IF: 4.6

2024-11-09

Scientific Reports

Abstract:In the field of cybersecurity, hackers often enter computer systems despite current security measures, owing to the huge amount of network traffic that makes intruder identification difficult. Differentiating between authorized traffic and abnormal data produced by Distributed Denial of Service (DDoS) attackers is still a major difficulty. This research provides a unique technique that uses Quantum Machine Learning (QML) to improve security protocols for secure communication between two parties. Our strategy enhances detection accuracy and speed by using the characteristics of quantum neural networks. The approach includes creating a dataset from network traffic patterns, preprocessing it, and then turning it into quantum bits via angle embedding. The research uses outlier analysis, min-entropy, and quantum state fidelity to distinguish between normal and abnormal data patterns. The dispersed randomness of network header data is measured using entropy, which aids in identifying security concerns. The suggested QML-based methodology outperforms conventional approaches and current models, including AMM-CNN and ANN models, with a detection accuracy of 99.87% for DDoS attacks. This advancement leads to more effective and secure communication networks.

multidisciplinary sciences

Quantum Algorithms for Anomaly Detection Using Amplitude Estimation

Quantum Algorithm for Unsupervised Anomaly Detection

Quantum Algorithm for Anomaly Detection of Sequences

Quantum Machine Learning For Quantum Anomaly Detection

Quantum Machine Learning Algorithms for Anomaly Detection: a Review

Quantum Anomaly Detection with Density Estimation and Multivariate Gaussian Distribution

Long-lived Particles Anomaly Detection with Parametrized Quantum Circuits

Quantum-inspired anomaly detection, a QUBO formulation

Qsco: A Quantum Scoring Module for Open-set Supervised Anomaly Detection

Quantum multi-anomaly detection

Applying Quantum Autoencoders for Time Series Anomaly Detection

Quantum similarity learning for anomaly detection

Exploring Unsupervised Anomaly Detection with Quantum Boltzmann Machines in Fraud Detection

Quantum anomaly detection in the latent space of proton collision events at the LHC

Quantum support vector data description for anomaly detection

Hyperspectral Anomaly Detection Using Quantum Potential Clustering

Quantum Patch-Based Autoencoder for Anomaly Segmentation

Quantum density estimation with density matrices: Application to quantum anomaly detection

Quantum Generative Adversarial Networks For Anomaly Detection In High Energy Physics

Quantum intrusion detection system using outlier analysis