Abstract:Anomaly detection is a significant task in sensors’ signal processing since interpreting an abnormal signal can lead to making a high-risk decision in terms of sensors’ applications. Deep learning algorithms are effective tools for anomaly detection due to their capability to address imbalanced datasets. In this study, we took a semi-supervised learning approach, utilizing normal data for training the deep learning neural networks, in order to address the diverse and unknown features of anomalies. We developed autoencoder-based prediction models to automatically detect anomalous data recorded by three electrochemical aptasensors, with variations in the signals’ lengths for particular concentrations, analytes, and bioreceptors. Prediction models employed autoencoder networks and the kernel density estimation (KDE) method for finding the threshold to detect anomalies. Moreover, the autoencoder networks were vanilla, unidirectional long short-term memory (ULSTM), and bidirectional LSTM (BLSTM) autoencoders for the training stage of the prediction models. However, the decision-making was based on the result of these three networks and the integration of vanilla and LSTM networks’ results. The accuracy as a performance metric of anomaly prediction models showed that the performance of vanilla and integrated models were comparable, while the LSTM-based autoencoder models showed the least accuracy. Considering the integrated model of ULSTM and vanilla autoencoder, the accuracy for the dataset with the lengthier signals was approximately 80%, while it was 65% and 40% for the other datasets. The lowest accuracy belonged to the dataset with the least normal data in its dataset. These results demonstrate that the proposed vanilla and integrated models can automatically detect abnormal data when there is sufficient normal data for training the models.

Anomaly Detection Based on Machine Learning for the CMS Electromagnetic Calorimeter Online Data Quality Monitoring

Autoencoder-based Anomaly Detection System for Online Data Quality Monitoring of the CMS Electromagnetic Calorimeter

Autoencoder-based Online Data Quality Monitoring for the CMS Electromagnetic Calorimeter

An Unsupervised Framework for Anomaly Detection in a Water Treatment System

Detector monitoring with artificial neural networks at the CMS experiment at the CERN Large Hadron Collider

Anomaly Detection in Particle Accelerators using Autoencoders

Anomaly Detection using Autoencoders in High Performance Computing Systems

Autoencoders for Real-Time SUEP Detection

ADFilter -- A Web Tool for New Physics Searches With Autoencoder-Based Anomaly Detection Using Deep Unsupervised Neural Networks

Autoencoders for At-Source Data Reduction and Anomaly Detection in High Energy Particle Detectors

Automated visual inspection of CMS HGCAL silicon sensor surface using an ensemble of a deep convolutional autoencoder and classifier

GAN-AE : An anomaly detection algorithm for New Physics search in LHC data

Data Quality Monitoring through Transfer Learning on Anomaly Detection for the Hadron Calorimeters

Spatio-Temporal Anomaly Detection with Graph Networks for Data Quality Monitoring of the Hadron Calorimeter

Anomaly Detection of Power Plant Equipment Using Long Short-Term Memory Based Autoencoder Neural Network

Online Anomaly Detection Using Machine Learning and HPC for Power System Synchrophasor Measurements

Anomaly Detection for Sensor Signals Utilizing Deep Learning Autoencoder-Based Neural Networks

A Real-time Anomaly Detection Using Convolutional Autoencoder with Dynamic Threshold

Real-time Anomaly Detection at the L1 Trigger of CMS Experiment

A Deep Learning Approach to Anomaly Sequence Detection for High-Resolution Monitoring of Power Systems