Abstract:The identification of anomalous activities is a challenging and crucially important task in sensor networks. This task is becoming increasingly complex with the increasing volume of data generated in real-world domains, and greatly benefits from the use of predictive models to identify anomalies in real time. A key use case for this task is the identification of misbehavior that may be caused by involuntary faults or deliberate actions. However, currently adopted anomaly detection methods are often affected by limitations such as the inability to analyze large-scale data, a reduced effectiveness when data presents multiple densities, a strong dependence on user-defined threshold configurations, and a lack of explainability in the extracted predictions. In this paper, we propose a distributed deep learning method that extends growing hierarchical self-organizing maps, originally designed for clustering tasks, to address anomaly detection tasks. The SOM-based modeling capabilities of the method enable the analysis of data with multiple densities, by exploiting multiple SOMs organized as a hierarchy. Our map-reduce implementation under Apache Spark allows the method to process and analyze large-scale sensor network data. An automatic threshold-tuning strategy reduces user efforts and increases the robustness of the method with respect to noisy instances. Moreover, an explainability component resorting to instance-based feature ranking emphasizes the most salient features influencing the decisions of the anomaly detection model, supporting users in their understanding of raised alerts. Experiments are conducted on five real-world sensor network datasets, including wind and photovoltaic energy production, vehicular traffic, and pedestrian flows. Our results show that the proposed method outperforms state-of-the-art anomaly detection competitors. Furthermore, a scalability analysis reveals that the method is able to scale linearly as the data volume presented increases, leveraging multiple worker nodes in a distributed computing setting. Qualitative analyses on the level of anomalous pollen in the air further emphasize the effectiveness of our proposed method, and its potential in determining the level of danger in raised alerts.

Sensor Fault Detection and Diagnosis Based on SOMNNs for Steady-State and Transient Operation

A New ICA-SOM Based Method for Compound Faults Diagnosis

A novel sensor fault diagnosis method based on Modified Ensemble Empirical Mode Decomposition and Probabilistic Neural Network

A novel compound neural network for fault diagnosis

Multi-Neural Networks for Faults Diagnosis Based on ICA Feature Extraction

Sensor Fault Diagnosis Based on Wavelet Packetand SOM Neural Network

A fault mode identification methodology based on self-organizing map

Sensor Fault Detection and Diagnostics of Nonlinear Systems with Application to Paper Machines

Fault Diagnosis of Hydraulic System based on SOM Neural Network

Sensor Fault Detection and Isolation in Autonomous Nonlinear Systems Using Neural Network-Based Observers

Temporal-Spatial Attention Network: A Novel Axial Piston Pump Coupled Fault Diagnosis Method

Concurrent Fault Detection and Anomaly Location in Closed-Loop Dynamic Systems with Measured Disturbances.

Rapid Sensor Fault Diagnosis for a Class of Nonlinear Systems via Deterministic Learning

A Novel Fault Detection and Identification Method for Complex Chemical Processes Based on OSCAE and CNN

A Sensor Network Modeling and Fault Detection Method for Large Wind Farms by Using Neural Networks

Research on Performance Degradation Assessment for Hydraulic Servo System Based on Fault Observer and SOM Network

Sensor Fault Reconstruction for a Class of 2-D Nonlinear Systems with Application to Fault Compensation

One Masked Model is All You Need for Sensor Fault Detection, Isolation and Accommodation

Detecting sensor faults for a chemical reactor rig via adaptive neural network model

Distributed and explainable GHSOM for anomaly detection in sensor networks

SOM-based Visualization Monitoring and Fault Diagnosis for Chemical Process