Abstract:Computer network anomaly detection and log analysis, as an important topic in the field of network security, has been a key task to ensure network security and system reliability. First, existing network anomaly detection and log analysis methods are often challenged by high-dimensional data and complex network topologies, resulting in unstable performance and high false-positive rates. In addition, traditional methods are usually difficult to handle time-series data, which is crucial for anomaly detection and log analysis. Therefore, we need a more efficient and accurate method to cope with these problems. To compensate for the shortcomings of current methods, we propose an innovative fusion model that integrates Isolation Forest, GAN (Generative Adversarial Network), and Transformer with each other, and each of them plays a unique role. Isolation Forest is used to quickly identify anomalous data points, and GAN is used to generate synthetic data with the real data distribution characteristics to augment the training dataset, while the Transformer is used for modeling and context extraction on time series data. The synergy of these three components makes our model more accurate and robust in anomaly detection and log analysis tasks. We validate the effectiveness of this fusion model in an extensive experimental evaluation. Experimental results show that our model significantly improves the accuracy of anomaly detection while reducing the false alarm rate, which helps to detect potential network problems in advance. The model also performs well in the log analysis task and is able to quickly identify anomalous behaviors, which helps to improve the stability of the system. The significance of this study is that it introduces advanced deep learning techniques, which work anomaly detection and log analysis.

A Fast High-Dimensional Tool for Detecting Anomalistic Nodes in Large Scale Systems (LSAND)

ASA: Adversary Situation Awareness Via Heterogeneous Graph Convolutional Networks.

Anomaly Detection of Large Scale Network Based on Data Streams

Online System Problem Detection by Mining Patterns of Console Logs

LSHiForest: A Generic Framework for Fast Tree Isolation Based Ensemble Anomaly Analysis.

GraphSAC: Detecting anomalies in large-scale graphs

Enhancing anomaly detection with adaptive node inspection in large-scale networks with binary sensors

Online Anomaly Detection in HPC Systems

Accurate and fast anomaly detection in industrial processes and IoT environments

Finding Gold in the Sand: Identifying Anomaly Indicators Though Huge Amount Security Logs

Anomaly Detection in High Performance Computers: A Vicinity Perspective

A task of anomaly detection for a smart satellite Internet of things system

A Survey of Graph-based Deep Learning for Anomaly Detection in Distributed Systems

Lcad: A Correlation Based Abnormal Pattern Detection Approach For Large Amount Of Monitor Data

Hierarchical GNN Framework for Earth's Surface Anomaly Detection in Single Satellite Imagery

Deep Learning-based Anomaly Detection and Log Analysis for Computer Networks

Monitoring industrial control systems via spatio-temporal graph neural networks

Detecting Large-Scale System Problems by Mining Console Logs

Data-Driven Root-Cause Analysis For Distributed System Anomalies

Root-cause analysis for time-series anomalies via spatiotemporal graphical modeling in distributed complex systems

An Unsupervised Spatiotemporal Graphical Modeling Approach to Anomaly Detection in Distributed CPS