Abstract:Computer network anomaly detection and log analysis, as an important topic in the field of network security, has been a key task to ensure network security and system reliability. First, existing network anomaly detection and log analysis methods are often challenged by high-dimensional data and complex network topologies, resulting in unstable performance and high false-positive rates. In addition, traditional methods are usually difficult to handle time-series data, which is crucial for anomaly detection and log analysis. Therefore, we need a more efficient and accurate method to cope with these problems. To compensate for the shortcomings of current methods, we propose an innovative fusion model that integrates Isolation Forest, GAN (Generative Adversarial Network), and Transformer with each other, and each of them plays a unique role. Isolation Forest is used to quickly identify anomalous data points, and GAN is used to generate synthetic data with the real data distribution characteristics to augment the training dataset, while the Transformer is used for modeling and context extraction on time series data. The synergy of these three components makes our model more accurate and robust in anomaly detection and log analysis tasks. We validate the effectiveness of this fusion model in an extensive experimental evaluation. Experimental results show that our model significantly improves the accuracy of anomaly detection while reducing the false alarm rate, which helps to detect potential network problems in advance. The model also performs well in the log analysis task and is able to quickly identify anomalous behaviors, which helps to improve the stability of the system. The significance of this study is that it introduces advanced deep learning techniques, which work anomaly detection and log analysis.

Big-data Analysis of Multi-Source Logs for Anomaly Detection on Network-Based System.

Socialanalysis: A Real-Time Query And Mining System From Social Media Data Streams

Research on System Log Anomaly Detection Combining Two-way Slice GRU and GA-Attention Mechanism

An Integrated Method for Anomaly Detection From Massive System Logs.

Distributed system anomaly detection using deep learning‐based log analysis

Experience Report: Deep Learning-based System Log Analysis for Anomaly Detection

Deep Learning-based Anomaly Detection and Log Analysis for Computer Networks

DeepUserLog: Deep Anomaly Detection on User Log Using Semantic Analysis and Key-Value Data

Multivariate Log-based Anomaly Detection for Distributed Database

LogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs

Natural Language Processing-based Model for Log Anomaly Detection

A Security Log Analysis Scheme Using Deep Learning Algorithm for IDSs in Social Network

An Empirical Investigation of Practical Log Anomaly Detection for Online Service Systems.

Online System Problem Detection by Mining Patterns of Console Logs

Design and application of real-time network abnormal traffic detection system based on Spark Streaming

Log‐based anomaly detection for distributed systems: State of the art, industry experience, and open issues

An Intelligent Framework for Log Anomaly Detection Based on Log Template Extraction

AutoLog: A Log Sequence Synthesis Framework for Anomaly Detection

A LSTM-Based Anomaly Detection Model for Log Analysis

User Log Anomaly Detection System Based on Isolation Forest

Log2graphs: An Unsupervised Framework for Log Anomaly Detection with Efficient Feature Extraction