Abstract:Deep neural networks (DNNs) have been showing significant success in various anomaly detection applications such as smart surveillance and industrial quality control. It is increasingly important to detect anomalies directly on edge devices, because of high responsiveness requirements and tight latency constraints. The accuracy of DNN-based solutions rely on large model capacity and thus long training and inference time, making them inapplicable on resource strenuous edge devices. It is hence imperative to scale DNN model sizes in correspondence to the run-time system requirements, i.e., meeting deadlines with minimal accuracy losses, which are highly dependent on the platforms and real-time system status. Existing scaling techniques either take long training time to pre-generate scaling options or disturb the unsteady training process of anomaly detection DNNs, lacking the adaptability to heterogeneous edge systems and incurring low inference accuracies. In this article, we present LightDNN to scale DNN models for anomaly detection applications at edge, featuring high detection accuracies with lightweight training and inference time. To this end, LightDNN quickly extracts and compresses blocks in a DNN, and provides large scaling space (e.g., 1 million options) by dynamically combining these compressed blocks online. At run-time, LightDNN predicts the DNN’s inference latency according to the monitored system status, and optimizes the combination of blocks to maximize its accuracy under deadline constraints. We implement and extensively evaluate LightDNN on both CPU and GPU edge platforms using 8 popular anomaly detection workloads. Comparative experiments with state-of-the-art methods show that our approach provides 145.8 to 0.56 trillion times more scaling options without increasing training and inference overheads, thus achieving as much as 15.05% increase in accuracy under the same deadlines.

LightLog: A Lightweight Temporal Convolutional Network for Log Anomaly Detection on the Edge

LWRN: Light-Weight Residual Network for Edge Detection

Federated Anomaly Detection on System Logs for the Internet of Things: A Customizable and Communication-Efficient Approach

Log anomaly detection method based on CNN and LSTM fusion

OneLog: Towards End-to-End Training in Software Log Anomaly Detection

LightESD: Fully-Automated and Lightweight Anomaly Detection Framework for Edge Computing

Natural Language Processing-based Model for Log Anomaly Detection

Lightweight and Accurate DNN-based Anomaly Detection at Edge

LogEvent2vec: LogEvent-to-Vector Based Anomaly Detection for Large-Scale Logs in Internet of Things

Log-based Anomaly Detection Without Log Parsing

Small Object Lentinula Edodes Logs Contamination Detection Method Based on Improved YOLOv7 in Edge-Cloud Computing

LogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs

Log2graphs: An Unsupervised Framework for Log Anomaly Detection with Efficient Feature Extraction

MLog: Mogrifier LSTM-based Log Anomaly Detection Approach Using Semantic Representation

OneLog: towards end-to-end software log anomaly detection

Anomaly Detection using Distributed Log Data: A Lightweight Federated Learning Approach

Log-based Anomaly Detection based on EVT Theory with feedback

ETCNLog: A System Log Anomaly Detection Method Based on Efficient Channel Attention and Temporal Convolutional Network

Experience Report: Deep Learning-based System Log Analysis for Anomaly Detection

A LSTM-Based Anomaly Detection Model for Log Analysis

OMLog: Online Log Anomaly Detection for Evolving System with Meta-learning