Abstract:Deep neural networks (DNNs) have been showing significant success in various anomaly detection applications such as smart surveillance and industrial quality control. It is increasingly important to detect anomalies directly on edge devices, because of high responsiveness requirements and tight latency constraints. The accuracy of DNN-based solutions rely on large model capacity and thus long training and inference time, making them inapplicable on resource strenuous edge devices. It is hence imperative to scale DNN model sizes in correspondence to the run-time system requirements, i.e., meeting deadlines with minimal accuracy losses, which are highly dependent on the platforms and real-time system status. Existing scaling techniques either take long training time to pre-generate scaling options or disturb the unsteady training process of anomaly detection DNNs, lacking the adaptability to heterogeneous edge systems and incurring low inference accuracies. In this article, we present LightDNN to scale DNN models for anomaly detection applications at edge, featuring high detection accuracies with lightweight training and inference time. To this end, LightDNN quickly extracts and compresses blocks in a DNN, and provides large scaling space (e.g., 1 million options) by dynamically combining these compressed blocks online. At run-time, LightDNN predicts the DNN’s inference latency according to the monitored system status, and optimizes the combination of blocks to maximize its accuracy under deadline constraints. We implement and extensively evaluate LightDNN on both CPU and GPU edge platforms using 8 popular anomaly detection workloads. Comparative experiments with state-of-the-art methods show that our approach provides 145.8 to 0.56 trillion times more scaling options without increasing training and inference overheads, thus achieving as much as 15.05% increase in accuracy under the same deadlines.

TinyLog: Log Anomaly Detection with Lightweight Temporal Convolutional Network for Edge Device

LightLog: A Lightweight Temporal Convolutional Network for Log Anomaly Detection on the Edge

LWRN: Light-Weight Residual Network for Edge Detection

Design of a Novel Neural Network Compression Method for Tiny Machine Learning

Small Object Lentinula Edodes Logs Contamination Detection Method Based on Improved YOLOv7 in Edge-Cloud Computing

Federated Anomaly Detection on System Logs for the Internet of Things: A Customizable and Communication-Efficient Approach

Towards Vision Mixture of Experts for Wildlife Monitoring on the Edge

Tiny-PPG: A Lightweight Deep Neural Network for Real-Time Detection of Motion Artifacts in Photoplethysmogram Signals on Edge Devices

TinyAD: Memory-efficient anomaly detection for time series data in Industrial IoT

Log anomaly detection method based on CNN and LSTM fusion

LogEvent2vec: LogEvent-to-Vector Based Anomaly Detection for Large-Scale Logs in Internet of Things

LogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs

OneLog: Towards End-to-End Training in Software Log Anomaly Detection

Log-based Anomaly Detection based on EVT Theory with feedback

Lightweight and Accurate DNN-based Anomaly Detection at Edge

TinyM$^2$Net-V3: Memory-Aware Compressed Multimodal Deep Neural Networks for Sustainable Edge Deployment

A LSTM-Based Anomaly Detection Model for Log Analysis

LCANet: Lightweight Context-Aware Attention Networks for Earthquake Detection and Phase-Picking on IoT Edge Devices

Log-based Anomaly Detection Without Log Parsing

LightESD: Fully-Automated and Lightweight Anomaly Detection Framework for Edge Computing

An Ultra-low Power TinyML System for Real-time Visual Processing at Edge