Abstract:Monitoring and detecting abnormal events in cyber-physical systems is crucial to industrial production. With the prevalent deployment of the Industrial Internet of Things (IIoT), an enormous amount of time series data is collected to facilitate machine learning models for anomaly detection, and it is of the utmost importance to directly deploy the trained models on the IIoT devices. However, it is most challenging to deploy complex deep learning models such as Convolutional Neural Networks (CNNs) on these memory-constrained IIoT devices embedded with microcontrollers (MCUs). To alleviate the memory constraints of MCUs, we propose a novel framework named Tiny Anomaly Detection (TinyAD) to efficiently facilitate onboard inference of CNNs for real-time anomaly detection. First, we conduct a comprehensive analysis of depthwise separable CNNs and regular CNNs for anomaly detection and find that the depthwise separable convolution operation can reduce the model size by 50-90% compared with the traditional CNNs. Then, to reduce the peak memory consumption of CNNs, we explore two complementary strategies, in-place, and patch-by-patch memory rescheduling, and integrate them into a unified framework. The in-place method decreases the peak memory of the depthwise convolution by sparing a temporary buffer to transfer the activation results, while the patch-by-patch method further reduces the peak memory of layer-wise execution by slicing the input data into corresponding receptive fields and executing in order. Furthermore, by adjusting the dimension of convolution filters, these strategies apply to both univariate time series and multidomain time series features. Extensive experiments on real-world industrial datasets show that our framework can reduce peak memory consumption by 2-5x with negligible computation overhead.

TinyAD: Memory-efficient anomaly detection for time series data in Industrial IoT

MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning

Real-Time Deep Anomaly Detection Framework for Multivariate Time-Series Data in Industrial IoT

MCUNet: Tiny Deep Learning on IoT Devices

SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers

T-RECX: Tiny-Resource Efficient Convolutional neural networks with early-eXit

A Novel Memory-Scheduling Strategy for Large Convolutional Neural Network on Memory-Limited Devices

MicroENet: an Efficient Network for MCUs with Low Model Parameters and Peak Memory

On-Device Training Under 256KB Memory

TinyTNAS: GPU-Free, Time-Bound, Hardware-Aware Neural Architecture Search for TinyML Time Series Classification

vMCU: Coordinated Memory Management and Kernel Optimization for DNN Inference on MCUs

Design of a Novel Neural Network Compression Method for Tiny Machine Learning

TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge

TinyM$^2$Net-V3: Memory-Aware Compressed Multimodal Deep Neural Networks for Sustainable Edge Deployment

Accelerating TinyML Inference on Microcontrollers through Approximate Kernels

Designing Extremely Memory-Efficient CNNs for On-device Vision Tasks

MCUFormer: Deploying Vision Tranformers on Microcontrollers with Limited Memory.

TinyFormer: Efficient Transformer Design and Deployment on Tiny Devices

MCUFormer: Deploying Vision Transformers on Microcontrollers with Limited Memory

Deep Anomaly Detection for Time-Series Data in Industrial IoT: A Communication-Efficient On-Device Federated Learning Approach

An Ultra-low Power TinyML System for Real-time Visual Processing at Edge