Abstract:Although existing reconstruction-based multivariate time series anomaly detection (MTSAD) methods have shown advanced performance, most assume the training data is clean. When faced with noise or contamination in training data, they can also reconstruct the anomaly well, weakening the distinction between normal and anomaly. Some probabilistic generation-based methods have been used to address this issue because of their implicit robust structure to noise, but the training process and suppression of anomalous generalization are not stable. The recently proposed explicit method based on the memory module would also sacrifice the reconstruction effect of normal patterns, resulting in limited performance improvement. Moreover, most existing MTSAD methods use a single fixed-length window for input, which weakens their ability to extract long-term dependency. This paper proposes a robust multi-scale feature extraction framework with the dual memory module to comprehensively extract features fusing different levels of semantic information and lengths of temporal dependency. First, this paper designs consecutive neighboring windows as inputs to allow the model to extract local and long-term dependency information. Secondly, a dual memory-augmented encoder is proposed to extract global typical patterns and local common features. It ensures the reconstruction ability of normal data while suppressing the generalization of the anomaly. Finally, this paper proposes a multi-scale fusion module to fuse latent variables representing different levels of semantic information and uses the reconstructed latent variables to reconstruct samples for anomaly detection. Experimental results on five datasets from diverse domains show that the proposed method outperforms 16 typical baseline methods.

Multi-scale Spatial Error Concealment via Hybrid Bayesian Regression

Spatial Error Concealment Via Model Based Coupled Sparse Representation

Error Concealment Algorithm for Spatial Multiple Description Coding of Video

Edge Detection of Complex Scenes Based on Bayesian Statistical Inference

MCNet: Rethinking the Core Ingredients for Accurate and Efficient Homography Estimation

Modified Edge-Oriented Spatial Interpolation For Consecutive Blocks Error Concealment

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

Block-based multiscale error concealment using low-rank completion

Error Concealment with Multiscale Patch Clustering and Low-Rank Minimization

Adaptive Error Concealment with Novel Content Classification

End-to-end Image Splicing Localization Based on Multi-Scale Features and Residual Refinement Module

An Adaptive Spatial Error Concealment for H.264/AVC Video Stream.

Image Restoration via Simultaneous Sparse Coding: Where Structured Sparsity Meets Gaussian Scale Mixture

Accurate Image Search with Multi-Scale Contextual Evidences

Effective Image Tampering Localization with Multi-Scale ConvNeXt Feature Fusion

Probabilistic Projective Association and Semantic Guided Relocalization for Dense Reconstruction

MDSCNN: Remote Sensing Image Spatial–Spectral Fusion Method via Multi-Scale Dual-Stream Convolutional Neural Network

Multi-Scale Video Anomaly Detection by Multi-Grained Spatio-Temporal Representation Learning

A spatial Bayesian latent factor model for image‐on‐image regression

Video Error Concealment Using Spatio-Temporal Boundary Matching and Partial Differential Equation

A robust multi-scale feature extraction framework with dual memory module for multivariate time series anomaly detection