Abstract:Hyperspectral anomaly detection, which aims to search and localize potential targets, is a research area with extensive application prospects and profound implications. In recent years, the emergence of unsupervised and self-supervised deep learning for image reconstruction has provided inspiring solutions for hyperspectral anomaly detection. However, due to sensor-induced and environmental effects, the full-image detection networks inevitably reconstruct anomalies along with the background. Existing detectors indirectly mitigate anomaly reconstruction by imposing constraints on hidden features or loss functions, but they provide unsatisfactory performance in large target detection scenarios. This work straightforwardly addresses this issue from the input source, i.e., introducing the concept of masked autoencoders (MAEs) into fully convolutional networks and further developing a sparse-inspired masked convolutional network (SMCNet) consisting of three mutually supportive components: 1) a hierarchical encoder; 2) a sparse projection layer; and 3) a hierarchical decoder. The encoder employs an adaptive potential anomaly masking strategy, leveraging sparse convolution for extracting multidimensional features of the remaining background. Meanwhile, a sparse-guided projection layer is created by discarding the positional embedding technique to populate the uncoded region and guide the background recovery without introducing anomalies. Finally, the decoder couples the hierarchical structure and a hybrid attention mechanism (local-middle–global and spatial-spectral) to refine the background during image recovery, whereas anomalies in the residual map are highlighted. Extensive experiments using ten typical competitors on six different types of datasets validate the effectiveness and generalization ability of the newly proposed SMCNet method.

Self-Supervised Masking for Unsupervised Anomaly Detection and Localization

Superpixel Masking and Inpainting for Self-Supervised Anomaly Detection.

A Novel MAE-Based Self-Supervised Anomaly Detection and Localization Method

Unsupervised Anomaly Detection via Masked Diffusion Posterior Sampling

Self-Supervised Anomaly Detection from Anomalous Training Data via Iterative Latent Token Masking

SMCNet: Sparse-Inspired Masked Convolutional Network for Hyperspectral Anomaly Detection

An Unsupervised Short- and Long-Term Mask Representation for Multivariate Time Series Anomaly Detection

AnatoMask: Enhancing Medical Image Segmentation with Reconstruction-guided Self-masking

Self-Supervised Medical Image Segmentation Using Deep Reinforced Adaptive Masking

MPS-AMS: Masked Patches Selection and Adaptive Masking Strategy Based Self-Supervised Medical Image Segmentation

Multilevel Saliency-Guided Self-Supervised Learning for Image Anomaly Detection

AnomalySD: Few-Shot Multi-Class Anomaly Detection with Stable Diffusion Model

Self-Supervised Multi-Scale Cropping and Simple Masked Attentive Predicting for Lung CT-Scan Anomaly Detection

Self-Supervised Masked Mesh Learning for Unsupervised Anomaly Detection on 3D Cortical Surfaces

Unsupervised Anomaly Detection in Medical Images with a Memory-augmented Multi-level Cross-attentional Masked Autoencoder

Self-Supervised Learning for Anomaly Detection With Dynamic Local Augmentation

Self-Supervised Surface Defect Localization via Joint De-Anomaly Reconstruction and Saliency-Guided Segmentation

Self-supervised Augmented Patches Segmentation for Anomaly Detection.

AMLP:Adaptive Masking Lesion Patches for Self-supervised Medical Image Segmentation

Anomaly-prior Guided Inpainting for Industrial Visual Anomaly Detection

AnoSeg: Anomaly Segmentation Network Using Self-Supervised Learning