Abstract:Infrared target detection has important applications in rescue and Earth observation. However, the disadvantages of low signal-to-clutter ratios and severe background noise interference for infrared imaging pose great challenges to the detection technology for infrared dim targets. Most algorithms only extract features from the spatial domain, while the lack of temporal information results in unsatisfactory detection performance when the difference between the target and the background is not significant enough. Although some methods utilize temporal information in the detection process, these nonlearning-based methods fail to incorporate the complex and changeable background, and need to adjust parameters according to the input. To tackle this problem, we proposed a Spatio-Temporal Differential Multiscale Attention Network (STDMANet), a learning-based method for multiframe infrared small target detection in this article. Our STDMANet first used the temporal multiscale feature extractor to obtain spatiotemporal (ST) features from multiple time scales and then resorted them to the spatial multiscale feature refiner to enhance the semantics of ST features on the premise of maintaining the position information of small targets. Finally, unlike other learning-based networks that require binary masks for training, we designed a mask-weighted heatmap loss to train the network with only center point annotations. At the same time, the proposed loss can balance missing detection and false alarm, so as to achieve a good balance between finding the targets and suppressing the background. Extensive quantitative experiments on public datasets validated that the proposed STDMANet could improve the metric ${F_{1}}$ score up to 0.9744, surpassing the state-of-the-art baseline by 0.1682. Qualitative experiments show the proposed method could stably extract foreground moving targets from video sequences with various backgrounds while reducing false alarm rate better than other recent baseline methods.

SSTNet: Sliced Spatio-Temporal Network With Cross-Slice ConvLSTM for Moving Infrared Dim-Small Target Detection

LEC-MTNN: a Novel Multi-Frame Infrared Small Target Detection Method Based on Spatial-Temporal Patch-Tensor

SCTransNet: Spatial-channel Cross Transformer Network for Infrared Small Target Detection

Strengthened Local Feature-based Spatial-Temporal Tensor Model for Infrared Dim and Small Target Detection

SFFNet: Shallow Feature Fusion Network Based on Detection Framework for Infrared Small Target Detection

Infrared Small Target Detection Based on Local Contrast Vector and Signed Normalization

Multiscale Interactive Attention Network for Infrared Small Target Detection

Dense Nested Attention Network for Infrared Small Target Detection

IMNN-LWEC: A Novel Infrared Small Target Detection Based on Spatial–Temporal Tensor Model

STDMANet: Spatio-Temporal Differential Multiscale Attention Network for Small Moving Infrared Target Detection

Infrared Dim and Small Target Detection Based on Superpixel Segmentation and Spatiotemporal Cluster 4D Fully-Connected Tensor Network Decomposition

Toward Dense Moving Infrared Small Target Detection: New Datasets and Baseline

ST-Trans: Spatial-Temporal Transformer for Infrared Small Target Detection in Sequential Images

Infrared small target detection based on multiscale local contrast learning networks

Multiscale Progressive Fusion Filter Network for Infrared Small Target Detection

Infrared Moving Small Target Detection Based on Space–Time Combination in Complex Scenes

Guided Attention and Joint Loss for Infrared Dim Small Target Detection

An infrared small target detection method using coordinate attention and feature fusion

Cross-Layer Feature Guided Multiscale Infrared Small Target Detection

Infrared Small Target Detection Based on a Temporally-Aware Fully Convolutional Neural Network

Dim and Small Target Detection in Multi-Frame Sequence Using Bi-Conv-LSTM and 3D-Conv Structure