Abstract:Infrared (IR) small target detection is a crucial aspect in both military and civilian fields. Due to the poor quality and complex scenarios, the existing technologies lack superior real-time and overall detection performance. Tensor analysis has shown superiority, but there are three key issues. The first pertains to appropriate tensor-structured data, the second concerns a more comprehensive tensor decomposition architecture, and the third is to achieve more satisfactory real-time performance. This article proposes an IR small target detection method named 4-D spatial–temporal tensor decomposition with block term decomposition-based norm and multidirectional derivative-based priors (4DST-BTMD). It converts the target detection task into a low-rank and sparse decomposition (LRSD) optimization problem of decomposing background, target, and noise tensors from 4-D spatial–temporal domain. First, we construct a 4-D spatial–temporal tensor, followed by projecting it into a constructed data-sphered space, which lays the data foundation for decomposition. Then, based on the 4-D sphered tensor, a low-rank surrogate named block term decomposition-based norm (BTDN) for background estimation is proposed, which fully integrates global information across different dimensions. Meanwhile, more effective salient 4-D prior tensors based on multidirectional derivatives are designed to effectively guide the model to focus on significant areas. Finally, an efficient ADMM-based solving framework is designed for the LRSD model. Furthermore, with seven state-of-the-art competitive methods, extensive experiments and analysis illustrate that the proposed 4DST-BTMD not only demonstrates the superiority in background suppressibility (BS) and target detectability (TD) but also has satisfactory real-time detection performance.

A Regularized Tensor Decomposition Method with Adaptive Rank Adjustment for Compressed-Sensed-Domain Background Subtraction.

A Tensor-Based Online RPCA Model for Compressive Background Subtraction

A Novel Tensor Robust PCA Approach for Background Subtraction from Compressive Measurements.

Total Variation Regularized Tensor RPCA for Background Subtraction From Compressive Measurements.

Background subtraction based on low-rank and structured sparse decomposition.

Surveillance Video Coding Via Low-Rank and Sparse Decomposition.

Moving Object Detection Using Tensor-Based Low-Rank and Saliently Fused-Sparse Decomposition.

An Improved Total Variation Regularized RPCA for Moving Object Detection with Dynamic Background

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Total Variation and Rank-1 Constraint RPCA for Background Subtraction

4DST-BTMD: an Infrared Small Target Detection Method Based on 4-D Data-Sphered Space

rSVDdpd: A Robust Scalable Video Surveillance Background Modelling Algorithm

Data-driven Background Representation Method to Video Surveillance.

Adaptive Difference Modelling for Background Subtraction.

Dynamic Mode Decomposition For Robust Pca With Applications To Foreground/Background Subtraction In Video Streams And Multi-Resolution Analysis

Joint Video Frame Set Division and Low-Rank Decomposition for Background Subtraction

Video Foreground Detection by Low-Rank and Reweighted Sparse Decomposition

Total Variation Regularized RPCA for Irregularly Moving Object Detection Under Dynamic Background.

Background Subtraction Based on Modified Pulse Coupled Neural Network in Compressive Domain

Modeling Background from Compressed Video

Complex Background Subtraction by Pursuing Dynamic Spatio-Temporal Models