Abstract:Infrared (IR) small target detection is a crucial aspect in both military and civilian fields. Due to the poor quality and complex scenarios, the existing technologies lack superior real-time and overall detection performance. Tensor analysis has shown superiority, but there are three key issues. The first pertains to appropriate tensor-structured data, the second concerns a more comprehensive tensor decomposition architecture, and the third is to achieve more satisfactory real-time performance. This article proposes an IR small target detection method named 4-D spatial–temporal tensor decomposition with block term decomposition-based norm and multidirectional derivative-based priors (4DST-BTMD). It converts the target detection task into a low-rank and sparse decomposition (LRSD) optimization problem of decomposing background, target, and noise tensors from 4-D spatial–temporal domain. First, we construct a 4-D spatial–temporal tensor, followed by projecting it into a constructed data-sphered space, which lays the data foundation for decomposition. Then, based on the 4-D sphered tensor, a low-rank surrogate named block term decomposition-based norm (BTDN) for background estimation is proposed, which fully integrates global information across different dimensions. Meanwhile, more effective salient 4-D prior tensors based on multidirectional derivatives are designed to effectively guide the model to focus on significant areas. Finally, an efficient ADMM-based solving framework is designed for the LRSD model. Furthermore, with seven state-of-the-art competitive methods, extensive experiments and analysis illustrate that the proposed 4DST-BTMD not only demonstrates the superiority in background suppressibility (BS) and target detectability (TD) but also has satisfactory real-time detection performance.

Structural Target-Aware Model for Thermal Infrared Tracking

Aligned Spatial-Temporal Memory Network for Thermal Infrared Target Tracking

RASTMTrack: Robust and Adaptive Space-Time Memory Networks for Visual Tracking

Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking

5-D Spatial-Temporal Information-Based Infrared Small Target Detection in Complex Environments

4DST-BTMD: an Infrared Small Target Detection Method Based on 4-D Data-Sphered Space

Exploring reliable infrared object tracking with spatio-temporal fusion transformer

Spatial-Temporal Tensor Representation Learning with Priors for Infrared Small Target Detection

The Thermal Infrared Visual Object Tracking VOT-TIR2015 Challenge Results

Improving Feature Discrimination for Object Tracking by Structural-similarity-based Metric Learning

AODiMP‐TIR: Anti‐occlusion thermal infrared targets tracker based on SuperDiMP

Hierarchical Attention Siamese Network for Thermal Infrared Target Tracking

Learning Dual-Level Deep Representation for Thermal Infrared Tracking

Strengthened Local Feature-based Spatial-Temporal Tensor Model for Infrared Dim and Small Target Detection

Coordinate-Aware Thermal Infrared Tracking Via Natural Language Modeling

Joint spatio-temporal modeling for visual tracking

Robust Structural Sparse Tracking

Twofold Structured Features-Based Siamese Network for Infrared Target Tracking

Tracking in tracking: An efficient method to solve the tracking distortion

ShaSTA: Modeling Shape and Spatio-Temporal Affinities for 3D Multi-Object Tracking

Spatio-Temporal Bi-directional Cross-frame Memory for Distractor Filtering Point Cloud Single Object Tracking