Abstract:Infrared small-target detection has widespread influences on anti-missile warning, precise weapon guidance, infrared stealth and anti-stealth, military reconnaissance, and other national defense fields. However, small targets are easily submerged in background clutter noise and have fewer pixels and shape features. Furthermore, random target positions and irregular motion can lead to target detection being carried out in the whole space–time domain. This could result in a large amount of calculation, and the accuracy and real-time performance are difficult to be guaranteed. Therefore, infrared small-target detection is still a challenging and far-reaching research hotspot. To solve the above problem, a novel multimodal feature fusion network (MFFN) is proposed, based on morphological characteristics, infrared radiation, and motion characteristics, which could compensate for the deficiency in the description of single modal characteristics of small targets and improve the recognition precision. Our innovations introduced in the paper are addressed in the following three aspects: Firstly, in the morphological domain, we propose a network with the skip-connected feature pyramid network (SCFPN) and dilated convolutional block attention module integrated with Resblock (DAMR) introduced to the backbone, which is designed to improve the feature extraction ability for infrared small targets. Secondly, in the radiation characteristic domain, we propose a prediction model of atmospheric transmittance based on deep neural networks (DNNs), which predicts the atmospheric transmittance effectively without being limited by the complex environment to improve the measurement accuracy of radiation characteristics. Finally, the dilated convolutional-network-based bidirectional encoder representation from a transformers (DC-BERT) structure combined with an attention mechanism is proposed for the feature extraction of radiation and motion characteristics. Finally, experiments on our self-established optoelectronic equipment detected dataset (OEDD) show that our method is superior to eight state-of-the-art algorithms in terms of the accuracy and robustness of infrared small-target detection. The comparative experimental results of four kinds of target sequences indicate that the average recognition rate Pavg is 92.64%, the mean average precision (mAP) is 92.01%, and the F1 score is 90.52%.

Denoising and Feature Extraction for Space Infrared Dim Target Recognition Utilizing Optimal VMD and Dual-Band Thermometry

A Space Infrared Dim Target Recognition Algorithm Based on Improved DS Theory and Multi-Dimensional Feature Decision Level Fusion Ensemble Classifier

Multi Scale Detail-Preserving Denoising Method Of Infrared Image Via Relative Total Variation

Effective Framework for Space Target Detection Through Atmospheric Turbulence

A Multi-Dimensional Feature Fusion Recognition Method for Space Infrared Dim Targets Based on Fuzzy Comprehensive with Spatio-Temporal Correlation

Infrared Sensation-Based Salient Targets Enhancement Methods in Low-Visibility Scenes

4DST-BTMD: an Infrared Small Target Detection Method Based on 4-D Data-Sphered Space

Infrared Small Target Detection Based on Multiscale Local Contrast Measure Using Local Energy Factor

Infrared Small-Target Detection Based on Radiation Characteristics with a Multimodal Feature Fusion Network

Infrared Dim and Small Target Detection Based on Local–Global Feature Fusion

Research on infrared dim and small target detection algorithm based on frequency domain difference

5-D Spatial-Temporal Information-Based Infrared Small Target Detection in Complex Environments

Hierarchical Feature Enhancement Algorithm for Multispectral Infrared Images of Dark and Weak Targets

Deep-IRTarget: An Automatic Target Detector in Infrared Imagery Using Dual-Domain Feature Extraction and Allocation

Strengthened Local Feature-based Spatial-Temporal Tensor Model for Infrared Dim and Small Target Detection

Infrared Small Target Detection via Two-Stage Feature Complementary Improved Tensor Low-Rank Sparse Decomposition

Research on denoising method based on temperature and humidity profile lidar

Infrared Dim and Small Target Detection from Complex Scenes via Multi-Frame Spatial-Temporal Patch-Tensor Model

Infrared Dim and Small Target Detection Based on Superpixel Segmentation and Spatiotemporal Cluster 4D Fully-Connected Tensor Network Decomposition

Mini-infrared thermal imaging system image denoising with multi-head feature fusion and detail enhancement network

Infrared Weak Target Detection in Dual Images and Dual Areas