Abstract:Infrared small-target detection has widespread influences on anti-missile warning, precise weapon guidance, infrared stealth and anti-stealth, military reconnaissance, and other national defense fields. However, small targets are easily submerged in background clutter noise and have fewer pixels and shape features. Furthermore, random target positions and irregular motion can lead to target detection being carried out in the whole space–time domain. This could result in a large amount of calculation, and the accuracy and real-time performance are difficult to be guaranteed. Therefore, infrared small-target detection is still a challenging and far-reaching research hotspot. To solve the above problem, a novel multimodal feature fusion network (MFFN) is proposed, based on morphological characteristics, infrared radiation, and motion characteristics, which could compensate for the deficiency in the description of single modal characteristics of small targets and improve the recognition precision. Our innovations introduced in the paper are addressed in the following three aspects: Firstly, in the morphological domain, we propose a network with the skip-connected feature pyramid network (SCFPN) and dilated convolutional block attention module integrated with Resblock (DAMR) introduced to the backbone, which is designed to improve the feature extraction ability for infrared small targets. Secondly, in the radiation characteristic domain, we propose a prediction model of atmospheric transmittance based on deep neural networks (DNNs), which predicts the atmospheric transmittance effectively without being limited by the complex environment to improve the measurement accuracy of radiation characteristics. Finally, the dilated convolutional-network-based bidirectional encoder representation from a transformers (DC-BERT) structure combined with an attention mechanism is proposed for the feature extraction of radiation and motion characteristics. Finally, experiments on our self-established optoelectronic equipment detected dataset (OEDD) show that our method is superior to eight state-of-the-art algorithms in terms of the accuracy and robustness of infrared small-target detection. The comparative experimental results of four kinds of target sequences indicate that the average recognition rate Pavg is 92.64%, the mean average precision (mAP) is 92.01%, and the F1 score is 90.52%.

Recognition of Micro-Motion Space Targets Based on Attention-Augmented Cross-Modal Feature Fusion Recognition Network

Sample Intercorrelation-Based Multidomain Fusion Network for Aquatic Human Activity Recognition Using Millimeter-Wave Radar.

Space Target Recognition Based on 4-D Range–Frequency–Time–Power Radar Data Cube

Aerial Target Recognition with Enhanced Micro-Doppler Dynamic Features Based on Frequency-Modulated Continuous-Wave Radar

MVFRnet: A Novel High-Accuracy Network for ISAR Air-Target Recognition via Multi-View Fusion

Multiview Attention CNN-LSTM Network for SAR Automatic Target Recognition

Two-Stream Deep Fusion Network Based on VAE and CNN for Synthetic Aperture Radar Target Recognition

Infrared Small-Target Detection Based on Radiation Characteristics with a Multimodal Feature Fusion Network

FEF-Net: A Deep Learning Approach to Multiview SAR Image Target Recognition

Multi-band Image Fusion with Infrared Broad Spectrum for Low and Slow Small Target Recognition

MSF-Net: A Multilevel Spatiotemporal Feature Fusion Network Combines Attention for Action Recognition

Multilevel Scattering Center and Deep Feature Fusion Learning Framework for SAR Target Recognition

Airborne Small Target Detection Method Based on Multimodal and Adaptive Feature Fusion

SAR Multi‐target Interactive Motion Recognition Based on Convolutional Neural Networks

Multi-View CNN-LSTM Neural Network for SAR Automatic Target Recognition

ISAR Maneuvering Target Imaging Based on Convolutional Neural Network

FEC: A Feature Fusion Framework for SAR Target Recognition Based on Electromagnetic Scattering Features and Deep CNN Features

Space Target Recognition Based on Radar Network Systems With BiGRU-Transformer and Dual Graph Fusion Network

SAR Target Recognition Based on Inception and Fully Convolutional Neural Network Combining Amplitude Domain Multiplicative Filtering Method.

A Novel Target Feature Fusion Method with Attention Mechanism for SAR-ATR

Intra-Pulse Modulation Recognition of Radar Signals Based on Efficient Cross-Scale Aware Network