Abstract:Infrared small-target detection has widespread influences on anti-missile warning, precise weapon guidance, infrared stealth and anti-stealth, military reconnaissance, and other national defense fields. However, small targets are easily submerged in background clutter noise and have fewer pixels and shape features. Furthermore, random target positions and irregular motion can lead to target detection being carried out in the whole space–time domain. This could result in a large amount of calculation, and the accuracy and real-time performance are difficult to be guaranteed. Therefore, infrared small-target detection is still a challenging and far-reaching research hotspot. To solve the above problem, a novel multimodal feature fusion network (MFFN) is proposed, based on morphological characteristics, infrared radiation, and motion characteristics, which could compensate for the deficiency in the description of single modal characteristics of small targets and improve the recognition precision. Our innovations introduced in the paper are addressed in the following three aspects: Firstly, in the morphological domain, we propose a network with the skip-connected feature pyramid network (SCFPN) and dilated convolutional block attention module integrated with Resblock (DAMR) introduced to the backbone, which is designed to improve the feature extraction ability for infrared small targets. Secondly, in the radiation characteristic domain, we propose a prediction model of atmospheric transmittance based on deep neural networks (DNNs), which predicts the atmospheric transmittance effectively without being limited by the complex environment to improve the measurement accuracy of radiation characteristics. Finally, the dilated convolutional-network-based bidirectional encoder representation from a transformers (DC-BERT) structure combined with an attention mechanism is proposed for the feature extraction of radiation and motion characteristics. Finally, experiments on our self-established optoelectronic equipment detected dataset (OEDD) show that our method is superior to eight state-of-the-art algorithms in terms of the accuracy and robustness of infrared small-target detection. The comparative experimental results of four kinds of target sequences indicate that the average recognition rate Pavg is 92.64%, the mean average precision (mAP) is 92.01%, and the F1 score is 90.52%.

Anti-Occlusion Infrared Aerial Target Recognition with Vision-Inspired Dual-Stream Graph Network

Air Target Recognition Algorithm based on Mixed Depth Features in the Interference Environment

Infrared Small-Target Detection Based on Radiation Characteristics with a Multimodal Feature Fusion Network

Perturbation Defense Ultra High-Speed Weak Target Recognition

Anti-interference recognition method of aerial infrared targets based on the Bayesian network

Dual-YOLO Architecture from Infrared and Visible Images for Object Detection

Oriented Infrared Vehicle Detection in Aerial Images via Mining Frequency and Semantic Information

Two-Stage Spatio-Temporal Feature Correlation Network for Infrared Ground Target Tracking

Twofold Structured Features-Based Siamese Network for Infrared Target Tracking

CS-ViG-UNet: Infrared small and dim target detection based on cycle shift vision graph convolution network

Joint Gabor histogram and vector graph association for aerial target anti-interference tracking

Feature Preservation and Shape Cues Assist Infrared Small Target Detection

Infrared target detection and tracking based on brain-inspired model and DNNs

Learning Nonlocal Quadrature Contrast for Detection and Recognition of Infrared Rotary-Wing UAV Targets in Complex Background

FDDBA-NET: Frequency Domain Decoupling Bidirectional Interactive Attention Network for Infrared Small Target Detection

A central role for cadherin signaling in cancer.

Infrared Small Target Detection via Interpatch Correlation Enhancement and Joint Local Visual Saliency Prior

Infrared target detection algorithm based on multipath coordinate attention mechanism

Lightweight Spatial Sliced-Concatenate-Multireceptive-Field Enhance and Joint Channel Attention Mechanism for Infrared Object Detection

Anti-Occlusion UAV Tracking Algorithm with a Low-Altitude Complex Background by Integrating Attention Mechanism

Multiscale Progressive Fusion Filter Network for Infrared Small Target Detection