Abstract:Infrared small-target detection has widespread influences on anti-missile warning, precise weapon guidance, infrared stealth and anti-stealth, military reconnaissance, and other national defense fields. However, small targets are easily submerged in background clutter noise and have fewer pixels and shape features. Furthermore, random target positions and irregular motion can lead to target detection being carried out in the whole space–time domain. This could result in a large amount of calculation, and the accuracy and real-time performance are difficult to be guaranteed. Therefore, infrared small-target detection is still a challenging and far-reaching research hotspot. To solve the above problem, a novel multimodal feature fusion network (MFFN) is proposed, based on morphological characteristics, infrared radiation, and motion characteristics, which could compensate for the deficiency in the description of single modal characteristics of small targets and improve the recognition precision. Our innovations introduced in the paper are addressed in the following three aspects: Firstly, in the morphological domain, we propose a network with the skip-connected feature pyramid network (SCFPN) and dilated convolutional block attention module integrated with Resblock (DAMR) introduced to the backbone, which is designed to improve the feature extraction ability for infrared small targets. Secondly, in the radiation characteristic domain, we propose a prediction model of atmospheric transmittance based on deep neural networks (DNNs), which predicts the atmospheric transmittance effectively without being limited by the complex environment to improve the measurement accuracy of radiation characteristics. Finally, the dilated convolutional-network-based bidirectional encoder representation from a transformers (DC-BERT) structure combined with an attention mechanism is proposed for the feature extraction of radiation and motion characteristics. Finally, experiments on our self-established optoelectronic equipment detected dataset (OEDD) show that our method is superior to eight state-of-the-art algorithms in terms of the accuracy and robustness of infrared small-target detection. The comparative experimental results of four kinds of target sequences indicate that the average recognition rate Pavg is 92.64%, the mean average precision (mAP) is 92.01%, and the F1 score is 90.52%.

DopNet: A Deep Convolutional Neural Network to Recognize Armed and Unarmed Human Targets

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

Domain Adaptation for Infrared-Radar Cross-Scene Multimodal Detection

DIAT-RadHARNet: A Lightweight DCNN for Radar Based Classification of Human Suspicious Activities

DIAT-μ RadHAR (Micro-Doppler Signature Dataset) & μ RadNet (A Lightweight DCNN)—For Human Suspicious Activity Recognition

Personnel Recognition and Gait Classification Based on Multistatic Micro-Doppler Signatures Using Deep Convolutional Neural Networks

Multilevel Recognition of UAV-to-Ground Targets Based on Micro-Doppler Signatures and Transfer Learning of Deep Convolutional Neural Networks

Aerial Target Recognition with Enhanced Micro-Doppler Dynamic Features Based on Frequency-Modulated Continuous-Wave Radar

Radar Target Detection Based on OTFS Signaling: A Deep Learning Approach

Micro-Doppler Based Human-Robot Classification Using Ensemble and Deep Learning Approaches

Motion Classification using Kinematically Sifted ACGAN-Synthesized Radar Micro-Doppler Signatures

Automatic Target Recognition of Millimeter-Wave Radar Based on Deep Learning

DNN Transfer Learning from Diversified Micro-Doppler for Motion Classification

A Convolutional Neural Network for Human Motion Recognition and Classification Using a Millimeter-Wave Doppler Radar

Dop-DenseNet: Densely Convolutional Neural Network-Based Gesture Recognition Using a Micro-Doppler Radar

Ballistic target recognition based on multiple data representations and deep-learning algorithms

Moving Target Detection for Single-Channel Csar Based on Deep Neural Network.

Deep Learning-based Estimation for Multitarget Radar Detection

Eliminate Aspect Angle Variations for Human Activity Recognition using Unsupervised Deep Adaptation Network

Infrared Small-Target Detection Based on Radiation Characteristics with a Multimodal Feature Fusion Network

Concealed Object Detection and Recognition System Based on Millimeter Wave FMCW Radar