[Mixed endocrine tumor with atypical Verner-Morrison syndrome: dissociated responses to somatostatin infusion and surgery].

D. Rigaud,M. Cerf,C. Ou-Yan,J. Arrago,J. Accary,J. Chayvialle,E. René,S. Bonfils

1982-06-01

Gastroentérologie Clinique et Biologique

Abstract:

What problem does this paper attempt to address?

MRF3Net: Infrared Small Target Detection Using Multi-Receptive Field Perception and Effective Feature Fusion

Xiaohan Zhang,Xue Zhang,Si-Yuan Cao,Beinan Yu,Chenghao Zhang,Hui-Liang Shen

DOI: https://doi.org/10.1109/tgrs.2024.3416470

IF: 8.2

2024-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Infrared small target detection (IRSTD) has made remarkable achievements in recent years. However, the core focus of current works lies on the philosophy of "increasing network complexity," which leaves the crucial strategies behind performance improvement unclear. To handle this, we highlight two strategies of IRSTD: 1) multireceptive field perception and 2) effective feature fusion. Focusing on these strategies, we propose a multireceptive field perception and effective feature fusion network, named MRF3Net. Specifically, for multireceptive field perception, we devise a multiple perception encoder (MPE). For effective feature fusion, we devise a feature fusion encoder (FFE) and a feature fusion decoder (FFD). The former improves the encoding efficiency by reducing the interference information and preserving target details, and the latter fuses the target information of low-level and high-level features while eliminating noise. Experiments demonstrate that MRF3Net achieves state-of-the-art performance on popular public datasets while maintaining a fast inference speed of approximately 0.011 s/frame on a single NVIDIA GeForce 3070Ti GPU and 0.049 s/frame on the NVIDIA Jetson Orin. Notably, it significantly reduces parameter costs compared with the previous state-of-the-art approaches, validating its efficiency. Moreover, our MPE, FFE, and FFD have proved to be effective in enhancing other IRSTD approaches. Our code will be made available at: https://github.com/Temperature-ai/MRF3Net.
An Effective TBD Algorithm for the Detection of Infrared Dim-Small Moving Target in the Sky Scene

lisha he,lijun xie,tian xie,haibin pan,yao zheng

DOI: https://doi.org/10.1007/978-3-642-35286-7_32

2012-01-01

Abstract:An effective algorithm for the detection of dim-small moving target in the infrared (IR) image sequence is described in this paper, which is based on the idea of Track-Before-Detect (TBD). To deal with the low signal to noise ratio (SNR) and high false alarm rate of the 1R target detection in the sky scene, two of the Track-Before-Detect (TBD) methods are introduced: dynamic programming (DP) for the SNR enhancement by energy accumulation, and multistage hypothesis testing (MSHT) to lower the false alarm rate by threshold judgment. Furthermore, constraints as the stabilization of the energy and the continuity of the movement of IR dim-small target are applied to avoid the energy scatter. And based on MSHT, most of the false trajectories are eliminated to reduce the calculated amount and save the storage space. Simulation shows good results for the detection of IR dim-small moving target based on the algorithm we proposed.
4DST-BTMD: an Infrared Small Target Detection Method Based on 4-D Data-Sphered Space

Yuan Luo,Xiaorun Li,Shuhan Chen,Chaoqun Xia

DOI: https://doi.org/10.1109/tgrs.2023.3347420

IF: 8.2

2024-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Infrared (IR) small target detection is a crucial aspect in both military and civilian fields. Due to the poor quality and complex scenarios, the existing technologies lack superior real-time and overall detection performance. Tensor analysis has shown superiority, but there are three key issues. The first pertains to appropriate tensor-structured data, the second concerns a more comprehensive tensor decomposition architecture, and the third is to achieve more satisfactory real-time performance. This article proposes an IR small target detection method named 4-D spatial–temporal tensor decomposition with block term decomposition-based norm and multidirectional derivative-based priors (4DST-BTMD). It converts the target detection task into a low-rank and sparse decomposition (LRSD) optimization problem of decomposing background, target, and noise tensors from 4-D spatial–temporal domain. First, we construct a 4-D spatial–temporal tensor, followed by projecting it into a constructed data-sphered space, which lays the data foundation for decomposition. Then, based on the 4-D sphered tensor, a low-rank surrogate named block term decomposition-based norm (BTDN) for background estimation is proposed, which fully integrates global information across different dimensions. Meanwhile, more effective salient 4-D prior tensors based on multidirectional derivatives are designed to effectively guide the model to focus on significant areas. Finally, an efficient ADMM-based solving framework is designed for the LRSD model. Furthermore, with seven state-of-the-art competitive methods, extensive experiments and analysis illustrate that the proposed 4DST-BTMD not only demonstrates the superiority in background suppressibility (BS) and target detectability (TD) but also has satisfactory real-time detection performance.
Dense Nested Attention Network for Infrared Small Target Detection

Boyang Li,Chao Xiao,Longguang Wang,Yingqian Wang,Zaiping Lin,Miao Li,Wei An,Yulan Guo

DOI: https://doi.org/10.1109/tip.2022.3199107

IF: 10.6

2023-03-18

IEEE Transactions on Image Processing

Abstract:Single-frame infrared small target (SIRST) detection aims at separating small targets from clutter backgrounds. With the advances of deep learning, CNN-based methods have yielded promising results in generic object detection due to their powerful modeling capability. However, existing CNN-based methods cannot be directly applied to infrared small targets since pooling layers in their networks could lead to the loss of targets in deep layers. To handle this problem, we propose a dense nested attention network (DNA-Net) in this paper. Specifically, we design a dense nested interactive module (DNIM) to achieve progressive interaction among high-level and low-level features. With the repetitive interaction in DNIM, the information of infrared small targets in deep layers can be maintained. Based on DNIM, we further propose a cascaded channel and spatial attention module (CSAM) to adaptively enhance multi-level features. With our DNA-Net, contextual information of small targets can be well incorporated and fully exploited by repetitive fusion and enhancement. Moreover, we develop an infrared small target dataset (namely, NUDT-SIRST) and propose a set of evaluation metrics to conduct comprehensive performance evaluation. Experiments on both public and our self-developed datasets demonstrate the effectiveness of our method. Compared to other state-of-the-art methods, our method achieves better performance in terms of probability of detection ( ), false-alarm rate ( ), and intersection of union ( ).

computer science, artificial intelligence,engineering, electrical & electronic
5-D Spatial-Temporal Information-Based Infrared Small Target Detection in Complex Environments

Yuan Luo,Xiaorun Li,Shuhan Chen

DOI: https://doi.org/10.1016/j.patcog.2024.111003

2025-01-01

Abstract:Recently, infrared (IR) small target detection problem has attracted increasing attention. Tensor component analysis-based techniques have been widely utilized, while they are faced with challenges such as tensor structures, background and target estimation, and real-time performance. In this paper, we propose a 5-D spatial-temporal factor-based completion model (5D-STFC) for IR small target detection. Specifically, a 5-D whitened spatial-temporal patch-tensor is constructed. Then, we devise a spatial-temporal factor-based low-rank background estimation norm and a Moreau envelope-derived sparsity estimation norm based on joint spatial-temporal knowledge. Furthermore, we establish a comprehensive completion model for component analysis. To efficiently solve this model, we design a multi-block alternating direction method of multipliers (multi-block ADMM)-based optimization scheme. Extensive experiments conducted on five real IR sequences demonstrate the superiority of 5D-STFC over nine state-of-the-art competitive methods. It can be concluded that 5D-STFC is excellent and practical in target detectability, background suppressibility, overall performance, and real-time performance.
LEC-MTNN: a Novel Multi-Frame Infrared Small Target Detection Method Based on Spatial-Temporal Patch-Tensor

Yuan Luo,Xiaorun Li,Shuhan Chen,Chaoqun Xia

DOI: https://doi.org/10.1117/12.2664542

2023-01-01

Abstract:Recently, many state-of-the-art methods have been proposed for infrared (IR) dim and small target detection, but the performance of IR small target detection still faces with challenges in complicated environments. In this paper, we propose a novel IR small target detection method named local entropy characterization prior with multi-mode weighted tensor nuclear norm (LEC-MTNN) that combines local entropy characterization prior (LEC) and multi-mode weighted tensor nuclear norm (MTNN). First, we transform the original infrared image sequence into a nonoverlapping spatial-temporal patch-tensor to fully utilize the spatial and temporal information in image sequences. Second, a nonconvex surrogate of tensor rank called MTNN is proposed to approximate background tensor rank, which organically combines the sum of the Laplace function of all the singular values and multi-mode tensor extension of the construct tensor without destroying the inherent structural information in the spatial-temporal tensor. Third, we introduce a new sparse prior map named LEC via an image entropy characterization operator and structure tensor theory, and more effective target prior can be extracted. As a sparse weight, it is beneficial to further preserve the targets and suppress the background components simultaneously. To solve the proposed model, an efficient optimization scheme utilizing the alternating direction multiplier method (ADMM) is designed to retrieve the small targets from IR sequence. Comprehensive experiments on four IR sequences of complex scenes demonstrate that LEC-MTNN has the superior target detectability (TD) and background suppressibility (BS) performance compared with other five state-of-the-art detection methods.
A Spatial-Temporal Feature-Based Detection Framework for Infrared Dim Small Target

Jinming Du,Huanzhang Lu,Luping Zhang,Moufa Hu,Sheng Chen,Yingjie Deng,Xinglin Shen,Yu Zhang

DOI: https://doi.org/10.1109/tgrs.2021.3117131

IF: 8.2

2022-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:The detection of infrared small targets under low signal-to-clutter ratio (SCR) and complex background conditions has been a challenging and popular research topic. In this article, a spatial-temporal feature-based detection framework is proposed. First, several factors, such as the infrared target's small sample, the sensitive size, and the usual sample selection strategy, that affect the detection of small targets are analyzed. In addition, the small intersection over union (IOU) strategy, which helps to solve the false convergence and sample misjudgment problem, is proposed. Second, aiming at the difficulties due to the target's dim information and complex background, the interframe energy accumulation (IFEA) enhancement mechanism-based end-to-end spatial-temporal feature extraction and target detection framework is proposed. This framework helps to enhance the target's energy, suppress the strong spatially nonstationary clutter, and detect dim small targets. Experimental results show that using the small IOU strategy and IFEA mechanism, the proposed multiple frame-based detection framework performs better than some popular deep learning (DL)-based detection algorithms.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
SSTNet: Sliced Spatio-Temporal Network With Cross-Slice ConvLSTM for Moving Infrared Dim-Small Target Detection

Shengjia Chen,Luping Ji,Jiewen Zhu,Mao Ye,Xiaoyong Yao

DOI: https://doi.org/10.1109/tgrs.2024.3350024

IF: 8.2

2024-02-02

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Infrared dim-small target detection, as an important branch of object detection, has been attracting research attention in recent decades. Its challenges mainly lie in the small target sizes and dim contrast to background images. Recent research schemes on it mainly focus on improving the feature representation of spatio-temporal domains only in single-slice temporal scope. More cross-slice motion, i.e., past and future, is seldom considered to enhance target features. To use cross-slice motion context, this article proposes a sliced spatio-temporal network (SSTNet) with cross-slice enhancement for moving infrared dim-small target detection. In our scheme, a new cross-slice ConvLSTM node is designed to capture spatio-temporal motion features from both inner slice and inter-slices. Moreover, to improve infrared small target motion feature learning, we extend conventional loss function by adopting a new motion-coordination loss (MCL) term. On these, we propose a motion-coupling neck to assist feature extractor in facilitating the capturing and utilization of motion features from multiframes. To our best knowledge, our work is the first one to explore the cross-slice spatio-temporal motion modeling for infrared dim-small targets. Experiments verify that our SSTNet could refresh most state-of-the-art metrics on two public benchmarks (DAUB and IRDST). Our source codes are available at https://github.com/UESTC-nnLab/SSTNet.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Multi-Scale Direction-Aware Network for Infrared Small Target Detection

Jinmiao Zhao,Zelin Shi,Chuang Yu,Yunpeng Liu

2024-06-04

Abstract:Infrared small target detection faces the problem that it is difficult to effectively separate the background and the target. Existing deep learning-based methods focus on appearance features and ignore high-frequency directional features. Therefore, we propose a multi-scale direction-aware network (MSDA-Net), which is the first attempt to integrate the high-frequency directional features of infrared small targets as domain prior knowledge into neural networks. Specifically, an innovative multi-directional feature awareness (MDFA) module is constructed, which fully utilizes the prior knowledge of targets and emphasizes the focus on high-frequency directional features. On this basis, combined with the multi-scale local relation learning (MLRL) module, a multi-scale direction-aware (MSDA) module is further constructed. The MSDA module promotes the full extraction of local relations at different scales and the full perception of key features in different directions. Meanwhile, a high-frequency direction injection (HFDI) module without training parameters is constructed to inject the high-frequency directional information of the original image into the network. This helps guide the network to pay attention to detailed information such as target edges and shapes. In addition, we propose a feature aggregation (FA) structure that aggregates multi-level features to solve the problem of small targets disappearing in deep feature maps. Furthermore, a lightweight feature alignment fusion (FAF) module is constructed, which can effectively alleviate the pixel offset existing in multi-level feature map fusion. Extensive experimental results show that our MSDA-Net achieves state-of-the-art (SOTA) results on the public NUDT-SIRST, SIRST and IRSTD-1k datasets.

Computer Vision and Pattern Recognition
Toward Dense Moving Infrared Small Target Detection: New Datasets and Baseline

Shengjia Chen,Luping Ji,Sicheng Zhu,Mao Ye,Haohao Ren,Yongsheng Sang

DOI: https://doi.org/10.1109/tgrs.2024.3443280

IF: 8.2

2024-09-02

IEEE Transactions on Geoscience and Remote Sensing

Abstract:As an important research branch of infrared small target detection, dense target detection (e.g., drone swarm detection) has always been a topic worth exploring. Currently, existing datasets cover only one or several (sparse) targets, with almost no dataset available for the research on dense small target detection. To advance this kind of search, for the first time, we synthesize two special dense moving target datasets (DMIST-60 and DMIST-100) on DAUB data. They both contain far more than 50 infrared small targets per frame. In the meantime, for evaluating our new datasets and flourishing detection methodology research, we propose a linking-aware sliced network (LASNet) as the baseline of our datasets. It mainly consists of visual feature extraction, motion feature extraction and motion-affinity fusion. The comprehensive experiments on our synthesized datasets confirm: i) both datasets are practical and effective for dense moving infrared small target detection and ii) proposed LASNet could always obviously outperform other compared methods in both sparse and dense target scenarios. Our new datasets and source codes are currently available at https://github.com/UESTC-nnLab/DMIST.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Triple-Domain Feature Learning With Frequency-Aware Memory Enhancement for Moving Infrared Small Target Detection

Weiwei Duan,Luping Ji,Shengjia Chen,Sicheng Zhu,Mao Ye

DOI: https://doi.org/10.1109/tgrs.2024.3452175

IF: 8.2

2024-09-25

IEEE Transactions on Geoscience and Remote Sensing

Abstract:As a subfield of object detection, moving infrared small target detection (ISTD) presents significant challenges due to tiny target sizes and low contrast against backgrounds. Currently existing methods primarily rely on the features extracted only from spatiotemporal domain. Frequency domain has hardly been concerned yet, although it has been widely applied in image processing. To extend feature source domains and enhance feature representation, we propose a new triple-domain strategy (Tridos) with the frequency-aware memory enhancement on spatiotemporal domain for ISTD. In this scheme, it effectively detaches and enhances frequency features by a local-global frequency-aware module (LGFM) with Fourier transform (FT). Inspired by human visual system (HVS), our memory enhancement is designed to capture the spatial relationships of infrared targets among video frames. Furthermore, it encodes temporal dynamics motion features via differential learning and residual enhancing. In addition, we further design a residual compensation to reconcile possible cross-domain feature mismatches. To our best knowledge, proposed Tridos is the first work to explore infrared target feature learning comprehensively in spatiotemporal-frequency domains. The extensive experiments on three datasets (i.e., DAUB, ITSDT-15K, and IRDST) validate that our triple-domain infrared feature learning scheme could often be obviously superior to state-of-the-art (SOTA) ones. Source codes are available at https://github.com/UESTC-nnLab/Tridos.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Infrared Dim and Small Target Detection Based on Superpixel Segmentation and Spatiotemporal Cluster 4D Fully-Connected Tensor Network Decomposition

Wenyan Wei,Tao Ma,Meihui Li,Haorui Zuo

DOI: https://doi.org/10.3390/rs16010034

IF: 5

2023-12-22

Remote Sensing

Abstract:The detection of infrared dim and small targets in complex backgrounds is very challenging because of the low signal-to-noise ratio of targets and the drastic change in background. Low-rank sparse decomposition based on the structural characteristics of infrared images has attracted the attention of many scholars because of its good interpretability. In order to improve the sensitivity of sliding window size, insufficient utilization of time series information, and inaccurate tensor rank in existing methods, a four-dimensional tensor model based on superpixel segmentation and statistical clustering is proposed for infrared dim and small target detection (ISTD). First, the idea of superpixel segmentation is proposed to eliminate the dependence of the algorithm on selection of the sliding window size. Second, based on the improved structure tensor theory, the image pixels are statistically clustered into three types: corner region, flat region, and edge region, and are assigned different weights to reduce the influence of background edges. Next, in order to better use spatiotemporal correlation, a Four-Dimensional Fully-Connected Tensor Network (4D-FCTN) model is proposed in which 3D patches with the same feature types are rearranged into the same group to form a four-dimensional tensor. Finally, the FCTN decomposition method is used to decompose the clustered tensor into low-dimensional tensors, with the alternating direction multiplier method (ADMM) used to decompose the low-rank background part and sparse target part. We validated our model across various datasets, employing cutting-edge methodologies to assess its effectiveness in terms of detection precision and reduction of background interference. A comparative analysis corroborated the superiority of our proposed approach over prevailing techniques.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Infrared Small-Target Detection Based on Radiation Characteristics with a Multimodal Feature Fusion Network

Di Wu,Lihua Cao,Pengji Zhou,Ning Li,Yi Li,Dejun Wang

DOI: https://doi.org/10.3390/rs14153570

IF: 5

2022-07-26

Remote Sensing

Abstract:Infrared small-target detection has widespread influences on anti-missile warning, precise weapon guidance, infrared stealth and anti-stealth, military reconnaissance, and other national defense fields. However, small targets are easily submerged in background clutter noise and have fewer pixels and shape features. Furthermore, random target positions and irregular motion can lead to target detection being carried out in the whole space–time domain. This could result in a large amount of calculation, and the accuracy and real-time performance are difficult to be guaranteed. Therefore, infrared small-target detection is still a challenging and far-reaching research hotspot. To solve the above problem, a novel multimodal feature fusion network (MFFN) is proposed, based on morphological characteristics, infrared radiation, and motion characteristics, which could compensate for the deficiency in the description of single modal characteristics of small targets and improve the recognition precision. Our innovations introduced in the paper are addressed in the following three aspects: Firstly, in the morphological domain, we propose a network with the skip-connected feature pyramid network (SCFPN) and dilated convolutional block attention module integrated with Resblock (DAMR) introduced to the backbone, which is designed to improve the feature extraction ability for infrared small targets. Secondly, in the radiation characteristic domain, we propose a prediction model of atmospheric transmittance based on deep neural networks (DNNs), which predicts the atmospheric transmittance effectively without being limited by the complex environment to improve the measurement accuracy of radiation characteristics. Finally, the dilated convolutional-network-based bidirectional encoder representation from a transformers (DC-BERT) structure combined with an attention mechanism is proposed for the feature extraction of radiation and motion characteristics. Finally, experiments on our self-established optoelectronic equipment detected dataset (OEDD) show that our method is superior to eight state-of-the-art algorithms in terms of the accuracy and robustness of infrared small-target detection. The comparative experimental results of four kinds of target sequences indicate that the average recognition rate Pavg is 92.64%, the mean average precision (mAP) is 92.01%, and the F1 score is 90.52%.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Infrared Dim and Small Target Detection from Complex Scenes via Multi-Frame Spatial-Temporal Patch-Tensor Model

Zongxu Pan,Yuhan Liu,Yuxin Hu,Yapeng Ma

DOI: https://doi.org/10.3390/rs14092234

IF: 5

2022-05-06

Remote Sensing

Abstract:Infrared imaging plays an important role in space-based early warning and anti-missile guidance due to its particular imaging mechanism. However, the signal-to-noise ratio of the infrared image is usually low and the target is moving, which makes most of the existing methods perform inferiorly, especially in very complex scenes. To solve these difficulties, this paper proposes a novel multi-frame spatial–temporal patch-tensor (MFSTPT) model for infrared dim and small target detection from complex scenes. First, the method of simultaneous sampling in spatial and temporal domains is adopted to make full use of the information between multi-frame images, establishing an image-patch tensor model that makes the complex background more in line with the low-rank assumption. Secondly, we propose utilizing the Laplace method to approximate the rank of the tensor, which is more accurate. Third, to suppress strong interference and sparse noise, a prior weighted saliency map is established through a weighted local structure tensor, and different weights are assigned to the target and background. Using an alternating direction method of multipliers (ADMM) to solve the model, we can accurately separate the background and target components and acquire the detection results. Through qualitative and quantitative analysis, experimental results of multiple real sequences verify the rationality and effectiveness of the proposed algorithm.

Engineering,Computer Science
Multiscale Feature Extraction U-Net for Infrared Dim- and Small-Target Detection

Xiaozhen Wang,Chengshan Han,Jiaqi Li,Ting Nie,Mingxuan Li,Xiaofeng Wang,Liang Huang

DOI: https://doi.org/10.3390/rs16040643

IF: 5

2024-02-09

Remote Sensing

Abstract:The technology of infrared dim- and small-target detection is irreplaceable in many fields, such as those of missile early warning systems and forest fire prevention, among others. However, numerous components interfere with infrared imaging, presenting challenges for achieving successful detection of infrared dim and small targets with a low rate of false alarms. Hence, we propose a new infrared dim- and small-target detection network, Multiscale Feature Extraction U-Net for Infrared Dim- and Small-Target Detection (MFEU-Net), which can accurately detect targets in complex backgrounds. It uses the U-Net structure, and the encoders and decoders consist of ReSidual U-block and Inception, allowing rich multiscale feature information to be extracted. Thus, the effectiveness of algorithms in detecting very small-sized targets can be improved. In addition, through the multidimensional channel and spatial attention mechanism, the model can be adjusted to focus more on the target area in the image, improving its extraction of target information and detection performance in different scenarios. The experimental results show that our proposed algorithm outperforms other advanced algorithms in detection performance. On the MFIRST, SIRST, and IRSTD-1k datasets, we achieved detection rates of 0.864, 0.962, and 0.965; IoU values of 0.514, 0.671, and 0.630; and false alarm rates of 3.08 × 10−5, 2.61 × 10−6, and 1.81 × 10−5, respectively.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Robust Unsupervised Multifeature Representation for Infrared Small Target Detection

Liqiong Chen,Tong Wu,Shuyuan Zheng,Zhaobing Qiu,Feng Huang

DOI: https://doi.org/10.1109/jstars.2024.3398361

IF: 4.715

2024-05-31

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:Infrared small target detection is critical to infrared search and tracking systems. However, accurate and robust detection remains challenging due to the scarcity of target information and the complexity of clutter interference. Existing methods have some limitations in feature representation, leading to poor detection performance in complex scenes. Especially when there are sharp edges near the target or in cluster multitarget detection, the "target suppression" phenomenon tends to occur. To address this issue, we propose a robust unsupervised multifeature representation (RUMFR) method for infrared small target detection. On the one hand, robust unsupervised spatial clustering (RUSC) is designed to improve the accuracy of feature extraction; on the other hand, pixel-level multiple feature representation is proposed to fully utilize the target detail information. Specifically, we first propose the center-weighted interclass difference measure (CWIDM) with a trilayer design for fast candidate target extraction. Note that CWIDM also guides the parameter settings of RUSC. Then, the RUSC-based model is constructed to accurately extract target features in complex scenes. By designing the parameter adaptive strategy and iterative clustering strategy, RUSC can robustly segment cluster multitargets from complex backgrounds. Finally, RUMFR that fuses pixel-level contrast, distribution, and directional gradient features is proposed for better target representation and clutter suppression. Extensive experimental results show that our method has stronger feature representation capability and achieves better detection performance than several state-of-the-art methods.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geography, physical
Dim and Small Target Detection in Multi-Frame Sequence Using Bi-Conv-LSTM and 3D-Conv Structure

Xin Liu,Xiaoyan Li,Liyuan Li,Xiaofeng Su,Fansheng Chen

DOI: https://doi.org/10.1109/access.2021.3110395

IF: 3.9

2021-01-01

IEEE Access

Abstract:Infrared dim and small target detection is widely used in military and civil fields. Traditional methods in that application rely on the local contrast between the target and background for single-frame detection. On the other hand, those algorithms depend on the motion model with fixed parameters for multi-frame association. For the great similarity of gray value and the dynamic changes of motion model parameters in the condition of low SNR and strong clutter, those methods possess weak robustness, low detection probability, and high false alarm rate. In this paper, an infrared video sequences encoding and decoding model based on Bidirectional Convolutional Long Short-Term Memory structure (Bi-Conv-LSTM) and 3D Convolutional structure (3D-Conv) is proposed, addressing the problem of high similarity and dynamic changes of parameters. For solving the problem of dynamic change in parameters, Bi-Conv-LSTM structure is used to learn the motion model of targets. And for the problem of low local contrast, 3D-Conv structure is adopted to extend receptive field in the time dimension. In order to improve the precision of detection, the Decoding part is divided into two different full connections with distinctive active function. Simulation results show that the trajectory detection accuracy of the proposed model is more than 90% under the condition of low SNR and maneuvering motion, which is better than traditional method of 80% in DB-TBD 20% in others. Real data experiment to illustrate that that our proposed method can detect small infrared targets of a low false alarm rate and high detection probability.

computer science, information systems,telecommunications,engineering, electrical & electronic
Exploring Feature Compensation and Cross-level Correlation for Infrared Small Target Detection

Xinbo Gao,Ke Yue,Jing Zhang,Yunsong Li,Mingjin Zhang

DOI: https://doi.org/10.1145/3503161.3548264

2022-10-10

Abstract:Single frame infrared small target (SIRST) detection is useful for many practical applications, such as maritime rescue. However, SIRST detection is challenging due to the low-contrast between small targets and noisy background in infrared images. To address this challenge, we propose a novel FC3-Net by exploring feature compensation and cross-level correlation for SIRST detection. Specifically, FC3-Net consists of a Fine-detail guided Multi-level Feature Compensation (F-MFC) module, and a Cross-level Feature Correlation (CFC) module. The F-MFC module aims to compensate the information loss of details caused by the downsampling layers in convolutional neural networks (CNN) via aggregating features from multiple adjacent levels, so that the detail features of small targets can be propagated to the deeper layers of the network. Besides, to suppress the side impact of background noise, the CFC module constructs an energy filtering kernel based on the higher-level features with less background noise to filter out the noise in the middle-level features, and fuse them with the low-level ones to learn a strong target representation. Putting them together into the encoder-decoder structure, our FC3-Net could produce an accurate target mask with fine shape and details. Experiment results on the public NUAA-SIRST and IRSTD-1k datasets demonstrate that the proposed FC3-Net outperforms state-of-the-art methods in terms of both pixel-level and object-level metrics. The code will be released at https://github.com/IPIC-Lab/SIRST-Detection-FC3-Net.

Computer Science,Engineering
Clustering and Tracking-Guided Infrared Spatial-Temporal Small Target Detection

Yuan Luo,Xiaorun Li,Jing Wang,Shuhan Chen

DOI: https://doi.org/10.1109/tgrs.2024.3384440

IF: 8.2

2024-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:In various civilian and military applications, infrared (IR) small target detection is faced with difficulties because of complex backgrounds, low signal-to-clutter ratio (SCR), and clutter interference. Although low-rank and sparse theories based on tensor analysis have been widely employed, three crucial issues persist. The first concerns accurate estimation of target and background, the second involves the development of a more comprehensive target detection model, and the last one is real-time detection performance. This article proposes an IR small target detection method named clustering and tracking-guided IR small target spatial-temporal prediction completion (CTSTC) model. Specifically, a 3-D spatial-temporal tensor is constructed in the high-frequency domain, incorporating target detection priors and subsequent yet-to-be-detected IR frames as foundational data for the prediction completion model. Second, we improve the $K$ -means clustering algorithm for multiple low-rank background clusters, followed by designing an improved $K$ -means clustering-derived rank surrogate (IKCR), resulting in more accurate low-rank background estimation. Furthermore, a Bayesian-inference-derived tracking regularization is incorporated into the completion model to describe the motions and state transitions of targets, thereby improving the robustness of interferences. Meanwhile, an efficient alternating direction method of multipliers (ADMM)-based optimization scheme is designed for solving the completion model. In addition, spatial-temporal evolution-based fusion strategies are proposed, which utilize the past and future spatial-temporal knowledge for the assistance of the detection of current frames and enhance both target detectability (TD) and background suppressibility (BS) of the prediction completion model. Compared with ten state-of-the-art competitive methods, extensive experiments on five practical datasets have illustrated the superiority of CTSTC in terms of TD, BS, and overall performance.

[Mixed endocrine tumor with atypical Verner-Morrison syndrome: dissociated responses to somatostatin infusion and surgery].

MRF3Net: Infrared Small Target Detection Using Multi-Receptive Field Perception and Effective Feature Fusion

An Effective TBD Algorithm for the Detection of Infrared Dim-Small Moving Target in the Sky Scene

4DST-BTMD: an Infrared Small Target Detection Method Based on 4-D Data-Sphered Space

Dense Nested Attention Network for Infrared Small Target Detection

5-D Spatial-Temporal Information-Based Infrared Small Target Detection in Complex Environments

LEC-MTNN: a Novel Multi-Frame Infrared Small Target Detection Method Based on Spatial-Temporal Patch-Tensor

A Spatial-Temporal Feature-Based Detection Framework for Infrared Dim Small Target

SSTNet: Sliced Spatio-Temporal Network With Cross-Slice ConvLSTM for Moving Infrared Dim-Small Target Detection

Multi-Scale Direction-Aware Network for Infrared Small Target Detection

Toward Dense Moving Infrared Small Target Detection: New Datasets and Baseline

Triple-Domain Feature Learning With Frequency-Aware Memory Enhancement for Moving Infrared Small Target Detection

Infrared Dim and Small Target Detection Based on Superpixel Segmentation and Spatiotemporal Cluster 4D Fully-Connected Tensor Network Decomposition

Infrared Small-Target Detection Based on Radiation Characteristics with a Multimodal Feature Fusion Network

Infrared Dim and Small Target Detection from Complex Scenes via Multi-Frame Spatial-Temporal Patch-Tensor Model

Multiscale Feature Extraction U-Net for Infrared Dim- and Small-Target Detection

Robust Unsupervised Multifeature Representation for Infrared Small Target Detection

Dim and Small Target Detection in Multi-Frame Sequence Using Bi-Conv-LSTM and 3D-Conv Structure

Exploring Feature Compensation and Cross-level Correlation for Infrared Small Target Detection

Clustering and Tracking-Guided Infrared Spatial-Temporal Small Target Detection