Patient safety. Safe and sound.

J. Carthey,S. Woodward,S. Adams,Martin Fletcher,M. Rejman

2003-11-13

Abstract:

What problem does this paper attempt to address?

Adaptive Data Augmentation Training Method for SAR Military Target Classification

Hongren Chen,Jiming Lv,Jiawei Huang,Di Wu,Daiyin Zhu

DOI: https://doi.org/10.1109/ICSIP61881.2024.10671494

2024-07-12

Abstract:Synthetic Aperture Radar, as a primary means of military reconnaissance, necessitates its related automatic identification technology to possess sufficient reliability and portability. However, the application of neural networks for the identification of target radar images often encounters a severe issue of overfitting. In this study, we propose an adaptive data augmentation technique that gradually expands the training set. Initially, we apply various data augmentation methods to the images in the dataset, in which there is a crucial denoising method proposed by us. Subsequently, the augmented images are trained alongside the original images, enabling the network to autonomously learn the correlations between the images, thus achieving the objective of reducing overfitting. Our experiments, conducted by comparing the training of multiple models on the FAST and MSTAR datasets, demonstrate the excellent performance of the adaptive data augmentation method in enhancing model attention and combating overfitting. We achieve up to maximum 10% accuracy improvements on FAST datasets with only changes in data enhancement

Computer Science,Engineering
Training Deep Learning Models with Hybrid Datasets for Robust Automatic Target Detection on real SAR images

Benjamin Camus,Théo Voillemin,Corentin Le Barbu,Jean-Christophe Louvigné,Carole Belloni,Emmanuel Vallée

2024-05-15

Abstract:In this work, we propose to tackle several challenges hindering the development of Automatic Target Detection (ATD) algorithms for ground targets in SAR images. To address the lack of representative training data, we propose a Deep Learning approach to train ATD models with synthetic target signatures produced with the MOCEM simulator. We define an incrustation pipeline to incorporate synthetic targets into real backgrounds. Using this hybrid dataset, we train ATD models specifically tailored to bridge the domain gap between synthetic and real data. Our approach notably relies on massive physics-based data augmentation techniques and Adversarial Training of two deep-learning detection architectures. We then test these models on several datasets, including (1) patchworks of real SAR images, (2) images with the incrustation of real targets in real backgrounds, and (3) images with the incrustation of synthetic background objects in real backgrounds. Results show that the produced hybrid datasets are exempt from image overlay bias. Our approach can reach up to 90% of Average Precision on real data while exclusively using synthetic targets for training.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning,Signal Processing
Weighted residual network for SAR automatic target recognition with data augmentation

Junyu Li,Cheng Peng

DOI: https://doi.org/10.3389/fnbot.2023.1298653

IF: 3.493

2023-12-20

Frontiers in Neurorobotics

Abstract:Introduction: Decades of research have been dedicated to overcoming the obstacles inherent in synthetic aperture radar (SAR) automatic target recognition (ATR). The rise of deep learning technologies has brought a wave of new possibilities, demonstrating significant progress in the field. However, challenges like the susceptibility of SAR images to noise, the requirement for large-scale training datasets, and the often protracted duration of model training still persist. Methods: This paper introduces a novel data augmentation strategy to address these issues. Our method involves the intentional addition and subsequent removal of speckle noise to artificially enlarge the scope of training data through noise perturbation. Furthermore, we propose a modified network architecture named weighted ResNet, which incorporates residual strain controls for enhanced performance. This network is designed to be computationally efficient and to minimize the amount of training data required. Results: Through rigorous experimental analysis, our research confirms that the proposed data augmentation method, when used in conjunction with the weighted ResNet model, significantly reduces the time needed for training. It also improves the SAR ATR capabilities. Discussion: Compared to existing models and methods tested, the combination of our data augmentation scheme and the weighted ResNet framework achieves higher computational efficiency and better recognition accuracy in SAR ATR applications. This suggests that our approach could be a valuable advancement in the field of SAR image analysis.

robotics,computer science, artificial intelligence,neurosciences
SAR Target Detection Based on SSD with Data Augmentation and Transfer Learning

Zhaocheng Wang,Lan Du,Jiashun Mao,Bin Liu,Dongwen Yang

DOI: https://doi.org/10.1109/lgrs.2018.2867242

IF: 5.343

2019-01-01

IEEE Geoscience and Remote Sensing Letters

Abstract:In this letter, the single shot multibox detector (SSD), which is a real-time object detection method based on convolutional neural network, is applied to realize target detection for synthetic aperture radar (SAR) images. Since there are no sufficient labeled images for training in SAR target detection, we apply two strategies, data augmentation and transfer learning. For data augmentation, the first approaches to use some image processing methods, i.e., manual-extracting subimages, adding noise, filtering, and flipping, on the original training images to generate some new training images; the second approach is to employ the existing SAR target recognition data set, MSTAR data set, to assist in accomplishing the target detection task. For transfer learning, we first apply subaperture decomposition technique on original SAR images to acquire three-channel subaperture SAR images, and then transfer the three-channel VGGNet model pretrained on the ImageNet data set to the three-channel subaperture SAR images, in order to initialize corresponding parameters of the convolutional layers in the base network in our SSD. The feature extraction network, consisting of the base network and the auxiliary structure, is used to learn multiscale feature maps, and then convolutional predictors are used to acquire the final detection results. The experimental results on the miniSAR real image data set demonstrate that the proposed method can obtain better detection performance than other detection methods.
Single-Scene SAR Image Data Augmentation Based on SBR and GAN for Target Recognition

Shangchen Feng,Xikai Fu,Yanlin Feng,Xiaolei Lv

DOI: https://doi.org/10.3390/rs16234427

IF: 5

2024-11-29

Remote Sensing

Abstract:High-performance neural networks for synthetic aperture radar (SAR) automatic target recognition (ATR) often encounter the challenge of data scarcity. The lack of sufficient labeled SAR image datasets leads to the consideration of using simulated data to supplement the dataset. On the one hand, electromagnetic computation simulations provide high amplitude accuracy but are inefficient for large-scale datasets due to their complex computations and physical models. On the other hand, ray tracing simulations offer high geometric accuracy and computational efficiency but struggle with low amplitude correctness, hindering accurate numerical feature extraction. Furthermore, the emergence of generative adversarial networks (GANs) provides a way to generate simulated datasets, trying to balance computational efficiency with image quality. Nevertheless, the simulated SAR images generated based on random noise lack constraints, and it is also difficult to generate images that exceed the parameter conditions of the real image's training set. Hence, it is essential to integrate physics-based simulation techniques into GANs to enhance the generalization ability of the imaging parameters. In this paper, we present the SingleScene-SAR Simulator, an efficient framework for SAR image simulation that operates under limited real SAR data. This simulator integrates rasterized shooting and bouncing rays (SBR) with cycle GAN, effectively achieving both amplitude correctness and geometric accuracy. The simulated images are appropriate for augmenting datasets in target recognition networks. Firstly, the SingleScene-SAR Simulator employs a rasterized SBR algorithm to generate radar cross section (RCS) images of target models. Secondly, a specific training pattern for cycle GAN is established to translate noisy RCS images into simulated SAR images that closely resemble real ones. Finally, these simulated images are utilized for data augmentation. Experimental results based on the constructed dataset show that with only one scene SAR image containing 30 target chips, the SingleScene-SAR Simulator can efficiently produce simulated SAR images that exhibit high similarity in both spatial and statistical distributions compared with real images. By employing simulated SAR images for data augmentation, the accuracy of target recognition networks can be consistently and significantly enhanced.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
SAR ATR Method with Limited Training Data via an Embedded Feature Augmenter and Dynamic Hierarchical-Feature Refiner

Chenwei Wang,Siyi Luo,Yulin Huang,Jifang Pei,Yin Zhang,Jianyu Yang

2023-09-01

Abstract:Without sufficient data, the quantity of information available for supervised training is constrained, as obtaining sufficient synthetic aperture radar (SAR) training data in practice is frequently challenging. Therefore, current SAR automatic target recognition (ATR) algorithms perform poorly with limited training data availability, resulting in a critical need to increase SAR ATR performance. In this study, a new method to improve SAR ATR when training data are limited is proposed. First, an embedded feature augmenter is designed to enhance the extracted virtual features located far away from the class center. Based on the relative distribution of the features, the algorithm pulls the corresponding virtual features with different strengths toward the corresponding class center. The designed augmenter increases the amount of information available for supervised training and improves the separability of the extracted features. Second, a dynamic hierarchical-feature refiner is proposed to capture the discriminative local features of the samples. Through dynamically generated kernels, the proposed refiner integrates the discriminative local features of different dimensions into the global features, further enhancing the inner-class compactness and inter-class separability of the extracted features. The proposed method not only increases the amount of information available for supervised training but also extracts the discriminative features from the samples, resulting in superior ATR performance in problems with limited SAR training data. Experimental results on the moving and stationary target acquisition and recognition (MSTAR), OpenSARShip, and FUSAR-Ship benchmark datasets demonstrate the robustness and outstanding ATR performance of the proposed method in response to limited SAR training data.

Image and Video Processing
Monostatic and Bistatic SAR Automatic Target Recognition with Multi-Aspect Feature Fusion in Open Environment

Wei Li,Zhe Geng,Daiyin Zhu,Haowen Zhou

DOI: https://doi.org/10.1109/ICSIP61881.2024.10671486

2024-07-12

Abstract:Synthetic aperture radar (SAR) automatic target recognition (ATR) in an open environment full of out-of-library (OOL) targets is more technically challenging than SAR-ATR concerning only known targets. Leveraging the Synthetic and Measured Paired Labeled Experiment (SAMPLE) dataset in the public domain and a proprietary bistatic SAR database featuring multiple types of representative military vehicles, we present a novel deep neural network (DNN) for categorizing the OOL military vehicles by jointly exploiting the multi-aspect target features and the prior knowledge regarding the scene of interest. The proposed network has a reconfigurable structure that could easily incorporate two extension modules specifically designed for the mission at hand, a cross-modality context analysis module for target prescreening and a local feature matching module for target variants and hybrid target identification. Preliminary experiment results show that the proposed network outperform the existing networks in categorizing the OOL targets in open environment.

Environmental Science,Engineering,Computer Science
ATGAN: A SAR Target Image Generation Method for Automatic Target Recognition

Zhiqiang Zeng,Xiaoheng Tan,Xin Zhang,Yan Huang,Jun Wan,Zhanye Chen

DOI: https://doi.org/10.1109/jstars.2024.3370185

IF: 4.715

2024-03-15

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:The performance of a deep learning-based synthetic aperture radar (SAR) automatic target recognition (ATR) model largely relies on the scale and quality of training samples. However, it is time-consuming and expensive to collect sufficient data in practice. Although generative adversarial network (GAN) provides a way for SAR target image generation, existing GAN-based methods cannot confirm what features the generator learns, thus they struggle in generating precise SAR target images. In this article, we propose an angle transformation GAN (ATGAN) that can generate azimuth-controllable SAR target images while preserving the target details. The key idea of our ATGAN is to reframe the generation task from the perspective of image-to-image translation. To this end, ATGAN consists of two modules, a coarse-to-fine generator that aims to learn the angle transformation in the deep feature space, and then, apply it to manipulate the representation of an input SAR target image to generate a new one, while a spectral-normalized patch discriminator that tries to estimate the probability that an input SAR target image is real rather than fake using a patch-averaged strategy. Combining with spatial transformer and adversarial training paradigm, ATGAN can generate precise SAR target images for ATR. Extensive experiments verify the effectiveness of the proposed ATGAN, and our method outperforms the state-of-the-art method qualitatively and quantitatively.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geography, physical
Transductive Prototypical Attention Reasoning Network for Few-Shot SAR Target Recognition

Haohao Ren,Sen Liu,Xuelian Yu,Lin Zou,Yun Zhou,Xuegang Wang,Hao Tang

DOI: https://doi.org/10.1109/tgrs.2023.3271218

IF: 8.2

2023-05-12

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Deep-learning-based synthetic aperture radar (SAR) automatic target recognition (ATR) algorithms have achieved outstanding performance under the condition of hundreds or thousands of training samples in recent years. Nevertheless, it is often rare to acquire great quantities of target samples in real SAR application scenarios. This article proposes a novel ATR method called transductive prototypical attention reasoning network (TPARN) to solve the problem of SAR target recognition with only a few training samples. To be specific, a region-awareness-based feature extraction model is first developed, which can effectively focus on the target region of interest (RoI) and suppress the background clutter by embedding direction-aware and position-sensitive information to extract more transferable knowledge. To heighten the discrimination of the sample features, a cross-feature spatial attention (CFSA) module is then proposed following the feature embedding model. Finally, a transductive prototype reasoning method is presented to realize the identity reasoning of the target, which can continuously update each class prototype with training samples and test samples together, thereby improving the classification accuracy. In addition, a marginal adaptive hybrid loss (MAHL) is proposed to obtain a discriminative feature embedding space with intraclass compactness and interclass divergence, aiming to facilitate subsequent target identity reasoning. Extensive experiments on the moving and stationary target acquisition and recognition (MSTAR) benchmark dataset reveal that the proposed method outperforms some state-of-the-arts under different few-shot SAR ATR tasks.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Learning Efficient Representations for Enhanced Object Detection on Large-scene SAR Images

Siyan Li,Yue Xiao,Yuhang Zhang,Lei Chu,Robert C. Qiu

DOI: https://doi.org/10.48550/arXiv.2201.08958

2022-01-22

Abstract:It is a challenging problem to detect and recognize targets on complex large-scene Synthetic Aperture Radar (SAR) images. Recently developed deep learning algorithms can automatically learn the intrinsic features of SAR images, but still have much room for improvement on large-scene SAR images with limited data. In this paper, based on learning representations and multi-scale features of SAR images, we propose an efficient and robust deep learning based target detection method. Especially, by leveraging the effectiveness of adversarial autoencoder (AAE) which influences the distribution of the investigated data explicitly, the raw SAR dataset is augmented into an enhanced version with a large quantity and diversity. Besides, an auto-labeling scheme is proposed to improve labeling efficiency. Finally, with jointly training small target chips and large-scene images, an integrated YOLO network combining non-maximum suppression on sub-images is used to realize multiple targets detection of high resolution images. The numerical experimental results on the MSTAR dataset show that our method can realize target detection and recognition on large-scene images accurately and efficiently. The superior anti-noise performance is also confirmed by experiments.

Computer Vision and Pattern Recognition
Multi-Aspect SAR Target Recognition Based on Prototypical Network with a Small Number of Training Samples

Pengfei Zhao,Lijia Huang,Yu Xin,Jiayi Guo,Zongxu Pan

DOI: https://doi.org/10.3390/s21134333

IF: 3.9

2021-06-24

Sensors

Abstract:At present, synthetic aperture radar (SAR) automatic target recognition (ATR) has been deeply researched and widely used in military and civilian fields. SAR images are very sensitive to the azimuth aspect of the imaging geomety; the same target at different aspects differs greatly. Thus, the multi-aspect SAR image sequence contains more information for classification and recognition, which requires the reliable and robust multi-aspect target recognition method. Nowadays, SAR target recognition methods are mostly based on deep learning. However, the SAR dataset is usually expensive to obtain, especially for a certain target. It is difficult to obtain enough samples for deep learning model training. This paper proposes a multi-aspect SAR target recognition method based on a prototypical network. Furthermore, methods such as multi-task learning and multi-level feature fusion are also introduced to enhance the recognition accuracy under the case of a small number of training samples. The experiments by using the MSTAR dataset have proven that the recognition accuracy of our method can be close to the accruacy level by all samples and our method can be applied to other feather extraction models to deal with small sample learning problems.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Attribute Feature Perturbation-Based Augmentation of SAR Target Data

Rubo Jin,Jianda Cheng,Wei Wang,Huiqiang Zhang,Jun Zhang

DOI: https://doi.org/10.3390/s24155006

2024-08-02

Abstract:Large-scale, diverse, and high-quality data are the basis and key to achieving a good generalization of target detection and recognition algorithms based on deep learning. However, the existing methods for the intelligent augmentation of synthetic aperture radar (SAR) images are confronted with several issues, including training instability, inferior image quality, lack of physical interpretability, etc. To solve the above problems, this paper proposes a feature-level SAR target-data augmentation method. First, an enhanced capsule neural network (CapsNet) is proposed and employed for feature extraction, decoupling the attribute information of input data. Moreover, an attention mechanism-based attribute decoupling framework is used, which is beneficial for achieving a more effective representation of features. After that, the decoupled attribute feature, including amplitude, elevation angle, azimuth angle, and shape, can be perturbed to increase the diversity of features. On this basis, the augmentation of SAR target images is realized by reconstructing the perturbed features. In contrast to the augmentation methods using random noise as input, the proposed method realizes the mapping from the input of known distribution to the change in unknown distribution. This mapping method reduces the correlation distance between the input signal and the augmented data, therefore diminishing the demand for training data. In addition, we combine pixel loss and perceptual loss in the reconstruction process, which improves the quality of the augmented SAR data. The evaluation of the real and augmented images is conducted using four assessment metrics. The images generated by this method achieve a peak signal-to-noise ratio (PSNR) of 21.6845, radiometric resolution (RL) of 3.7114, and dynamic range (DR) of 24.0654. The experimental results demonstrate the superior performance of the proposed method.
Learning to Generate SAR Images With Adversarial Autoencoder

Qian Song,Feng Xu,Xiao Xiang Zhu,Ya-Qiu Jin

DOI: https://doi.org/10.1109/TGRS.2021.3086817

IF: 8.2

2022-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Deep learning-based synthetic aperture radar (SAR) target recognition often suffers from sparsely distributed training samples and rapid angular variations due to scattering scintillation. Thus, data-driven SAR target recognition is considered a typical few-shot learning (FSL) task. This article first reviews the key issues of FSL and provides a definition of the FSL task. A novel adversarial autoencoder (AAE) is then proposed as an SAR representation and generation network. It consists of a generator network that decodes target knowledge to SAR images and an adversarial discriminator network that not only learns to discriminate ``fake'' generated images from real ones but also encodes the input SAR image back to target knowledge. The discriminator employs progressively expanding convolution layers and a corresponding layer-by-layer training strategy. It uses two cyclic loss functions to enforce consistency between the inputs and outputs. Moreover, rotated cropping is introduced as a mechanism to address the challenge of representing the target orientation. The moving and stationary Target recognition (MSTAR) 7-target dataset is used to evaluate the AAE's performance, and the results demonstrate its ability to generate SAR images with aspect angular diversity. Using only 90 training samples with at least 25 degrees of orientation interval, the trained AAE is able to generate the remaining 1748 samples of other orientation angles with an unprecedented level of fidelity. Thus, it can be used for data augmentation in SAR target recognition FSL tasks. Our experimental results show that the AAE could boost the test accuracy by 5.77%.
Deep Learning for Target Classification from SAR Imagery: Data Augmentation and Translation Invariance

Hidetoshi Furukawa

DOI: https://doi.org/10.48550/arXiv.1708.07920

2017-08-26

Abstract:This report deals with translation invariance of convolutional neural networks (CNNs) for automatic target recognition (ATR) from synthetic aperture radar (SAR) imagery. In particular, the translation invariance of CNNs for SAR ATR represents the robustness against misalignment of target chips extracted from SAR images. To understand the translation invariance of the CNNs, we trained CNNs which classify the target chips from the MSTAR into the ten classes under the condition of with and without data augmentation, and then visualized the translation invariance of the CNNs. According to our results, even if we use a deep residual network, the translation invariance of the CNN without data augmentation using the aligned images such as the MSTAR target chips is not so large. A more important factor of translation invariance is the use of augmented training data. Furthermore, our CNN using augmented training data achieved a state-of-the-art classification accuracy of 99.6%. These results show an importance of domain-specific data augmentation.

Computer Vision and Pattern Recognition
A Review of Data Augmentation Methods of Remote Sensing Image Target Recognition

Xuejie Hao,Lu Liu,Rongjin Yang,Lizeyan Yin,Le Zhang,Xiuhong Li

DOI: https://doi.org/10.3390/rs15030827

IF: 5

2023-02-02

Remote Sensing

Abstract:In recent years, remote sensing target recognition algorithms based on deep learning technology have gradually become mainstream in the field of remote sensing because of the great improvements that have been made in the accuracy of image target recognition through the use of deep learning. In the research of remote sensing image target recognition based on deep learning, an insufficient number of research samples is often an encountered issue; too small a number of research samples will cause the phenomenon of an overfitting of the model. To solve this problem, data augmentation techniques have also been developed along with the popularity of deep learning, and many methods have been proposed. However, to date, there is no literature aimed at expounding and summarizing the current state of the research applied to data augmentation for remote sensing object recognition, which is the purpose of this article. First, based on the essential principles of data augmentation methods, the existing methods are divided into two categories: data-based data augmentation methods and network-based data augmentation methods. Second, this paper subdivides and compares each method category to show the advantages, disadvantages, and characteristics of each method. Finally, this paper discusses the limitations of the existing methods and points out future research directions for data augmentation methods.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Semisupervised Learning-Based SAR ATR via Self-Consistent Augmentation

Chen Wang,Jun Shi,Yuanyuan Zhou,Xiaqing Yang,Zenan Zhou,Shunjun Wei,Xiaoling Zhang

DOI: https://doi.org/10.1109/tgrs.2020.3013968

IF: 8.2

2021-06-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:In synthetic aperture radar (SAR) automatic target recognition, it is expensive and time-consuming to annotate the targets. Thus, training a network with a few labeled data and plenty of unlabeled data attracts attention of many researchers. In this article, we design a semisupervised learning framework including self-consistent augmentation rule, mixup-based mixture, and weighted loss, which allows a classification network to utilize unlabeled data during training and ultimately alleviates the demand of labeled data. The proposed self-consistent augmentation rule forces the samples before and after augmentation to share the same labels to utilize the unlabeled data, which can ensure the prominent effect of supervised learning part of the framework for training by balancing amounts of labeled and unlabeled samples in a minibatch, and makes the network achieve better performance. Then, a mixture method is introduced to mix the labeled, unlabeled, and augmented samples for the better involvement of label information in the mixed samples. By using cross-entropy loss for the mixed-labeled mixtures and mean-squared error loss for the mixed-unlabeled mixtures, the total loss is defined as the weighted sum of them. The experiments on the MSTAR data set and OpenSARShip data set show that the performance of the method is not only far better than the state of the art among current semisupervised-based classifiers but also near to the state of the art among the supervised learning-based networks.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Convolutional Neural Network With Attention Mechanism for SAR Automatic Target Recognition

Ming Zhang,Jubai An,Da Hua Yu,Li Dong Yang,Liang Wu,Xiao Qi Lu

DOI: https://doi.org/10.1109/lgrs.2020.3031593

IF: 5.343

2022-01-01

IEEE Geoscience and Remote Sensing Letters

Abstract:Synthetic aperture radar automatic target recognition (SAR ATR) is a key technique of remote-sensing image recognition, which has many potential applications in the fields of military surveillance, national defense, civil application, and so on. With the development of science and technology, deep convolutional neural network (DCNN) has been widely applied for SAR ATR. However, it is difficult to use deep learning to train models with limited ray SAR images. To resolve this problem, we proposed an effectively lightweight attention mechanism CNN (AM-CNN) model for SAR ATR. Extensive experimental results on the Moving and Stationary Target Acquisition and Recognition (MSTAR) data set illustrate that the AM-CNN model can achieve a superior recognition performance, and the average recognition accuracy can reach 99.35% on the classification of 10 class targets. Compared with the traditional CNN and the state-of-the-art method, our model is significantly superior to improve performance and efficiency.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Target Recognition in ISAR Image via Range Profile Perturbation Imaging

Ganggang Dong,Hongwei Liu

DOI: https://doi.org/10.1109/tgrs.2024.3502695

IF: 8.2

2024-11-29

IEEE Transactions on Geoscience and Remote Sensing

Abstract:The deep learning-based target recognition methods have achieved great success in recent years. The major advantage lies in the ability to learn the high-level representation from the input data adaptively. Yet, they relied on large amounts of training data to cover the complete distribution space of samples. It is infeasible to be met in the practical applications. The fitting ability and the learning power were therefore deteriorated. To solve the problem, a new target augmentation method is proposed in this article. The original complex-valued image is first recast into the phase history. The range profiles are then randomly perturbed, such as the shift in cyclic, corruption in range bins, and the drop of range bins. The perturbed range profiles are used for target imaging, forming the new inverse synthetic aperture radar (ISAR) images. The diversity of the training dataset can be enhanced, and the learning effectiveness of the deep model can be improved accordingly. To verify the proposed method, several rounds of experiments are performed. The results demonstrate the advantages of the proposed method in comparison to state-of-the-art.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Physical-Related Feature Extraction From Simulated SAR Image Based on the Adversarial Encoding Network for Data Augmentation

Shaoyan Du,Jun Hong,Yu Wang,Kaichu Xing,Tian Qiu

DOI: https://doi.org/10.1109/lgrs.2021.3100642

IF: 5.343

2022-01-01

IEEE Geoscience and Remote Sensing Letters

Abstract:The synthetic aperture radar automatic target recognition (SAR ATR) application based on the deep convolutional network often faces data scarcity. SAR image simulation based on electromagnetic and geometric calculations can provide a large amount of data that contains interpretable physical features, such as shadow and contour. However, there is a big difference between the simulated SAR image and the real image, and it is difficult to directly use it for data augmentation. This letter proposes the adversarial encoding network to extract the physical-related features, which can be understood as the common features between the simulated and real data. By designing the adversarial learning between an encoder and a discriminator, the encoder can extract real features from the simulated images. The encoded features are sent to a classifier to ensure the correct category information. A decoder is used to reconstruct the encoded features into the input image so that the encoded feature retains the image information as much as possible. Ablation experiments and comparative experiments are used to verify the ability of each module and the performance of the proposed method. The results show that the proposed model can achieve 98.55% accuracy, especially when the real data are insufficient for classification, which verifies that the proposed method is effective for data augmentation.
Enhanced small target detection and color interpretation of synthetic aperture radar images

Zhuowei Wang,Junyang Liu,Juntao Xu,Genping Zhao

DOI: https://doi.org/10.1117/1.jrs.18.044504

IF: 1.568

2024-10-09

Journal of Applied Remote Sensing

Abstract:Simultaneous achievement of the detection of small targets in synthetic aperture radar (SAR) images and the visual interpretation of the entire scene remains challenging due to the SAR imaging properties. To address these challenges, a two-branch network, which includes a proposed target detection network of TYSAR-YOLOv5 and a SAR image colorization network of CycleGAN, is developed. TYSAR-YOLOv5 is established on the basis of the YOLOv5 network, which incorporates an additional detection head specifically designed for capturing small targets from shallow features. The BoTNet structure is also deployed in the backbone network to capture global information and locate targets in highly dense scenes accurately with an acceptable number of parameters. To enhance the interpretation of the surrounding environment of detected targets, the CycleGAN network known for style transfer capabilities is employed to colorize SAR images and fuse with detected targets to achieve the enhanced target detection result of the SAR image. We expanded and updated the large-scale multi-class SAR image target detection dataset-1.0 (MSAR-1.0) by adding small aircraft targets using data augmentation techniques. The reference color images corresponding to the SAR images of each target type are also added using Google Earth Engine and public vision data for SAR image colorization. Experimental results demonstrate that the developed network dominantly outperformed state-of-the-art target detection networks in small aircraft target detection and multi-class target detection tasks. Of more importance, the final visualizations of target detection exhibit excellent interpretability, which provides rich semantic information benefiting decision-making.

environmental sciences,imaging science & photographic technology,remote sensing

Patient safety. Safe and sound.

Adaptive Data Augmentation Training Method for SAR Military Target Classification

Training Deep Learning Models with Hybrid Datasets for Robust Automatic Target Detection on real SAR images

Weighted residual network for SAR automatic target recognition with data augmentation

SAR Target Detection Based on SSD with Data Augmentation and Transfer Learning

Single-Scene SAR Image Data Augmentation Based on SBR and GAN for Target Recognition

SAR ATR Method with Limited Training Data via an Embedded Feature Augmenter and Dynamic Hierarchical-Feature Refiner

Monostatic and Bistatic SAR Automatic Target Recognition with Multi-Aspect Feature Fusion in Open Environment

ATGAN: A SAR Target Image Generation Method for Automatic Target Recognition

Transductive Prototypical Attention Reasoning Network for Few-Shot SAR Target Recognition

Learning Efficient Representations for Enhanced Object Detection on Large-scene SAR Images

Multi-Aspect SAR Target Recognition Based on Prototypical Network with a Small Number of Training Samples

Attribute Feature Perturbation-Based Augmentation of SAR Target Data

Learning to Generate SAR Images With Adversarial Autoencoder

Deep Learning for Target Classification from SAR Imagery: Data Augmentation and Translation Invariance

A Review of Data Augmentation Methods of Remote Sensing Image Target Recognition

Semisupervised Learning-Based SAR ATR via Self-Consistent Augmentation

Convolutional Neural Network With Attention Mechanism for SAR Automatic Target Recognition

Target Recognition in ISAR Image via Range Profile Perturbation Imaging

Physical-Related Feature Extraction From Simulated SAR Image Based on the Adversarial Encoding Network for Data Augmentation

Enhanced small target detection and color interpretation of synthetic aperture radar images