Small Sample Learning with High Order Contractive Auto-Encoders and Application in SAR Images

Qianwen Yang,Fuchun Sun

DOI: https://doi.org/10.1007/s11432-017-9214-8

2018-01-01

Science China Information Sciences

Abstract:>Dear editor,Recently auto-encoders(AEs)are used as intermediate layers or unsupervised learning stages in deep learning networks[1].However,unlike other deep learning algorithms,which can extract higher-

What problem does this paper attempt to address?

Auto-AD: Autonomous Hyperspectral Anomaly Detection Network Based on Fully Convolutional Autoencoder

Shaoyu Wang,Xinyu Wang,Liangpei Zhang,Yanfei Zhong

DOI: https://doi.org/10.1109/tgrs.2021.3057721

IF: 8.2

2021-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Hyperspectral anomaly detection is aimed at detecting observations that differ from their surroundings, and is an active area of research in hyperspectral image processing. Recently, autoencoders (AEs) have been applied in hyperspectral anomaly detection; however, the existing AE-based methods are complicated and involve manual parameter setting and preprocessing and/or postprocessing procedures. In this article, an autonomous hyperspectral anomaly detection network (Auto-AD) is proposed, in which the background is reconstructed by the network and the anomalies appear as reconstruction errors. Specifically, through a fully convolutional AE with skip connections, the background can be reconstructed while the anomalies are difficult to reconstruct, since the anomalies are relatively small compared to the background and have a low probability of occurring in the image. To further suppress the anomaly reconstruction, an adaptive-weighted loss function is designed, where the weights of potential anomalous pixels with large reconstruction errors are reduced during training. As a result, the anomalies have a higher contrast with the background in the map of reconstruction errors. The experimental results obtained on a public airborne data set and two unmanned aerial vehicle-borne hyperspectral data sets confirm the effectiveness of the proposed Auto-AD method.
Self-taught Learning with Residual Sparse Autoencoders for HEp-2 Cell Staining Pattern Recognition

Xian-Hua Han,JiandDe Sun,Lanfen Lin,Yen-Wei Chen

DOI: https://doi.org/10.1007/978-3-030-00919-9_16

2018-01-01

Abstract:Self-taught learning aims at obtaining compact and latent representations from data them-selves without previously manual labeling, which would be time-consuming and laborious. This study proposes a novel self-taught learning for more accurately reconstructing the raw data based on the sparse autoencoder. It is well known that autoencoder is able to learn latent features via setting the target values to be equal to the input data, and can be stacked for pursuing high-level feature learning. Motivated by the natural sparsity of data representation, sparsity has been imposed on the hidden layer responses of autoencoder for more effective feature learning. Although the conventional autoencoder-based feature learning aims at obtaining the latent representation via minimizing the approximation error of the input data, it is unavoidable to produce reconstruction residual error of the input data and thus some tiny structures are unable to be represented, which may be essential information for fine-grained image task such as medical image analysis. Even with the multiple-layer stacking for high-level feature pursuing in autoencoder-based learning strategy, the lost tiny structure in the former layers can not be recovered evermore. Therefore, this study proposes a residual sparse autoencoder for learning the latent feature representation of more tiny structures in the raw input data. With the unavoidably generated reconstruction residual error, we exploit another sparse autoencoder to pursuing the latent feature of the residual tiny structures and this self-taught learning process can continue until the representation residual error is enough small. We evaluate the proposed residual sparse autoencoding for self-taught learning the latent representations of HEp-2 cell image, and prove that promising performance for staining pattern recognition can be achieved compared with the conventional sparse autoencoder and the-state-of-the-art methods.
Remote Sensing Image Recognition Based on Generalized Regularized Auto-Encoders

YANG Qianwen,SUN Fuchun

DOI: https://doi.org/10.16511/j.cnki.qhdxxb.2018.25.006

2018-01-01

Abstract:This paper addresses the problem of sample scarcity in SAR (synthetic aperture radar) images,which are very useful remote sensing sources but are very costly to obtain.SAR images have limited samples which makes it hard to get a standardized "good" model for even simple classification tasks.Then,the limited samples are expanded via generalization of the sample space using prior and a priori information including labels.Then,auto-learning models,regularized auto-encoders,are used to extract useful features from the generalized sample space.A regularization term is used to penalize generalized samples in an image recognition algorithm.The method produces good results on limit sized subsets from the MNIST database and the SAR MSTAR image dataset.With limited input samples,the method gives better reconstruction errors and recognition accuracies in the SAR ship images than the state of-art methods.Thus,this algorithm is shown to be successful in both theoretical analyses and tests.
Single Sample Face Recognition Via Learning Deep Supervised Autoencoders

Shenghua Gao,Yuting Zhang,Kui Jia,Jiwen Lu,Yingying Zhang

DOI: https://doi.org/10.1109/tifs.2015.2446438

IF: 7.231

2015-01-01

IEEE Transactions on Information Forensics and Security

Abstract:This paper targets learning robust image representation for single training sample per person face recognition. Motivated by the success of deep learning in image representation, we propose a supervised autoencoder, which is a new type of building block for deep architectures. There are two features distinct our supervised autoencoder from standard autoencoder. First, we enforce the faces with variants to be mapped with the canonical face of the person, for example, frontal face with neutral expression and normal illumination; Second, we enforce features corresponding to the same person to be similar. As a result, our supervised autoencoder extracts the features which are robust to variances in illumination, expression, occlusion, and pose, and facilitates the face recognition. We stack such supervised autoencoders to get the deep architecture and use it for extracting features in image representation. Experimental results on the AR, Extended Yale B, CMU-PIE, and Multi-PIE data sets demonstrate that by coupling with the commonly used sparse representation-based classification, our stacked supervised autoencoders-based face representation significantly outperforms the commonly used image representations in single sample per person face recognition, and it achieves higher recognition accuracy compared with other deep learning models, including the deep Lambertian network, in spite of much less training data and without any domain information. Moreover, supervised autoencoder can also be used for face verification, which further demonstrates its effectiveness for face representation.
Differentially Deep Subspace Representation for Unsupervised Change Detection of SAR Images

Bin Luo,Chudi Hu,Xin Su,Yajun Wang

DOI: https://doi.org/10.3390/rs11232740

IF: 5

2019-11-21

Remote Sensing

Abstract:Temporal analysis of synthetic aperture radar (SAR) time series is a basic and significant issue in the remote sensing field. Change detection as well as other interpretation tasks of SAR images always involves non-linear/non-convex problems. Complex (non-linear) change criteria or models have thus been proposed for SAR images, instead of direct difference (e.g., change vector analysis) with/without linear transform (e.g., Principal Component Analysis, Slow Feature Analysis) used in optical image change detection. In this paper, inspired by the powerful deep learning techniques, we present a deep autoencoder (AE) based non-linear subspace representation for unsupervised change detection with multi-temporal SAR images. The proposed architecture is built upon an autoencoder-like (AE-like) network, which non-linearly maps the input SAR data into a latent space. Unlike normal AE networks, a self-expressive layer performing like principal component analysis (PCA) is added between the encoder and the decoder, which further transforms the mapped SAR data to mutually orthogonal subspaces. To make the proposed architecture more efficient at change detection tasks, the parameters are trained to minimize the representation difference of unchanged pixels in the deep subspace. Thus, the proposed architecture is namely the Differentially Deep Subspace Representation (DDSR) network for multi-temporal SAR images change detection. Experimental results on real datasets validate the effectiveness and superiority of the proposed architecture.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Hyperspectral Anomaly Detection with Auto-Encoder and Independent Target

Shuhan Chen,Xiaorun Li,Yunfeng Yan

DOI: https://doi.org/10.3390/rs15225266

IF: 5

2023-01-01

Remote Sensing

Abstract:As an unsupervised data representation neural network, auto-encoder (AE) has shown great potential in denoising, dimensionality reduction, and data reconstruction. Many AE-based background (BKG) modeling methods have been developed for hyperspectral anomaly detection (HAD). However, their performance is subject to their unbiased reconstruction of BKG and target pixels. This article presents a rather different low rank and sparse matrix decomposition (LRaSMD) method based on AE, named auto-encoder and independent target (AE-IT), for hyperspectral anomaly detection. First, the encoder weight matrix, obtained by a designed AE network, is utilized to construct a projector for generating a low-rank component in the encoder subspace. By adaptively and reasonably determining the number of neurons in the latent layer, the designed AE-based method can promote the reconstruction of BKG. Second, to ensure independence and representativeness, the component in the encoder orthogonal subspace is made into a sphere and followed by finding of unsupervised targets to construct an anomaly space. In order to mitigate the influence of noise on anomaly detection, sparse cardinality (SC) constraint is enforced on the component in the anomaly space for obtaining the sparse anomaly component. Finally, anomaly detector is constructed by combining Mahalanobi distance and multi-components, which include encoder component and sparse anomaly component, to detect anomalies. The experimental results demonstrate that AE-IT performs competitively compared to the LRaSMD-based models and AE-based approaches.
Causal Adversarial Autoencoder for Disentangled SAR Image Representation and Few-Shot Target Recognition

Qian Guo,Huilin Xu,Feng Xu

DOI: https://doi.org/10.1109/tgrs.2023.3330478

IF: 8.2

2023-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Lack of interpretability and weak generalization ability have become the major challenges with data-driven intelligent synthetic aperture radar-automatic target recognition (SAR-ATR) technology, especially in practical applications with azimuth-sparse training samples. A novel insight into SAR image representation with neural networks from a causal perspective is presented in this article. First, a causal model of SAR image representation conditioned on disentangled semantic factors is proposed. A set of SAR images is considered as a low-dimensional manifold, which is controlled by three semantic factors, namely, intrinsics, diversity, and randomness. A causal adversarial autoencoder (CAE) for SAR-ATR is then proposed to embody this disentangled representation, which incorporates a number of novel built-in network features. A physically reasonable cyclic high-frequency information-based embedding (CHE) method is proposed for azimuth encoding, which ensures the uniformity, continuity, periodicity, and distinctiveness of angle. A symmetrically conditional encoding (SCE) module is established to constrain the semantic consistency of low-dimensional features. Besides, a hybrid loss function is designed, which is composed of latent adversarial loss, reconstruction loss, and task-oriented losses. Both representation and generalization abilities are thoroughly evaluated through qualitative visualization and quantitative comparison experiments on the moving and stationary target acquisition and recognition (MSTAR) and FUSAR-Ship datasets. Experimental results demonstrate superior representation ability for the disentangled properties via angle interpolation and target transformation of SAR images. Using only 12 samples per class, the proposed CAE can achieve an accuracy of 93.1% for the ten-target SAR-ATR classification task.
Learning to Generate SAR Images With Adversarial Autoencoder

Qian Song,Feng Xu,Xiao Xiang Zhu,Ya-Qiu Jin

DOI: https://doi.org/10.1109/TGRS.2021.3086817

IF: 8.2

2022-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Deep learning-based synthetic aperture radar (SAR) target recognition often suffers from sparsely distributed training samples and rapid angular variations due to scattering scintillation. Thus, data-driven SAR target recognition is considered a typical few-shot learning (FSL) task. This article first reviews the key issues of FSL and provides a definition of the FSL task. A novel adversarial autoencoder (AAE) is then proposed as an SAR representation and generation network. It consists of a generator network that decodes target knowledge to SAR images and an adversarial discriminator network that not only learns to discriminate ``fake'' generated images from real ones but also encodes the input SAR image back to target knowledge. The discriminator employs progressively expanding convolution layers and a corresponding layer-by-layer training strategy. It uses two cyclic loss functions to enforce consistency between the inputs and outputs. Moreover, rotated cropping is introduced as a mechanism to address the challenge of representing the target orientation. The moving and stationary Target recognition (MSTAR) 7-target dataset is used to evaluate the AAE's performance, and the results demonstrate its ability to generate SAR images with aspect angular diversity. Using only 90 training samples with at least 25 degrees of orientation interval, the trained AAE is able to generate the remaining 1748 samples of other orientation angles with an unprecedented level of fidelity. Thus, it can be used for data augmentation in SAR target recognition FSL tasks. Our experimental results show that the AAE could boost the test accuracy by 5.77%.
Interpretable Disentangled Adversarial Auto-Encoder for SAR-ATR with Sparse Training Samples.

Qian Guo,Feng Xu

DOI: https://doi.org/10.1109/igarss52108.2023.10282082

2023-01-01

Abstract:Lack of interpretability and weak generalization ability have become the major problems with data-driven intelligent Synthetic Aperture Radar-Automatic Target Recognition (SAR-ATR) technology, especially with sparse training samples. A novel insight into the typical target representation with neural networks from a causal perspective is presented in this paper. Specifically, a set of SAR images is causally modeled by intrinsic, diverse, and random attributes, which is consistent with the forward imaging process of SAR. Consequently, an Interpretable Disentangled Adversarial auto-Encoder (IDAE) is proposed based on the disentangled representations. A Symmetrically Conditional Encoding (SCE) module is established to constrain the semantic consistency of low-dimensional features. Besides, a hybrid loss function is designed for iterative training. Experiments conducted on the MSTAR dataset show that the proposed model improves both representation and generalization abilities. IDAE is able to achieve a classification accuracy of 93.1% using only 12 samples per class.
A new Stack Autoencoder: Neighbouring Sample Envelope Embedded Stack Autoencoder Ensemble Model

Chuanyan Zhou,Jie Ma,Fan Li,Yongming Li,Pin Wang,Xiaoheng Zhang

DOI: https://doi.org/10.48550/arXiv.2210.14956

2022-10-25

Abstract:Stack autoencoder (SAE), as a representative deep network, has unique and excellent performance in feature learning, and has received extensive attention from researchers. However, existing deep SAEs focus on original samples without considering the hierarchical structural information between samples. To address this limitation, this paper proposes a new SAE model-neighbouring envelope embedded stack autoencoder ensemble (NE_ESAE). Firstly, the neighbouring sample envelope learning mechanism (NSELM) is proposed for preprocessing of input of SAE. NSELM constructs sample pairs by combining neighbouring samples. Besides, the NSELM constructs a multilayer sample spaces by multilayer iterative mean clustering, which considers the similar samples and generates layers of envelope samples with hierarchical structural information. Second, an embedded stack autoencoder (ESAE) is proposed and trained in each layer of sample space to consider the original samples during training and in the network structure, thereby better finding the relationship between original feature samples and deep feature samples. Third, feature reduction and base classifiers are conducted on the layers of envelope samples respectively, and output classification results of every layer of samples. Finally, the classification results of the layers of envelope sample space are fused through the ensemble mechanism. In the experimental section, the proposed algorithm is validated with over ten representative public datasets. The results show that our method significantly has better performance than existing traditional feature learning methods and the representative deep autoencoders.

Machine Learning,Artificial Intelligence
Learning Efficient Representations for Enhanced Object Detection on Large-scene SAR Images

Siyan Li,Yue Xiao,Yuhang Zhang,Lei Chu,Robert C. Qiu

DOI: https://doi.org/10.48550/arXiv.2201.08958

2022-01-22

Abstract:It is a challenging problem to detect and recognize targets on complex large-scene Synthetic Aperture Radar (SAR) images. Recently developed deep learning algorithms can automatically learn the intrinsic features of SAR images, but still have much room for improvement on large-scene SAR images with limited data. In this paper, based on learning representations and multi-scale features of SAR images, we propose an efficient and robust deep learning based target detection method. Especially, by leveraging the effectiveness of adversarial autoencoder (AAE) which influences the distribution of the investigated data explicitly, the raw SAR dataset is augmented into an enhanced version with a large quantity and diversity. Besides, an auto-labeling scheme is proposed to improve labeling efficiency. Finally, with jointly training small target chips and large-scene images, an integrated YOLO network combining non-maximum suppression on sub-images is used to realize multiple targets detection of high resolution images. The numerical experimental results on the MSTAR dataset show that our method can realize target detection and recognition on large-scene images accurately and efficiently. The superior anti-noise performance is also confirmed by experiments.

Computer Vision and Pattern Recognition
L2G Auto-encoder

Xinhai Liu,Zhizhong Han,Xin Wen,Yu-Shen Liu,Matthias Zwicker

DOI: https://doi.org/10.1145/3343031.3350960

2019-01-01

Abstract:Auto-encoder is an important architecture to understand point clouds in an encoding and decoding procedure of self reconstruction. Current auto-encoder mainly focuses on the learning of global structure by global shape reconstruction, while ignoring the learning of local structures. To resolve this issue, we propose Local-to-Global auto-encoder (L2G-AE) to simultaneously learn the local and global structure of point clouds by local to global reconstruction. Specifically, L2G-AE employs an encoder to encode the geometry information of multiple scales in a local region at the same time. In addition, we introduce a novel hierarchical self-attention mechanism to highlight the important points, scales and regions at different levels in the information aggregation of the encoder. Simultaneously, L2G-AE employs a recurrent neural network (RNN) as decoder to reconstruct a sequence of scales in a local region, based on which the global point cloud is incrementally reconstructed. Our outperforming results in shape classification, retrieval and upsampling show that L2G-AE can understand point clouds better than state-of-the-art methods.
Learning Deep Representations Using Convolutional Auto-Encoders with Symmetric Skip Connections

Lian-Feng Dong,Yuan-Zhu Gan,Xiao-Liao Mao,Yu-Bin Yang,Chunhua Shen

DOI: https://doi.org/10.1109/icassp.2018.8462085

2018-01-01

Abstract:Convolutional neural networks (CNNs) have shown their power on many computer vision tasks. However, there are still some limitations, including their sensitivity to weight initialization and dependency to large scale labeled data. In this paper, we try to address these two problems by proposing a simple yet powerful CNN based denoising auto-encoder network which can be trained end-to-end in an unsupervised manner. The network architecture we use is a fully convolutional auto-encoder with symmetric encoder-decoder connections. The proposed method can not only reconstruct clean images from corrupted ones, but also learn abstract image representation through the reconstruction training. The encoder part of the network can be a good all-convolution network for classification. With the help of unsupervised pre-training, it achieves very competitive results even without extra unlabeled data. Further more, we show experimentally that our network also performs well in semi -supervised learning tasks.
SAR Image Classification Using Greedy Hierarchical Learning With Unsupervised Stacked CAEs

Zhensheng Sun,Juan Li,Peng Liu,Weijia Cao,Tao Yu,Xingfa Gu

DOI: https://doi.org/10.1109/tgrs.2020.3023192

IF: 8.2

2021-07-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Synthetic aperture radar (SAR) can provide stable data source for earth observation due to its advantages of all day and night, all-weather, and strong penetration. SAR image classification as a fundamental procedure has been proved its great value in plenty of remote sensing applications. Conventional classification algorithms mainly rely on hand-designed features, which are susceptible to widespread coherent speckle noise and geometric distortion in high-resolution SAR images. Inspired by the recent impressive success in data mining and deep learning, a greedy hierarchical convolutional neural network (GHCNN) is developed. It aims at obtaining optimized feature representation, relieving the effect of speckle noise, and promoting the local pattern recognition of geometric distortion in single-polarized SAR image classification. First, a series of convolutional autoencoders (CAEs) is trained in the greedy layer-wise unsupervised strategy. This step provides an unbiased regularizer and a priori distribution derived from large volumes of unlabeled SAR patches. Then, to optimize multiple parameter subspaces globally, several CAEs are coupled together to form a deeper hierarchical structure in a stacked and unsupervised fashion. Afterward, a convolutional network with identical topology inherits the pretrained weights. After supervised finetuning, it realizes class prediction. Synchronously, t-distributed stochastic neighbor embedding (t-SNE) algorithm is applied to monitor the efficiency of feature representation during the training period. Experimental results demonstrate that the proposed method has competitive advantages over involved contrast methods.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
SAR Image Despeckling Based on Convolutional Denoising Autoencoder

Qianqian Zhang,Ruizhi Sun

DOI: https://doi.org/10.48550/arXiv.2011.14627

2020-11-30

Abstract:In Synthetic Aperture Radar (SAR) imaging, despeckling is very important for image analysis,whereas speckle is known as a kind of multiplicative noise caused by the coherent imaging system. During the past three decades, various algorithms have been proposed to denoise the SAR image. Generally, the BM3D is considered as the state of art technique to despeckle the speckle noise with excellent performance. More recently, deep learning make a success in image denoising and achieved a improvement over conventional method where large train dataset is required. Unlike most of the images SAR image despeckling approach, the proposed approach learns the speckle from corrupted images directly. In this paper, the limited scale of dataset make a efficient exploration by using convolutioal denoising autoencoder (C-DAE) to reconstruct the speckle-free SAR images. Batch normalization strategy is integrated with C- DAE to speed up the train time. Moreover, we compute image quality in standard metrics, PSNR and SSIM. It is revealed that our approach perform well than some others.

Image and Video Processing,Computer Vision and Pattern Recognition
A comprehensive survey on design and application of autoencoder in deep learning

Pengzhi Li,Yan Pei,Jianqiang Li

DOI: https://doi.org/10.1016/j.asoc.2023.110176

2023-03-10

Applied Soft Computing Journal

Abstract:Autoencoder is an unsupervised learning model, which can automatically learn data features from a large number of samples and can act as a dimensionality reduction method. With the development of deep learning technology, autoencoder has attracted the attention of many scholars. Researchers have proposed several improved versions of autoencoder based on different application fields. First, this paper explains the principle of a conventional autoencoder and investigates the primary development process of an autoencoder. Second, We proposed a proposed taxonomy of autoencoders according to their structures and principles. The related autoencoder models are comprehensively analyzed and discussed. This paper introduces the application progress of autoencoders in different fields, such as image classification and natural language processing, etc. Finally, the shortcomings of the current autoencoder algorithm are summarized, and prospected for its future development directions are addressed.
Deep SAR Imaging and Motion Compensation

Wei Pu

DOI: https://doi.org/10.1109/tip.2021.3051484

IF: 10.6

2021-01-01

IEEE Transactions on Image Processing

Abstract:Compressive sensing (CS) and matrix sensing (MS) techniques have been applied to the synthetic aperture radar (SAR) imaging problem to reduce the sampling amount of SAR echo using the sparse or low-rank prior information. To further exploit the redundancy and improve sampling efficiency, we take a different approach, wherein a deep SAR imaging algorithm is proposed. The main idea is to exploit the redundancy of the backscattering coefficient using an auto-encoder structure, wherein the hidden latent layer in auto-encoder has lower dimension and less parameters than the backscattering coefficient layer. Based on the auto-encoder model, the parameters of the auto-encoder structure and the backscattering coefficient are estimated simultaneously by optimizing the reconstruction loss associated with the down-sampled SAR echo. In addition, in order to meet the practical application requirements, a deep SAR motion compensation algorithm is proposed to eliminate the effect of motion errors on imaging results. The effectiveness of the proposed algorithms is verified on both simulated and real SAR data.

computer science, artificial intelligence,engineering, electrical & electronic
Autoencoders and their applications in machine learning: a survey

Kamal Berahmand,Fatemeh Daneshfar,Elaheh Sadat Salehi,Yuefeng Li,Yue Xu

DOI: https://doi.org/10.1007/s10462-023-10662-6

IF: 9.588

2024-02-05

Artificial Intelligence Review

Abstract:Autoencoders have become a hot researched topic in unsupervised learning due to their ability to learn data features and act as a dimensionality reduction method. With rapid evolution of autoencoder methods, there has yet to be a complete study that provides a full autoencoders roadmap for both stimulating technical improvements and orienting research newbies to autoencoders. In this paper, we present a comprehensive survey of autoencoders, starting with an explanation of the principle of conventional autoencoder and their primary development process. We then provide a taxonomy of autoencoders based on their structures and principles and thoroughly analyze and discuss the related models. Furthermore, we review the applications of autoencoders in various fields, including machine vision, natural language processing, complex network, recommender system, speech process, anomaly detection, and others. Lastly, we summarize the limitations of current autoencoder algorithms and discuss the future directions of the field.

computer science, artificial intelligence
Semantic-Aware Auto-Encoders for Self-supervised Representation Learning

Guangrun Wang,Yansong Tang,Liang Lin,Philip H. S. Torr

DOI: https://doi.org/10.1109/cvpr52688.2022.00944

2022-01-01

Abstract:The resurgence of unsupervised learning can be attributed to the remarkable progress of self-supervised learning, which includes generative $(\mathcal{G})$ and discriminative $(\mathcal{D})$ models. In computer vision, the mainstream self-supervised learning algorithms are $\mathcal{D}$ models. However, designing a $\mathcal{D}$ model could be over-complicated; also, some studies hinted that a $\mathcal{D}$ model might not be as general and interpretable as a $\mathcal{G}$ model. In this paper, we switch from $\mathcal{D}$ models to $\mathcal{G}$ models using the classical auto-encoder $(AE)$ . Note that a vanilla $\mathcal{G}$ model was far less efficient than a $\mathcal{D}$ model in self-supervised computer vision tasks, as it wastes model capability on overfitting semantic-agnostic high-frequency details. Inspired by perceptual learning that could use cross-view learning to perceive concepts and semantics 1 1 Following [26], we refer to semantics as visual concepts, e.g., a semantic-ware model indicates the model can perceive visual concepts, and the learned features are efficient in object recognition, detection, etc., we propose a novel $AE$ that could learn semantic-aware representation via cross-view image reconstruction. We use one view of an image as the input and another view of the same image as the reconstruction target. This kind of $AE$ has rarely been studied before, and the optimization is very difficult. To enhance learning ability and find a feasible solution, we propose a semantic aligner that uses geometric transformation knowledge to align the hidden code of $AE$ to help optimization. These techniques significantly improve the representation learning ability of $AE$ and make selfsupervised learning with $\mathcal{G}$ models possible. Extensive experiments on many large-scale benchmarks (e.g., ImageNet, COCO 2017, and SYSU-30k) demonstrate the effectiveness of our methods. Code is available at https://github.com/wanggrun/Semantic-Aware-AE.
Learned Compression Framework With Pyramidal Features and Quality Enhancement for SAR Images

Zhixiong Di,Xuan Chen,Qiang Wu,Jiangyi Shi,Quanyuan Feng,Yibo Fan

DOI: https://doi.org/10.1109/LGRS.2022.3155651

IF: 5.343

2022-01-01

IEEE Geoscience and Remote Sensing Letters

Abstract:Current image compression algorithms based on transforms can achieve ideal performance for natural images, but do not do well with synthetic aperture radar (SAR) images. We propose a learned compression framework with pyramidal features and quality enhancement to fully exploit the redundancy among image pixels and to improve the compression bitrate and reconstruction quality. Based on the variational autoencoder (VAE) architecture, pyramidal decomposition is performed at the first autoencoder to extract both global and coarse feature maps. The latent distribution is modeled by the second hyperprior autoencoder with a single-Gaussian model for more accurate and flexible entropy estimation. Universal quantization is applied to consolidate the entropy estimation accuracy of the hyperprior network. To further improve reconstruction quality, a residual dense network (RDN) is adopted to fully capture local and global features. Experimental results demonstrate that the proposed framework provides a better rate-distortion tradeoff than standard codecs such as JPEG, JPEG2000, and learning-based methods on both the Sandia and ICEYE datasets.

Small Sample Learning with High Order Contractive Auto-Encoders and Application in SAR Images

Auto-AD: Autonomous Hyperspectral Anomaly Detection Network Based on Fully Convolutional Autoencoder

Self-taught Learning with Residual Sparse Autoencoders for HEp-2 Cell Staining Pattern Recognition

Remote Sensing Image Recognition Based on Generalized Regularized Auto-Encoders

Single Sample Face Recognition Via Learning Deep Supervised Autoencoders

Differentially Deep Subspace Representation for Unsupervised Change Detection of SAR Images

Hyperspectral Anomaly Detection with Auto-Encoder and Independent Target

Causal Adversarial Autoencoder for Disentangled SAR Image Representation and Few-Shot Target Recognition

Learning to Generate SAR Images With Adversarial Autoencoder

Interpretable Disentangled Adversarial Auto-Encoder for SAR-ATR with Sparse Training Samples.

A new Stack Autoencoder: Neighbouring Sample Envelope Embedded Stack Autoencoder Ensemble Model

Learning Efficient Representations for Enhanced Object Detection on Large-scene SAR Images

L2G Auto-encoder

Learning Deep Representations Using Convolutional Auto-Encoders with Symmetric Skip Connections

SAR Image Classification Using Greedy Hierarchical Learning With Unsupervised Stacked CAEs

SAR Image Despeckling Based on Convolutional Denoising Autoencoder

A comprehensive survey on design and application of autoencoder in deep learning

Deep SAR Imaging and Motion Compensation

Autoencoders and their applications in machine learning: a survey

Semantic-Aware Auto-Encoders for Self-supervised Representation Learning

Learned Compression Framework With Pyramidal Features and Quality Enhancement for SAR Images