Abstract:The generally unsupervised nature of autoencoder models implies that the main training metric is formulated as the error between input images and their corresponding reconstructions. Different reconstruction loss variations and latent space regularizations have been shown to improve model performances depending on the tasks to solve and to induce new desirable properties such as disentanglement. Nevertheless, measuring the success in, or enforcing properties by, the input pixel space is a challenging endeavour. In this work, we want to make use of the available data more efficiently and provide design choices to be considered in the recording or generation of future datasets to implicitly induce desirable properties during training. To this end, we propose a new sampling technique which matches semantically important parts of the image while randomizing the other parts, leading to salient feature extraction and a neglection of unimportant details. The proposed method can be combined with any existing reconstruction loss and the performance gain is superior to the triplet loss. We analyse the resulting properties on various datasets and show improvements on several computer vision tasks: illumination and unwanted features can be normalized or smoothed out and shadows are removed such that classification or other tasks work more reliably; a better invariances with respect to unwanted features is induced; the generalization capacities from synthetic to real images is improved, such that more of the semantics are preserved; uncertainty estimation is superior to Monte Carlo Dropout and an ensemble of models, particularly for datasets of higher visual complexity. Finally, classification accuracy by means of simple linear classifiers in the latent space is improved compared to the triplet loss. For each task, the improvements are highlighted on several datasets commonly used by the research community, as well as in automotive applications.

Reconstruction of FRI Signals Using Autoencoders with Fixed Decoders

Learning-Based Reconstruction of FRI Signals

IEF-CSNET: Information Enhancement and Fusion Network for Compressed Sensing Reconstruction

Learning to Sample: Data-Driven Sampling and Reconstruction of FRI Signals

Sparsity-based Reconstruction Method for Signals with Finite Rate of Innovation

An Efficient Estimation Method for the Model Order of FRI Signal Based on Sub-Nyquist Sampling.

RODEO: Robust DE-aliasing autoencOder for Real-time Medical Image Reconstruction

Cascade Decoders-Based Autoencoders for Image Reconstruction

A Decoder-Free Reconstruction Method for Semi-Supervised Surface Defect Detection

A Generalized Approach for Recovering Time Encoded Signals with Finite Rate of Innovation

PEAR: PEriodic And fixed Rank separation for fast fMRI

Reconstructing Natural Images from Human Fmri by Alternating Encoding and Decoding with Shared Autoencoder Regularization

Sub-Nyquist Sampling of Pulse Streams Based on the Real Part of Fourier Coefficients

REV-AE: A Learned Frame Set for Image Reconstruction

Reversible Autoencoder: A CNN-Based Nonlinear Lifting Scheme for Image Reconstruction

A Simulation Study on Performance of Decoders in Chronic Recording.

The Fri Sampling and Recovery of Pulse Streams Based on Discrete Cosine Transform

Neuromorphic Sampling of Sparse Signals

Robust online reconstruction of continuous-time signals from a lean spike train ensemble code

Autoencoder and Partially Impossible Reconstruction Losses

Towards a Sampling Theory for Implicit Neural Representations