Abstract:The generally unsupervised nature of autoencoder models implies that the main training metric is formulated as the error between input images and their corresponding reconstructions. Different reconstruction loss variations and latent space regularizations have been shown to improve model performances depending on the tasks to solve and to induce new desirable properties such as disentanglement. Nevertheless, measuring the success in, or enforcing properties by, the input pixel space is a challenging endeavour. In this work, we want to make use of the available data more efficiently and provide design choices to be considered in the recording or generation of future datasets to implicitly induce desirable properties during training. To this end, we propose a new sampling technique which matches semantically important parts of the image while randomizing the other parts, leading to salient feature extraction and a neglection of unimportant details. The proposed method can be combined with any existing reconstruction loss and the performance gain is superior to the triplet loss. We analyse the resulting properties on various datasets and show improvements on several computer vision tasks: illumination and unwanted features can be normalized or smoothed out and shadows are removed such that classification or other tasks work more reliably; a better invariances with respect to unwanted features is induced; the generalization capacities from synthetic to real images is improved, such that more of the semantics are preserved; uncertainty estimation is superior to Monte Carlo Dropout and an ensemble of models, particularly for datasets of higher visual complexity. Finally, classification accuracy by means of simple linear classifiers in the latent space is improved compared to the triplet loss. For each task, the improvements are highlighted on several datasets commonly used by the research community, as well as in automotive applications.

REV-AE: A Learned Frame Set for Image Reconstruction

Reversible Autoencoder: A CNN-Based Nonlinear Lifting Scheme for Image Reconstruction

Frame Prediction Using Recurrent Convolutional Encoder with Residual Learning

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

Data Reconstruction Based on Supervised Deep Auto-Encoder.

Cascade Decoders-Based Autoencoders for Image Reconstruction

Deep Neural Network Based Frame Reconstruction for Optimized Video Coding

Dilated Residual Encode-Decode Networks for Image Denoising

Conditional Variational Autoencoder for Learned Image Reconstruction

Iteratively Refined Image Reconstruction with Learned Attentive Regularizers

Multi-level Encoder-Decoder Architectures for Image Restoration

DCAE: A dual conditional autoencoder framework for the reconstruction from EEG into image

Reconstruction of Hidden Representation for Robust Feature Extraction

Image Reconstruction using Enhanced Vision Transformer

Reconstructing Natural Images from Human Fmri by Alternating Encoding and Decoding with Shared Autoencoder Regularization

Autoencoder and Partially Impossible Reconstruction Losses

Image Super-Resolution Algorithm Based on an Improved Sparse Autoencoder

Image Restoration Using Convolutional Auto-encoders with Symmetric Skip Connections.

AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurring

Auto-Encoded Supervision for Perceptual Image Super-Resolution

Learned Image Compression Using Adaptive Block-Wise Encoding and Reconstruction Network