Abstract:Autoencoding has achieved great empirical success as a framework for learning generative models for natural images. Autoencoders often use generic deep networks as the encoder or decoder, which are difficult to interpret, and the learned representations lack clear structure. In this work, we make the explicit assumption that the image distribution is generated from a multi-stage sparse deconvolution. The corresponding inverse map, which we use as an encoder, is a multi-stage convolution sparse coding (CSC), with each stage obtained from unrolling an optimization algorithm for solving the corresponding (convexified) sparse coding program. To avoid computational difficulties in minimizing distributional distance between the real and generated images, we utilize the recent closed-loop transcription (CTRL) framework that optimizes the rate reduction of the learned sparse representations. Conceptually, our method has high-level connections to score-matching methods such as diffusion models. Empirically, our framework demonstrates competitive performance on large-scale datasets, such as ImageNet-1K, compared to existing autoencoding and generative methods under fair conditions. Even with simpler networks and fewer computational resources, our method demonstrates high visual quality in regenerated images. More surprisingly, the learned autoencoder performs well on unseen datasets. Our method enjoys several side benefits, including more structured and interpretable representations, more stable convergence, and scalability to large datasets. Our method is arguably the first to demonstrate that a concatenation of multiple convolution sparse coding/decoding layers leads to an interpretable and effective autoencoder for modeling the distribution of large-scale natural image datasets.

Dual Sum-Product Networks Autoencoding.

Dual Sum-Product Networks Autoencoder for Multi-Label Classification

Multi-head Variational Graph Autoencoder Constrained by Sum-product Networks

Deep Compression of Sum-Product Networks on Tensor Networks

Deep Model Compression and Inference Speedup of Sum-Product Networks on Tensor Trains

Automatic Document Summarization Via Deep Neural Networks

A survey of sum–product networks structural learning

Visualizing and Understanding Sum-Product Networks

Dual Branch Autoencoder Network for Spectral-Spatial Hyperspectral Unmixing

A NEW TRAINING ALGORITHM OF AUTOENCODER COMBINING LATERAL INHIBITION MECHANISM

Maximum A Posteriori Inference in Sum-Product Networks

Top-Down Bayesian Posterior Sampling for Sum-Product Networks

Video Summarization with a Dual-Path Attentive Network

Link Prediction and Node Classification Based on Multitask Graph Autoencoder.

Dual-Constrained Deep Semi-Supervised Coupled Factorization Network with Enriched Prior

Double Path Networks for Sequence to Sequence Learning.

Tractable Probabilistic Graph Representation Learning with Graph-Induced Sum-Product Networks

ANE: Network Embedding Via Adversarial Autoencoders

Dual Autoencoders Features for Imbalance Classification Problem.

Closed-Loop Transcription via Convolutional Sparse Coding

Nonuniform Hyper-Network Embedding with Dual Mechanism