Abstract:Variational autoencoder is a commonly unsupervised learning model. However, its complex structure hinders the utilization of the network architecture search algorithm to release researchers from tedious manual design. To design excellent architectures automatically, this paper proposes an efficient evolutionary architecture search for variational autoencoder with alternating optimization and adaptive crossover(AOC-VAE). Firstly, to alleviate the problem of large search space when automatically designing variational autoencoders, AOC-VAE designs an alternating optimized search mechanism based on the specific coupling of encoder and decoder in variational autoencoders, which reduces the original huge search space almost to half. Then, AOC-VAE can find quickly the optimal individual in the solution space by designing an adaptive crossover mechanism. In early evolutionary period, the structural differences between individuals are relatively significant, making crossover operations more inclined to exchange structural information between individuals. As evolution progresses, the individual structures in the population tend to be similar, and the exchange of information concentrates on the parameter. Finally, in the optimization process, a fitness evaluation mechanism based on dynamic weights is designed to accurately find out the outstanding individuals under the current optimization goal. Individual fitness in the population is more inclined to be affected by the current optimization goal, thus guiding the population to evolve according to the optimization goal at different stages. AOC-VAE is verified on MNIST, SVHN, CIFAR-10, and CIFAR-100 benchmark datasets and compared with 14 algorithms. The experimental results show that the VAE network structure designed by the AOC-VAE performs well in the image classification task.

Comparison of improved variational autoencoder models for human face generation

Evolving Deep Convolutional Variational Autoencoders for Image Classification

Research on Improved Algorithm Based on Perceptual Loss for Variational Autoencoder

eVAE: Evolutionary Variational Autoencoder

Improving Variational Auto-Encoder with Self-Attention and Mutual Information for Image Generation

Multi-Stage Variational Auto-Encoders for Coarse-to-Fine Image Generation

Comparative Analysis of Generative Models: Enhancing Image Synthesis with VAEs, GANs, and Stable Diffusion

An efficient evolutionary architecture search for variational autoencoder with alternating optimization and adaptive crossover

Variational autoencoder-based neural network model compression

Exploring Variational Autoencoders for Medical Image Generation: A Comprehensive Study

NVAE: A Deep Hierarchical Variational Autoencoder

Deep Feature Consistent Variational Autoencoder

Diagnosing and Enhancing VAE Models

Make a Face: Towards Arbitrary High Fidelity Face Manipulation.

Improve variational autoEncoder with auxiliary softmax multiclassifier

Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design

Face Age Feature Analysis Based on Improved Conditional Adversarial Auto-encoder (I-CAAE)

Super-resolution Variational Auto-Encoders

Contrastive Variational Autoencoder Enhances Salient Features

TimeVAE: A Variational Auto-Encoder for Multivariate Time Series Generation

Unregularized Auto-Encoder with Generative Adversarial Networks for Image Generation