Abstract:We present a deep-learning Variational Encoder-Decoder (VED) framework for learning data-driven low-dimensional representations of the relationship between high-dimensional parameters of a physical system and the system's high-dimensional observable response. The framework consists of two deep learning-based probabilistic transformations: An encoder mapping parameters to latent codes and a decoder mapping latent codes to the observable response. The hyperparameters of these transformations are identified by maximizing a variational lower bound on the log-conditional distribution of the observable response given parameters. To promote the disentanglement of latent codes, we equip this variational loss with a penalty on the off-diagonal entries of the aggregate distribution covariance of codes. This regularization penalty encourages the pushforward of a standard Gaussian distribution of latent codes to approximate the marginal distribution of the observable response. Using the proposed framework we successfully model the hydraulic pressure response at observation wells of a groundwater flow model as a function of its discrete log-hydraulic transmissivity field. Compared to the canonical correlation analysis encoding, the VED model achieves a lower-dimensional latent representation, with as low as $r = 50$ latent dimensions without a significant loss of reconstruction accuracy. We explore the impact of regularization on model performance, finding that KL-divergence and covariance regularization improve feature disentanglement in latent space while maintaining reconstruction accuracy. Furthermore, we evaluate the generative capabilities of the regularized model by decoding random Gaussian noise, revealing that tuning both $\beta$ and $\lambda$ parameters enhances the quality of the generated observable response data.

Learning minimal representations of stochastic processes with variational autoencoders

Learning minimal representations of stochastic processes with variational autoencoders

Hidden Talents of the Variational Autoencoder

Uncertainty Autoencoders: Learning Compressed Representations via Variational Information Maximization

Physics-informed variational inference for uncertainty quantification of stochastic differential equations

Physics-enhanced Gaussian Process Variational Autoencoder

Deep Learning of Process Data with Supervised Variational Auto-encoder for Soft Sensor

Systematic Development of a New Variational Autoencoder Model Based on Uncertain Data for Monitoring Nonlinear Processes

Uncertainty in latent representations of variational autoencoders optimized for visual tasks

Stochastic Differential Equations with Variational Wishart Diffusions

Predictive variational autoencoder for learning robust representations of time-series data

From the Expectation Maximisation Algorithm to Autoencoded Variational Bayes

Disentangling Generative Factors of Physical Fields Using Variational Autoencoders

Connections with Robust PCA and the Role of Emergent Sparsity in Variational Autoencoder Models

Auto-Encoding Variational Bayes

Analyzing multimodal probability measures with autoencoders

Variational learning for switching state-space models

Exploring the Potential of Variational Autoencoders for Modeling Nonlinear Relationships in Psychological Data

Stochastic Variational Approach to Minimum Uncertainty States

Variational Encoder-Decoders for Learning Latent Representations of Physical Systems

Solving deep-learning density functional theory via variational autoencoders