Abstract:Summary Structured additive regression models are perhaps the most commonly used class of models in statistical applications. It includes, among others, (generalized) linear models, (generalized) additive models, smoothing spline models, state space models, semiparametric regression, spatial and spatiotemporal models, log-Gaussian Cox processes and geostatistical and geoadditive models. We consider approximate Bayesian inference in a popular subset of structured additive regression models, latent Gaussian models, where the latent field is Gaussian, controlled by a few hyperparameters and with non-Gaussian response variables. The posterior marginals are not available in closed form owing to the non-Gaussian response variables. For such models, Markov chain Monte Carlo methods can be implemented, but they are not without problems, in terms of both convergence and computational time. In some practical applications, the extent of these problems is such that Markov chain Monte Carlo sampling is simply not an appropriate tool for routine analysis. We show that, by using an integrated nested Laplace approximation and its simplified version, we can directly compute very accurate approximations to the posterior marginals. The main benefit of these approximations is computational: where Markov chain Monte Carlo algorithms need hours or days to run, our approximations provide more precise estimates in seconds or minutes. Another advantage with our approach is its generality, which makes it possible to perform Bayesian analysis in an automatic, streamlined way, and to compute model comparison criteria and various predictive measures so that models can be compared and the model under study can be challenged.

Sequential Labeling with Latent Variables: an Exact Inference Algorithm and Its Efficient Approximation

Exact Decoding on Latent Variable Conditional Models is NP-Hard

EFFICIENT INFERENCE AND TRAINING FOR CONDITIONAL LATENT VARIABLE MODELS¡¢£¤¥¦ § ©

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

A Unified Theory of Exact Inference and Learning in Exponential Family Latent Variable Models

Modeling Latent-Dynamic in Shallow Parsing

Semi-supervised Mixture of Latent Factor Analysis Models with Application to Online Key Variable Estimation

Sequential sampling of Gaussian process latent variable models

Fast approximate inference with INLA: the past, the present and the future

Latent Semantics Encoding for Label Distribution Learning.

Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations

Generative Label Enhancement with Gaussian Mixture and Partial Ranking.

LCBM: A Multi-View Probabilistic Model for Multi-Label Classification

Approximate Probabilistic Inference for Time-Series Data A Robust Latent Gaussian Model With Temporal Awareness

A Tale of Two Latent Flows: Learning Latent Space Normalizing Flow with Short-run Langevin Flow for Approximate Inference

Latent State Estimation Helps UI Agents to Reason

A Label Embedding Method via Conditional Covariance Maximization for Multi-label Classification.

Incremental Variational Inference for Latent Dirichlet Allocation

Supervised Hashing With Latent Factor Models

Beyond the Black Box: A Statistical Model for LLM Reasoning and Inference

Fast Gradient-Based Inference with Continuous Latent Variable Models in Auxiliary Form