Abstract:Summary Structured additive regression models are perhaps the most commonly used class of models in statistical applications. It includes, among others, (generalized) linear models, (generalized) additive models, smoothing spline models, state space models, semiparametric regression, spatial and spatiotemporal models, log-Gaussian Cox processes and geostatistical and geoadditive models. We consider approximate Bayesian inference in a popular subset of structured additive regression models, latent Gaussian models, where the latent field is Gaussian, controlled by a few hyperparameters and with non-Gaussian response variables. The posterior marginals are not available in closed form owing to the non-Gaussian response variables. For such models, Markov chain Monte Carlo methods can be implemented, but they are not without problems, in terms of both convergence and computational time. In some practical applications, the extent of these problems is such that Markov chain Monte Carlo sampling is simply not an appropriate tool for routine analysis. We show that, by using an integrated nested Laplace approximation and its simplified version, we can directly compute very accurate approximations to the posterior marginals. The main benefit of these approximations is computational: where Markov chain Monte Carlo algorithms need hours or days to run, our approximations provide more precise estimates in seconds or minutes. Another advantage with our approach is its generality, which makes it possible to perform Bayesian analysis in an automatic, streamlined way, and to compute model comparison criteria and various predictive measures so that models can be compared and the model under study can be challenged.

Pseudo-marginal Bayesian inference for Gaussian process latent variable models

Pseudo-marginal Bayesian inference for supervised Gaussian process latent variable models

Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations

Variational Inference for Uncertainty on the Inputs of Gaussian Process Models

Beyond the Mean-Field: Structured Deep Gaussian Processes Improve the Predictive Uncertainties

Fully Bayesian Inference for Latent Variable Gaussian Process Models

Sequential sampling of Gaussian process latent variable models

Variational sparse inverse Cholesky approximation for latent Gaussian processes via double Kullback-Leibler minimization

Amortized Variational Inference for Deep Gaussian Processes

Bayesian Non-linear Latent Variable Modeling via Random Fourier Features

Pseudo Independent Conditional Approximation for Training the Mixtures of Gaussian Processes

Spike and Slab Gaussian Process Latent Variable Models

Hamiltonian Monte Carlo using an adjoint-differentiated Laplace approximation: Bayesian inference for latent Gaussian models and beyond

Bayesian leave-one-out cross-validation approximations for Gaussian latent variable models

Latent Gaussian Process Regression

Structured Variational Inference for Coupled Gaussian Processes

Improving Hyperparameter Learning under Approximate Inference in Gaussian Process Models

Scalable marginalization of correlated latent variables with applications to learning particle interaction kernels

Variational Bayesian Inference in High-Dimensional Linear Mixed Models

Sparse Orthogonal Variational Inference for Gaussian Processes

Iterative Methods for Vecchia-Laplace Approximations for Latent Gaussian Process Models