Abstract:Amortized simulation-based neural posterior estimation provides a novel machine learning based approach for solving parameter estimation problems. It has been shown to be computationally efficient and able to handle complex models and data sets. Yet, the available approach cannot handle the in experimental studies ubiquitous case of missing data, and might provide incorrect posterior estimates. In this work, we discuss various ways of encoding missing data and integrate them into the training and inference process. We implement the approaches in the BayesFlow methodology, an amortized estimation framework based on invertible neural networks, and evaluate their performance on multiple test problems. We find that an approach in which the data vector is augmented with binary indicators of presence or absence of values performs the most robustly. Indeed, it improved the performance also for the simpler problem of data sets with variable length. Accordingly, we demonstrate that amortized simulation-based inference approaches are applicable even with missing data, and we provide a guideline for their handling, which is relevant for a broad spectrum of applications. In biomedical research, mechanistic models describe dynamic processes, yet inferring their underlying parameters can often be challenging. Bayesian statistics provides an established framework for this by integrating prior knowledge with observed data, and naturally enables uncertainty quantification as a distribution of parameter values is returned. However, classical case-based methods for Bayesian inference can be computationally expensive, particularly when the same model needs to be fitted to different data sets. Recently, deep-learning-based approaches have been developed to streamline the inference procedure, allowing the upfront training cost to amortize when applied to multiple data sets. In this manuscript, we explore approaches to extend the setup to data sets with missing data. In summary, an encoding scheme which exploits data augmentation with binary indicators of presence or absence performs the most robustly across different test problems.

A Note on the Robustness of a Full Bayesian Method for Nonignorable Missing Data Analysis

Stop or Continue Data Collection: A Nonignorable Missing Data Approach for Continuous Variables

Multiple Imputation of Missing Categorical and Continuous Values via Bayesian Mixture Models with Local Dependence

Bayesian Modeling Longitudinal Dyadic Data with Nonignorable Dropout, with Application to a Breast Cancer Study

A Bayesian hybrid method for the analysis of generalized linear models with missing-not-at-random covariates

Bayesian Approach to Non-ignorable Missingness in Latent Growth Models

Nonstandard Conditionally Specified Models for Nonignorable Missing Data.

Convergence analysis of data augmentation algorithms for Bayesian robust multivariate linear regression with incomplete data

Bayesian Quantile Regression for Longitudinal Studies with Nonignorable Missing Data.

Robust growth mixture models with non-ignorable missingness: Models, estimation, selection, and application

Handling Nonmonotone Missing Data with Available Complete-Case Missing Value Assumption

A Note on Ising Network Analysis with Missing Data

Missing data in amortized simulation-based neural posterior estimation

Estimating Transition Probabilities for Ignorable Intermittent Missing Data in a Discrete-Time Markov Chain

Bayesian Methods and Model Selection for Latent Growth Curve Models with Missing Data

Bayesian sensitivity analysis for a missing data model

Bayesian Latent-Class Mixed-Effect Hybrid Models for Dyadic Longitudinal Data with Non-Ignorable Dropouts.

Non-standard conditionally specified models for non-ignorable missing data

Bayesian Inference for Growth Mixture Models with Latent Class Dependent Missing Data

Full-semiparametric-likelihood-based inference for non-ignorable missing data

Model-based Inference for Two-Stage Cluster Samples Subject to Nonignorable Item Nonresponse