Abstract:Simulation-based inference (SBI) is constantly in search of more expressive algorithms for accurately inferring the parameters of complex models from noisy data. We present consistency models for neural posterior estimation (CMPE), a new free-form conditional sampler for scalable, fast, and amortized SBI with generative neural networks. CMPE combines the advantages of normalizing flows and flow matching methods into a single generative architecture: It essentially distills a continuous probability flow and enables rapid few-shot inference with an unconstrained architecture that can be tailored to the structure of the estimation problem. Our empirical evaluation demonstrates that CMPE not only outperforms current state-of-the-art algorithms on three hard low-dimensional problems, but also achieves competitive performance in a high-dimensional Bayesian denoising experiment and in estimating a computationally demanding multi-scale model of tumor spheroid growth.

What problem does this paper attempt to address?

### Problems Addressed by the Paper The paper aims to address the issues of speed and scalability in parameter estimation within Simulation-based Inference (SBI). Specifically, the authors propose a new method—Consistency Model Posterior Estimation (CMPE)—to achieve fast, scalable, and efficient neural posterior estimation. ### Background and Challenges 1. **Simulation-based Inference (SBI)**: - SBI is a method for accurately inferring parameters from noisy data of complex models. - Traditional methods face computational inefficiencies when dealing with high-dimensional and complex models. 2. **Existing Methods**: - **Normalizing Flows** and **Flow Matching Methods** are currently popular SBI methods, but they are slow in multi-step sampling processes. - **Diffusion Models** produce excellent generative results but require solving multiple differential equations during inference, leading to slow sampling speeds. ### Solution 1. **Consistency Model Posterior Estimation (CMPE)**: - CMPE combines the advantages of normalizing flows and flow matching methods, achieving fast few-step inference through an unconstrained generative architecture. - This method accelerates posterior distribution estimation by training a conditional consistency model to directly map any point on a trajectory to the starting point. 2. **Main Contributions**: - **Adaptability**: Applying conditional consistency models to simulation-based Bayesian inference. - **Advantages**: Demonstrating the fundamental advantages of CMPE in terms of expressive free-form architecture and fast inference. - **Performance**: CMPE outperforms existing normalizing flows and flow matching methods in three benchmark experiments, high-dimensional Bayesian denoising experiments, and a tumor spheroid growth model. ### Experimental Results 1. **Low-dimensional Experiments**: - In three low-dimensional experiments with bimodal posterior distributions, CMPE shows better performance than other methods, especially in terms of sampling speed and accuracy. 2. **High-dimensional Image Denoising**: - In high-dimensional image denoising tasks, CMPE also performs well, effectively handling complex high-dimensional data. 3. **Scientific Model Application**: - In a computationally challenging tumor spheroid growth model, CMPE demonstrates superior performance in non-trivial scientific simulators. ### Conclusion By proposing the CMPE method, the paper addresses the speed and scalability issues in parameter estimation within SBI, providing a new solution for fast and efficient inference of complex models.

Consistency Models for Scalable and Fast Simulation-Based Inference

Flow Matching for Scalable Simulation-Based Inference

Fast, accurate and lightweight sequential simulation-based inference using Gaussian locally linear mappings

Preconditioned Neural Posterior Estimation for Likelihood-free Inference

Simultaneous identification of models and parameters of scientific simulators

Compositional simulation-based inference for time series

Active Sequential Posterior Estimation for Sample-Efficient Simulation-Based Inference

Parallelization and High-Performance Computing Enables Automated Statistical Inference of Multi-scale Models.

Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimation

A Comprehensive Guide to Simulation-based Inference in Computational Biology

Cost-aware Simulation-based Inference

Pseudo-Likelihood Inference

Compositional Score Modeling for Simulation-based Inference

A Vine-Copula Based Adaptive Mcmc Sampler for Efficient Inference of Dynamical Systems

Scalable inference with autoregressive neural ratio estimation

SMC Is All You Need: Parallel Strong Scaling

All-in-one simulation-based inference

Comparing AI versus Optimization Workflows for Simulation-Based Inference of Spatial-Stochastic Systems

L-C2ST: Local Diagnostics for Posterior Approximations in Simulation-Based Inference

Simulation-based inference for efficient identification of generative models in computational connectomics