Abstract:We advocate for a new paradigm of cosmological likelihood-based inference, leveraging recent developments in machine learning and its underlying technology, to accelerate Bayesian inference in high-dimensional settings. Specifically, we combine (i) emulation, where a machine learning model is trained to mimic cosmological observables, e.g. CosmoPower-JAX; (ii) differentiable and probabilistic programming, e.g. JAX and NumPyro, respectively; (iii) scalable Markov chain Monte Carlo (MCMC) sampling techniques that exploit gradients, e.g. Hamiltonian Monte Carlo; and (iv) decoupled and scalable Bayesian model selection techniques that compute the Bayesian evidence purely from posterior samples, e.g. the learned harmonic mean implemented in harmonic. This paradigm allows us to carry out a complete Bayesian analysis, including both parameter estimation and model selection, in a fraction of the time of traditional approaches. First, we demonstrate the application of this paradigm on a simulated cosmic shear analysis for a Stage IV survey in 37- and 39-dimensional parameter spaces, comparing $\Lambda$CDM and a dynamical dark energy model ($w_0w_a$CDM). We recover posterior contours and evidence estimates that are in excellent agreement with those computed by the traditional nested sampling approach while reducing the computational cost from 8 months on 48 CPU cores to 2 days on 12 GPUs. Second, we consider a joint analysis between three simulated next-generation surveys, each performing a 3x2pt analysis, resulting in 157- and 159-dimensional parameter spaces. Standard nested sampling techniques are simply unlikely to be feasible in this high-dimensional setting, requiring a projected 12 years of compute time on 48 CPU cores; on the other hand, the proposed approach only requires 8 days of compute time on 24 GPUs. All packages used in our analyses are publicly available.

Test of artificial neural networks in likelihood-free cosmological constraints: A comparison of information maximizing neural networks and denoising autoencoder

Test of Artificial Neural Networks in Likelihood-free Cosmological Constraints: A Comparison of IMNN and DAE

Likelihood-free Cosmological Constraints with Artificial Neural Networks: An Application on Hubble Parameters and SNe Ia

CoLFI: Cosmological Likelihood-free Inference with Neural Density Estimators

Estimating Cosmological Parameters and Reconstructing Hubble Constant with Artificial Neural Networks: A Test with Reconstructed $H(z)$

Likelihood-free Inference with the Mixture Density Network

Enhancing Cosmological Model Selection with Interpretable Machine Learning

Dimensionality Reduction Techniques for Statistical Inference in Cosmology

A Tale of Two Fields: Neural Network-Enhanced non-Gaussianity Search with Halos

Cosmological model discrimination with Deep Learning

Constraining Galaxy-Halo Connection Using Machine Learning

Attention-Based Neural Network Emulators for Multi-Probe Data Vectors Part II: Assessing Tension Metrics

Neural Networks for cosmological model selection and feature importance using Cosmic Microwave Background data

ParamANN: A Neural Network to Estimate Cosmological Parameters for $Λ$CDM Universe Using Hubble Measurements

Model Comparison of Dark Energy Models Using Deep Network.

The future of cosmological likelihood-based inference: accelerated high-dimensional parameter estimation and model comparison

A comparative study of cosmological constraints from weak lensing using Convolutional Neural Networks

ParamANN: a neural network to estimate cosmological parameters for ΛCDM universe using hubble measurements

Cosmological constraints from low redshift 21 cm intensity mapping with machine learning

ECoPANN: A Framework for Estimating Cosmological Parameters Using Artificial Neural Networks

Reconstructing Functions and Estimating Parameters with Artificial Neural Networks: A Test with a Hubble Parameter and SNe Ia