Abstract:Normalizing flows (NF) use a continuous generator to map a simple latent (e.g. Gaussian) distribution, towards an empirical target distribution associated with a training data set. Once trained by minimizing a variational objective, the learnt map provides an approximate generative model of the target distribution. Since standard NF implement differentiable maps, they may suffer from pathological behaviors when targeting complex distributions. For instance, such problems may appear for distributions on multi-component topologies or characterized by multiple modes with high probability regions separated by very unlikely areas. A typical symptom is the explosion of the Jacobian norm of the transformation in very low probability areas. This paper proposes to overcome this issue thanks to a new Markov chain Monte Carlo algorithm to sample from the target distribution in the latent domain before transporting it back to the target domain. The approach relies on a Metropolis adjusted Langevin algorithm whose dynamics explicitly exploits the Jacobian of the transformation. Contrary to alternative approaches, the proposed strategy preserves the tractability of the likelihood and it does not require a specific training. Notably, it can be straightforwardly used with any pre-trained NF network, regardless of the architecture. Experiments conducted on synthetic and high-dimensional real data sets illustrate the efficiency of the method.

Improving $Λ$ Signal Extraction with Domain Adaptation via Normalizing Flows

Normalizing Flows for Domain Adaptation when Identifying $Λ$ Hyperon Events

Flows for Flows: Morphing one Dataset into another with Maximum Likelihood Estimation

Chained Quantile Morphing with Normalizing Flows

Normalizing Flows for High-Dimensional Detector Simulations

Training normalizing flows with computationally intensive target probability distributions

Towards a data-driven model of hadronization using normalizing flows

Piecewise Normalizing Flows

L2LFlows: Generating High-Fidelity 3D Calorimeter Images

Unifying Simulation and Inference with Normalizing Flows

ν-Flows: Conditional Neutrino Regression

Convolutional L2LFlows: Generating Accurate Showers in Highly Granular Calorimeters Using Convolutional Normalizing Flows

Normalizing flows for random fields in cosmology

Normalizing flow sampling with Langevin dynamics in the latent space

Flow Away your Differences: Conditional Normalizing Flows as an Improvement to Reweighting

The NFLikelihood: an unsupervised DNNLikelihood from Normalizing Flows

Deep learning for flow observables in ultrarelativistic heavy-ion collisions

Practical applications of machine-learned flows on gauge fields

Learning Likelihoods with Conditional Normalizing Flows