Abstract:Future wireless networks are envisioned to provide ubiquitous sensing services, which also gives rise to a substantial demand for high-dimensional non-convex parameter estimation, i.e., the associated likelihood function is non-convex and contains numerous local optima. Variational Bayesian inference (VBI) provides a powerful tool for modeling complex estimation problems and reasoning with prior information, but poses a long-standing challenge on computing intractable posteriori distributions. Most existing variational methods generally rely on assumptions about specific distribution families to derive closed-form solutions, and are difficult to apply in high-dimensional, non-convex scenarios. Given these challenges, firstly, we propose a parallel stochastic particle variational Bayesian inference (PSPVBI) algorithm. Thanks to innovations such as particle approximation, additional updates of particle positions, and parallel stochastic successive convex approximation (PSSCA), PSPVBI can flexibly drive particles to fit the posteriori distribution with acceptable complexity, yielding high-precision estimates of the target parameters. Furthermore, additional speedup can be obtained by deep-unfolding (DU) the PSPVBI algorithm. Specifically, superior hyperparameters are learned to dramatically reduce the number of algorithmic iterations. In this PSPVBI-induced Deep-Unfolding Networks, some techniques related to gradient computation, data sub-sampling, differentiable sampling, and generalization ability are also employed to facilitate the practical deployment. Finally, we apply the LPSPVBI to solve several important parameter estimation problems in wireless sensing scenarios. Simulations indicate that the LPSPVBI algorithm outperforms existing solutions.

Particle-based energetic variational inference

DPVI: A Dynamic-Weight Particle-Based Variational Inference Framework

GAD-PVI: A General Accelerated Dynamic-Weight Particle-Based Variational Inference Framework

Understanding and Accelerating Particle-Based Variational Inference

Particle Semi-Implicit Variational Inference

Variance Reduction and Quasi-Newton for Particle-Based Variational Inference

Particle-based Variational Inference with Generalized Wasserstein Gradient Flow

A Stochastic Particle Variational Bayesian Inference Inspired Deep-Unfolding Network for Sensing over Wireless Networks

Variational Inference Using Material Point Method

Variational Inference via Smoothed Particle Hydrodynamics

Semi-Implicit Functional Gradient Flow

Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm

Flexible and Efficient Inference with Particles for the Variational Gaussian Approximation

Variational Potential Flow: A Novel Probabilistic Framework for Energy-Based Generative Modelling

Learning Generalized Diffusions using an Energetic Variational Approach

Wasserstein Gradient Flow over Variational Parameter Space for Variational Inference

Theoretical Guarantees for Variational Inference with Fixed-Variance Mixture of Gaussians

Forward $χ^2$ Divergence Based Variational Importance Sampling

A Stochastic Particle Variational Bayesian Inference Inspired Deep-Unfolding Network for Non-Convex Parameter Estimation

Variational Refinement for Importance Sampling Using the Forward Kullback-Leibler Divergence

A Primer on Variational Inference for Physics-Informed Deep Generative Modelling