Abstract:Future wireless networks are envisioned to provide ubiquitous sensing services, which also gives rise to a substantial demand for high-dimensional non-convex parameter estimation, i.e., the associated likelihood function is non-convex and contains numerous local optima. Variational Bayesian inference (VBI) provides a powerful tool for modeling complex estimation problems and reasoning with prior information, but poses a long-standing challenge on computing intractable posteriori distributions. Most existing variational methods generally rely on assumptions about specific distribution families to derive closed-form solutions, and are difficult to apply in high-dimensional, non-convex scenarios. Given these challenges, firstly, we propose a parallel stochastic particle variational Bayesian inference (PSPVBI) algorithm. Thanks to innovations such as particle approximation, additional updates of particle positions, and parallel stochastic successive convex approximation (PSSCA), PSPVBI can flexibly drive particles to fit the posteriori distribution with acceptable complexity, yielding high-precision estimates of the target parameters. Furthermore, additional speedup can be obtained by deep-unfolding (DU) the PSPVBI algorithm. Specifically, superior hyperparameters are learned to dramatically reduce the number of algorithmic iterations. In this PSPVBI-induced Deep-Unfolding Networks, some techniques related to gradient computation, data sub-sampling, differentiable sampling, and generalization ability are also employed to facilitate the practical deployment. Finally, we apply the LPSPVBI to solve several important parameter estimation problems in wireless sensing scenarios. Simulations indicate that the LPSPVBI algorithm outperforms existing solutions.

A Particle Algorithm for Mean-Field Variational Inference

DPVI: A Dynamic-Weight Particle-Based Variational Inference Framework

A Stochastic Particle Variational Bayesian Inference Inspired Deep-Unfolding Network for Sensing over Wireless Networks

Particle Mean Field Variational Bayes

Theoretical and Computational Guarantees of Mean Field Variational Inference for Community Detection

Understanding and Accelerating Particle-Based Variational Inference

Flexible and Efficient Inference with Particles for the Variational Gaussian Approximation

Variance Reduction and Quasi-Newton for Particle-Based Variational Inference

A generalized mean field algorithm for variational inference in exponential families

Theoretical Guarantees for Variational Inference with Fixed-Variance Mixture of Gaussians

On the Convergence of Coordinate Ascent Variational Inference

Variational Inference Using Material Point Method

A Stochastic Particle Variational Bayesian Inference Inspired Deep-Unfolding Network for Non-Convex Parameter Estimation

Variational Inference: A Review for Statisticians

Particle Semi-Implicit Variational Inference

Mean-field Variational Inference via Wasserstein Gradient Flow

Particle-based energetic variational inference

GAD-PVI: A General Accelerated Dynamic-Weight Particle-Based Variational Inference Framework

Robust Coordinate Ascent Variational Inference with Markov chain Monte Carlo simulations

Variational mcmc

Variational Bayesian inference with stochastic search