Abstract:Obtaining a reliable estimate of the joint probability mass function (PMF) of a set of random variables from observed data is a significant objective in statistical signal processing and machine learning. Modelling the joint PMF as a tensor that admits a low-rank canonical polyadic decomposition (CPD) has enabled the development of efficient PMF estimation algorithms. However, these algorithms require the rank (model order) of the tensor to be specified beforehand. In real-world applications, the true rank is unknown. Therefore, an appropriate rank is usually selected from a candidate set either by observing validation errors or by computing various likelihood-based information criteria, a procedure which is computationally expensive for large datasets. This paper presents a novel Bayesian framework for estimating the joint PMF and automatically inferring its rank from observed data. We specify a Bayesian PMF estimation model and employ appropriate prior distributions for the model parameters, allowing for tuning-free rank inference via a single training run. We then derive a deterministic solution based on variational inference (VI) to approximate the posterior distributions of various model parameters. Additionally, we develop a scalable version of the VI-based approach by leveraging stochastic variational inference (SVI) to arrive at an efficient algorithm whose complexity scales sublinearly with the size of the dataset. Numerical experiments involving both synthetic data and real movie recommendation data illustrate the advantages of our VI and SVI-based methods in terms of estimation accuracy, automatic rank detection, and computational efficiency.

Bayesian Regression Analysis using Median Rank Set Sampling

Bayesian mixture modelling with ranked set samples

Three-fold utilization of supplementary information for mean estimation under median ranked set sampling scheme

Bayesian estimation for median discrete Weibull regression model

The Estimate Of The Rank For Regression Coefficient Matrix In A Median Regression-Model

Estimation methods based on ranked set sampling for the arctan uniform distribution with application

Statistical inference and data analysis for inverted Kumaraswamy distribution based on maximum ranked set sampling with unequal samples

Bayesian Uncertainty Estimation Under Complex Sampling

Bayesian rank-based hypothesis testing for the rank sum test, the signed rank test, and Spearman's ρ

Bayesian rank penalization.

The Superiority of Bayes Linear Unbiased Minimum Variance Estimator with Respect to Ridge Estimator

Bayesian inference using least median of squares and least trimmed squares in models with independent or correlated errors and outliers

Bayesian Modal Regression based on Mixture Distributions

Uncertainty Quantification in Bayesian Reduced-Rank Sparse Regressions

Generalized Median of Means Principle for Bayesian Inference

THE METHOD OF RANK-BASED ROBUST REGRESSION ANALYSIS

Bayesian Estimation and Tuning-Free Rank Detection for Probability Mass Function Tensors

Maximum likelihood estimation of the parameters of the inverse Gaussian distribution using maximum rank set sampling with unequal samples

Bayesian Quantile Regression for Ordinal Models

Bayesian Rank-Clustering

Medical and Engineering Applications for Estimation and Prediction of a New Competing Risks Model: A Bayesian Approach