Dynamic Embeddings for Efficient Parameter Learning of Bayesian Network with Multiple Latent Variables

Zhiwei Qi,Kun Yue,Liang Duan,Kuang Hu,Zhihong Liang
DOI: https://doi.org/10.1016/j.ins.2022.01.020
IF: 8.1
2022-01-01
Information Sciences
Abstract:Latent variables (LVs), representing the unobservable abstract concepts, such as patient disease and customer credit, play an important role in the simplification of network structure and improving the interpretability of Bayesian network (BN). However, LVs incorporated into BN lead to missing probability parameters due to the missing observation. As the classic method for parameter estimation for the situation with LVs, the expectation- maximization (EM) suffers high complexity and slow convergence. To this end, we propose dynamic embeddings for parameter learning of BN with LVs. Firstly, we reconstruct the Estep of EM and propose to use the dynamic embeddings to calculate the weights of fractional samples that could reduce the computational complexity of parameter learning. Secondly, we propose to construct the point mutual information (PMI) matrix to represent directed weighted graphs (DWGs) transformed from the updated parameters. Thirdly, the incremental singular value decomposition (SVD) is adopted to generate dynamic embeddings while capturing the updated parameters and preserving BN's graphical structure. Experimental results show that our proposed methods are efficient and effective. On real-world BNs, the efficiency, convergence and accuracy of our method outperform those of the state-of-the-art methods for parameter learning of BN with multiple LVs. (C) 2022 Published by Elsevier Inc.
What problem does this paper attempt to address?