Bayesian Analysis in Data Cubes

Ruibin Xi,Youngjin Kim,Yixin Chen

2009-01-01

Abstract:Abstract

What problem does this paper attempt to address?

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Chao Zhang,Li Z,Hui Qian,Xin Du

DOI: https://doi.org/10.24963/ijcai.2022/675

2022-01-01

Abstract:Many real-world phenomena arise from causal relationships among a set of variables. As a powerful tool, Bayesian Network (BN) has been successful in describing high-dimensional distributions. However, the faithfulness condition, enforced in most BN learning algorithms, is violated in the settings where multiple variables synergistically affect the outcome (i.e., with polyadic dependencies). Building upon recent development in cluster causal diagrams (C-DAGs), we initiate the formal study of learning C-DAGs from observational data to relax the faithfulness condition. We propose a new scoring function, the Clustering Information Criterion (CIC), based on information-theoretic measures that represent various complex interactions among variables. The CIC score also contains a penalization of the model complexity under the minimum description length principle. We further provide a searching strategy to learn structures of high scores. Experiments on both synthetic and real data support the effectiveness of the proposed method.
Number : wucse-2009-30 2009 Online Bayesian Analysis

Ruibin Xi

2019-01-01

Abstract:In the last few years, there has been active research on aggregating advanced statistical measures in multidimensional data cubes from partitioned subsets of data. In this paper, we propose an online compression and aggregation scheme to support Bayesian estimations in data cubes based on the asymptotic properties of Bayesian statistics. In the proposed approach, we compress each data segment by retaining only the model parameters and a small amount of auxiliary measures. We then develop an aggregation formula that allows us to reconstruct the Bayesian estimation from partitioned segments with a small approximation error. We show that the Bayesian estimates and the aggregated Bayesian estimates are asymptotically equivalent. Type of Report: Other Department of Computer Science & Engineering Washington University in St. Louis Campus Box 1045 St. Louis, MO 63130 ph: (314) 935-6160 Online Bayesian Analysis Ruibin Xi Department of Mathematics Washington University rxi@math.wustl.edu Youngjin Kim Department of Computer Science Washington University moah.kim@gmail.com Nan Lin Department of Mathematics Washington University nlin@math.wustl.edu Yixin Chen Department of Computer Science Washington University chen@cse.wustl.edu
Compression and Aggregation of Bayesian Estimates for Data Intensive Computing

Ruibin Xi,Nan Lin,Yixin Chen,Youngjin Kim

DOI: https://doi.org/10.1007/s10115-011-0459-4

IF: 2.7

2011-01-01

Knowledge and Information Systems

Abstract:Bayesian estimation is a major and robust estimator for many advanced statistical models. Being able to incorporate prior knowledge in statistical inference, Bayesian methods have been successfully applied in many different fields such as business, computer science, economics, epidemiology, genetics, imaging, and political science. However, due to its high computational complexity, Bayesian estimation has been deemed difficult, if not impractical, for large-scale databases, stream data, data warehouses, and data in the cloud. In this paper, we propose a novel compression and aggregation schemes (C&A) that enables distributed, parallel, or incremental computation of Bayesian estimates. Assuming partitioning of a large dataset, the C&A scheme compresses each partition into a synopsis and aggregates the synopsis into an overall Bayesian estimate without accessing the raw data. Such a C&A scheme can find applications in OLAP for data cubes, stream data mining, and cloud computing. It saves tremendous computing time since it processes each partition only once, enabling fast incremental update, and allows parallel processing. We prove that the compression is asymptotically lossless in the sense that the aggregated estimator deviates from the true model by an error that is bounded and approaches to zero when the data size increases. The results show that the proposed C&A scheme can make feasible OLAP of Bayesian estimates in a data cube. Further, it supports real-time Bayesian analysis of stream data, which can only be scanned once and cannot be permanently retained. Experimental results validate our theoretical analysis and demonstrate that our method can dramatically save time and space costs with almost no degradation of the modeling accuracy.
Compression and Aggregation for Logistic Regression Analysis in Data Cubes

Ruibin Xi,Nan Lin,Yixin Chen

DOI: https://doi.org/10.1109/tkde.2008.186

IF: 9.235

2009-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Logistic regression is an important technique for analyzing and predicting data with categorical attributes. In this paper, We consider supporting online analytical processing (OLAP) of logistic regression analysis for multi-dimensional data in a data cube where it is expensive in time and space to build logistic regression models for each cell from the raw data. We propose a novel scheme to compress the data in such a way that we can reconstruct logistic regression models to answer any OLAP query without accessing the raw data. Based on a first-order approximation to the maximum likelihood estimating equations, we develop a compression scheme that compresses each base cell into a small compressed data block with essential information to support the aggregation of logistic regression models. Aggregation formulae for deriving high-level logistic regression models from lower level component cells are given. We prove that the compression is nearly lossless in the sense that the aggregated estimator deviates from the true model by an error that is bounded and approaches to zero when the data size increases. The results show that the proposed compression and aggregation scheme can make feasible OLAP of logistic regression in a data cube. Further, it supports real-time logistic regression analysis of stream data, which can only be scanned once and cannot be permanently retained. Experimental results validate our theoretical analysis and demonstrate that our method can dramatically save time and space costs with almost no degradation of the modeling accuracy.
Bayesian Analysis for Exponential Random Graph Models Using the Adaptive Exchange Sampler.

Ick Hoon Jin,Ying Yuan,Faming Liang

DOI: https://doi.org/10.4310/sii.2013.v6.n4.a13

2013-01-01

Statistics and Its Interface

Abstract:Exponential random graph models have been widely used in social network analysis. However, these models are extremely difficult to handle from a statistical viewpoint, because of the intractable normalizing constant and model degeneracy. In this paper, we consider a fully Bayesian analysis for exponential random graph models using the adaptive exchange sampler, which solves the intractable normalizing constant and model degeneracy issues encountered in Markov chain Monte Carlo (MCMC) simulations. The adaptive exchange sampler can be viewed as a MCMC extension of the exchange algorithm, and it generates auxiliary networks via an importance sampling procedure from an auxiliary Markov chain running in parallel. The convergence of this algorithm is established under mild conditions. The adaptive exchange sampler is illustrated using a few social networks, including the Florentine business network, molecule synthetic network, and dolphins network. The results indicate that the adaptive exchange algorithm can produce more accurate estimates than approximate exchange algorithms, while maintaining the same computational efficiency.
Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Xin Wei,Chunguang Li

DOI: https://doi.org/10.1016/j.sigpro.2013.04.007

IF: 4.729

2013-01-01

Signal Processing

Abstract:Recently, a representative approach, named mixtures of common factor analyzers (MCFA), was proposed for clustering high-dimensional observed data. Existing model-parameter estimation methods for this approach is based on the maximum likelihood criterion and performed by the expectation-maximization algorithm. In this paper, we consider the MCFA from a Bayesian perspective and propose the Bayesian mixtures of common factor analyzers (BMCFA) model, which replaces the deterministic model parameters in the MCFA by stochastic variables. Then we present a variational inference algorithm for this BMCFA model. Moreover, the proposed BMCFA model and the associated variational inference algorithm are used for clustering the high-dimensional synthetic data, the wine data from the UCI machine learning repository and the gene expression data. Experimental results illustrate that the BMCFA has good generalization capacities, automatically determining the appropriate number of clusters from high-dimensional observed data.
A Clustered Dwarf Structure to Speed Up Queries on Data Cubes

Yukun Bao,Fangling Leng,Daling Wang,Guanding Yu

DOI: https://doi.org/10.5626/jcse.2007.1.2.195

2007-01-01

Journal of Computing Science and Engineering

Abstract:Dwarf is a highly compressed structure, which compresses the cube by eliminating the semantic redundancies while computing a data cube. Although it has high compression ratio, Dwarf is slower in querying and more difficult in updating due to its structure characteristics. We all know that the original intention of data cube is to speed up the query performance, so we propose two novel clustering methods for query optimization: the recursion clustering method which clusters the nodes in a recursive manner to speed up point queries and the hierarchical clustering method which clusters the nodes of the same dimension to speed up range queries. To facilitate the implementation, we design a partition strategy and a logical clustering mechanism. Experimental results show our methods can effectively improve the query performance on data cubes, and the recursion clustering method is suitable for both point queries and range queries.
Holistic Cube Analysis: A Query Framework for Data Insights

Xi Wu,Shaleen Deep,Joe Benassi,Fengan Li,Yaqi Zhang,Uyeong Jang,James Foster,Stella Kim,Yujing Sun,Long Nguyen,Stratis Viglas,Somesh Jha,John Cieslewicz,Jeffrey F. Naughton

2023-07-01

Abstract:Many data insight questions can be viewed as searching in a large space of tables and finding important ones, where the notion of importance is defined in some adhoc user defined manner. This paper presents Holistic Cube Analysis (HoCA), a framework that augments the capabilities of relational queries for such problems. HoCA first augments the relational data model and introduces a new data type AbstractCube, defined as a function which maps a region-features pair to a relational table (a region is a tuple which specifies values of a set of dimensions). AbstractCube provides a logical form of data, and HoCA operators are cube-to-cube transformations. We describe two basic but fundamental HoCA operators, cube crawling and cube join (with many possible extensions). Cube crawling explores a region space, and outputs a cube that maps regions to signal vectors. Cube join, in turn, is critical for composition, allowing one to join information from different cubes for deeper analysis. Cube crawling introduces two novel programming features, (programmable) Region Analysis Models (RAMs) and Multi-Model Crawling. Crucially, RAM has a notion of population features, which allows one to go beyond only analyzing local features at a region, and program region-population analysis that compares region and population features, capturing a large class of importance notions. HoCA has a rich algorithmic space, such as optimizing crawling and join performance, and physical design of cubes. We have implemented and deployed HoCA at Google. Our early HoCA offering has attracted more than 30 teams building applications with it, across a diverse spectrum of fields including system monitoring, experimentation analysis, and business intelligence. For many applications, HoCA empowers novel and powerful analyses, such as instances of recurrent crawling, which are challenging to achieve otherwise.

Databases,Distributed, Parallel, and Cluster Computing,Programming Languages
The computation of semantic data cube

Yubao Liu,Jian Yin

DOI: https://doi.org/10.1007/11590354_74

2005-01-01

Abstract:The multidimensional analysis based on data cube has been growing interest. However existing data cube model usually does not have the semantics of attributes and hence the analysis usually provides results with raw numbers and ignores the real meanings of these numbers. An example result is that the total sales of PC in this year are above 2000. The semantics of sale performance, high or low, is not clear and that is not easy to be understood for decision makers. The semantic data cube model with linguistic semantics is presented in this paper. The semantic data cube uses fuzzy set to represent the linguistic semantics of the dimensions and measures of data cube. The computation of semantic data cube is studied and the serial and parallel computation algorithms are presented. The experiments on the synthetic datasets show that the algorithms are scalable and efficient.
Bayesian Bi-clustering Methods with Applications in Computational Biology

Han Yan,Jiexing Wu,Yang Li,Jun S. Liu

DOI: https://doi.org/10.48550/arXiv.2007.06136

2021-02-10

Abstract:Bi-clustering is a useful approach in analyzing biological data when observations come from heterogeneous groups and have a large number of features. We outline a general Bayesian approach in tackling bi-clustering problems in moderate to high dimensions, and propose three Bayesian bi-clustering models on categorical data, which increase in complexities in their modeling of the distributions of features across bi-clusters. Our proposed methods apply to a wide range of scenarios: from situations where data are cluster-distinguishable only among a small subset of features but masked by a large amount of noise, to situations where different groups of data are identified by different sets of features or data exhibit hierarchical structures. Through simulation studies, we show that our methods outperform existing (bi-)clustering methods in both identifying clusters and recovering feature distributional patterns across bi-clusters. We apply our methods to two genetic datasets, though the area of application of our methods is even broader.

Applications
Bayesian Tensor Analysis

Dacheng Tao,Jimeng Sun,Jialie Shen,Xindong Wu,Xuelong Li,Stephen J. Maybank,Christos Faloutsos

DOI: https://doi.org/10.1109/ijcnn.2008.4633981

2008-01-01

Abstract:Vector data are normally used for probabilistic graphical models with Bayesian inference. However, tensor data, i.e., multidimensional arrays, are actually natural representations of a large amount of real data, in data mining, computer vision, and many other applications. Aiming at breaking the huge gap between vectors and tensors in conventional statistical tasks, e.g., automatic model selection, this paper proposes a decoupled probabilistic algorithm, named Bayesian tensor analysis (BTA). BTA automatically selects a suitable model for tensor data, as demonstrated by empirical studies.
A Co-analysis Framework for Exploring Multivariate Scientific Data

Xiangyang He,Yubo Tao,Qirui Wang,Hai Lin

DOI: https://doi.org/10.1016/j.visinf.2018.12.005

2019-08-19

Abstract:In complex multivariate data sets, different features usually include diverse associations with different variables, and different variables are associated within different regions. Therefore, exploring the associations between variables and voxels locally becomes necessary to better understand the underlying phenomena. In this paper, we propose a co-analysis framework based on biclusters, which are two subsets of variables and voxels with close scalar-value relationships, to guide the process of visually exploring multivariate data. We first automatically extract all meaningful biclusters, each of which only contains voxels with a similar scalar-value pattern over a subset of variables. These biclusters are organized according to their variable sets, and biclusters in each variable set are further grouped by a similarity metric to reduce redundancy and support diversity during visual exploration. Biclusters are visually represented in coordinated views to facilitate interactive exploration of multivariate data based on the similarity between biclusters and the correlation of scalar values with different variables. Experiments on several representative multivariate scientific data sets demonstrate the effectiveness of our framework in exploring local relationships among variables, biclusters and scalar values in the data.

Computer Vision and Pattern Recognition,Computation and Language
DP-space: Bayesian Nonparametric Subspace Clustering with Small-variance Asymptotics.

Yining Wang,Jun Zhu

2015-01-01

Abstract:Subspace clustering separates data points approximately lying on union of affine subspaces into several clusters. This paper presents a novel nonparametric Bayesian subspace clustering model that infers both the number of subspaces and the dimension of each subspace from the observed data. Though the posterior inference is hard, our model leads to a very efficient deterministic algorithm, DP-space , which retains the nonparametric ability under a smallvariance asymptotic analysis. DP-space monotonically minimizes an intuitive objective with an explicit tradeoff between data fitness and model complexity. Experimental results demonstrate that DP-space outperforms various competitors in terms of clustering accuracy and at the same time it is highly efficient.
Practical Inference Control for Data Cubes

Haibing Lu,Yingjiu Li

DOI: https://doi.org/10.1109/TDSC.2007.70217

2008-04-01

IEEE Transactions on Dependable and Secure Computing

Abstract:The fundamental problem for inference control in data cubes is how to efficiently calculate the lower and upper bounds for each cell value given the aggregations of cell values over multiple dimensions. In this paper, we provide the first practical solution for estimating exact bounds in two-dimensional irregular data cubes (that is, data cubes in which certain cell values are known to a snooper). Our results imply that the exact bounds cannot be obtained by a direct application of the Frechet bounds in some cases. We then propose a new approach to improve the classic Frechet bounds for any high-dimensional data cube in the most general case. The proposed approach improves upon the Frechet bounds in the sense that it gives bounds that are at least as tight as those computed by Frechet yet is simpler in terms of time complexity. Based on our solutions to the fundamental problem, we discuss various security applications such as privacy protection of released data, fine-grained access control, and auditing, and identify some future research directions.

Mathematics,Computer Science
Bayesian analysis of social influence

Johan Koskinen,Galina Daraganova

DOI: https://doi.org/10.1111/rssa.12844

2022-04-20

Abstract:Journal of the Royal Statistical Society: Series A (Statistics in Society), EarlyView.
Bayesian model-based clustering for populations of network data

Anastasia Mantziou,Simon Lunagomez,Robin Mitra

DOI: https://doi.org/10.48550/arXiv.2107.03431

2023-06-20

Abstract:There is increasing appetite for analysing populations of network data due to the fast-growing body of applications demanding such methods. While methods exist to provide readily interpretable summaries of heterogeneous network populations, these are often descriptive or ad hoc, lacking any formal justification. In contrast, principled analysis methods often provide results difficult to relate back to the applied problem of interest. Motivated by two complementary applied examples, we develop a Bayesian framework to appropriately model complex heterogeneous network populations, whilst also allowing analysts to gain insights from the data, and make inferences most relevant to their needs. The first application involves a study in Computer Science measuring human movements across a University. The second analyses data from Neuroscience investigating relationships between different regions of the brain. While both applications entail analysis of a heterogeneous population of networks, network sizes vary considerably. We focus on the problem of clustering the elements of a network population, where each cluster is characterised by a network representative. We take advantage of the Bayesian machinery to simultaneously infer the cluster membership, the representatives, and the community structure of the representatives, thus allowing intuitive inferences to be made. The implementation of our method on the human movement study reveals interesting movement patterns of individuals in clusters, readily characterised by their network representative. For the brain networks application, our model reveals a cluster of individuals with different network properties of particular interest in Neuroscience. The performance of our method is additionally validated in extensive simulation studies.

Applications
Bayesian Analysis of Image and Genetic Data

E. Herskovits,Rong Chen,D. Goldman,C. Hodgkinson,Yihong Yang,E. Hong,E. Stein

2010-01-01

Abstract: Conventional analysis of image and genetic data are limited by: High dimensionality: Data (D) include ~106 voxels (V) and ~106 SNPs (G), in addition to clinical variables (C)  Severe under-sampling  Spatial correlations among voxel variables  Bayesian networks (BNs) model nonlinear associations among categorical variables  BN-based data mining complements hypothesis testing Compute P(BN | D) for n variables, each of which has ri states and qi joint parent states, using the BDe metric 1 (P(D) is a constant):
Bayesian small area demography

Junni L. Zhang,John Bryant,Kirsten Nissen

2019-01-01

Survey methodology

Abstract:Demographers are facing increasing pressure to disaggregate their estimates and forecasts by characteristics such as region, ethnicity, and income. Traditional demographic methods were designed for large samples, and perform poorly with disaggregated data. Methods based on formal Bayesian statistical models offer better performance. We illustrate with examples from a long-term project to develop Bayesian approaches to demographic estimation and forecasting. In our first example, we estimate mortality rates disaggregated by age and sex for a small population. In our second example, we simultaneously estimate and forecast obesity prevalence disaggregated by age. We conclude by addressing two traditional objections to the use of Bayesian methods in statistical agencies.
Bayesian Analysis for Social Science Research

Carolina Luque,Juan Sosa

DOI: https://doi.org/10.48550/arXiv.2306.11966

2023-06-21

Abstract:In this manuscript, we discuss the substantial importance of Bayesian reasoning in Social Science research. Particularly, we focus on foundational elements to fit models under the Bayesian paradigm. We aim to offer a frame of reference for a broad audience, not necessarily with specialized knowledge in Bayesian statistics, yet having interest in incorporating this kind of methods in studying social phenomena. We illustrate Bayesian methods through case studies regarding political surveys, population dynamics, and standardized educational testing. Specifically, we provide technical details on specific topics such as conjugate and non-conjugate modeling, hierarchical modeling, Bayesian computation, goodness of fit, and model testing.

Methodology
Bayesian Analysis of Multidimensional Functional Data

John Shamshoian,Damla Senturk,Shafali Jeste,Donatello Telesca

DOI: https://doi.org/10.48550/arXiv.1909.08763

2019-09-19

Abstract:Multi-dimensional functional data arises in numerous modern scientific experimental and observational studies. In this paper we focus on longitudinal functional data, a structured form of multidimensional functional data. Operating within a longitudinal functional framework we aim to capture low dimensional interpretable features. We propose a computationally efficient nonparametric Bayesian method to simultaneously smooth observed data, estimate conditional functional means and functional covariance surfaces. Statistical inference is based on Monte Carlo samples from the posterior measure through adaptive blocked Gibbs sampling. Several operative characteristics associated with the proposed modeling framework are assessed comparatively in a simulated environment. We illustrate the application of our work in two case studies. The first case study involves age-specific fertility collected over time for various countries. The second case study is an implicit learning experiment in children with Autism Spectrum Disorder (ASD).

Methodology

Bayesian Analysis in Data Cubes

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Number : wucse-2009-30 2009 Online Bayesian Analysis

Compression and Aggregation of Bayesian Estimates for Data Intensive Computing

Compression and Aggregation for Logistic Regression Analysis in Data Cubes

Bayesian Analysis for Exponential Random Graph Models Using the Adaptive Exchange Sampler.

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

A Clustered Dwarf Structure to Speed Up Queries on Data Cubes

Holistic Cube Analysis: A Query Framework for Data Insights

The computation of semantic data cube

Bayesian Bi-clustering Methods with Applications in Computational Biology

Bayesian Tensor Analysis

A Co-analysis Framework for Exploring Multivariate Scientific Data

DP-space: Bayesian Nonparametric Subspace Clustering with Small-variance Asymptotics.

Practical Inference Control for Data Cubes

Bayesian analysis of social influence

Bayesian model-based clustering for populations of network data

Bayesian Analysis of Image and Genetic Data

Bayesian small area demography

Bayesian Analysis for Social Science Research

Bayesian Analysis of Multidimensional Functional Data