A Numerical Study of the Bottom-Up and Top-Down Inference Processes in And-Or Graphs

WuTianfu,ZhuSong-Chun

IF: 13.369

2011-01-01

International Journal of Computer Vision

Abstract:This paper presents a numerical study of the bottom-up and top-down inference processes in hierarchical models using the And-Or graph as an example. Three inference processes are identified for eac...

What problem does this paper attempt to address?

A Numerical Study of the Bottom-Up and Top-Down Inference Processes in And-Or Graphs.

Tianfu Wu,Song-Chun Zhu

DOI: https://doi.org/10.1007/s11263-010-0346-6

IF: 13.369

2010-01-01

International Journal of Computer Vision

Abstract:This paper presents a numerical study of the bottom-up and top-down inference processes in hierarchical models using the And-Or graph as an example. Three inference processes are identified for each node A in a recursively defined And-Or graph in which stochastic context sensitive image grammar is embedded: the α ( A ) process detects node A directly based on image features, the β ( A ) process computes node A by binding its child node(s) bottom-up and the γ ( A ) process predicts node A top-down from its parent node(s). All the three processes contribute to computing node A from images in complementary ways. The objective of our numerical study is to explore how much information each process contributes and how these processes should be integrated to improve performance. We study them in the task of object parsing using And-Or graph formulated under the Bayesian framework. Firstly, we isolate and train the α ( A ), β ( A ) and γ ( A ) processes separately by blocking the other two processes. Then, information contributions of each process are evaluated individually based on their discriminative power, compared with their respective human performance. Secondly, we integrate the three processes explicitly for robust inference to improve performance and propose a greedy pursuit algorithm for object parsing. In experiments, we choose two hierarchical case studies: one is junctions and rectangles in low-to-middle-level vision and the other is human faces in high-level vision. We observe that (i) the effectiveness of the α ( A ), β ( A ) and γ ( A ) processes depends on the scale and occlusion conditions, (ii) the α (face) process is stronger than the α processes of facial components, while β (junctions) and β (rectangle) work much better than their α processes, and (iii) the integration of the three processes improves performance in ROC comparisons.
Variational Inference over Graph: Knowledge Representation for Deep Process Data Analytics

Zhichao Chen,Zhihuan Song,Zhiqiang Ge

DOI: https://doi.org/10.1109/tkde.2023.3327415

IF: 9.235

2024-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:With the advent of the industrial Big Data era, accurate estimation of product quality and monitoring of working conditions from historical data have become crucial in the process industry. However, the majority of data-driven approaches predominantly rely on observational data, overlooking the valuable empirical knowledge derived from experience or underlying mechanisms. In order to leverage this knowledge, researchers employ variousgraphneuralnetwork-basedmethodswhichintroduceconnectionsamongprocess variables for feature extraction. Nevertheless, it is imperative to recognize that process knowledge undergoes changes due to internal or external concept drift. To address this challenge, we propose a novel deep learning module called “variational inference over graph” to effectively harness shifting knowledge. Building upon the self-attention mechanism, we design a probabilistic self-attention mechanism for encoding and reconciling prior knowledge. Instead of directly encoding the prior knowledge through graph neural network edges, we incorporate it as regularization term within the variational inference framework that accounts for knowledge shift. Furthermore, we introduce reparameterization estimator to control the variance resulting from knowledge uncertainty. To showcase the capability of our proposed method, we conduct various experiments on quality prediction tasks in real industrial process.
Geometric and Topological Inference for Deep Representations of Complex Networks

Baihan Lin

DOI: https://doi.org/10.48550/arXiv.2203.05488

IF: 5.414

2022-03-10

Machine Learning

Abstract:Understanding the deep representations of complex networks is an important step of building interpretable and trustworthy machine learning applications in the age of internet. Global surrogate models that approximate the predictions of a black box model (e.g. an artificial or biological neural net) are usually used to provide valuable theoretical insights for the model interpretability. In order to evaluate how well a surrogate model can account for the representation in another model, we need to develop inference methods for model comparison. Previous studies have compared models and brains in terms of their representational geometries (characterized by the matrix of distances between representations of the input patterns in a model layer or cortical area). In this study, we propose to explore these summary statistical descriptions of representations in models and brains as part of a broader class of statistics that emphasize the topology as well as the geometry of representations. The topological summary statistics build on topological data analysis (TDA) and other graph-based methods. We evaluate these statistics in terms of the sensitivity and specificity that they afford when used for model selection, with the goal to relate different neural network models to each other and to make inferences about the computational mechanism that might best account for a black box representation. These new methods enable brain and computer scientists to visualize the dynamic representational transformations learned by brains and models, and to perform model-comparative statistical inference.
Hierarchical Bayesian Network Modeling Framework for Large-Scale Process Monitoring and Decision Making.

Guangjie Chen,Zhiqiang Ge

DOI: https://doi.org/10.1109/tcst.2018.2882562

IF: 4.8

2020-01-01

IEEE Transactions on Control Systems Technology

Abstract:In this brief, a hierarchical Bayesian network modeling framework is formulated for large-scale process monitoring and decision making, which includes a basic layer and a functional layer. First, the whole process is decomposed into different units, where local Bayesian networks are constructed, providing monitoring information and decision-making capability for the upper layer. The network structure is determined automatically based on the process data in each local unit of the basic layer. Then, through incorporating the topological structure of the process, a functional Bayesian network is further constructed to infer the information from the basic layer, which can be customized according to user demands, such as fault detection, fault diagnosis, and classification of operating status. The performance of the proposed method is evaluated through a benchmark process.
Interpreting Bottom-Up Decision-Making of CNNs via Hierarchical Inference

Dan Wang,Xinrui Cui,Xun Chen,Rabab Ward,Z. Jane Wang

DOI: https://doi.org/10.1109/TIP.2021.3097187

IF: 10.6

2021-01-01

IEEE Transactions on Image Processing

Abstract:With the great success of convolutional neural networks (CNNs), interpretation of their internal network mechanism has been increasingly critical, while the network decision-making logic is still an open issue. In the bottom-up hierarchical logic of neuroscience, the decision-making process can be deduced from a series of sub-decision-making processes from low to high levels. Inspired by this, we propose the Concept-harmonized HierArchical INference (CHAIN) interpretation scheme. In CHAIN, a network decision-making process from shallow to deep layers is interpreted by the hierarchical backward inference based on visual concepts from high to low semantic levels. Firstly, we learned a general hierarchical visual-concept representation in CNN layered feature space by concept harmonizing model on a large concept dataset. Secondly, for interpreting a specific network decision-making process, we conduct the concept-harmonized hierarchical inference backward from the highest to the lowest semantic level. Specifically, the network learning for a target concept at a deeper layer is disassembled into that for concepts at shallower layers. Finally, a specific network decision-making process is explained as a form of concept-harmonized hierarchical inference, which is intuitively comparable to the bottom-up hierarchical visual recognition way. Quantitative and qualitative experiments demonstrate the effectiveness of the proposed CHAIN at both instance and class levels.
Hierarchical Parameter Estimation of GRN Based on Topological Analysis

Wei Zhang,Feng Zhang,Jianming Zhang,Ning Wang

DOI: https://doi.org/10.1049/iet-syb.2018.5015

2018-01-01

IET Systems Biology

Abstract:Reverse engineering of gene regulatory network (GRN) is an important and challenging task in systems biology. Existing parameter estimation approaches that compute model parameters with the same importance are usually computationally expensive or infeasible, especially in dealing with complex biological networks.In order to improve the efficiency of computational modeling, the paper applies a hierarchical estimation methodology in computational modeling of GRN based on topological analysis. This paper divides nodes in a network into various priority levels using the graph-based measure and genetic algorithm. The nodes in the first level, that correspond to root strongly connected components(SCC) in the digraph of GRN, are given top priority in parameter estimation. The estimated parameters of vertices in the previous priority level ARE used to infer the parameters for nodes in the next priority level. The proposed hierarchical estimation methodology obtains lower error indexes while consuming less computational resources compared with single estimation methodology. Experimental outcomes with insilico networks and a realistic network show that gene networks are decomposed into no more than four levels, which is consistent with the properties of inherent modularity for GRN. In addition, the proposed hierarchical parameter estimation achieves a balance between computational efficiency and accuracy.
Topology Inference of Directed Graphs by Gaussian Processes with Sparsity Constraints

Chen Cui,Paolo Banelli,Petar M. Djuric,Petar M. Djurić

DOI: https://doi.org/10.1109/tsp.2024.3381071

IF: 4.875

2024-01-01

IEEE Transactions on Signal Processing

Abstract:In machine learning applications, data are often high-dimensional and intricately related. It is often of interest to find the underlying structure and causal relationships among the data and represent these relationships with directed graphs. In this paper, we study multivariate time series, where each series is associated with a node of a graph, and where the objective is to estimate the topology of a sparse graph that reflects how the nodes of the graph affect each other, if at all. We propose a novel fully Bayesian approach that employs a sparsity-encouraging prior on the hyperparameters. The proposed method allows for nonlinear and multiple lag relationships among the time series. The method is based on Gaussian processes, and it treats the entries of the graph adjacency matrix as hyperparameters. It utilizes a modified automatic relevance determination (ARD) kernel and allows for learning the mapping function from selected past data to current data as edges of a graph. We show that the resulting adjacency matrix provides the intrinsic structure of the graph and answers causality-related questions. Numerical tests show that the proposed method has comparable or better performance than state-of-the-art methods.

engineering, electrical & electronic
Characterizing the Influence of Topology on Graph Learning Tasks

Kailong Wu,Yule Xie,Jiaxin Ding,Yuxiang Ren,Luoyi Fu,Xinbing Wang,Chenghu Zhou

2024-04-11

Abstract:Graph neural networks (GNN) have achieved remarkable success in a wide range of tasks by encoding features combined with topology to create effective representations. However, the fundamental problem of understanding and analyzing how graph topology influences the performance of learning models on downstream tasks has not yet been well understood. In this paper, we propose a metric, TopoInf, which characterizes the influence of graph topology by measuring the level of compatibility between the topological information of graph data and downstream task objectives. We provide analysis based on the decoupled GNNs on the contextual stochastic block model to demonstrate the effectiveness of the metric. Through extensive experiments, we demonstrate that TopoInf is an effective metric for measuring topological influence on corresponding tasks and can be further leveraged to enhance graph learning.

Machine Learning,Artificial Intelligence
When Does Bottom-up Beat Top-down in Hierarchical Community Detection?

Maximilien Dreveton,Daichi Kuroda,Matthias Grossglauser,Patrick Thiran

2024-07-24

Abstract:Hierarchical clustering of networks consists in finding a tree of communities, such that lower levels of the hierarchy reveal finer-grained community structures. There are two main classes of algorithms tackling this problem. Divisive ($\textit{top-down}$) algorithms recursively partition the nodes into two communities, until a stopping rule indicates that no further split is needed. In contrast, agglomerative ($\textit{bottom-up}$) algorithms first identify the smallest community structure and then repeatedly merge the communities using a $\textit{linkage}$ method. In this article, we establish theoretical guarantees for the recovery of the hierarchical tree and community structure of a Hierarchical Stochastic Block Model by a bottom-up algorithm. We also establish that this bottom-up algorithm attains the information-theoretic threshold for exact recovery at intermediate levels of the hierarchy. Notably, these recovery conditions are less restrictive compared to those existing for top-down algorithms. This shows that bottom-up algorithms extend the feasible region for achieving exact recovery at intermediate levels. Numerical experiments on both synthetic and real data sets confirm the superiority of bottom-up algorithms over top-down algorithms. We also observe that top-down algorithms can produce dendrograms with inversions. These findings contribute to a better understanding of hierarchical clustering techniques and their applications in network analysis.

Social and Information Networks,Machine Learning,Statistics Theory,Methodology
High-Level Parallelism and Nested Features for Dynamic Inference Cost and Top-Down Attention

André Peter Kelm,Niels Hannemann,Bruno Heberle,Lucas Schmidt,Tim Rolff,Christian Wilms,Ehsan Yaghoubi,Simone Frintrop

2024-11-20

Abstract:This paper introduces a novel network topology that seamlessly integrates dynamic inference cost with a top-down attention mechanism, addressing two significant gaps in traditional deep learning models. Drawing inspiration from human perception, we combine sequential processing of generic low-level features with parallelism and nesting of high-level features. This design not only reflects a finding from recent neuroscience research regarding - spatially and contextually distinct neural activations - in human cortex, but also introduces a novel "cutout" technique: the ability to selectively activate %segments of the network for task-relevant only network segments of task-relevant categories to optimize inference cost and eliminate the need for re-training. We believe this paves the way for future network designs that are lightweight and adaptable, making them suitable for a wide range of applications, from compact edge devices to large-scale clouds. Our proposed topology also comes with a built-in top-down attention mechanism, which allows processing to be directly influenced by either enhancing or inhibiting category-specific high-level features, drawing parallels to the selective attention mechanism observed in human cognition. Using targeted external signals, we experimentally enhanced predictions across all tested models. In terms of dynamic inference cost our methodology can achieve an exclusion of up to $73.48\,\%$ of parameters and $84.41\,\%$ fewer giga-multiply-accumulate (GMAC) operations, analysis against comparative baselines show an average reduction of $40\,\%$ in parameters and $8\,\%$ in GMACs across the cases we evaluated.

Computer Vision and Pattern Recognition
Algorithm for the Inference of a Dynamic Topology

Lieguang Zeng

2011-01-01

Abstract:An improved sequential topology inference algorithm was developed to infer an updated network topology for a changed node set.The algorithm first computes the relevancy between the joined node and the receiver nodes with an adaptive threshold used to search for the correct position of the joined node.In the algorithm incorporates the hop count information to reduce the number of search steps.This algorithm can effectively infer the updated network topology and improve the inference accuracy.Simulations show that this algorithm is more effective and more accurate than existing algorithms with the same probes.
A Hierarchical Model for Perception Memory Based on Connected Graph and Dynamic Process

危辉,栾尚敏

2004-01-01

Abstract:One of the interferences between inheritance and concurrency is inheritance anomaly. From the view of cognitive computational neuroscience, a direct information representation method is presented based on neural system dynamics and graphic theory. A group of neurons and their connections representing perceptual information directly and the dynamical behaviors of neurons are defined firstly, and then a two-layer neural network is designed to record characteristics of stimulus and connect a specialized neural circuit that responding to the perception of that stimulus respectively. This could be achieved by the structure learning algorithm. The circuit constituted by neurons in two layers is also served as an associative memory of stimulus whose credibility is decided by the degree of connection of the circuit. The direct representation method is of very significance to the research of semantic representation and inference driven by semantics in artificial intelligence.
Integration and Goal-Guided Scheduling of Bottom-Up and Top-Down Computing Processes in Hierarchical Models

Song-Chun Zhu,Tianfu Wu

2011-01-01

Abstract:Accuracy performance and computational efficiency are two of the most important issues of object detection and parsing in computer vision, and the trade-off between them is usually guided by vision goals. In the literature, to improve accuracy performance, hierarchical models have been widely and successfully used, but often at the expense of increasing the computational burden largely. The explosion of computing costs would practically prevent a computer vision system from scaling to hierarchical models which consist of a large number of nodes. Meanwhile, hierarchical models are studied with zero-one loss used for nodes (i.e., loss cost-insensitive). The goal of this thesis is to present a framework of integrating and scheduling bottom-up (BU) and top-down (TD) computing processes in a recursively defined hierarchical And-Or graph (AoG) to address, with a numerical study, the vision-goal-guided trade-off between accuracy performance and computational efficiency in both loss cost-insensitive and cost-sensitive situations. The BU/TD computing processes consist of three types of processes identified for each node A in an AoG: (i) The α(A) process detects node A directly based on image features: (ii) The β(A) process computes node A by binding its child node(s) bottom-up: and (iii) The γ(A) process predicts node A top-down from its parent node(s). To evaluate their individual information contributions, the three processes are isolated and then trained separately. The learning of the three processes are formulated under the maximum likelihood estimation (MLE) framework. A numerical study of the information contribution is presented with both computer and human experiments. The experimental results show that the three processes contribute to computing node A from images in complementary ways in terms of scale and occlusion conditions. To improve the accuracy performance, the α-β-γ computing processes are integrated by breadth-first search (BFS) in object parsing with AoG formulated under the Bayesian framework. The three processes are explicitly connected to the Bayesian inference and the dynamic programming (DP) implementation. With experiments on human face parsing and hierarchical image structure parsing, the results show performance improvement in the same manner consistent with their evaluated information contributions. Next, to advance computational efficiency of learnt computing processes given allowable bounds on accuracy performance in cost-sensitive object detection, near-optimal decision policies are learnt for computing processes of terminal nodes and And-nodes by minimizing the corresponding risk function which explicitly takes into account the computational cost, the false negative (FN) and false positive (FP) loss costs. Finally, a theoretical study is proposed to schedule all the α-β-γ computing processes in an AoG under the best, firstheuristic search framework to adapt computing orders of nodes in an AoG to different vision tasks and image datasets.
Evaluating Information Contributions of Bottom-Up and Top-Down Processes

Xiong Yang,Tianfu Wu,Song-Chun Zhu

DOI: https://doi.org/10.1109/iccv.2009.5459386

2009-01-01

Abstract:This paper presents a method to quantitatively evaluate information contributions of individual bottom-up and top-down computing processes in object recognition. Our objective is to start a discovery on how to schedule bottom-up and top-down processes. (1) We identify two bottom-up processes and one top-down process in hierarchical models, termed α, β and γ channels respectively ; (2) We formulate the three channels under an unified Bayesian framework; (3) We use a blocking control strategy to isolate the three channels to separately train them and individually measure their information contributions in typical recognition tasks; (4) Based on the evaluated results, we integrate the three channels to detect objects with performance improvements obtained. Our experiments are performed in both low-middle level tasks, such as detecting edges/bars and junctions, and high level tasks, such as detecting human faces and cars, together with a group of human study designed to compare computer and human perception.
Hierarchical Fuzzy Opinion Networks: Top-Down for Social Organizations and Bottom-Up for Election

Li-Xin Wang

DOI: https://doi.org/10.1109/tfuzz.2020.2965864

IF: 12.253

2020-01-01

IEEE Transactions on Fuzzy Systems

Abstract:A fuzzy opinion is a Gaussian fuzzy set with the center representing the opinion and the standard deviation representing the uncertainty about the opinion, and a fuzzy opinion network is a connection of a number of fuzzy opinions in a structured way. In this article, we propose a top–down hierarchical fuzzy opinion network to model how the opinion of a top leader is penetrated into the members in social organizations, and a bottom–up fuzzy opinion network to model how the opinions of a large number of agents are agglomerated layer-by-layer into a consensus or a few opinions in the social processes, such as an election. For the top–down hierarchical fuzzy opinion network, we prove that the opinions of all the agents converge to the leader's opinion but the uncertainties of the agents in different groups are generally converge to different values. We demonstrate that the speed of convergence is greatly improved by organizing the agents in a hierarchical structure of small groups. For the bottom–up hierarchical fuzzy opinion network, we simulate how a wide spectrum of opinions are negotiating and summarizing with each other, in a layer-by-layer fashion in some typical situations.

computer science, artificial intelligence,engineering, electrical & electronic
Computing three-dimensional scene from a single image by bottom-up/top-down bayesian inference

Song-Chun Zhu,Feng Han

2005-01-01

Abstract:It is common experience for human vision to perceive full 3D shape and scene from a single 2D image with the occluded parts "filled-in" by prior visual knowledge. Thus, computing the 3D structures of all the objects in the scene from a single image is a fundamental problem in computer vision. In this thesis, we propose a bottom-up/top-down Bayesian inference framework to compute the 3D structures of objects in the scene from a single image, which integrates the involved visual tasks (segmentation, perceptual grouping, object detection and recognition, 3D reconstruction) in a principled way and incorporates the prior visual knowledge in the inference. The output of the inference framework is a hierarchical "parsing graph" with the scene label at the top (or root), objects with 3D structures and their parts at intermediate nodes, and image pixels at the bottom. The number of layers in this parsing graph is determined by the types of objects or visual patterns. The nodes in this parsing graph correspond to visual patterns represented by probabilistic models. The parsing graph also has both top-down connections and horizontal spatial connections, which correspond to the generative models and spatial relations modeled by Markov Random Field (MRF) respectively. Formulated in Bayesian framework, the inference algorithm computes the parsing graph from the input image by optimizing a posterior probability. In this optimization process, we integrate two popular computing paradigms in computer vision: generative methods, and discriminative methods. The former formulates the posterior probability to maximize in terms of generative models for images defined by likelihood functions and priors. The latter computes discriminative proposals using some bottom-up tests to drive the maximizing process in the solution space. Thus, the inference algorithm achieves both speed and consistency. We also investigate three mechanisms to efficiently construct the parsing graph based on the properties of visual patterns being computed: bottom-up construction mechanism, top-down construction mechanism, and bottom-up/top-down construction mechanism.
Collective Relational Inference for learning heterogeneous interactions

Zhichao Han,Olga Fink,David S. Kammer

2024-01-24

Abstract:Interacting systems are ubiquitous in nature and engineering, ranging from particle dynamics in physics to functionally connected brain regions. These interacting systems can be modeled by graphs where edges correspond to the interactions between interactive entities. Revealing interaction laws is of fundamental importance but also particularly challenging due to underlying configurational complexities. The associated challenges become exacerbated for heterogeneous systems that are prevalent in reality, where multiple interaction types coexist simultaneously and relational inference is required. Here, we propose a novel probabilistic method for relational inference, which possesses two distinctive characteristics compared to existing methods. First, it infers the interaction types of different edges collectively by explicitly encoding the correlation among incoming interactions with a joint distribution, and second, it allows handling systems with variable topological structure over time. We evaluate the proposed methodology across several benchmark datasets and demonstrate that it outperforms existing methods in accurately inferring interaction types. We further show that when combined with known constraints, it allows us, for example, to discover physics-consistent interaction laws of particle systems. Overall the proposed model is data-efficient and generalizable to large systems when trained on smaller ones. The developed methodology constitutes a key element for understanding interacting systems and may find application in graph structure learning.

Machine Learning
Inferring Hierarchical Mixture Structures: A Bayesian Nonparametric Approach

Weipeng Huang,Nishma Laitonjam,Guangyuan Piao,Neil J. Hurley

DOI: https://doi.org/10.1007/978-3-030-75768-7_17

2021-01-01

Abstract:We present a Bayesian Nonparametric model for Hierarchical Clustering (HC). Such a model has two main components. The first component is the random walk process from parent to child in the hierarchy and we apply nested Chinese Restaurant Process (nCRP). Then, the second part is the diffusion process from parent to child where we employ Hierarchical Dirichlet Process Mixture Model (HDPMM). This is different from the common choice which is Gaussian-to-Gaussian. We demonstrate the properties of the model and propose a Markov Chain Monte Carlo procedure with elegantly analytical updating steps for inferring the model variables. Experiments on the real-world datasets show that our method obtains reasonable hierarchies and remarkable empirical results according to some well known metrics.
Human Learning of Hierarchical Graphs

Xiaohuan Xia,Andrei A. Klishin,Jennifer Stiso,Christopher W. Lynn,Ari E. Kahn,Lorenzo Caciagli,Dani S. Bassett

2023-09-06

Abstract:Humans are constantly exposed to sequences of events in the environment. Those sequences frequently evince statistical regularities, such as the probabilities with which one event transitions to another. Collectively, inter-event transition probabilities can be modeled as a graph or network. Many real-world networks are organized hierarchically and understanding how humans learn these networks is an ongoing aim of current investigations. While much is known about how humans learn basic transition graph topology, whether and to what degree humans can learn hierarchical structures in such graphs remains unknown. We investigate how humans learn hierarchical graphs of the Sierpiński family using computer simulations and behavioral laboratory experiments. We probe the mental estimates of transition probabilities via the surprisal effect: a phenomenon in which humans react more slowly to less expected transitions, such as those between communities or modules in the network. Using mean-field predictions and numerical simulations, we show that surprisal effects are stronger for finer-level than coarser-level hierarchical transitions. Surprisal effects at coarser levels of the hierarchy are difficult to detect for limited learning times or in small samples. Using a serial response experiment with human participants (n=$100$), we replicate our predictions by detecting a surprisal effect at the finer-level of the hierarchy but not at the coarser-level of the hierarchy. To further explain our findings, we evaluate the presence of a trade-off in learning, whereby humans who learned the finer-level of the hierarchy better tended to learn the coarser-level worse, and vice versa. Our study elucidates the processes by which humans learn hierarchical sequential events. Our work charts a road map for future investigation of the neural underpinnings and behavioral manifestations of graph learning.

Neurons and Cognition,Statistical Mechanics,Biological Physics,Physics and Society
Inference of Causal Networks using a Topological Threshold

Filipe Barroso,Diogo Gomes,Gareth J. Baxter

2024-04-22

Abstract:We propose a constraint-based algorithm, which automatically determines causal relevance thresholds, to infer causal networks from data. We call these topological thresholds. We present two methods for determining the threshold: the first seeks a set of edges that leaves no disconnected nodes in the network; the second seeks a causal large connected component in the data.

Machine Learning,Methodology

A Numerical Study of the Bottom-Up and Top-Down Inference Processes in And-Or Graphs

A Numerical Study of the Bottom-Up and Top-Down Inference Processes in And-Or Graphs.

Variational Inference over Graph: Knowledge Representation for Deep Process Data Analytics

Geometric and Topological Inference for Deep Representations of Complex Networks

Hierarchical Bayesian Network Modeling Framework for Large-Scale Process Monitoring and Decision Making.

Interpreting Bottom-Up Decision-Making of CNNs via Hierarchical Inference

Hierarchical Parameter Estimation of GRN Based on Topological Analysis

Topology Inference of Directed Graphs by Gaussian Processes with Sparsity Constraints

Characterizing the Influence of Topology on Graph Learning Tasks

When Does Bottom-up Beat Top-down in Hierarchical Community Detection?

High-Level Parallelism and Nested Features for Dynamic Inference Cost and Top-Down Attention

Algorithm for the Inference of a Dynamic Topology

A Hierarchical Model for Perception Memory Based on Connected Graph and Dynamic Process

Integration and Goal-Guided Scheduling of Bottom-Up and Top-Down Computing Processes in Hierarchical Models

Evaluating Information Contributions of Bottom-Up and Top-Down Processes

Hierarchical Fuzzy Opinion Networks: Top-Down for Social Organizations and Bottom-Up for Election

Computing three-dimensional scene from a single image by bottom-up/top-down bayesian inference

Collective Relational Inference for learning heterogeneous interactions

Inferring Hierarchical Mixture Structures: A Bayesian Nonparametric Approach

Human Learning of Hierarchical Graphs

Inference of Causal Networks using a Topological Threshold