Decomposition of structural learning about directed acyclic graphs

XieXianchao,GengZhi,ZhaoQiang

DOI: https://doi.org/10.5555/1644517.1644678

IF: 14.4

2006-01-01

Artificial Intelligence

Abstract:In this paper, we propose that structural learning of a directed acyclic graph can be decomposed into problems related to its decomposed subgraphs. The decomposition of structural learning requires...

What problem does this paper attempt to address?

Decomposition of Structural Learning about Directed Acyclic Graphs

XC Xie,Z Geng,Q Zhao

DOI: https://doi.org/10.1016/j.artint.2005.12.004

IF: 14.4

2006-01-01

Artificial Intelligence

Abstract:In this paper, we propose that structural learning of a directed acyclic graph can be decomposed into problems related to its decomposed subgraphs. The decomposition of structural learning requires conditional independencies, but it does not require that separators are complete undirected subgraphs. Domain or prior knowledge of conditional independencies can be utilized to facilitate the decomposition of structural learning. By decomposition, search for d-separators in a large network is localized to small subnetworks. Thus both the efficiency of structural learning and the power of conditional independence tests can be improved.
A Recursive Method for Structural Learning of Directed Acyclic Graphs

X. H. Xie,Zhi Geng

2008-01-01

Journal of Machine Learning Research

Abstract:In this paper, we propose a recursive method for structural learning of directed acyclic graphs (DAGs), in which a problem of structural learning for a large DAG is first decomposed into two problems of structural learning for two small vertex subsets, each of which is then decomposed recursively into two problems of smaller subsets until none subset can be decomposed further. In our approach, search for separators of a pair of variables in a large DAG is localized to small subsets, and thus the approach can improve the efficiency of searches and the power of statistical tests for structural learning. We show how the recent advances in the learning of undirected graphical models can be employed to facilitate the decomposition. Simulations are given to demonstrate the performance of the proposed method.
Structural Learning Of Chain Graphs Via Decomposition

Zongming Ma,Xianchao Xie,Zhi Geng

2008-01-01

Journal of Machine Learning Research

Abstract:Chain graphs present a broad class of graphical models for description of conditional independence structures, including both Markov networks and Bayesian networks as special cases. In this paper, we propose a computationally feasible method for the structural learning of chain graphs based on the idea of decomposing the learning problem into a set of smaller scale problems on its decomposed subgraphs. The decomposition requires conditional independencies but does not require the separators to be complete subgraphs. Algorithms for both skeleton recovery and complex arrow orientation are presented. Simulations under a variety of settings demonstrate the competitive performance of our method, especially when the underlying graph is sparse.
Decomposition of search for v-structures in DAGs

Zhi Geng,Chi Wang,Qiang Zhao

DOI: https://doi.org/10.1016/j.jmva.2004.10.012

IF: 1.387

2005-01-01

Journal of Multivariate Analysis

Abstract:We show that the problem of searching for v-structures in a directed acyclic graph can be decomposed into searches in its decomposed subgraphs. This result simplifies the search for v-structures and the recovery of local causal relationships.
Structural learning about directed acyclic graphs from multiple databases

Qiang Zhao

DOI: https://doi.org/10.1155/2012/579543

2012-01-01

Abstract and Applied Analysis

Abstract:We propose an approach for structural learning of directed acyclic graphs from multiple databases. We first learn a local structure from each database separately, and then we combine these local structures together to construct a global graph over all variables. In our approach, we do not require conditional independence, which is a basic assumption in most methods. © 2012 Qiang Zhao.
Directed Acyclic Graph Structure Learning from Dynamic Graphs

Shaohua Fan,Shuyang Zhang,Xiao Wang,Chuan Shi

DOI: https://doi.org/10.1609/aaai.v37i6.25913

2023-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Estimating the structure of directed acyclic graphs (DAGs) of features (variables) plays a vital role in revealing the latent data generation process and providing causal insights in various applications. Although there have been many studies on structure learning with various types of data, the structure learning on the dynamic graph has not been explored yet, and thus we study the learning problem of node feature generation mechanism on such ubiquitous dynamic graph data. In a dynamic graph, we propose to simultaneously estimate contemporaneous relationships and time-lagged interaction relationships between the node features. These two kinds of relationships form a DAG, which could effectively characterize the feature generation process in a concise way. To learn such a DAG, we cast the learning problem as a continuous score-based optimization problem, which consists of a differentiable score function to measure the validity of the learned DAGs and a smooth acyclicity constraint to ensure the acyclicity of the learned DAGs. These two components are translated into an unconstraint augmented Lagrangian objective which could be minimized by mature continuous optimization techniques. The resulting algorithm, named GraphNOTEARS, outperforms baselines on simulated data across a wide range of settings that may encounter in real-world applications. We also apply the proposed approach on two dynamic graphs constructed from the real-world Yelp dataset, demonstrating our method could learn the connections between node features, which conforms with the domain knowledge.
Structural Learning About Independence Graphs From Multiple Databases

Qiang Zhao,Hua Chen,Zhi Geng

DOI: https://doi.org/10.1007/978-3-540-71701-0_127

2007-01-01

Abstract:In this paper, we propose an approach for structural learning of independence graphs from multiple databases or prior knowledge of conditional independencies. In our approach, we first learn a local graph from each database separately, and then we combine these local graphs together to construct a global graph over all variables. This approach can also be used in structural learning to utilize the prior knowledge of conditional independencies.
A LAYER-DECOMPOSITION WITH DEGREE METHOD FOR SUBGRAPHS RECOGNITION PROBLEM

YF Xu

DOI: https://doi.org/10.11650/twjm/1500407526

2003-01-01

Taiwanese Journal of Mathematics

Abstract:For two planar undirected graphs $G$ and $H$, the {\it subgraphs recognition problem} (SRP) is to find and list all subgraphs of $G$ which are isomorphic to $H$. In this paper, we introduce the idea of layer-decomposition with degree and present an algorithm based on this idea for SRP. Since subgraphs isomorphic to each other contain their spanning trees with the same decomposition, the SRP can be decomposed into two subproblems: First, find subtrees of $G$ which have the same layer-decomposition as that of $H$. Then, test whether the induced subgraphs generated by these subtrees are isomorphic to $H$. By this scheme, we greatly decrease the complexity to $O(n(\Delta-1)^{k-1}k^2)$, where $\Delta$ is the degree of $G$ and $n, k$ are the orders of $G, H$ respectively.
Structured Decompositions: Structural and Algorithmic Compositionality

Benjamin Merlin Bumpus,Zoltan A. Kocsis,Jade Edenstar Master

2024-09-10

Abstract:We introduce structured decompositions. These are category-theoretic data structures which simlutaneously generalize notions from graph theory (including tree-width, layered tree-width, co-tree-width and graph decomposition width) geometric group theory (specifically Bass-Serre theory) and dynamical systems (e.g. hybrid dynamical systems). Furthermore, structured decompositions allow us to generalize these aforementioned combinatorial invariants, which have played a central role in the study of structural and algorithmic compositionality in both graph theory and parameterized complexity, to new settings. For example, in any category with enough colimits they describe algorithmically useful structural compositionality: as an application of our theory we prove an algorithmic meta-theorem for the Sub_P-composition problem. In concrete terms, when instantiated in the category of graphs, this meta-theorem yields compositional algorithms for NP-hard problems such as: Maximum Bipartite Subgraph, Maximum Planar Subgraph and Longest Path.

Category Theory,Data Structures and Algorithms,Combinatorics
Structural Learning of Causal Networks

Yangbo He,Jinzhu Jia,Zhi Geng

DOI: https://doi.org/10.1007/s41237-017-0018-8

2017-01-01

Behaviormetrika

Abstract:Causal network models are popular statistical tools to represent dependencies or causal relationships among variables in complex systems. Structural learning of causal networks is crucial to discover the causal knowledge and to infer casual effects. In this paper, we discuss structural learning of two types of graphical models, undirected graphs and directed acyclic graphs. We first introduce the methods for learning undirected graphical models. Then we discuss structural learning of directed acyclic graphs. We focus on the issues on model space of causal networks, decomposition learning of structures from observational data, local structural learning approaches and the active learning for optimal designs of intervention.
Towards Unsupervised Deep Graph Structure Learning

Yixin Liu,Yu Zheng,Daokun Zhang,Hongxu Chen,Hao Peng,Shirui Pan

DOI: https://doi.org/10.48550/arXiv.2201.06367

2022-01-17

Abstract:In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures; besides, the dependence on explicit structures prevents GNNs from being applied to general unstructured scenarios. To address these issues, recently emerged deep graph structure learning (GSL) methods propose to jointly optimize the graph structure along with GNN under the supervision of a node classification task. Nonetheless, these methods focus on a supervised learning scenario, which leads to several problems, i.e., the reliance on labels, the bias of edge distribution, and the limitation on application tasks. In this paper, we propose a more practical GSL paradigm, unsupervised graph structure learning, where the learned graph topology is optimized by data itself without any external guidance (i.e., labels). To solve the unsupervised GSL problem, we propose a novel StrUcture Bootstrapping contrastive LearnIng fraMEwork (SUBLIME for abbreviation) with the aid of self-supervised contrastive learning. Specifically, we generate a learning target from the original data as an "anchor graph", and use a contrastive loss to maximize the agreement between the anchor graph and the learned graph. To provide persistent guidance, we design a novel bootstrapping mechanism that upgrades the anchor graph with learned structures during model learning. We also design a series of graph learners and post-processing schemes to model the structures to learn. Extensive experiments on eight benchmark datasets demonstrate the significant effectiveness of our proposed SUBLIME and high quality of the optimized graphs.

Machine Learning
Structural Landmarking and Interaction Modelling: on Resolution Dilemmas in Graph Classification

Kai Zhang,Yaokang Zhu,Jun Wang,Jie Zhang,Hongyuan Zha

DOI: https://doi.org/10.48550/arXiv.2006.15763

2020-06-29

Abstract:Graph neural networks are promising architecture for learning and inference with graph-structured data. Yet difficulties in modelling the ``parts'' and their ``interactions'' still persist in terms of graph classification, where graph-level representations are usually obtained by squeezing the whole graph into a single vector through graph pooling. From complex systems point of view, mixing all the parts of a system together can affect both model interpretability and predictive performance, because properties of a complex system arise largely from the interaction among its components. We analyze the intrinsic difficulty in graph classification under the unified concept of ``resolution dilemmas'' with learning theoretic recovery guarantees, and propose ``SLIM'', an inductive neural network model for Structural Landmarking and Interaction Modelling. It turns out, that by solving the resolution dilemmas, and leveraging explicit interacting relation between component parts of a graph to explain its complexity, SLIM is more interpretable, accurate, and offers new insight in graph representation learning.

Machine Learning
A Survey on Graph Structure Learning: Progress and Opportunities

Yanqiao Zhu,Weizhi Xu,Jinghao Zhang,Yuanqi Du,Jieyu Zhang,Qiang Liu,Carl Yang,Shu Wu

DOI: https://doi.org/10.48550/arXiv.2103.03036

IF: 5.414

2021-03-04

Machine Learning

Abstract:Graphs are widely used to describe real-world objects and their interactions. Graph Neural Networks (GNNs) as a de facto model for analyzing graphstructured data, are highly sensitive to the quality of the given graph structures. Therefore, noisy or incomplete graphs often lead to unsatisfactory representations and prevent us from fully understanding the mechanism underlying the system. In pursuit of an optimal graph structure for downstream tasks, recent studies have sparked an effort around the central theme of Graph Structure Learning (GSL), which aims to jointly learn an optimized graph structure and corresponding graph representations. In the presented survey, we broadly review recent progress in GSL methods. Specifically, we first formulate a general pipeline of GSL and review state-of-the-art methods classified by the way of modeling graph structures, followed by applications of GSL across domains. Finally, we point out some issues in current studies and discuss future directions.
Non-negative Weighted DAG Structure Learning

Samuel Rey,Seyed Saman Saboksayr,Gonzalo Mateos

2024-09-12

Abstract:We address the problem of learning the topology of directed acyclic graphs (DAGs) from nodal observations, which adhere to a linear structural equation model. Recent advances framed the combinatorial DAG structure learning task as a continuous optimization problem, yet existing methods must contend with the complexities of non-convex optimization. To overcome this limitation, we assume that the latent DAG contains only non-negative edge weights. Leveraging this additional structure, we argue that cycles can be effectively characterized (and prevented) using a convex acyclicity function based on the log-determinant of the adjacency matrix. This convexity allows us to relax the task of learning the non-negative weighted DAG as an abstract convex optimization problem. We propose a DAG recovery algorithm based on the method of multipliers, that is guaranteed to return a global minimizer. Furthermore, we prove that in the infinite sample size regime, the convexity of our approach ensures the recovery of the true DAG structure. We empirically validate the performance of our algorithm in several reproducible synthetic-data test cases, showing that it outperforms state-of-the-art alternatives.

Machine Learning,Signal Processing
Structural Entropy Based Graph Structure Learning for Node Classification

Liang Duan,Xiang Chen,Wenjie Liu,Daliang Liu,Kun Yue,Angsheng Li

DOI: https://doi.org/10.1609/aaai.v38i8.28679

2024-01-01

Abstract:As one of the most common tasks in graph data analysis, node classification is frequently solved by using graph structure learning (GSL) techniques to optimize graph structures and learn suitable graph neural networks. Most of the existing GSL methods focus on fusing different structural features (basic views) extracted from the graph, but very little graph semantics, like hierarchical communities, has been incorporated. Thus, they might be insufficient when dealing with the graphs containing noises from real-world complex systems. To address this issue, we propose a novel and effective GSL framework for node classification based on the structural information theory. Specifically, we first prove that an encoding tree with the minimal structural entropy could contain sufficient information for node classification and eliminate redundant noise via the graph's hierarchical abstraction. Then, we provide an efficient algorithm for constructing the encoding tree to enhance the basic views. Combining the community influence deduced from the encoding tree and the prediction confidence of each view, we further fuse the enhanced views to generate the optimal structure. Finally, we conduct extensive experiments on a variety of datasets. The results demonstrate that our method outperforms the state-of-the-art competitors on effectiveness and robustness.
Distributed D-core Decomposition over Large Directed Graphs

Xuankun Liao,Qing Liu,Jiaxin Jiang,Xin Huang,Jianliang Xu,Byron Choi

DOI: https://doi.org/10.14778/3529337.3529340

IF: 2.5

2022-01-01

Proceedings of the VLDB Endowment

Abstract:Given a directed graph G and integers k and l. a D-core is the maximal subgraph H subset of G such that for every vertex of H, its in-degree and out-degree are no smaller than k and l, respectively. For a directed graph G, the problem of D-core decomposition aims to compute the non-empty D-cores for all possible values of k and l. In the literature, several peeling-based algorithms have been proposed to handle D-core decomposition. However, the peeling-based algorithms that work in a sequential fashion and require global graph information during processing are mainly designed for centralized settings, which cannot handle large-scale graphs efficiently in distributed settings. Motivated by this, we study the distributed D-core decomposition problem in this paper. We start by defining a concept called anchored coreness, based on which we propose a new H-index-based algorithm for distributed D-core decomposition. Furthermore, we devise a novel concept, namely skyline coreness, and show that the D-core decomposition problem is equivalent to the computation of skyline corenesses for all vertices. We design an efficient D-index to compute the skyline corenesses distributedly. We implement the proposed algorithms under both vertex-centric and block-centric distributed graph processing frameworks. Moreover, we theoretically analyze the algorithm and message complexities. Extensive experiments on large real-world graphs with billions of edges demonstrate the efficiency of the proposed algorithms in terms of both the running time and communication overhead.
SE-GSL: A General and Effective Graph Structure Learning Framework Through Structural Entropy Optimization

Dongcheng Zou,Hao Peng,Xiang Huang,Renyu Yang,Jianxin Li,Jia Wu,Chunyang Liu,Philip S. Yu

DOI: https://doi.org/10.1145/3543507.3583453

2023-01-01

Abstract:Graph Neural Networks (GNNs) are de facto solutions to structural data learning. However, it is susceptible to low-quality and unreliable structure, which has been a norm rather than an exception in real-world graphs. Existing graph structure learning (GSL) frameworks still lack robustness and interpretability. This paper proposes a general GSL framework, SE-GSL, through structural entropy and the graph hierarchy abstracted in the encoding tree. Particularly, we exploit the one-dimensional structural entropy to maximize embedded information content when auxiliary neighbourhood attributes is fused to enhance the original graph. A new scheme of constructing optimal encoding trees are proposed to minimize the uncertainty and noises in the graph whilst assuring proper community partition in hierarchical abstraction. We present a novel sample-based mechanism for restoring the graph structure via node structural entropy distribution. It increases the connectivity among nodes with larger uncertainty in lower-level communities. SE-GSL is compatible with various GNN models and enhances the robustness towards noisy and heterophily structures. Extensive experiments show significant improvements in the effectiveness and robustness of structure learning and node representation learning.
Learning DAGs without imposing acyclicity

Gherardo Varando

DOI: https://doi.org/10.48550/arXiv.2006.03005

2020-06-05

Abstract:We explore if it is possible to learn a directed acyclic graph (DAG) from data without imposing explicitly the acyclicity constraint. In particular, for Gaussian distributions, we frame structural learning as a sparse matrix factorization problem and we empirically show that solving an $\ell_1$-penalized optimization yields to good recovery of the true graph and, in general, to almost-DAG graphs. Moreover, this approach is computationally efficient and is not affected by the explosion of combinatorial complexity as in classical structural learning algorithms.

Machine Learning,Computation
DeGNN: Improving Graph Neural Networks with Graph Decomposition

Xupeng Miao,Nezihe Merve Gürel,Wentao Zhang,Zhichao Han,Bo Li,wei min,Susie Xi Susie Rao,Hansheng Ren,Yinan Shan,Yingxia Shao,Yujie Wang,Fan Wu,HUI XUE,Yaming Yang,Zitao Zhang,Yang Zhao,Shuai Zhang,Yujing Wang,Bin Cui,Ce Zhang

DOI: https://doi.org/10.1145/3447548.3467312

2021-01-01

Abstract:ABSTRACTMining from graph-structured data is an integral component of graph data management. A recent trending technique, graph convolutional network (GCN), has gained momentum in the graph mining field, and plays an essential part in numerous graph-related tasks. Although the emerging GCN optimization techniques bring improvements to specific scenarios, they perform diversely in different applications and introduce many trial-and-error costs for practitioners. Moreover, existing GCN models often suffer from oversmoothing problem. Besides, the entanglement of various graph patterns could lead to non-robustness and harm the final performance of GCNs. In this work, we propose a simple yet efficient graph decomposition approach to improve the performance of general graph neural networks. We first empirically study existing graph decomposition methods and propose an automatic connectivity-ware graph decomposition algorithm, DeGNN. To provide a theoretical explanation, we then characterize GCN from the information-theoretic perspective and show that under certain conditions, the mutual information between the output after l layers and the input of GCN converges to 0 exponentially with respect to l. On the other hand, we show that graph decomposition can potentially weaken the condition of such convergence rate, alleviating the information loss when GCN becomes deeper. Extensive experiments on various academic benchmarks and real-world production datasets demonstrate that graph decomposition generally boosts the performance of GNN models. Moreover, our proposed solution DeGNN achieves state-of-the-art performances on almost all these tasks.
A Graph Based Approach To Design Decomposition

B Yuan,Jg Sun

1999-01-01

Abstract:This paper proposes a new graph based decomposing approach: C-R approach by using two graph operations. clipping and reducing. The clipping operation is used to identify the geometric elements those can be removed ahead, while the reducing operation is used to identify the geometric elements those can be combined into a rigid body. With the two operations applied alternatively, the C-R approach can deal with the decomposition of under-, well- and over-constrained design systems, especially of the highly sparse under-constrained design systems.

Decomposition of structural learning about directed acyclic graphs

Decomposition of Structural Learning about Directed Acyclic Graphs

A Recursive Method for Structural Learning of Directed Acyclic Graphs

Structural Learning Of Chain Graphs Via Decomposition

Decomposition of search for v-structures in DAGs

Structural learning about directed acyclic graphs from multiple databases

Directed Acyclic Graph Structure Learning from Dynamic Graphs

Structural Learning About Independence Graphs From Multiple Databases

A LAYER-DECOMPOSITION WITH DEGREE METHOD FOR SUBGRAPHS RECOGNITION PROBLEM

Structured Decompositions: Structural and Algorithmic Compositionality

Structural Learning of Causal Networks

Towards Unsupervised Deep Graph Structure Learning

Structural Landmarking and Interaction Modelling: on Resolution Dilemmas in Graph Classification

A Survey on Graph Structure Learning: Progress and Opportunities

Non-negative Weighted DAG Structure Learning

Structural Entropy Based Graph Structure Learning for Node Classification

Distributed D-core Decomposition over Large Directed Graphs

SE-GSL: A General and Effective Graph Structure Learning Framework Through Structural Entropy Optimization

Learning DAGs without imposing acyclicity

DeGNN: Improving Graph Neural Networks with Graph Decomposition

A Graph Based Approach To Design Decomposition