[Diagnosis, course and treatment of plugged ulcer perforations or perforations in the septate peritoneum].

J. Alexandre

Abstract:

What problem does this paper attempt to address?

DAG-GAN: Causal Structure Learning with Generative Adversarial Nets

Yinghua Gao,Li Shen,Shu-Tao Xia

DOI: https://doi.org/10.1109/icassp39728.2021.9414770

2021-01-01

Abstract:Learning Directed Acyclic Graph (DAG) from purely observational data is a critical problem for causal inference. Most existing works tackle this problem by exploring gradient-based learning methods with a smooth characterization of acyclicity. A major shortcoming of current gradient based works is that they independently optimize SEMs with a single sample and neglect the interactions between different samples. In this paper, we consider DAG structure learning from the perspective of distributional optimization and design an adversarial framework named DAG-GAN to detect the DAG structure from data. We theoretically analyze the Nash equilibrium property of DAG-GAN and propose a novel score function to exploit the interactions between different samples. In addition, extensive experiments are conducted to validate the efficiency of DAG-GAN against several state-of-the-art DAG learning methods.
Idag: Invariant DAG Searching for Domain Generalization

Zenan Huang,Haobo Wang,Junbo Zhao,Nenggan Zheng

DOI: https://doi.org/10.1109/iccv51070.2023.01756

2023-01-01

Abstract:Existing machine learning (ML) models are often fragile in open environments because the data distribution frequently shifts. To address this problem, domain generalization (DG) aims to explore underlying invariant patterns for stable prediction across domains. In this work, we first characterize that this failure of conventional ML models in DG attributes to an inadequate identification of causal structures. We further propose a novel invariant Directed Acyclic Graph (dubbed iDAG) searching framework that attains an invariant graphical relation as the proxy to the causality structure from the intrinsic data-generating process. To enable tractable computation, iDAG solves a constrained optimization objective built on a set of representative class-conditional prototypes. Additionally, we integrate a hierarchical contrastive learning module, which poses a strong effect of clustering, for enhanced prototypes as well as stabler prediction. Extensive experiments on the synthetic and real-world benchmarks demonstrate that iDAG outperforms the state-of-the-art approaches, verifying the superiority of causal structure identification for DG. The code of iDAG is available at https://github.com/lccurious/iDAG.
Scalable and Flexible Causal Discovery with an Efficient Test for Adjacency

Alan Nawzad Amin,Andrew Gordon Wilson

2024-06-18

Abstract:To make accurate predictions, understand mechanisms, and design interventions in systems of many variables, we wish to learn causal graphs from large scale data. Unfortunately the space of all possible causal graphs is enormous so scalably and accurately searching for the best fit to the data is a challenge. In principle we could substantially decrease the search space, or learn the graph entirely, by testing the conditional independence of variables. However, deciding if two variables are adjacent in a causal graph may require an exponential number of tests. Here we build a scalable and flexible method to evaluate if two variables are adjacent in a causal graph, the Differentiable Adjacency Test (DAT). DAT replaces an exponential number of tests with a provably equivalent relaxed problem. It then solves this problem by training two neural networks. We build a graph learning method based on DAT, DAT-Graph, that can also learn from data with interventions. DAT-Graph can learn graphs of 1000 variables with state of the art accuracy. Using the graph learned by DAT-Graph, we also build models that make much more accurate predictions of the effects of interventions on large scale RNA sequencing data.

Machine Learning
DAG-GNN: DAG Structure Learning with Graph Neural Networks

Yue Yu,Jie Chen,Tian Gao,Mo Yu

DOI: https://doi.org/10.48550/arXiv.1904.10098

IF: 5.414

2019-04-22

Machine Learning

Abstract:Learning a faithful directed acyclic graph (DAG) from samples of a joint distribution is a challenging combinatorial problem, owing to the intractable search space superexponential in the number of graph nodes. A recent breakthrough formulates the problem as a continuous optimization with a structural constraint that ensures acyclicity (Zheng et al., 2018). The authors apply the approach to the linear structural equation model (SEM) and the least-squares loss function that are statistically well justified but nevertheless limited. Motivated by the widespread success of deep learning that is capable of capturing complex nonlinear mappings, in this work we propose a deep generative model and apply a variant of the structural constraint to learn the DAG. At the heart of the generative model is a variational autoencoder parameterized by a novel graph neural network architecture, which we coin DAG-GNN. In addition to the richer capacity, an advantage of the proposed model is that it naturally handles discrete variables as well as vector-valued ones. We demonstrate that on synthetic data sets, the proposed method learns more accurate graphs for nonlinearly generated samples; and on benchmark data sets with discrete variables, the learned graphs are reasonably close to the global optima. The code is available at \url{https://github.com/fishmoon1234/DAG-GNN}.
Directed Acyclic Graphs With Tears

Zhichao Chen,Zhiqiang Ge

DOI: https://doi.org/10.1109/tai.2022.3181115

2022-01-01

IEEE Transactions on Artificial Intelligence

Abstract: Bayesian network is a frequently-used method for fault detection and diagnosis in industrial processes. The basis of Bayesian network is structure learning which learns a directed acyclic graph (DAG) from data. However, the search space will scale super-exponentially with the increase of process variables, which makes the data-driven structure learning a challenging problem. To this end, the DAGs with NOTEARs methods are being well studied not only for their conversion of the discrete optimization into continuous optimization problem but also their compatibility with deep learning framework. Nevertheless, there still remain challenges for NOTEAR-based methods: 1) the infeasible solution results from the gradient descent-based optimization paradigm; 2) the truncation operation to promise the learned graph acyclic. In this work, the reason for challenge 1) is analyzed theoretically, and a novel method named DAGs with Tears method is proposed based on mix-integer programming to alleviate challenge 2). In addition, prior knowledge is able to incorporate into the new proposed method, making structure learning more practical and useful in industrial processes. Finally, a numerical example and an industrial example are adopted as case studies to demonstrate the superiority of the developed method.
GraphTTA: Test Time Adaptation on Graph Neural Networks

Guanzi Chen,Jiying Zhang,Xi Xiao,Yang Li

DOI: https://doi.org/10.48550/arXiv.2208.09126

2022-08-19

Abstract:Recently, test time adaptation (TTA) has attracted increasing attention due to its power of handling the distribution shift issue in the real world. Unlike what has been developed for convolutional neural networks (CNNs) for image data, TTA is less explored for Graph Neural Networks (GNNs). There is still a lack of efficient algorithms tailored for graphs with irregular structures. In this paper, we present a novel test time adaptation strategy named Graph Adversarial Pseudo Group Contrast (GAPGC), for graph neural networks TTA, to better adapt to the Out Of Distribution (OOD) test data. Specifically, GAPGC employs a contrastive learning variant as a self-supervised task during TTA, equipped with Adversarial Learnable Augmenter and Group Pseudo-Positive Samples to enhance the relevance between the self-supervised task and the main task, boosting the performance of the main task. Furthermore, we provide theoretical evidence that GAPGC can extract minimal sufficient information for the main task from information theory perspective. Extensive experiments on molecular scaffold OOD dataset demonstrated that the proposed approach achieves state-of-the-art performance on GNNs.

Machine Learning
Deep Learning With DAGs

Sourabh Balgi,Adel Daoud,Jose M. Peña,Geoffrey T. Wodtke,Jesse Zhou

2024-01-13

Abstract:Social science theories often postulate causal relationships among a set of variables or events. Although directed acyclic graphs (DAGs) are increasingly used to represent these theories, their full potential has not yet been realized in practice. As non-parametric causal models, DAGs require no assumptions about the functional form of the hypothesized relationships. Nevertheless, to simplify the task of empirical evaluation, researchers tend to invoke such assumptions anyway, even though they are typically arbitrary and do not reflect any theoretical content or prior knowledge. Moreover, functional form assumptions can engender bias, whenever they fail to accurately capture the complexity of the causal system under investigation. In this article, we introduce causal-graphical normalizing flows (cGNFs), a novel approach to causal inference that leverages deep neural networks to empirically evaluate theories represented as DAGs. Unlike conventional approaches, cGNFs model the full joint distribution of the data according to a DAG supplied by the analyst, without relying on stringent assumptions about functional form. In this way, the method allows for flexible, semi-parametric estimation of any causal estimand that can be identified from the DAG, including total effects, conditional effects, direct and indirect effects, and path-specific effects. We illustrate the method with a reanalysis of Blau and Duncan's (1967) model of status attainment and Zhou's (2019) model of conditional versus controlled mobility. To facilitate adoption, we provide open-source software together with a series of online tutorials for implementing cGNFs. The article concludes with a discussion of current limitations and directions for future development.

Machine Learning,Econometrics,Methodology
Guided structure learning of DAGs for count data

Thi Kim Hue Nguyen,Monica Chiogna,Davide Risso,Erika Banzato

DOI: https://doi.org/10.1177/1471082x241266738

2024-10-12

Statistical Modelling

Abstract:Statistical Modelling, Ahead of Print. In this paper, we tackle structure learning of directed acyclic graphs (DAGs), with the idea of exploiting available prior knowledge of the domain at hand to guide the search of the best structure. In particular, we assume to know the topological ordering of variables in addition to the given data. We study a new algorithm for learning the structure of DAGs, proving its theoretical consistency in the limit of infinite observations. Furthermore, we experimentally compare the proposed algorithm to several popular competitors, to study its behaviour in finite samples. Biological validation of the algorithm is presented through the analysis of non-small cell lung cancer data.

statistics & probability
Directed Acyclic Graph Learning on Attributed Heterogeneous Network

Jiaxuan Liang,Jun Wang,Guoxian Yu,Wei Guo,Carlotta Domeniconi,Maozu Guo

DOI: https://doi.org/10.1109/tkde.2023.3266453

IF: 9.235

2023-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Learning the directed acyclic graph (DAG) among causal variables is a fundamental pre-task in causal discovery. Available DAG learning solutions canonically focus on homogeneous nodes with multiple variables and assume i.i.d. samples, how to learn DAG on typical attributed heterogeneous network (AHN) composed with different types of inter-dependent nodes and diverse attributes is a practical but more difficult task. In this paper, we propose HetDAG to identify DAG among nodes from heterogeneous network. HetDAG first embeds different types of node attributes and aggregates these embeddings as the node's raw representation. Then it uses contrastive learning with prior network structure to explore latent relationships between nodes and update the representation. Next, HetDAG introduces an attention-based DAG learning module that takes node representations as input to search DAG and orient edges between nodes. To the best of our knowledge, HetDAG is the first study to learn DAG on heterogeneous networks. Extensive experiments on both semi-synthetic and real data show that HetDAG can learn DAG in an efficacy way and outperforms the state-of-the-art approaches. The results on real biological networks confirm that HetDAG can find out the causal relations between lncRNAs and miRNAs.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
A Sampling-Based Framework for Hypothesis Testing on Large Attributed Graphs

Yun Wang,Chrysanthi Kosyfaki,Sihem Amer-Yahia,Reynold Cheng

DOI: https://doi.org/10.14778/3681954.3681993

IF: 2.5

2024-07-01

Proceedings of the VLDB Endowment

Abstract:Hypothesis testing is a statistical method used to draw conclusions about populations from sample data, typically represented in tables. With the prevalence of graph representations in real-life applications, hypothesis testing on graphs is gaining importance. In this work, we formalize node, edge, and path hypotheses on attributed graphs. We develop a sampling-based hypothesis testing framework, which can accommodate existing hypothesis-agnostic graph sampling methods. To achieve accurate and time-efficient sampling, we then propose a Path-Hypothesis-Aware SamplEr, PHASE, an m -dimensional random walk that accounts for the paths specified in the hypothesis. We further optimize its time efficiency and propose PHASE opt . Experiments on three real datasets demonstrate the ability of our framework to leverage common graph sampling methods for hypothesis testing, and the superiority of hypothesis-aware sampling methods in terms of accuracy and time efficiency.

computer science, information systems, theory & methods
A Semiparametric Two-Sample Hypothesis Testing Problem for Random Graphs

Minh Tang,Avanti Athreya,Daniel L. Sussman,Vince Lyzinski,Youngser Park,Carey E. Priebe

DOI: https://doi.org/10.1080/10618600.2016.1193505

2017-04-03

Journal of Computational and Graphical Statistics

Abstract:Two-sample hypothesis testing for random graphs arises naturally in neuroscience, social networks, and machine learning. In this article, we consider a semiparametric problem of two-sample hypothesis testing for a class of latent position random graphs. We formulate a notion of consistency in this context and propose a valid test for the hypothesis that two finite-dimensional random dot product graphs on a common vertex set have the same generating latent positions or have generating latent positions that are scaled or diagonal transformations of one another. Our test statistic is a function of a spectral decomposition of the adjacency matrix for each graph and our test procedure is consistent across a broad range of alternatives. We apply our test procedure to real biological data: in a test-retest dataset of neural connectome graphs, we are able to distinguish between scans from different subjects; and in the C. elegans connectome, we are able to distinguish between chemical and electrical networks. The latter example is a concrete demonstration that our test can have power even for small-sample sizes. We conclude by discussing the relationship between our test procedure and generalized likelihood ratio tests. Supplementary materials for this article are available online.

statistics & probability
Two-sample testing for random graphs

Xiaoyi Wen

DOI: https://doi.org/10.1002/sam.11703

2024-06-27

Abstract:The employment of two‐sample hypothesis testing in examining random graphs has been a prevalent approach in diverse fields such as social sciences, neuroscience, and genetics. We advance a spectral‐based two‐sample hypothesis testing methodology to test the latent position random graphs. We propose two distinct asymptotic normal statistics, each optimally designed for two different models—the elementary Erdős–Rényi model and the more complex latent position random graph model. For the latter, the spectral embedding of the adjacency matrix was utilized to estimate the test statistic. The proposed method exhibited superior efficacy as it accomplished higher power than the conventional method of mean estimation. To validate our hypothesis testing procedure, we applied it to empirical biological data to discern structural variances in gene co‐expression networks between COVID‐19 patients and individuals who remained unaffected by the disease.

Mathematics,Computer Science
Causal Structural Hypothesis Testing and Data Generation Models

Jeffrey Jiang,Omead Pooladzandi,Sunay Bhat,Gregory Pottie

DOI: https://doi.org/10.48550/arXiv.2210.11275

2022-11-05

Abstract:A vast amount of expert and domain knowledge is captured by causal structural priors, yet there has been little research on testing such priors for generalization and data synthesis purposes. We propose a novel model architecture, Causal Structural Hypothesis Testing, that can use nonparametric, structural causal knowledge and approximate a causal model's functional relationships using deep neural networks. We use these architectures for comparing structural priors, akin to hypothesis testing, using a deliberate (non-random) split of training and testing data. Extensive simulations demonstrate the effectiveness of out-of-distribution generalization error as a proxy for causal structural prior hypothesis testing and offers a statistical baseline for interpreting results. We show that the variational version of the architecture, Causal Structural Variational Hypothesis Testing can improve performance in low SNR regimes. Due to the simplicity and low parameter count of the models, practitioners can test and compare structural prior hypotheses on small dataset and use the priors with the best generalization capacity to synthesize much larger, causally-informed datasets. Finally, we validate our methods on a synthetic pendulum dataset, and show a use-case on a real-world trauma surgery ground-level falls dataset.

Machine Learning,Artificial Intelligence
Smoothed nested testing on directed acyclic graphs

J H Loper,L Lei,W Fithian,W Tansey

DOI: https://doi.org/10.1093/biomet/asab041

IF: 3.0279

2021-07-02

Biometrika

Abstract:Summary We consider the problem of multiple hypothesis testing when there is a logical nested structure to the hypotheses. When one hypothesis is nested inside another, the outer hypothesis must be false if the inner hypothesis is false. We model the nested structure as a directed acyclic graph, including chain and tree graphs as special cases. Each node in the graph is a hypothesis and rejecting a node requires also rejecting all of its ancestors. We propose a general framework for adjusting node-level test statistics using the known logical constraints. Within this framework, we study a smoothing procedure that combines each node with all of its descendants to form a more powerful statistic. We prove that a broad class of smoothing strategies can be used with existing selection procedures to control the familywise error rate, false discovery exceedance rate, or false discovery rate, so long as the original test statistics are independent under the null. When the null statistics are not independent, but are derived from positively correlated normal observations, we prove control for all three error rates when the smoothing method is an arithmetic averaging of the observations. Simulations and an application to a real biology dataset demonstrate that smoothing leads to substantial power gains.

statistics & probability,mathematical & computational biology,biology
A semiparametric two-sample hypothesis testing problem for random dot product graphs

Minh Tang,Avanti Athreya,Daniel L. Sussman,Vince Lyzinski,Carey E. Priebe

DOI: https://doi.org/10.48550/arXiv.1403.7249

2014-03-27

Methodology

Abstract:Two-sample hypothesis testing for random graphs arises naturally in neuroscience, social networks, and machine learning. In this paper, we consider a semiparametric problem of two-sample hypothesis testing for a class of latent position random graphs. We formulate a notion of consistency in this context and propose a valid test for the hypothesis that two finite-dimensional random dot product graphs on a common vertex set have the same generating latent positions or have generating latent positions that are scaled or diagonal transformations of one another. Our test statistic is a function of a spectral decomposition of the adjacency matrix for each graph and our test procedure is consistent across a broad range of alternatives. We apply our test procedure to real biological data: in a test-retest data set of neural connectome graphs, we are able to distinguish between scans from different subjects; and in the {\em C.elegans} connectome, we are able to distinguish between chemical and electrical networks. The latter example is a concrete demonstration that our test can have power even for small sample sizes. We conclude by discussing the relationship between our test procedure and generalized likelihood ratio tests.
Structural transfer learning of non-Gaussian DAG

Mingyang Ren,Xin He,Junhui Wang

2023-10-16

Abstract:Directed acyclic graph (DAG) has been widely employed to represent directional relationships among a set of collected nodes. Yet, the available data in one single study is often limited for accurate DAG reconstruction, whereas heterogeneous data may be collected from multiple relevant studies. It remains an open question how to pool the heterogeneous data together for better DAG structure reconstruction in the target study. In this paper, we first introduce a novel set of structural similarity measures for DAG and then present a transfer DAG learning framework by effectively leveraging information from auxiliary DAGs of different levels of similarities. Our theoretical analysis shows substantial improvement in terms of DAG reconstruction in the target study, even when no auxiliary DAG is overall similar to the target DAG, which is in sharp contrast to most existing transfer learning methods. The advantage of the proposed transfer DAG learning is also supported by extensive numerical experiments on both synthetic data and multi-site brain functional connectivity network data.

Machine Learning,Methodology
Contextual Directed Acyclic Graphs

Ryan Thompson, Edwin V. Bonilla, Robert Kohn

2023-10-25

Abstract:Estimating the structure of directed acyclic graphs (DAGs) from observational data remains a significant challenge in machine learning. Most research in this area concentrates on learning a single DAG for the entire population. This paper considers an alternative setting where the graph structure varies across individuals based on available "contextual" features. We tackle this contextual DAG problem via a neural network that maps the contextual features to a DAG, represented as a weighted adjacency matrix. The neural network is equipped with a novel projection layer that ensures the output matrices are sparse and satisfy a recently developed characterization of acyclicity. We devise a scalable computational framework for learning contextual DAGs and provide a convergence guarantee and an analytical gradient for backpropagating through the projection layer. Our experiments suggest that the new approach can recover the true context-specific graph where existing approaches fail.

Machine Learning
Variational DAG Estimation via State Augmentation With Stochastic Permutations

Edwin V. Bonilla,Pantelis Elinas,He Zhao,Maurizio Filippone,Vassili Kitsios,Terry O'Kane

2024-05-28

Abstract:Estimating the structure of a Bayesian network, in the form of a directed acyclic graph (DAG), from observational data is a statistically and computationally hard problem with essential applications in areas such as causal discovery. Bayesian approaches are a promising direction for solving this task, as they allow for uncertainty quantification and deal with well-known identifiability issues. From a probabilistic inference perspective, the main challenges are (i) representing distributions over graphs that satisfy the DAG constraint and (ii) estimating a posterior over the underlying combinatorial space. We propose an approach that addresses these challenges by formulating a joint distribution on an augmented space of DAGs and permutations. We carry out posterior estimation via variational inference, where we exploit continuous relaxations of discrete distributions. We show that our approach performs competitively when compared with a wide range of Bayesian and non-Bayesian benchmarks on a range of synthetic and real datasets.

Machine Learning
Adaptive Skeleton Construction for Accurate DAG Learning

Xianjie Guo,Kui Yu,Lin Liu,Peipei Li,Jiuyong Li

DOI: https://doi.org/10.1109/tkde.2023.3265015

IF: 9.235

2023-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Directed acyclic graph (DAG) learning plays a key role in causal discovery and many machine learning tasks. Learning a DAG from high-dimensional data always faces scalability problems. A local-to-global DAG learning approach can be scaled to high-dimensional data, however, existing local-to-global DAG learning algorithms employ either the AND-rule or the OR-rule for constructing a DAG skeleton. Simply using either rule, existing local-to-global methods may learn an inaccurate DAG skeleton, leading to unsatisfactory DAG learning performance. To tackle this problem, in this paper, we propose an Adaptive DAG Learning (ADL) algorithm. The novel contribution of ADL is that it can simultaneously and adaptively use the AND-rule and the OR-rule to construct an accurate global DAG skeleton. We conduct extensive experiments on both benchmark and real-world datasets, and the experimental results show that ADL is significantly better than some existing local-to-global and global DAG learning algorithms.

computer science, information systems, artificial intelligence,engineering, electrical & electronic

[Diagnosis, course and treatment of plugged ulcer perforations or perforations in the septate peritoneum].

DAG-GAN: Causal Structure Learning with Generative Adversarial Nets

Idag: Invariant DAG Searching for Domain Generalization

Scalable and Flexible Causal Discovery with an Efficient Test for Adjacency

DAG-GNN: DAG Structure Learning with Graph Neural Networks

Directed Acyclic Graphs With Tears

GraphTTA: Test Time Adaptation on Graph Neural Networks

Deep Learning With DAGs

Guided structure learning of DAGs for count data

Directed Acyclic Graph Learning on Attributed Heterogeneous Network

A Sampling-Based Framework for Hypothesis Testing on Large Attributed Graphs

A Semiparametric Two-Sample Hypothesis Testing Problem for Random Graphs

Two-sample testing for random graphs

Causal Structural Hypothesis Testing and Data Generation Models

Smoothed nested testing on directed acyclic graphs

A semiparametric two-sample hypothesis testing problem for random dot product graphs

Structural transfer learning of non-Gaussian DAG

Contextual Directed Acyclic Graphs

Variational DAG Estimation via State Augmentation With Stochastic Permutations

Adaptive Skeleton Construction for Accurate DAG Learning