Multiplex graph matching matched filters

Konstantinos Pantazis,Daniel L. Sussman,Youngser Park,Zhirui Li,Carey E. Priebe,Vince Lyzinski

DOI: https://doi.org/10.1007/s41109-022-00464-0

2022-05-15

Applied Network Science

Abstract:We consider the problem of detecting a noisy induced multiplex template network in a larger multiplex background network. Our approach, which extends the graph matching matched filter framework of Sussman et a...

English Else

What problem does this paper attempt to address?

Gotta match 'em all: Solution diversification in graph matching matched filters

Zhirui Li,Ben Johnson,Daniel L. Sussman,Carey E. Priebe,Vince Lyzinski

2024-07-05

Abstract:We present a novel approach for finding multiple noisily embedded template graphs in a very large background graph. Our method builds upon the graph-matching-matched-filter technique proposed in Sussman et al., with the discovery of multiple diverse matchings being achieved by iteratively penalizing a suitable node-pair similarity matrix in the matched filter algorithm. In addition, we propose algorithmic speed-ups that greatly enhance the scalability of our matched-filter approach. We present theoretical justification of our methodology in the setting of correlated Erdos-Renyi graphs, showing its ability to sequentially discover multiple templates under mild model conditions. We additionally demonstrate our method's utility via extensive experiments both using simulated models and real-world dataset, include human brain connectomes and a large transactional knowledge base.

Machine Learning,Combinatorics,Applications,Methodology
Layered Graph Matching with Composite Cluster Sampling

Liang Lin,Xiaobai Liu,Song-Chun Zhu

DOI: https://doi.org/10.1109/tpami.2009.150

IF: 23.6

2009-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:This paper presents a framework of layered graph matching for integrating graph partition and matching. The objective is to find an unknown number of corresponding graph structures in two images. We extract discriminative local primitives from both images and construct a candidacy graph whose vertices are matching candidates (i.e., a pair of primitives) and whose edges are either negative for mutual exclusion or positive for mutual consistence. Then we pose layered graph matching as a multicoloring problem on the candidacy graph and solve it using a composite cluster sampling algorithm. This algorithm assigns some vertices into a number of colors, each being a matched layer, and turns off all the remaining candidates. The algorithm iterates two steps: 1) Sampling the positive and negative edges probabilistically to form a composite cluster, which consists of a few mutually conflicting connected components (CCPs) in different colors and 2) assigning new colors to these CCPs with consistence and exclusion relations maintained, and the assignments are accepted by the Markov Chain Monte Carlo (MCMC) mechanism to preserve detailed balance. This framework demonstrates state-of-the-art performance on several applications, such as multi-object matching with large motion, shape matching and retrieval, and object localization in cluttered background.
Layered Graph Match with Graph Editing

Liang Lin,Song-Chun Zhu,Yongtian Wang

DOI: https://doi.org/10.1109/cvpr.2007.383190

2007-01-01

Abstract:Many vision tasks are posed as either graph partitioning (coloring) or graph matching (correspondence) problems. The former include segmentation and grouping, and the latter include wide baseline stereo, large motion, object tracking and recognition. In this paper, we present an integrated solution for both graph matching and graph partition using an effective sampling algorithm in a Bayesian framework. Given two images for matching, we extract two graphs using a primal sketch algorithm [4]. The graph nodes are linelets and primitives (junctions). Both graphs are automatically partitioned into an unknown number of K + 1 layers of subgraphs so that K pairs of subgraphs are matched and the remaining layer contains unmatched backgrounds. Each matched pair represent a "moving object" with a TPS (thin-plate-spline) transform to account for its deformations and a set of graph operators to edit the pair of subgraphs to achieve perfect structural match. The matching energy between two subgraphs includes geometric deformations, appearance dissimilarities, and the cost of graph editing operators. We demonstrate its application on two tasks: (i) large motion with occlusion, and (ii) automatic detection and recognition of common objects in a pair of images.
Discriminative community detection for multiplex networks

Meiby Ortiz-Bouza,Selin Aviyente

2024-09-30

Abstract:Multiplex networks have emerged as a promising approach for modeling complex systems, where each layer represents a different mode of interaction among entities of the same type. A core task in analyzing these networks is to identify the community structure for a better understanding of the overall functioning of the network. While different methods have been proposed to detect the community structure of multiplex networks, the majority deal with extracting the consensus community structure across layers. In this paper, we address the community detection problem across two closely related multiplex networks. For example in neuroimaging studies, it is common to have multiple multiplex brain networks where each layer corresponds to an individual and each group to different experimental conditions. In this setting, one may be interested in both learning the community structure representing each experimental condition and the discriminative community structure between two groups. In this paper, we introduce two discriminative community detection algorithms based on spectral clustering. The first approach aims to identify the discriminative subgraph structure between the groups, while the second one learns the discriminative and the consensus community structures, simultaneously. The proposed approaches are evaluated on both simulated and real world multiplex networks.

Social and Information Networks,Machine Learning
Reconstruction of multiplex networks via graph embeddings

Daniel Kaiser,Siddharth Patwardhan,Minsuk Kim,Filippo Radicchi

DOI: https://doi.org/10.1103/PhysRevE.109.024313

2024-02-27

Abstract:Multiplex networks are collections of networks with identical nodes but distinct layers of edges. They are genuine representations for a large variety of real systems whose elements interact in multiple fashions or flavors. However, multiplex networks are not always simple to observe in the real world; often, only partial information on the layer structure of the networks is available, whereas the remaining information is in the form of aggregated, single-layer networks. Recent works have proposed solutions to the problem of reconstructing the hidden multiplexity of single-layer networks using tools proper of network science. Here, we develop a machine learning framework that takes advantage of graph embeddings, i.e., representations of networks in geometric space. We validate the framework in systematic experiments aimed at the reconstruction of synthetic and real-world multiplex networks, providing evidence that our proposed framework not only accomplishes its intended task, but often outperforms existing reconstruction techniques.

Physics and Society
Community Detection and Improved Detectability in Multiplex Networks

Yuming Huang,Ashkan Panahi,Hamid Krim,Liyi Dai

DOI: https://doi.org/10.1109/TNSE.2019.2949036

2019-11-26

Abstract:We investigate the widely encountered problem of detecting communities in multiplex networks, such as social networks, with an unknown arbitrary heterogeneous structure. To improve detectability, we propose a generative model that leverages the multiplicity of a single community in multiple layers, with no prior assumption on the relation of communities among different layers. Our model relies on a novel idea of incorporating a large set of generic localized community label constraints across the layers, in conjunction with the celebrated Stochastic Block Model (SBM) in each layer. Accordingly, we build a probabilistic graphical model over the entire multiplex network by treating the constraints as Bayesian priors. We mathematically prove that these constraints/priors promote existence of identical communities across layers without introducing further correlation between individual communities. The constraints are further tailored to render a sparse graphical model and the numerically efficient Belief Propagation algorithm is subsequently employed. We further demonstrate by numerical experiments that in the presence of consistent communities between different layers, consistent communities are matched, and the detectability is improved over a single layer. We compare our model with a "correlated model" which exploits the prior knowledge of community correlation between layers. Similar detectability improvement is obtained under such a correlation, even though our model relies on much milder assumptions than the correlated model. Our model even shows a better detection performance over a certain correlation and signal to noise ratio (SNR) range. In the absence of community correlation, the correlation model naturally fails, while ours maintains its performance.

Social and Information Networks,Machine Learning,Physics and Society
Multiplex Labeling Graph for Near-Online Tracking in Crowded Scenes

Yang Zhang,Hao Sheng,Yubin Wu,Shuai Wang,Wei Ke,Zhang Xiong

DOI: https://doi.org/10.1109/jiot.2020.2996609

IF: 10.6

2020-09-01

IEEE Internet of Things Journal

Abstract:In recent years, the demand for intelligent devices related to the Internet of Things (IoT) is rapidly increasing. In the field of computer vision, many algorithms have been preinstalled in IoT devices to achieve higher efficiency, such as face recognition, area detection, target tracking, etc. Tracking is an important but complex task that needs high efficiency solutions in real applications. There is a common assumption that detection can only represent one pedestrian to describe nonoverlapping in physical space. In fact, the pixels of the image do not exactly correspond to the positions in the real world. In order to overcome the limitation of this assumption, we remove this unreasonable assumption and present a novel idea that each detector response can have multiple labels to describe different targets at the same time. Therefore, we propose a graph-based method for near-online tracking in this article. We introduce a detection multiplexing method for tracking in the monocular image and propose a multiplex labeling graph (MLG) model. Each node in MLG has the ability to represent multiple targets. In addition, we improve the shortage of graph-based trackers in using temporal features. We construct long short-term memory networks to model motion and appearance features for MLG optimization. On the public multiobject tracking challenge benchmark, our near-online method gains satisfactory efficiency and achieves state-of-the-art results without additional private detection as well.

computer science, information systems,telecommunications,engineering, electrical & electronic
Layered Neighborhood Expansion for Incremental Multiple Graph Matching

Zixuan Chen,Zhihui Xie,Junchi Yan,Yinqiang Zheng,Xiaokang Yang

DOI: https://doi.org/10.1007/978-3-030-58607-2_15

2020-01-01

Abstract:Graph matching has been a fundamental problem in computer vision and pattern recognition, for its practical flexibility as well as NP hardness challenge. Though the matching between two graphs and among multiple graphs have been intensively studied in literature, the online setting for incremental matching of a stream of graphs has been rarely considered. In this paper, we treat the graphs as graphs on a super-graph, and propose a novel breadth first search based method for expanding the neighborhood on the super-graph for a new coming graph, such that the matching with the new graph can be efficiently performed within the constructed neighborhood. Then depth first search is performed to update the overall pairwise matchings. Moreover, we show our approach can also be readily used in the batch mode setting, by adaptively determining the order of coming graph batch for matching, still under the neighborhood expansion based incremental matching framework. Experiments on both online and offline matching of graph collections show our approach’s state-of-the-art accuracy and efficiency.
Blind Graph Matching Using Graph Signals

Hang Liu,Anna Scaglione,Hoi-To Wai

DOI: https://doi.org/10.1109/TSP.2024.3382840

2024-03-30

Abstract:Classical graph matching aims to find a node correspondence between two unlabeled graphs of known topologies. This problem has a wide range of applications, from matching identities in social networks to identifying similar biological network functions across species. However, when the underlying graphs are unknown, the use of conventional graph matching methods requires inferring the graph topologies first, a process that is highly sensitive to observation errors. In this paper, we tackle the blind graph matching problem with unknown underlying graphs directly using observations of graph signals, which are generated from graph filters applied to graph signal excitations. We propose to construct sample covariance matrices from the observed signals and match the nodes based on the selected sample eigenvectors. Our analysis shows that the blind matching outcome converges to the result obtained with known graph topologies when the signal sampling size is large and the signal noise is small. Numerical results showcase the performance improvement of the proposed algorithm compared to matching two estimated underlying graphs learned from the graph signals.

Signal Processing
Community Detection in Multiplex Networks Using Orthogonal Non-Negative Matrix Tri-Factorization Based on Graph Regularization and Diversity

Yuqi Yang,Shanshan Yu,Baicheng Pan,Chenglu Li,Man-Fai Leung

DOI: https://doi.org/10.3390/math12081124

IF: 2.4

2024-04-09

Mathematics

Abstract:In recent years, community detection has received increasing interest. In network analysis, community detection refers to the identification of tightly connected subsets of nodes, which are called "communities" or "groups", in the network. Non-negative matrix factorization models are often used to solve the problem. Orthogonal non-negative matrix tri-factorization (ONMTF) exhibits significant potential as an approach for community detection within multiplex networks. This paper explores the application of ONMTF in multiplex networks, aiming to detect both shared and exclusive communities simultaneously. The model decomposes each layer within the multiplex network into two low-rank matrices. One matrix corresponds to shared communities across all layers, and the other to unique communities within each layer. Additionally, graph regularization and the diversity of private communities are taken into account in the algorithm. The Hilbert Schmidt Independence Criterion (HSIC) is used to constrain the independence of private communities. The results prove that ONMTF effectively addresses community detection in multiplex networks. It also offers strong interpretability and feature extraction capabilities. Therefore, it is an advanced method for community detection in multiplex networks.

mathematics
Discrimination universally determines reconstruction of multiplex networks

Wu Mincheng,Chen Jiming,He Shibo,Sun Youxian,Havlin Shlomo,Gao Jianxi

2020-01-01

Abstract: Network reconstruction is fundamental to understanding the dynamical behaviors of the networked systems. Many systems, modeled by multiplex networks with various types of interactions, display an entirely different dynamical behavior compared to the corresponding aggregated network. In many cases, unfortunately, only the aggregated topology and partial observations of the network layers are available, raising an urgent demand for reconstructing multiplex networks. We fill this gap by developing a mathematical and computational tool based on the Expectation-Maximization framework to reconstruct multiplex layer structures. The reconstruction accuracy depends on the various factors, such as partial observation and network characteristics, limiting our ability to predict and allocate observations. Surprisingly, by using a mean-field approximation, we discovered that a discrimination indicator that integrates all these factors universally determines the accuracy of reconstruction. This discovery enables us to design the optimal strategies to allocate the fixed budget for deriving the partial observations, promoting the optimal reconstruction of multiplex networks. To further evaluate the performance of our method, we predict beside structure also dynamical behaviors on the multiplex networks, including percolation, random walk, and spreading processes. Finally, applying our method on empirical multiplex networks drawn from biological, transportation, and social domains, corroborate the theoretical analysis.
Layered Graph Matching by Composite Cluster Sampling with Collaborative and Competitive Interactions

Liang Lin,Kun Zeng,Xiaobai Liu,Song-Chun Zhu

DOI: https://doi.org/10.1109/cvpr.2009.5206585

2009-01-01

Abstract:This paper studies a framework for matching an unknown number of corresponding structures in two images (shapes), motivated by detecting objects in cluttered background and learning parts from articulated motion. Due to the large distortion between shapes and ambiguity caused by symmetric or cluttered structures, many inference algorithms often get stuck in local minimums and converge slowly We propose a composite cluster sampling algorithm with a "candidacy graph" representation, where each vertex (candidate) is a possible match for a pair of source and target primitives (local structure or small curves), and the layered matching is then formulated as a multiple coloring problem. Each two vertices can be linked by either a competitive edge or a collaborative edge. These edges indicate the connected vertices should/shouldn't be assigned the same color With this representation, the stochastic sampling contains two steps: (i) Sampling the competitive and collaborative edges to form a composite cluster, in which a few mutual-conflicting connected components are in different colors; (ii) Sampling the new colors to this cluster remaining consistency with Markov Chain Monte Carlo (MCMC) mechanism. The algorithm is applied to many applications on many public datasets and outperform the state of the art approaches.
Sampling Graphlets of Multiplex Networks: A Restricted Random Walk Approach

Simiao Jiao,Zihui Xue,Xiaowei Chen,Yuedong Xu

DOI: https://doi.org/10.1145/3456291

2020-01-01

Abstract:Graphlets are induced subgraph patterns that are crucial to the understanding of the structure and function of a large network. A lot of effort has been devoted to calculating graphlet statistics where random walk-based approaches are commonly used to access restricted graphs through the available application programming interfaces (APIs). However, most of them merely consider individual networks while overlooking the strong coupling between different networks. In this article, we estimate the graphlet concentration in multiplex networks with real-world applications. An inter-layer edge connects two nodes in different layers if they actually belong to the same node. The access to a multiplex network is restrictive in the sense that the upper layer allows random walk sampling, whereas the nodes of lower layers can be accessed only through the inter-layer edges and only support random node or edge sampling. To cope with this new challenge, we define a suit of two-layer graphlets and propose novel random walk sampling algorithms to estimate the proportion of all the three-node graphlets. An analytical bound on the sampling steps is proved to guarantee the convergence of our unbiased estimator. We further generalize our algorithm to explore the tradeoff between the estimated accuracy of different graphlets when the sample budget is split into different layers. Experimental evaluation on real-world and synthetic multiplex networks demonstrates the accuracy and high efficiency of our unbiased estimators.
Finding overlapping communities in multiplex networks

Nazanin Afsarmanesh,Matteo Magnani

DOI: https://doi.org/10.48550/arXiv.1602.03746

2016-03-07

Abstract:We define an approach to identify overlapping communities in multiplex networks, extending the popular clique percolation method for simple graphs. The extension requires to rethink the basic concepts on which the clique percolation algorithm is based, including cliques and clique adjacency, to allow the presence of multiple types of edges.

Social and Information Networks,Physics and Society
GLMNet: Graph Learning-Matching Networks for Feature Matching

Bo Jiang,Pengfei Sun,Jin Tang,Bin Luo

DOI: https://doi.org/10.48550/arXiv.1911.07681

2019-11-18

Abstract:Recently, graph convolutional networks (GCNs) have shown great potential for the task of graph matching. It can integrate graph node feature embedding, node-wise affinity learning and matching optimization together in a unified end-to-end model. One important aspect of graph matching is the construction of two matching graphs. However, the matching graphs we feed to existing graph convolutional matching networks are generally fixed and independent of graph matching, which thus are not guaranteed to be optimal for the graph matching task. Also, existing GCN matching method employs several general smoothing-based graph convolutional layers to generate graph node embeddings, in which extensive smoothing convolution operation may dilute the desired discriminatory information of graph nodes. To overcome these issues, we propose a novel Graph Learning-Matching Network (GLMNet) for graph matching problem. GLMNet has three main aspects. (1) It integrates graph learning into graph matching which thus adaptively learn a pair of optimal graphs that best serve graph matching task. (2) It further employs a Laplacian sharpening convolutional module to generate more discriminative node embeddings for graph matching. (3) A new constraint regularized loss is designed for GLMNet training which can encode the desired one-to-one matching constraints in matching optimization. Experiments on two benchmarks demonstrate the effectiveness of GLMNet and advantages of its main modules.

Computer Vision and Pattern Recognition
Matched Filtering on Directed Graphs

Isidora Stanković,Miloš Brajović,Cornel Ioana,Miloš Daković,Danilo Mandic,Ljubiša Stanković

DOI: https://doi.org/10.1109/tsmc.2024.3407948

2024-08-21

IEEE Transactions on Systems Man and Cybernetics Systems

Abstract:The matched filter is a crucial concept in both signal analysis and convolutional neural networks (CNNs). Previous work has addressed graph matched filtering principles for undirected graphs. This article expands upon the existing literature, by exploring matched filtering principles for signals on directed graphs. In such cases, the adjacency matrix is asymmetric, and commonly results in nonorthogonal eigenvectors. The presented concept is supported by a detailed analysis and numerical examples.

automation & control systems,computer science, cybernetics
Template matching: matched spatial filters and beyond

R. Brunelli,T. Poggiot

DOI: https://doi.org/10.1016/s0031-3203(96)00104-5

IF: 8

1997-05-01

Pattern Recognition

Abstract:Template matching by means of cross-correlation is common practice in pattern recognition in spite of its drawbacks. This paper reviews some results on how these shortcomings can be removed. Several techniques (Matched Spatial Filters, Synthetic Discriminant Functions, Principal Components Projections and Reconstruction Residuals) are reviewed and compared on a common task: locating eyes in a database of faces. New variants are also proposed and compared: least squares Discriminant Functions and the combined use of projections on eigenfunctions and the corresponding reconstruction residuals. Finally, approximation networks are introduced in an attempt to improve filter design by the introduction of nonlinearity. © I997 Pattern Recognition Society. Published by Elsevier Science Ltd.

computer science, artificial intelligence,engineering, electrical & electronic
Mesoscopic Structures Reveal the Network Between the Layers of Multiplex Datasets

Jacopo Iacovacci,Zhihao Wu,Ginestra Bianconi

DOI: https://doi.org/10.48550/arXiv.1505.03824

2015-05-14

Physics and Society

Abstract:Multiplex networks describe a large variety of complex systems, whose elements (nodes) can be connected by different types of interactions forming different layers (networks) of the multiplex. Multiplex networks include social networks, transportation networks or biological networks in the cell or in the brain. Extracting relevant information from these networks is of crucial importance for solving challenging inference problems and for characterizing the multiplex networks microscopic and mesoscopic structure. Here we propose an information theory method to extract the network between the layers of multiplex datasets, forming a "network of networks". We build an indicator function, based on the entropy of network ensembles, to characterize the mesoscopic similarities between the layers of a multiplex network and we use clustering techniques to characterize the communities present in this network of networks. We apply the proposed method to study the Multiplex Collaboration Network formed by scientists collaborating on different subjects and publishing in the Americal Physical Society (APS) journals. The analysis of this dataset reveals the interplay between the collaboration networks and the organization of knowledge in physics.

Multiplex graph matching matched filters

Gotta match 'em all: Solution diversification in graph matching matched filters

Layered Graph Matching with Composite Cluster Sampling

Layered Graph Match with Graph Editing

Discriminative community detection for multiplex networks

Reconstruction of multiplex networks via graph embeddings

Community Detection and Improved Detectability in Multiplex Networks

Multiplex Labeling Graph for Near-Online Tracking in Crowded Scenes

Layered Neighborhood Expansion for Incremental Multiple Graph Matching

Blind Graph Matching Using Graph Signals

Community Detection in Multiplex Networks Using Orthogonal Non-Negative Matrix Tri-Factorization Based on Graph Regularization and Diversity

Discrimination universally determines reconstruction of multiplex networks

Layered Graph Matching by Composite Cluster Sampling with Collaborative and Competitive Interactions

Sampling Graphlets of Multiplex Networks: A Restricted Random Walk Approach

Finding overlapping communities in multiplex networks

GLMNet: Graph Learning-Matching Networks for Feature Matching

Matched Filtering on Directed Graphs

Template matching: matched spatial filters and beyond

Mesoscopic Structures Reveal the Network Between the Layers of Multiplex Datasets