Survey of Attribute-Link Clustering Algorithms

Limin Wang

2008-01-01

Abstract:This paper provided a detailed survey of current attribute-link clustering algorithms in link mining at first,and then introduced and analyzed the represented attribute-link clustering arithmetic.And pointed out some future directions in the end.

What problem does this paper attempt to address?

A Survey of Deep Graph Clustering: Taxonomy, Challenge, and Application

Yue Liu,Jun Xia,Sihang Zhou,Siwei Wang,Xifeng Guo,Xihong Yang,Ke Liang,Wenxuan Tu,Stan Z. Li,Xinwang Liu

2022-01-01

Abstract: Graph clustering, which aims to divide the nodes in the graph into several distinct clusters, is a fundamental and challenging task. In recent years, deep graph clustering methods have been increasingly proposed and achieved promising performance. However, the corresponding survey paper is scarce and it is imminent to make a summary in this field. From this motivation, this paper makes the first comprehensive survey of deep graph clustering. Firstly, the detailed definition of deep graph clustering and the important baseline methods are introduced. Besides, the taxonomy of deep graph clustering methods is proposed based on four different criteria including graph type, network architecture, learning paradigm, and clustering method. In addition, through the careful analysis of the existing works, the challenges and opportunities from five perspectives are summarized. At last, the applications of deep graph clustering in four domains are presented. It is worth mentioning that a collection of state-of-the-art deep graph clustering methods including papers, codes, and datasets is available on GitHub. We hope this work will serve as a quick guide and help researchers to overcome challenges in this vibrant field.
Clustering attributed graphs: Models, measures and methods

CECILE BOTHOREL,JUAN DAVID CRUZ,MATTEO MAGNANI,BARBORA MICENKOVÁ

DOI: https://doi.org/10.1017/nws.2015.9

2015-03-18

Network Science

Abstract:Abstract Clustering a graph, i.e., assigning its nodes to groups, is an important operation whose best known application is the discovery of communities in social networks. Graph clustering and community detection have traditionally focused on graphs without attributes, with the notable exception of edge weights. However, these models only provide a partial representation of real social systems, that are thus often described using node attributes, representing features of the actors, and edge attributes, representing different kinds of relationships among them. We refer to these models as attributed graphs . Consequently, existing graph clustering methods have been recently extended to deal with node and edge attributes. This article is a literature survey on this topic, organizing, and presenting recent research results in a uniform way, characterizing the main existing clustering methods and highlighting their conceptual differences. We also cover the important topic of clustering evaluation and identify current open problems.
A Survey on Incomplete Multi-view Clustering

Jie Wen,Zheng Zhang,Lunke Fei,Bob Zhang,Yong Xu,Zhao Zhang,Jinxing Li

DOI: https://doi.org/10.1109/TSMC.2022.3192635

2022-08-17

Abstract:Conventional multi-view clustering seeks to partition data into respective groups based on the assumption that all views are fully observed. However, in practical applications, such as disease diagnosis, multimedia analysis, and recommendation system, it is common to observe that not all views of samples are available in many cases, which leads to the failure of the conventional multi-view clustering methods. Clustering on such incomplete multi-view data is referred to as incomplete multi-view clustering. In view of the promising application prospects, the research of incomplete multi-view clustering has noticeable advances in recent years. However, there is no survey to summarize the current progresses and point out the future research directions. To this end, we review the recent studies of incomplete multi-view clustering. Importantly, we provide some frameworks to unify the corresponding incomplete multi-view clustering methods, and make an in-depth comparative analysis for some representative methods from theoretical and experimental perspectives. Finally, some open problems in the incomplete multi-view clustering field are offered for researchers.

Machine Learning,Multimedia
A Neighborhood Search Method for Link-Based Tag Clustering

Jianwei Cui,Pei Li,Hongyan Liu,Jun He,Xiaoyong Du

DOI: https://doi.org/10.1007/978-3-642-03348-3_12

2009-01-01

Abstract:Recently tagging has been a flexible and important way to share and categorize web resources. However, ambiguity and large quantities of tags restrict its value for resource sharing and navigation. Tag clustering could help alleviate these problems by gathering relevant tags. In this paper, we introduce a link-based method to measure the relevance between tags based on random walk on graphs. We also propose a new clustering method which could address several challenges in tag clustering. The experimental results based on del.icio.us show that our methods achieve good accuracy and acceptable performance on tag clustering.
A Survey of Deep Graph Clustering: Taxonomy, Challenge, Application, and Open Resource

Yue Liu,Jun Xia,Sihang Zhou,Xihong Yang,Ke Liang,Chenchen Fan,Yan Zhuang,Stan Z. Li,Xinwang Liu,Kunlun He

2023-09-12

Abstract:Graph clustering, which aims to divide nodes in the graph into several distinct clusters, is a fundamental yet challenging task. Benefiting from the powerful representation capability of deep learning, deep graph clustering methods have achieved great success in recent years. However, the corresponding survey paper is relatively scarce, and it is imminent to make a summary of this field. From this motivation, we conduct a comprehensive survey of deep graph clustering. Firstly, we introduce formulaic definition, evaluation, and development in this field. Secondly, the taxonomy of deep graph clustering methods is presented based on four different criteria, including graph type, network architecture, learning paradigm, and clustering method. Thirdly, we carefully analyze the existing methods via extensive experiments and summarize the challenges and opportunities from five perspectives, including graph data quality, stability, scalability, discriminative capability, and unknown cluster number. Besides, the applications of deep graph clustering methods in six domains, including computer vision, natural language processing, recommendation systems, social network analyses, bioinformatics, and medical science, are presented. Last but not least, this paper provides open resource supports, including 1) a collection (\url{<a class="link-external link-https" href="https://github.com/yueliu1999/Awesome-Deep-Graph-Clustering" rel="external noopener nofollow">this https URL</a>}) of state-of-the-art deep graph clustering methods (papers, codes, and datasets) and 2) a unified framework (\url{<a class="link-external link-https" href="https://github.com/Marigoldwu/A-Unified-Framework-for-Deep-Attribute-Graph-Clustering" rel="external noopener nofollow">this https URL</a>}) of deep graph clustering. We hope this work can serve as a quick guide and help researchers overcome challenges in this vibrant field.

Machine Learning,Artificial Intelligence
Graph clustering based on structural/attribute similarities

Yang Zhou,Hong Cheng,Jeffrey Xu Yu

DOI: https://doi.org/10.14778/1687627.1687709

IF: 2.5

2009-08-01

Proceedings of the VLDB Endowment

Abstract:The goal of graph clustering is to partition vertices in a large graph into different clusters based on various criteria such as vertex connectivity or neighborhood similarity. Graph clustering techniques are very useful for detecting densely connected groups in a large graph. Many existing graph clustering methods mainly focus on the topological structure for clustering, but largely ignore the vertex properties which are often heterogenous. In this paper, we propose a novel graph clustering algorithm, SA-Cluster , based on both structural and attribute similarities through a unified distance measure. Our method partitions a large graph associated with attributes into k clusters so that each cluster contains a densely connected subgraph with homogeneous attribute values. An effective method is proposed to automatically learn the degree of contributions of structural similarity and attribute similarity. Theoretical analysis is provided to show that SA-Cluster is converging. Extensive experimental results demonstrate the effectiveness of SA-Cluster through comparison with the state-of-the-art graph clustering and summarization methods.

computer science, information systems, theory & methods
Link Discovery:A New Data Mining Method

CHEN Fei,SHANG Lin,LUO Bin,CHEN Shi-Fu

DOI: https://doi.org/10.3969/j.issn.1002-137X.2006.11.034

2006-01-01

Computer Science

Abstract:Link Discovery is a relatively new form of data mining. Link Discovery is the technique for mining large amounts of data to find hidden patterns, extract valuable knowledge and discover hidden links. A survey on link discovery is presented in the paper, including the definition, the research range, characteristics and challenges of Link Discovery. And several typical Link Discovery methods are detailed, including unsupervised Link Discovery methods (novel Link Discovery), relational data mining with inductive logic programming for Link Discovery, multi-hypothesis abductive reasoning for Link Discovery, Link Discovery based on Correlation Analysis and the KOJAK group finder. We emphasize on the performance evaluation metrics for Link Discovery systems and measuring confidence intervals in Link Discovery. Further more the aplication of Link Discovery is presented: EELD. Lastly some issues about Link Discovery are discussed and the future directions of Link Discovery are pointed out.
A Survey of Link Prediction Algorithms

Vivian Feng

2023-06-14

Abstract:The problem of link prediction, predicting if two nodes in a network have a connection between them, is a theoretical problem with numerous field-agnostic real-world applications. This paper investigates the efficacy of three classes of link prediction algorithms: local node similarity heuristics, the global index Random Walk with Restart, and Node2Vec embeddings. Furthermore, this paper provides insight into the performance of canonical link prediction algorithms on small graphs. The graphs included in this study are sampled from various domains, including infrastructure and ecological networks.

Social and Information Networks
Improving local clustering based top-L link prediction methods via asymmetrical link clustering information

Zhihao Wu,Youfang Lin,Yiji Zhao,Hongyan Yan

DOI: https://doi.org/10.1016/j.physa.2017.11.103

2017-11-22

Abstract:Networks can represent a wide range of complex systems, such as social, biological and technological systems. Link prediction is one of the most important problems in network analysis, and has attracted much research interest recently. Many link prediction methods have been proposed to solve this problem with various technics. We can note that clustering information plays an important role in solving the link prediction problem. In previous literatures, we find node clustering coefficient appears frequently in many link prediction methods. However, node clustering coefficient is limited to describe the role of a common-neighbor in different local networks, because it can not distinguish different clustering abilities of a node to different node pairs. In this paper, we shift our focus from nodes to links, and propose the concept of asymmetric link clustering (ALC) coefficient. Further, we improve three node clustering based link prediction methods via the concept of ALC. The experimental results demonstrate that ALC-based methods outperform node clustering based methods, especially achieving remarkable improvements on food web, hamster friendship and Internet networks. Besides, comparing with other methods, the performance of ALC-based methods are very stable in both globalized and personalized top-L link prediction tasks.

Social and Information Networks,Physics and Society
A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects

Absalom E. Ezugwu,Abiodun M. Ikotun,Olaide O. Oyelade,Laith Abualigah,Jeffery O. Agushaka,Christopher I. Eke,Andronicus A. Akinyelu

DOI: https://doi.org/10.1016/j.engappai.2022.104743

IF: 8

2022-04-01

Engineering Applications of Artificial Intelligence

Abstract:Clustering is an essential tool in data mining research and applications. It is the subject of active research in many fields of study, such as computer science, data science, statistics, pattern recognition, artificial intelligence, and machine learning. Several clustering techniques have been proposed and implemented, and most of them successfully find excellent quality or optimal clustering results in the domains mentioned earlier. However, there has been a gradual shift in the choice of clustering methods among domain experts and practitioners alike, which is precipitated by the fact that most traditional clustering algorithms still depend on the number of clusters provided a priori. These conventional clustering algorithms cannot effectively handle real-world data clustering analysis problems where the number of clusters in data objects cannot be easily identified. Also, they cannot effectively manage problems where the optimal number of clusters for a high-dimensional dataset cannot be easily determined. Therefore, there is a need for improved, flexible, and efficient clustering techniques. Recently, a variety of efficient clustering algorithms have been proposed in the literature, and these algorithms produced good results when evaluated on real-world clustering problems. This study presents an up-to-date systematic and comprehensive review of traditional and state-of-the-art clustering techniques for different domains. This survey considers clustering from a more practical perspective. It shows the outstanding role of clustering in various disciplines, such as education, marketing, medicine, biology, and bioinformatics. It also discusses the application of clustering to different fields attracting intensive efforts among the scientific community, such as big data, artificial intelligence, and robotics. This survey paper will be beneficial for both practitioners and researchers. It will serve as a good reference point for researchers and practitioners to design improved and efficient state-of-the-art clustering algorithms.
CoHomo: A Cluster-Attribute Correlation Aware Graph Clustering Framework

Yaming Yang,Hongmin Liu,Ziyu Guan,Xiaofei He,Gaoliang Liu

DOI: https://doi.org/10.1016/j.neucom.2020.06.002

IF: 6

2020-01-01

Neurocomputing

Abstract:An attributed graph is a graph where nodes are associated with attributes describing their features. Clustering on an attributed graph is to detect clusters that have not only (1) cohesive structure; but also (2) homogeneous attribute values. We observe that in an attributed graph, different clusters tend to correlate to different attributes. For example, a cluster may show homogeneous values on attribute A but random values on attribute B, while for another cluster the situation could be the reverse. Existing attributed graph clustering methods ignore this phenomenon, thus leading to unsatisfactory clustering results. In this paper, we propose a novel attributed graph clustering framework called CoHomo to detect clusters with different attribute correlation patterns. The objective is to detect clusters that show both high structural cohesiveness and value homogeneity on some of the attributes. CoHomo defines and optimizes a correlation weight vector for each cluster to capture its correlation degrees to different node attributes. We formalize this problem as a bi-objective optimization problem and design an efficient heuristic optimizing method. The correlation weights for a cluster can be updated in two ways, synchronous updating or asynchronous updating, during the process of clustering. CoHomo is parameter-free and has near linear scalability. Theoretical analysis shows that all the results on the Pareto front generated by CoHomo are weak Pareto optimal solutions. Extensive experiments on attributed graphs based on several real world networks verify the effectiveness and show that our method outperforms the state-of-the-art method.
Utilizing Different Link Types to Enhance Document Clustering Based on Markov Random Field Model with Relaxation Labeling

Xiaodan Zhang,Xiaohua Hu,Tingting He,E. K. Park,Xiaohua Zhou

DOI: https://doi.org/10.1109/tsmca.2012.2187183

2012-01-01

Abstract:With the fast growing number of works utilizing link information in enhancing unsupervised document clustering, it is becoming necessary to make a comparative evaluation of the impacts of different link types on document clustering. Various types of links between text documents, including explicit links such as citation links and hyperlinks, implicit links such as coauthorship and cocitation links, and similarity links such as content similarity links, convey topic similarity or topic transferring patterns, which is very useful for document clustering. In this paper, we adopt a clustering algorithm based on Markov random field and relaxation labeling, which employs both content and linkage information, to evaluate the effectiveness of the aforementioned types of links for document clustering on ten data sets. The experimental results show that linkage information is quite effective in improving content-based document clustering. Furthermore, a series of important findings regarding the impacts of different link types on document clustering is discovered through our experiments.
A Fuzzy Clustering Based Method for Attributed Graph Partitioning

Chaobo He,Shuangyin Liu,Lei Zhang,Jianhua Zheng

DOI: https://doi.org/10.1007/s12652-018-1054-2

IF: 3.662

2018-01-01

Journal of Ambient Intelligence and Humanized Computing

Abstract:Graph partitioning methods in data mining have been widely used to discover protein complexes in protein–protein interaction (PPI) network. However, PPI networks with attributes need more effective attribute graph partitioning methods. Attribute graph partitioning aims to obtain high quality partitions satisfying the requirement: nodes in the same partition not only connect to each other more densely but also share more similar attribute values. In this paper, we propose a novel method for attributed graph partitioning based on fuzzy clustering. This method firstly devises a unified similarity measure using SimRank to construct the fuzzy similarity matrix of the attributed graph and can integrate structural and attribute similarities of nodes into a flexible weighted framework. Then it deduces the corresponding fuzzy equivalent matrix using fuzzy set theory. Finally, the result of partitioning can be obtained using fuzzy clustering algorithm. We conduct some experiments on several typical attributed graphs, which can also simulate PPI networks with attributes. The results show that our method is very effective to identify high quality partitions of attributed graphs and even performs better than some representative methods.
Incorporating User's Preference into Attributed Graph Clustering

Wei Ye,Dominik Mautz,Ambuj Singh,Claudia Plant,Christian Bohm

DOI: https://doi.org/10.1109/tkde.2020.2976063

IF: 9.235

2021-12-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Graph clustering has been studied extensively on both plain graphs and attributed graphs. However, all these methods need to partition the whole graph to find cluster structures. Sometimes, based on domain knowledge, people may have information about a specific target region in the graph and only want to find a single cluster concentrated on this local region. Such a task is called local clustering. In contrast to global clustering, local clustering aims to find only one cluster that is concentrating on the given seed vertex (and also on the designated attributes for attributed graphs). Currently, very few methods can deal with this kind of task. To this end, we propose two quality measures for a local cluster: Graph Unimodality (GU) and Attribute Unimodality (AU). The former measures the homogeneity of the graph structure while the latter measures the homogeneity of the subspace that is composed of the designated attributes. We call their linear combination as Compactness. Further, we propose LOCLU to optimize the Compactness score. The local cluster detected by LOCLU concentrates on the region of interest, provides efficient information flow in the graph and exhibits a unimodal data distribution in the subspace of the designated attributes.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
Block-level link analysis.

Deng Cai,Xiaofei He,Ji-Rong Wen,Wei-Ying Ma

DOI: https://doi.org/10.1145/1008992.1009068

2004-01-01

Abstract:ABSTRACTLink Analysis has shown great potential in improving the performance of web search. PageRank and HITS are two of the most popular algorithms. Most of the existing link analysis algorithms treat a web page as a single node in the web graph. However, in most cases, a web page contains multiple semantics and hence the web page might not be considered as the atomic node. In this paper, the web page is partitioned into blocks using the vision-based page segmentation algorithm. By extracting the page-to-block, block-to-page relationships from link structure and page layout analysis, we can construct a semantic graph over the WWW such that each node exactly represents a single semantic topic. This graph can better describe the semantic structure of the web. Based on block-level link analysis, we proposed two new algorithms, Block Level PageRank and Block Level HITS, whose performances we study extensively using web data.
Link Based Clustering of Web Search Results

Yitong Wang,Masaru Kitsuregawa

DOI: https://doi.org/10.1007/3-540-47714-4_21

2001-01-01

Abstract:With information proliferation on the Web, how to obtain high-quality information from the Web has been one of hot research topics in many fields like Database, IR as well as AI. Web search engine is the most commonly used tool for information retrieval; however, its current status is far from satisfaction. In this paper, we propose a new approach to cluster search results returned from Web search engine using link analysis. Unlike document clustering algorithms in IR that based on common words/phrases shared between documents, our approach is base on common links shared by pages using co-citation and coupling analysis. We also extend standard clustering algorithm K-means to make it more natural to handle noises and apply it to web search results. By filtering some irrelevant pages, our approach clusters high quality pages into groups to facilitate users' accessing and browsing. Preliminary experiments and evaluations are conducted to investigate its effectiveness. The experiment results show that clustering on web search results via link analysis is promising.
A link clustering based overlapping community detection algorithm

Chuan Shi,Yanan Cai,Di Fu,Yuxiao Dong,Bin Wu

DOI: https://doi.org/10.1016/j.datak.2013.05.004

IF: 1.5

2013-01-01

Data & Knowledge Engineering

Abstract:There is a surge of community detection study on complex network analysis in recent years, since communities often play important roles in network systems. However, many real networks have more complex overlapping community structures. This paper proposes a novel algorithm to discover overlapping communities. Different from conventional algorithms based on node clustering, the proposed algorithm is based on link clustering. Since links usually represent unique relations among nodes, the link clustering will discover groups of links that have the same characteristics. Thus nodes naturally belong to multiple communities. The algorithm applies genetic operation to cluster on links. An effective encoding schema is designed and the number of communities can be automatically determined. Experiments on both artificial networks and real networks validate the effectiveness and efficiency of the proposed algorithm.
An Empirical Study on Property Clustering in Linked Data

Saisai Gong,Haoxuan Li,Wei Hu,Yuzhong Qu

DOI: https://doi.org/10.4018/ijswis.2018010102

2016-01-01

Abstract:Properties are used to describe entities, and a part of them are likely to be clustered together to constitute an aspect. For example, first name, middle name and last name are usually gathered to describe a person's name. However, existing automated approaches to property clustering remain far from satisfactory for an open domain like Linked Data. In this paper, the authors firstly investigated the relatedness between properties using 13 different measures. Then, they employed seven clustering algorithms and two combination methods for property clustering. Based on a sample set of Linked Data, the authors empirically studied property clustering in Linked Data and found that a proper combination of different measures and clustering algorithms gave rise to the best result. Additionally, they reported how property clustering can improve user experience in an entity browsing system.
A Review on Link Analysis

Li Jiang,Yin Zhiming

DOI: https://doi.org/10.3969/j.issn.1002-1027.2008.02.010

2008-01-01

Abstract:Based on the relative study of link analysis during the past years, the authors summarized the four perspectives of Link analysis including Webometrics, Optimization of Information Retrieval, Web structure mining and Modeling for the Web structure. Furthermore, the status quo of each perspective are analyzed.
Association Link Network Based Core Events Discovery on the Web

Yang Liu,Nazanin Borhan,Xiangfeng Luo,Hui Zhang,Xiang He

DOI: https://doi.org/10.1109/cse.2013.88

2013-01-01

Abstract:As documents are explosively increasing in the era of big data, document clustering has been proven to be useful for organizing online document streams into events. However, extant studies on document clustering still suffer from the problems of high dimensionality, scalability and accuracy. In this paper, we will present a novel association link network (ALN) based document clustering method, which is an adaptive iteration splitting process to discover core events on the web. In the iteration, we first detect community structures from ALN, then, map documents to the associated community based on words relations in ALN, finally rebuild communities using the mapped documents. Compared to existing document clustering methods, the effectiveness of presented clustering method in automatically discovering the web events is proved by the experimental results on real data set.

Survey of Attribute-Link Clustering Algorithms

A Survey of Deep Graph Clustering: Taxonomy, Challenge, and Application

Clustering attributed graphs: Models, measures and methods

A Survey on Incomplete Multi-view Clustering

A Neighborhood Search Method for Link-Based Tag Clustering

A Survey of Deep Graph Clustering: Taxonomy, Challenge, Application, and Open Resource

Graph clustering based on structural/attribute similarities

Link Discovery:A New Data Mining Method

A Survey of Link Prediction Algorithms

Improving local clustering based top-L link prediction methods via asymmetrical link clustering information

A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects

CoHomo: A Cluster-Attribute Correlation Aware Graph Clustering Framework

Utilizing Different Link Types to Enhance Document Clustering Based on Markov Random Field Model with Relaxation Labeling

A Fuzzy Clustering Based Method for Attributed Graph Partitioning

Incorporating User's Preference into Attributed Graph Clustering

Block-level link analysis.

Link Based Clustering of Web Search Results

A link clustering based overlapping community detection algorithm

An Empirical Study on Property Clustering in Linked Data

A Review on Link Analysis

Association Link Network Based Core Events Discovery on the Web