An Ant Colony Clustering Algorithm on a Manifold

王宗利,刘希玉

2008-01-01

Abstract:An entropy-based ant colony algorithm and a manifold learning method were introduced.The manifold learning method based on dynamical tangent space alignment was combined with an ant colony algorithm,giving a new idea of a clustering algo-rithm.This algorithm can improve the speed of convergence.

What problem does this paper attempt to address?

An Optimized Ant System For Clustering With Elitist Ant And Local Search

Ming-Pan Li,Min Yao

DOI: https://doi.org/10.1051/itmconf/20160705011

2016-01-01

ITM Web of Conferences

Abstract:Clustering analysis is an important field in data mining, and also one of the current research hotspots in computer science. This paper focus on some classical data clustering algorithms and swarm intelligence, especially ant colony optimization, trying to combine these two kinds of algorithms and improve the efficiency and accuracy of data clustering. This paper proposes a new ant colony optimization data clustering algorithm, named ant colony clustering algorithm with elitist ant and local search (ACC-EAL). This algorithm adopts a new pheromone incremental calculation method, making the distances among the clusters tend to increase, and the clusters get denser. Meanwhile local search provides the ants more opportunity to find optimal solution and the elite ant strategy makes the ants with optimal solutions contribute more to the pheromone increment.
Learning Exemplar-Represented Manifolds in Latent Space for Classification.

Shu Kong,Donghui Wang

DOI: https://doi.org/10.1007/978-3-642-40994-3_16

2013-01-01

Abstract:Intrinsic manifold structure of a data collection is valuable information for classification task. By considering the manifold structure in the data set for classification and with the sparse coding framework, we propose an algorithm to: (1) find exemplars from each class to represent the class-specific manifold structure, in which way the object-space dimensionality is reduced; (2) simultaneously learn a latent feature space to make the mapped data more discriminative according to the class-specific manifold measurement. We call the proposed algorithm Exemplar-represented Manifold in Latent Space for Classification (EMLSC). We also present the nonlinear extension of EMLSC based on kernel tricks to deal with highly nonlinear situations. Experiments on synthetic and real-world datasets demonstrate the merit of the proposed method.
An Iterative Optimization Clustering Algorithm Based on Manifold Distance

Na Wang,Sun'an Wang,Haifeng Du

DOI: https://doi.org/10.1109/iciea.2009.5138457

2009-01-01

Abstract:In this study, a novel iterative optimization clustering algorithm is proposed by using a manifold distance based dissimilarity metric which can measure the geodesic distance along the manifold and a criterion function which can express the clustering target, that is the samples in the same cluster being somehow more similar than samples in different one. The steps of the algorithm are discussed in detail. Simulation results on six artificial datasets with different manifold structures show that comparing to k means clustering algorithm, the new algorithm has the ability to identify complex non-convex clusters.
Clustering with Adaptive Manifold Structure Learning

Zhao Kang,Chong Peng,Qiang Cheng

DOI: https://doi.org/10.1109/icde.2017.44

2017-01-01

Abstract:Construction of a reliable similarity matrix is fundamental for graph-based clustering methods. However, most of the current work is built upon some simple manifold structure, whereas limited work has been conducted on nonlinear data sets where data reside in a union of manifolds rather than a union of subspaces. Therefore, we construct a similarity graph to capture both global and local manifold structures of the input data set. The global structure is exploited based on the self-expressive property of data in an implicit feature space using kernel methods. Since the similarity graph computation is independent of the subsequent clustering, the final results may be far from optimal. To overcome this limitation, we simultaneously learn similarity graph and clustering structure in a principled way. Experimental studies demonstrate that our proposed algorithms deliver consistently superior results to other state-of-the-art algorithms.
A Robust Density-Based Clustering Algorithm for Multi-Manifold Structure.

Jianpeng Zhang,Mykola Pechenizkiy,Yulong Pei,Julia Efremova

DOI: https://doi.org/10.1145/2851613.2851644

2016-01-01

Abstract:In real-world pattern recognition tasks, the data with multiple manifolds structure is ubiquitous and unpredictable. Performing an effective clustering on such data is a challenging problem. In particular, it is not obvious how to design a similarity measure for multiple manifolds. In this paper, we address this problem proposing a new manifold distance measure, which can better capture both local and global spatial manifold information. We define a new way of local density estimation accounting for the density characteristic. It represents local density more accurately. Meanwhile, it is less sensitive to the parameter settings. Besides, in order to select the cluster centers automatically, a two-phase exemplar determination method is proposed. The experiments on several synthetic and real-world datasets show that the proposed algorithm has higher clustering effectiveness and better robustness for data with varying density, multi-scale and noise overlap characteristics.
LAAT: Locally Aligned Ant Technique for discovering multiple faint low dimensional structures of varying density

Abolfazl Taghribi,Kerstin Bunte,Rory Smith,Jihye Shin,Michele Mastropietro,Reynier F. Peletier,Peter Tino

DOI: https://doi.org/10.1109/TKDE.2022.3177368

2022-06-13

Abstract:Dimensionality reduction and clustering are often used as preliminary steps for many complex machine learning tasks. The presence of noise and outliers can deteriorate the performance of such preprocessing and therefore impair the subsequent analysis tremendously. In manifold learning, several studies indicate solutions for removing background noise or noise close to the structure when the density is substantially higher than that exhibited by the noise. However, in many applications, including astronomical datasets, the density varies alongside manifolds that are buried in a noisy background. We propose a novel method to extract manifolds in the presence of noise based on the idea of Ant colony optimization. In contrast to the existing random walk solutions, our technique captures points that are locally aligned with major directions of the manifold. Moreover, we empirically show that the biologically inspired formulation of ant pheromone reinforces this behavior enabling it to recover multiple manifolds embedded in extremely noisy data clouds. The algorithm performance in comparison to state-of-the-art approaches for noise reduction in manifold detection and clustering is demonstrated, on several synthetic and real datasets, including an N-body simulation of a cosmological volume.

Machine Learning
Co-Clustering With Manifold And Double Sparse Representation

Fang Li,Sanyuan Zhang

DOI: https://doi.org/10.1007/978-3-319-68935-7_31

2017-01-01

Abstract:Clustering is a fundamental tool that has been applied in dealing with huge volumes of text documents and images. For extracting relevant information from the enormous volumes of available data, some co-clustering algorithms have been proposed and shown to be superior to traditional one-side clustering. In this paper, we proposed a novel co-clustering approach called double sparse manifold learning (DSML). We based our formulation on double sparse constraints and manifold learning which use a modified version of mutual k-nearest neighbor graph to capture the underlying structure, modeled sample-feature relationship from the data reconstruction perspective. We developed an iterative procedure to get the solution. Our method preserves local geometrical structure better. Experiments on three benchmark datasets show that our method can get more promising performance on all analyzed data-sets.
A Clustering Chunking Method Based on Manifold Geodesic Distance

LEI Lin,XIONG Wei,JING Ning,XIAO Jianfu

DOI: https://doi.org/10.13209/j.0479-8023.2013.019

2013-01-01

Abstract:Regarding the Chinese chunker analysis as a procedure of inner-sentence word clustering and chunker type labeling,a grammar function space is constructed at first,and then embedded in a lower dimension space by applying ISOMAP to observe the distribution feature of Chinese word in the embedding space.In the hierarchical clustering algorithm which is aiming at partitioning word into different clusters,the manifold geodesic distance is employed instead of Euclidean distance to measure the similarity between words.The algorithm facilitates the increment of Chinese chunker analysis performance under the condition of appropriate algorithm complexity.
Generalized Clustering and Multi-Manifold Learning with Geometric Structure Preservation

Lirong Wu,Zicheng Liu,Jun Xia,Zelin Zang,Siyuan Li,Stan Z. Li

DOI: https://doi.org/10.1109/WACV51458.2022.00173

2022-01-01

Abstract:Though manifold-based clustering has become a popular research topic, we observe that one important factor has been omitted by these works, namely that the defined clustering loss may corrupt the local and global structure of the latent space. In this paper, we propose a novel Generalized Clustering and Multi-manifold Learning (GCML) framework with geometric structure preservation for generalized data, i.e., not limited to 2-D image data and has a wide range of applications in speech, text, and biology domains. In the proposed framework, manifold clustering is done in the latent space guided by a clustering loss. To overcome the problem that the clustering-oriented loss may deteriorate the geometric structure of the latent space, an isometric loss is proposed for preserving intra-manifold structure locally and a ranking loss for inter-manifold structure globally. Extensive experimental results have shown that GCML exhibits superior performance to counterparts in terms of qualitative visualizations and quantitative metrics, which demonstrates the effectiveness of preserving geometric structure. Code has been made available at: https://github.com/LirongWu/GCML.
Improved manifold clustering algorithm based on density peaks search

Yan-li LIU,Jian-peng ZHANG

DOI: https://doi.org/10.16208/j.issn1000-7024.2016.06.043

2016-01-01

Abstract:For DensityClust algorithm,the main difficulty is that it is hard to measure the similarity of complex manifold structure and determine the number of cluster centers.To solve this problem,a geodesic distance was proposed to judge the neighborhood relationship between samples.Considering both local and global spatial manifold information,the density peak of each sample was calculated.A criterion to decide cluster center was defined according to each sample’s density peak.The automatic-determination cluster center method was designed to decide and select the cluster centers automatically.Experimental results based on several artificial and real-world datasets show its higher accuracy for data with manifold distribution characteristic.
Co-Clustering On Manifolds

Quanquan Gu,Jie Zhou

DOI: https://doi.org/10.1145/1557019.1557063

2009-01-01

Abstract:Co-clustering is based on the duality between data points (e.g. documents) and features (e.g. words), i.e. data points can be grouped based on their distribution on features, while features can be grouped based on their distribution on the data points. In the past decade, several co-clustering algorithms have been proposed and shown to be superior to traditional one-side clustering. However, existing co-clustering algorithms fail to consider the geometric structure in the data, which is essential for clustering data on manifold. To address this problem, in this paper, we propose a Dual Regularized Co-Clustering (DRCC) method based on semi-nonnegative matrix tri-factorization. We deem that not only the data points, but also the features are sampled from some manifolds, namely data manifold and feature manifold respectively. As a result, we construct two graphs, i.e. data graph and feature graph, to explore the geometric structure of data manifold and feature manifold. Then our co-clustering method is formulated as semi-nonnegative matrix tri-factorization with two graph regularizers, requiring that the cluster labels of data points are smooth with respect to the data manifold, while the cluster labels of features are smooth with respect to the feature manifold. We will show that DRCC can be solved via alternating minimization, and its convergence is theoretically guaranteed. Experiments of clustering on many benchmark data sets demonstrate that the proposed method outperforms many state of the art clustering methods.
An Ant Colony Clustering Algorithm Based on Pheromone Diffusion Mechanism

陈圣,李翔

DOI: https://doi.org/10.3969/j.issn.1671-1815.2009.16.018

2009-01-01

Abstract:As an important part of data mining technology,clustering is widely used in many fields. By using distributed parallel computing and positive feedback mechanism,ant colony algorithms have optimal global convergence,and have succeeded in solving many NP-hard problems. A model of pheromone diffusion is introduced to the ant colony clustering algorithm and by using a new designed pheromone update mechanism,a novel ant colony clustering algorithm based on pheromone diffusion mechanism is proposed. The results of experiments show that the new method is improved obviously compare with ant colony clustering algorithm.
An Improved Ant Colony Clustering Algorithm Using Information Entropy

严燕,卢宏涛

DOI: https://doi.org/10.3969/j.issn.1006-9348.2009.08.044

2009-01-01

Abstract:Ant colony clustering algorithm can be realized on the basis of the basic model that imitates the aggregation of dead bodies by ants.The paper validates LF and entropy based ant colony clustering algorithms via proposing the key simulation methods.Comparing the performance of the two algorithms,it is shown that entropy based ant colony clustering algorithm has the defect of easily getting local optimality although it has better convergence compared with LF.The paper intends to propose an improved entropy based ant colony clustering algorithm mainly for solving that problem through cluster splitting,merging and handling of isolated objects.The computational results show that the clustering result and convergence are better than that of the other two methods.
The Research and Application of Ant Colony Algorithm

王剑,李平,杨春节

DOI: https://doi.org/10.3969/j.issn.1001-4551.2003.05.048

2003-01-01

Abstract:Ant colony algorithm was a novel simulated ecosystem evolutionary algorithm. After introducing the essence of the ant colony algorithm and several improved ant colony algorithms, this paper discussed its application in the complicated combinatorial optimization problems, such as the TSP problem, the job-shop scheduling problem, routing in LSI, the telecommunication networks routing problem, and so on.
A Class of Manifold Regularized Multiplicative Update Algorithms for Image Clustering

Shangming Yang,Zhang Yi,Xiaofei He,Xuelong Li

DOI: https://doi.org/10.1109/TIP.2015.2457033

IF: 10.6

2015-01-01

IEEE Transactions on Image Processing

Abstract:Multiplicative update algorithms are important tools for information retrieval, image processing, and pattern recognition. However, when the graph regularization is added to the cost function, different classes of sample data may be mapped to the same subspace, which leads to the increase of data clustering error rate. In this paper, an improved nonnegative matrix factorization (NMF) cost function...
Text Classification and Clustering Based on Ant Colony Algorithms

Yan LI,Yue-guo ZHANG,Sheng-hong LI

DOI: https://doi.org/10.3969/j.issn.1009-8054.2009.10.024

2009-01-01

Abstract:In order to study and improve performance of text classification and clustering, the authors, based on the usage of ant colony algorithm in solving the TSP(travelling salesman problem), modify and use this algorithm in the text classification and clustering.When this algorithm is used to cluster texts, the way for releasing ants? pheromone, and the mode for clustering path-nodes as well should be changed, and finally the similar texts are placed together.In text classification, the information must be told to the ants, which indicates the final categories and is wanted before the process.The experiment indicates the facts that this new method could increase the rate of accuracy, and that the ant colony algorithm could be used in text classification and clustering.
Ant colony search algorithms for optimal packing problem

Wen Peng,Ruofeng Tong,Min Tang,Jinxiang Dong

DOI: https://doi.org/10.1007/11539117_164

2005-01-01

Abstract:Ant Colony optimization takes inspiration from the behavior of real ant colony to solve optimization problems. This paper presents a parallel model for ant colony to solve the optimal packing problem. The problem is represented by a directed graph so that the objective of the original problem becomes to find the shortest closed circuit on the graph under the problem-specific constraints. A number of artificial ants are distributed on the graph and communicate with one another through the pheromone trails which are a form of the long-term memory guiding the future exploration of the graph. The algorithm supports the parallel computation and facilitates quick convergence to the optimal solution. The performance of the proposed method as compared to those of the genetic-based approaches is very promising.
Manifold distance based artificial immune incremental data clustering algorithm

Ruirui Zhang,Tao Li,Xin Xiao,Yuanquan Shi

2013-01-01

Journal of Computational Information Systems

Abstract:The existing artificial immune based incremental data clustering algorithms have some short comings, such as without scalability, adapting to new patterns slowly, and so on. This paper puts forward a manifold distance based artificial immune incremental data clustering algorithm, denoted md-aiNet. The algorithm introduces the manifold distance as the global similarity measure, adopts Euclidean distance as the local similarity measure, and proposes an incremental data clustering method based on the immune response model, simulating the initial response and secondary response in the immune system. Through simulation experiments in artificial datasets and UCI datasets, md-aiNet is better than MSMAIS and ISFaiNet which are influential immune based incremental data clustering algorithms. The algorithm can effectively deal with real-world data clustering problems with complex distributions and higher dimensions, and can extract the intrinsic mode of the data. Especially for the data set with non-spherical distribution, clustering accuracy of the algorithm has raised by 40% than MSMAIS and ISFaiNet. Copyright © 2013 Binary Information Press.
Clustering analysis using manifold kernel concept factorization.

Ping Li,Chun Chen,Jiajun Bu

DOI: https://doi.org/10.1016/j.neucom.2012.02.013

IF: 6

2012-01-01

Neurocomputing

Abstract:Various exponential-growing documents and images have become omnipresent in past decades, and it is of vital importance to group them into clusters upon desired. Matrix factorization is exhibited to help yield encouraging clustering results in previous works, whereas the data manifold structure, which holds plentiful spatial model information, is not fully respected by most existing techniques. And kernel learning is advantageous for unfolding nonlinear structure. Therefore, in this paper we propose a novel clustering approach called Manifold Kernel Concept Factorization (MKCF) that incorporates the manifold kernel learning in concept factorization, which encodes the local geometrical structure in the kernel space. This method efficiently preserves the data semantic structure using graph Laplacian, and the nonlinear manifold learning in the warped RKHS potentially reflects the underlying local geometry of the data. Thus, the concepts consistent with the intrinsic manifold structure are well extracted, and this greatly benefits aggregating documents and images within the same concept into the same cluster. Extensive empirical studies demonstrate that MKCF owns the superiority of achieving the more satisfactory clustering performance as well as deriving the better-represented lower data space.
Clustering Tree-Structured Data on Manifold

Na Lu,Hongyu Miao

DOI: https://doi.org/10.1109/tpami.2015.2505282

IF: 23.6

2016-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Tree-structured data usually contain both topological and geometrical information, and are necessarily considered on manifold instead of euclidean space for appropriate data parameterization and analysis. In this study, we propose a novel tree-structured data parameterization, called Topology-Attribute matrix (T-A matrix), so the data clustering task can be conducted on matrix manifold. We incorporate the structure constraints embedded in data into the non-negative matrix factorization method to determine meta-trees from the T-A matrix, and the signature vector of each single tree can then be extracted by meta-tree decomposition. The meta-tree space turns out to be a cone space, in which we explore the distance metric and implement the clustering algorithm based on the concepts like Fréchet mean. Finally, the T-A matrix based clustering (TAMBAC) framework is evaluated and compared using both simulated data and real retinal images to illustrate its efficiency and accuracy.

An Ant Colony Clustering Algorithm on a Manifold

An Optimized Ant System For Clustering With Elitist Ant And Local Search

Learning Exemplar-Represented Manifolds in Latent Space for Classification.

An Iterative Optimization Clustering Algorithm Based on Manifold Distance

Clustering with Adaptive Manifold Structure Learning

A Robust Density-Based Clustering Algorithm for Multi-Manifold Structure.

LAAT: Locally Aligned Ant Technique for discovering multiple faint low dimensional structures of varying density

Co-Clustering With Manifold And Double Sparse Representation

A Clustering Chunking Method Based on Manifold Geodesic Distance

Generalized Clustering and Multi-Manifold Learning with Geometric Structure Preservation

Improved manifold clustering algorithm based on density peaks search

Co-Clustering On Manifolds

An Ant Colony Clustering Algorithm Based on Pheromone Diffusion Mechanism

An Improved Ant Colony Clustering Algorithm Using Information Entropy

The Research and Application of Ant Colony Algorithm

A Class of Manifold Regularized Multiplicative Update Algorithms for Image Clustering

Text Classification and Clustering Based on Ant Colony Algorithms

Ant colony search algorithms for optimal packing problem

Manifold distance based artificial immune incremental data clustering algorithm

Clustering analysis using manifold kernel concept factorization.

Clustering Tree-Structured Data on Manifold