The interelation in fuzzy clustering

S. Yue,Ping Li,Zheng-you Wang

2004-01-01

Abstract:Abstrset: We examine the structure of several objective fmcliohs in fumy clustering, and annlyze their common ebarnfteristies, by which we mver the interrelation and dnality in these objective Punctions. These results are verified by two corresponding experiments as well.

What problem does this paper attempt to address?

The interrelation in fuzzy clustering

Shihong Yue,Ping Li,Zheng Wang

DOI: https://doi.org/10.1109/ICMLC.2004.1382014

2004-01-01

Abstract:We examine the structure of several objective functions in fuzzy clustering, and analyze their common characteristics, by which we recover the interrelation and duality in these objective functions. These results are verified by two corresponding experiments as well.
A kind of practical fuzzy clustering

Min Yao,Weihong Wang

DOI: https://doi.org/10.1109/WCICA.2002.1021464

2002-01-01

Abstract:Fuzzy clustering is one of the most important fuzzy techniques. This paper adopts a relational degree as similarity measurement between objects, and thus forms relational clustering which may find wide applications in social systems and economic systems. At the same time, this paper presents a kind of recomposed fuzzy clustering which can be used to execute the task of partitioning and evaluation for a lot of objects in many systems effectively.
NEW APPROACHES TO THE FUZZY CLUSTERING VIA AFS THEORY

YAN REN,MINGLI SONG,XIAODONG LIU

2007-01-01

Abstract:In this paper, we study and improve the fuzzy clustering index and clustering algorithm proposed by X. Liu et. al. in IEEE Transactions on Systems, Man, Cybernetics, 2005, and also study the fuzzy clustering problems by the order relation descriptions of the objects on each attribute, instead of the real number descriptions. The new fuzzy clustering algorithm has two main advantages: One is that it can mimic the human reasoning processes and ofier an interpretable clustering algorithm which is represented by some fuzzy sets with deflnite semantic interpretations. Another is the data types of the attributes can be various types or sub-preference relations, even descriptions of human intuitions. Finally, the well known real-world iris data set is used to illustrate accuracy of the new clustering algorithm. A number of illustrative examples show that this approach ofiers a far more ∞exible and efiective means for the intelligent systems in real-world applications.
Adaptive Approach to Fuzzy Clustering

岳士弘,李平,宋执环,谷应鲲

DOI: https://doi.org/10.3785/j.issn.1008-973x.2004.10.010

2004-01-01

Abstract:Fuzzy c-means (FCM) algorithm has noise-sensitivity and lacks the typicality of membership of point to cluster. An adaptive approach to fuzzy clustering was presented to overcome these problems. The approach could automatically distinguish these important points by multiplying a suitable weight number and these important clusters in dataset. Also, the approach can work well in noisy circumstances and its convergence is proven theoretically. Two experiments were used to verify the effectiveness and efficiency of the proposed approach in this paper.
Fuzzy Tabu Search Method for the Clustering Problem

HB Xu,HJ Wang,CG Li

DOI: https://doi.org/10.1109/icmlc.2002.1174508

2002-01-01

Abstract:In this paper, the clustering problem (CP) of clustering m objects into c clusters is considered. The objects are represented by points in n-dimensional Euclidean space, and the objective is to classify these m points into c groups so that the distance between points within a cluster and its center is minimized. The problem is an optimization problem that has many local minima. In this paper, we develop a novel fuzzy tabu search (FTS) method for solving this problem. Benefits of the proposed algorithm are illustrated by the numerical results. The obtained results are compared with the standard tabu search method.
Fuzzy Clustering with Novel Separable Criterion

Yin Zhonghang,Tang Yuangang,Sun Fuchun,Sun Zengqi

DOI: https://doi.org/10.1016/s1007-0214(06)70154-7

2006-01-01

Abstract:Fuzzy clustering has been used widely in pattern recognition, image processing, and data analysis. An improved fuzzy clustering algorithm was developed based on the conventional fuzzy c-means (FCM) to obtain better quality clustering results. The update equations for the membership and the cluster center are derived from the alternating optimization algorithm. Two fuzzy scattering matrices in the objective function assure the compactness between data points and cluster centers, and also strengthen the separation between cluster centers in terms of a novel separable criterion. The clustering algorithm properties are shown to be an improvement over the FCM method's properties. Numerical simulations show that the clustering algorithm gives more accurate clustering results than the FCM method.
Fuzzy Partitional Clustering Algorithms

Min Zhang,Jian Yu

2004-01-01

Journal of Software

Abstract:Fuzzy partitional clustering algorithms are widely used in pattern recognition field. Until now, more and more research results on them have been developed in the literature. In order to study these algorithms systematically and deeply, they are reviewed in this paper based on c-means algorithm, from metrics, entropy, and constraints on membership function or cluster centers. Moreover, the advantages and disadvantages of the typical fuzzy partitional algorithms are discussed. It is pointed out that the standard FCM algorithm is robust to the scaling transformation of dataset, while others are sensitive to such transformation. Such conclusion is experimentally verified when implementing the standard FCM and the maximum entropy clustering algorithm. Finally, the problems existing in these algorithms and the prospects of the fuzzy partitional algorithms are discussed.
An Improved Fcm Clustering Method For Interval Data

Shen-Ming Gu,Jian-Wen Zhao,Ling He

DOI: https://doi.org/10.1007/978-3-642-16248-0_74

2010-01-01

Abstract:In fuzzy c-means (FCM) clustering algorithm, each data point belongs to a cluster with a degree specified by a membership grade. Furthermore, FCM partitions a collection of vectors in c fuzzy groups and finds a cluster center in each group so that the objective function is minimized. This paper introduces a clustering method for objects described by interval data. It extends the FCM clustering algorithm by using combined distances. Moreover, simulated experiments with interval data sets have been performed in order to show the usefulness of this method.
FRCM: A fuzzy rough c -means clustering method

Bin Yu,Zijian Zheng,Mingjie Cai,Witold Pedrycz,Weiping Ding

DOI: https://doi.org/10.1016/j.fss.2024.108860

IF: 4.462

2024-01-13

Fuzzy Sets and Systems

Abstract:Fuzzy c -means (FCM) clustering is a clustering method based on fuzzy theory. This method shows good adaptability by assigning membership values to each sample to represent the degree of membership of the sample to each cluster. However, when dealing with fuzzy boundary data, FCM also generates uncertainty and randomness, which in turn affects the accuracy of clustering results and the number of iterations required for algorithm convergence. In order to solve this problem, fuzzy rough set, as a method of dealing with uncertain data, provides a more accurate and strict description method for the processing of boundary data. Considering this advantage, this paper proposes a new fuzzy rough c -means (FRCM) clustering algorithm to improve the performance and iteration efficiency of FCM. Specifically, in this paper, the similarity based on the Gaussian kernel and the membership information of the object for each cluster are firstly used to construct a fuzzy rough set model to describe the fuzzy roughness between the object and the cluster center, which is used to more accurately represent the relationship between the object and the cluster. Secondly, based on the fuzzy rough model, the fuzzy rough degree of the object is calculated, which is used to describe the approximation degree of the object to the center of each cluster. This fuzzy expression can better handle the fuzzy boundary problem between the object and the cluster center, thereby improving the clustering results and enhancing interpretability. Finally, based on fuzzy rough degree information, the FRCM algorithm is designed. The experimental results show that our proposed method has better performance compared to other comparative clustering methods on both synthetic and real datasets. Specifically, compared to FCM, this algorithm exhibits higher iteration efficiency.

mathematics, applied,statistics & probability,computer science, theory & methods
Fuzzy c-Means Clustering with Discriminative Projection

Bifan Wei,Lingling Zhang,Jun Liu,Yiwei Chen,Wenjun Wu,Xuan Luo

DOI: https://doi.org/10.1109/ICKG52313.2021.00062

2021-12-01

Abstract:The clustering technique plays an important role in data mining and machine learning fields. Clustering for high-dimensional data, such as texts, images, and videos, remains a challenging task due to the existence of many noise features. The widely used methods for this issue focus on mining a effective pattern in high-dimensional data using some dimensionality reduction techniques before clustering. This strategy slightly mitigates the effects of irrelevant and redundant features, but cannot significantly improve the clustering performance because the captured pattern by dimensionality reduction is not directly related to the clustering task. In this paper, we propose a unified framework to achieve discriminative dimensionality reduction and fuzzy clustering for high-dimensional data simultaneously. The proposed framework not only utilizes the clustering results to directly guide or supervise the process of discriminative dimensionality reduction, but also controls the clustering fuzziness more easily by a $F$ -norm regularization term. An efficient optimization algorithm is exploited to address the objective function of our method, which is proved to converge to the local optimal solution in theory. We evaluate the proposed method on three large-scale fine-grained image datasets, including Birds, Flowers, and Cars, for clustering and retrieval two tasks. The experimental results on metrics ACC, NMI, ARI and Recall@K indicate that our method achieves the comparable performance over the state-of-the-art methods.

Computer Science
Fuzzy Smooth Equilibrium Method for Clustering.

Jiaojiao Yang,Zhouwang Yang

DOI: https://doi.org/10.1007/s40815-019-00787-8

IF: 4.085

2020-01-01

International Journal of Fuzzy Systems

Abstract:Clustering model plays an indispensable role in exploring data structures. To extend supervised learning to unsupervised, the maximum margin clustering model has been proposed. Maximum margin-based frameworks develop a powerful tool for supervised learning. It could yield good results by combining with some fuzzy clustering models. However, such methods characterized by high computational cost and are sensitive to the nearest neighbor relationships between data objects. Sometimes, they could lead to degenerate solutions. By reconstructing the Laplacian matrix with different similarity measurements, a new fuzzy smooth equilibrium clustering (FSEC) model is proposed. This model combines MMC with spectral clustering, but there is no need to solve the eigenvalue decomposition problem. Using the equilibrium regularization term can avoid degenerate solutions. Numerous experiments have established the effectiveness of the newly FSEC model.
New Inter-Cluster Proximity Index for Fuzzy C-Means Clustering

Fan Li,Shijin Dai,Qihe Liu,Guowei Yang

DOI: https://doi.org/10.1093/ietisy/e91-d.2.363

2008-01-01

IEICE Transactions on Information and Systems

Abstract:This letter presents a new inter-cluster proximity index for fuzzy partitions obtained from the fuzzy c-means algorithm. It is defined as the average proximity of all possible pairs of clusters. The proximity of each pair of clusters is determined by the overlap and the separation of the two clusters. The former is quantified by using concepts of Fuzzy Rough sets theory and the latter by computing the distance between cluster centroids. Experimental results indicate the efficiency of the proposed index.
Interval-valued possibilistic fuzzy C-means clustering algorithm

Zexuan Ji,Yong Xia,Quansen Sun,Guo Cao

DOI: https://doi.org/10.1016/j.fss.2013.12.011

IF: 4.462

2014-10-01

Fuzzy Sets and Systems

Abstract:Type-2 fuzzy sets have drawn increasing research attentions in the pattern recognition community, since it is capable of modeling various uncertainties that cannot be appropriately managed by usual fuzzy sets. Although it has been introduced to data clustering, most widely used clustering approaches based on type-2 fuzzy sets still suffer from inherent drawbacks, such as the sensitiveness to outliers and initializations. In this paper, we incorporate the interval-valued fuzzy sets into the hybrid fuzzy clustering scheme, and thus propose the interval-valued possibilistic fuzzy c-means (IPFCM) clustering algorithm. We use both fuzzy memberships and possibilistic typicalities to model the uncertainty implied in the data sets, and develop solutions to overcome the difficulties caused by type-2 fuzzy sets, such as the construction of footprint of uncertainty, type-reduction and defuzzification. We compare the proposed algorithm with five fuzzy clustering approaches, including the FCM, PCM, PFCM, IFCM and IPCM, on two-dimensional Gaussian data sets and four multi-dimensional benchmark data sets. We also apply these clustering techniques to segment the brain magnetic resonance images and natural images. Our results show that the proposed IPFCM algorithm is more robust to outliers and initializations and can produce more accurate clustering results.

mathematics, applied,statistics & probability,computer science, theory & methods
An Efficient And Applicable Clustering Algorithm Using Fuzzy Art

Chunbao Chen,Liya Wang

DOI: https://doi.org/10.1109/WCICA.2006.1712953

2006-01-01

Abstract:Lots of clustering algorithms have been developed, and in most of them some parameters should be determined by hand. However, it is very difficult to determine them manually without any prior domain knowledge. To solve this problem, a novel similarity based clustering algorithm was presented. It aimed at avoiding instructional parameters to be determined by hand, and at the same time, improving the efficiency of clustering. By introducing fuzzy Adaptive Resonance Theory (ART) to pre-train the similarity criterion, the instructional parameter was determined dynamically. The new clustering algorithm was analyzed and applied later to cluster the product data. A comparison with K-means shows that this algorithm produced clusters with higher quality and in less time. Validity analysis to the clustering results confirms applicaliflity of this algorithm.
Combining Similarity and Divergence Measures for Intuitionistic Fuzzy Information Clustering

Jiubing Liu,Xianzhong Zhou,Bing Huang,Huaxiong Li,Hengrong Ju

DOI: https://doi.org/10.3233/jifs-18427

2019-01-01

Journal of Intelligent & Fuzzy Systems

Abstract:In the study of intuitionistic fuzzy clustering, the construction of an intuitionistic fuzzy similarity matrix (IFSM) is a fundamental and important issue in the direct clustering analysis, since it determines clustering results and computational efforts. Many methods based on the axioms of intuitionistic fuzzy similarity relations are applicable to IFSM construction. However, most of existing methods may yield a “counterintuitive result” in some cases and consume much computational time. In this paper, we propose a novel intuitionistic fuzzy clustering method to deal with such problems. First, based on the normalized Hamming distance, we define a similarity measure between intuitionistic fuzzy numbers (IFNs), by which a similarity measure between intuitionistic fuzzy sets (IFSs) is induced. Second, a divergence measure between IFSs is obtained by extending the dissimilarity of IFNs. Third, we construct an IFSM by using together the similarity and divergence measures so as to cluster the intuitionistic fuzzy information. Finally, two examples are presented to show the effectiveness and advantages of our method.
A rough set-based fuzzy clustering

Yaqin Zhao,Xianzhong Zhou,Guizhong Tang

DOI: https://doi.org/10.1007/11562382_31

2005-01-01

Abstract:This paper presents a rough set-based fuzzy clustering algorithm in which the objects of fuzzy clustering are initial clusters obtained in terms of equivalence relations. Initial clustering is performed directly by judging whether equivalence relations are equal, not computing the intersection of equivalence classes as usual, and the correctness of the theory is proved using rough set theory. Excessive generation of some small classes is suppressed by secondary clustering on the basis of defining fuzzy similarity between two initial clusters. Consequently the dimension of fuzzy similarity matrix is reduced. The definition of integrated approximation precision is given as evaluation of clustering validity. The algorithm can dynamically adjust parameter to get the optimal result. Some experiments were performed to validate this method. The results showed that the algorithm could handle preferably the clustering problems of both numerical data and nominal data.
A Netting Clustering Analysis Method under Intuitionistic Fuzzy Environment

Zhong Wang,Zeshui Xu,Shousheng Liu,Jian Tang

DOI: https://doi.org/10.1016/j.asoc.2011.05.004

IF: 8.7

2011-01-01

Applied Soft Computing

Abstract:In this paper, we investigate the technique for clustering objects with intuitionistic fuzzy information. We first propose a formula to derive the intuitionistic fuzzy similarity degree between two intuitionistic fuzzy sets and develop an approach to constructing an intuitionistic fuzzy similarity matrix. Then, we present a netting method to make clustering analysis of intuitionistic fuzzy sets via intuitionistic fuzzy similarity matrix. Two numerical examples are given to illustrate and verify our method.
FUZZY DESCRIPTION OF FUZZY DIRECTION RELATIONS AND THEIR SIMILARITIES

Du Shihong,Wang Qiao,Yang Yipeng

2004-01-01

Abstract:Not only spatial objects but also direction relations have the fuzziness. Because conventional quantitative or qualitative methods describing direction relations can't describe fuzziness radically, they will lose information inevitably. In this article, based on the principle which regards the fuzziness as fuzziness rather than crispness, not only the fuzzy partition method and fuzzy membership functions of directions are proposed, but also provide fuzzy description method of direction relations and its fuzzy membership functions between fuzzy objects and crisp objects. In contrast with conventional methods, the method in this article has two advantages: first, a fuzzy partition of direction region allows overlaps between neighboring direction regions but crisp partition does not; second, it uniforms the methods describing direction relations between crisp object and fuzzy object.
Sparsity Fuzzy C-Means Clustering With Principal Component Analysis Embedding

Hui Yang,Hongyun Jiang,Jianyong Zhu,F. Nie,Jingwei Chen

DOI: https://doi.org/10.1109/TFUZZ.2022.3217343

IF: 12.253

2023-07-01

IEEE Transactions on Fuzzy Systems

Abstract:The clustering method has been widely used in data mining, pattern recognition, and image identification. Fuzzy c-means (FCM) is a soft clustering method that introduces the concept of membership. In this method, the fuzzy membership matrix is obtained by calculating the distance between data points in the original space. However, these methods may yield suboptimal results owing to the influence of redundant features. Moreover, FCM is always sensitive to noise points and heavily subject to outliers. In this article, we propose a method called sparsity FCM clustering with principal component analysis embedding (P_SFCM). We simultaneously conduct principal component analysis and membership learning, and then add an additional weighting factor for each data point. The goal of this operation is to identify the noise or outliers. Overall, the benefit of our framework is that it retains most of the information in the subspace while improving the robustness of the noise. In this article, we employ an iterative optimization algorithm to efficiently solve our model. To verify the reliability of the proposed method, we conduct a convergence analysis, noise robustness analysis, and multicluster experiments. Furthermore, comparative experiments are conducted on both synthetic and real benchmark datasets. The experimental results show that the P_SFCM is competitive with comparable methods.

Computer Science
A Study on Multi-Kernel Intuitionistic Fuzzy C-means Clustering with Multiple Attributes

Shan Zeng,Zhiyong Wang,Rui Huang,Ling Chen,David Feng

DOI: https://doi.org/10.1016/j.neucom.2019.01.042

IF: 6

2019-01-01

Neurocomputing

Abstract:Fuzzy C-means (FCM) clustering has been widely applied in various data-driven applications. While traditional FCM clustering algorithms handle uncertainty with type-2 Fuzzy Sets (T2 FSs), the recently-proposed intuitionistic fuzzy sets (IFSs) have shown advantages for describing vague and uncertain data by taking both membership degree and non-membership degree into account. However, intuitionistic fuzzy C-means (IFCM) algorithms generally do not take the importance of individual attributes and the structure of the data into account, when multi-modal and imbalanced features are involved in an application. Therefore, in this paper, we propose to address this issue of IFCM with multi-kernel mapping. First, different types of features are grouped. Second, a composite kernel is constructed to map each attribute group into an individual kernel space and to linearly combine these kernels with optimimal weights. Comprehensive experiments have been conducted on a wide range of datasets, such as machine learning repository (UCI) dataset, fabric dataset, hyperspectral imaging classification and MRI brain images segmentation to demonstrate the superior performance of the proposed clustering algorithm in comparison with the state-of-the-art in the field. (C) 2019 Elsevier B.V. All rights reserved.

The interelation in fuzzy clustering

The interrelation in fuzzy clustering

A kind of practical fuzzy clustering

NEW APPROACHES TO THE FUZZY CLUSTERING VIA AFS THEORY

Adaptive Approach to Fuzzy Clustering

Fuzzy Tabu Search Method for the Clustering Problem

Fuzzy Clustering with Novel Separable Criterion

Fuzzy Partitional Clustering Algorithms

An Improved Fcm Clustering Method For Interval Data

FRCM: A fuzzy rough c -means clustering method

Fuzzy c-Means Clustering with Discriminative Projection

Fuzzy Smooth Equilibrium Method for Clustering.

New Inter-Cluster Proximity Index for Fuzzy C-Means Clustering

Interval-valued possibilistic fuzzy C-means clustering algorithm

An Efficient And Applicable Clustering Algorithm Using Fuzzy Art

Combining Similarity and Divergence Measures for Intuitionistic Fuzzy Information Clustering

A rough set-based fuzzy clustering

A Netting Clustering Analysis Method under Intuitionistic Fuzzy Environment

FUZZY DESCRIPTION OF FUZZY DIRECTION RELATIONS AND THEIR SIMILARITIES

Sparsity Fuzzy C-Means Clustering With Principal Component Analysis Embedding

A Study on Multi-Kernel Intuitionistic Fuzzy C-means Clustering with Multiple Attributes