The Verification of a New Fuzzy Clustering Validity Index

Chunde Bao

2012-01-01

Abstract:According to the improving idea of Vcso,we defined the separation and proposed a new fuzzy clustering validity index Vnew.Theoretical proof and experimental analysis showed that the fuzzy clustering validity index is reliability.

What problem does this paper attempt to address?

A New Validity Index Based on Intra-Cluster Variation and Inter-Cluster Overlap

BEN Sheng-lan,SU Guang-da

DOI: https://doi.org/10.16136/j.joel.2010.02.024

2010-01-01

Abstract:The determination of cluster number is still an open problem for fuzzy C-means clustering In this paper,a new validity index is proposed to evaluate partition and determine the optimal number of clusters for fuzzy clustering. In a good partition,the similarities of patterns in a cluster should be maxi-mized and the clusters should be well separated Intra-cluster variation and inter-cluster overlap are de-fined to measure the similarities within a cluster and the separation between clusters respectively. The validity index is defined based on the two measurements. Experimental results on four artifiaal datasets and two real datasets show the effeaiveness and robustness of the proposed validity index.
On the Index of Cluster Validity

SH Yue,P Li,ZH Song

2005-01-01

Abstract:The index of cluster validity is very useful in cluster algorithm. The number of clusters to choose in any index of cluster validity is the most important parameter in the sense that other parameters of the cluster algorithm really have second effect. In this paper, an important theorem on the variance ratio of index of cluster validity is proven, which shows that the variance ratio is closely related to a characteristic scale in clustering process and linearly linear relation as the characteristic scale is varied. Likewise two basic principles for designing the indexes of clustering validity are presented. Based on these results and the divisibility of clusters in dataset, four new equations about the lower and upper bounds of real number of clusters are derived. Furthermore, facing the density-and grid-based clustering algorithms two new approaches for computing the indexes of cluster validity are proposed, and these approaches show some new and instructive design ways. Also, two experiments are used to verify the effectiveness of these approaches in this paper.
A GROUP OF NEW INDEXES OF CLUSTER VALIDITY

岳士弘,李平,于剑

DOI: https://doi.org/10.3969/j.issn.1003-6059.2004.04.025

2004-01-01

Abstract:We examined several popular indexes of cluster validity and showed the laws that they must obey. A group of new indexes of cluster validity was presented to calculate the lower and upper bound of real cluster number in dataset. The group of indexes of cluster validity can be performed efficiently in dataset with arbitrary-shaped and density-skewed clusters. Two experiments were used to verify the effectiveness of the design in this paper.
A new validity measure for fuzzy c-means clustering

Dae-Won Kim,Kwang H. Lee

2024-07-09

Abstract:A new cluster validity index is proposed for fuzzy clusters obtained from fuzzy c-means algorithm. The proposed validity index exploits inter-cluster proximity between fuzzy clusters. Inter-cluster proximity is used to measure the degree of overlap between clusters. A low proximity value refers to well-partitioned clusters. The best fuzzy c-partition is obtained by minimizing inter-cluster proximity with respect to c. Well-known data sets are tested to show the effectiveness and reliability of the proposed index.

Artificial Intelligence
A Robust Cluster Validity Index for Fuzzy C-Means Clustering

Yating Hu,Chuncheng Zuo,Yang,Fuheng Qu

DOI: https://doi.org/10.1109/tmee.2011.6199238

2011-01-01

Abstract:Fuzzy c-means clustering algorithm (FCM) is one of the mostly used clustering algorithms. Although several cluster validity have been proposed to execute FCM as unsupervised clustering algorithm, the performance of FCM and its validity index is deeply influenced by the noises and outliers. To solve such problem, a robust cluster validity for FCM is proposed in this paper. The proposed index consists of two terms, i.e., compactness and separation measure. The compactness measure is determined by the fuzzy membership matrix and the cluster number, which indicates the compactness within a cluster. The separation measure is defined as the distance of the different fuzzy sets, which indicates the separability of different clusters. The proposed validity is compared with typical cluster validity indices on six data sets, including two real and four artificial data sets. The experimental results show the effectiveness of the proposed index.
A Fuzzy Cluster Validity Index Based on Clustering Mistake Measures

Sheng-Lan BEN,Guang-Da SU

DOI: https://doi.org/10.3969/j.issn.1003-6059.2010.01.003

2010-01-01

Abstract:The mistakes in fuzzy clustering can be categorized into two types:classifying data originated from different classes into one cluster and classifying data originated from the same class into different clusters.In this paper,intra-class non-consistency and inter-class overlapping are defined to measure the two kinds of mistakes respectively.A good fuzzy partition is expected to have few clustering mistakes and large compactness.Based on the two mistake measures and cluster compactness,a cluster validity index is proposed to evaluate the clustering results.Experimental results show the effectiveness and the robustness of the proposed validity index in determining optimal number of clusters.
A Fuzzy Clustering Validity Index Induced by Triple Center Relation

Yiming Tang,Jiajia Huang,Witold Pedrycz,Bing Li,Fuji Ren

DOI: https://doi.org/10.1109/tcyb.2023.3263215

IF: 11.8

2023-01-01

IEEE Transactions on Cybernetics

Abstract:The existing clustering validity indexes (CVIs) show some difficulties to produce the correct cluster number when some cluster centers are close to each other, and the separation processing mechanism appears simple. The results are imperfect in case of noisy data sets. For this reason, in this study, we come up with a novel CVI for fuzzy clustering, referred to as the triple center relation (TCR) index. The originality of this index is twofold. On the one hand, a new fuzzy cardinality is built on the strength of the maximum membership degree, and a novel compactness formula is constructed by combining it with the within-class weighted squared error sum. On the other hand, starting from the minimum distance between different cluster centers, the mean distance as well as the sample variance of cluster centers in the statistical sense are further integrated. These three factors are combined by means of product to form a triple characterization of the relationship between cluster centers, and hence a 3-D expression pattern of separability is formed. Subsequently, the TCR index is put forward by combining the compactness formula with the separability expression pattern. By virtue of the degenerate structure of hard clustering, we show an important property of the TCR index. Finally, based on the fuzzy C-means (FCMs) clustering algorithm, experimental studies were conducted on 36 data sets (incorporating artificial and UCI data sets, images, the Olivetti face database). For comparative purposes, 10 CVIs were also considered. It has been found that the proposed TCR index performs best in finding the correct cluster number, and has excellent stability.
A Classification of Cluster Validity Indexes Based on Membership Degree and Applications

Nannan Xie,Liang Hu,Nurbol Luktarhan,Kuo Zhao

DOI: https://doi.org/10.1007/978-3-642-23971-7_6

2011-01-01

Abstract:With the widely used of data mining and cluster analysis, cluster validation is attracting increasing attention. In this paper, the concept and development of cluster validation are introduced, then, based on the membership degree, a classification of cluster validity indexes is proposed: cluster validity indexes fit for crisp cluster, cluster validity indexes fit for fuzzy cluster. Based on this, combining with Cluster Validity Analysis Platform (CVAP), describing the two most important usages of cluster validation: to find the optimal number of clusters and to find appropriate clustering algorithms to a particular data set. Experiments give visualization representation of clustering validation process.
CVAP: Validation for Cluster Analyses

Kaijun Wang,Baijie Wang,Liuqing Peng

DOI: https://doi.org/10.2481/dsj.007-020

2009-01-01

Data Science Journal

Abstract:Evaluation of clustering results (or cluster validation) is an important and necessary step in cluster analysis, but it is often time-consuming and complicated work. We present a visual cluster validation tool, the Cluster Validity Analysis Platform (CVAP), to facilitate cluster validation. The CVAP provides necessary methods (e.g., many validity indices, several clustering algorithms and procedures) and an analysis environment for clustering, evaluation of clustering results, estimation of the number of clusters, and performance comparison among different clustering algorithms. It can help users accomplish their clustering tasks faster and easier and help achieve good clustering quality when there is little prior knowledge about the cluster structure of a data set.
Cluster Validity for Fuzzy Criterion Clustering

BD LIU,AO ESOGBUE

DOI: https://doi.org/10.1109/icsmc.1995.538538

1995-01-01

Abstract:Defines a validity measure for fuzzy criterion clustering which is a novel approach to fuzzy clustering that in addition to being non-distance based addresses the cluster validity problem. The model is then recast as a bilevel fuzzy criterion clustering problem. The authors propose an algorithm for this model that solves both the validity and clustering problems. The authors' approach is validated via some sample problems.
Improved Validation Index for Fuzzy Clustering

Yuangang Tang,Fuchun Sun,Zengqi Sun

DOI: https://doi.org/10.1109/acc.2005.1470111

2005-01-01

Abstract:This paper proposes a new validation index for fuzzy clustering in order to eliminate the monotonically decreasing tendency as the number of clusters approaches to the number of data points and avoid the numerical instability of validation index when fuzzy weighting exponent increases. Limit analyses of Xie-Beni index, Kwon index and the proposed index are also considered for the convenience of contrast. Lastly, two numerical examples are presented to show the effectiveness of the proposed validation index.
A validity measure for fuzzy clustering

X.L. Xie,G. Beni

DOI: https://doi.org/10.1109/34.85677

IF: 23.6

1991-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:The authors present a fuzzy validity criterion based on a validity function which identifies compact and separate fuzzy c-partitions without assumptions as to the number of substructures inherent in the data. This function depends on the data set, geometric distance measure, distance between cluster centroids and more importantly on the fuzzy partition generated by any fuzzy algorithm used. The function is mathematically justified via its relationship to a well-defined hard clustering validity function, the separation index for which the condition of uniqueness has already been established. The performance of this validity function compares favorably to that of several others. The application of this validity function to color image segmentation in a computer color vision system for recognition of IC wafer defects which are otherwise impossible to detect using gray-scale image processing is discussed.<>

computer science, artificial intelligence,engineering, electrical & electronic
A New Cluster Validity Function Based on the Modified Partition Fuzzy Degree

Jie Li,Xinbo Gao,Li-cheng Jiao

DOI: https://doi.org/10.1007/978-3-540-25929-9_72

2005-01-01

Abstract:The cluster validity is an important topic of cluster analysis, which is often converted into the determination of the optimal cluster number. Most of the available cluster validity functions are limited for the analysis of numeric data set and ineffective for the categorical data set. For this purpose, a new cluster validity function is presented in this paper, namely the modified partition fuzzy degree. By combining the partition entropy and the partition fuzzy degree, the new cluster validity can be applied to any data set with numeric attributes or categorical attributes. The experimental results illustrate the effectiveness of the proposed cluster validity function.
A New Validity Index Based on Fuzzy Energy and Fuzzy Entropy Measures in Fuzzy Clustering Problems

Ferdinando Di Martino,Salvatore Sessa

DOI: https://doi.org/10.3390/e22111200

IF: 2.738

2020-10-23

Entropy

Abstract:Two well-known drawbacks in fuzzy clustering are the requirement of assigning in advance the number of clusters and random initialization of cluster centers. The quality of the final fuzzy clusters depends heavily on the initial choice of the number of clusters and the initialization of the clusters, then, it is necessary to apply a validity index to measure the compactness and the separability of the final clusters and run the clustering algorithm several times. We propose a new fuzzy C-means algorithm in which a validity index based on the concepts of maximum fuzzy energy and minimum fuzzy entropy is applied to initialize the cluster centers and to find the optimal number of clusters and initial cluster centers in order to obtain a good clustering quality, without increasing time consumption. We test our algorithm on UCI (University of California at Irvine) machine learning classification datasets comparing the results with the ones obtained by using well-known validity indices and variations of fuzzy C-means by using optimization algorithms in the initialization phase. The comparison results show that our algorithm represents an optimal trade-off between the quality of clustering and the time consumption.

physics, multidisciplinary
A New Robust Fuzzy Clustering Validity Index for Imbalanced Data Sets.

Yun Liu,Yanfang Jiang,Tao Hou,Fu Liu

DOI: https://doi.org/10.1016/j.ins.2020.08.041

IF: 8.1

2021-01-01

Information Sciences

Abstract:Determining the number of clusters of a data set, which is usually evaluated by a clustering validity index (CVI), is a significant issue in clustering analysis. While several CVIs have been proposed, the imperfect clustering results of the fuzzy c-means (FCM) clustering algo-rithm on imbalanced data sets may affect their decisions. To address this problem, the impact of imperfect clustering results on the traditional CVI is first analyzed, and it is found that the distance between two imbalanced clusters becomes closer, which will subsequently impact the separation metric. Inspired by this, a new fuzzy CVI called the imbalanced index (IMI) is proposed in this paper. IMI is the ratio of the fuzzy compactness and separation metrics. The main characteristic of IMI is the new definition of the separation metric, in which the imbalance ratio of two clusters is used to enlarge the distance between their centers. IMI is then employed to evaluate the clustering results of FCM on a variety of data sets, and is compared with several well-known CVIs. The experimental results demonstrate that IMI is robust to the imperfect clustering results of FCM caused by imbalanced data distributions and achieves superior performance as compared to other CVIs. (C) 2020 Elsevier Inc. All rights reserved.
A New Validity Index for Fuzzy-Possibilistic C-Means Clustering

Mohammad Hossein Fazel Zarandi,Shahabeddin Sotudian,Oscar Castillo

DOI: https://doi.org/10.48550/arXiv.2005.09162

2020-05-19

Abstract:In some complicated datasets, due to the presence of noisy data points and outliers, cluster validity indices can give conflicting results in determining the optimal number of clusters. This paper presents a new validity index for fuzzy-possibilistic c-means clustering called Fuzzy-Possibilistic (FP) index, which works well in the presence of clusters that vary in shape and density. Moreover, FPCM like most of the clustering algorithms is susceptible to some initial parameters. In this regard, in addition to the number of clusters, FPCM requires a priori selection of the degree of fuzziness and the degree of typicality. Therefore, we presented an efficient procedure for determining their optimal values. The proposed approach has been evaluated using several synthetic and real-world datasets. Final computational results demonstrate the capabilities and reliability of the proposed approach compared with several well-known fuzzy validity indices in the literature. Furthermore, to clarify the ability of the proposed method in real applications, the proposed method is implemented in microarray gene expression data clustering and medical image segmentation.

Machine Learning,Artificial Intelligence,Computer Vision and Pattern Recognition
Volume and Surface Area Based Cluster Validity Index

Qi Li,Shihong Yue,Mingliang Ding

DOI: https://doi.org/10.1109/access.2020.2968938

IF: 3.9

2020-01-01

IEEE Access

Abstract:Cluster validity index plays an important role in assessing the quality of clustering results. However, most of the existing validity indices take a trial-and-error strategy, and their correctness depend on not only the measurements of intra- and inter-cluster distances but also the specific clustering algorithms and data structures. Consequently, the applications of these indices are limited in practice. In this paper, we firstly define the total surface area and volume of all clusters in a 2-dimensinal data space, thereby recovering their natural interrelation among various numbers of clusters. On this basis, a novel validity index is proposed to directly assess the clustering results of any dataset, which does not require any trail-and-error process, clustering algorithms, data structures, or the measurements of intra- and inter-cluster distances. In the case of a high-dimensional data space, all clusters are transformed into spherical clusters of normalized size in a 2-dimensinal data space through a multidimensional scaling transformation. Two groups of typical synthetic datasets and real datasets with various characteristics are used to validate the novel validity index.
Efficient synthetical clustering validity indexes for hierarchical clustering

Qin Xu,Qiang Zhang,Jinpei Liu,Bin Luo

DOI: https://doi.org/10.1016/j.eswa.2020.113367

IF: 8.5

2020-08-01

Expert Systems with Applications

Abstract:<p>Clustering validation and identifying the optimal number of clusters are of great importance in expert and intelligent systems. However, the commonly used similarity measures for validating are not versatile to measure the complex data structure, in reality, some of which are not as effective as that of the used clustering algorithm which gives the clustering results. This paper studies the validity indexes for the hierarchical clustering algorithm and proposes a unified validity index framework. For the single-linkage agglomerative hierarchical clustering we propose two efficient synthetical clustering validity (SCV) indexes using the minimum spanning tree to calculate the intra-cluster compactness to overcome the deficiencies of the measurements in the existing validity indexes. For the general hierarchical clustering, a self-adaptive similarity measure strategy and two generalized synthetical clustering validity (GSCV) indexes, which are the extension of the proposed SCV indexes, are developed. The proposed SCV and GSCV indexes constitute a unified validity index framework, where SCV index is a special case of GSCV index, can avoid the incompatibility of the similarity measure between the clustering and validation. The experimental comparisons with the state-of-the-art validity indexes on artificial and real-world data sets demonstrate the efficiency of the proposed validity indexes in discovering the true number of clusters and dealing with various sorts of data sets, including imbalanced data sets.</p>

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
CLUSTERING VALIDITY FUNCTION BASED ON PARTITION FUZZY DEGREE

宫改云,高新波,伍忠东

DOI: https://doi.org/10.3969/j.issn.1003-6059.2004.04.006

2004-01-01

Abstract:Fuzzy C-mean (FCM) is one of popular and effective algorithms for data partition. However, the reasonable determination of the cluster number, i.e. clustering validity is still an open problem for FCM. For this purpose, by combining the geometrical structure of the data set with its fuzzy partition information, this paper redefines the partition matrix of the data set, and further presents a clustering validity function based on the partition fuzzy degree. Experimental results illustrate the effectiveness and robustness of the proposed clustering validity function.
Validity index for clustering with penalizing method

Jun Wang,Xiyuan Peng,Yu Peng

DOI: https://doi.org/10.1109/ISSCAA.2010.5633028

2010-01-01

Abstract:One of the most difficult problems facing the user of clustering analysis techniques in practice is the objective assessment of the stability and validity of the clusters found by the numerical technique used. The problem of determining the “true” number of clusters has been called the fundamental problem of cluster validity. In this paper, a validity index for clustering with penalizing method is proposed, maximization of which ensures the formation of a small number of compact clusters with large separation between at least two clusters. Experimental results are provided to demonstrate the superiority of this index as compared to five well-known validity indexes by using the k-means and fuzzy c-means algorithms.

The Verification of a New Fuzzy Clustering Validity Index

A New Validity Index Based on Intra-Cluster Variation and Inter-Cluster Overlap

On the Index of Cluster Validity

A GROUP OF NEW INDEXES OF CLUSTER VALIDITY

A new validity measure for fuzzy c-means clustering

A Robust Cluster Validity Index for Fuzzy C-Means Clustering

A Fuzzy Cluster Validity Index Based on Clustering Mistake Measures

A Fuzzy Clustering Validity Index Induced by Triple Center Relation

A Classification of Cluster Validity Indexes Based on Membership Degree and Applications

CVAP: Validation for Cluster Analyses

Cluster Validity for Fuzzy Criterion Clustering

Improved Validation Index for Fuzzy Clustering

A validity measure for fuzzy clustering

A New Cluster Validity Function Based on the Modified Partition Fuzzy Degree

A New Validity Index Based on Fuzzy Energy and Fuzzy Entropy Measures in Fuzzy Clustering Problems

A New Robust Fuzzy Clustering Validity Index for Imbalanced Data Sets.

A New Validity Index for Fuzzy-Possibilistic C-Means Clustering

Volume and Surface Area Based Cluster Validity Index

Efficient synthetical clustering validity indexes for hierarchical clustering

CLUSTERING VALIDITY FUNCTION BASED ON PARTITION FUZZY DEGREE

Validity index for clustering with penalizing method