Abstract:Background: The recent advancement of microarray technology with lower noise and better affordability makes it possible to determine expression of several thousand genes simultaneously. The differentially expressed genes are filtered first and then clustered based on the expression profiles of the genes. A large number of clustering algorithms and distance measuring matrices are proposed in the literature. The popular ones among them include hierarchal clustering and k-means clustering. These algorithms have often used the Euclidian distance or Pearson correlation distance. The biologists or the practitioners are often confused as to which algorithm to use since there is no clear winner among algorithms or among distance measuring metrics. Several validation indices have been proposed in the literature and these are based directly or indirectly on distances; hence a method that uses any of these indices does not relate to any biological features such as biological processes or molecular functions. Results: In this paper we have proposed a metric to measure the effectiveness of clustering algorithms of genes by computing inter-cluster cohesiveness and as well as the intra-cluster separation with respect to biological features such as biological processes or molecular functions. We have applied this metric to the clusters on the data set that we have created as part of a larger study to determine the cancer suppressive mechanism of a class of chemicals called retinoids.We have considered hierarchal and k-means clustering with Euclidian and Pearson correlation distances. Our results show that genes of similar expression profiles are more likely to be closely related to biological processes than they are to molecular functions. The findings have been supported by many works in the area of gene clustering. Conclusion: The best clustering algorithm of genes must achieve cohesiveness within a cluster with respect to some biological features, and as well as maximum separation between clusters in terms of the distribution of genes of a behavioral group across clusters. We claim that our proposed metric is novel in this respect and that it provides a measure of both inter and intra cluster cohesiveness. Best of all, computation of the proposed metric is easy and it provides a single quantitative value, which makes comparison of different algorithms easier. The maximum cluster cohesiveness and the maximum intra-cluster separation are indicated by the metric when its value is 0.We have demonstrated the metric by applying it to a data set with gene behavioral groupings such as biological process and molecular functions. The metric can be easily extended to other features of a gene such as DNA binding sites and protein-protein interactions of the gene product, special features of the intron-exon structure, promoter characteristics, etc. The metric can also be used in other domains that use two different parametric spaces; one for clustering and the other one for measuring the effectiveness.

An Investigation into Distance Measures in Cluster Analysis

Data Clustering: Integrating Different Distance Measures with Modified k-Means Algorithm

A new distance measurement and its application in K-Means Algorithm

Performance evaluation of K-means clustering algorithm with various distance metrics

A Statistical Information-Based Clustering Approach in Distance Space

Effects of similarity/distance metrics on k-means algorithm with respect to its applications in IoT and multimedia: a review

The Exploitation of Distance Distributions for Clustering

A Novel Effective Distance Measure and a Relevant Algorithm for Optimizing the Initial Cluster Centroids of K-means

Sub-One Quasi-Norm-Based k-Means Clustering Algorithm and Analyses

Analysis of Euclidean Distance and Manhattan Distance in the K-Means Algorithm for Variations Number of Centroid K

Mixed-type Distance Shrinkage and Selection for Clustering via Kernel Metric Learning

Quantifying Distances Between Clusters with Elliptical or Non-Elliptical Shapes

A Review and Evaluation of Elastic Distance Functions for Time Series Clustering

Automatic Recommendation of a Distance Measure for Clustering Algorithms

Subspace Clustering by Directly Solving Discriminative K-means

Effect of Distance Metrics in Determining K-Value in K-Means Clustering Using Elbow and Silhouette Method

K-groups: A Generalization of K-means Clustering

Metric for measuring the effectiveness of clustering of DNA microarray expression

An Effective and Efficient Approach for Clusterability Evaluation

K – Means Algorithm