Abstract:Background: The recent advancement of microarray technology with lower noise and better affordability makes it possible to determine expression of several thousand genes simultaneously. The differentially expressed genes are filtered first and then clustered based on the expression profiles of the genes. A large number of clustering algorithms and distance measuring matrices are proposed in the literature. The popular ones among them include hierarchal clustering and k-means clustering. These algorithms have often used the Euclidian distance or Pearson correlation distance. The biologists or the practitioners are often confused as to which algorithm to use since there is no clear winner among algorithms or among distance measuring metrics. Several validation indices have been proposed in the literature and these are based directly or indirectly on distances; hence a method that uses any of these indices does not relate to any biological features such as biological processes or molecular functions. Results: In this paper we have proposed a metric to measure the effectiveness of clustering algorithms of genes by computing inter-cluster cohesiveness and as well as the intra-cluster separation with respect to biological features such as biological processes or molecular functions. We have applied this metric to the clusters on the data set that we have created as part of a larger study to determine the cancer suppressive mechanism of a class of chemicals called retinoids.We have considered hierarchal and k-means clustering with Euclidian and Pearson correlation distances. Our results show that genes of similar expression profiles are more likely to be closely related to biological processes than they are to molecular functions. The findings have been supported by many works in the area of gene clustering. Conclusion: The best clustering algorithm of genes must achieve cohesiveness within a cluster with respect to some biological features, and as well as maximum separation between clusters in terms of the distribution of genes of a behavioral group across clusters. We claim that our proposed metric is novel in this respect and that it provides a measure of both inter and intra cluster cohesiveness. Best of all, computation of the proposed metric is easy and it provides a single quantitative value, which makes comparison of different algorithms easier. The maximum cluster cohesiveness and the maximum intra-cluster separation are indicated by the metric when its value is 0.We have demonstrated the metric by applying it to a data set with gene behavioral groupings such as biological process and molecular functions. The metric can be easily extended to other features of a gene such as DNA binding sites and protein-protein interactions of the gene product, special features of the intron-exon structure, promoter characteristics, etc. The metric can also be used in other domains that use two different parametric spaces; one for clustering and the other one for measuring the effectiveness.

Unique Metric for Health Analysis with Optimization of Clustering Activity and Cross Comparison of Results from Different Approach

Metric for measuring the effectiveness of clustering of DNA microarray expression

Simulation-derived best practices for clustering clinical data

Data Clustering: Integrating Different Distance Measures with Modified k-Means Algorithm

An Analytical Study on Behavior of Clusters Using K Means, EM and K* Means Algorithm

SA-PSO-GK++: A New Hybrid Clustering Approach for Analyzing Medical Data

Canonical PSO Based k-Means Clustering Approach for Real Datasets

Physically Interpretable Performance Metrics for Clustering

Performance evaluation of K-means clustering algorithm with various distance metrics

H-mrk-means: Enhanced Heuristic mrk-means for Linear Time Clustering of Big Data Using Hybrid Meta-heuristic Algorithm

An Effective and Efficient Approach for Clusterability Evaluation

Performance Evaluation of Threshold-Based and k-means Clustering Algorithms Using Iris Dataset

Silhouette Analysis for Performance Evaluation in Machine Learning with Applications to Clustering

Comparative Analysis of Optimization Strategies for K-means Clustering in Big Data Contexts: A Review

An optimized SVM-RFE based feature selection and weighted entropy K-means approach for big data clustering in mapreduce

New approaches for clustering high dimensional data

Effects of similarity/distance metrics on k-means algorithm with respect to its applications in IoT and multimedia: a review

Performance evaluation of some clustering algorithms and validity indices

Min max kurtosis distance based improved initial centroid selection approach of K-means clustering for big data mining on gene expression data

A New Metrics For Hierarchical Clustering