Abstract:Background: The recent advancement of microarray technology with lower noise and better affordability makes it possible to determine expression of several thousand genes simultaneously. The differentially expressed genes are filtered first and then clustered based on the expression profiles of the genes. A large number of clustering algorithms and distance measuring matrices are proposed in the literature. The popular ones among them include hierarchal clustering and k-means clustering. These algorithms have often used the Euclidian distance or Pearson correlation distance. The biologists or the practitioners are often confused as to which algorithm to use since there is no clear winner among algorithms or among distance measuring metrics. Several validation indices have been proposed in the literature and these are based directly or indirectly on distances; hence a method that uses any of these indices does not relate to any biological features such as biological processes or molecular functions. Results: In this paper we have proposed a metric to measure the effectiveness of clustering algorithms of genes by computing inter-cluster cohesiveness and as well as the intra-cluster separation with respect to biological features such as biological processes or molecular functions. We have applied this metric to the clusters on the data set that we have created as part of a larger study to determine the cancer suppressive mechanism of a class of chemicals called retinoids.We have considered hierarchal and k-means clustering with Euclidian and Pearson correlation distances. Our results show that genes of similar expression profiles are more likely to be closely related to biological processes than they are to molecular functions. The findings have been supported by many works in the area of gene clustering. Conclusion: The best clustering algorithm of genes must achieve cohesiveness within a cluster with respect to some biological features, and as well as maximum separation between clusters in terms of the distribution of genes of a behavioral group across clusters. We claim that our proposed metric is novel in this respect and that it provides a measure of both inter and intra cluster cohesiveness. Best of all, computation of the proposed metric is easy and it provides a single quantitative value, which makes comparison of different algorithms easier. The maximum cluster cohesiveness and the maximum intra-cluster separation are indicated by the metric when its value is 0.We have demonstrated the metric by applying it to a data set with gene behavioral groupings such as biological process and molecular functions. The metric can be easily extended to other features of a gene such as DNA binding sites and protein-protein interactions of the gene product, special features of the intron-exon structure, promoter characteristics, etc. The metric can also be used in other domains that use two different parametric spaces; one for clustering and the other one for measuring the effectiveness.

On triangle inequalities of correlation-based distances for gene expression profiles

A Further Study on Correlation Order

Distance correlation application to gene co-expression network analysis

On Clustering Time Series Using Euclidean Distance and Pearson Correlation

Multivariate regression analysis of distance matrices for testing associations between gene expression patterns and related variables

Diverse correlation structures in gene expression data and their utility in improving statistical inference

Improved distance correlation estimation

The Chi-Square Test of Distance Correlation

Handling Triangle Inequality Violations in Euclidean Distance Based Network Coordinate Systems

Quantitative Correlation Inequalities via Semigroup Interpolation

Partial Distance Correlation with Methods for Dissimilarities

Using Matrix of Thresholding Partial Correlation Coefficients to Infer Regulatory Network

Addressing the Mean-Correlation Relationship in Co-Expression Analysis

Characteristics of Distance Matrices, the Second Look

Metric for measuring the effectiveness of clustering of DNA microarray expression

On the Triangular Inequality of the Subspaces Dissimilarity

Leggett-Garg-like Inequalities from a Correlation Matrix Construction

The Gene Mover's Distance: Single-cell similarity via Optimal Transport

Generalized correlation measure using count statistics for gene expression data with ordered samples

ASYMPTOTIC DISTRIBUTIONS OF HIGH-DIMENSIONAL DISTANCE CORRELATION INFERENCE

Beyond Triangle Inequality: Sifting Noisy and Outlier Distance Measurements for Localization