Abstract:Clustering is one of the most effective methods for analyzing datasets that contain a large number of objects with numerous attributes. Clustering seeks to identify groups, or clusters, of similar objects. In low dimensional space, the similarity between objects is often evaluated by summing the difference across all of their attributes. High dimensional data, however, may contain irrelevant attributes which mask the existence of clusters. The discovery of groups of objects that are highly similar within some subsets of relevant attributes becomes an important but challenging task. My thesis focuses on various models and algorithms for this task. We first present a flexible clustering model, namely OP-Cluster (Order Preserving Cluster). Under this model, two objects are similar on a subset of attributes if the values of these two objects induce the same relative ordering of these attributes. OP-Clustering algorithm has demonstrated to be useful to identify co-regulated genes in gene expression data. We also propose a semi-supervised approach to discover biologically meaningful OP-Clusters by incorporating existing gene function classifications into the clustering process. This semi-supervised algorithm yields only OP-clusters that are significantly enriched by genes from specific functional categories. Real datasets are often noisy. We propose a noise-tolerant clustering algorithm for mining frequently occurring itemsets. This algorithm is called approximate frequent itemsets (AFI). Both the theoretical and experimental results demonstrate that our AFI mining algorithm has higher recoverability of real clusters than any other existing itemset mining approaches. Pair-wise dissimilarities are often derived from original data to reduce the complexities of high dimensional data. Traditional clustering algorithms taking pair-wise dissimilarities as input often generate disjoint clusters from pair-wise dissimilarities. It is well known that the classification model represented by disjoint clusters is inconsistent with many real classifications, such gene function classifications. We develop a Poclustering algorithm, which generates overlapping clusters from pair-wise dissimilarities. We prove that by allowing overlapping clusters, Poclustering fully preserves the information of any dissimilarity matrices while traditional partitioning algorithms may cause significant information loss.

A Clustering Algorithm for High-Dimensional Nonlinear Feature Data with Applications

Deep Clustering and Visualization for End-to-End High-Dimensional Data Analysis.

Semi-supervised Hierarchical Clustering Analysis for High Dimensional Data

K-Profiles: A Nonlinear Clustering Method For Pattern Detection In High Dimensional Data

A Cluster Method of Functional Data Analysis

New approaches for clustering high dimensional data

A Mapping- Based Clustering Approach for High Dimensional Data

Application of Sparse Spectral Clustering Algorithm in High-Dimensional Data

Clustering by Detecting Density Peaks and Assigning Points by Similarity-First Search Based on Weighted K-Nearest Neighbors Graph

Nonlinear clustering: methods and applications

High-Attribute Dimensional Sparse Clustering Algorithm Based on Knowledge Granularity

A robust clustering method with noise identification based on directed K-nearest neighbor graph

A Novel Intelligent Clustering Approach For High Dimensional Data In A Big Data Environment

Improved density peaks clustering algorithm combining K-Nearest Neighbors

A Novel Density Peaks Clustering Halo Node Assignment Method Based on K-Nearest Neighbor Theory

An Effective Nonparametric Clustering Algorithm Based on Statistical Features of Neighborhood

Study on Density Peaks Clustering Based on K-Nearest Neighbors and Principal Component Analysis

Automatic Density Clustering with Multiple Kernels for High-Dimension Bioinformatics Data

Clonal Selection Classification Algorithm for High-Dimensional Data

An Enhanced DPCA Fault Diagnosis Method Based on Hierarchical Cluster Analysis

Analysis on High-dimensional Data Classification Method based on Characteristic Subspace