Abstract:ABSTRACTClustering is a widely used technique in data mining applications to discover patterns in the underlying data. Most traditional clustering algorithms are limited to handling datasets that contain either continuous or categorical attributes. However, datasets with mixed types of attributes are common in real life data mining problems. In this paper, we propose a distance measure that enables clustering data with both continuous and categorical attributes. This distance measure is derived from a probabilistic model that the distance between two clusters is equivalent to the decrease in log-likelihood function as a result of merging. Calculation of this measure is memory efficient as it depends only on the merging cluster pair and not on all the other clusters. Zhang et al [8] proposed a clustering method named BIRCH that is especially suitable for very large datasets. We develop a clustering algorithm using our distance measure based on the framework of BIRCH. Similar to BIRCH, our algorithm first performs a pre-clustering step by scanning the entire dataset and storing the dense regions of data records in terms of summary statistics. A hierarchical clustering algorithm is then applied to cluster the dense regions. Apart from the ability of handling mixed type of attributes, our algorithm differs from BIRCH in that we add a procedure that enables the algorithm to automatically determine the appropriate number of clusters and a new strategy of assigning cluster membership to noisy data. For data with mixed type of attributes, our experimental results confirm that the algorithm not only generates better quality clusters than the traditional k-means algorithms, but also exhibits good scalability properties and is able to identify the underlying number of clusters in the data correctly. The algorithm is implemented in the commercial data mining tool Clementine 6.0 which supports the PMML standard of data mining model deployment.

An Affinity Propagation Clustering Algorithm for Mixed Numeric and Categorical Datasets

Distributed Affinity Propagation Clustering Based on MapReduce

Clustering Mixed Numeric and Categorical Data: A Cluster Ensemble Approach

A k-mean clustering algorithm for mixed numeric and categorical data

Adjustable Preference Affinity Propagation Clustering

A robust and scalable clustering algorithm for mixed type attributes in large database environment.

Scalable Algorithms for Clustering Large Datasets with Mixed Type Attributes

A Novel Density Peaks Clustering Algorithm for Mixed Data

Adaptive Affinity Propagation Clustering

A Density-Adaptive Affinity Propagation Clustering Algorithm Based on Spectral Dimension Reduction

An Entropy-Based Density Peaks Clustering Algorithm for Mixed Type Data Employing Fuzzy Neighborhood

K-ANMI: A Mutual Information Based Clustering Algorithm for Categorical Data

A Similarity Measurement with Entropy-Based Weighting for Clustering Mixed Numerical and Categorical Datasets

A New Weight Based Density Peaks Clustering Algorithm for Numerical and Categorical Data

Cluster Ensemble Method for Databases with Mixed Numeric and Categorical Values

Affinity Propagation Based on K-mutual Nearest Neighbor Consistency

Domain Knowledge Blended Affinity Propagation

A Novel Density Peaks Clustering Algorithm Based on K Nearest Neighbors with Adaptive Merging Strategy

Advancing Spectral Clustering for Categorical and Mixed-Type Data: Insights and Applications

G-ANMI: A Mutual Information Based Genetic Clustering Algorithm for Categorical Data

Summary of Affinity Propagation