Image Clustering Based on Deep Sparse Representations

Le Lv,Dongbin Zhao,Qingqiong Deng
DOI: https://doi.org/10.1109/ssci.2016.7850110
2016-01-01
Abstract:Currently, the supervised trained deep neural networks (DNNs) have been successfully applied in several image classification tasks. However, how to extract powerful data representations and discover semantic concepts from unlabeled data is a more practical issue. Unsupervised feature learning methods aim at extracting abstract representations from unlabeled data. Large amount of research works illustrate that these representations can be directly used in the supervised tasks. However, due to the high dimensionality of these representations, it is difficult to discover the categorical concepts among them in an unsupervised way. In this paper, we propose combining the winner-take-all autoencoder with the bipartite graph partitioning algorithm to cluster unlabeled image data. The winner-take-all autoencoder can learn the additive sparse representations. By the experiments, we present the properties of the sparse representations. The bipartite graph partitioning can take full advantage of them and generate semantic clusters. We discover that the confident instances in each cluster are well discriminated. Based on the initial clustering result, we further train a support vector machine (SVM) to refine the clusters. Our method can discover the categorical concepts rapidly and the experiment shows that the clustering performance of our method is good.
What problem does this paper attempt to address?