Clustering by Scale-Space Filtering

LeungYee,ZhangJiang-She,XuZong-Ben

IF: 23.6

2000-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:In pattern recognition and image processing, the major application areas of cluster analysis, human eyes seem to possess a singular aptitude to group objects and find important structures in an eff...

What problem does this paper attempt to address?

Clustering by Scale-Space Filtering

Yee Leung,Jiang-She Zhang,Zong-Ben Xu

DOI: https://doi.org/10.1109/34.895974

2000-01-01

Abstract:In pattern recognition and image processing, the major application areas of cluster analysis, human eyes seem to possess a singular aptitude to group objects and find important structures in an efficient and effective way. Thus, a clustering algorithm simulating a visual system may solve some basic problems in these areas of research. From this point of view, we propose a new approach to data clustering by modeling the blurring effect of lateral retinal interconnections based on scale space theory. In this approach, a data set is considered as an image with each light point located at a datum position. As we blur this image, smaller light blobs merge into larger ones until the whole image becomes one light blob at a low enough level of resolution. By identifying each blob with a cluster, the blurring process generates a family of clusterings along the hierarchy. The advantages of the proposed approach are: 1) The derived algorithms are computationally stable and insensitive to initialization and they are totally free from solving difficult global optimization problems. 2) It facilitates the construction of new checks on cluster validity and provides the final clustering a significant degree of robustness to noise in data and change in scale. 3) It is more robust in cases where hyperellipsoidal partitions may not be assumed. 4) It is suitable for the task of preserving the structure and integrity of the outliers in the clustering process. 5) The clustering is highly consistent with that perceived by human eyes. 6) The new approach provides a unified framework for scale-related clustering algorithms recently derived from many different fields such as estimation theory, recurrent signal processing on self-organization feature maps, information theory and statistical mechanics, and radial basis function neural networks.
Fuzzy Clustering Algorithms Based on Resolution and Their Application in Image Compression.

XW Kong,RY Wang,GP Li

DOI: https://doi.org/10.1016/s0031-3203(01)00216-3

IF: 8

2002-01-01

Pattern Recognition

Abstract:This paper presents an idea of clustering resolution. On the basis of the idea, fuzzy clustering algorithms based on resolution are deduced, which naturally comprise a set of clustering algorithms. Thus, c-means algorithm and fuzzy c-means algorithms are actually special examples in the set. As an application for codebook design in image compression based on vector quantization, fuzzy clustering algorithms based on multiresolution are developed, which are almost prior to conventional algorithms in all aspects.
Scale Space Based on Clustering Method Integrating Spatial Relationships and Non-Spatial Atrributes

Huang Zhimin,Zhang Xiaodong,Zhang Feng,Ke Weiliang

DOI: https://doi.org/10.1117/12.712636

2006-01-01

Abstract:With the widespread use of spatial data technologies, enormous and complex spatial data have been accumulated, thus the traditional GIS (Geographic Information Systems) spatial analysis methods are confronted with great challenges. Therefore, we need a new spatial analysis method of data-driven rather than model-driven, exploratory rather than reasoning. Spatial clustering, which groups similar spatial objects into classes such that the intra-cluster similarity is maximized and the inter-cluster similarity is minimized, is an important method of spatial data mining([1]). In the article, by virtue of Delaunay diagram, we propose a spatial clustering algorithm, which incorporates spatial relationships with non-spatial attribute. Then the objects whose characters are less obvious are classified into clusters that are more obvious and the precondition is that they are neighbouring, namely they must share the same Delaunay edge. Along with rescaling, the same spatial object presents different states of distribution. We show via experiment of a synthetic data set that our algorithm can integrate spatial relationships and non-spatial attribute. The obtained clustering result is highly consistent with that perceived by human eyes and is capable of recognizing clusters of arbitrary shape.
Identification of Seismic Activities Through Visualization and Scale-Space Filtering

Chengzhi Qin,Yee Leung,Jiangshe Zhang

DOI: https://doi.org/10.1142/9789812774118_0090

IF: 2.777

2006-01-01

Applied Artificial Intelligence

Abstract:The identification of seismic active periods and episodes in spatio-temporal data is a complex scale-related clustering problem. Clustering by scale-space filtering is employed to give a quantitative basis for their identification. Visualization methods are employed to facilitate researchers to interactively assess and judge the clustering results by their domain specific experience in order to obtain the optimal segmentation of the seismic active periods and episodes. The real-life applications in strong earthquakes occurred in Northern China confirms the effectiveness of such an integrative approach.
A Statistical Information-Based Clustering Approach in Distance Space

Yue Shi-hong,Li Ping,Guo Ji-dong,Zhou Shui-geng

DOI: https://doi.org/10.1007/bf02842480

2005-01-01

Journal of Zhejiang University SCIENCE A

Abstract:Clustering, as a powerful data mining technique for discovering interesting data distributions and patterns in the underlying database, is used in many fields, such as statistical data analysis, pattern recognition, image processing, and other business applications. Density-based Spatial Clustering of Applications with Noise (DBSCAN) (Esteret al., 1996) is a good performance clustering method for dealing with spatial data although it leaves many problems to be solved. For example, DBSCAN requires a necessary user-specified threshold while its computation is extremely time-consuming by current method such as OPTICS, etc. (Ankerstet al., 1999), and the performance of DBSCAN under different norms has yet to be examined. In this paper, we first developed a method based on statistical information of distance space in database to determine the necessary threshold. Then our examination of the DBSCAN performance under different norms showed that there was determinable relation between them. Finally, we used two artificial databases to verify the effectiveness and efficiency of the proposed methods.
Massive Data Clustering by Multi-Scale Psychological Observations

Shusen Yang,Liwen Zhang,Chen Xu,Hanqiao Yu,Jianqing Fan,Zongben Xu

DOI: https://doi.org/10.1093/nsr/nwab183

2021-01-01

Abstract:Clustering is the discovery of latent group structure in data and is a fundamental problem in artificial intelligence,and a vital procedure in data-driven scientific research over all disciplines.Yet,existing methods have various limitations,especially we ak cognitive interpretability and poor computational scalability,when it comes to clustering massive datasets that are increasingly available in all domains.Here,by simulating the multi-scale cognitive observation process of humans,we design a scalable algorithm to detect clusters hierarchically hidden in massive datasets.The observation scale changes,following the Weber-Fechner law to capture the gradually emerging meaningful grouping structure.We validated our approach in real datasets with up to a billion records and 2000 dimensions,including taxi trajectories,single-cell gene expressions,face images,computer logs and audios.Our approach outperformed popular methods in usability,efficiency,effectiveness and robustness across different domains.
Density-based Clustering Method by Simulating Visual Systems

WANG Wei-dong,LU Jin-chan,ZHANG Jiang-she

DOI: https://doi.org/10.3969/j.issn.1005-3085.2005.02.026

2005-01-01

Abstract:In pattern recognition, image processing and cluster analysis, human eyes possess a singular aptitude to group objects and find the important structures in an efficient and effective way. In this paper we propose a new data clustering approach by simulating the ability of human eyes based on density-based methods. This algorithm is insensitive to initialization, and can discover clusters of arbitrary shape and find optimal clustering.
Scale-Space Analysis of Discrete Filtering over Arbitrary Triangulated Surfaces

Chunlin Wu,Jiansong Deng,Falai Chen,Xuecheng Tai

DOI: https://doi.org/10.1137/080722758

IF: 1.938

2009-01-01

SIAM Journal on Imaging Sciences

Abstract:Discrete filtering of information over triangulated surfaces has proved very useful in computer graphics applications. This technique is based on diffusion equations and has been extensively applied to image processing, harmonic map regularization and texture generating, etc. [C. L. Bajaj and G. Xu, ACM Trans. Graph., 22 (2003), pp. 4-32], [C. Wu, J. Deng, and F. Chen, IEEE Trans. Vis. Comput. Graph., 14 (2008), pp. 666-679]. However, little has been done on analysis (especially quantitative analysis) of the behavior of these filtering procedures. Since in applications mesh surfaces can be of arbitrary topology and the filtering can be nonlinear and even anisotropic, the analysis of the quantitative behavior is a very difficult issue. In this paper, we first present the discrete linear, nonlinear, and anisotropic filtering schemes via discretizing diffusion equations with appropriately defined differential operators on triangulated surfaces, and then use concepts of discrete scale-spaces to describe these filtering procedures and analyze their properties respectively. Scale-space properties such as existence and uniqueness, continuous dependence on initial value, discrete semigroup property, grey level shift invariance and conservation of total grey level, information reduction (also known as topology simplification), and constant limit behavior have been proved. In particular, the information reduction property is analyzed by eigenvalue and eigenvector analysis of matrices. Different from the direct observation of the local filtering to the diffusion equations and other interpretation methods based on wholly global quantities such as energy and entropy, this viewpoint helps us understand the filtering both globally (information reduction as image components shrink) and locally (how the image component contributes to its shrink rate). With careful consideration of the correspondence between eigenvalues and eigenvectors and their features, differences between linear and nonlinear filtering, as well as between isotropic and anisotropic filtering, are discussed. We also get some stability results of the filtering schemes. Several examples are provided to illustrate the properties.
A New Filtering Method Based on Spatial Clustering

ZHAO Hong-rui,TANG Zhong-shi

2006-01-01

Journal of Computer Applications

Abstract:Some traditional image filters may lose detailed spatial information while controlling noise. The remote sensing image cluster algorithm was introduced and improved, and then a spatial clustering method was presented. Spatial clustering method was helpful to distinguish and protect the image spatial patterns, and was used to separate louder noise that affected the image visual effect. Based on the separation of noise points set (NPS) and signal points set (SPS), NPS was filtered and SPS was fused with weighted averaging method. The result shows that new filter based on spatial clustering technique can remove the image noise. Furthermore, it can protect unpolluted detailed spatial information as much as possible. Better filtering result is got on the case of multi-noise.
Learning a Subspace for Clustering Via Pattern Shrinking

Chenping Hou,Feiping Nie,Yuanyuan Jiao,Changshui Zhang,Yi Wu

DOI: https://doi.org/10.1016/j.ipm.2013.01.004

IF: 7.466

2013-01-01

Information Processing & Management

Abstract:Clustering is a basic technique in information processing. Traditional clustering methods, however, are not suitable for high dimensional data. Thus, learning a subspace for clustering has emerged as an important research direction. Nevertheless, the meaningful data are often lying on a low dimensional manifold while existing subspace learning approaches cannot fully capture the nonlinear structures of hidden manifold. In this paper, we propose a novel subspace learning method that not only characterizes the linear and nonlinear structures of data, but also reflects the requirements of following clustering. Compared with other related approaches, the proposed method can derive a subspace that is more suitable for high dimensional data clustering. Promising experimental results on different kinds of data sets demonstrate the effectiveness of the proposed approach.
Exploiting Unsupervised and Supervised Constraints for Subspace Clustering

Han Hu,Jianjiang Feng,Jie Zhou

DOI: https://doi.org/10.1109/tpami.2014.2377740

IF: 23.6

2015-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Data in many image and video analysis tasks can be viewed as points drawn from multiple low-dimensional subspaces with each subspace corresponding to one category or class. One basic task for processing such kind of data is to separate the points according to the underlying subspace, referred to as subspace clustering. Extensive studies have been made on this subject, and nearly all of them use unconstrained subspace models, meaning the points can be drawn from everywhere of a subspace, to represent the data. In this paper, we attempt to do subspace clustering based on a constrained subspace assumption that the data is further restricted in the corresponding subspaces, e.g., belonging to a submanifold or satisfying the spatial regularity constraint. This assumption usually describes the real data better, such as differently moving objects in a video scene and face images of different subjects under varying illumination. A unified integer linear programming optimization framework is used to approach subspace clustering, which can be efficiently solved by a branch-and-bound (BB) method. We also show that various kinds of supervised information, such as subspace number, outlier ratio, pairwise constraints, size prior and etc., can be conveniently incorporated into the proposed framework. Experiments on real data show that the proposed method outperforms the state-of-the-art algorithms significantly in clustering accuracy. The effectiveness of the proposed method in exploiting supervised information is also demonstrated.
Towards Clustering-friendly Representations: Subspace Clustering Via Graph Filtering

Zhengrui Ma,Zhao Kang,Guangchun Luo,Ling Tian,Wenyu Chen

DOI: https://doi.org/10.1145/3394171.3413597

2020-01-01

Abstract:Finding a suitable data representation for a specific task has been shown to be crucial in many applications. The success of subspace clustering depends on the assumption that the data can be separated into different subspaces. However, this simple assumption does not always hold since the raw data might not be separable into subspaces. To recover the "clustering-friendly" representation and facilitate the subsequent clustering, we propose a graph filtering approach by which a smooth representation is achieved. Specifically, it injects graph similarity into data features by applying a low-pass filter to extract useful data representations for clustering. Extensive experiments on image and document clustering datasets demonstrate that our method improves upon state-of-the-art subspace clustering techniques. Especially, its comparable performance with deep learning methods emphasizes the effectiveness of the simple graph filtering scheme for many real-world applications. An ablation study shows that graph filtering can remove noise, preserve structure in the image, and increase the separability of classes.
Object Searching in Scale-Space

Guang-Rong Ji,Bao-Liang Lu,Xia Chen,Jian Wang

DOI: https://doi.org/10.1109/icsmc.1999.814154

1999-01-01

Abstract:One of the important problems in multi-scale analysis is the detection of feature evolution in scale-space. Using the Laplacian of 2-D Gaussian as the kernel, the detected zero-crossing of a corner in scale-space is an ellipse whose radius of curvature is determined by scale analysis and the slope of the corner's boundary. Based on this result, we propose an object searching method for meso-scale eddy detection in remotely sensed ocean images. The method is based on the strategy of detecting possible eddies from large regions to small regions. Instead of applying the Hough transform directly to the edge map, we first search the position of the eddies by using an ellipse fitting. Then we apply the local Hough transform to each of the candidate sub-regions to detect the regions which have no eddy inside. Finally, we use image segmentation and object recognition techniques to detect the precise positions of the eddies
Smoothed Multi-View Subspace Clustering

Peng Chen,Liang Liu,Zhengrui Ma,Zhao Kang

DOI: https://doi.org/10.1007/978-981-16-5188-5_10

2021-01-01

Abstract:In recent years, multi-view subspace clustering has achieved impressive performance due to the exploitation of complementary imformation across multiple views. However, multi-view data can be very complicated and are not easy to cluster in real-world applications. Most existing methods operate on raw data and may not obtain the optimal solution. In this work, we propose a novel multi-view clustering method named smoothed multi-view subspace clustering (SMVSC) by employing a novel technique, i.e., graph filtering, to obtain a smooth representation for each view, in which similar data points have similar feature values. Specifically, it retains the graph geometric features through applying a low-pass filter. Consequently, it produces a ``clustering-friendly" representation and greatly facilitates the downstream clustering task. Extensive experiments on benchmark datasets validate the superiority of our approach. Analysis shows that graph filtering increases the separability of classes.
Mining Maximal Pattern-Based Subspace Clusters in High Dimensional Space

Lu Yansheng,Hu Rong,Zou Lei,Zhou Chong

DOI: https://doi.org/10.3969/j.issn.1003-7985.2006.04.010

2006-01-01

Abstract:The problem of pattern-based subspace clustering, a special type of subspace clustering that uses pattern similarity as a measure of similarity, is studied. Unlike most traditional clustering algorithms that group the close values of objects in all the dimensions or a set of dimensions, clustering by pattern similarity shows an interesting pattern, where objects exhibit a coherent pattern of rise and fall in subspaces. A novel approach,named EMaPle to mine the maximal pattern-based subspace clusters, is designed. The EMaPle searches clusters only in the attribute enumeration spaces which are relatively few compared to the large number of row combinations in the typical datasets, and it exploits novel pruning techniques. EMaPle can find the clusters satisfying coherent constraints, size constraints and sign constraints neglected in MaPle. Both synthetic data sets and real data sets are used to evaluate EMaPle and demonstrate that it is more effective and scalable than MaPle.
A New Clustering Method Suitable for Large Scale Data

Xu Yin,Hong Xingyong,Zhou Wenjiang,Wang Lunwen,Zhang Ling,Tan Ying

DOI: https://doi.org/10.1109/wcica.2008.4593875

2008-01-01

Abstract:In this paper, constructive neural networks (i.e. CNN) are used to cluster large-scale patterns, and the optimum granularity is chosen by quotient space granularity analysis method. This method not only makes good use of the characteristic of CNN in reducing the computing complexity, but also takes the advantage of quotient space theory in choosing the optimum granularity. So it can cluster large-scale and complicated data effectively. The results of the experiments show the validity of this method.
Scene analysis using scale invariant feature extraction and probabilistic modeling

Bill Buckles,Parthasarathy Guturu,Yao Shen

2011-01-01

Abstract:Conventional pattern recognition systems have two components: feature analysis and pattern classification. For any object in an image, features could be considered as the major characteristic of the object either for object recognition or object tracking purpose. Features extracted from a training image, can be used to identify the object when attempting to locate the object in a test image containing many other objects. To perform reliable scene analysis, it is important that the features extracted from the training image are detectable even under changes in image scale, noise and illumination. Scale invariant feature has wide applications such as image classification, object recognition and object tracking in the image processing area. In this thesis, color feature and SIFT (scale invariant feature transform) are considered to be scale invariant feature. The classification, recognition and tracking result were evaluated with novel evaluation criterion and compared with some existing methods. I also studied different types of scale invariant feature for the purpose of solving scene analysis problems. I propose probabilistic models as the foundation of analysis scene scenario of images. In order to differential the content of image, I develop novel algorithms for the adaptive combination for multiple features extracted from images. I demonstrate the performance of the developed algorithm on several scene analysis tasks, including object tracking, video stabilization, medical video segmentation and scene classification.
A Distance Scaling Method to Improve Density-Based Clustering.

Ye Zhu,Kai Ming Ting,Maia Angelova

DOI: https://doi.org/10.1007/978-3-319-93040-4_31

2018-01-01

Abstract:Density-based clustering is able to find clusters of arbitrary sizes and shapes while effectively separating noise. Despite its advantage over other types of clustering, it is well-known that most density-based algorithms face the same challenge of finding clusters with varied densities. Recently, ReScale, a principled density-ratio preprocessing technique, enables a density-based clustering algorithm to identify clusters with varied densities. However, because the technique is based on one-dimensional scaling, it does not do well in datasets which require multi-dimensional scaling. In this paper, we propose a multi-dimensional scaling method, named DScale, which rescales based on the computed distance. It overcomes the key weakness of ReScale and requires one less parameter while maintaining the simplicity of the implementation. Our empirical evaluation shows that DScale has better clustering performance than ReScale for three existing density-based algorithms, i.e., DBSCAN, OPTICS and DP, on synthetic and real-world datasets.
Flexible Clustering by Tendency in High Dimensional Space

Jinze Liu,Wei Wang

2003-01-01

Abstract:Clustering is the process of grouping a set of objects into classes of similar objects. Until recently, the concept of similarity is based on dis- tances, e.g Euclidean distance and cosine distance. Our previous work on -cluster and -pCluster designed new similarity models to capture subspace coherency exhibited in data and focused on shifting patterns or scaling patterns. Along the same general direction, we propose a more flexible yet powerful clustering model, namely u-Cluster (Up- pattern Cluster). Under this model, two objects are similar in a subset of dimensions if there exist a permutation of these dimensions, along which both objects exhibit a consistent 'up' pattern. For instance, in DNA microarray analysis, the expression levels of two genes can rise synchronously in response to a sequence of environment stimuli. Al- though the magnitude of their expression levels might not be close and the amount by which they rise might not be equivalent, the 'up' pat- terns that they exhibit can be consistent. Discovery of such clusters of genes is essential in revealing significant connections in gene regula- tory networks. In addition, E-Commerce applications such as collabo- rative filtering and stock analysis can also benefit from this model for identifying customer groups that have consistent trends in interests or activities (purchasing, browsing, etc). We also devise an efficient algo- rithm that takes advantage of fast sequential pattern mining to detect such clusters. Its efficiency and effectiveness have been demonstrated through experiments on several real data sets.
A Review on Scale Space Method in Computer Vision

Jian SUN,Zong-ben XU

DOI: https://doi.org/10.3969/j.issn.1005-3085.2005.06.001

2005-01-01

Abstract:PDE method, variational method and mathematical morphology method have been applied in computer vision widely in recent years. As a uniform framework for these methods, scale space method has been one of the most popular research orientations in the field of computer vision. This paper reviews on the main thoughts, theoretical foundations, image processing abilities and implementations of the scale space method. Then we provide some research problems of the scale space method that are worthy of concern.

Clustering by Scale-Space Filtering

Clustering by Scale-Space Filtering

Fuzzy Clustering Algorithms Based on Resolution and Their Application in Image Compression.

Scale Space Based on Clustering Method Integrating Spatial Relationships and Non-Spatial Atrributes

Identification of Seismic Activities Through Visualization and Scale-Space Filtering

A Statistical Information-Based Clustering Approach in Distance Space

Massive Data Clustering by Multi-Scale Psychological Observations

Density-based Clustering Method by Simulating Visual Systems

Scale-Space Analysis of Discrete Filtering over Arbitrary Triangulated Surfaces

A New Filtering Method Based on Spatial Clustering

Learning a Subspace for Clustering Via Pattern Shrinking

Exploiting Unsupervised and Supervised Constraints for Subspace Clustering

Towards Clustering-friendly Representations: Subspace Clustering Via Graph Filtering

Object Searching in Scale-Space

Smoothed Multi-View Subspace Clustering

Mining Maximal Pattern-Based Subspace Clusters in High Dimensional Space

A New Clustering Method Suitable for Large Scale Data

Scene analysis using scale invariant feature extraction and probabilistic modeling

A Distance Scaling Method to Improve Density-Based Clustering.

Flexible Clustering by Tendency in High Dimensional Space

A Review on Scale Space Method in Computer Vision