Robust Ensemble Clustering Using Probability Trajectories

HuangDong,LaiJian-Huang,WangChang-Dong

IF: 9.235

2016-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Although many successful ensemble clustering approaches have been developed in recent years, there are still two limitations to most of the existing approaches. First, they mostly overlook the issu...

What problem does this paper attempt to address?

Robust Ensemble Clustering Using Probability Trajectories.

Dong Huang,Jian-Huang Lai,Chang-Dong Wang

DOI: https://doi.org/10.1109/TKDE.2015.2503753

2016-01-01

Abstract:Although many successful ensemble clustering approaches have been developed in recent years, there are still two limitations to most of the existing approaches. First, they mostly overlook the issue of uncertain links, which may mislead the overall consensus process. Second, they generally lack the ability to incorporate global information to refine the local links. To address these two limitations, in this paper, we propose a novel ensemble clustering approach based on sparse graph representation and probability trajectory analysis. In particular, we present the elite neighbor selection strategy to identify the uncertain links by locally adaptive thresholds and build a sparse graph with a small number of probably reliable links. We argue that a small number of probably reliable links can lead to significantly better consensus results than using all graph links regardless of their reliability. The random walk process driven by a new transition probability matrix is utilized to explore the global information in the graph. We derive a novel and dense similarity measure from the sparse graph by analyzing the probability trajectories of the random walkers, based on which two consensus functions are further proposed. Experimental results on multiple real-world datasets demonstrate the effectiveness and efficiency of our approach.
Robust Object Tracking with a Hierarchical Ensemble Framework

Mengmeng Wang,Yong Liu,Rong Xiong

DOI: https://doi.org/10.1109/iros.2016.7759091

2016-01-01

Abstract:Autonomous robots enjoy a wide popularity nowadays and have been applied in many applications, such as home security, entertainment, delivery, navigation and guidance. It is vital for robots to track objects accurately in real time in these applications, so it is necessary to focus on tracking algorithms to improve the robustness, speed and accuracy. In this paper, we propose a real-time robust object tracking algorithm based on a hierarchical ensemble framework which incorporates information including individual pixel features, local patches and holistic target models. The framework combines multiple ensemble models simultaneously instead of using a single ensemble model individually. A discriminative model which accounts for the matching degree of local patches is adopted via a bottom ensemble layer, and a generative model which exploits holistic templates is used to search for the object based on the middle ensemble layer as well as an adaptive Kalman filter. We test the proposed tracker on challenging benchmark image sequences. The experimental results demonstrate that the proposed tracker performs superiorly against several state-of- the-art algorithms, especially when the appearance changes dramatically and the occlusions occur.
A Probabilistic Approach to Latent Cluster Analysis

Zhipeng Xie,Rui Dong,Zhengheng Deng,Zhenying He,Weidong Yang

2013-01-01

Abstract:Facing a large number of clustering solutions, cluster ensemble method provides an effective approach to aggregating them into a better one. In this paper, we propose a novel cluster ensemble method from probabilistic perspective. It assumes that each clustering solution is generated from a latent cluster model, under the control of two probabilistic parameters. Thus, the cluster ensemble problem is reformulated into an optimization problem of maximum likelihood. An EM-style algorithm is designed to solve this problem. It can determine the number of clusters automatically. Experimenal results have shown that the proposed algorithm outperforms the state-of-the-art methods including EAC-AL, CSPA, HGPA, and MCLA. Furthermore, it has been shown that our algorithm is stable in the predicted numbers of clusters.
Clustering Noisy Trajectories Via Robust Deep Attention Auto-Encoders.

Rui Zhang,Peng Xie,Hongbo Jiang,Chen Wang,Zhu Xiao,Ling Liu

DOI: https://doi.org/10.1109/mdm.2019.00-73

2019-01-01

Abstract:Trajectory clustering aims at grouping similar trajectories into one cluster. It is an efficient way of finding the representative path or common trend shared by different moving objects, and also provides a foundation for movement pattern mining, anomaly detection and other applications. Existing trajectory clustering studies mainly rely on feature selection and similarity measurement based on their geographical and spatial properties. However, one obstacle hindering their wide usage is the problem of clustering accuracy in the presence of noisy or incomplete sensing data, due to limited sensory device quantity, communication errors, sensor failures, and sensor vacancy. This paper proposes an error-tolerant trajectory clustering approach by incorporating denoising methods.We propose the Robust Deep Attention Auto-encoders model (called Robust DAA) to learn the representations of low-dimensional denoising trajectories with three novel features. First, we present the deep attention auto-encoders by integrating the attention mechanism into the classical deep auto-encoder, which is capable of enhancing feature propagation and feature selection. Second, we train the deep attention auto-encoder by applying proximal method, back propagation and the Alternating Direction of Method of Multipliers (ADMM). As a result, our Robust DAA can reduce the negative influence of the noise on trajectory data. Finally, we perform clustering over the low-dimensional denoising representations using traditional clustering algorithms and demonstrates the quality of the clustering results by comparing our approach with existing representative methods. Extensive experiments are conducted on both synthetic datasets and real datasets. The results show that our approach outperforms the existing models in terms of accuracy, precision, recall and f1-score.
Embedding Ensemble Tracking in a Stochastic Framework for Robust Object Tracking

Yu Gu,Ping Li,Bo Han

DOI: https://doi.org/10.1631/jzus.a0820647

2009-01-01

Journal of Zhejiang University SCIENCE A

Abstract:We propose an algorithm of embedding ensemble tracking in a stochastic framework to achieve robust tracking performance under partial occlusion, illumination changes, and abrupt motion. It operates on likelihood images generated by the ensemble method, and combines mean shift and particle filtering in a principled way, where a better proposal distribution is designed by first propagating particles via a motion model, and then running mean shift to move towards their local peaks in the likelihood image. An observation model in the particle filter incorporates global and local information within a region, and an adaptive motion model is adopted to depict the evolution of the object state. The algorithm needs fewer particles to manage the tracking task compared with the general particle filter, and recaptures the object quickly after occlusion occurs. Experiments on two image sequences demonstrate the effectiveness and robustness of the proposed algorithm.
Robust Trajectory Clustering for Motion Segmentation

Feng Shi,Zhong Zhou,Jiangjian Xiao,Wei Wu

DOI: https://doi.org/10.1109/iccv.2013.383

2013-01-01

Abstract:Due to occlusions and objects' non-rigid deformation in the scene, the obtained motion trajectories from common trackers may contain a number of missing or mis-associated entries. To cluster such corrupted point based trajectories into multiple motions is still a hard problem. In this paper, we present an approach that exploits temporal and spatial characteristics from tracked points to facilitate segmentation of incomplete and corrupted trajectories, thereby obtain highly robust results against severe data missing and noises. Our method first uses the Discrete Cosine Transform (DCT) bases as a temporal smoothness constraint on trajectory projection to ensure the validity of resulting components to repair pathological trajectories. Then, based on an observation that the trajectories of foreground and background in a scene may have different spatial distributions, we propose a two-stage clustering strategy that first performs foreground-background separation then segments remaining foreground trajectories. We show that, with this new clustering strategy, sequences with complex motions can be accurately segmented by even using a simple translational model. Finally, a series of experiments on Hopkins 155 dataset and Berkeley motion segmentation dataset show the advantage of our method over other state-of-the-art motion segmentation algorithms in terms of both effectiveness and robustness.
Robust Subspace Clustering Via Thresholding Ridge Regression

Xi Peng,Zhang Yi,Huajin Tang

DOI: https://doi.org/10.1609/aaai.v29i1.9788

2015-01-01

Abstract:Given a data set from a union of multiple linear subspaces, a robust subspace clustering algorithm fits each group of data points with a low-dimensional subspace and then clusters these data even though they are grossly corrupted or sampled from the union of dependent subspaces. Under the framework of spectral clustering, recent works using sparse representation, low rank representation and their extensions achieve robust clustering results by formulating the errors (e.g., corruptions) into their objective functions so that the errors can be removed from the inputs. However, these approaches have suffered from the limitation that the structure of the errors should be known as the prior knowledge. In this paper, we present a new method of robust subspace clustering by eliminating the effect of the errors from the projection space (representation) rather than from the input space. We firstly prove that ell_1-, ell_2-, and ell_infty-norm-based linear projection spaces share the property of intra-subspace projection dominance, i.e., the coefficients over intra-subspace data points are larger than those over inter-subspace data points. Based on this property, we propose a robust and efficient subspace clustering algorithm, called Thresholding Ridge Regression (TRR). TRR calculates the ell2-norm-based coefficients of a given data set and performs a hard thresholding operator; and then the coefficients are used to build a similarity graph for clustering. Experimental studies show that TRR outperforms the state-of-the-art methods with respect to clustering quality, robustness, and time-saving.
Clustering Ensemble Approaches: an Overview

YANG Lin-yun,WANG Wen-yuan

DOI: https://doi.org/10.3969/j.issn.1001-3695.2005.12.003

2005-01-01

Abstract:Ensemble approaches are widely and successfully used in classification algorithms and regression models.It can offer better results for overcoming instabilities in classification algorithms and regression models.However,in unsupervised learning,the researches of ensemble approaches are concerned only in recent years.Because the prior information of data sets in unsupervised learning is unknown,the ensemble approaches of classification algorithms and regression models can't be utilized in the same way directly.Recent researches and experiments show that clustering ensemble approaches can enhance the robustness and stabilities of unsupervised learning greatly.This paper makes an overview of the clustering ensemble approaches in recent years.It illustrates the contents and characteristics of recent clustering ensemble approaches research and discusses the future directions of clustering ensemble study.
A Deep Trajectory Clustering Method Based on Sequence‐to‐sequence Autoencoder Model

Chao Wang,Fangzheng Lyu,Sensen Wu,Yuanyuan Wang,Liuchang Xu,Feng Zhang,Shaowen Wang,Yongheng Wang,Zhenhong Du

DOI: https://doi.org/10.1111/tgis.12905

IF: 2.568

2022-01-01

Transactions in GIS

Abstract:Most existing trajectory clustering methods use point matching similarity measurement strategies to compare trajectory objects; however, such methods have poor similarity measurement accuracy, which reduces clustering quality. To address this research gap, this article considers a combination of trajectory-feature learning and clustering. A deep trajectory clustering (DTC) method toward clustering-friendly spaces is proposed to simultaneously learn trajectory representations (i.e., low-dimensional vectors are used to represent trajectories) and cluster centroids, and further acquire the cluster assignments end to end. We first use a sequence-to-sequence autoencoder network for pretraining to obtain preliminary trajectory vectors, and then jointly optimize the learned representations and cluster centroids under the same framework. The effectiveness of DTC is demonstrated in synthetic datasets, and the learned representations in the real world can be used to identify hot routes in cities.
Enhanced Ensemble Clustering Via Fast Propagation of Cluster-Wise Similarities

Dong Huang,Chang-Dong Wang,Hongxing Peng,Jianhuang Lai,Chee-Keong Kwoh

DOI: https://doi.org/10.1109/tsmc.2018.2876202

2021-01-01

Abstract:Ensemble clustering has been a popular research topic in data mining and machine learning. Despite its significant progress in recent years, there are still two challenging issues in the current ensemble clustering research. First, most of the existing algorithms tend to investigate the ensemble information at the object-level, yet often lack the ability to explore the rich information at higher levels of granularity. Second, they mostly focus on the direct connections (e.g., direct intersection or pair-wise co-occurrence) in the multiple base clusterings, but generally neglect the multiscale indirect relationship hidden in them. To address these two issues, this paper presents a novel ensemble clustering approach based on fast propagation of cluster-wise similarities via random walks. We first construct a cluster similarity graph with the base clusters treated as graph nodes and the cluster-wise Jaccard coefficient exploited to compute the initial edge weights. Upon the constructed graph, a transition probability matrix is defined, based on which the random walk process is conducted to propagate the graph structural information. Specifically, by investigating the propagating trajectories starting from different nodes, a new cluster-wise similarity matrix can be derived by considering the trajectory relationship. Then, the newly obtained cluster-wise similarity matrix is mapped from the cluster-level to the object-level to achieve an enhanced co-association matrix, which is able to simultaneously capture the object-wise co-occurrence relationship as well as the multiscale cluster-wise relationship in ensembles. Finally, two novel consensus functions are proposed to obtain the consensus clustering result. Extensive experiments on a variety of real-world datasets have demonstrated the effectiveness and efficiency of our approach.
Parameter-Free Robust Ensemble Framework of Fuzzy Clustering

Zhaoyin Shi,Long Chen,Weiping Ding,Chuanbin Zhang,Yingxu Wang

DOI: https://doi.org/10.1109/tfuzz.2023.3277692

IF: 12.253

2023-01-01

IEEE Transactions on Fuzzy Systems

Abstract:The ensemble of fuzzy clustering can address the problems presented in the base clustering, such as fluctuations in results due to random initialization and performance degradation due to outliers. However, the performance of fuzzy clustering ensembles is still hampered by some challenges that include misaligned membership matrices, loss of information in the co-similarity matrix, large storage space, unstable ensemble results due to an additional re-clustering, the need for original data information for assistance, etc. To address these issues, we propose a parameter-free robust ensemble framework for fuzzy clustering. After obtaining the set of membership matrices, we cascade these membership matrices and mine the latent spectral matrix of the raw data. Benefiting from this step, we obtain global features of the dataset without knowing the specific data. Then, our framework uses transition matrices to solve the alignment problem, avoiding the storage of large-scale matrices. Most importantly, we introduce a robust weighted mechanism in the optimization model, where each base clustering is adaptively adjusted and the effect of outliers is suppressed by a robust function. In addition, the model yields the results as a membership matrix, which produces the exact partition results directly without any subsequent clustering operations. Finally, since our model is a parameter-free model, the setting of hyper-parameters is avoided and the applicability of the model is improved as well. The effective algorithm of the optimization model is derived and its time complexity and convergence are analyzed. The results of competitive experiments on benchmark data show that the proposed ensemble framework is effective compared to state-of-the-art methods.

computer science, artificial intelligence,engineering, electrical & electronic
Probability Trajectory: One New Movement Description for Trajectory Prediction

Pei Lv,Hui Wei,Tianxin Gu,Yuzhen Zhang,Xiaoheng Jiang,Bing Zhou,Mingliang Xu

DOI: https://doi.org/10.48550/arXiv.2101.10595

2021-01-26

Computer Vision and Pattern Recognition

Abstract:Trajectory prediction is a fundamental and challenging task for numerous applications, such as autonomous driving and intelligent robots. Currently, most of existing work treat the pedestrian trajectory as a series of fixed two-dimensional coordinates. However, in real scenarios, the trajectory often exhibits randomness, and has its own probability distribution. Inspired by this observed fact, also considering other movement characteristics of pedestrians, we propose one simple and intuitive movement description, probability trajectory, which maps the coordinate points of pedestrian trajectory into two-dimensional Gaussian distribution in images. Based on this unique description, we develop one novel trajectory prediction method, called social probability. The method combines the new probability trajectory and powerful convolution recurrent neural networks together. Both the input and output of our method are probability trajectories, which provide the recurrent neural network with sufficient spatial and random information of moving pedestrians. And the social probability extracts spatio-temporal features directly on the new movement description to generate robust and accurate predicted results. The experiments on public benchmark datasets show the effectiveness of the proposed method.
Maximum Joint Probability With Multiple Representations for Clustering

Rui Zhang,Hongyuan Zhang,Xuelong Li

DOI: https://doi.org/10.1109/tnnls.2021.3056420

IF: 14.255

2021-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Classical generative models in unsupervised learning intend to maximize <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.048ex" height="2.843ex" style="vertical-align: -0.838ex; margin-left: -0.089ex;" viewBox="-38.5 -863.1 2173.5 1223.9" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use xlink:href="#MJMAIN-28" x="503" y="0"></use> <use xlink:href="#MJMATHI-58" x="893" y="0"></use> <use xlink:href="#MJMAIN-29" x="1745" y="0"></use></g></svg></span> . In practice, samples may have multiple representations caused by various transformations, measurements, and so on. Therefore, it is crucial to integrate information from different representations, and lots of models have been developed. However, most of them fail to incorporate the prior information about data distribution <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.048ex" height="2.843ex" style="vertical-align: -0.838ex; margin-left: -0.089ex;" viewBox="-38.5 -863.1 2173.5 1223.9" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-70" x="0" y="0"></use> <use xlink:href="#MJMAIN-28" x="503" y="0"></use> <use xlink:href="#MJMATHI-58" x="893" y="0"></use> <use xlink:href="#MJMAIN-29" x="1745" y="0"></use></g></svg></span> to distinguish representations. In this article, we propose a novel clustering framework that attempts to maximize the joint probability of data and parameters. Under this framework, the prior distribution can be employed to measure the rationality of diverse representations. <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.066ex" height="2.176ex" style="vertical-align: -0.338ex;" viewBox="0 -791.3 889.5 936.9" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-4B" x="0" y="0"></use></g></svg></span> -means is a special case of the proposed framework. Meanwhile, a specific clustering model considering both multiple kernels and multiple views is derived to verify the validity of the designed framework and model.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-70" d="M23 287Q24 290 25 295T30 317T40 348T55 381T75 411T101 433T134 442Q209 442 230 378L240 387Q302 442 358 442Q423 442 460 395T497 281Q497 173 421 82T249 -10Q227 -10 210 -4Q199 1 187 11T168 28L161 36Q160 35 139 -51T118 -138Q118 -144 126 -145T163 -148H188Q194 -155 194 -157T191 -175Q188 -187 185 -190T172 -194Q170 -194 161 -194T127 -193T65 -192Q-5 -192 -24 -194H-32Q-39 -187 -39 -183Q-37 -156 -26 -148H-6Q28 -147 33 -136Q36 -130 94 103T155 350Q156 355 156 364Q156 405 131 405Q109 405 94 377T71 316T59 280Q57 278 43 278H29Q23 284 23 287ZM178 102Q200 26 252 26Q282 26 310 49T356 107Q374 141 392 215T411 325V331Q411 405 350 405Q339 405 328 402T306 393T286 380T269 365T254 350T243 336T235 326L232 322Q232 321 229 308T218 264T204 212Q178 106 178 102Z"></path><path stroke-width="1" id="MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="MJMATHI-4B" d="M285 628Q285 635 228 637Q205 637 198 638T191 647Q191 649 193 661Q199 681 203 682Q205 683 214 683H219Q260 681 355 681Q389 681 418 681T463 682T483 682Q500 682 500 674Q500 669 497 660Q496 658 496 654T495 648T493 644T490 641T486 639T479 638T470 637T456 637Q416 636 405 634T387 623L306 305Q307 305 490 449T678 597Q692 611 692 620Q692 635 667 637Q651 637 651 648Q651 650 654 662T659 677Q662 682 676 682Q680 682 711 681T791 680Q814 680 839 681T869 682Q889 682 889 672Q889 650 881 642Q878 637 862 637Q787 632 726 586Q710 576 656 534T556 455L509 418L518 396Q527 374 546 329T581 244Q656 67 661 61Q663 59 666 57Q680 47 717 46H738Q744 38 744 37T741 19Q737 6 731 0H720Q680 3 625 3Q503 3 488 0H478Q472 6 472 9T474 27Q478 40 480 43T491 46H494Q544 46 544 71Q544 75 517 141T485 216L427 354L359 301L291 248L268 155Q245 63 245 58Q245 51 253 49T303 46H334Q340 37 340 35Q340 19 333 5Q328 0 317 0Q314 0 280 1T180 2Q118 2 85 2T49 1Q31 1 31 11Q31 13 34 25Q38 41 42 43T65 46Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Z"></path></defs></svg>
Trajectory clustering: a partition-and-group framework

Jiawei Han,Jae-Gil Lee,K. Whang

DOI: https://doi.org/10.1145/1247480.1247546

2007-06-11

Abstract:Existing trajectory clustering algorithms group similar trajectories as a whole, thus discovering common trajectories. Our key observation is that clustering trajectories as a whole could miss common sub-trajectories. Discovering common sub-trajectories is very useful in many applications, especially if we have regions of special interest for analysis. In this paper, we propose a new partition-and-group framework for clustering trajectories, which partitions a trajectory into a set of line segments, and then, groups similar line segments together into a cluster. The primary advantage of this framework is to discover common sub-trajectories from a trajectory database. Based on this partition-and-group framework, we develop a trajectory clustering algorithm TRACLUS. Our algorithm consists of two phases: partitioning and grouping. For the first phase, we present a formal trajectory partitioning algorithm using the minimum description length(MDL) principle. For the second phase, we present a density-based line-segment clustering algorithm. Experimental results demonstrate that TRACLUS correctly discovers common sub-trajectories from real trajectory data.

Computer Science
Likely, Light, and Accurate Context-Free Clusters-based Trajectory Prediction

Tiago Rodrigues de Almeida,Oscar Martinez Mozos

2023-07-27

Abstract:Autonomous systems in the road transportation network require intelligent mechanisms that cope with uncertainty to foresee the future. In this paper, we propose a multi-stage probabilistic approach for trajectory forecasting: trajectory transformation to displacement space, clustering of displacement time series, trajectory proposals, and ranking proposals. We introduce a new deep feature clustering method, underlying self-conditioned GAN, which copes better with distribution shifts than traditional methods. Additionally, we propose novel distance-based ranking proposals to assign probabilities to the generated trajectories that are more efficient yet accurate than an auxiliary neural network. The overall system surpasses context-free deep generative models in human and road agents trajectory data while performing similarly to point estimators when comparing the most probable trajectory.

Machine Learning
Clustering network-constrained uncertain trajectories

Jingyu Chen,Ping Chen,Qiuyan Huo,Xuezhou Xu

DOI: https://doi.org/10.1109/fskd.2011.6019795

2011-07-01

Abstract:Low sampling-rate and uncertain features of trajectory data present new challenges to trajectories data mining. This paper proposed a relationship graph-based trajectory clustering algorithm for objects moving on road networks. By constructing an approximate minimum spanning tree of a trajectory, based on the spatial distance of candidate segments, a distance measurement scheme is presented to judge the degree of similarity. The relationship graphical model is adopted to represent the network-constrained trajectory data. A modified RepStream clustering algorithm is proposed to retain the stable relationship information. The experiments show that the clustering algorithm has superior accuracy in low sampling-rate and sampling error trajectories data.
Hybrid Cluster Ensemble Framework Based on the Random Combination of Data Transformation Operators

Zhiwen Yu,Hau-San Wong,Jane You,Guoxian Yu,Guoqiang Han

DOI: https://doi.org/10.1016/j.patcog.2011.11.016

IF: 8

2012-01-01

Pattern Recognition

Abstract:Given a dataset P represented by an n×m matrix (where n is the number of data points and m is the number of attributes), we study the effect of applying transformations to P and how this affects the performance of different ensemble algorithms. Specifically, a dataset P can be transformed into a new dataset P′ by a set of transformation operators Φ in the instance dimension, such as sub-sampling, super-sampling, noise injection, and so on, and a corresponding set of transformation operators Ψ in the attribute dimension. Based on these conventional transformation operators Φ and Ψ, a general form Ω of the transformation operator is proposed to represent different kinds of transformation operators. Then, two new data transformation operators, known respectively as probabilistic based data sampling operator and probabilistic based attribute sampling operator, are designed to generate new datasets in the ensemble. Next, three new random transformation operators are proposed, which include the random combination of transformation operators in the data dimension, in the attribute dimension, and in both dimensions respectively. Finally, a new cluster ensemble approach is proposed, which integrates the random combination of data transformation operators across different dimensions, a hybrid clustering technique, a confidence measure, and the normalized cut algorithm into the ensemble framework. The experiments show that (i) random combination of transformation operators across different dimensions outperforms most of the conventional data transformation operators for different kinds of datasets. (ii) The proposed cluster ensemble framework performs well on different datasets such as gene expression datasets and datasets in the UCI machine learning repository.
A Clustering Ensemble Method of Aircraft Trajectory Based on the Similarity Matrix

Xiao Chu,Xianghua Tan,Weili Zeng

DOI: https://doi.org/10.3390/aerospace9050269

IF: 2.66

2022-05-18

Aerospace

Abstract:Performing clustering analysis on a large amount of historical trajectory data can obtain information such as frequent flight patterns of aircraft and air traffic flow distribution, which can provide a reference for the revision of standard flight procedures and the optimization of the division of airspace sectors. At present, most trajectory clustering uses a single clustering algorithm. When other processing remains unchanged, it is difficult to improve the clustering effect by using a single clustering method. Therefore, this paper proposes a trajectory clustering ensemble method based on a similarity matrix. Firstly, a stacked autoencoder is used to learn a small number of features that are sufficiently representative of the trajectory and used as the input to the subsequent clustering algorithm. Secondly, each basis cluster is used to cluster the data set, and then a consistent similarity matrix is obtained by using the clustering results of each basis cluster. On this basis, using the deformation of the matrix as the distance matrix between trajectories, the agglomerative hierarchical clustering algorithm is used to ensemble the results of each basis cluster. Taking the Nanjing Lukou Airport terminal area as an example, the experimental results show that integrating multiple basis clusters eliminates the inherent randomness of a single clustering algorithm, and the trajectory clustering results are more robust.

engineering, aerospace
Probabilistic Cluster Structure Ensemble

Zhiwen Yu,Le Li,Hau-San Wong,Jane You,Guoqiang Han,Yunjun Gao,Guoxian Yu

DOI: https://doi.org/10.1016/j.ins.2014.01.030

IF: 8.1

2014-01-01

Information Sciences

Abstract:Cluster structure ensemble focuses on integrating multiple cluster structures extracted from different datasets into a unified cluster structure, instead of aligning the individual labels from the clustering solutions derived from multiple homogenous datasets in the cluster ensemble framework. In this article, we design a novel probabilistic cluster structure ensemble framework, referred to as Gaussian mixture model based cluster structure ensemble framework (GMMSE), to identify the most representative cluster structure from the dataset. Specifically, GMMSE first applies the bagging approach to produce a set of variant datasets. Then, a set of Gaussian mixture models are used to capture the underlying cluster structures of the datasets. GMMSE applies K-means to initialize the values of the parameters of the Gaussian mixture model, and adopts the Expectation Maximization approach (EM) to estimate the parameter values of the model. Next, the components of the Gaussian mixture models are viewed as new data samples which are used to construct the representative matrix capturing the relationships among components. The similarity between two components corresponding to their respective Gaussian distributions is measured by the Bhattycharya distance function. Afterwards, GMMSE constructs a graph based on the new data samples and the representative matrix, and searches for the most representative cluster structure. Finally, we also design four criteria to assign the data samples to their corresponding clusters based on the unified cluster structure. The experimental results show that (i) GMMSE works well on synthetic datasets and real datasets in the UCI machine learning repository. (ii) GMMSE outperforms most of the previous cluster ensemble approaches.
A Robust Convex Formulation for Ensemble Clustering

Junning Gao,Makoto Yamada,Samuel Kaski,Hiroshi Mamitsuka,Shanfeng Zhu

2016-01-01

Abstract:We formulate ensemble clustering as a regularization problem over nuclear norm and cluster-wise group norm, and present an efficient optimization algorithm, which we call Robust Convex Ensemble Clustering (RCEC). A key feature of RCEC allows to remove anomalous cluster assignments obtained from component clustering methods by using the group-norm regularization. Moreover, the proposed method is convex and can find the globally optimal solution. We first showed that using synthetic data experiments, RCEC could learn stable cluster assignments from the input matrix including anomalous clusters. We then showed that RCEC outperformed state-of-the-art ensemble clustering methods by using real-world data sets.

Robust Ensemble Clustering Using Probability Trajectories

Robust Ensemble Clustering Using Probability Trajectories.

Robust Object Tracking with a Hierarchical Ensemble Framework

A Probabilistic Approach to Latent Cluster Analysis

Clustering Noisy Trajectories Via Robust Deep Attention Auto-Encoders.

Embedding Ensemble Tracking in a Stochastic Framework for Robust Object Tracking

Robust Trajectory Clustering for Motion Segmentation

Robust Subspace Clustering Via Thresholding Ridge Regression

Clustering Ensemble Approaches: an Overview

A Deep Trajectory Clustering Method Based on Sequence‐to‐sequence Autoencoder Model

Enhanced Ensemble Clustering Via Fast Propagation of Cluster-Wise Similarities

Parameter-Free Robust Ensemble Framework of Fuzzy Clustering

Probability Trajectory: One New Movement Description for Trajectory Prediction

Maximum Joint Probability With Multiple Representations for Clustering

Trajectory clustering: a partition-and-group framework

Likely, Light, and Accurate Context-Free Clusters-based Trajectory Prediction

Clustering network-constrained uncertain trajectories

Hybrid Cluster Ensemble Framework Based on the Random Combination of Data Transformation Operators

A Clustering Ensemble Method of Aircraft Trajectory Based on the Similarity Matrix

Probabilistic Cluster Structure Ensemble

A Robust Convex Formulation for Ensemble Clustering