Abstract:With the wide applications of Gaussian mixture clustering, e.g., in semantic video classification [H. Luo, J. Fan, J. Xiao, X. Zhu, Semantic principal video shot classification via mixture Gaussian, in: Proceedings of the 2003 International Conference on Multimedia and Expo, vol. 2, 2003, pp. 189–192], it is a nontrivial task to select the useful features in Gaussian mixture clustering without class labels. This paper, therefore, proposes a new feature selection method, through which not only the most relevant features are identified, but the redundant features are also eliminated so that the smallest relevant feature subset can be found. We integrate this method with our recently proposed Gaussian mixture clustering approach, namely rival penalized expectation-maximization (RPEM) algorithm [Y.M. Cheung, A rival penalized EM algorithm towards maximizing weighted likelihood for density mixture clustering with automatic model selection, in: Proceedings of the 17th International Conference on Pattern Recognition, 2004, pp. 633–636; Y.M. Cheung, Maximum weighted likelihood via rival penalized EM for density mixture clustering with automatic model selection, IEEE Trans. Knowl. Data Eng. 17(6) (2005) 750–761], which is able to determine the number of components (i.e., the model order selection) in a Gaussian mixture automatically. Subsequently, the data clustering, model selection, and the feature selection are all performed in a single learning process. Experimental results have shown the efficacy of the proposed approach.

Feature Weighted Rival Penalized EM for Gaussian Mixture Clustering: Automatic Feature and Model Selections in a Single Paradigm

A New Feature Selection Method for Gaussian Mixture Clustering

Iterative Feature Selection In Gaussian Mixture Clustering With Automatic Model Selection

Gaussian mixture density modeling and decomposition with weighted likelihood

A Maximum Weighted Likelihood Approach To Simultaneous Model Selection And Feature Weighting In Gaussian Mixture

Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions

Entropy Penalized Automated Model Selection On Gaussian Mixture

Model selection of Gaussian mixture process and its application

Renyi entropy penalized learning algorithm for Gaussian mixture with automated model selection

Regularized Maximum Likelihood Estimation and Feature Selection in Mixtures-of-Experts Models

On Weight Design of Maximum Weighted Likelihood and an Extended EM Algorithm

Harmonious Competition Learning for Gaussian Mixtures

An Efficient Greedy EM Algorithm for Gaussian Mixture for Adaptive Model Selection Using the Kurtosis and Skewness Criterion

The Competitive EM Algorithm for Gaussian Mixtures with BYY Harmony Criterion

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

A generalized competitive learning algorithm on gaussian mixture with automatic model selection

Competitive EM Algorithm for Finite Mixture Models

Gaussian Mixture Learning Via Robust Competitive Agglomeration

A Semi-Supervised Learning Algorithm on Gaussian Mixture with Automatic Model Selection

A Novel Split and Merge EM Algorithm for Gaussian Mixture Model

An Effective Model Selection Criterion for Mixtures of Gaussian Processes.