Abstract:Model selection is a critical issue in unsupervised learning. Conventionally, model selection is implemented in two phases by some statistical model selection criterion such as Akaike's information criterion (AIC), Bozdogan's consistent Akaike's information criterion (CAIC), Schwarz's Bayesian inference criterion (BIC) which formally coincides with the minimum description length (MDL) criterion, and the cross-validation (CV) criterion. These methods are very time intensive and may become problematic when sample size is small. Recently, the Bayesian Ying-Yang (BYY) harmony learning has been developed as a unified framework with new mechanisms for model selection and regularization. In this thesis we make a systematic investigation on BYY learning as well as several typical model selection criteria for model selection on factor analysis models, Gaussian mixture models, and factor analysis mixture models. For factor analysis models, we develop an improved BYY harmony data smoothing learning criterion BYY-HDS in help of considering the dependence between the factors and observations. We make empirical comparisons of the BYY harmony empirical learning criterion BYY-HEC, BYY-HDS, the BYY automatic model selection method BYY-AUTO, AIC, CAIC, BIC, and CV for selecting the number of factors not only on simulated data sets of different sample sizes, noise variances, data dimensions and factor numbers, but also on two real data sets from air pollution data and sport track records, respectively. The most remarkable findings of our study is that BYY-HDS is superior to its counterparts, especially when the sample size is small. AIC, BYY-HEC, BYY-AUTO and CV have a risk of overestimating, while BIC and CAIC have a risk of underestimating in most cases. BYY-AUTO is superior to other methods in a computational cost point of view. The cross-validation method requires the highest computing cost. (Abstract shortened by UMI.)

Cluster Number Selection for a Small Set of Samples Using the Bayesian Ying-Yang Model

Cluster Number Selection for a Small Set of Samples Using the Bayesian

On the Study of BKYY Cluster Number Selection Criterion for Small Sample Data Set with Bootstrap Technique

Investigation on Several Model Selection Criteria for Determining the Number of Cluster

A Comparative Study Of Several Cluster Number Selection Criteria

Comparison on Bayesian Ying-Yang Theory Based Clustering Number Selection Criterion with Information Theoretical Criteria

Bayesian Ying-Yang System and Theory As a Unified Statistical Learning Approach (VII): Data Smoothing.

Bayesian Ying-Yang Machine, Clustering And Number Of Clusters

Automatic Cluster Number Determination Via BYY Harmony Learning

A Comparative Study on Lagrange Ying-Yang Alternation Method in Gaussian Mixture-Based Clustering

Investigation on Bayesian Ying-Yang Learning for Model Selection in Unsupervised Learning

How Many Clusters?: A Ying-Yang Machine Based Theory for a Classical Open Problem in Pattern Recognition

A comparative study on selection of cluster number and local subspace dimension in the mixture PCA models

A Comparative Study on Data Smoothing Regularization for Local Factor Analysis

New Advances on Bayesian Ying-Yang Learning System with Kullback and Non-Kullback Separation Functionals

The BYY annealing learning algorithm for Gaussian mixture with automated model selection

Selecting the number of clusters, clustering models, and algorithms. A unifying approach based on the quadratic discriminant score

Automated Model Selection of the Two-Layer Mixtures of Gaussian Process Functional Regressions for Curve Clustering and Prediction

Bayesian Clustering with Variable and Transformation Selections

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

Projection-embedded BYY Learning Algorithm for Gaussian Mixture-Based Clustering