Abstract:A unified statistical learning approach called Bayesian Ying-Yang (BYY) system and theory has been developed by the present author in recent years. In a sister paper [14], this BYY system and theory has been shown to function as a general theory for unsupervised learning and its extension called semi-unsupervised learning, such that not only several existing popular unsupervised learning approaches are included as special cases, but also a number of new theories and models are provided for unsupervised pattern recognition and cluster analysis, data dimension reduction, and independent component analysis. In this paper, the basic system and theory in [14] is further theoretically justified and extended into a general system and theory with a general implementation technique such that not only those results [14] are kept as special cases still, but also it works for supervised learning and temporal modeling on parameter learning, regularization, structural scale or complexity selection, and architecture design. Particularly, temporal modeling and regression based on Hidden Markov Model (HMM) and the linear and nonlinear state space model are discussed in detail, with an adaptive algorithm proposed for various specific variants of HMM model and state space models. Moreover, the criteria for deciding the number of hidden states in HMM and the order of state space are also proposed. In another sister paper [2] of this proceeding, several specific models and algorithms as well as model selection criteria will be given for dependence reduction, data dimension reduction, independent component analysis, supervised classification and regression. In addition, the relation of the BW learning system and theory to a number of existing learning models and theories has been discussed in [14].

Multisets Modeling Learning: an Unified Theory for Supervised and Unsupervised Learning

A Multi-Task Learning Strategy for Unsupervised Clustering Via Explicitly Separating the Commonality

Multiview Supervised Learning

Theories for Unsupervised Learning: PCA and Its Nonlinear Extensions

A Unified Perspective on Advances of Independent Subspaces: Basic, Temporal, and Local Structures

A Theory of Multimodal Learning

Unsupervised Object-Centric Learning from Multiple Unspecified Viewpoints

Multiple Kernel Subspace Learning for Clustering and Classification

An Overview on Unsupervised Learning from Data Mining Perspective

Deep Multiview Clustering Via Iteratively Self-Supervised Universal and Specific Space Learning

Semi-Supervised Structured Subspace Learning for Multi-View Clustering

A Survey on Multi-view Learning

Supervised structure learning

Comprehensive Semi-Supervised Multi-Modal Learning.

Modeling Nonlinear Manifolds with Mixtures of Localized Principal Subspaces under a Self-Organizing Framework

Unsupervised Multiple Kernel Learning

Multi-Instance Learning from Supervised View

Learning Unseen Modality Interaction

Multi-task self-supervised learning based fusion representation for Multi-view clustering

Bayesian Ying-Yang System and Theory as A Unified Statistical Learning Approach (II): From Unsupervised Learning to Supervised Learning and Temporal Modeling

Multi-View Concept Learning for Data Representation