Abstract:Learning features from multiple views has attracted much research attention in different machine learning tasks, such as multiclass and multilabel classification problems. In this paper, we propose a multiclass multilabel multiview learning framework with a linear computational cost where an example is associated with at least one label and represented by multiple information sources. We simultaneously analyze all features by learning an integrated projection matrix. We can also automatically select more important views for subsequent classifier to predict each class. As the proposed objective function is nonsmooth and difficult to solve, we apply a novel optimization method that converts the multiview learning problem to a set of linear single-view learning problems by bridging our problem to an easily solvable approach. Compared to the conventional methods which learn the entire projection matrix, our algorithm independently optimizes each column of the projection matrix for each class, which can be easily parallelized. In each column optimization, the most computationally intensive step is pure and simple matrix-by-vector multiplication. As a result, our algorithm is much more applicable to large-scale problems than the multiview learning methods with a nonlinear computational cost. Moreover, rigorous convergence proof of the proposed algorithm is also provided. To evaluate the effectiveness of the proposed approach, experimental comparisons are made with state-of-the-art algorithms in multiclass and multilabel classification tasks on many multiview benchmarks. We also report the efficiency comparison results on different numbers of data samples. The experimental results demonstrate that our algorithm can achieve superior performance to all the compared algorithms.

Multiview Correlation Feature Learning with Multiple Kernels

Multi-View Correlated Feature Learning by Uncovering Shared Component.

A Multiview Learning Framework with a Linear Computational Cost

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Composite Nonlinear Multiset Canonical Correlation Analysis for Multiview Feature Learning and Recognition

Multi-view kernel machine on single-view data

MultiK-MHKS: a Novel Multiple Kernel Learning Algorithm.

Contrastive Multi-View Kernel Learning.

Laplacian multiset canonical correlations for multiview feature extraction and image recognition

Co-Learning Non-Negative Correlated and Uncorrelated Features for Multi-View Data

Kernelized Multiview Subspace Analysis By Self-Weighted Learning

Robust Kernelized Multiview Self-Representation for Subspace Clustering

Kernel correlation–dissimilarity for Multiple Kernel k-Means clustering

Multi-view uncorrelated linear discriminant analysis with applications to handwritten digit recognition

Kernel Correlation-Dissimilarity for Multiple Kernel k-Means Clustering

Multiple Kernel Subspace Learning for Clustering and Classification

A Dynamic Discriminative Canonical Correlation Analysis via Adaptive Weight Scheme

Nonnegative Constrained Graph Based Canonical Correlation Analysis for Multi-view Feature Learning

A Novel Multi-View Dimensionality Reduction and Recognition Framework with Applications to Face Recognition.

Tensor Canonical Correlation Analysis for Multi-View Dimension Reduction

Multi-View Cosine Similarity Learning with Application to Face Verification