Abstract:Multi-label classification has revealed broad applications and outstanding importance in machine learning and data mining. In the multi-label domain, in addition to the problems including large instance size and high-dimensional features which need to be addressed urgently, the dimensionality of label space is increasing rapidly, leading to high computational overhead and curse of dimensionality. For tackling this issue, a typical technique called label space dimensionality reduction (LSDR) has been proposed, whose various corresponding methods are responsible for converting the high-dimensional label space into a low-dimensional one, including label embedding (LE) and label selection (LS), and then solve a low-dimensional classification or regression problem efficiently. In this paper, we focus on LE approaches, whose performance greatly depends on a preferable LE criterion. We investigate the conditional covariance operator, which originally is a nonlinear kernel-based dependence between two random vectors, formulated as a trace operation including label Gram matrix and feature Gram inverse matrix. We simplify this operator with linear label kernel matrix, which is then maximized under orthonormal constraints, resulting in an eigenvector problem. Therefore, our compression and recovery matrices correspond to those eigenvectors with several top-ranked eigenvalues. Our proposed novel LE method based on conditional covariance maximization is termed as ML-CCM for short. The experiments on four public benchmark data sets demonstrate that our proposed technique is statistically superior to three state-of-the-art LE methods on the basis of two performance evaluation metrics.

Can the Virtual Labels Obtained by Traditional LP Approaches Be Well Encoded in WLR?

Semisupervised Dimensionality Reduction and Classification Through Virtual Label Regression

Recursive Orthogonal Label Regression: A Framework for Semi-supervised Dimension Reduction

A Novel Discriminative Virtual Label Regression Method for Unsupervised Feature Selection

Leveraging Local Variance for Pseudo-Label Selection in Semi-supervised Learning

Label Propagation Through Linear Neighborhoods

Semi-supervised Vector-valued Learning: Improved Bounds and Algorithms

Semi-supervised Discriminant Analysis Based on Sparse-Coding Theory

A Label Embedding Method via Conditional Covariance Maximization for Multi-label Classification.

Label Augmentation with Reinforced Labeling for Weak Supervision

Label Walking Nonnegative Matrix Factorization

A Local-Density-Ratio Based Algorithm for Setting Weight in Weighted Least Squares Support Vector Machine

Learning under Label Proportions for Text Classification

Variational Label Enhancement

Streaming Label Learning for Modeling Labels on the Fly.

A soft label based linear discriminant analysis for semi-supervised dimensionality reduction

Long-Tailed Partial Label Learning Via Dynamic Rebalancing

Robust Long-Tailed Learning Via Label-Aware Bounded CVaR

Identification of LPV System Using Locally Weighted Technique

Towards Understanding Label Smoothing

Label Distribution Learning: A Local Collaborative Mechanism