Abstract:Multi-class classification learning can be implemented by the decomposition to binary classification or the direct techniques. The decomposition technique simplifies s the original learning problem into a set of binary subproblems, separately learns each one, and then combines their results to make a final decision. While the direct technique learns a set of multi-class classifiers by directly optimizing one single objective function. Plenty of empirical results have shown that the two techniques achieve comparable performance. However, both the techniques are mainly designed for vector-pattern samples at present. These traditional vector-pattern-oriented decomposition technique has been extended to a new type of matrix-pattern-oriented classifiers which obtain better learning performance and reduce the learning time–cost by utilizing the original structural information of the input matrix. To our best knowledge, no direct multi-class learning method for matrix pattern has been proposed so far. Therefore, this paper aims to propose a direct multi-class classification technique to compensate such a missing, which is a natural extension of the vector-based direct multi-class classification technique. Simultaneously, the left or right vector acting on matrix pattern in the multi-class matrixized objective function plays a role of a tradeoff parameter to balance the capacity of learning and generalization. Finally, based on the original binary-classifier Matrix-pattern-oriented Modified Ho-Kashyap classifier named MatMHKS, we design a corresponding Direct Multi-class Matrixized Learning Machine named McMatMHKS. It is the first direct multi-class classification technique for matrix patterns. To validate both feasibility and effectiveness of McMatMHKS, we conduct the comparative experiments on some benchmark datasets with two multi-class support vector machines and MatMHKS with the decomposition technique including both one-vs-one and one-vs-all. The results show that like its vector-oriented counterpart, McMatMHKS not only has comparable classification accuracy and AUC value, but also owns lower time complexity when compared with its corresponding decomposition machines.

IMAT: Matrix Learning Machine with Interpolation Mapping

Matrixized Learning Machine with Feature-Clustering Interpolation

McMatMHKS: A Direct Multi-Class Matrixized Learning Machine.

Multiple Matrix Learning Machine with Five Aspects of Pattern Information

Matrixized learning machine with modified pairwise constraints

An efficient Kernel-based matrixized least squares support vector machine

Double-fold localized multiple matrixized learning machine

Globalized and Localized Matrix-Pattern-oriented Classification Machine

Three-fold Structured Classifier Design Based on Matrix Pattern.

Entropy-Based Matrix Learning Machine for Imbalanced Data Sets

Locality Sensitive Discriminant Matrixized Learning Machine.

Matrix-Pattern-Oriented Ho-Kashyap Classifier with Regularization Learning

Prior-Induced Information Alignment for Image Matting

A Novel Matrix-Pattern-Oriented Ho-Kashyap Classifier with Locally Spatial Smoothness

New Least Squares Support Vector Machines Based on Matrix Patterns

An Improved Kernel Isomap Algorithm with Application to Image Retrieval

Matrix-pattern-oriented least squares support vector classifier with AdaBoost

DFIMat: Decoupled Flexible Interactive Matting in Multi-Person Scenarios

Regularized Matrix-Pattern-Oriented Classification Machine with Universum

Multi-linear Interactive Matrix Factorization.

Efficient Matrixized Classification Learning with Separated Solution Process