Abstract:Over the past two decades, matrix-based or bilinear discriminant analysis (BLDA) methods have received much attention. However, it has been reported that the traditional vector-based regularized LDA (RLDA) is still quite competitive and could outperform BLDA on some benchmark datasets. A central question is whether the superiority of the vector-based RLDA would always hold for general matrix data, or is there any type of matrix data on which BLDA would perform better than RLDA? Actually, the reported comparisons are found to suffer from two limitations: (i) the comparisons are only limited to image data, and (ii) regularized RLDA is compared with non-regularized BLDA. In this paper, we break the two limitations and investigate the central question on another type of matrix data, namely multivariate time series (MTS) data. We propose a new two-parameter regularized BLDA (RBLDA) for MTS data classification. To choose the two parameters, we develop an efficient model selection algorithm. The newly proposed RBLDA enables us to perform a fair comparison between vector-based RLDA and matrix-based RBLDA. Experiments on a number of real MTS data sets are conducted to compare RBLDA with RLDA and evaluate the proposed algorithm. The results reveal that the superiority of the vector-based RLDA does not always hold for general matrix data, and RBLDA outperforms RLDA on MTS data. Moreover, the proposed model selection algorithm is efficient, and RBLDA can produce better visualization of MTS data than RLDA.

Rank-k 2-D Multinomial Logistic Regression for Matrix Data Classification.

Two Dimensional Large Margin Nearest Neighbor for Matrix Classification.

Multiple Rank Multi-Linear SVM for Matrix Data Classification.

Robust Regularized Low-Rank Matrix Models for Regression and Classification

A framework of regularized low-rank matrix models for regression and classification

Efficient Image Classification Via Multiple Rank Regression

Class-Distributed Learning for Multinomial Logistic Regression with High Dimensional Features and a Large Number of Classes

Low-rank kernel regression with preserved locality for multi-class analysis

Semi-Supervised Kernel Discriminative Low-Rank Ridge Regression for Data Classification

Two-sided Matrix Regression

Sr-LDA:Sparse and Reduced-Rank Linear Discriminant Analysis for High Dimensional Matrix

Compound Rank-k Projections for Bilinear Analysis.

Low-rank Discriminative Regression Learning for Image Classification

Matrix-based Vs. Vector-Based Linear Discriminant Analysis: A Comparison of Regularized Variants on Multivariate Time Series Data.

Regularized Matrix Regression

Simultaneous Dimension Reduction and Variable Selection for Multinomial Logistic Regression

L2RM: Low-Rank Linear Regression Models for High-Dimensional Matrix Responses

Kernel Discriminant Learning for Ordinal Regression

A Portmanteau Local Feature Discrimination Approach to the Classification with High-dimensional Matrix-variate Data

Robust Multinomial Logistic Regression Based on RPCA

A procedure of linear discrimination analysis with detected sparsity structure for high-dimensional multi-class classification