Abstract:Support tensor machine (STM), as a higher-order extension of support vector machine, is adept at effectively addressing tensorial data classification problems, which maintains the inherent structure in tensors and mitigates the curse of dimensionality. However, it needs to resort to the alternating projection iterative technique, which is very time-consuming. To overcome this shortcoming, we propose an efficient sequential safe static and dynamic screening rule (SS-SDSR) for accelerating STM in this paper. Its main idea is to reduce every projection iterative sub-model by identifying and deleting the redundant variables before and during the training process without sacrificing accuracy. Its construction mainly consists of two parts: (1) The static screening rule and dynamic screening rule are first built based on the variational inequality and duality gap, respectively. (2) The sequential screening process is achieved by using the static screening rule with the different adjacent parameters and applying the dynamic screening rule under the same parameter. In the experiment, on the one hand, to verify the influence of different parameter intervals, screening frequencies, and forms of data on the effectiveness of our method, three experiments on artificial datasets are conducted, which indicate that our method is effective for any forms of data when the parameter interval is small and the screening frequency is appropriate. On the other hand, to demonstrate the feasibility and validity of our SS-SDSR, numerical experiments on eleven vector-based datasets, and six tensor-based datasets are conducted and compared with the other five algorithms. Experimental results illustrate the effectiveness and safety of our SS-SDSR.

Multi-variable Estimation-Based Safe Screening Rule for Small Sphere and Large Margin Support Vector Machine.

A Multi-Class Large Margin Classifier

M-estimator Based Support Vector Machine and Its Application

Novel One-Vs-rest Classifier Based on SVM and Multi-Spheres

A Novel and Safe Two-Stage Screening Method for Support Vector Machine

MMSVC: an Efficient Unsupervised Learning Approach for Large-Scale Datasets.

Multi-task Twin Bounded Support Vector Machine and Its Safe Screening Rule.

Safe Sample Screening for Robust Support Vector Machine

Safe Screening Rules for Accelerating Twin Support Vector Machine Classification

Label Pair of Instances-Based Safe Screening for Multilabel Rank Support Vector Machine

Multiview Structural Large Margin Classifier and Its Safe Acceleration Strategy

A Safe Screening Rule with Bi-level Optimization of $ν$ Support Vector Machine

A two-stage safe screening method for non-convex support vector machine with ramp loss

A Safe Accelerative Approach for Pinball Support Vector Machine Classifier

A Non-Convex Robust Small Sphere and Large Margin Support Vector Machine for Imbalanced Data Classification

Scaling Up Twin Support Vector Regression with Safe Screening Rule.

A Two-Stage Gap Safe Screening Rule for Multi-Label Optimal Margin Distribution Machine

Sequential Safe Static and Dynamic Screening Rule for Accelerating Support Tensor Machine

A Safe Screening Rule for Accelerating Weighted Twin Support Vector Machine.

A Safe Double Screening Strategy for Elastic Net Support Vector Machine

A Safe Screening Based Framework for Support Vector Regression.