Abstract:Multiview learning (MvL) is an advancing domain in machine learning, leveraging multiple data perspectives to enhance model performance through view-consistency and view-discrepancy. Despite numerous successful multiview-based SVM models, existing frameworks predominantly focus on the consensus principle, often overlooking the complementarity principle. Furthermore, they exhibit limited robustness against noisy, error-prone, and view-inconsistent samples, prevalent in multiview datasets. To tackle the aforementioned limitations, this paper introduces Wave-MvSVM, a novel multiview support vector machine framework leveraging the wave loss (W-loss) function, specifically designed to harness both consensus and complementarity principles. Unlike traditional approaches that often overlook the complementary information among different views, the proposed Wave-MvSVM ensures a more comprehensive and resilient learning process by integrating both principles effectively. The W-loss function, characterized by its smoothness, asymmetry, and bounded nature, is particularly effective in mitigating the adverse effects of noisy and outlier data, thereby enhancing model stability. Theoretically, the W-loss function also exhibits a crucial classification-calibrated property, further boosting its effectiveness. Wave-MvSVM employs a between-view co-regularization term to enforce view consistency and utilizes an adaptive combination weight strategy to maximize the discriminative power of each view. The optimization problem is efficiently solved using a combination of GD and the ADMM, ensuring reliable convergence to optimal solutions. Theoretical analyses, grounded in Rademacher complexity, validate the generalization capabilities of the Wave-MvSVM model. Extensive empirical evaluations across diverse datasets demonstrate the superior performance of Wave-MvSVM in comparison to existing benchmark models.

Multiview Structural Large Margin Classifier and Its Safe Acceleration Strategy

Multi-View Analysis Dictionary Learning for Image Classification.

A Multiview Learning Framework with a Linear Computational Cost

A Multi-Class Large Margin Classifier

Retargeted Multi-View Classification Via Structured Sparse Learning

Multiview Learning With Robust Double-Sided Twin SVM

Safe Multi-View Deep Classification.

Multiview learning with twin parametric margin SVM

Multi-View Support Vector Machines with the Consensus and Complementarity Information

Multi-variable Estimation-Based Safe Screening Rule for Small Sphere and Large Margin Support Vector Machine.

MTKSVCR: A Novel Multi-Task Multi-Class Support Vector Machine with Safe Acceleration Rule

Multiview Consensus Structure Discovery

Soft Margin Consistency Based Scalable Multi-View Maximum Entropy Discrimination

Fast multi-view twin hypersphere support vector machine with consensus and complementary principles

Common Structured Low-Rank Matrix Recovery for Cross-View Classification

Enhancing Multiview Synergy: Robust Learning by Exploiting the Wave Loss Function with Consensus and Complementarity Principles

A Novel Multi-View Learning Developed from Single-View Patterns

Block-based multi-view classification via view-based ??<sub>2,??</sub>sparse representation and adaptive view fusion

Modal-Regression-Based Structured Low-Rank Matrix Recovery for Multiview Learning

Multi-view Hybrid Embedding: A Divide-and-Conquer Approach

Multi-View Class Incremental Learning