Abstract:Multiview learning (MvL) is an advancing domain in machine learning, leveraging multiple data perspectives to enhance model performance through view-consistency and view-discrepancy. Despite numerous successful multiview-based SVM models, existing frameworks predominantly focus on the consensus principle, often overlooking the complementarity principle. Furthermore, they exhibit limited robustness against noisy, error-prone, and view-inconsistent samples, prevalent in multiview datasets. To tackle the aforementioned limitations, this paper introduces Wave-MvSVM, a novel multiview support vector machine framework leveraging the wave loss (W-loss) function, specifically designed to harness both consensus and complementarity principles. Unlike traditional approaches that often overlook the complementary information among different views, the proposed Wave-MvSVM ensures a more comprehensive and resilient learning process by integrating both principles effectively. The W-loss function, characterized by its smoothness, asymmetry, and bounded nature, is particularly effective in mitigating the adverse effects of noisy and outlier data, thereby enhancing model stability. Theoretically, the W-loss function also exhibits a crucial classification-calibrated property, further boosting its effectiveness. Wave-MvSVM employs a between-view co-regularization term to enforce view consistency and utilizes an adaptive combination weight strategy to maximize the discriminative power of each view. The optimization problem is efficiently solved using a combination of GD and the ADMM, ensuring reliable convergence to optimal solutions. Theoretical analyses, grounded in Rademacher complexity, validate the generalization capabilities of the Wave-MvSVM model. Extensive empirical evaluations across diverse datasets demonstrate the superior performance of Wave-MvSVM in comparison to existing benchmark models.

Incomplete-view oriented kernel learning method with generalization error bound

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

A Multiview Learning Framework with a Linear Computational Cost

Support Vector Pursuit Learning

Multi-view cost-sensitive kernel learning for imbalanced classification problem

Multiview learning with twin parametric margin SVM

Fast multi-view twin hypersphere support vector machine with consensus and complementary principles

Kernelized Multiview Subspace Analysis By Self-Weighted Learning

Multi-View Learning with Incomplete Views

Incomplete multi-view clustering via kernelized graph learning

Efficient and Effective Regularized Incomplete Multi-view Clustering

Robust Kernelized Multiview Self-Representation for Subspace Clustering

Kernelized multi-view subspace clustering via auto-weighted graph learning

Global and local multi-view multi-label learning with incomplete views and labels

MVDG: A Unified Multi-view Framework for Domain Generalization

Enhancing Multiview Synergy: Robust Learning by Exploiting the Wave Loss Function with Consensus and Complementarity Principles

Label recovery and label correlation co-learning for multi-view multi-label classification with incomplete labels

Multi-view universum support vector machines with insensitive pinball loss

A Support Vector Machine with a Hybrid Kernel and Minimal Vapnik-Chervonenkis Dimension

Large-Margin Predictive Latent Subspace Learning for Multiview Data Analysis.

Efficient and Effective Incomplete Multi-View Clustering