Abstract:Recently, the research on semi-supervised support vector machine (S3VM) has received much attention, and many S3VM algorithms have been proposed. Existing studies have shown that S3VM is effective especially in the situations where labeled data is scarce. Nevertheless, most of existing S3VM algorithms belong to centralized learning, that is, all the data is stored and processed at a fusion center. In many real-world applications, data may be horizontally or vertically distributed over multiple nodes (parties). Besides, from the concerns of privacy and security, each node would not like to share its original data with the others. On the other hand, considering that the data is usually sequentially generated, online processing is preferred. In this paper, we propose two online distributed S3VM (dS3VM) algorithms, which are respectively used for horizontally and vertically partitioned data classification. In these two algorithms, to get a fully decentralized implementation, we propose a new form of manifold regularization defined on some anchor points that are adaptively selected by an online strategy. Besides, we use the sparse random feature map to approximate the kernel feature map. In this manner, the model parameters can be collaboratively estimated without transmitting the original data between neighbors. The convergence performances of the proposed algorithms are analyzed. Simulations on several data sets are performed. Results show that the proposed dS3VM algorithms achieve good classification performance even when there is only a small portion of labeled data.

Efficient Text Categorization Using A Min-Max Modular Support Vector Machine

A multiclass classification framework for document categorization

A Multi-Class Large Margin Classifier

Collaborative Work with Linear Classifier and Extreme Learning Machine for Fast Text Categorization

Fast text categorization based on collaborative work in the semantic and class spaces

A class-feature-centroid classifier for text categorization

Hierarchical Multi-Label Text Categorization with Global Margin Maximization

Dimensionality Reduction With Category Information Fusion And Non-Negative Matrix Factorization For Text Categorization

Minimum Classification Error Rate Training of Supervised Topic Mixture Model for Multi-Label Text Categorization.

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

Muli-label Text Categorization with Hidden Components.

Multicycle disassembly-based decomposition algorithm to train multiclass support vector machines

Hierarchical multi-class text categorization with global margin maximization

Feature Selection for Support Vector Machines in Text Categorization

Efficient multi-class unlabeled constrained semi-supervised SVM.

Distributed Online Semi-Supervised Support Vector Machine

Efficacy of Regularized Multitask Learning Based on SVM Models.

Text Categorization Based on Regularization Extreme Learning Machine

A New Transductive Support Vector Machine Approach To Text Categorization

Parallel and Sequential Support Vector Machines for Multi-label Classification

Low-Rank Multitask Learning based on Tensorized SVMs and LSSVMs