Abstract:Structural information is very important for improving the classification performance of classifiers. In order to increase the generalization performance of support vector machine (SVM) directly, several kinds of structured SVMs have been proposed. These algorithms with structural information only simply embed the global structural information or the local within-class information into SVM model. Thus, they sometimes are not suitable for real-world problems. To overcome the drawbacks, we firstly propose a novel SVM with local structural information (LSI-SVM) in this paper. In the LSI-SVM, the <i>K</i>-nearest neighbor (KNN) method is adopted. Applying the KNN method, the farthest neighbors set intra-class and the nearest neighbors set inter-class of the overall samples are obtained. It is more reasonable to maximize the margin between the nearest neighbors and the farthest neighbors. Both the global and local data structures are added into the optimization problem, making the LSI-SVM can fully utilize the underlying structural information and yield better performance. Furthermore, for nonlinear classification, the reproducing kernel Hilbert space theory is introduced and the kernel-based LSI-SVM is generated. What's more, in order to accelerate the training speed of LSI-SVM, a stochastic gradient LSI-SVM (LSI-SVM +) is constructed using the stochastic gradient descent (SGD) solver. Lastly, experimental results on regular-scale datasets, steel surface defects datasets, ORL face dataset and large-scale datasets demonstrate that both LSI-SVM and LSI-SVM + outperform other state-of-the-art algorithms on accuracy. In the meanwhile, our LSI-SVM + has high efficiency.

Training MT Model Using Structural SVM

Non-linear Learning for Statistical Machine Translation.

Discriminative Training for Log-Linear Based SMT: Global or Local Methods.

Meta-Structure Transformation Model for Statistical Machine Translation.

Locally Training the Log-Linear Model for SMT.

RM-structure alignment based statistical machine translation model

Better Simultaneous Translation with Monotonic Knowledge Distillation.

A Bilingual Graph-Based Semantic Model for Statistical Machine Translation.

A Maximum-Entropy Segmentation Model for Statistical Machine Translation

Softmax-margin Training for Statistical Machine Translation

Exploring the traditional NMT model and Large Language Model for chat translation

An Improved Hierarchical Phrase Based Machine Translation Model

User- Oriented Chinese Language Model and Its Machine Learning

A Linguistically Motivated MT Evaluation System Based on SVM Regression

Statistical Machine Translation Model with Meta-Structure Alignments

A SP synchronous generation model for statistical machine translation 1

Linguistically motivated statistical machine translation : models and algorithms

A Joint Rule Selection Model for Hierarchical Phrase-Based Translation.

ANALYSIS OF GLOBAL RELIABILITY AND SENSITIVITY OF STRUCTURES BASED ON MLS-SVM

Structural Supervision for Word Alignment and Machine Translation.

Stochastic gradient support vector machine with local structural information for pattern recognition