Abstract:Classical supervised machine learning techniques have been explored for semantically annotating unstructured textual data such as consumers' comments archived at social media websites to extract business intelligence. However, these techniques often require a large number of manually labeled training examples to produce accurate annotations. Several active learning approaches that are designed based on probabilistic sequence models have been explored to minimize the number of labeled training examples for semantic annotation tasks. Recent research has shown that large-margin classifiers are viable alternatives to automated semantic annotation, given their strong generalization capabilities and the ability to process high-dimensional data. However, the existing active learning methods that are designed for probabilistic sequence models cannot be easily adapted and applied to large-margin classifiers. The main contribution of this paper is the development of novel active learning methods for large-margin classifiers to fill the aforementioned research gap. In particular, we propose an innovative perspective of taking active learning as a search of optimal parameters for large-margin classifiers. A rigorous evaluation involving two benchmark tests and an empirical test based on real-world data extracted from Amazon.com reveals that the proposed active learning methods can train effective classifiers with significantly fewer training examples while achieving similar annotation performance, compared to a typical state-of-the-art classifier that only uses several labeled training examples. More specifically, one of our proposed active learning methods can reduce the number of training examples by 19.74% at the 68% level of F 1 when compared to the best baseline method, as evaluated based on the Amazon data set. Our research opens the door to the application of intelligent semantic annotation techniques to support real-world applications such as automatically analyzing consumer comments for customer relationship management.

Improving Sparsely Labeled Text Classification with Data Editing

Improving semi-supervised text classification by using wikipedia knowledge

Improving Short Text Classification Through Better Feature Space Selection

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

An Interactive Visual Analytics System for Incremental Classification Based on Semi-supervised Topic Modeling

Learning to Label with Active Learning and Reinforcement Learning.

Effective Multi-Label Active Learning for Text Classification

Semi-supervised Label Enhancement Via Structured Semantic Extraction

Effective Active Learning Strategies for the Use of Large-Margin Classifiers in Semantic Annotation: an Optimal Parameter Discovery Perspective.

Improving Semi-Supervised Text Classification with Dual Meta-Learning

Interactive Correction of Mislabeled Training Data

A Semi-Supervised Active Learning Method for Structured Data Enhancement with Small Samples

Perturbation-based Self-supervised Attention for Attention Bias in Text Classification

Semi-automatic Labeling with Active Learning for Multi-label Image Classification.

Image annotation by semi-supervised cross-domain learning with group sparsity

Data-efficient Active Learning for Structured Prediction with Partial Annotation and Self-Training

Semi-supervised Collaborative Filtering by Text-enhanced Domain Adaptation

Improving Chinese Word Segmentation Using Partially Annotated Sentences

Adaptive semi-supervised learning from stronger augmentation transformations of discrete text information

Improving Classification Performance With Human Feedback: Label a few, we label the rest

An Active Deep Learning Approach for Minimally-Supervised Polsar Image Classification