Margin based active learning

Maria-Florina Balcan, Andrei Broder, Tong Zhang

2007-06-13

Abstract:We present a framework for margin based active learning of linear separators. We instantiate it for a few important cases, some of which have been previously considered in the literature. We analyze the effectiveness of our framework both in the realizable case and in a specific noisy setting related to the Tsybakov small noise condition.

What problem does this paper attempt to address?

Adversarial Active Learning for Deep Networks: a Margin Based Approach

Melanie Ducoffe,Frederic Precioso

DOI: https://doi.org/10.48550/arXiv.1802.09841

2018-02-27

Abstract:We propose a new active learning strategy designed for deep neural networks. The goal is to minimize the number of data annotation queried from an oracle during training. Previous active learning strategies scalable for deep networks were mostly based on uncertain sample selection. In this work, we focus on examples lying close to the decision boundary. Based on theoretical works on margin theory for active learning, we know that such examples may help to considerably decrease the number of annotations. While measuring the exact distance to the decision boundaries is intractable, we propose to rely on adversarial examples. We do not consider anymore them as a threat instead we exploit the information they provide on the distribution of the input space in order to approximate the distance to decision boundaries. We demonstrate empirically that adversarial active queries yield faster convergence of CNNs trained on MNIST, the Shoe-Bag and the Quick-Draw datasets.

Machine Learning,Computer Vision and Pattern Recognition
Towards Desirable Decision Boundary by Moderate-Margin Adversarial Training

Xiaoyu Liang,Yaguan Qian,Jianchang Huang,Xiang Ling,Bin Wang,Chunming Wu,Wassim Swaileh

DOI: https://doi.org/10.1016/j.patrec.2023.07.009

2022-01-01

Abstract:The previous adversarial training methods tended to use a larger uniform perturbation budget to obtain an inclusive decision boundary, which improved robustness. However, this large uniform perturbation budget will bring an unnecessary increase in the margin along adversarial directions, causing heavy cross-over between natural and adversarial examples. It is not conducive to balancing the trade-off between robustness and natural accuracy. In this paper, we propose a novel adversarial training scheme, namely Moderate-Margin Adversarial Training (MMAT), to achieve a better trade-off. Specifically, we generate finer-grained adversarial examples to mitigate the cross-over between them and natural examples of neighboring classes. Meanwhile, we design a hybrid loss to learn adversarial examples and natural examples respectively to further obtain a moderate decision boundary. Extensive experiments show MMAT achieves high natural accuracy and robustness under both black-box and white-box attacks. Especially, state-of-the-art robustness and natural accuracy are achieved on SVHN.
Improved Margin Sampling for Active Learning.

Jin Zhou,Shiliang Sun

DOI: https://doi.org/10.1007/978-3-662-45646-0_13

2014-01-01

Abstract:Active learning is a learning mechanism which can actively query the user for labels. The goal of an active learning algorithm is to build an effective training set by selecting those most informative samples and improve the efficiency of the model within the limited time and resource. In this paper, we mainly focus on a state-of-the-art active learning method, the SVM-based margin sampling. However, margin sampling does not consider the distribution and the structural space connectivity among the unlabeled data when several examples are chosen simultaneously, which may lead to oversampling on dense regions. To overcome this shortcoming, we propose an improved margin sampling method by applying the manifold-preserving graph reduction algorithm to the original margin sampling method. Experimental results on multiple data sets demonstrate that our method obtains better classification performance compared with the original margin sampling.
Noise-adaptive Margin-based Active Learning and Lower Bounds under Tsybakov Noise Condition

Yining Wang,Aarti Singh

DOI: https://doi.org/10.48550/arXiv.1406.5383

2015-11-24

Abstract:We present a simple noise-robust margin-based active learning algorithm to find homogeneous (passing the origin) linear separators and analyze its error convergence when labels are corrupted by noise. We show that when the imposed noise satisfies the Tsybakov low noise condition (Mammen, Tsybakov, and others 1999; Tsybakov 2004) the algorithm is able to adapt to unknown level of noise and achieves optimal statistical rate up to poly-logarithmic factors. We also derive lower bounds for margin based active learning algorithms under Tsybakov noise conditions (TNC) for the membership query synthesis scenario (Angluin 1988). Our result implies lower bounds for the stream based selective sampling scenario (Cohn 1990) under TNC for some fairly simple data distributions. Quite surprisingly, we show that the sample complexity cannot be improved even if the underlying data distribution is as simple as the uniform distribution on the unit ball. Our proof involves the construction of a well separated hypothesis set on the d-dimensional unit ball along with carefully designed label distributions for the Tsybakov noise condition. Our analysis might provide insights for other forms of lower bounds as well.

Machine Learning
Margin-based sampling in high dimensions: When being active is less efficient than staying passive

Alexandru Tifrea,Jacob Clarysse,Fanny Yang

2023-06-02

Abstract:It is widely believed that given the same labeling budget, active learning (AL) algorithms like margin-based active learning achieve better predictive performance than passive learning (PL), albeit at a higher computational cost. Recent empirical evidence suggests that this added cost might be in vain, as margin-based AL can sometimes perform even worse than PL. While existing works offer different explanations in the low-dimensional regime, this paper shows that the underlying mechanism is entirely different in high dimensions: we prove for logistic regression that PL outperforms margin-based AL even for noiseless data and when using the Bayes optimal decision boundary for sampling. Insights from our proof indicate that this high-dimensional phenomenon is exacerbated when the separation between the classes is small. We corroborate this intuition with experiments on 20 high-dimensional datasets spanning a diverse range of applications, from finance and histology to chemistry and computer vision.

Machine Learning
Nearest Neighbor Classifier with Margin Penalty for Active Learning

Yuan Cao,Zhiqiao Gao,Jie Hu,Mingchuan Yang

DOI: https://doi.org/10.48550/arXiv.2203.09174

2022-01-01

Abstract: As deep learning becomes the mainstream in the field of natural language processing, the need for suitable active learning method are becoming unprecedented urgent. Active Learning (AL) methods based on nearest neighbor classifier are proposed and demonstrated superior results. However, existing nearest neighbor classifier are not suitable for classifying mutual exclusive classes because inter-class discrepancy cannot be assured by nearest neighbor classifiers. As a result, informative samples in the margin area can not be discovered and AL performance are damaged. To this end, we propose a novel Nearest neighbor Classifier with Margin penalty for Active Learning(NCMAL). Firstly, mandatory margin penalty are added between classes, therefore both inter-class discrepancy and intra-class compactness are both assured. Secondly, a novel sample selection strategy are proposed to discover informative samples within the margin area. To demonstrate the effectiveness of the methods, we conduct extensive experiments on for datasets with other state-of-the-art methods. The experimental results demonstrate that our method achieves better results with fewer annotated samples than all baseline methods.
Structured Large Margin Learning

DF Wang,DS Yeung,WWY Ng,ECC Tsang,XZ Wang

DOI: https://doi.org/10.1109/icmlc.2005.1527682

2005-01-01

Abstract:This paper presents a new large margin learning approach, namely structured large margin machine (SLMM), which incorporates both merits of "structured" learning models and advantages of large margin learning schemes. The promising features of this model, such as enhanced generalization ability, scalability, extensibility, and noise tolerance, are demonstrated theoretically and empirically. SLMM is of theoretical importance because it is a generalization of learning models like SVM, MPM, LDA, and M4 etc. Moreover, it provides a novel insight into the study of learning methods and forms a foundation for conceiving other "structured" classifiers.
Learning Distinctive Margin Toward Active Domain Adaptation

Ming Xie,Yuxi Li,Yabiao Wang,Zekun Luo,Zhenye Gan,Zhongyi Sun,Mingmin Chi,Chengjie Wang,Pei Wang

DOI: https://doi.org/10.1109/cvpr52688.2022.00783

2022-01-01

Abstract:Despite plenty of efforts focusing on improving the domain adaptation ability (DA) under unsupervised or few-shot semi-supervised settings, recently the solution of active learning started to attract more attention due to its suitability in transferring model in a more practical way with limited annotation resource on target data. Nevertheless, most active learning methods are not inherently designed to handle domain gap between data distribution, on the other hand, some active domain adaptation methods (ADA) usually requires complicated query functions, which is vulnerable to overfitting. In this work, we propose a concise but effective ADA method called Select-by-Distinctive-Margin (SDM), which consists of a maximum margin loss and a margin sampling algorithm for data selection. We provide theoretical analysis to show that SDM works like a Support Vector Machine, storing hard examples around decision boundaries and exploiting them to find informative and transferable data. In addition, we propose two variants of our method, one is designed to adaptively adjust the gradient from margin loss, the other boosts the selectivity of margin sampling by taking the gradient direction into account. We benchmark SDM with standard active learning setting, demonstrating our algorithm achieves competitive results with good data scalability. Code is available at https://github.com/TencentYoutuResearch/ActiveLearning-SDM
Online active classification via margin-based and feature-based label queries

Tingting Zhai,Frédéric Koriche,Yang Gao,Junwu Zhu,Bin Li

DOI: https://doi.org/10.1007/s10994-022-06133-8

IF: 5.414

2022-03-11

Machine Learning

Abstract:In the paradigm of online active classification, the learner not only has to predict the label of each incoming instance, but also must decide whether the true label of that instance should be supplied, or not. The overall goal is to minimize the number of prediction mistakes with few label queries. In this paper, we focus on a novel framework for online active learning, with the aim of handling high dimensional classification problems. The key component of our framework is to exploit both the margin-based predictive uncertainty and the feature-based discriminative information of the current instance, in order to determine whether it should be labeled. Based on this labeling strategy, we propose several online active learning algorithms, for both binary classification tasks and multiclass ones. For these algorithms, which use adaptive subgradient methods for updating their linear model, expected mistake bounds are provided. Experiments on high-dimensional (binary and multiclass) classification datasets reveal the benefit of our label query strategy, and show the superiority of our algorithms over the existing ones.

computer science, artificial intelligence
Look-ahead Active Learning Reliability Analysis Based on Stepwise Margin Reduction

Tong Zhou,Tong Guo,You Dong,Fan Yang,Dan M. Frangopol

DOI: https://doi.org/10.1016/j.ress.2023.109830

IF: 7.247

2024-01-01

Reliability Engineering & System Safety

Abstract:According to the concept of limit-state margin probability function, a new look-ahead learning function called stepwise margin reduction (SMR) is proposed for active learning reliability analysis. SMR aims to select the best next point as the one minimizing, in expectation, the integrated margin probability function when adding such a new point. The plain definition of SMR involves a double integral, and three-fold contributions are made to reducing the associated computational burden. First, the closed-form expression of inner integral is well deduced, which avoids burdensome Gaussian–Hermite quadrature or drawing simulations of Gaussian process. Second, thanks to the locality of analytical expression of inner integral, truncated-integral scheme (TIS) is devised for the outer integral to avoid serious computer memory issue. Third, the candidate pool is pruned to accelerate the selection of best next point per iteration. The efficacy of SMR-based active learning reliability method is illustrated on two analytical functions, three numerical examples and one real-world engineering problem. Results demonstrate that in SMR, the TIS performs better than the traditional limited-integral scheme. Then, in comparison with existing pointwise and look-ahead learning functions, SMR gains favorable advantage in term of both computational accuracy and efficiency.
Convergence and Margin of Adversarial Training on Separable Data

Zachary Charles,Shashank Rajput,Stephen Wright,Dimitris Papailiopoulos

DOI: https://doi.org/10.48550/arXiv.1905.09209

2019-05-23

Abstract:Adversarial training is a technique for training robust machine learning models. To encourage robustness, it iteratively computes adversarial examples for the model, and then re-trains on these examples via some update rule. This work analyzes the performance of adversarial training on linearly separable data, and provides bounds on the number of iterations required for large margin. We show that when the update rule is given by an arbitrary empirical risk minimizer, adversarial training may require exponentially many iterations to obtain large margin. However, if gradient or stochastic gradient update rules are used, only polynomially many iterations are required to find a large-margin separator. By contrast, without the use of adversarial examples, gradient methods may require exponentially many iterations to achieve large margin. Our results are derived by showing that adversarial training with gradient updates minimizes a robust version of the empirical risk at a $\mathcal{O}(\ln(t)^2/t)$ rate, despite non-smoothness. We corroborate our theory empirically.

Machine Learning,Optimization and Control
Recursive Maximum Margin Active Learning

Shilin Gui,Yuanyuan Jiao,Hong Tao,Chenping Hou

DOI: https://doi.org/10.1109/access.2019.2915334

IF: 3.9

2019-01-01

IEEE Access

Abstract:Active learning is an important technique to alleviate the problem when there is abundant unlabeled data but scarce labeled data. It aims to choose the most valuable samples to label in order to build powerful predictive models with minimal supervision. However, under the setup of active learning, when the data are characterized by high-dimensional features, it will be difficult to get a reliable estimate on the model parameters, as the labeled data are limited. Most existing works tackle this problem by learning a low-dimensional representation of data before active learning, but it cannot guarantee to obtain promising results, as traditional feature extraction techniques and active learning algorithms are designed independently. In this paper, we propose an efficient hybrid active learning algorithm, called Recursive Maximum Margin Active Learning. We optimize the active learning and semi-supervised feature extraction under a unified framework to tackle the high-dimensional features' problems and select the most representative samples in the low-dimensional space. By introducing the semi-supervised maximum margin criterion into active learning, we can conduct sample selection and feature extraction recursively at each iteration of active learning to learn more accurate models. The extensive experimental results show that the proposed method outperforms several state-of-the-art active learning methods on publicly available datasets.
Effective Active Learning Strategies for the Use of Large-Margin Classifiers in Semantic Annotation: an Optimal Parameter Discovery Perspective.

Kaiquan Xu,Stephen Shaoyi Liao,Raymond Y. K. Lau,J. Leon Zhao

DOI: https://doi.org/10.1287/ijoc.2013.0578

IF: 3.288

2014-01-01

INFORMS Journal on Computing

Abstract:Classical supervised machine learning techniques have been explored for semantically annotating unstructured textual data such as consumers' comments archived at social media websites to extract business intelligence. However, these techniques often require a large number of manually labeled training examples to produce accurate annotations. Several active learning approaches that are designed based on probabilistic sequence models have been explored to minimize the number of labeled training examples for semantic annotation tasks. Recent research has shown that large-margin classifiers are viable alternatives to automated semantic annotation, given their strong generalization capabilities and the ability to process high-dimensional data. However, the existing active learning methods that are designed for probabilistic sequence models cannot be easily adapted and applied to large-margin classifiers. The main contribution of this paper is the development of novel active learning methods for large-margin classifiers to fill the aforementioned research gap. In particular, we propose an innovative perspective of taking active learning as a search of optimal parameters for large-margin classifiers. A rigorous evaluation involving two benchmark tests and an empirical test based on real-world data extracted from Amazon.com reveals that the proposed active learning methods can train effective classifiers with significantly fewer training examples while achieving similar annotation performance, compared to a typical state-of-the-art classifier that only uses several labeled training examples. More specifically, one of our proposed active learning methods can reduce the number of training examples by 19.74% at the 68% level of F 1 when compared to the best baseline method, as evaluated based on the Amazon data set. Our research opens the door to the application of intelligent semantic annotation techniques to support real-world applications such as automatically analyzing consumer comments for customer relationship management.
Dirichlet Active Learning

Kevin Miller,Ryan Murray

2023-11-10

Abstract:This work introduces Dirichlet Active Learning (DiAL), a Bayesian-inspired approach to the design of active learning algorithms. Our framework models feature-conditional class probabilities as a Dirichlet random field and lends observational strength between similar features in order to calibrate the random field. This random field can then be utilized in learning tasks: in particular, we can use current estimates of mean and variance to conduct classification and active learning in the context where labeled data is scarce. We demonstrate the applicability of this model to low-label rate graph learning by constructing ``propagation operators'' based upon the graph Laplacian, and offer computational studies demonstrating the method's competitiveness with the state of the art. Finally, we provide rigorous guarantees regarding the ability of this approach to ensure both exploration and exploitation, expressed respectively in terms of cluster exploration and increased attention to decision boundaries.

Machine Learning
Margin Distribution Analysis

Jun Wang,Zhi-Hua Zhou

DOI: https://doi.org/10.1109/tnnls.2021.3054979

IF: 14.255

2021-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Margin is an important concept in machine learning; theoretical analyses further reveal that the distribution of margin plays a more critical role than the minimum margin in generalization power. Recently, several approaches have achieved performance breakthroughs by optimizing the margin distribution, but their computational cost, which is usually higher than before, still hinders them to be widely applied. In this article, we propose margin distribution analysis (MDA), which optimizes the margin distribution more simply by maximizing the margin mean and minimizing the margin variance simultaneously. MDA is efficient and resistive to class-imbalance naturally, since its objective distinguishes the margin means of different classes and can be broken up into two linear equations. In practice, it can also cooperate with other frameworks such as reweight-minimization when facing complex circumstances with noise and outliers. Empirical studies validate the superiority of MDA in real-world data sets, and demonstrate that simple approaches can also perform competitively by optimizing margin distribution.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
An efficient online active learning algorithm for binary classification

Dehua Liu,Peng Zhang,Qinghua Zheng

DOI: https://doi.org/10.1016/j.patrec.2015.08.010

IF: 4.757

2015-01-01

Pattern Recognition Letters

Abstract:We propose a new online active learning algorithm for binary classification.Our algorithm uses a margin-based criterion with iteratively decreased threshold.Our algorithm requires less queries to achieve comparable classification accuracy.Our algorithm incurs a smaller computation overhead at the same time. Active learning is an important class of machine learning where labels are queried when necessary. Most active learning algorithms need to iteratively retrain the classifier when new labeled data are obtained. Such a batch learning process can incur a high overhead in both time and memory. In this paper, we propose a new online active learning algorithm for binary classification. Our algorithm uses the margin-based criterion, which compares the margin of instances with a threshold to decide whether it should be queried. Especially, we propose Iteratively Decreased Threshold (IDT), a new threshold update method for the margin-based criterion. By iteratively decreasing the threshold with IDT, our algorithm can effectively reduce the number of queried instances. In addition, as evaluating the margin-based criterion involves only simple inner productions, our algorithm is also very efficient to evaluate. We compare our algorithm with other state-of-the-art online active learning algorithms on six data sets, demonstrating that it requires less queries to achieve the same classification accuracy, and incurs a smaller computation overhead at the same time.
Gaussian Process Versus Margin Sampling Active Learning

Jin Zhou,Shiliang Sun

DOI: https://doi.org/10.1016/j.neucom.2015.04.086

IF: 6

2015-01-01

Neurocomputing

Abstract:There are a large number of unlabeled examples in real-world application, and if the labels of these unlabeled examples are given manually, then the cost will be very high. The problem about how to label these massive unlabeled instances with the minimal cost is paid more and more attention. Active learning efficiently solves this bottleneck by selecting the most informative examples from the unlabeled examples and establishing a classifier with a higher classifier accuracy to label unlabeled examples, which greatly improves work efficiency. In this paper, we compare two kinds of traditional active learning algorithms relying on a single classifier, namely Gaussian process and margin sampling active learning, in two aspects of classification error rates and computing time. Moreover, we compare their improved versions (GPMAL and IMS) which apply the manifold-preserving graph reduction (MPGR) algorithm. MPGR constructs a subset which well exploits the structural spatial connectivity and spatial diversity among examples. By using MPGR, an active learner selects the informative and representative candidates from the subset instead of the whole unlabeled data set. In addition, a comparison with a state-of-the-art active learning method, QUIRE, is provided. Experimental results on multiple data sets show that both GPMAL and IMS have their own advantages.
The Power of Localization for Efficiently Learning Linear Separators with Noise

Pranjal Awasthi,Maria Florina Balcan,Philip M. Long

DOI: https://doi.org/10.48550/arXiv.1307.8371

2018-06-04

Abstract:We introduce a new approach for designing computationally efficient learning algorithms that are tolerant to noise, and demonstrate its effectiveness by designing algorithms with improved noise tolerance guarantees for learning linear separators. We consider both the malicious noise model and the adversarial label noise model. For malicious noise, where the adversary can corrupt both the label and the features, we provide a polynomial-time algorithm for learning linear separators in $\Re^d$ under isotropic log-concave distributions that can tolerate a nearly information-theoretically optimal noise rate of $\eta = \Omega(\epsilon)$. For the adversarial label noise model, where the distribution over the feature vectors is unchanged, and the overall probability of a noisy label is constrained to be at most $\eta$, we also give a polynomial-time algorithm for learning linear separators in $\Re^d$ under isotropic log-concave distributions that can handle a noise rate of $\eta = \Omega\left(\epsilon\right)$. We show that, in the active learning model, our algorithms achieve a label complexity whose dependence on the error parameter $\epsilon$ is polylogarithmic. This provides the first polynomial-time active learning algorithm for learning linear separators in the presence of malicious noise or adversarial label noise.

Machine Learning,Computational Complexity,Data Structures and Algorithms
A Generic Online Parallel Learning Framework for Large Margin Models

Shuming Ma,Xu Sun

DOI: https://doi.org/10.48550/arXiv.1703.00786

2017-03-02

Abstract:To speed up the training process, many existing systems use parallel technology for online learning algorithms. However, most research mainly focus on stochastic gradient descent (SGD) instead of other algorithms. We propose a generic online parallel learning framework for large margin models, and also analyze our framework on popular large margin algorithms, including MIRA and Structured Perceptron. Our framework is lock-free and easy to implement on existing systems. Experiments show that systems with our framework can gain near linear speed up by increasing running threads, and with no loss in accuracy.

Computation and Language,Machine Learning
Recent Advances in Large Margin Learning

Yiwen Guo,Changshui Zhang

DOI: https://doi.org/10.48550/arXiv.2103.13598

2021-06-21

Abstract:This paper serves as a survey of recent advances in large margin training and its theoretical foundations, mostly for (nonlinear) deep neural networks (DNNs) that are probably the most prominent machine learning models for large-scale data in the community over the past decade. We generalize the formulation of classification margins from classical research to latest DNNs, summarize theoretical connections between the margin, network generalization, and robustness, and introduce recent efforts in enlarging the margins for DNNs comprehensively. Since the viewpoint of different methods is discrepant, we categorize them into groups for ease of comparison and discussion in the paper. Hopefully, our discussions and overview inspire new research work in the community that aim to improve the performance of DNNs, and we also point to directions where the large margin principle can be verified to provide theoretical evidence why certain regularizations for DNNs function well in practice. We managed to shorten the paper such that the crucial spirit of large margin learning and related methods are better emphasized.

Machine Learning,Cryptography and Security,Computer Vision and Pattern Recognition,Neural and Evolutionary Computing

Margin based active learning

Adversarial Active Learning for Deep Networks: a Margin Based Approach

Towards Desirable Decision Boundary by Moderate-Margin Adversarial Training

Improved Margin Sampling for Active Learning.

Noise-adaptive Margin-based Active Learning and Lower Bounds under Tsybakov Noise Condition

Margin-based sampling in high dimensions: When being active is less efficient than staying passive

Nearest Neighbor Classifier with Margin Penalty for Active Learning

Structured Large Margin Learning

Learning Distinctive Margin Toward Active Domain Adaptation

Online active classification via margin-based and feature-based label queries

Look-ahead Active Learning Reliability Analysis Based on Stepwise Margin Reduction

Convergence and Margin of Adversarial Training on Separable Data

Recursive Maximum Margin Active Learning

Effective Active Learning Strategies for the Use of Large-Margin Classifiers in Semantic Annotation: an Optimal Parameter Discovery Perspective.

Dirichlet Active Learning

Margin Distribution Analysis

An efficient online active learning algorithm for binary classification

Gaussian Process Versus Margin Sampling Active Learning

The Power of Localization for Efficiently Learning Linear Separators with Noise

A Generic Online Parallel Learning Framework for Large Margin Models

Recent Advances in Large Margin Learning