Abstract:Active learning aims at obtaining high-accuracy models with as a few labeled data as possible, by iteratively and elaborately selecting most valuable data to query labels during the learning process, thereby the cost of labeling data can be reduced. Most previous active learning approaches consider the situation of centralized processing, where all the unlabeled data are supposed to be gathered together in one place. Due to the development of distributed applications, distributed processing has attracted a lot of interests given the situation that data are distributed at different nodes over network. In this paper, we focus on the issue of distributed active learning (DAL) for the classification problem. We propose a fully decentralized active learning approach, which consists of two parts, namely, a distributed sample selection strategy and a distributed classification algorithm. The former helps nodes to cooperatively select data based on uncertainty, diversity, and representativeness of data. Due to the introducing of a randomized preselection method in the strategy, we can achieve diversity of the selected data without any information exchange among nodes. The latter helps each node to train its local multi-class classification model in a global sense without transmitting original data among nodes. We demonstrate the effectiveness of the proposed DAL approach on several real data sets. Simulation results show that the proposed approach can significantly reduce the number of labeled data needed for obtaining a high-accuracy classifier in distributed case.

Neighborhood Preserving D-Optimal Design for Active Learning and Its Application to Terrain Classification

Active Learning Via Neighborhood Reconstruction

Laplacian Regularized D-optimal Design for active learning and its application to image retrieval

Active Learning Based on Locally Linear Reconstruction

Active Learning Based on Local Representation.

G-Optimal Design with Laplacian Regularization.

Active Learning Via Local Structure Reconstruction

Distributed Active Learning.

New Balanced Active Learning Model and Optimization Algorithm.

Column Subset Selection for Active Learning in Image Classification

Active Learning for Social Image Retrieval Using Locally Regressive Optimal Design

Adaptive Learning for Dynamic Features and Noisy Labels

Using methods from dimensionality reduction for active learning with low query budget

Non-myopic Active Learning with Performance Guarantee

Active Learning with Label Quality Control

Heuristic improvement for active learning using localized generalization error as selection criterion

Active Learning with Optimal Distribution for Image Classification

Early Active Learning via Robust Representation and Structured Sparsity.

Active Learning in the Spatial Domain for Remote Sensing Image Classification

Discriminative Neighborhood Preserving Dictionary Learning for Image Classification.

Avoid Wasted Annotation Costs in Open-set Active Learning with Pre-trained Vision-Language Model