Abstract:In many domains, effectively applying machine learning models requires a large number of annotations and labelled data, which might not be available in advance. Acquiring annotations often requires significant time, effort, and computational resources, making it challenging. Active learning strategies are pivotal in addressing these challenges, particularly for diverse data types such as graphs. Although active learning has been extensively explored for node-level classification, its application to graph-level learning, especially for regression tasks, is not well-explored. We develop a unified active learning framework specializing in graph annotating and graph-level learning for regression tasks on both standard and expanded graphs, which are more detailed representations. We begin with graph collection and construction. Then, we construct various graph embeddings (unsupervised and supervised) into a latent space. Given such an embedding, the framework becomes task agnostic and active learning can be performed using any regression method and query strategy suited for regression. Within this framework, we investigate the impact of using different levels of information for active and passive learning, e.g., partially available labels and unlabelled test data. Despite our framework being domain agnostic, we validate it on a real-world application of software performance prediction, where the execution time of the source code is predicted. Thus, the graph is constructed as an intermediate source code representation. We support our methodology with a real-world dataset to underscore the applicability of our approach. Our real-world experiments reveal that satisfactory performance can be achieved by querying labels for only a small subset of all the data. A key finding is that Graph2Vec (an unsupervised embedding approach for graph data) performs the best, but only when all train and test features are used. However, Graph Neural Networks (GNNs) are the most flexible embedding techniques when used for different levels of information with and without label access. In addition, we find that the benefit of active learning increases for larger datasets (more graphs) and when the graphs are more complex, which is arguably when active learning is the most important.

Active Learning on Sparse Graph for Image Annotation

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

Semantic-gap-oriented active learning for multilabel image annotation.

Uncertainty Sampling Based Active Learning with Diversity Constraint by Sparse Selection.

An active learning method with difficulty learning mechanism for crack detection

Learning to Simulate Labelled Datasets with an Image-Level Content Consistent Graph Constraint

Visualization-Based Active Learning for Video Annotation.

Effective Active Learning Method for Spiking Neural Networks.

Column Subset Selection for Active Learning in Image Classification

Mitigating Semantic Confusion from Hostile Neighborhood for Graph Active Learning

Focus on informative graphs! Semi-supervised active learning for graph-level classification

A unified active learning framework for annotating graph data for regression task

A Graph-Based Approach for Active Learning in Regression

Unlabeled data selection for active learning in image classification

Batch Active Learning for Multispectral and Hyperspectral Image Segmentation Using Similarity Graphs

Graph Learning on K Nearest Neighbours for Automatic Image Annotation

GALAXY: Graph-based Active Learning at the Extreme

Active learning for efficient annotation in precision agriculture: a use-case on crop-weed semantic segmentation

Exploiting the entire feature space with sparsity for automatic image annotation.

Active Model Selection for Graph-Based Semi-Supervised Learning

Active Scene Learning