Abstract:As a widely used weakly supervised learning scheme, modern multiple instance learning (MIL) models achieve competitive performance at the bag level. However, instance-level prediction, which is essential for many important applications, remains largely unsatisfactory. We propose to conduct novel active deep multiple instance learning that samples a small subset of informative instances for annotation, aiming to significantly boost the instance-level prediction. A variance regularized loss function is designed to properly balance the bias and variance of instance-level predictions, aiming to effectively accommodate the highly imbalanced instance distribution in MIL and other fundamental challenges. Instead of directly minimizing the variance regularized loss that is non-convex, we optimize a distributionally robust bag level likelihood as its convex surrogate. The robust bag likelihood provides a good approximation of the variance based MIL loss with a strong theoretical guarantee. It also automatically balances bias and variance, making it effective to identify the potentially positive instances to support active sampling. The robust bag likelihood can be naturally integrated with a deep architecture to support deep model training using mini-batches of positive-negative bag pairs. Finally, a novel P-F sampling function is developed that combines a probability vector and predicted instance scores, obtained by optimizing the robust bag likelihood. By leveraging the key MIL assumption, the sampling function can explore the most challenging bags and effectively detect their positive instances for annotation, which significantly improves the instance-level prediction. Experiments conducted over multiple real-world datasets clearly demonstrate the state-of-the-art instance-level prediction achieved by the proposed model.

Instance Elimination Strategy for Non-Convex Multiple-Instance Learning Using Sparse Positive Bags

Multiple-Instance Learning from Pairwise Comparison Bags

Instance Elimination Strategy for Non-Convex Multiple-Instance Support Vector Machine

Multiple instance learning from similarity-confidence bags

Sparse multiple instance learning with non -convex penalty

Image Classification Algorithm Based on Bag?Level Space Multiple Instance Learning with Sparse Representation

Multiple Instance Learning on Structured Data

Salient instance selection for multiple-instance learning

An Instance Selection and Optimization Method for Multiple Instance Learning

Multiple-Instance Learning from Similar and Dissimilar Bags

Multiple instance learning based on positive instance selection and bag structure construction

Learning Sparse Kernel Classifiers for Multi-Instance Classification

Multi-instance Learning in the Presence of Positive and Unlabeled Bags

Learning With Only Multiple Instance Positive Bags

Multi-Instance Learning from Positive and Unlabeled Bags

On the Complexity of One-class SVM for Multiple Instance Learning

Pairwise-similarity-based Instance Reduction for Efficient Instance Selection in Multiple-Instance Learning.

Balancing Bias and Variance for Active Weakly Supervised Learning

Mild: Multiple-Instance Learning Via Disambiguation

Feature Screening Strategy for Non-Convex Sparse Logistic Regression with Log Sum Penalty

Multiple-Instance Learning from Unlabeled Bags with Pairwise Similarity