Abstract:Weakly supervised object detection (WSOD) and semantic segmentation with image-level annotations have attracted extensive attention due to their high label efficiency. Multiple instance learning (MIL) offers a feasible solution for the two tasks by treating each image as a bag with a series of instances (object regions or pixels) and identifying foreground instances that contribute to bag classification. However, conventional MIL paradigms often suffer from issues, e.g., discriminative instance domination and missing instances. In this article, we observe that negative instances usually contain valuable deterministic information, which is the key to solving the two issues. Motivated by this, we propose a novel MIL paradigm based on negative deterministic information (NDI), termed NDI-MIL, which is based on two core designs with a progressive relation: NDI collection and negative contrastive learning (NCL). In NDI collection, we identify and distill NDI from negative instances online by a dynamic feature bank. The collected NDI is then utilized in a NCL mechanism to locate and punish those discriminative regions, by which the discriminative instance domination and missing instances issues are effectively addressed, leading to improved object-and pixel-level localization accuracy and completeness. In addition, we design an NDI-guided instance selection (NGIS) strategy to further enhance the systematic performance. Experimental results on several public benchmarks, including PASCAL VOC 2007, PASCAL VOC 2012, and MS COCO, show that our method achieves satisfactory performance. The code is available at: https://github.com/GC-WSL/NDI.

Image Annotation by Multiple-Instance Learning with Discriminative Feature Mapping and Selection

Multiple-Instance Learning from Pairwise Comparison Bags

Region-Based Image Annotation Using Heuristic Support Vector Machine in Multiple-Instance Learning

Multiple-instance learning with instance selection via constructive covering algorithm

A Multiple Instance Learning Approach to Image Annotation with Saliency Map.

Multi-instance Positive and Unlabeled Learning with Bi-Level Embedding

A New Multiple Instance Algorithm Using Structural Information.

Diversified Dictionaries for Multi-Instance Learning

Mild: Multiple-Instance Learning Via Disambiguation

Concurrent Multiple Instance Learning For Image Categorization

Negative Deterministic Information-Based Multiple Instance Learning for Weakly Supervised Object Detection and Segmentation

Multiple-Instance Learning from Unlabeled Bags with Pairwise Similarity

Deep multiple instance selection

DGMIL: Distribution Guided Multiple Instance Learning for Whole Slide Image Classification

Cascade of Multi-level Multi-instance Classifiers for Image Annotation.

Multiple instance learning: A survey of problem characteristics and applications

Scalable Algorithms for Multi-Instance Learning.

Multiple-Instance Learning from Similar and Dissimilar Bags

Scalable Multi-instance Learning

Multiple instance learning from similarity-confidence bags

Deep Multiple Instance Learning for Zero-Shot Image Tagging