Abstract:Weakly supervised object detection (WSOD) and semantic segmentation with image-level annotations have attracted extensive attention due to their high label efficiency. Multiple instance learning (MIL) offers a feasible solution for the two tasks by treating each image as a bag with a series of instances (object regions or pixels) and identifying foreground instances that contribute to bag classification. However, conventional MIL paradigms often suffer from issues, e.g., discriminative instance domination and missing instances. In this article, we observe that negative instances usually contain valuable deterministic information, which is the key to solving the two issues. Motivated by this, we propose a novel MIL paradigm based on negative deterministic information (NDI), termed NDI-MIL, which is based on two core designs with a progressive relation: NDI collection and negative contrastive learning (NCL). In NDI collection, we identify and distill NDI from negative instances online by a dynamic feature bank. The collected NDI is then utilized in a NCL mechanism to locate and punish those discriminative regions, by which the discriminative instance domination and missing instances issues are effectively addressed, leading to improved object-and pixel-level localization accuracy and completeness. In addition, we design an NDI-guided instance selection (NGIS) strategy to further enhance the systematic performance. Experimental results on several public benchmarks, including PASCAL VOC 2007, PASCAL VOC 2012, and MS COCO, show that our method achieves satisfactory performance. The code is available at: https://github.com/GC-WSL/NDI.

Concept-dependent Image Annotation Via Existence-Based Multiple-Instance Learning

Image Annotation by Multiple-Instance Learning with Discriminative Feature Mapping and Selection

Multiple-Instance Learning from Pairwise Comparison Bags

Region-Based Image Annotation Using Heuristic Support Vector Machine in Multiple-Instance Learning

Concurrent Multiple Instance Learning For Image Categorization

Deep Multiple Instance Learning for Zero-Shot Image Tagging

Negative Deterministic Information-Based Multiple Instance Learning for Weakly Supervised Object Detection and Segmentation

Multi-instance Positive and Unlabeled Learning with Bi-Level Embedding

Multi-instance Learning Based on Instance Consistency for Image Retrieval

Web Image Clustering Based-on Multiple Instance Learning

Exploiting Generalized Discriminative Multiple Instance Learning for Multimedia Semantic Concept Detection

Explicit Metric-Based Multiconcept Multi-Instance Learning with Triplet and Superbag

Multi-Instance Learning with an Extended Kernel Density Estimation for Object Categorization

Exploring Multi-Grained Concept Annotations for Multimodal Large Language Models

A Multiclass Multiple Instance Learning Method with Exact Likelihood

Interventional Multi-Instance Learning with Deconfounded Instance-Level Prediction

Multi-Modal Multi-Label Semantic Indexing Of Images Based On Hybrid Ensemble Learning

Salient instance selection for multiple-instance learning

Mil-Skde: Multiple-Instance Learning With Supervised Kernel Density Estimation

Correlative multi-label multi-instance image annotation

Webly-supervised Visual Concept Learning with Cardinality Guided Instance Mining and Clustered Multitask Refinement.