Abstract:Multiple Instance Learning (MIL) has been widely used in weakly supervised whole slide image (WSI) classification. Typical MIL methods include a feature embedding part, which embeds the instances into features via a pre-trained feature extractor, and an MIL aggregator that combines instance embeddings into predictions. Most efforts have typically focused on improving these parts. This involves refining the feature embeddings through self-supervised pre-training as well as modeling the correlations between instances separately. In this paper, we proposed a sparsely coding MIL (SC-MIL) method that addresses those two aspects at the same time by leveraging sparse dictionary learning. The sparse dictionary learning captures the similarities of instances by expressing them as sparse linear combinations of atoms in an over-complete dictionary. In addition, imposing sparsity improves instance feature embeddings by suppressing irrelevant instances while retaining the most relevant ones. To make the conventional sparse coding algorithm compatible with deep learning, we unrolled it into a sparsely coded module leveraging deep unrolling. The proposed SC module can be incorporated into any existing MIL framework in a plug-and-play manner with an acceptable computational cost. The experimental results on multiple datasets demonstrated that the proposed SC module could substantially boost the performance of state-of-the-art MIL methods. The codes are available at \href{<a class="link-external link-https" href="https://github.com/sotiraslab/SCMIL.git" rel="external noopener nofollow">this https URL</a>}{<a class="link-external link-https" href="https://github.com/sotiraslab/SCMIL.git" rel="external noopener nofollow">this https URL</a>}.

Localized Content-Based Image Retrieval Through Evidence Region Identification

Region Selection based on Evidence Confidence for Localized Content-Based Image Retrieval

Region-Based Image Annotation Using Heuristic Support Vector Machine in Multiple-Instance Learning

SLV: Spatial Likelihood Voting for Weakly Supervised Object Detection

Localized Content-Based Image Retrieval Using Semi-Supervised Multiple Instance Learning

A Convex Method For Locating Regions Of Interest With Multi-Instance Learning

A Behaviorally Evidence-based Method for Computing Spatial Comparisons of Image Scenarios

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Localized content based image retrieval by multiple instance active learning

Multilabel Neighborhood Propagation for Region-Based Image Retrieval

Text-based image retrieval using progressive multi-instance learning

Interactive Localized Content Based Image Retrieval with Multiple-Instance Active Learning

Bag dissimilarity regularized multi-instance learning

Learning In Region-Based Image Retrieval

A New Multi-Instance Learning Scheme For Scene Categorization Using Information Bottleneck Theory

On Combining Multiple Instance Linear SVM and Bag Splitting for High Performance Visual Object Localization

Multi-Level Region Matching for Fine-Grained Sketch-Based Image Retrieval

Instance Explainable Multi-instance Learning for ROI of Various Data

Multiple-Instance Learning from Similar and Dissimilar Bags

SC-MIL: Sparsely Coded Multiple Instance Learning for Whole Slide Image Classification

Web Image Clustering Based-on Multiple Instance Learning