Abstract:Estimating the Region of Interest (ROI) for images is a classic problem in the field of computer vision. In a broader sense, the object of ROI estimation can be generalized to the bag containing multiple data instances, i.e., identify the instances that probably arouse our interest. Under the circumstance without instance labels, generalized ROI estimation problem can be addressed in the framework of Multi-Instance Learning (MIL). MIL is a variation of supervised learning where a bag containing multiple instances is assigned a single class label. Though the success in bag-level classification, when bags contain a large number of instances, existing works ignore instance-level interpretation which is the key to ROI estimation. In this paper we propose an instance explainable MIL method to solve the problem. We devise a generalized permutation-invariant operator with the idea of utility and show that the interpretation issues can be addressed by including a family of utility functions in the space of instance embedding. Following this route, we propose a novel Permutation-Invariant Operator to improve the instance-level interpretability of MIL as well as the overall performance. We also point out that existing approaches can be regarded as a special case of our framework and qualitatively analyze the superiority of our work. Furthermore we give a criterion to measure the linear separability in the instance embedding space. We conduct extensive evaluations on both classic MIL benchmarks and a real-life histopathology dataset. Experimental results show that our method achieves a significant improvement in the performance of both instance-level ROI estimation and bag-level classification compared to state-of-the-art methods.

A Convex Method For Locating Regions Of Interest With Multi-Instance Learning

Locating regions of interest in CBIR with multi-instance learning techniques

Semisupervised SVM Batch Mode Active Learning with Applications to Image Retrieval

Learning In Region-Based Image Retrieval

A convex neighbor-constrained active contour model for image segmentation

Region Selection based on Evidence Confidence for Localized Content-Based Image Retrieval

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

Instance Explainable Multi-instance Learning for ROI of Various Data

The Application of Multi-instance Learning in Multi-ROI Breast Tumor Classification

A Fine Image Matching Method Based on Regions of Interest

Region-Based Image Annotation Using Heuristic Support Vector Machine in Multiple-Instance Learning

Convex Experimental Design Using Manifold Structure for Image Retrieval.

Localized Content-Based Image Retrieval Using Semi-Supervised Multiple Instance Learning

Localized Content-Based Image Retrieval Through Evidence Region Identification

A Method for Image Retrieval Based on Salient Points Feature Multiple-Instance Learning

Image Retrieval Based on Multi-instance Saliency Model

Convex-relaxed kernel mapping for image segmentation

On Combining Multiple Instance Linear SVM and Bag Splitting for High Performance Visual Object Localization

Localized content based image retrieval by multiple instance active learning

Multi-semantic Scene Classification Based on Region of Interest

An approach of content-based image retrieval based on image salient region