Abstract:Multi-instance learning (MIL) has demonstrated its usefulness in many real-world image applications in recent years. However two critical challenges prevent one from effectively using MIL in practice. First, existing MIL methods routinely model the predictive targets using the instances of input images, but rarely utilize an input image as a whole. As a result, the useful information conveyed by the holistic representation of an input image could be potentially lost. Second, the varied numbers of the instances of the input images in a data set make it infeasible to use traditional learning models that can only deal with single-vector inputs. To tackle these two challenges, in this paper we propose a novel image representation learning method that can integrate the local patches (the instances) of an input image (the bag) and its holistic representation into one single-vector representation. Our new method first learns a projection to preserve both global and local consistencies of the instances of an input image. It then projects the holistic representation of the same image into the learned subspace for information enrichment. Taking into account the content and characterization variations in natural scenes and photos, we develop an objective that maximizes the ratio of the summations of a number of l(1)-norm distances, which is difficult to solve in general. To solve our objective, we derive a new efficient non-greedy iterative algorithm and rigorously prove its convergence. Promising results in extensive experiments have demonstrated improved performances of our new method that validate its effectiveness.

Multilinear Graph Embedding: Representation and Regularization for Images.

Feature Extraction Via Multi-View Non-Negative Matrix Factorization with Local Graph Regularization.

Multi-Manifold Sparse Graph Embedding for Multi-Modal Image Classification

Multi-View Graph Embedding Learning for Image Co-Segmentation and Co-Localization

Regularized direct Linear Graph Embedding

Robust $$l_{2,1}$$l2,1 Norm-Based Sparse Dictionary Coding Regularization of Homogenous and Heterogenous Graph Embeddings for Image Classifications

Robust l_2,1 Norm-Based Sparse Dictionary Coding Regularization of Homogenous and Heterogenous Graph Embeddings for Image Classifications

Discriminant Locally Linear Embedding with High-Order Tensor Data.

Graph Regularized Encoder-Decoder Networks for Image Representation Learning

Image Feature Extraction via Graph Embedding Regularized Projective Non-negative Matrix Factorization.

Graph Representation Learning Via Graphical Mutual Information Maximization.

Unsupervised Multi-view Nonlinear Graph Embedding.

Graph Embedding Multi-Kernel Metric Learning for Image Set Classification With Grassmannian Manifold-Valued Features

Generalized Multi-view Embedding for Visual Recognition and Cross-modal Retrieval

Learning Multi-instance Enriched Image Representations Via Non-greedy Ratio Maximization of the L1-Norm Distances

Maximal Linear Embedding for Dimensionality Reduction

Multi-Facet Network Embedding: Beyond the General Solution of Detection and Representation

Graph Regularized Multilayer Concept Factorization for Data Representation

Dual Graph-Regularized Multi-view Feature Learning

Semi-supervised Convex Nonnegative Matrix Factorizations with Graph Regularized for Image Representation

Graph-Regularized Local Coordinate Concept Factorization for Image Representation