Abstract:Feature fusion is a commonly used strategy in image retrieval tasks, which aggregates the matching responses of multiple visual features. Feasible sets of features can be either descriptors (SIFT, HSV) for an entire image or the same descriptor for different local parts (face, body). Ideally, the to-be-fused heterogeneous features are pre-assumed to be discriminative and complementary to each other. However, the effectiveness of different features varies dramatically according to different queries. That is to say, for some queries, a feature may be neither discriminative nor complementary to existing ones, while for other queries, the feature suffices. As a result, it is important to estimate the effectiveness of features in a query-adaptive manner. To this end, this article proposes a new late fusion scheme at the score level. We base our method on the observation that the sorted score curves contain patterns that describe their effectiveness. For example, an "L"-shaped curve indicates that the feature is discriminative while a gradually descending curve suggests a bad feature. As such, this paper introduces a query-adaptive late fusion pipeline. In the hand-crafted version, it can be an unsupervised approach to tasks like particular object retrieval. In the learning version, it can also be applied to supervised tasks like person recognition and pedestrian retrieval, based on a trainable neural module. Extensive experiments are conducted on two object retrieval datasets and one person recognition dataset. We show that our method is able to highlight the good features and suppress the bad ones, is resilient to distractor features, and achieves very competitive retrieval accuracy compared with the state of the art. In an additional person re-identification dataset, the application scope and limitation of the proposed method are studied.

Adaptively Weighted Graph Fusion for Image Retrieval.

Rank-Aware Graph Fusion With Contextual Dissimilarity Measurement For Image Retrieval

Efficient Image Retrieval via Feature Fusion and Adaptive Weighting.

Query Adaptive Fusion for Graph-Based Visual Reranking.

An Adaptive Weight Method for Image Retrieval Based Multi-Feature Fusion.

Normalized Similarity Measurement And Query Adaptive Fusion For Graph Based Visual Reranking

Query Adaptive Late Fusion for Image Retrieval.

Robust ImageGraph: Rank-Level Feature Fusion for Image Search.

Augmented Feature Fusion for Image Retrieval System

An Effective Feature Fusion Solution for Image Retrieval.

Weighted Multi-feature Fusion Algorithm for Fine-Grained Image Retrieval.

Node-Sensitive Graph Fusion via Topo-Correlation for Image Retrieval

Group and Rank Fusion for Accurate Image Retrieval

Adaptive multi-feature fusion via cross-entropy normalization for effective image retrieval

Query-Adaptive Remote Sensing Image Retrieval Based on Image Rank Similarity and Image-to-Query Class Similarity.

Query-adaptive Late Fusion for Image Search and Person Re-Identification

Graph-Based Features for Image Retrieval

Social Neighborhood Graph and Multigraph Fusion Ranking for Multifeature Image Retrieval

Multi-Feature Fusion Image Retrieval Algorithm Based on Fuzzy Color

Compressed sensing based feature fusion for image retrieval

Effective Image Retrieval Via Multilinear Multi-index Fusion.