Abstract:Many image retrieval studies use metric learning to train an image encoder. However, metric learning cannot handle differences in users' preferences, and requires data to train an image encoder. To overcome these limitations, we revisit relevance feedback, a classic technique for interactive retrieval systems, and propose an interactive CLIP-based image retrieval system with relevance feedback. Our retrieval system first executes the retrieval, collects each user's unique preferences through binary feedback, and returns images the user prefers. Even when users have various preferences, our retrieval system learns each user's preference through the feedback and adapts to the preference. Moreover, our retrieval system leverages CLIP's zero-shot transferability and achieves high accuracy without training. We empirically show that our retrieval system competes well with state-of-the-art metric learning in category-based image retrieval, despite not training image encoders specifically for each dataset. Furthermore, we set up two additional experimental settings where users have various preferences: one-label-based image retrieval and conditioned image retrieval. In both cases, our retrieval system effectively adapts to each user's preferences, resulting in improved accuracy compared to image retrieval without feedback. Overall, our work highlights the potential benefits of integrating CLIP with classic relevance feedback techniques to enhance image retrieval.

An implicit relevance feedback method for CBIR with real-time eye tracking

Relevance Feedback Techniques In Interactive Content-Based Image Retrieval

Relevance Feedback: a Power Tool for Interactive Content-Based Image Retrieval

An active feedback framework for image retrieval

Using Implicit Relevane Feedback to Advance Web Image Search

Research on multi-level log-based relevance feedback scheme for image retrieval

Improving Retrieval Performance by Region Constraints and Relevance Feedback

A Survey on Relevance Feedback Techniques in Content-based Medical Image Retrieval

A self-relevance feedback method based on object labels

Adaptive relevance feedback based on Bayesian inference for image retrieval

An Iterative Approach for EEG based Rapid Face Search: A Refined Retrieval by Brain Computer Interfaces

Revisiting Relevance Feedback for CLIP-based Interactive Image Retrieval

Relevance feedback: A power tool for interactive content-based image retrieval.

Enhancing Content-Based Image Retrieval by Exploiting Relevance Feedback Logs

Designing a new deep convolutional neural network for content-based image retrieval with relevance feedback

An Improved Relevance Feedback in CBIR

Learning based relevance feedback in image retrieval

Eye-Gaze Tracking Research Based on Image Processing

From A Glance to "Gotcha": Interactive Facial Image Retrieval with Progressive Relevance Feedback

Relevance Feedback with Brain Signals

Eye Tracking as a Source of Implicit Feedback in Recommender Systems: A Preliminary Analysis