Abstract:Image retrieval based on the query-by-example (QBE) principle is still not reliable enough, largely because of the likely variations in the capture conditions (e.g. light, blur, scale, occlusion) and viewpoint between the query image and the images in the collection. In this paper, we propose a framework in which this problem is explicitly addressed to improve the reliability of QBE-based image retrieval. We aim at the use scenario involving the user capturing the query object by his/her mobile device and requesting information augmenting the query from the database. Reliability improvement is achieved by allowing the user to submit not a single image but a short video clip as a query. Since a video clip may combine object or scene appearances captured from different viewpoints and under different conditions, the rich information contained therein can be exploited to discover the proper query representation and to improve the relevance of the retrieved results. The experimental results show that video-based image retrieval (VBIR) is significantly more reliable than the retrieval using a single image as query. Furthermore, to make the proposed framework deployable in a practical mobile image retrieval system, where realtime query response is required, we also propose the priority queue-based feature description scheme and cache-based bi-quantization algorithm for an efficient parallel implementation of the VBIR concept.

QIVISE: A Quantum-Inspired Interactive Video Search Engine in VBS2023.

QIRM: A quantum interactive retrieval model for session search.

Quantum Theory-Inspired Search

Video browser showdown by NUS

Interactive Known-Item Search Using Semantic Textual and Colour Modalities.

The VISIONE Video Search System: Exploiting Off-the-Shelf Text Search Engines for Large-Scale Video Retrieval

Visual query suggestion: Towards capturing user intent in internet image search

A Quantum Expectation Value Based Language Model with Application to Question Answering

Visual Query Suggestion

VIREO/ECNU @ TRECVID 2013: A Video Dance of Detection, Recounting and Search with Motion Relativity and Concept Learning from Wild.

Binary Subspace Coding for Query-by-Image Video Retrieval

PolySmart and VIREO @ TRECVid 2024 Ad-hoc Video Search

Video-based Image Retrieval

Simple Baselines for Interactive Video Retrieval with Questions and Answers

Interactive multimodal video search: an extended post-evaluation for the VBS 2022 competition

Searching for images by video

Utilizing Related Samples to Enhance Interactive Concept-Based Video Search

A New Visual Interface for Searching and Navigating Slide-Based Lecture Videos

The Evaluation Criteria for a Video Query Language with Powerful Expressiveness

An Interactive Video Search Platform for Multi-modal Retrieval with Advanced Concepts

3D Self-Attention for Unsupervised Video Quantization