Faster-FIIS-GMS: a novel object detection framework for instance search

Xiaochen Liu,Tao Zhang,Chong Shen
DOI: https://doi.org/10.1007/s11042-023-15616-2
IF: 2.577
2023-01-01
Multimedia Tools and Applications
Abstract:Visual sensors are widely deployed in many promising detection fields, such as precision measurement, visual object detection and search. Instance search is a special object search method based on visual sensor, which is of fundamental importance to many applications, including the area of civil and military. Although a quantity of instance search solutions has been proposed, it remains a critical challenge to provide a real-time, lightweight labeling, easy to deploy and able to simultaneous-object-positioning-and-classification method. To address the challenge, a novel instance search method named Faster-FIIS-GMS is described in this paper. The improved Faster R-CNN with the MRFR (Multi-Receptive Field Residual module) and the APM (Adaptive Proposals Mechanism) is proposed to achieve more accurate and time-saving object detection and background information elimination simultaneously. Next, a novel image matching method named Fast Intensity Initial Screening Algorithm (FIIS) is introduced to filter foreground information in an image preliminarily and then combined with Grid-based Motion Statistics (GMS) to achieve the final searching. The performance of Faster-FIIS-GMS is analyzed and validated by experimental tests in a dataset annotated by manual, and the experimental results demonstrate that the proposed method has great potential in instance search for real scene environment, as it achieves high accuracy and satisfactory real time performance using the general computer. We also provide the comparison to state-of-the-arts to investigate the superiority of the proposed scheme at the end of the work.
What problem does this paper attempt to address?