Abstract:In indoor low-light environments, the lack of light makes the captured images often suffer from quality degradation problems, including missing features in dark areas, noise interference, low brightness, and low contrast. Therefore, the feature extraction algorithms are unable to extract the feature information contained in the images accurately, thereby hindering the subsequent target search task in this environment and making it difficult to determine the location information of the target. Aiming at this problem, a joint local and high-level semantic information (JLHS) target search method is proposed based on joint bilateral filtering and camera response model (JBCRM) image preprocessing enhancement. The JBCRM method improves the image quality by highlighting the dark region features and removing the noise interference in order to solve the problem of the difficult extraction of feature points in low-light images, thus providing better visual data for subsequent target search tasks. The JLHS method increases the feature matching accuracy between the target image and the offline database image by combining local and high-level semantic information to characterize the image content, thereby boosting the accuracy of the target search. Experiments show that, compared with the existing image-enhancement methods, the PSNR of the JBCRM method is increased by 34.24% at the highest and 2.61% at the lowest. The SSIM increased by 63.64% at most and increased by 12.50% at least. The Laplacian operator increased by 54.47% at most and 3.49% at least. When the mainstream feature extraction techniques, SIFT, ORB, AKAZE, and BRISK, are utilized, the number of feature points in the JBCRM-enhanced images are improved by a minimum of 20.51% and a maximum of 303.44% over the original low-light images. Compared with other target search methods, the average search error of the JLHS method is only 9.8 cm, which is 91.90% lower than the histogram-based search method. Meanwhile, the average search error is reduced by 18.33% compared to the VGG16-based target search method. As a result, the method proposed in this paper significantly improves the accuracy of the target search in low-light environments, thus broadening the application scenarios of target search in indoor environments, and providing an effective solution for accurately determining the location of the target in geospatial space.

The progressive target search mechanism of visual scene

Long-Term Map-Based Visual Localization: Analysis of Individual Components of a Hierarchical Pipeline

Real-time Automatic Small Target Detection Using Saliency Extraction and Morphological Theory

Integrating Three Mechanisms of Visual Attention for Active Visual Search

Contour-guided saliency detection with long-range interactions

Attention-based active visual search for mobile robots

Long-term Object Search Using Incremental Scene Graph Updating

A Study of Targets Independence and Modeling of Multiple-Target Random Visual Search

Saliency Based Proposal Refinement in Robotic Vision

Finding any Waldo with zero-shot invariant and efficient visual search

Topographical Representation of Saliency in the Human Visual and Temporo-occipital Cortex

Remote Sensing Target Detection Based on Visual Saliency Guidance and Classifier Fusion

Saliency selection for robust visual tracking

Combining Laser-Scanning Data and Images for Target Tracking and Scene Modeling

Commonsense Scene Graph-based Target Localization for Object Search

Semantic-aware Next-Best-View for Multi-DoFs Mobile System in Search-and-Acquisition based Visual Perception

Investigation of infrared dim and small target detection algorithm based on the visual saliency feature

Target detection in complex scene of SAR image based on existence probability

Saliency-Associated Object Tracking

Target Search for Joint Local and High-Level Semantic Information Based on Image Preprocessing Enhancement in Indoor Low-Light Environments

Visual search as an embodied process: The effects of perspective change and external reference on search performance