Abstract:Almost all conventional template-matching methods employ low-level image features to measure the similarity between a template image and a scene image using similarity measures such as pixel intensity and pixel gradient. Although these methods have been widely used in many applications, they cannot simultaneously address all types of robustness challenges. In this study, with the goal of simultaneously addressing the various challenges, we present a robust semantic template-matching approach (RSTM). Inspired by the local binary descriptor, we propose a novel superpixel region binary descriptor (SRBD) to construct a multilevel semantic fusion feature vector for RSTM. SRBD uses a new kernel-distance-based simple linear iterative clustering (KD-SLIC) method to extract the stable superpixels from the template image; Then, based on the average intensity difference between each superpixel region and its neighbors, the dominant gradient orientation of each superpixel can be obtained, and the semantic features of each superpixel can be described as the dominant orientation difference vector, which is coded as the rotation-invariant SRBD. In the off-line matching phase, the fusion semantic feature vector of RSTM combines the multilevel SRBD features with different numbers of superpixels. In the online matching phase, to cope with rotation invariance, a marginal probability model is proposed and applied to locate the positions of template images in the scene image. Moreover, to accelerate computation, an image pyramid is employed. We conduct a series of experiments on a large dataset randomly selected from the MS COCO dataset to fully analyze the robustness of this approach. The experimental results show that RSTM simultaneously addresses rotation changes, scale changes, noise, occlusions, blur, nonlinear illumination changes and deformation with high time efficiency while also outperforming previous stateof- the-art template-matching methods.

Robust Text Image Alignment with Template for Information Retrieval.

Towards Fast and Accurate Image-Text Retrieval with Self-Supervised Fine-Grained Alignment

A New Fine-grained Alignment Method for Image-text Matching

HAAN: Learning a Hierarchical Adaptive Alignment Network for Image-Text Retrieval

Image Retrieval Using Object Template

Robust Semantic Template Matching Using a Superpixel Region Binary Descriptor

Robust Object Recognition Via Weakly Supervised Metric and Template Learning

Cross-Modal and Uni-Modal Soft-Label Alignment for Image-Text Retrieval

Cross-modal alignment with graph reasoning for image-text retrieval

Learning-Based Text Image Quality Assessment with Texture Feature and Embedding Robustness

Semantic Template: A Robust Approach To Support Content-Based Image Retrieval

Image-text matching using multi-subspace joint representation

A Mutually Textual and Visual Refinement Network for Image-Text Matching

Information Theoretic Text-to-Image Alignment

Robust Face Alignment Based on Local Texture Classifiers

Global–Local Information Soft-Alignment for Cross-Modal Remote-Sensing Image–Text Retrieval

Searching for Alignment in Face Recognition

Learning accurate template matching with differentiable coarse-to-fine correspondence refinement

Detected text-based image retrieval approach for textual images

Template Matching Based On Image Gray Value

Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval