Abstract:Almost all conventional template-matching methods employ low-level image features to measure the similarity between a template image and a scene image using similarity measures such as pixel intensity and pixel gradient. Although these methods have been widely used in many applications, they cannot simultaneously address all types of robustness challenges. In this study, with the goal of simultaneously addressing the various challenges, we present a robust semantic template-matching approach (RSTM). Inspired by the local binary descriptor, we propose a novel superpixel region binary descriptor (SRBD) to construct a multilevel semantic fusion feature vector for RSTM. SRBD uses a new kernel-distance-based simple linear iterative clustering (KD-SLIC) method to extract the stable superpixels from the template image; Then, based on the average intensity difference between each superpixel region and its neighbors, the dominant gradient orientation of each superpixel can be obtained, and the semantic features of each superpixel can be described as the dominant orientation difference vector, which is coded as the rotation-invariant SRBD. In the off-line matching phase, the fusion semantic feature vector of RSTM combines the multilevel SRBD features with different numbers of superpixels. In the online matching phase, to cope with rotation invariance, a marginal probability model is proposed and applied to locate the positions of template images in the scene image. Moreover, to accelerate computation, an image pyramid is employed. We conduct a series of experiments on a large dataset randomly selected from the MS COCO dataset to fully analyze the robustness of this approach. The experimental results show that RSTM simultaneously addresses rotation changes, scale changes, noise, occlusions, blur, nonlinear illumination changes and deformation with high time efficiency while also outperforming previous stateof- the-art template-matching methods.

Robust Frame-to-Frame Hybrid Matching

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Robust Affine Invariant Feature Extraction for Image Matching

A Hypergraph Matching Framework for Refining Multi-source Feature Correspondences.

Robust feature point matching based on geometric consistency and affine invariant spatial constraint

A Robust Affine Invariant Feature Matching Approach.

A Robust Mismatch Removal Method for Image Matching Based on the Fusion of the Local Features and the Depth

A Robust Algorithm For Feature Point Matching

Robust Image Feature Point Matching Based on Structural Distance

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Robust Camera Motion Estimation in Video Sequences

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

A unified feature-spatial cycle consistency fusion framework for robust image matching

A Fast Image Matching Approach Based on Scale-space Representation of Image and a Novel Robust Hausdorff Distance

Robust Semantic Template Matching Using a Superpixel Region Binary Descriptor

Fast and Robust Spatial Matching for Object Retrieval

A Robust Point Sets Matching Method

Robust Feature Matching for Remote Sensing Image Registration via Linear Adaptive Filtering

Robust Feature Matching for Remote Sensing Image Registration via Guided Hyperplane Fitting