Abstract:Almost all conventional template-matching methods employ low-level image features to measure the similarity between a template image and a scene image using similarity measures such as pixel intensity and pixel gradient. Although these methods have been widely used in many applications, they cannot simultaneously address all types of robustness challenges. In this study, with the goal of simultaneously addressing the various challenges, we present a robust semantic template-matching approach (RSTM). Inspired by the local binary descriptor, we propose a novel superpixel region binary descriptor (SRBD) to construct a multilevel semantic fusion feature vector for RSTM. SRBD uses a new kernel-distance-based simple linear iterative clustering (KD-SLIC) method to extract the stable superpixels from the template image; Then, based on the average intensity difference between each superpixel region and its neighbors, the dominant gradient orientation of each superpixel can be obtained, and the semantic features of each superpixel can be described as the dominant orientation difference vector, which is coded as the rotation-invariant SRBD. In the off-line matching phase, the fusion semantic feature vector of RSTM combines the multilevel SRBD features with different numbers of superpixels. In the online matching phase, to cope with rotation invariance, a marginal probability model is proposed and applied to locate the positions of template images in the scene image. Moreover, to accelerate computation, an image pyramid is employed. We conduct a series of experiments on a large dataset randomly selected from the MS COCO dataset to fully analyze the robustness of this approach. The experimental results show that RSTM simultaneously addresses rotation changes, scale changes, noise, occlusions, blur, nonlinear illumination changes and deformation with high time efficiency while also outperforming previous stateof- the-art template-matching methods.

A Double Circle Structure Descriptor and Hough Voting Matching for Real-Time Object Detection

Large Margin Object Tracking with Circulant Feature Maps

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Hierarchical Clustering Matching for Features with Repetitive Patterns in Visual Odometry

Realtime and Robust Object Matching with a Large Number of Templates

Realtime object matching with robust dominant orientation templates

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Robust 3D Face Recognition by Local Shape Difference Boosting

An Image Matching Method Based on Improved DCCD and SIFT Descriptor

Real-time Multi-Object Tracking Based on Bi-directional Matching

D2Former: Jointly Learning Hierarchical Detectors and Contextual Descriptors Via Agent-based Transformers

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Fast and Robust Spatial Matching for Object Retrieval

HD2Reg: Hierarchical Descriptors and Detectors for Point Cloud Registration

High Resolution Centroid Hirschman Descriptor for Moving Object Detection

Matching Algorithm for 3D Point Cloud Recognition and Registration Based on Multi-Statistics Histogram Descriptors

A Concurrent Multiscale Detector for End-to-End Image Matching

Robust Semantic Template Matching Using a Superpixel Region Binary Descriptor

Occlusion-Aware Real-Time Object Tracking