Abstract:Almost all conventional template-matching methods employ low-level image features to measure the similarity between a template image and a scene image using similarity measures such as pixel intensity and pixel gradient. Although these methods have been widely used in many applications, they cannot simultaneously address all types of robustness challenges. In this study, with the goal of simultaneously addressing the various challenges, we present a robust semantic template-matching approach (RSTM). Inspired by the local binary descriptor, we propose a novel superpixel region binary descriptor (SRBD) to construct a multilevel semantic fusion feature vector for RSTM. SRBD uses a new kernel-distance-based simple linear iterative clustering (KD-SLIC) method to extract the stable superpixels from the template image; Then, based on the average intensity difference between each superpixel region and its neighbors, the dominant gradient orientation of each superpixel can be obtained, and the semantic features of each superpixel can be described as the dominant orientation difference vector, which is coded as the rotation-invariant SRBD. In the off-line matching phase, the fusion semantic feature vector of RSTM combines the multilevel SRBD features with different numbers of superpixels. In the online matching phase, to cope with rotation invariance, a marginal probability model is proposed and applied to locate the positions of template images in the scene image. Moreover, to accelerate computation, an image pyramid is employed. We conduct a series of experiments on a large dataset randomly selected from the MS COCO dataset to fully analyze the robustness of this approach. The experimental results show that RSTM simultaneously addresses rotation changes, scale changes, noise, occlusions, blur, nonlinear illumination changes and deformation with high time efficiency while also outperforming previous stateof- the-art template-matching methods.

Robust Object Recognition Via Weakly Supervised Metric and Template Learning

SLV: Spatial Likelihood Voting for Weakly Supervised Object Detection

Weakly Supervised Metric Learning for Traffic Sign Recognition in a LIDAR-Equipped Vehicle

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection.

Robust Semantic Template Matching Using a Superpixel Region Binary Descriptor

Realtime object matching with robust dominant orientation templates

Realtime and Robust Object Matching with a Large Number of Templates

User-Click-Data-Based Fine-Grained Image Recognition Via Weakly Supervised Metric Learning

A robust approach for object recognition

Weakly-Supervised Learning of Category-Specific 3D Object Shapes.

Weakly Supervised Multi-Object Tracking and Segmentation

Learning shared template representation with augmented feature for multi-object pose estimation

Online Metric-Weighted Linear Representations for Robust Visual Tracking

MuSCLe: A Multi-Strategy Contrastive Learning Framework for Weakly Supervised Semantic Segmentation

Robust local metric learning via least square regression regularization for scene recognition

Object Recognition via Adaptive Multi-level Feature Integration

Misclassification in Weakly Supervised Object Detection

Improving Feature Discrimination for Object Tracking by Structural-similarity-based Metric Learning

MOL: Towards Accurate Weakly Supervised Remote Sensing Object Detection Via Multi-view Noisy Learning

Weakly Supervised Instance Segmentation by Exploring Entire Object Regions

Boosting Weakly-Supervised Image Segmentation Via Representation, Transform, and Compensator