Abstract:While image matching has been studied in remote sensing community for decades, matching multimodal data [e.g., optical, light detection and ranging (LiDAR), synthetic aperture radar (SAR), and map] remains a challenging problem because of significant nonlinear intensity differences between such data. To address this problem, we present a novel fast and robust template matching framework integrating local descriptors for multimodal images. First, a local descriptor [such as histogram of oriented gradient (HOG) and local self-similarity (LSS) or speeded-up robust feature (SURF)] is extracted at each pixel to form a pixelwise feature representation of an image. Then, we define a fast similarity measure based on the feature representation using the fast Fourier transform (FFT) in the frequency domain. A template matching strategy is employed to detect correspondences between images. In this procedure, we also propose a novel pixelwise feature representation using orientated gradients of images, which is named channel features of orientated gradients (CFOG). This novel feature is an extension of the pixelwise HOG descriptor with superior performance in image matching and computational efficiency. The major advantages of the proposed matching framework include: 1) structural similarity representation using the pixelwise feature description and 2) high computational efficiency due to the use of FFT. The proposed matching framework has been evaluated using many different types of multimodal images, and the results demonstrate its superior matching performance with respect to the state-of-the-art methods.

A Multivariate Hit-or-Miss Transform for Conjoint Spatial and Spectral Template Matching

Joint Rank-Order Multi-Value Hit-Or-Miss Transformation

<title>Joint transform correlator using multivalue hit-or-miss transformation</title>

Improvement of the Distortion-Invariant Ability of Hit-or-Miss Transformation by Using Uncertain Pixels

Joint Transform Correlator Using Multi-Value Hit-Or-Miss Transformation

Optical Morphological Hit-Or-Miss Transform For Pattern Recognition Of Gray-Scale Image

Computing Multivalued Mathematical Morphology on Multiband Images Using Algorithms for Multicriteria Analysis

Optical Implementation of the Morphological Hit–miss Transform Using Extensive Complementary Encoding

Heterogeneous image transformation

Extending the Morphological Hit-or-Miss Transform to Deep Neural Networks

Optical Implementation of Morphological Hit-Miss Transform Using Complementary-Encoding

Joint hit-or-miss transform correlator

Composite Kernel Target Detection Based on Mathematical Morphology for Hyperspectral Imagery

Template matching: matched spatial filters and beyond

Realtime and Robust Object Matching with a Large Number of Templates

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Mutual information based non-parametric transform stereo matching algorithm

Template Matching via Densities on the Roto-Translation Group

Compressive Pattern Matching on Multispectral Data

Fast and Robust Matching for Multimodal Remote Sensing Image Registration