Abstract:With the popularity of vision sensors and the advancement of image processing technology, machine vision tasks based on image matching have received widespread attention. Matching methods based on handcrafted features have strong interpretability, but they are susceptible to noise in complex environments. In addition, deep learning has shown potential in improving matching performance, but at the cost of large amounts of specific samples and computing resources. In recent years, there have been efforts to explore how to combine handcrafted features and deep features to enhance the performance, but most of them only consider their sequential relationship. To address these challenges, we propose a novel image matching scheme with a fine-grained decision-level fusion (DLF) method that fully considers the judgments of handcrafted features and deep features for potential correspondence points, effectively combining handcrafted and deep features in a novel way. We also train generic features on public datasets to handle unseen scenes. We use RootSIFT as prior knowledge to guide the extraction of deep features, significantly reducing computational overhead. In addition, we carefully design preprocessing steps by incorporating device attitude information. We conduct image matching experiments on public datasets and our own captured dataset. Compared to the existing methods, as illustrated in our experimental results, the proposed scheme achieves an overall 2.5– $6\times $ more correct matches with improved robustness. Finally, we design a target localization algorithm incorporating an unmanned aerial vehicle (UAV) to achieve accurate and efficient localization using the proposed matching scheme and weighted least squares (WLS) estimation algorithm, demonstrating the versatility of the proposed image matching scheme.

A Feature Fusion Algorithm For Human Matching Between Non-Overlapping Cameras

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

Analysis of Appearance Features for Human Matching Between Different Fields of View

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

Fusion of Multiple Channel Features for Person Re-Identification

A Feature Fusion Strategy For Person Re-Identification

A New Wavelet Image Fusion Algorithm Based on Human Visual System

Person Re-identification by Multi-hypergraph Fusion

Person Re-Identification by Optimizing and Integrating Multiple Feature Representations

Real Time Object Tracking Using Fused Color And Edge Cues

Image Matching Via Feature Fusion and Coherent Constraint.

Human Tracking Algorithm Based on Model Fusion

Image Matching and Localization Based on Fusion of Handcrafted and Deep Features

Multiple feature fusion for object tracking

Human tracking in camera network with non-overlapping FOVs

A high-level image sequence fusion algorithm for human detection

Image Matching Based on Multi-Features Fusion

A Target Tracking Algorithm Based On Adaptive Multiple Feature Fusion

Image fusion using lifting wavelet transform with human visual features

Human Interaction Recognition Fusing Multiple Features of Depth Sequences

An Improved Mean-shift Tracking Algorithm Based on Adaptive Multiple Feature Fusion