Abstract:With the popularity of vision sensors and the advancement of image processing technology, machine vision tasks based on image matching have received widespread attention. Matching methods based on handcrafted features have strong interpretability, but they are susceptible to noise in complex environments. In addition, deep learning has shown potential in improving matching performance, but at the cost of large amounts of specific samples and computing resources. In recent years, there have been efforts to explore how to combine handcrafted features and deep features to enhance the performance, but most of them only consider their sequential relationship. To address these challenges, we propose a novel image matching scheme with a fine-grained decision-level fusion (DLF) method that fully considers the judgments of handcrafted features and deep features for potential correspondence points, effectively combining handcrafted and deep features in a novel way. We also train generic features on public datasets to handle unseen scenes. We use RootSIFT as prior knowledge to guide the extraction of deep features, significantly reducing computational overhead. In addition, we carefully design preprocessing steps by incorporating device attitude information. We conduct image matching experiments on public datasets and our own captured dataset. Compared to the existing methods, as illustrated in our experimental results, the proposed scheme achieves an overall 2.5– $6\times $ more correct matches with improved robustness. Finally, we design a target localization algorithm incorporating an unmanned aerial vehicle (UAV) to achieve accurate and efficient localization using the proposed matching scheme and weighted least squares (WLS) estimation algorithm, demonstrating the versatility of the proposed image matching scheme.

Human hand detection using robust local descriptors

A real-time hand gesture recognition method

An HOG-CT Human Detector with Histogram-Based Search.

Robust 3D Hand Detection from a Single RGB-D Image in Unconstrained Environments

A Robust Context Attention Network for Human Hand Detection

Robust Hand Tracking Based on Online Learning and Multi-Cue Flocks of Features

Human Detection Based on Fusion of Histograms of Oriented Gradients and Main Partial Features

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

A Fingertips Detection Method Based On The Combination Of Centroid And Harris Corner Algorithm

Robust hand tracking with Hough Forest and multi-cue flocks of features

Joint Hand Detection and Rotation Estimation by Using CNN

Detector-in-Detector: Multi-Level Analysis for Human-Parts

Combination Features and Models for Human Detection.

Discriminative Local Binary Patterns for Human Detection in Personal Album

Robust Hand Gesture Detection Method Based on Multi-feature Fusion

Image Matching and Localization Based on Fusion of Handcrafted and Deep Features

Robust Hand Detection and Tracking Based on Monocular Vision

Hand-crafted and deep convolutional neural network features fusion and selection strategy: An application to intelligent human action recognition

Hand Gesture Recognition using Deep Feature Fusion Network based on Wearable Sensors

Vision-Based Hand Detection and Tracking Using Fusion of Kernelized Correlation Filter and Single-Shot Detection

Human Behavior Recognition via Hierarchical Patches Descriptor and Approximate Locality-Constrained Linear Coding