Abstract:As the fundamental problem in the computer vision area, image matching has wide applications in pose estimation, 3D reconstruction, image retrieval, etc. Suffering from the influence of external factors, the process of image matching using classical local detectors, e.g., scale-invariant feature transform (SIFT), and the outlier filtering approaches, e.g., Random sample consensus (RANSAC), show high computation speed and pool robustness under changing illumination and viewpoints conditions, while image matching approaches with deep learning strategy (such as HardNet, OANet) display reliable achievements in large-scale datasets with challenging scenes. However, the past learning-based approaches are limited to the distinction and quality of the dataset and the training strategy in the image-matching approaches. As an extension of the previous conference paper, this paper proposes an accurate and robust image matching approach using fewer training data in an end-to-end manner, which could be used to estimate the pose error This research first proposes a novel dataset cleaning and construction strategy to eliminate the noise and improve the training efficiency; Secondly, a novel loss named quadratic hinge triplet loss (QHT) is proposed to gather more effective and stable feature matching; Thirdly, in the outlier filtering process, the stricter OANet and bundle adjustment are applied for judging samples by adding the epipolar distance constraint and triangulation constraint to generate more outstanding matches; Finally, to recall the matching pairs, dynamic guided matching is used and then submit the inliers after the PyRANSAC process. Multiple evaluation metrics are used and reported in the 1st place in the Track1 of CVPR Image-Matching Challenge Workshop. The results show that the proposed method has advanced performance in large-scale and challenging Phototourism benchmark.

Image Set Classification Using Candidate Sets Selection and Improved Reverse Training

Image Set Classification Based on Synthetic Examples and Reverse Training

Simultaneous Learning of Reduced Prototypes and Local Metric for Image Set Classification.

Column Subset Selection for Active Learning in Image Classification

Group Collaborative Representation for Image Set Classification.

Learning Intra and Inter-Camera Invariance for Isolated Camera Supervised Person Re-identification

A Review of Image Set Classification

Matching Image Sets via Adaptive Multi Convex Hull

Multiple-Shot Person Re-identification by Features Learned from Third-party Image Sets

Image Set-Based Classification Using Collaborative Exemplars Representation.

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

Camera-aware cluster-instance joint online learning for unsupervised person re-identification

Improved HardNet and Stricter Outlier Filtering to Guide Reliable Matching

Set-Based Feature Learning for Person Re-identification Via Third-Party Images

Discriminative Residual Analysis for Image Set Classification with Posture and Age Variations

Boosting constrained mutual subspace method for robust image-set based object recognition

A Set-Level Joint Sparse Representation for Image Set Classification.

Image Set Classification Based on Cooperative Sparse Representation.

Learning Part-Alignment Feature for Person Re-Identification with Spatial-Temporal-based Re-Ranking Method

Face Image Set Classification with Self-Weighted Latent Sparse Discriminative Learning.