Abstract:2D-3D matching is an essential step for visual localization, where the accuracy of the camera pose is mainly determined by the quality of 2D-3D correspondences. The matching is typically achieved by the nearest neighbor search of local features. Many existing works have shown impressive results on both the efficiency and accuracy. Recently emerged learning-based features further improve the robustness compared to the traditional hand-crafted ones. However, it is still hard to establish enough correct matches in challenging scenes with illumination changes or repetitive patterns due to the intrinsic local properties of local features. In this work, we propose a novel method to deal with 2D-3D matching in a very robust way. We first establish as many potential correct matches as possible using the local similarity. Then we construct a bipartite graph and use a deep neural network, referred to as Bipartite Graph Network (BGNet), to extract the global geometric information. The network predicts the likelihood of being an inlier for each edge and outputs the globally optimal one-to-one correspondences with a Hungarian pooling layer. The experiments show that the proposed method can find more correct matches and improves localization on both the robustness and accuracy. The results on multiple visual localization datasets are obviously better than the existing state-of-the-arts, which demonstrates the effectiveness of the proposed method.

Learning-Based Bipartite Graph Matching for View-Based 3D Model Retrieval.

View-based 3D Object Retrieval by Bipartite Graph Matching.

3D object retrieval by bipartite matching

3D Model Retrieval Using Weighted Bipartite Graph Matching.

Viewpoint-Aware Representation for Sketch-Based 3D Model Retrieval

Statistical Modeling and Many-to-many Matching for View-Based 3D Object Retrieval

Efficient View-Based 3-D Object Retrieval Via Hypergraph Learning

Learning Bipartite Graph Matching for Robust Visual Localization.

3-D Object Retrieval With Hausdorff Distance Learning

View-Based Discriminative Probabilistic Modeling for 3D Object Retrieval and Recognition

View-based 3D Object Retrieval Via Multi-Modal Graph Learning

View-based 3D object retrieval with discriminative views.

Feature Representation for 3D Object Retrieval Based on Unconstrained Multi-View

Exploring Discriminative Views for 3D Object Retrieval.

Partial Gromov-Wasserstein Learning for Partial Graph Matching

3-D Object Retrieval and Recognition with Hypergraph Analysis

A Metric Learning Method for Image-based 3D Shape Retrieval

View-Based 3-D Model Retrieval: A Benchmark

View-based 3D model retrieval with probabilistic graph model

Representative views re-ranking for 3D model retrieval with multi-bipartite graph reinforcement model.

Multi-Modal Clique-Graph Matching for View-Based 3D Model Retrieval