CorMatcher: A corners-guided graph neural network for local feature matching
Hainan Luo,Tao Xie,Ao Wang,Kun Dai,Chuqing Cao,Lijun Zhao
DOI: https://doi.org/10.1016/j.eswa.2024.125190
IF: 8.5
2024-08-31
Expert Systems with Applications
Abstract:Local feature matching is crucial for various computer vision tasks like Structure from Motion (SfM) and visual localization. In human visual matching, individuals typically scan image pairs to detect and match prominent corners, then refine matches by leveraging the geometric structure information from these corners. Inspired by this observation, we propose CorMatcher, a corners-guided detector-free network that investigates the guiding role of prominent corners in local feature matching. The concept of CorMatcher is utilizing the corners-images interaction module (CIIM) and deep supervision technique (DST) to replicate the aforementioned human behaviors, thus generating more human-intuitive features for accurate feature matching. CIIM imitates human behavior that first observes corners to guide the matching process, and then extend the matching space from corners to entire images. Technically, In particular, CIIM first integrates global information across all keypoints to ensure overall perception. Then, CIIM extracts reliable corners, performs feature enhancement among them, and propagates the enhanced features of corners to entire images. Finally, CIIM interacts features of all keypoints to ensure that the global information is comprehensively considered to establish final matches. In addition, we apply DST to the corners, rather than all keypoints, to supervise matching results after each feature enhancement process, thus simulating the human behavior that appraises matching results after each observation. Comprehensive experiments demonstrate that CorMatcher exhibits superior performance compared to several benchmarks.
computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science