Abstract:Semantic correspondence remains a challenging task for establishing correspondences between a pair of images with the same category or similar scenes due to the large intra-class appearance. In this paper, we introduce a novel problem called 'Small Object Semantic Correspondence (SOSC).' This problem is challenging due to the close proximity of keypoints associated with small objects, which results in the fusion of these respective features. It is difficult to identify the corresponding key points of the fused features, and it is also difficult to be recognized. To address this challenge, we propose the Keypoint Bounding box-centered Cropping (KBC) method, which aims to increase the spatial separation between keypoints of small objects, thereby facilitating independent learning of these keypoints. The KBC method is seamlessly integrated into our proposed inference pipeline and can be easily incorporated into other methodologies, resulting in significant performance enhancements. Additionally, we introduce a novel framework, named KBCNet, which serves as our baseline model. KBCNet comprises a Cross-Scale Feature Alignment (CSFA) module and an efficient 4D convolutional decoder. The CSFA module is designed to align multi-scale features, enriching keypoint representations by integrating fine-grained features and deep semantic features. Meanwhile, the 4D convolutional decoder, based on efficient 4D convolution, ensures efficiency and rapid convergence. To empirically validate the effectiveness of our proposed methodology, extensive experiments are conducted on three widely used benchmarks: PF-PASCAL, PF-WILLOW, and SPair-71k. Our KBC method demonstrates a substantial performance improvement of 7.5\% on the SPair-71K dataset, providing compelling evidence of its efficacy.

AirCode: A Robust Object Encoding Method

SSF: Sparse Point Cloud Object Detection Based on Self-Adaptive Voxel Encoding and Focal-Sparse Convolution

Oriented RepPoints for Aerial Object Detection

AirCode: Unobtrusive Physical Tags for Digital Fabrication

AirLoc: Object-based Indoor Relocalization

Robust Object-Level Semantic Visual SLAM Using Semantic Keypoints

From Independence to Cooperation: A Novel Keypoint Extraction Framework for Autonomous Systems

A novel search coding method for generic object recognition based on shared features

Multi-Level structured image coding on high-dimensional image representation

Independently Keypoint Learning for Small Object Semantic Correspondence

Object-attribute-relation Model-Based Semantic Coding for Image Transmission

Leveraging Positional Encoding for Robust Multi-Reference-Based Object 6D Pose Estimation

Sim2Real Object-Centric Keypoint Detection and Description

Hope: Hierarchical Object Prototype Encoding For Efficient Object Instance Search In Videos

AeroDetectNet: A Lightweight, High-Precision Network for Enhanced Detection of Small Objects in Aerial Remote Sensing Imagery.

DPANet: Position‐aware feature encoding and decoding for accurate large‐scale point cloud semantic segmentation

Keypoint Autoencoders: Learning Interest Points of Semantics

Object-Based Image Coding: A Learning-Driven Revisit

ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimation

OSK: A Novel LiDAR Occupancy Set Key-Based Place Recognition Method in Urban Environment

Robust Data Association for Object-level Semantic SLAM