Abstract:Optical and synthetic aperture radar (SAR) image keypoint detection is an important foundation for multimodal remote sensing image matching. The influence of nonlinear radiometric differences and geometric deformation between optical and SAR images leads to low repeatability of existing keypoint detection methods. To address the problem that existing keypoint detection methods cannot provide the required homonymous points for heterogeneous image matching, we propose a keypoint detection method [multilevel attention Siamese network for keypoint detection in optical and SAR images (SKD-Net)] and improve it in terms of both network structure and network optimization. First, we propose a multilevel attention Siamese network, which is composed of multiple convolutional modules and transformer modules with shared weights to extract common features at different levels for keypoint detection. We introduce a transformer module in the keypoint detection pipeline and fuse shallow and deep features to obtain more spatial and rich semantic information to facilitate heterogeneous image keypoint detection. Then, to ensure that the detected keypoints have more homonymous points and localization accuracy, we propose a position-consistent loss. Unlike previous loss functions, our designed position-consistent loss function takes the differences between heterogeneous image score maps into account, and it autonomously selects the optimized correct point pairs to enable the network to perform correct learning. Finally, extensive experiments show that our detection method outperforms the current state-of-the-art keypoint detection methods in terms of repeatability, localization accuracy, and matching performance. Our source code is available at https://github.com/zhangschen/SKD-Net.

Image KeyPoints Detector Based On Transformer Of Wavelet Transform

SEKD: Self-Evolving Keypoint Detection and Description

A Region-Based Descriptor Network for Uniformly Sampled Keypoints

From Independence to Cooperation: A Novel Keypoint Extraction Framework for Autonomous Systems

KeypointDETR: an End-to-End 3D Keypoint Detector

Multilevel Attention Siamese Network for Keypoint Detection in Optical and SAR Images

Improving Transformer-based Image Matching by Cascaded Capturing Spatially Informative Keypoints

SAR–Optical Image Matching Using Self-Supervised Detection and a Transformer–CNN-Based Network

Deep Corner

TransMarker: A Pure Vision Transformer for Facial Landmark Detection.

Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filters Revisited

ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformation

FeatureBooster: Boosting Feature Descriptors with a Lightweight Neural Network

PointTransformer: Encoding Human Local Features for Small Target Detection

3D Keypoint Detection Based on Deep Neural Network with Sparse Autoencoder

Real-time CNN-based Keypoint Detector with Sobel Filter and Descriptor Trained with Keypoint Candidates

DKNAS: A Practical Deep Keypoint Extraction Framework Based on Neural Architecture Search

Dynamic Keypoint Detection Network for Image Matching

Realtime CNN-based Keypoint Detector with Sobel Filter and CNN-based Descriptor Trained with Keypoint Candidates

A Scale and Rotational Invariant Key-point Detector based on Sparse Coding

A Novel Keypoint Detection in Wavelet Pyramid Space