Abstract:The automatic registration of infrared and visible images in vehicular imaging systems remains challenging in vision-assisted driving systems because of differences in imaging mechanisms. Existing registration methods often fail to accurately register infrared and visible images in vehicular imaging systems due to numerous spurious points during feature extraction, unstable feature descriptions, and low feature matching efficiency. To address these issues, a robust and efficient registration of infrared and visible images for vehicular imaging systems is proposed. In the feature extraction stage, we propose a structural similarity point extractor (SSPE) that extracts feature points using the structural similarity between weighted phase congruency (PC) maps and gradient magnitude (GM) maps. This approach effectively suppresses invalid feature points while ensuring the extraction of stable and reliable ones. In the feature description stage, we design a rotation-invariant feature descriptor (RIFD) that comprehensively describes the attributes of feature points, thereby enhancing their discriminative power. In the feature matching stage, we propose an effective coarse-to-fine matching strategy (EC2F) that improves the matching efficiency through nearest neighbor matching and threshold-based fast sample consensus (FSC), while improving registration accuracy through coordinate-based iterative optimization. Registration experiments on public datasets and a self-established dataset demonstrate the superior performance of our proposed method, and also confirm its effectiveness in real vehicular environments.

Design and Implementation of A Real-Time Image Registration in an Infrared Search and Track System

A Fully Automatic Registration Approach Based on Contour and SIFT for HJ-1 Images

Infrared and Visible Image Registration in UAV Inspection

Research Of Automated Image Registration Technique For Infrared Images Based On Optical Flow Field Analysis

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

Infrared Small Target Detection Via Modified Random Walks

An Iterative SIFT Based on Intensity and Spatial Information for Remote Sensing Image Registration

Robust and Efficient Registration of Infrared and Visible Images for Vehicular Imaging Systems

Feature Tracking for Projection Registration in Laboratory-Scale Reflective Tomography Laser Radar Imaging

Research on Infrared and Visible Image Registration Algorithm for Complex Road Scenes.

An Improved Method for Remote Sensing Image Registration

Registration Method for Infrared Images under Conditions of Fixed-Pattern Noise

Registration method of infrared images based on the optimal peak of phase-correlation criterion

A Real-time Target Detection Algorithm for Panorama Infrared Search and Track System

A Robust Infrared and Visible Image Registration Method for Dual Sensor UAV System

Robust Registration for Ultra-Field Infrared and Visible Binocular Images

Real-time System for Small Target Detection and Tracking in Infrared Image

A Registration Algorithm of Infrared and Visible Images Based on Revised Measure Function

Visible and Infrared Image Registration Algorithm Based on Feature Points

Remote Sensing Image Registration Based on Dynamic Threshold Calculation Strategy and Multiple-Feature Distance Fusion.

Study on Real-Time Registration in Dual Spectrum Low Level Light Night Vision Technique