Abstract:In order to solve the problem of fully automatic and high-precision alignment of monochrome and color videos , the first frame and subsequent frame alignment methods for video alignment are designed to improve the alignment accuracy while ensuring the speed of alignment. For the first frame , firstly , the scale invariant feature transform (SIFT) is improved based on the characteristics of dual cameras, and then the coarse alignment is performed for monochrome and color videos, which increases the stability and accuracy of the coarse alignment matrix. Subsequently, the alignment matrices of monochrome and color videos are modified according to the coarse alignment matrix coefficients using the scale pyramid model. For the subsequent frames in the video, a translation correction method with a step pyramid is used to reuse the corrected alignment matrix obtained in the first frame, and the translation correction method is used to compensate for the translation errors caused by uncertain time difference fluctuations and camera oscillations, which finally improves the alignment efficiency and alignment accuracy of monochrome and color videos. The experimental results show that for monochrome and color videos of 640x480 size, the algorithm in this paper reduces the root mean square error of the first frame alignment by 0. 79% and the marker point error of the first frame from about 1 pixel to undetectable compared with the traditional SIFT algorithm, and the average alignment time of consecutive video frames is only 0. 357 s, while still keeping the marker point error undetectable. The algorithm in this paper better meets the requirements of fully automatic, high accuracy, fast and robustness for monochrome and color video alignment.

Efficient Photometric Alignment for Around View Monitor System

An optimization method for registration and mosaicking of remote sensing images

Luminance and Chrominance Correction for Multi-view Video Using Overlapped Local Histogram Matching

A post-alignment method for stereoscopic movie

Unaligned Hyperspectral Image Fusion Via Registration and Interpolation Modeling

Multi-projector Calibration and Alignment Using Flatness Analysis for Irregular-Shape Surfaces

3-D Surround View for Advanced Driver Assistance Systems.

Optimal Illumination and Color Consistency for Optical Remote-Sensing Image Mosaicking

Ring Fusion of Fisheye Images Based on Corner Detection Algorithm for Around View Monitoring System of Intelligent Driving

A Color Correction Method Based on Incremental Multilevel Iterative Histogram Matching

Image Mosaic Intelligent Vehicle Around View Monitoring System Based on Ring Fusion Method

Real-time Continuous Geometric Calibration for Projector-Camera System under Ambient Illumination

Parameter Blending for Multi-Camera Harmonization for Automotive Surround View Systems

High Precision Registration of Monochrome and Color Video Based on Improved SIFT and Mutual Information Method

Colour alignment for relative colour constancy via non-standard references

Blending Luminance Uniformity Matrix: A New Robust Photometric Calibration in Multi-Projector Systems

Monocular Camera Mapping with Pose-Guided Optimization: Enhancing Marking-Level HD Map Accuracy

Tackling Challenges of Low-texture and Illumination Variations for Endoscopy Self-supervised Monocular Depth Estimation

Multispectral Image Alignment with Nonlinear Scale-Invariant Keypoint and Enhanced Local Feature Matrix

A New Calibration Technique For Multi-Camera Systems Of Limited Overlapping Field-Of-Views

Real-Time Multi-Camera Video Stitching Algorithm with Adaptive Sensing of Illumination and Dynamic Objects