Abstract:UAV remote sensing image stitching can provide a more comprehensive and continuous area by stitching several overlapping region images. It has been widely used in many fields, such as airborne reconnaissance and surveillance tasks, agriculture production, geological disaster monitoring, and so on. However, traditional feature-based image stitching methods often require hand-crafted features and multiple execution steps, which could extract many redundant feature points in non-overlapping regions and may fail to stitch images with weak textures. To solve this problem, we propose an improved VGG16 Siamese network for the UAV remote sensing image stitching model to achieve end-to-end stitching. The first 13 layers of the VGG16 network were intercepted to form a shared weights feature extraction network, and an improved Squeeze-and-Excitation module was introduced to effectively extract the features of the overlapping areas of the images. A network of regressing affine matrix was designed by using the LeakyReLu activation function to protect the relevant feature maps after feature fine matching, which improves the accuracy of image stitching. Besides, we constructed datasets to train our network: a single UAV remote sensing image was used to form a training image pair based on a limited degree of affine transformation, and the real label of affine transformation between the image pairs was obtained. We compared the SIFT + RANSAC, APAP, and deep homography estimation-based image stitching algorithm on the UAV remote sensing datasets. Experiments show the value of structural similarity(SSIM) increased by 24.1%, and the root mean square error(RMSE) was reduced by 14.69%. Moreover, the proposed stitching model also has good stitching results for UAV remote sensing images as well as weak texture images in subjective visual effects.

Superpixel-Based Seamless Image Stitching for UAV Images.

UAV Image Stitching Based on Optimal Seam and Half-Projective Warp

Unmanned aerial vehicle image stitching based on multi‐region segmentation

Seam-Cutting Based Unmanned Aerial Vehicle Hyperspectral Image Stitching

Seamless UAV Hyperspectral Image Stitching Using Optimal Seamline Detection via Graph Cuts

Fast Color Blending for Seamless Image Stitching.

Elimination of Irregular Boundaries and Seams for UAV Image Stitching with a Diffusion Model

A Stereo Dual-Channel Dynamic Programming Algorithm for UAV Image Stitching

An Application of Panoramic Mosaic in UAV Aerial Image

A Robust UAV Hyperspectral Image Stitching Method Based on Deep Feature Matching

Research on Aerial Image Stitching Technology

Seam-line Determination Via Minimal Connected Area Searching and Minimum Spanning Tree for UAV Image Mosaicking

UAV remote sensing image stitching via improved VGG16 Siamese feature extraction network

UAV Image Stitching Based on Mesh-Guided Deformation and Ground Constraint.

Improved Seam-Line Searching Algorithm for UAV Image Mosaic with Optical Flow

SatellStitch: Satellite Imagery-Assisted UAV Image Seamless Stitching for Emergency Response without GCP and GNSS

A Fast and Effective Panorama Stitching Algorithm on UAV Aerial Images

UAV Image Stitching Using Shape-Preserving Warp Combined with Global Alignment

UAV Low-Altitude Aerial Image Stitching Based on Semantic Segmentation and ORB Algorithm for Urban Traffic

MLP-Based Efficient Stitching Method for UAV Images

A Real-time Stitching Algorithm for UAV Aerial Images