Abstract:This paper proposes a systematic image mosaicking methodology to produce hyperspectral image for environment monitoring using an emerging UAV-based push-broom hyperspectral imager. The suitability of alternative methods in each step is assessed by experiments of an urban scape, a river course and a forest study area. First, the hyperspectral image strips were acquired by sequentially stitching the UAV images acquired by push-broom scanning along each flight line. Next, direct geo-referencing was applied to each image strip to get initial geo-rectified result. Then, with ground control points, the curved surface spline function was used to transform the initial geo-rectified image strips to improve their geometrical accuracy. To further remove the displacement between pairs of image strips, an improved phase correlation (IPC) and a SIFT and RANSAC-based method (SR) were used in image registration. Finally, the weighted average and the best stitching image fusion method were used to remove the spectral differences between image strips and get the seamless mosaic. Experiment results showed that as the GCPs‘ number increases, the mosaicked image‘s geometrical accuracy increases. In image registration, there exists obvious edge information that can be accurately extracted from the urban scape and river course area; comparative results can be achieved by the IPC method with less time cost. However, for the ground objects with complex texture like forest, the edges extracted from the image is prone to be inaccurate and result in the failure of the IPC method, and only the SR method can get a good result. In image fusion, the best stitching fusion method can get seamless results for all three study areas. Whereas, the weighted average fusion method was only useful in eliminating the stitching line for the river course and forest areas but failed for the urban scape area due to the spectral heterogeneity of different ground objects. For different environment monitoring applications, the proposed methodology provides a practical solution to seamlessly mosaic UAV-based push-broom hyperspectral images with high geometrical accuracy and spectral fidelity.

Hyperspectral demosaicking and crosstalk correction using deep learning

Deep Learning-Based Crop Mapping in the Cloudy Season Using One-Shot Hyperspectral Satellite Imagery.

Hyperspectral Imaging from a Raw Mosaic Image with End-to-end Learning

Deep learning approach for hyperspectral image demosaicking, spectral correction and high-resolution RGB reconstruction

Spatial gradient consistency for unsupervised learning of hyperspectral demosaicking: Application to surgical imaging

Efficient and Accurate Hyperspectral Image Demosaicing with Neural Network Architectures

A Snapshot Near-Infrared Hyperspectral Demosaicing Method with Convolutional Neural Networks in Low Illumination Environment

A Robust UAV Hyperspectral Image Stitching Method Based on Deep Feature Matching

A Simplified Method For Uav Multispectral Images Mosaicking

Seamless Mosaicking of UAV-Based Push-Broom Hyperspectral Images for Environment Monitoring

Hyperspectral Image Super-Resolution with a Mosaic RGB Image

Channel-by-Channel Demosaicking Networks with Embedded Spectral Correlation

A self-supervised and adversarial approach to hyperspectral demosaicking and RGB reconstruction in surgical imaging

Model-based demosaicking for acquisitions by a RGBW color filter array

Multispectral Snapshot Image Registration Using Learned Cross Spectral Disparity Estimation and a Deep Guided Occlusion Reconstruction Network

DENSE POINT CLOUD EXTRACTION FROM UAV IMAGERY USING PARALLAX ATTENTION

Deep Color Image Demosaicking with Feature Pyramid Channel Attention

Joint Spatial-Spectral Pattern Optimization and Hyperspectral Image Reconstruction

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Hyperspectral Image Super-Resolution under Misaligned Hybrid Camera System.

Comparative Analysis of Hyperspectral Image Reconstruction Using Deep Learning for Agricultural and Biological Applications