Image Fusion Techniques in Remote Sensing

Reham Gharbia,Ahmad Taher Azar,Ali El Baz,Aboul Ella Hassanien
DOI: https://doi.org/10.48550/arXiv.1403.5473
2014-03-11
Abstract:Remote sensing image fusion is an effective way to use a large volume of data from multisensor images. Most earth satellites such as SPOT, Landsat 7, IKONOS and QuickBird provide both panchromatic (Pan) images at a higher spatial resolution and multispectral (MS) images at a lower spatial resolution and many remote sensing applications require both high spatial and high spectral resolutions, especially for GIS based applications. An effective image fusion technique can produce such remotely sensed images. Image fusion is the combination of two or more different images to form a new image by using a certain algorithm to obtain more and better information about an object or a study area than. The image fusion is performed at three different processing levels which are pixel level, feature level and decision level according to the stage at which the fusion takes place. There are many image fusion methods that can be used to produce high resolution multispectral images from a high resolution pan image and low resolution multispectral images. This paper explores the major remote sensing data fusion techniques at pixel level and reviews the concept, principals, limitations and advantages for each technique. This paper focused on traditional techniques like intensity hue-saturation- (HIS), Brovey, principal component analysis (PCA) and Wavelet.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
This paper aims to explore remote - sensing image fusion techniques, especially pixel - level data fusion methods. The paper mainly focuses on how to fuse panchromatic (Pan) images with high spatial resolution and multispectral (MS) images with low spatial resolution to generate multispectral images with both high spatial resolution and high spectral resolution. This fusion technique is very important in Geographic Information Systems (GIS) and other remote - sensing applications, because many applications require image data with both high spatial resolution and high spectral resolution. ### Main issues of the paper 1. **Requirements for high spatial resolution and high spectral resolution**: - Remote - sensing applications (such as classification, change detection, land cover analysis, etc.) usually require images with both high spatial resolution and high spectral resolution. - Separate panchromatic images or multispectral images cannot meet these requirements, so image fusion techniques are needed to combine the advantages of both. 2. **Classification of image fusion techniques**: - Image fusion can be carried out at different processing levels, including pixel - level, feature - level and decision - level. - This paper focuses on pixel - level image fusion techniques, especially traditional methods such as IHS (Intensity - Hue - Saturation), Brovey transformation, Principal Component Analysis (PCA) and wavelet transformation. 3. **Advantages and disadvantages of existing techniques**: - **IHS**: It can enhance the spatial details of multispectral images, but there is serious spectral distortion. - **Brovey transformation**: It is simple to calculate and takes a short time, but it introduces significant radiometric distortion and requires experienced analysts to adjust parameters. - **PCA**: It can compress a large amount of input information without losing too much information, but the first selected eigenvalue may not contain all patterns, resulting in a decline in the quality of the fused image. - **小波变换**: Through multi - resolution analysis, it can maintain spectral characteristics while improving spatial resolution, but it completely discards the low - frequency part of the panchromatic image, which may cause the mosaic phenomenon in the fused image. 4. **Future research directions**: - The existing traditional image fusion techniques have limitations and cannot fully meet the requirements of remote - sensing applications. - The future direction is to develop hybrid systems, combining the advantages of multiple techniques to improve the quality and efficiency of fused images. ### Conclusion The paper summarizes the advantages and disadvantages of various image fusion techniques and points out the advantages of hybrid systems in pixel - level fusion. The author believes that future image fusion research should focus on improving traditional systems and developing more efficient hybrid techniques to better meet the requirements of remote - sensing applications.