Remote Sensing Image Fusion:Newest Development and Perspective

Chai Yong,He You,Qu Changwen

DOI: https://doi.org/10.3969/j.issn.1627-9730.2009.08.001

2009-01-01

Abstract:Conception of remote sensing image fusion is summarized.Classification and algorithms of remote sensing image fusion is studied.And evaluation of remote sensing image fusion is discussed.The development trend and direction are brought out after analysising the embarrassment deeply.

What problem does this paper attempt to address?

Imaging spectrometer image data fusion

jiping ma,zequn guan,jilin liu

DOI: https://doi.org/10.1117/12.323601

1998-01-01

Abstract:Imaging spectrometer is one important aspect of contemporary remote sensing developments. It is characterized by huge amount of supermultipal spectral image data provision. For less remote sensing image data provision, we used to put all the data directly into the process of image object recognition without making any data fusion. Even occasional data fusion is experiential. This situation is not suitable for imaging spectrometer. The supermultipal bands of imaging spectrometer provide us with much more freedom on available choices of suitable images for procession and information extraction; at the same time, fusion between different related image data aimed at themes extracting can reduce the amount of data on one hand, and make most use of imaging spectrometer image data on the other. And to some extent, image data fusion is of utmost importance and practical significance for theme information extracting from imaging spectrometer images. This paper discusses fusion methods for conventional remote sensing data. Based on analysis of imaging spectrometer, it proposes method for imaging spectrometer image data.© (1998) COPYRIGHT SPIE--The International Society for Optical Engineering. Downloading of the abstract is permitted for personal use only.
Remote Sensing Image Fusion Based on Fuzzy Theory in Pixel Level and Assessing the Quality of Resulting Images

Zhongyong Xiao,Hong Jiang,Huiping Zhou,Shuquan Yu

DOI: https://doi.org/10.1117/12.760455

2007-01-01

Abstract:The technology of image fusion now has been used in the process of remote sensing data. It can integrate the information from multi-sensor data so as to complement the shortage of single sensor image, then more suitable for the purpose of human visual perception, computer-aided object detection, and target recognition. Currently, there are many methods of image fusion we can get from other researcher's study, but these methods of image fusion have some disadvantages. This paper presented the approach of image fusion in pixel level with the fuzzy theory, the source of data used in this paper come from QuicicBird image, the resolutions of multi-spectral with four bands and panchromatic image are 2.44m and 0.61m respectively. The process of image fusion is implemented mainly in the fuzzy tool of Matlab. Lastly, assessing the quality of resulting images and these methods of evaluation is based on visually and statistically. The findings that the fused image has remained the attributes of multi-spectral image and high resolution image with 0.61m instead of 2.44m. It is indicated that the fused image is finer than the original multi-spectral image. So the approach of this paper has presented could be a good method to process remote sensing image fusion.
Image Fusion in Remote Sensing: An Overview and Meta Analysis

Hessah Albanwan,Rongjun Qin,Yang Tang

2024-01-17

Abstract:Image fusion in Remote Sensing (RS) has been a consistent demand due to its ability to turn raw images of different resolutions, sources, and modalities into accurate, complete, and spatio-temporally coherent images. It greatly facilitates downstream applications such as pan-sharpening, change detection, land-cover classification, etc. Yet, image fusion solutions are highly disparate to various remote sensing problems and thus are often narrowly defined in existing reviews as topical applications, such as pan-sharpening, and spatial-temporal image fusion. Considering that image fusion can be theoretically applied to any gridded data through pixel-level operations, in this paper, we expanded its scope by comprehensively surveying relevant works with a simple taxonomy: 1) many-to-one image fusion; 2) many-to-many image fusion. This simple taxonomy defines image fusion as a mapping problem that turns either a single or a set of images into another single or set of images, depending on the desired coherence, e.g., spectral, spatial/resolution coherence, etc. We show that this simple taxonomy, despite the significant modality difference it covers, can be presented by a conceptually easy framework. In addition, we provide a meta-analysis to review the major papers studying the various types of image fusion and their applications over the years (from the 1980s to date), covering 5,926 peer-reviewed papers. Finally, we discuss the main benefits and emerging challenges to provide open research directions and potential future works.

Computer Vision and Pattern Recognition,Image and Video Processing
A review of remote sensing image fusion methods

Hassan Ghassemian

DOI: https://doi.org/10.1016/j.inffus.2016.03.003

IF: 18.6

2016-11-01

Information Fusion

Abstract:The recent years have been marked by continuous improvements of remote sensors with applications like monitoring and management of the environment, precision agriculture, security and defense. On the one hand, the high spectral resolution is necessary for an accurate class discrimination of land covers. On the other hand, the high spatial resolution is required for an accurate description of the texture and shapes. Practically, each kind of imaging sensor can only focus on a given different operating range and environmental conditions, the reception of all the necessary information for detecting an object or classifying a scene is not possible. So, for the full exploitation of multisource data, advanced analytical or numerical image fusion techniques have been developed. In this paper, we review some popular and state-of-the-art fusion methods in different levels especially at pixel level. In addition to reviewing of different fusion methods, varied approaches and metrics for assessment of fused product are also presented.
The Study on Image Fusion for Medium and High Spatial Resolution Remote Sensing Images

贾春燕,邓劲松,王新辉,谭永生,沈掌泉

DOI: https://doi.org/10.3969/j.issn.1004-0323.2007.04.010

2007-01-01

Abstract:With the principles of image fusion methods,this paper focused on finding a proper method for fusing the panchromatic and multi-spectral images of QuickBird,SPOT5 and Landsat ETM+.Brovey,SVR,PCA,Pansharp and Gram-schmidt were used in this paper.The results showed that within these methods,①the optimum method for QuickBird image was Gram-schmidt transform.②Pansharp transform was the optimum for SPOT5 image.③For ETM+ image,the Gram-schmidt transform was the best method from the view of preserving spectral information of multi-spectral image;Brovey transform presented the best spatial information for band 2 and band 3,SVR transform obtained the better spatial effects than other transforms for band 1,5,7,and Pansharp transform was the best method for band 2.
Image Fusion Technologies In Commercial Remote Sensing Packages

Firouz Abdullah Al-Wassai,N. V. Kalyankar,N.V. Kalyankar

DOI: https://doi.org/10.48550/arXiv.1307.2440

2013-07-09

Computer Vision and Pattern Recognition

Abstract:Several remote sensing software packages are used to the explicit purpose of analyzing and visualizing remotely sensed data, with the developing of remote sensing sensor technologies from last ten years. Accord-ing to literature, the remote sensing is still the lack of software tools for effective information extraction from remote sensing data. So, this paper provides a state-of-art of multi-sensor image fusion technologies as well as review on the quality evaluation of the single image or fused images in the commercial remote sensing pack-ages. It also introduces program (ALwassaiProcess) developed for image fusion and classification.
Spatiotemporal Fusion in Remote Sensing

Hessah Albanwan,Rongjun Qin

DOI: https://doi.org/10.48550/arXiv.2107.02701

2021-07-07

Abstract:Remote sensing images and techniques are powerful tools to investigate earth surface. Data quality is the key to enhance remote sensing applications and obtaining a clear and noise-free set of data is very difficult in most situations due to the varying acquisition (e.g., atmosphere and season), sensor, and platform (e.g., satellite angles and sensor characteristics) conditions. With the increasing development of satellites, nowadays Terabytes of remote sensing images can be acquired every day. Therefore, information and data fusion can be particularly important in the remote sensing community. The fusion integrates data from various sources acquired asynchronously for information extraction, analysis, and quality improvement. In this chapter, we aim to discuss the theory of spatiotemporal fusion by investigating previous works, in addition to describing the basic concepts and some of its applications by summarizing our prior and ongoing works.

Computer Vision and Pattern Recognition
The Realistic Fusion of Multi-spectral Images

金剑秋,王章野,江照意,彭群生

DOI: https://doi.org/10.3969/j.issn.1006-8961.2002.09.012

2002-01-01

Journal of Image and Graphics

Abstract:Multi-spectral information fusion is the combination of information acquired from multi-spectral sensors in the same scene to acquire clearer description about the scene by using the temporal and spacial correlation, and their complementarity. The realistic fusion refers to the conservation of spectral features from original multi-spectral images in certain case in the new fused image. In this paper we propose a new image fusion method by analyzing advantage and disadvantage of several common methods and studying those applicable environments. This method integrates several fusion methods according to those applicable environments. Besides we propose a new HVS based image fusion which is suitable for little correlation among the multi-spectral images. The HVS based method can extrude target spectral character. When the correlation among multi-spectral images is strong, the wavelet transform-based or PCA method is used according to the distance of the targets. Experiments show that our integrated method can be suitable for different type scene, and the fusion results are better than that using single fusion method and the result is advantageous to the detection and recognition for targets.
Remote sensing Image fusion based on iterative discrete Shearlet transform

Yong CHAI,You HE,Changwen QU

DOI: https://doi.org/10.3778/j.issn.1002-8331.2011.03.052

2011-01-01

Abstract:Shearlet transform is one kind of multiscale geometric analysis tools.And it is useful at processing image with complex texture and edge.A remote sensing image fusion method based on iterative discrete Shearlet transform is proposed.This algorithm decomposes the source images into multiresolution and multidirection tree representations,and obtains the decomposed tree of the fusion image by different rules for the coarse and detail parts separately.At last,fusion image is got by invert discrete Shearlet transform.Experiments show this algorithm has better performance than image fusion methods based on Contourlet and keeps texture and edge more effectually.
Image Fusion Techniques in Remote Sensing

Reham Gharbia,Ahmad Taher Azar,Ali El Baz,Aboul Ella Hassanien

DOI: https://doi.org/10.48550/arXiv.1403.5473

2014-03-11

Abstract:Remote sensing image fusion is an effective way to use a large volume of data from multisensor images. Most earth satellites such as SPOT, Landsat 7, IKONOS and QuickBird provide both panchromatic (Pan) images at a higher spatial resolution and multispectral (MS) images at a lower spatial resolution and many remote sensing applications require both high spatial and high spectral resolutions, especially for GIS based applications. An effective image fusion technique can produce such remotely sensed images. Image fusion is the combination of two or more different images to form a new image by using a certain algorithm to obtain more and better information about an object or a study area than. The image fusion is performed at three different processing levels which are pixel level, feature level and decision level according to the stage at which the fusion takes place. There are many image fusion methods that can be used to produce high resolution multispectral images from a high resolution pan image and low resolution multispectral images. This paper explores the major remote sensing data fusion techniques at pixel level and reviews the concept, principals, limitations and advantages for each technique. This paper focused on traditional techniques like intensity hue-saturation- (HIS), Brovey, principal component analysis (PCA) and Wavelet.

Computer Vision and Pattern Recognition
Analysis of Remote Sensing Image Fusion Based on Different Algorithms

Jin Zhao

2011-01-01

Abstract:Remote sensing(RS) image fusion makes the image has high resolution and abundant spectrum information,and the fusion algorithm is a study hot spot in RS field in recent years.Though many fusion algorithms for different RS images have been put forward,the fidelity of spectrum information and the fusion degree of spatial information are still focus issues in fusion algorithm study.Therefore,it is necessary for researchers to evaluate the effect of different fusion algorithms.In this paper,ETM+ image is selected based on ENVI software platform.The fusion results of panchromate and multi-spectra are quantitatively evaluated and the best fusion algorithm is discussed by different fusion algorithms,such as PCA,Multiplicative,Brovey and Wavelet transformations applied for different index,such as average value,standard deviation,deviation index,and relative coefficient.The result shows that Wavelet transformations is the best fusion algorithm,and Multiplicative transformations is better than Brovey and PCA.This result has laid a foundation to make full use of the panchromatic high resolution and multi-spectral charactristics,and to mine data potential.
The Research on Comparing and Analyzing the Remote Sensing Image Fusion and Algorithm with High Spectral and Spatial Quality

SHEN Tao,DANG An-rang

DOI: https://doi.org/10.3969/j.issn.2095-6835.2010.14.001

2010-01-01

Abstract:With the capability of the sensor promoting,modern remote sensing technology provides various spectral and spatial resolution remote sensing data.It becomes a challenge for remote sensing application to how to use multi-sources and multi-scales remote sensing image adequately and effective.This paper expatiates systemically the theory and method of the remote sensing image fusion,analyzes detailedly the method and character of the remote sensing image fusion of the pixel level,feature level,decision level.We discuss two remote sensing image fusion algorithm with high spectral and spatial quality —Gram-Schmidt and SFIM.We present the evaluating system of the fusion result.The research results show that the SFIM is the optimum fusion method.
Multi-source remote sensing data fusion: status and trends

Jixian Zhang

DOI: https://doi.org/10.1080/19479830903561035

2010-03-01

International Journal of Image and Data Fusion

Abstract:With the fast development of remote sensor technologies, e.g. the appearance of Very High Resolution (VHR) optical sensors, SAR, LiDAR, etc., mounted on either airborne or spaceborne platforms, multi-source remote sensing data fusion techniques are emerging due to the demand for new methods and algorithms. The general fusion techniques have been well developed and applied in various fields ranging from satellite earth observation to computer vision, medical image processing, defence security and so on. Despite the fast development, the techniques remain challenging for multi-source data fusion within varying spatial and temporal resolutions. This article reviews current techniques of multi-source remote sensing data fusion and discusses their future trends and challenges through the concept of hierarchical classification, i.e., pixel/data level, feature level and decision level. This article concentrates on discussing optical panchromatic and multi-spectral data fusing methods. So far, the pixel level fusion methods have mainly focused on optical data fusion; high-level fusion includes feature level and decision level fusion of multi-source data, such as synthetic aperture radar, optical images, LiDAR and other types of data. Finally, this article summarises several trends tending to broaden the application of multi-source data fusion.
The Study of Methods of Quantitative Evaluation on Remote Sensing Image Fusion and Actualization

LI Xin-liang,ZHAO Shu-he,KE Chang-qing,GUAN Kai-yu

DOI: https://doi.org/10.3969/j.issn.1004-0323.2007.03.027

2007-01-01

Abstract:With the rapid development of technique on remote sensing image fusion,the methods of fusion have been ameliorated from pixel level to decision level recently.But how to quantificationally evaluate the resultant image impersonality and comprehensively is also a question.This paper brings forward brightness information,spa-texture information and spectrum distortion information by analysing and summarizing current methods of quantitative evaluation on remote sensing image fusion.Those parameters have been actualized via a program.At last,the multi-spectral bands and panchromatic band image of QuickBird sensors are fused with IHS(Intensity-Hue-Saturation)fusion and PCA(Primary Component Analysis)fusion.By evaluation the resultant with the parameters,it shows that quantitative evaluation is more available and comprehensive than qualitative evaluation.So the quantitative evaluation is suitable to evaluate the fused image.And it can support how to choose the appropriate method of image fusion.
A New Fusion Method for Remote Sensing Images Based on Salient Region Extraction

Libao Zhang,Jue Zhang

DOI: https://doi.org/10.1109/icip.2017.8296624

2017-01-01

Abstract:The goal of the remote sensing image fusion is to inject the detail information extracted from panchromatic (PAN) images to multispectral (MS) images with minimized spectral distortion. However, different regions in the image may practically have different demands on the spatial and spectral resolution. In this paper, a new fusion method for remote sensing images based on salient region extraction is proposed. By introducing the hybrid visual saliency analysis, information in the PAN and MS image are automatically partitioned into two categories: salient and non-salient regions. Then, a sub-region fusion strategy is applied to fuse the non-salient and salient regions respectively. For non salient regions, such as farmland and mountains, the wavelet transform is used in the process of spatial infusion to suppress spectral distortion. As for salient regions like residential areas, the windowed IHS transform is carried out for its merits of effective integration of spatial and spectrum information. Experimental results demonstrate that our proposal achieves a better balance between spatial injection and spectral maintenance in different regions.
Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Tianyu Zhang,Qiang Zhou,Huajun Feng,Zhihai Xu,Qi Li,Yueting Chen

DOI: https://doi.org/10.1117/12.2032470

2013-01-01

Abstract:The fusion of infrared and visible light images can effectively improve the ability of detail description and hot taget representation. For this purpose, a novel image fusion algorithm based on nonsubsampled shearlet transform (NSST) was presented in this paper. Firstly, the NSST was adopted to decompose the two source images at different scales and directions, and the low-frequency and high-frequency sub-band coefficients of the images were obtained. Secondly, we used a modified fusion rules. For the low-frequency coefficients of the fused image, we summed up the low-frequency coefficients of two source images, and then subtracted the average of the mean values of the two low-frequency coefficients. Meanwhile, considering that adjacent pixels had strong correlation, an improved selection principle based on the local energy matching was developed for the high-frequency coefficients of the fused image, which was also consistent with the characteristics of the human vision system. Finally, the fused image was reconstructed by performing the inverse NSST on the combined coefficients. Experimental results demonstrate that the proposed algorithm can effectively integrate important information from infrared and visible light images. And comparing with some other image fusion algorithms, the proposed algorithm can further enhance the contrast of fused images and protect more detail information of source images. Both visual quality and objective evaluation criteria show that the method has a higher performance.
Images Fusing In Remote Sensing Mapping

qiming qin,daping liu,haitao liu

DOI: https://doi.org/10.1109/ICII.2001.982765

2001-01-01

Abstract:The remote sensing images fusing is a method, which integrates multiform image data sets into a new data set by geometry matching, color transformation and other ways. During mapping the LiJiang county in YunNan province with high-resolution remote sensing image, we found that it is a good way to utilize the technique of image fusing, which includes image matching, image interpolation, edge enhancement, and imagery updating, to improve the mapping quality. After iterative experiments, we explored a new way to update and fuse based on TM image, SPOT panchromatic image and the air photos.In the fused image, various RS images information can supplement each other, so the fused image not only have abundant spectrum information, but also reserve high spatial resolution. It proves that imagery fusion is an important way to improve represent ability on map of imagery.
Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art

Pedram Ghamisi,Richard Gloaguen,Peter M. Atkinson,Jón Atli Benediktsson,Behnood Rasti,Naoto Yokoya,Qunming Wang,Bernhard Höfle,Lorenzo Bruzzone,Francesca Bovolo,Mingmin Chi,Katharina Anders

DOI: https://doi.org/10.1109/mgrs.2018.2890023

IF: 14.6

2019-01-01

IEEE Geoscience and Remote Sensing Magazine

Abstract:This article brings together the advances of multisource and multitemporal data fusion approaches with respect to the various research communities and provides a thorough and discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to conduct novel investigations on this challenging topic by supplying sufficient detail and references. More specifically, this work provides a bird's-eye view of many important contributions specifically dedicated to the topics of pansharpening and resolution enhancement, point cloud data fusion, hyperspectral and lidar data fusion, multitemporal data fusion, and big data and social media. In addition, the main challenges and possible future research in each area are outlined and discussed.
A review of remote sensing image spatiotemporal fusion: Challenges, applications and recent trends

Juan Xiao,Ashwani Kumar Aggarwal,Nguyen Hong Duc,Abhinandan Arya,Uday Kiran Rage,Ram Avtar

DOI: https://doi.org/10.1016/j.rsase.2023.101005

2023-06-05

Remote Sensing Applications: Society and Environment

Abstract:In remote sensing (RS), use of single optical sensors is frequently inadequate for practical applications (e.g., agricultural, forest, ecology monitoring) due to trade-offs between spatial and temporal resolution. The advent of spatiotemporal fusion (STF) of RS images has allowed the production of images with high resolution at both spatial and temporal scales. Despite the development of more than 100 STF models in the past two decades, many of these models have not been practically applied due to the possibility of limited understanding of the models. Therefore, this study aims to provide a comprehensive review of STF categories, including their conception, development, challenges, and applications. This study focuses primarily on deep learning-based STF models, which achieved superior performance and significantly increased the number of STF models. This review can guide the selection and design of STF models, as well as proposes future directions for STF modeling. The findings of this review facilitate further STF research to improve the accuracy and application in the field of agriculture, forestry and ecological monitoring using fused RS images.
Panchromatic and multispectral image fusion for remote sensing and earth observation: Concepts, taxonomy, literature review, evaluation methodologies and challenges ahead

Kai Zhang,Feng Zhang,Wenbo Wan,Hui Yu,Jiande Sun,Javier Del Ser,Eyad Elyan,Amir Hussain

DOI: https://doi.org/10.1016/j.inffus.2022.12.026

IF: 18.6

2023-01-04

Information Fusion

Abstract:Panchromatic and multispectral image fusion, termed pan-sharpening, is to merge the spatial and spectral information of the source images into a fused one, which has a higher spatial and spectral resolution and is more reliable for downstream tasks compared with any of the source images. It has been widely applied to image interpretation and pre-processing of various applications. A large number of methods have been proposed to achieve better fusion results by considering the spatial and spectral relationships among panchromatic and multispectral images. In recent years, the fast development of artificial intelligence (AI) and deep learning (DL) has significantly enhanced the development of pan-sharpening techniques. However, this field lacks a comprehensive overview of recent advances boosted by the rise of AI and DL. This paper provides a comprehensive review of a variety of pan-sharpening methods that adopt four different paradigms, i.e., component substitution, multiresolution analysis, degradation model, and deep neural networks. As an important aspect of pan-sharpening, the evaluation of the fused image is also outlined to present various assessment methods in terms of reduced-resolution and full-resolution quality measurement. Then, we conclude this paper by discussing the existing limitations, difficulties, and challenges of pan-sharpening techniques, datasets, and quality assessment. In addition, the survey summarizes the development trends in these areas, which provide useful methodological practices for researchers and professionals. Finally, the developments in pan-sharpening are summarized in the conclusion part. The aim of the survey is to serve as a referential starting point for newcomers and a common point of agreement around the research directions to be followed in this exciting area.

Remote Sensing Image Fusion:Newest Development and Perspective

Imaging spectrometer image data fusion

Remote Sensing Image Fusion Based on Fuzzy Theory in Pixel Level and Assessing the Quality of Resulting Images

Image Fusion in Remote Sensing: An Overview and Meta Analysis

A review of remote sensing image fusion methods

The Study on Image Fusion for Medium and High Spatial Resolution Remote Sensing Images

Image Fusion Technologies In Commercial Remote Sensing Packages

Spatiotemporal Fusion in Remote Sensing

The Realistic Fusion of Multi-spectral Images

Remote sensing Image fusion based on iterative discrete Shearlet transform

Image Fusion Techniques in Remote Sensing

Analysis of Remote Sensing Image Fusion Based on Different Algorithms

The Research on Comparing and Analyzing the Remote Sensing Image Fusion and Algorithm with High Spectral and Spatial Quality

Multi-source remote sensing data fusion: status and trends

The Study of Methods of Quantitative Evaluation on Remote Sensing Image Fusion and Actualization

A New Fusion Method for Remote Sensing Images Based on Salient Region Extraction

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Images Fusing In Remote Sensing Mapping

Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art

A review of remote sensing image spatiotemporal fusion: Challenges, applications and recent trends

Panchromatic and multispectral image fusion for remote sensing and earth observation: Concepts, taxonomy, literature review, evaluation methodologies and challenges ahead