Data Fusion Techniques for Multisources Remotely Sensed Imagery

孙家柄,贾永红,李德仁

DOI: https://doi.org/10.3969/j.issn.1004-0323.2000.01.010

2012-01-01

Abstract:Techniques for data fusion in multisources remotely sensed imagery are reviewed.Representation of information,framework,algorithms,control and applications of fusion are included.Problems,possibilities and prospects of data fusion are discussed in conclusion.

What problem does this paper attempt to address?

The Theory and Techniques for Data Fusion of Multi-Sources Remotely Sensed Imagery

韩玲,吴汉宁

DOI: https://doi.org/10.3321/j.issn:1000-274x.2004.04.021

2004-01-01

JOURNAL OF NORTHWEST UNIVERSITY(NATURAL SCIENCE EDITION)

Abstract:Aim Exploring the techniques of the efficient integration of remote sensing images with multiple spatial, temporal and spectrum resolution.The techniques for data fusion in multi-sources remotely sensed imagery are reviewed including the concept of fusion,the algorithms of fusion and the evaluate of fusion effects.Methods Analyzing the remotely sensed imagery for multiple spatial, temporal and spectrum resolution giving three method for data fusion is pixel-based, featuee-based and decision-based.Using the information theory to build a system for appraiseing the quality of fusion imagery.Results The multi-source image data fusion can be classified into three levels:pixel-based, featuee-based and decision-based.Using pixel-based method,the information loss is the lowest, using decision-based method the information loss is the highest.The accuracy of the pixel-based is the higest,and of decision-based method is the lowest.Conclusion Comparing multi-source image data fusion as single image data fusion can get more accuracy more safety more reliable image, it can raise the resolution and definition,effectively rasie the utilization of the remotely sensed imagery.
Imaging spectrometer image data fusion

jiping ma,zequn guan,jilin liu

DOI: https://doi.org/10.1117/12.323601

1998-01-01

Abstract:Imaging spectrometer is one important aspect of contemporary remote sensing developments. It is characterized by huge amount of supermultipal spectral image data provision. For less remote sensing image data provision, we used to put all the data directly into the process of image object recognition without making any data fusion. Even occasional data fusion is experiential. This situation is not suitable for imaging spectrometer. The supermultipal bands of imaging spectrometer provide us with much more freedom on available choices of suitable images for procession and information extraction; at the same time, fusion between different related image data aimed at themes extracting can reduce the amount of data on one hand, and make most use of imaging spectrometer image data on the other. And to some extent, image data fusion is of utmost importance and practical significance for theme information extracting from imaging spectrometer images. This paper discusses fusion methods for conventional remote sensing data. Based on analysis of imaging spectrometer, it proposes method for imaging spectrometer image data.© (1998) COPYRIGHT SPIE--The International Society for Optical Engineering. Downloading of the abstract is permitted for personal use only.
Research on the Technology of Multi-source Remote Sensing Image Data Fusion

姜芸,臧淑英,王军

DOI: https://doi.org/10.3969/j.issn.1672-5867.2009.02.013

2009-01-01

Abstract:It summarized the multiple source remote sensing image fusion concept as well as the fusion process,three kind of fusion levels,and the advantages and demerits.Then it described the commonly used fusion method and the step.It also discussed the subjective and objective standard for remote sensing image assessment.Finally,it summarized the key technologies in further research for multiple source remote sensing image fusion,provided the reference for similar research and applications.
Multi-Sensor Image Fusion: A Survey of the State of the Art

Bing Li,Yong Xian,Daqiao Zhang,Juan Su,Xiaoxiang Hu,Weilin Guo

DOI: https://doi.org/10.4236/jcc.2021.96005

2021-01-01

Journal of Computer and Communications

Abstract:Image fusion has been developing into an important area of research. In remote sensing, the use of the same image sensor in different working modes, or different image sensors, can provide reinforcing or complementary information. Therefore, it is highly valuable to fuse outputs from multiple sensors (or the same sensor in different working modes) to improve the overall performance of the remote images, which are very useful for human visual perception and image processing task. Accordingly, in this paper, we first provide a comprehensive survey of the state of the art of multi-sensor image fusion methods in terms of three aspects: pixel-level fusion, feature-level fusion and decision-level fusion. An overview of existing fusion strategies is then introduced, after which the existing fusion quality measures are summarized. Finally, this review analyzes the development trends in fusion algorithms that may attract researchers to further explore the research in this field.
Advances of Multisource Remote Sensing Image Fusion Techniques in China

杨丽萍,陈发虎,颉耀文

DOI: https://doi.org/10.3969/j.issn.1004-0323.2007.01.023

2007-01-01

Abstract:With the availability of multisensor,multitemporal,multiresolution and multifrequency image data from operational Earth observation satellites,the fusion of digital image data has become a valuable tool in remote sensing image processing.For the full exploitation of increasingly sophisticated multisource data,a lot of image fusion algorithms have been developed.In order to comprehensively understand the development of image fusion technologies in China,this paper reviews the traditional fusion algorithms and some improved fusion algorithms based on traditional HIS,Brovey,PCA and Wavelet fusion in detail.In addition,some new fusion algorithms are also introduced.Problems and prospects of image fusion are addressed simply for the attention of future researches in related fields.As multisource image fusion is a widely applied technique for various research fields,a comprehensive understanding of the image fusion algorithms would be beneficial for the choice of data and image quality control for different purposes of researches.
Data-driven multi-source remote sensing data fusion:progress and challenges

ZHANG Liangpei,HE Jiang,YANG Qianqian,XIAO Yi,YUAN Qiangqiang

DOI: https://doi.org/10.11947/j.AGCS.2022.20220171

2022-01-01

Abstract:Multi-source remote sensing data fusion is an important technology to generate seamless observation data of large scene with a high temporal-spatial-spectral resolution, which breaks through the limitation of single sensor observation and realize the complementary utilization of multi-platform and multi-mode observation data. With the improvement of artificial intelligence theory and technology, data-driven multi-source remote sensing data fusion has been widely favored by researchers. However, the inherent low physical interpretability and weak generalization ability of data-driven algorithms have impeded its further development in multi-source remote sensing data fusion. Therefore, this paper systematically summarizes the researches of homogeneous remote sensing data fusion, heterogeneous remote sensing data fusion and point-surface fusion through three sections, and analyzes the trend of each fusion problem. Finally, this paper discusses the challenges faced by data-driven fusion algorithm, and points out some feasible future directions of multi-source remote sensing data fusion, which provides some suggestions for researchers in this field.
Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art

Pedram Ghamisi,Richard Gloaguen,Peter M. Atkinson,Jón Atli Benediktsson,Behnood Rasti,Naoto Yokoya,Qunming Wang,Bernhard Höfle,Lorenzo Bruzzone,Francesca Bovolo,Mingmin Chi,Katharina Anders

DOI: https://doi.org/10.1109/mgrs.2018.2890023

IF: 14.6

2019-01-01

IEEE Geoscience and Remote Sensing Magazine

Abstract:This article brings together the advances of multisource and multitemporal data fusion approaches with respect to the various research communities and provides a thorough and discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to conduct novel investigations on this challenging topic by supplying sufficient detail and references. More specifically, this work provides a bird's-eye view of many important contributions specifically dedicated to the topics of pansharpening and resolution enhancement, point cloud data fusion, hyperspectral and lidar data fusion, multitemporal data fusion, and big data and social media. In addition, the main challenges and possible future research in each area are outlined and discussed.
Multisource and Multitemporal Data Fusion in Remote Sensing.

Pedram Ghamisi,Behnood Rasti,Naoto Yokoya,Qunming Wang,Bernhard Hofle,Lorenzo Bruzzone,Francesca Bovolo,Mingmin Chi,Katharina Anders,Richard Gloaguen,Peter M. Atkinson,Jon Atli Benediktsson

DOI: https://doi.org/10.48550/arxiv.1812.08287

2018-01-01

Abstract:The sharp and recent increase in the availability of data captured by different sensors combined with their considerably heterogeneous natures poses a serious challenge for the effective and efficient processing of remotely sensed data. Such an increase in remote sensing and ancillary datasets, however, opens up the possibility of utilizing multimodal datasets in a joint manner to further improve the performance of the processing approaches with respect to the application at hand. Multisource data fusion has, therefore, received enormous attention from researchers worldwide for a wide variety of applications. Moreover, thanks to the revisit capability of several spaceborne sensors, the integration of the temporal information with the spatial and/or spectral/backscattering information of the remotely sensed data is possible and helps to move from a representation of 2D/3D data to 4D data structures, where the time variable adds new information as well as challenges for the information extraction algorithms. There are a huge number of research works dedicated to multisource and multitemporal data fusion, but the methods for the fusion of different modalities have expanded in different paths according to each research community. This paper brings together the advances of multisource and multitemporal data fusion approaches with respect to different research communities and provides a thorough and discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to conduct novel investigations on this challenging topic by supplying sufficient detail and references.
Data Fusion Method for Multi-sources Remotely Sensed Imagery Based on IHS Transformation and Wavelet Analysis

Wang Guang-jun,Xiao Qiu-ping,Fu Mei-chen,Wang Zeng

DOI: https://doi.org/10.1109/ESIAT.2009.8

2009-01-01

Abstract:Data fusion for multi-sources remotely sensed images is becoming a key-question in RS application. In this paper, two images differing in spatial resolution and spectral resolution are used in data fusion. The additive fusion technique based on IHS and wavelet transform is discussed, and an improved additive fusion technique is put forward. Firstly, the high frequency from high spatial resolution image after wavelet transform is added to the high frequency of the intensity from multi-spectral image after IHS transform and wavelet transform, which will get a integration of high frequency for a new intensity I', while maintaining the low frequency of Intensity from the multi-spectral image as the low frequency for I'; secondly I' is acquired by making the inverse wavelet transform; finally the fusion result is gained by making the inverse I'HS transform. The fusion test proves that the improved additive fusion technique is much more accurate in maintaining the characteristics of the multi-spectral image as well as improving the spatial resolution.
Multisource remote sensing information fusion based on wavelet transformation algorithm

Jianli Ding,Qijiang Zhu,Ying Zhang,Tashpolat Tiyip,Chuansheng Liu,Rui Sun,Xiaoling Pan

DOI: https://doi.org/10.1117/12.466699

2003-01-01

Abstract:This paper presents the results of an intercomparison study of data fusion methods. Three data fusion techniques, based respectively on the Daubechies wavelet basis method, the IHS transform, and the Principle Component Analysis (PCA), are compared with each other. According to the data set we used in this study, the Daubechies Wavelet Basis method is far more efficient than the PCA and the IHS transform, It thus establishes the advantages for data fusion, formally called multiple resolution analysis. This method is the best among the three for image sharpening and for maintaining the information of the original data. We conclude with the result from this study that the Daubechies Wavelet Basis method has the largest application potential for merging the spatial and spectral characteristics of multiple resolution remote sensing data with high efficiency.
Multi-source remote sensing data fusion: status and trends

Jixian Zhang

DOI: https://doi.org/10.1080/19479830903561035

2010-03-01

International Journal of Image and Data Fusion

Abstract:With the fast development of remote sensor technologies, e.g. the appearance of Very High Resolution (VHR) optical sensors, SAR, LiDAR, etc., mounted on either airborne or spaceborne platforms, multi-source remote sensing data fusion techniques are emerging due to the demand for new methods and algorithms. The general fusion techniques have been well developed and applied in various fields ranging from satellite earth observation to computer vision, medical image processing, defence security and so on. Despite the fast development, the techniques remain challenging for multi-source data fusion within varying spatial and temporal resolutions. This article reviews current techniques of multi-source remote sensing data fusion and discusses their future trends and challenges through the concept of hierarchical classification, i.e., pixel/data level, feature level and decision level. This article concentrates on discussing optical panchromatic and multi-spectral data fusing methods. So far, the pixel level fusion methods have mainly focused on optical data fusion; high-level fusion includes feature level and decision level fusion of multi-source data, such as synthetic aperture radar, optical images, LiDAR and other types of data. Finally, this article summarises several trends tending to broaden the application of multi-source data fusion.
Multi-Source Remote Sensing Data Fusion Based on Wavelet Transformation Algorithm

Jianli Ding,QiJiang Zhu,Ying Zhang,Tashpolat Polat Tiyip,Chuansheng Liu,Rui Sun,Xiaoling Pan

DOI: https://doi.org/10.1117/12.466699

2003-01-01

Abstract:This paper presents the results of an intercomparison study of data fusion methods. Three data fusion techniques, based respectively on the Daubechies wavelet basis method, the IHS transform, and the Principle Component Analysis (PCA), are compared with each other. According to the data set we used in this study, the Daubechies Wavelet Basis method is far more efficient than the PCA and the IHS transform, It thus establishes the advantages for data fusion, formally called multiple resolution analysis. This method is the best among the three for image sharpening and for maintaining the information of the original data. We conclude with the result from this study that the Daubechies Wavelet Basis method has the largest application potential for merging the spatial and spectral characteristics of multiple resolution remote sensing data with high efficiency.
Image Fusion Techniques in Remote Sensing

Reham Gharbia,Ahmad Taher Azar,Ali El Baz,Aboul Ella Hassanien

DOI: https://doi.org/10.48550/arXiv.1403.5473

2014-03-11

Abstract:Remote sensing image fusion is an effective way to use a large volume of data from multisensor images. Most earth satellites such as SPOT, Landsat 7, IKONOS and QuickBird provide both panchromatic (Pan) images at a higher spatial resolution and multispectral (MS) images at a lower spatial resolution and many remote sensing applications require both high spatial and high spectral resolutions, especially for GIS based applications. An effective image fusion technique can produce such remotely sensed images. Image fusion is the combination of two or more different images to form a new image by using a certain algorithm to obtain more and better information about an object or a study area than. The image fusion is performed at three different processing levels which are pixel level, feature level and decision level according to the stage at which the fusion takes place. There are many image fusion methods that can be used to produce high resolution multispectral images from a high resolution pan image and low resolution multispectral images. This paper explores the major remote sensing data fusion techniques at pixel level and reviews the concept, principals, limitations and advantages for each technique. This paper focused on traditional techniques like intensity hue-saturation- (HIS), Brovey, principal component analysis (PCA) and Wavelet.

Computer Vision and Pattern Recognition
An Application of Multi-source Remote Sensing Data Fusion in Geological Interpretation

韩玲,吴汉宁

DOI: https://doi.org/10.3969/j.issn.1000-3177.2004.02.010

2004-01-01

Abstract:Multi source remote sensing data fusion is a technology to combine multi source remote sensing images by means of advanced image processing technology, in order to intergrate various information either from various wavebands of one sensor or from multi sensors,to raise the efficiency of the information gathering its accuracy and reliability of interpretation. The comprehensive description of features can be got. Multi source remote sensing data fusion is an inevitable development trend for application of remote sensing technology. The technology of multi source remote sensing data fusion in geological interpretation will have broader application.
Multisensor Satellite Image Fusion and Networking for All-Weather Environmental Monitoring

Ni-Bin Chang,Kaixu Bai,Sanaz Imen,Chi-Farn Chen,Wei Gao

DOI: https://doi.org/10.1109/jsyst.2016.2565900

IF: 4.802

2018-01-01

IEEE Systems Journal

Abstract:Given the advancements of remote sensing technology, large volumes of remotely sensed images with different spatial, temporal, and spectral resolutions are available. To better monitor and understand the changing Earth's environment, fusion of remotely sensed images with different spatial, temporal, and spectral resolutions is critical for distinctive feature retrieval, interpretation, mapping, and decision analysis. A suite of methods have been developed to fuse multisensor satellite images for different purposes in the past few decades. This paper provides a thorough review of contemporary and classic image fusion methods and presents a summary of their phenomenological applications, with challenges and perspectives, for environmental systems analysis. Cross-mission satellite image fusion, networking, and missing value pixel reconstruction for environmental monitoring are described, and their complex integration is illustrated with a case study of Lake Nicaragua that elucidates the state-of-the-art remote sensing technologies for advancing water quality management.
Data Fusion of Satellite Remotely Sensed Images and Its Application in Agriculture

Zhuang Xiao-yun,Shi Run-he,Liu Chao-shun

DOI: https://doi.org/10.1117/12.888029

2011-01-01

Abstract:As the development of satellite remote sensing technology, it is possible to obtain various remotely sensed images from sensors with different spatial and spectral characters. Data fusion is a widely used technique to make full use of the different kinds of information so as to reach a more accurate and stable result. This paper investigates the extraction of Normalized Difference Vegetation Index (NDVI), an important parameter indicating the growth of crops in agriculture, from a SPOT panchromatic image and a TM multispectral image using 5 classical data fusion methods, they are Principal Component Spectral Sharpening (PCSS), Brovey Fusion, Gram-Schmidt Spectral Sharpening (GS), CN Spectral Sharping (CN) and wavelet fusion. Results show that the fused image by any of the methods contains more information content for NDVI extraction than before. Comparatively, GS has better effects in remaining both spectral information and brightness than other four methods.
Spatiotemporal Fusion in Remote Sensing

Hessah Albanwan,Rongjun Qin

DOI: https://doi.org/10.48550/arXiv.2107.02701

2021-07-07

Abstract:Remote sensing images and techniques are powerful tools to investigate earth surface. Data quality is the key to enhance remote sensing applications and obtaining a clear and noise-free set of data is very difficult in most situations due to the varying acquisition (e.g., atmosphere and season), sensor, and platform (e.g., satellite angles and sensor characteristics) conditions. With the increasing development of satellites, nowadays Terabytes of remote sensing images can be acquired every day. Therefore, information and data fusion can be particularly important in the remote sensing community. The fusion integrates data from various sources acquired asynchronously for information extraction, analysis, and quality improvement. In this chapter, we aim to discuss the theory of spatiotemporal fusion by investigating previous works, in addition to describing the basic concepts and some of its applications by summarizing our prior and ongoing works.

Computer Vision and Pattern Recognition
Spatiotemporal Fusion of Multisource Remote Sensing Data: Literature Survey, Taxonomy, Principles, Applications, and Future Directions

Xiaolin Zhu,Fangyi Cai,Jiaqi Tian,Trecia Kay-Ann Williams,Trecia Williams

DOI: https://doi.org/10.3390/rs10040527

IF: 5

2018-03-29

Remote Sensing

Abstract:Satellite time series with high spatial resolution is critical for monitoring land surface dynamics in heterogeneous landscapes. Although remote sensing technologies have experienced rapid development in recent years, data acquired from a single satellite sensor are often unable to satisfy our demand. As a result, integrated use of data from different sensors has become increasingly popular in the past decade. Many spatiotemporal data fusion methods have been developed to produce synthesized images with both high spatial and temporal resolutions from two types of satellite images, frequent coarse-resolution images, and sparse fine-resolution images. These methods were designed based on different principles and strategies, and therefore show different strengths and limitations. This diversity brings difficulties for users to choose an appropriate method for their specific applications and data sets. To this end, this review paper investigates literature on current spatiotemporal data fusion methods, categorizes existing methods, discusses the principal laws underlying these methods, summarizes their potential applications, and proposes possible directions for future studies in this field.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Study of optic remote sensing image fusion methods

Jin Yuanyuan,Xiang Jie

DOI: https://doi.org/10.3969/j.issn.1002-7300.2011.06.022

2011-01-01

Abstract:With new sensor appearing,the capability of acquiring remote sensing image is always processing,kinds and amounts of image are also rapidly increasing.Remote sensing image fusion provided a new route for manage,analysis and application of multi-source data.For comparing effects of the different types methords,this passage firstly introduced HIS,Brovey,Wavelet three kinds fusion methods and four fusion evaluation guideline,and then did fusion experiment with Landsat 7 ETM+data,and then analysed the results,at last compared total capability with three fusion methods.
Data Fusion Technology of Multi-Resource Satellite-Borne Remote Sensing and Its Applications for Coastal Zone Environment Monitoring and Information Evaluation

Han Zhen,Jin Yaqiu

DOI: https://doi.org/10.1117/12.681843

2006-01-01

Abstract:To synthesize the observations of microwave and optical remote sensing, the data fusion technology is developed to study the Yangtze River estuary. Information extractions, such as classification of typical objects in the coastal zone, the tidal flat waterside lines and the suspended sediment information, using Chinese Moderate Resolution Imaging Spectroradiometer, are studied.

Data Fusion Techniques for Multisources Remotely Sensed Imagery

The Theory and Techniques for Data Fusion of Multi-Sources Remotely Sensed Imagery

Imaging spectrometer image data fusion

Research on the Technology of Multi-source Remote Sensing Image Data Fusion

Multi-Sensor Image Fusion: A Survey of the State of the Art

Advances of Multisource Remote Sensing Image Fusion Techniques in China

Data-driven multi-source remote sensing data fusion:progress and challenges

Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art

Multisource and Multitemporal Data Fusion in Remote Sensing.

Data Fusion Method for Multi-sources Remotely Sensed Imagery Based on IHS Transformation and Wavelet Analysis

Multisource remote sensing information fusion based on wavelet transformation algorithm

Multi-source remote sensing data fusion: status and trends

Multi-Source Remote Sensing Data Fusion Based on Wavelet Transformation Algorithm

Image Fusion Techniques in Remote Sensing

An Application of Multi-source Remote Sensing Data Fusion in Geological Interpretation

Multisensor Satellite Image Fusion and Networking for All-Weather Environmental Monitoring

Data Fusion of Satellite Remotely Sensed Images and Its Application in Agriculture

Spatiotemporal Fusion in Remote Sensing

Spatiotemporal Fusion of Multisource Remote Sensing Data: Literature Survey, Taxonomy, Principles, Applications, and Future Directions

Study of optic remote sensing image fusion methods

Data Fusion Technology of Multi-Resource Satellite-Borne Remote Sensing and Its Applications for Coastal Zone Environment Monitoring and Information Evaluation