Spatial Resolution Enhancement of Vegetation Indexes via Fusion of Hyperspectral and Multispectral Satellite Data

Luciano Alparone,Alberto Arienzo,Andrea Garzelli
DOI: https://doi.org/10.3390/rs16050875
IF: 5
2024-03-02
Remote Sensing
Abstract:The definition and calculation of a spectral index suitable for characterizing vegetated landscapes depend on the number and widths of the bands of the imaging instrument. Here, we point out the advantages of performing the fusion of hyperspectral (HS) satellite data with the multispectral (MS) bands of Sentinel-2 to calculate such vegetation indexes as the normalized area over reflectance curve (NAOC) and the red-edge inflection point (REIP), which benefit from the availability of quasi-continuous pixel spectra. Unfortunately, MS data may be acquired from satellite platforms with very high spatial resolution; HS data may not. Despite their excellent spectral resolution, satellite imaging spectrometers currently resolve areas not greater than 30 × 30 m2, where different thematic classes of landscape may be mixed together to form a unique pixel spectrum. A way to resolve mixed pixels is to perform the fusion of the HS dataset with the same dataset produced by an MS scanner that images the same scene with a finer spatial resolution. The HS dataset is sharpened from 30 m to 10 m by means of the Sentinel-2 bands that have all been previously brought to 10 m. To do so, the hyper-sharpening protocol, that is, m:n fusion, is exploited in two nested steps: the first one to bring the 20 m bands of Sentinel-2 all to 10 m, the second one to sharpen all the 30 m HS bands to 10 m by using the Sentinel-2 bands previously hyper-sharpened to 10 m. Results are presented on an agricultural test site in The Netherlands imaged by Sentinel-2 and by the satellite imaging spectrometer recently launched as a part of the environmental mapping and analysis program (EnMAP). Firstly, the excellent match of statistical consistency of the fused HS data to the original MS and HS data is evaluated by means of analysis tools, existing and developed ad hoc for this specific case. Then, the spatial and radiometric accuracy of REIP and NAOC calculated from fused HS data are analyzed on the classes of pure and mixed pixels. On pure pixels, the values of REIP and NAOC calculated from fused data are consistent with those calculated from the original HS data. Conversely, mixed pixels are spectrally unmixed by the fusion process to resolve the 10 m scale of the MS data. How the proposed method can be used to check the temporal evolution of vegetation indexes when a unique HS image and many MS images are available is the object of a final discussion.
environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to enhance the spatial resolution of vegetation indices by fusing hyperspectral (HS) satellite data with multispectral (MS) satellite data. Specifically, the paper focuses on how to use multispectral data with higher spatial resolution (such as the 10 -meter -resolution data provided by Sentinel - 2) to improve the spatial resolution of hyperspectral data, so as to calculate some vegetation indices more accurately, such as the area under the normalized reflectance curve (NAOC) and the red - edge inflection point (REIP). Although multispectral data can provide very high spatial resolution, its spectral resolution is limited; while hyperspectral data has high spectral resolution but low spatial resolution. Therefore, by fusing these two types of data, the spatial resolution can be improved while maintaining high spectral resolution, so as to better analyze vegetation characteristics. ### Main problems 1. **Low spatial resolution of hyperspectral data**: Hyperspectral data usually has a spatial resolution of 30 meters, which may not be fine enough in many applications, especially when detailed analysis of vegetation structure and health status is required. 2. **Insufficient spectral resolution of multispectral data**: Although multispectral data (such as Sentinel - 2) can provide a 10 -meter -resolution, its spectral resolution is not sufficient to accurately calculate some complex vegetation indices, such as NAOC and REIP. 3. **Mixed - pixel problem**: Due to the low spatial resolution of hyperspectral data, a single pixel may contain information of multiple ground object types, resulting in spectral mixing and affecting the accuracy of vegetation indices. ### Solutions The paper proposes a two - stage hyper - sharpening method to enhance the spatial resolution of hyperspectral data through the following steps: 1. **First stage**: Use the 10 -meter -resolution visible - near - infrared (VNIR) band of Sentinel - 2 to hyper - sharpen the 20 -meter -resolution red - edge (RE), narrow - band near - infrared (NIR) and short - wave infrared (SWIR) bands to 10 -meter -resolution. 2. **Second stage**: Use the 10 -meter -resolution multispectral data hyper - sharpened in the first stage to hyper - sharpen the 30 -meter -resolution hyperspectral data, and finally increase the spatial resolution of the hyperspectral data to 10 meters. ### Key technologies - **Multivariate linear regression**: Used to synthesize enhanced bands, and calculate the optimal weights by the minimum mean - square - error (MMSE) method. - **Contrast - enhanced fusion algorithm**: Used to fuse low - resolution bands with enhanced bands to generate high - resolution bands. - **Statistical quality assessment**: Evaluate the quality of the fused data through indicators such as the normalized root - mean - square - error (NRMSE) and the spatial consistency factor (1−D∗s). ### Application prospects - **Vegetation monitoring**: The enhanced spatial resolution enables more accurate monitoring of the growth state, health status and change trend of vegetation. - **Environmental management**: Helps to manage and protect natural resources more finely, especially in fields such as agriculture, forestry and ecological environment protection. - **Spatio - temporal fusion**: When only one hyperspectral image and multiple multispectral images are available, continuous monitoring in time can be achieved through fusion technology. Through this method, researchers can better utilize the advantages of hyperspectral and multispectral data and improve the accuracy and reliability of vegetation indices.