XAI-Guided Enhancement of Vegetation Indices for Crop Mapping

Hiba Najjar,Francisco Mena,Marlon Nuske,Andreas Dengel
2024-07-11
Abstract:Vegetation indices allow to efficiently monitor vegetation growth and agricultural activities. Previous generations of satellites were capturing a limited number of spectral bands, and a few expert-designed vegetation indices were sufficient to harness their potential. New generations of multi- and hyperspectral satellites can however capture additional bands, but are not yet efficiently exploited. In this work, we propose an explainable-AI-based method to select and design suitable vegetation indices. We first train a deep neural network using multispectral satellite data, then extract feature importance to identify the most influential bands. We subsequently select suitable existing vegetation indices or modify them to incorporate the identified bands and retrain our model. We validate our approach on a crop classification task. Our results indicate that models trained on individual indices achieve comparable results to the baseline model trained on all bands, while the combination of two indices surpasses the baseline in certain cases.
Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: how to use Explainable Artificial Intelligence (XAI) techniques to select and design suitable Vegetation Indices (VIs) in order to improve the performance of crop classification tasks based on multispectral satellite data. Specifically, traditional vegetation indices fail to fully utilize their potential when dealing with new - generation multispectral and hyperspectral satellite data. These new satellites can capture more spectral bands, but how to effectively use these additional bands remains a challenge. Therefore, the author proposes an XAI - based method. By training deep neural networks and extracting feature importance, the most influential bands are identified, and then existing vegetation indices are selected or modified to better adapt to these bands. The main contributions of the paper include: 1. **Proposing an XAI - based method**: Quantify the importance of each band to model prediction through techniques such as Shapley Value Sampling (SVS). 2. **Improving the selection and design of vegetation indices**: According to the importance of bands, select or adjust existing vegetation indices, such as NDVI, NDRE, and NDMI, etc., and verify their performance in crop classification tasks. 3. **Experimental verification**: Experiments prove that using optimized vegetation indices can achieve classification effects comparable to or even better than the baseline model, especially more prominent in certain crop types. ### Key Formulas - **NDVI (Normalized Difference Vegetation Index)**: \[ \text{NDVI}=\frac{(N - R)}{(N + R)} \] where \( N \) represents the Near - Infrared band (NIR), and \( R \) represents the Red band (Red). - **n - NDVI (Narrow - band Normalized Difference Vegetation Index)**: \[ \text{n - NDVI}=\frac{(nN - R)}{(nN + R)} \] where \( nN \) represents the Narrow - band Near - Infrared band (n - NIR), and \( R \) represents the Red band (Red). - **NDRE (Normalized Difference Red Edge Index)**: \[ \text{NDRE}=\frac{(N - RE1)}{(N + RE1)} \] where \( N \) represents the Near - Infrared band (NIR), and \( RE1 \) represents the first Red Edge band (Red Edge 1). - **NDRE2 and NDRE3**: \[ \text{NDRE2}=\frac{(N - RE2)}{(N + RE2)}, \quad \text{NDRE3}=\frac{(N - RE3)}{(N + RE3)} \] where \( RE2 \) and \( RE3 \) represent the second and third Red Edge bands respectively. - **NDMI (Normalized Difference Moisture Index)**: \[ \text{NDMI}=\frac{(N - S1)}{(N + S1)} \] where \( N \) represents the Near - Infrared band (NIR), and \( S1 \) represents the Short - wave Infrared band 1 (SWIR1). - **NDMI2**: \[ \text{NDMI2}=\frac{(N - S2)}{(N + S2)} \] where \( S2 \) represents the Short - wave Infrared band 2 (SWIR2). Through these improved vegetation indices, the paper shows how to more effectively use multispectral satellite data in crop classification tasks, thereby improving the accuracy and efficiency of classification.