Plant detection from ultra high resolution remote sensing images: A Semantic Segmentation approach based on fuzzy loss

Shivam Pande,Baki Uzun,Florent Guiotte,Thomas Corpetti,Florian Delerue,Sébastien Lefèvre
2024-09-01
Abstract:In this study, we tackle the challenge of identifying plant species from ultra high resolution (UHR) remote sensing images. Our approach involves introducing an RGB remote sensing dataset, characterized by millimeter-level spatial resolution, meticulously curated through several field expeditions across a mountainous region in France covering various landscapes. The task of plant species identification is framed as a semantic segmentation problem for its practical and efficient implementation across vast geographical areas. However, when dealing with segmentation masks, we confront instances where distinguishing boundaries between plant species and their background is challenging. We tackle this issue by introducing a fuzzy loss within the segmentation model. Instead of utilizing one-hot encoded ground truth (GT), our model incorporates Gaussian filter refined GT, introducing stochasticity during training. First experimental results obtained on both our UHR dataset and a public dataset are presented, showing the relevance of the proposed methodology, as well as the need for future improvement.
Computer Vision and Pattern Recognition,Artificial Intelligence
What problem does this paper attempt to address?
The paper aims to address the problem of identifying plant species from Ultra High Resolution (UHR) remote sensing images. Specifically, the main challenges faced by the research team include: 1. **Dataset Characteristics**: They constructed an RGB remote sensing dataset with millimeter-level spatial resolution, collecting data of various landscapes in a mountainous area in France through multiple field surveys. 2. **Semantic Segmentation Framework**: The plant species identification task is treated as a semantic segmentation problem to achieve efficient and practical implementation over large geographic areas. 3. **Boundary Recognition Challenge**: When processing segmentation masks, distinguishing the boundaries between plant species and the background becomes difficult, especially in cases of natural overlap. 4. **Fuzzy Loss Function**: To address the above issues, a fuzzy loss function was introduced. By incorporating a Gaussian filter-optimized Ground Truth (GT) during training, the randomness of the labels was increased. The core contribution of the research lies in proposing a novel method to handle the plant identification problem in UHR remote sensing images and validating the effectiveness of this method through experiments, as well as its potential for further improvement.