Multi-Sensor Deep Learning for Glacier Mapping

Codruţ-Andrei Diaconu,Konrad Heidler,Jonathan L. Bamber,Harry Zekollari
2024-09-18
Abstract:The more than 200,000 glaciers outside the ice sheets play a crucial role in our society by influencing sea-level rise, water resource management, natural hazards, biodiversity, and tourism. However, only a fraction of these glaciers benefit from consistent and detailed in-situ observations that allow for assessing their status and changes over time. This limitation can, in part, be overcome by relying on satellite-based Earth Observation techniques. Satellite-based glacier mapping applications have historically mainly relied on manual and semi-automatic detection methods, while recently, a fast and notable transition to deep learning techniques has started. This chapter reviews how combining multi-sensor remote sensing data and deep learning allows us to better delineate (i.e. map) glaciers and detect their temporal changes. We explain how relying on deep learning multi-sensor frameworks to map glaciers benefits from the extensive availability of regional and global glacier inventories. We also analyse the rationale behind glacier mapping, the benefits of deep learning methodologies, and the inherent challenges in integrating multi-sensor earth observation data with deep learning algorithms. While our review aims to provide a broad overview of glacier mapping efforts, we highlight a few setups where deep learning multi-sensor remote sensing applications have a considerable potential added value. This includes applications for debris-covered and rock glaciers that are visually difficult to distinguish from surroundings and for calving glaciers that are in contact with the ocean. These specific cases are illustrated through a series of visual imageries, highlighting some significant advantages and challenges when detecting glacier changes, including dealing with seasonal snow cover, changing debris coverage, and distinguishing glacier fronts from the surrounding sea ice.
Computer Vision and Pattern Recognition,Image and Video Processing
What problem does this paper attempt to address?
The problem this paper attempts to address is: how to better map glaciers and detect their changes over time using multi-sensor remote sensing data and deep learning techniques. Specifically, the paper focuses on the following aspects: 1. **Importance of Glaciers**: There are approximately 275,000 glaciers globally, which play crucial roles in sea level rise, water resource management, natural disasters, biodiversity, and tourism. However, only a very small number of glaciers have long-term and detailed on-site observation data. 2. **Necessity of Satellite Remote Sensing**: Due to the limitations of on-site observations, satellite remote sensing becomes the only feasible method to obtain representative glacier data. Traditional glacier mapping mainly relies on manual and semi-automatic detection methods, while in recent years, deep learning techniques have begun to emerge in this field. 3. **Advantages of Deep Learning**: Deep learning methods can extract information, patterns, and trends from multi-modal remote sensing data that are difficult to obtain through traditional methods. Especially for debris-covered glaciers and glaciers in contact with the ocean (such as calving glaciers), deep learning methods have significant advantages. 4. **Challenges Faced**: Despite the great potential of deep learning in glacier mapping, there are still some challenges, including the uncertainty of data labeling, differences in data quality across different regions, and interference from clouds and shadows in optical data. The paper reviews existing research, analyzes the application of deep learning in glacier mapping, and focuses on the integration of multi-sensor data and its advantages and challenges in specific application scenarios.