Geospatial Data Fusion: Combining Lidar, SAR, and Optical Imagery with AI for Enhanced Urban Mapping

Sajjad Afroosheh,Mohammadreza Askari
2024-12-26
Abstract:This study explores the integration of Lidar, Synthetic Aperture Radar (SAR), and optical imagery through advanced artificial intelligence techniques for enhanced urban mapping. By fusing these diverse geospatial datasets, we aim to overcome the limitations associated with single-sensor data, achieving a more comprehensive representation of urban environments. The research employs Fully Convolutional Networks (FCNs) as the primary deep learning model for urban feature extraction, enabling precise pixel-wise classification of essential urban elements, including buildings, roads, and vegetation. To optimize the performance of the FCN model, we utilize Particle Swarm Optimization (PSO) for hyperparameter tuning, significantly enhancing model accuracy. Key findings indicate that the FCN-PSO model achieved a pixel accuracy of 92.3% and a mean Intersection over Union (IoU) of 87.6%, surpassing traditional single-sensor approaches. These results underscore the potential of fused geospatial data and AI-driven methodologies in urban mapping, providing valuable insights for urban planning and management. The implications of this research pave the way for future developments in real-time mapping and adaptive urban infrastructure planning.
Computer Vision and Pattern Recognition,Artificial Intelligence,Image and Video Processing
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the limitations of existing single - sensor data in urban mapping. Specifically: 1. **Limitations of single - sensor data**: - **Lidar**: Although it can provide high - resolution 3D data, it lacks detailed depiction of surface texture and complex structures. - **SAR (Synthetic Aperture Radar)**: It can capture surface texture and height information under bad weather conditions, but may not accurately represent complex structures. - **Optical images**: They provide rich visual and spectral data, but perform poorly in cloudy or low - light conditions. 2. **The need for fusing multi - source geospatial data**: - By fusing the data of Lidar, SAR and optical images, the limitations of single - sensor data can be overcome, and a more comprehensive representation of the urban environment can be obtained. - The fused data can extract urban features, such as buildings, roads and vegetation, more accurately. 3. **The need for improving model performance**: - Use deep - learning models (especially Fully Convolutional Networks, FCNs) for automated urban feature extraction. - In order to optimize the performance of the FCN model, the Particle Swarm Optimization (PSO) technique is used for hyper - parameter tuning to improve the accuracy of the model. 4. **Specific objectives**: - **Construct a comprehensive data - fusion framework** for urban mapping, combining Lidar, SAR and optical images. - **Apply Fully Convolutional Networks (FCNs)** for feature extraction to achieve pixel - level classification. - **Introduce Particle Swarm Optimization (PSO)** technique to optimize the hyper - parameters of the deep - learning model and ensure the best performance of the model on complex datasets. Through these methods, the paper aims to improve the accuracy, efficiency and scalability of urban mapping and provide valuable tools for the development of modern smart - city infrastructures. The experimental results show that the fused - data and AI - driven methods have significant advantages in urban mapping, especially when dealing with complex urban environments.