Abstract:Terrain classification is crucial for the successful execution of autonomous navigation and path planning during Mars rover missions. This study focuses on enhancing the rover's capability to traverse the Martian surface by investigating the integration of advanced semantic segmentation models based on deep learning. The aim is to identify the most effective deep learning model from recent advancements and establish efficient training approaches.The study selected the state-of-the-art U-Net and DeepLabV3+ models for further assessment and evaluation, utilizing both the AI4Mars and ESA's LabelMars datasets. Techniques such as preprocessing, augmentation, and various loss functions were investigated to improve model performance and class imbalance issues are tackled. To mitigate overfitting, regularization techniques like weight decay and early stopping were applied, ensuring robust model training. Additionally, to further enhance the model’s performance, especially in recognizing rare classes, the study investigated the use of state-of-the-art GAN models for generating new images and expand training sets.Our findings reveal that excluding the background class from training and testing significantly improves model performance. Using early stopping regularization reduces the training time drastically while giving high model performance. Notably, the DeepLabV3+ model surpasses the performance reported in existing literature, achieving a maximum segmentation accuracy and Mean Intersection over Union (mIoU) of 99% and 87% on the AI4Mars dataset, and 87% and 72% on the LabelMars dataset, respectively. The integration of GAN-generated images into training further improved rare class performance by up to 2%. These advancements in deep learning models for terrain classification promise to significantly enhance the capabilities of Mars rovers in autonomous navigation and path planning.

A hybrid attention semantic segmentation network for unstructured terrain on Mars

EHANet: Efficient Hybrid Attention Network Towards Real-time Semantic Segmentation

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

MarsSeg: Mars Surface Semantic Segmentation with Multi-level Extractor and Connector

Hybrid Multiple Attention Network for Semantic Segmentation in Aerial Images

S5Mars: Semi-Supervised Learning for Mars Semantic Segmentation

S$^{5}$Mars: Semi-Supervised Learning for Mars Semantic Segmentation

S^5Mars: Semi-Supervised Learning for Mars Semantic Segmentation

Low-cost Mars Terrain Classification System Based on Coarse-grained Annotation

MarsMapNet: A Novel Superpixel-Guided Multiview Feature Fusion Network for Efficient Martian Landform Mapping

Improved Mars Terrain Segmentation in Terms of Style Transfer and Network Architecture

Deep Learning based Semantic Segmentation for Mars Rover Terrain Classification

Semi-Supervised Learning for Mars Imagery Classification and Segmentation

SegMarsViT: Lightweight Mars Terrain Segmentation Network for Autonomous Driving in Planetary Exploration

MarsFormer: Martian Rock Semantic Segmentation With Transformer

C-PLES: Contextual Progressive Layer Expansion with Self-attention for Multi-class Landslide Segmentation on Mars using Multimodal Satellite Imagery

SCAttNet: Semantic Segmentation Network with Spatial and Channel Attention Mechanism for High-Resolution Remote Sensing Images

Hybridizing Cross-Level Contextual and Attentive Representations for Remote Sensing Imagery Semantic Segmentation

Hybridizing Euclidean and Hyperbolic Similarities for Attentively Refining Representations in Semantic Segmentation of Remote Sensing Images

Semantic Segmentation of Urban Airborne LiDAR Point Clouds Based on Fusion Attention Mechanism and Multi-Scale Features

SACANet: scene-aware class attention network for semantic segmentation of remote sensing images