Abstract:Terrain classification is crucial for the successful execution of autonomous navigation and path planning during Mars rover missions. This study focuses on enhancing the rover's capability to traverse the Martian surface by investigating the integration of advanced semantic segmentation models based on deep learning. The aim is to identify the most effective deep learning model from recent advancements and establish efficient training approaches.The study selected the state-of-the-art U-Net and DeepLabV3+ models for further assessment and evaluation, utilizing both the AI4Mars and ESA's LabelMars datasets. Techniques such as preprocessing, augmentation, and various loss functions were investigated to improve model performance and class imbalance issues are tackled. To mitigate overfitting, regularization techniques like weight decay and early stopping were applied, ensuring robust model training. Additionally, to further enhance the model’s performance, especially in recognizing rare classes, the study investigated the use of state-of-the-art GAN models for generating new images and expand training sets.Our findings reveal that excluding the background class from training and testing significantly improves model performance. Using early stopping regularization reduces the training time drastically while giving high model performance. Notably, the DeepLabV3+ model surpasses the performance reported in existing literature, achieving a maximum segmentation accuracy and Mean Intersection over Union (mIoU) of 99% and 87% on the AI4Mars dataset, and 87% and 72% on the LabelMars dataset, respectively. The integration of GAN-generated images into training further improved rare class performance by up to 2%. These advancements in deep learning models for terrain classification promise to significantly enhance the capabilities of Mars rovers in autonomous navigation and path planning.

Improved Mars Terrain Segmentation in Terms of Style Transfer and Network Architecture

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Low-cost Mars Terrain Classification System Based on Coarse-grained Annotation

MarsSeg: Mars Surface Semantic Segmentation with Multi-level Extractor and Connector

Evaluate and Improve the Quality of Neural Style Transfer.

Mars Terrain Segmentation with Less Labels

A hybrid attention semantic segmentation network for unstructured terrain on Mars

Mixed-domain Training Improves Multi-Mission Terrain Segmentation

SegMarsViT: Lightweight Mars Terrain Segmentation Network for Autonomous Driving in Planetary Exploration

MarsFormer: Martian Rock Semantic Segmentation With Transformer

Deep Learning based Semantic Segmentation for Mars Rover Terrain Classification

C-PLES: Contextual Progressive Layer Expansion with Self-attention for Multi-class Landslide Segmentation on Mars using Multimodal Satellite Imagery

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

MarsScapes and UDAFormer: A Panorama Dataset and a Transformer-Based Unsupervised Domain Adaptation Framework for Martian Terrain Segmentation

Automated Rock Detection From Mars Rover Image via Y-Shaped Dual-Task Network With Depth-Aware Spatial Attention Mechanism

Semi-Supervised Learning for Mars Imagery Classification and Segmentation

Terrain Classification Using Mars Raw Images Based on Deep Learning Algorithms with Application to Wheeled Planetary Rovers

Mapping "Brain Terrain" Regions on Mars using Deep Learning

MarsMapNet: A Novel Superpixel-Guided Multiview Feature Fusion Network for Efficient Martian Landform Mapping

MarsNet: Automated Rock Segmentation with Transformers for Tianwen-1 Mission

S5Mars: Semi-Supervised Learning for Mars Semantic Segmentation