Abstract:Terrain classification is crucial for the successful execution of autonomous navigation and path planning during Mars rover missions. This study focuses on enhancing the rover's capability to traverse the Martian surface by investigating the integration of advanced semantic segmentation models based on deep learning. The aim is to identify the most effective deep learning model from recent advancements and establish efficient training approaches.The study selected the state-of-the-art U-Net and DeepLabV3+ models for further assessment and evaluation, utilizing both the AI4Mars and ESA's LabelMars datasets. Techniques such as preprocessing, augmentation, and various loss functions were investigated to improve model performance and class imbalance issues are tackled. To mitigate overfitting, regularization techniques like weight decay and early stopping were applied, ensuring robust model training. Additionally, to further enhance the model’s performance, especially in recognizing rare classes, the study investigated the use of state-of-the-art GAN models for generating new images and expand training sets.Our findings reveal that excluding the background class from training and testing significantly improves model performance. Using early stopping regularization reduces the training time drastically while giving high model performance. Notably, the DeepLabV3+ model surpasses the performance reported in existing literature, achieving a maximum segmentation accuracy and Mean Intersection over Union (mIoU) of 99% and 87% on the AI4Mars dataset, and 87% and 72% on the LabelMars dataset, respectively. The integration of GAN-generated images into training further improved rare class performance by up to 2%. These advancements in deep learning models for terrain classification promise to significantly enhance the capabilities of Mars rovers in autonomous navigation and path planning.

Terrain Data Real-Time Analysis Based on Point Cloud for Mars Rover

Visual Traversability Analysis for Micro Planetary Rover

3D Map Building for Mobile Robot under Unknown Outdoor Environments

Low-cost Mars Terrain Classification System Based on Coarse-grained Annotation

Terrain Classification Using Mars Raw Images Based on Deep Learning Algorithms with Application to Wheeled Planetary Rovers

Rover Attitude and Camera Parameter: Rock Measurements on Mars Surface Based on Rover Attitude and Camera Parameter for Tianwen-1 Mission

High-Resolution and Spatial-Continuous 3-D Model Reconstruction of Martian Surface by Integrating Multisensor Data of Zhurong Rover

Automatic Data Processing for Space Robotics Machine Learning

Towards Safer Planetary Exploration: A Hybrid Architecture for Terrain Traversability Analysis in Mars Rovers

High-Precision Measurement of 3-D Rock Morphology on Mars Using Stereo Rover Imagery

Mars Rover Localization Based on A2G Obstacle Distribution Pattern Matching

A Mars Local Terrain Matching Method Based on 3D Point Clouds

Perception-aware Autonomous Mast Motion Planning for Planetary Exploration Rovers

Primary Analysis of Mars Geological Structure Based on High Frequency Radar Data of China's Zhurong Mars Rover

An Autonomous Navigation Method for Planetary Rover Based on Multi-modal Fusion and Multi-factor Graph Optimization

Topographic Reconstruction of the "Tianwen-1" Landing Area on the Mars Using High Resolution Imaging Camera Images

Uncertainty-Based Vibration/Gyro Composite Planetary Terrain Mapping

Real-Time Stochastic Terrain Mapping and Processing for Autonomous Safe Landing

Rapid SLAM Method for Star Surface Rover in Unstructured Space Environments

Deep Learning based Semantic Segmentation for Mars Rover Terrain Classification

Evaluation of 3D CNN Semantic Mapping for Rover Navigation