Abstract:Expeditions on Mars and interest in research orienting around these exploration missions have been accelerating more than ever, recently. Due to lack of active human interference in Mars missions, processing and accurate classification of images taken by the rovers is a very essential part of the system. Proper identification of landforms governs the accessibility of the mobile rovers on Mars' surface. Moreover, NASA has already collected over two million images from the planet, and more volumes are yet to arrive as these photographs serve as major documents for photogrammetry and studies based on remote sensing. Automatic labeling of incoming images and also making searching of the image database easier in the public interest requires highly accurate image classifiers. Deriving motivation from the above causes, this study intends to implement an efficient supervised multi-class image classifier for identifying Mars imagery. However, this objective is confronted by a major bottleneck. Most datasets that are accurately labeled, portray a highly skewed nature and insufficient data to train a deep model from scratch. The MSL surface imagery labeled dataset captured by the Curiosity rover, that has been considered for this study, is one such dataset with only 6691 images distributed unevenly into 25 classes. These obstacles are less signified in the existing literature and hence this paper addresses these challenges, outperforming the state-of-the-art metrics. Due to the absence of large data volume, a transfer learning based methodology was considered, using very deep convolutional networks pre-trained on ImageNet dataset. But images from Mars often involve a difference in hue, contrast and clarity when compared with images taken on Earth. Hence, the deep model was fine-tuned with our dataset and the extracted feature from the tuned neural network was used for the final classification. It was found that the results obtained from a single pre-trained model were not optimum and that ensemble approaches could unify many such results into a better result. Similar feature vectors were extracted from a few other pre-trained models. The whole setup converges into a dynamic routing module, a novel polling algorithm, which for each image, comes to an agreement about the best set of features while generating the output probability vector. The proposed approach is evaluated by several numeric metrics like accuracy, precision and recall, confusion matrices and roc curves, against the chosen individual pre-trained models and most prominent ensemble methods. Mars-TRP produces a test accuracy of around 88% in the standard test set of MSL surface dataset and an accuracy of 96% in the HiRise dataset, outperforming the individual pre-trained models, all the ensemble baselines and other existing approaches.

Deep Mars: CNN Classification of Mars Imagery for the PDS Imaging Atlas

Mars Image Content Classification: Three Years of NASA Deployment and Recent Advances

Interactive Mars Image Content-Based Search with Interpretable Machine Learning

Mars Imagery Classification: A Galactic Battle between Knowledge Transfer Networks and their Dual-Attention Armed Adversaries

Mars-TRP: Classification of Mars imagery using dynamic polling between transferred features

Mapping "Brain Terrain" Regions on Mars using Deep Learning

Low-cost Mars Terrain Classification System Based on Coarse-grained Annotation

Planetary Mapping Using Deep Learning: A Method to Evaluate Feature Identification Confidence Applied to Habitats in Mars-Analog Terrain

Deep Learning based Semantic Segmentation for Mars Rover Terrain Classification

CONVOLUTIONAL NEURAL NETWORK IMAGE CLASSIFICATION OF MARS-ANALOG TERRAIN: PRELIMINARY RESULTS AND IMPLICATIONS FOR THE SEARCH FOR LIFE ON MARS.

Automated detection of geological landforms on Mars using Convolutional Neural Networks

SPASS: Scientific Prominence Active Search System with Deep Image Captioning Network

Multi-mission Terrain Classifier for Safe Rover Navigation and Automated Science

AI4MARS: A Dataset for Terrain-Aware Autonomous Driving on Mars

MRSCAtt: A Spatio-Channel Attention-Guided Network for Mars Rover Image Classification

Autonomous Martian rock image classification based on transfer deep learning methods

Automated Rock Detection From Mars Rover Image via Y-Shaped Dual-Task Network With Depth-Aware Spatial Attention Mechanism

Effective Feature Selection for Mars McMurdo Terrain Image Classification

MarsMapNet: A Novel Superpixel-Guided Multiview Feature Fusion Network for Efficient Martian Landform Mapping

Planet Four: A Neural Network's Search For Polar Spring-time Fans On Mars

MarsNet: Automated Rock Segmentation with Transformers for Tianwen-1 Mission