Abstract:Rapid, efficient and reproducible drillcore logging is fundamental in mineral exploration. Drillcore mapping has evolved rapidly in the recent decade, especially with the advances in hyperspectral spectral imaging. A wide range of imaging sensors is now available, providing rapidly increasing spectral as well as spatial resolution and coverage. However, the fusion of data acquired with multiple sensors is challenging and usually not conducted operationally. We propose an innovative solution based on the recent developments made in machine learning to integrate such multi-sensor datasets. Image feature extraction using orthogonal total variation component analysis enables a strong reduction in dimensionality and memory size of each input dataset, while maintaining the majority of its spatial and spectral information. This is in particular advantageous for sensors with very high spatial and/or spectral resolution, which are otherwise difficult to jointly process due to their large data memory requirements during classification. The extracted features are not only bound to absorption features but recognize specific and relevant spatial or spectral patterns. We exemplify the workflow with data acquired with five commercially available hyperspectral sensors and a pair of RGB cameras. The robust and efficient spectral-spatial procedure is evaluated on a representative set of geological samples. We validate the process with independent and detailed mineralogical and spectral data. The suggested workflow provides a versatile solution for the integration of multi-source hyperspectral data in a diversity of geological applications. In this study, we show a straight-forward integration of visible/near-infrared (VNIR), short-wave infrared (SWIR) and long-wave infrared (LWIR) data for sensors with highly different spatial and spectral resolution that greatly improves drillcore mapping.

Nested Fusion: A Method for Learning High Resolution Latent Structure of Multi-Scale Measurement Data on Mars

Planetary Mapping Using Deep Learning: A Method to Evaluate Feature Identification Confidence Applied to Habitats in Mars-Analog Terrain

PIXLISE-C: Exploring The Data Analysis Needs of NASA Scientists for Mineral Identification

Multi-instrument Image Correlation for In Situ Planetary Science on Mars 2020

Mapping "Brain Terrain" Regions on Mars using Deep Learning

MaRF: Representing Mars as Neural Radiance Fields

Data Fusion With Latent Map Gaussian Processes

MarsFormer: Martian Rock Semantic Segmentation With Transformer

Federated Multi-Agent Mapping for Planetary Exploration

Multi-Sensor Spectral Imaging of Geological Samples: A Data Fusion Approach Using Spatio-Spectral Feature Extraction

Spatial Spectroscopic Models for Remote Exploration

Common Data Fusion Framework: An open-source Common Data Fusion Framework for space robotics

A Novel Utilization of Image Registration Techniques to Process Mastcam Images in Mars Rover With Applications to Image Fusion, Pixel Clustering, and Anomaly Detection

Massive Stereo-Based DTM Production for Mars on Cloud Computers

The power of paired proximity science observations: Co-located data from SHERLOC and PIXL on Mars

Unsupervised Data Fusion With Deeper Perspective: A Novel Multisensor Deep Clustering Algorithm

Modelling and Simulation of Microstructural Evolution for Extra-terrestrial Planetary Chemistry Mapping Using Artificial Intelligence – a NASA Mars Rover Study

SparseFusion: Efficient Sparse Multi-Modal Fusion Framework for Long-Range 3D Perception

Adaptive sampling with PIXL on the Mars Perseverance rover

Advanced harmonization and sensor fusion to transform data readiness and resolution for big data analytics

A Kernel-Based Multi-Featured Rock Modeling and Detection Framework for a Mars Rover