Abstract:'Slide scanners' are rapid optical microscopes equipped with automated and accurate x-y travel stages with virtual z-motion that cannot be rotated. In biomedical microscopic imaging, they are widely deployed to generate whole-slide images (WSI) of tissue samples in various modes of illumination. The availability of WSI has motivated the development of instrument-agnostic advanced image analysis software, helping drug development, pathology, and many other areas of research. Slide scanners are now being modified to enable polarised petrographic microscopy by simulating stage rotation with the acquisition of multiple rotation angles of the polariser–analyser pair for observing randomly oriented anisotropic materials. Here we report on the calibration strategy of one repurposed slide scanner and describe a pilot image analysis pipeline designed to introduce the wider audience to the complexity of performing computer-assisted feature recognition on mineral groups. The repurposed biological scanner produces transmitted light plane- and cross-polarised (TL-PPL and XPL) and unpolarised reflected light (RL) WSI from polished thin sections or slim epoxy mounts at various magnifications, yielding pixel dimensions from ca. 2.7 × 2.7 to 0.14 × 0.14 μm. A data tree of 14 WSI is regularly obtained, containing two RL and six of each PPL and XPL WSI (at 18° rotation increments). This pyramidal image stack is stitched and built into a local server database simultaneously with acquisition. The pyramids (multi-resolution 'cubes') can be viewed with freeware locally deployed for teaching petrography and collaborative research. The main progress reported here concerns image analysis with a pilot open-source software pipeline enabling semantic segmentation on petrographic imagery. For this purpose, all WSI are post-processed and aligned to a 'fixed' reflective surface (RL), and the PPL and XPL stacks are then summarised in one image, each with ray tracing that describes visible light reflection, absorption, and O- and E-wave interference phenomena. The maximum red-green-blue values were found to best overcome the limitation of refractive index anisotropy for segmentation based on pixel-neighbouring feature maps. This strongly reduces the variation in dichroism in PPL and interference colour in XPL. The synthetic ray trace WSI is then combined with one RL to estimate modal mineralogy with multi-scale algorithms originally designed for object-based cell segmentation in pathological tissues. This requires generating a small number of polygonal expert annotations that inform a training dataset, enabling on-the-fly machine learning classification into mineral classes. The accuracy of the approach was tested by comparison with modal mineralogy obtained by energy-dispersive spectroscopy scanning electron microscopy (SEM-EDX) for a suite of rocks of simple mineralogy (granulites and peridotite). The strengths and limitations of the pixel-based classification approach are described, and phenomena from sample preparation imperfections to semantic segmentation artefacts around fine-grained minerals and/or of indiscriminate optical properties are discussed. Finally, we provide an outlook on image analysis strategies that will improve the status quo by using the first-pass mineralogy identification from optical WSI to generate a location grid to obtain targeted chemical data (e.g., by SEM-EDX) and by considering the rock texture.

Novel technique for the preparation and analysis of powder-based polished sections by automated optical mineralogy: Part 2 – Use of deep learning approach for transparent mineral detection

A Novel Method for Evaluation of Ore Minerals Based on Optical Microscopy and Image Analysis: Preliminary Results

Deep-Learning-Based Automatic Mineral Grain Segmentation and Recognition

Tracking element-mineral associations with unsupervised learning and dimensionality reduction in chemical and optical image stacks of thin sections

A New Method for the Detection of Siliceous Microfossils on Sediment Microscope Slides Using Convolutional Neural Networks

Instance segmentation of quartz in iron ore optical microscopy images by deep learning

Petrographic Microscopy with Ray Tracing and Segmentation from Multi-Angle Polarisation Whole-Slide Images

A mineralogy characterisation technique for copper ore in flotation pulp using deep learning machine vision with optical microscopy

Cements and concretes materials characterisation using machine‐learning‐based reconstruction and 3D quantitative mineralogy via X‐ray microscopy

Phase quantification using deep neural network processing of XRD patterns

A deep learning solution for particle size analysis in low resolution inline microscopy images based on generative adversarial network

Machine Learning for recognition of minerals from multispectral data

Efficient Phase Segmentation of Light-Optical Microscopy Images of Highly Complex Microstructures Using a Correlative Approach in Combination with Deep Learning Techniques

Application of Target Detection Based on Deep Learning in Intelligent Mineral Identification

Deep-Learning-Enabled Fast Optical Identification and Characterization of Two-Dimensional Materials

An Improved Mineral Image Recognition Method Based on Deep Learning

Deep‐Learning‐Enabled Fast Optical Identification and Characterization of 2D Materials

Multichannel Sandstone Thin Sections Identification Based on Improved DeepLab V3 Plus Neural Network

Deep Learning-Based Binocular Image Analysis for In Situ Measurement of Particle Length Distribution During Crystallization Process

Fusion of Laser-Induced Breakdown Spectroscopy and Raman Spectroscopy for Mineral Identification Based on Machine Learning

Enhanced Nanoparticle Recognition via Deep Learning-Accelerated Plasmonic Sensing