Abstract:3D point clouds of natural environments relevant to problems in geomorphology (rivers, coastal environments, cliffs,…) often require classification of the data into elementary relevant classes. A typical example is the separation of riparian vegetation from ground in fluvial environments, the distinction between fresh surfaces and rockfall in cliff environments, or more generally the classification of surfaces according to their morphology (e.g. the presence of bedforms or by grain size). Natural surfaces are heterogeneous and their distinctive properties are seldom defined at a unique scale, prompting the use of multi-scale criteria to achieve a high degree of classification success. We have thus defined a multi-scale measure of the point cloud dimensionality around each point. The dimensionality characterizes the local 3D organization of the point cloud within spheres centered on the measured points and varies from being 1D (points set along a line), 2D (points forming a plane) to the full 3D volume. By varying the diameter of the sphere, we can thus monitor how the local cloud geometry behaves across scales. We present the technique and illustrate its efficiency in separating riparian vegetation from ground and classifying a mountain stream as vegetation, rock, gravel or water surface. In these two cases, separating the vegetation from ground or other classes achieve accuracy larger than 98%. Comparison with a single scale approach shows the superiority of the multi-scale analysis in enhancing class separability and spatial resolution of the classification. Scenes between 10 and one hundred million points can be classified on a common laptop in a reasonable time. The technique is robust to missing data, shadow zones and changes in point density within the scene. The classification is fast and accurate and can account for some degree of intra-class morphological variability such as different vegetation types. A probabilistic confidence in the classification result is given at each point, allowing the user to remove the points for which the classification is uncertain. The process can be both fully automated (minimal user input once, all scenes treated in large computation batches), but also fully customized by the user including a graphical definition of the classifiers if so desired. Working classifiers can be exchanged between users independently of the instrument used to acquire the data avoiding the need to go through full training of the classifier. Although developed for fully 3D data, the method can be readily applied to 2.5D airborne lidar data.

SediNet: a configurable deep learning model for mixed qualitative and quantitative optical granulometry

CNN for Image-Based Sediment Detection Applied to a Large Terrestrial and Airborne Dataset

Convolutional Neural Networks for Image-Based Sediment Detection Applied to a Large Terrestrial and Airborne Dataset

Estimation of grain-size distributions and associated parameters from digital images of sediment

Sediment grain segmentation in thin-section images using dual-modal Vision Transformer

Deep learning‐based grain‐size decomposition model: A feasible solution for dealing with methodological uncertainty

Automated grain sizing from uncrewed aerial vehicles imagery of a gravel‐bed river: Benchmarking of three object‐based methods

A systematic framework for DEM study of realistic gravel-sand mixture from particle recognition to macro- and micro-mechanical analysis

Sediment core analysis using artificial intelligence

Granular computing based segmentation and textural analysis (GrCSTA) framework for object-based LULC classification of fused remote sensing images

UAV-Based Optical Granulometry as Tool for Detecting Changes in Structure of Flood Depositions

Deep-Learning-Based Automatic Mineral Grain Segmentation and Recognition

Leveraging Spatial Metadata in Machine Learning for Improved Objective Quantification of Geological Drill Core

MudrockNet: Semantic Segmentation of Mudrock SEM Images through Deep Learning

Exploring optical descriptors for rapid estimation of coastal sediment organic carbon and nearby land-use classifications via machine learning models

3D terrestrial lidar data classification of complex natural scenes using a multi-scale dimensionality criterion: Applications in geomorphology

Automated determination of transport and depositional environments in sand and sandstones

Deep Learning and Histogram-Based Grain Size Analysis of Images

Machine learning applied to pore-space geometry in sandstones: a tool for evaluating grain-scale similarity?

Optimized and autonomous machine learning framework for characterizing pores, particles, grains and grain boundaries in microstructural images

Deep multimodal fusion model for moisture content measurement of sand gravel using images, NIR spectra, and dielectric data