Abstract:Rockfall detection is a crucial procedure in the field of geology, which helps to reduce the associated risks. Currently, geologists identify rockfall events almost manually utilizing point cloud and imagery data obtained from different caption devices such as Terrestrial Laser Scanner or digital cameras. Multi-temporal comparison of the point clouds obtained with these techniques requires a tedious visual inspection to identify rockfall events which implies inaccuracies that depend on several factors such as human expertise and the sensibility of the sensors. This paper addresses this issue and provides an intelligent framework for rockfall event detection for any individual working in the intersection of the geology domain and decision support systems. The development of such an analysis framework poses significant research challenges and justifies intensive experimental analysis. In particular, we propose an intelligent system that utilizes multiple machine learning algorithms to detect rockfall clusters of point cloud data. Due to the extremely imbalanced nature of the problem, a plethora of state-of-the-art resampling techniques accompanied by multiple models and feature selection procedures are being investigated. Various machine learning pipeline combinations have been benchmarked and compared applying well-known metrics to be incorporated into our system. Specifically, we developed statistical and machine learning techniques and applied them to analyze point cloud data extracted from Terrestrial Laser Scanner in two distinct case studies, involving different geological contexts: the basaltic cliff of Castellfollit de la Roca and the conglomerate Montserrat Massif, both located in Spain. Our experimental data suggest that some of the above-mentioned machine learning pipelines can be utilized to detect rockfall incidents on mountain walls, with experimentally proven accuracy.

End-to-End Rockfall Detection Based on DINO

DroneNet: Rescue Drone-View Object Detection

DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection

An Analysis of Deep Object Detectors For Diver Detection

DINOv2 Rocks Geological Image Analysis: Classification, Segmentation, and Interpretability

Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detection

Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection

Real-Time Dynamic Intelligent Image Recognition and Tracking System for Rockfall Disasters

Early stage damage detection of wind turbine blades based on UAV images and deep learning

Landslide Extraction Using Mask R-CNN with Background-Enhancement Method

Vision-based Crater and Rock Detection Using a Cascade Decision Forest

Deep learning of rock images for intelligent lithology identification

Rock Crack Recognition Technology Based on Deep Learning

End-to-End Intelligent Framework for Rockfall Detection

A Novel Method for Identifying Landslide Surface Deformation via the Integrated YOLOX and Mask R-CNN Model

DINO-X: A Unified Vision Model for Open-World Object Detection and Understanding

Landslide Recognition from Multi-Feature Remote Sensing Data Based on Improved Transformers

Deep Learning in Rockburst Intensity Level Prediction: Performance Evaluation and Comparison of the NGO-CNN-BiGRU-Attention Model

A Strong and Reproducible Object Detector with Only Public Datasets

DINO-SD: Champion Solution for ICRA 2024 RoboDepth Challenge

WEA-DINO: An Improved DINO With Word Embedding Alignment for Remote Scene Zero-Shot Object Detection