Abstract:While the localization of radiological sources has traditionally been handled with statistical algorithms, such a task can be augmented with advanced machine learning methodologies. The combination of deep and reinforcement learning has provided learning-based navigation to autonomous, single-detector, mobile systems. However, these approaches lacked the capacity to terminate a surveying/search task without outside influence of an operator or perfect knowledge of source location (defeating the purpose of such a system). Two stopping criteria are investigated in this work for a machine learning navigated system: one based upon Bayesian and maximum likelihood estimation (MLE) strategies commonly used in source localization, and a second providing the navigational machine learning network with a "stop search" action. A convolutional neural network was trained via reinforcement learning in a 10 m × 10 m simulated environment to navigate a randomly placed detector-agent to a randomly placed source of varied strength (stopping with perfect knowledge during training). The network agent could move in one of four directions (up, down, left, right) after taking a 1 s count measurement at the current location. During testing, the stopping criteria for this navigational algorithm was based upon a Bayesian likelihood estimation technique of source presence, updating this likelihood after each step, and terminating once the confidence of the source being in a single location exceeded 0.9. A second network was trained and tested with similar architecture as the previous but which contained a fifth action: for self-stopping. The accuracy and speed of localization with set detector and source initializations were compared over 50 trials of MLE-Bayesian approach and 1000 trials of the CNN with self-stopping. The statistical stopping condition yielded a median localization error of ~1.41 m and median localization speed of 12 steps. The machine learning stopping condition yielded a median localization error of 0 m and median localization speed of 17 steps. This work demonstrated two stopping criteria available to a machine learning guided, source localization system.

Machine Learning-Based Sparse Near-Field Scanning: when to Automatically Stop?

Multi-Frequency and Multi-Component Sparse Near Field Scanning Based on Active Machine Learning

Approximate Message Passing with Nearest Neighbor Sparsity Pattern Learning

Physics Based Sparsity Level Determination for Acoustic Scattered Far-Field Prediction.

A Novel Machine-Learning-Based Batch Selection Method in Sparse Near-Field Scanning

A Novel Method for Analyzing the Influence of Relative Attitude of Laser Profile Scanner on 3D Measurement System

Active Machine Learning for Automatic High-Frequency EMI Source Localization

Noise reduction of laser scanning data based on self-estimated angular threshold

Efficient Discharge Waveform Distribution Measurement Using Active Machine Learning

Near-Field Prediction in Complex Environment Based on Phaseless Scanned Fields and Machine Learning

Stopping criteria for ending autonomous, single detector radiological source searches

Learning-Based Subsurface Quantitative Imaging via Near-Field Scanning Microwave Microscopy

Deep-Learning-Aided Extraction of Optical Constants in Scanning Near-Field Optical Microscopy

A machine learning decision criterion for reducing scan time for hyperspectral neutron computed tomography systems

Unsupervised Near-Field Array SAR Imaging Method Based on Latent Variable Generative Models

3-D SAR Autofocusing with Learned Sparsity

Research on a Two-stage Plane Adaptive Sampling Algorithm for Near-field Scanning Acceleration

Deep Non-line-of-sight Imaging from Under-scanning Measurements.

A real-time automatic rail extraction algorithm for low-density mobile laser scanning data

Non-line-of-sight Sparse Aperture ISAR Imaging Via A Novel Detail-aware Regularization

Bearing Fault Diagnosis by Sparse Frequency Spiral Spectrum Driven NAF-LDM under Strong Noise and Small Samples