Abstract:Accurately predicting the performance of a tunnel boring machine (TBM) is important to safe and efficient tunneling. The application of machine learning algorithms to TBM performance prediction creates several challenges. Such prediction is a nontrivial task involving procedures such as data preprocessing, selection of a machine learning algorithm and optimization of the related hyperparameters. The demand for expert knowledge has restricted the application of machine learning methods to TBM performance prediction, and it is meaningful to study predicting TBM performance automatically. In this paper, we explore three approaches to TBM performance prediction using Bayesian optimization and automated machine learning (AutoML). In the first study, Bayesian optimization is used to determine the optimal hyperparameters of various machine learning algorithms, including support vector regression (SVR), decision tree, bagging tree, random forest and AdaBoost. We attain the minimum mean squared error (MSE) values of 3.135 x 10(-2) and 3.177 x 10(-2) for a decision tree and SVR, respectively. In the second approach called the neural architecture search (NAS), the optimal combination of architecture, hyperparameters and the training procedure of an artificial neural network is found in a single operation. We obtain the optimal results of 3.514 x 10(-2) and 3.237 x 10(-2) if complete and simplified NAS are used, respectively. In the third method, the best combination of a data preprocessing method, a machine learning model and the related hyperparameters is found, and an optimal MSE value of 3.148 x 10(-2) is obtained using AutoML. In all three studies, we obtain state-of-the-art prediction results that are superior to a previous best prediction result of 3.500 x 10(-2). The prediction results prove that Bayesian optimization and AutoML are powerful tools that can not only effectively predict TBM performance but also reduce the demand for expert knowledge of machine learning.

CBOL-Tuner: Classifier-pruned Bayesian optimization to explore temporally structured latent spaces for particle accelerator tuning

Reinforcement learning-trained optimisers and Bayesian optimisation for online particle accelerator tuning

Adaptive Machine Learning for Time-Varying Systems: Low Dimensional Latent Space Tuning

Adaptive Latent Space Tuning for Non-Stationary Distributions

Accelerator system parameter estimation using variational autoencoded latent regression

Local Latent Space Bayesian Optimization over Structured Inputs

TBM Performance Prediction with Bayesian Optimization and Automated Machine Learning

More Sample-Efficient Tuning of Particle Accelerators with Bayesian Optimization and Prior Mean Models

Large Language Models for Human-Machine Collaborative Particle Accelerator Tuning through Natural Language

Autotuning Apache TVM-based Scientific Applications Using Bayesian Optimization

High-dimensional Bayesian optimization using low-dimensional feature spaces

CoTuner: A Hierarchical Learning Framework for Coordinately Optimizing Resource Partitioning and Parameter Tuning.

High-Dimensional Controller Tuning through Latent Representations

Towards latent space evolution of spatiotemporal dynamics of six-dimensional phase space of charged particle beams

Application of the asynchronous advantage actor–critic machine learning algorithm to real-time accelerator tuning

Transfer Learning Based Search Space Design for Hyperparameter Tuning.

A conditional latent autoregressive recurrent model for generation and forecasting of beam dynamics in particle accelerators

Efficient Parameter Tuning for a Structure-Based Virtual Screening HPC Application

Function Space Particle Optimization for Bayesian Neural Networks

Bayesian Optimization in Variational Latent Spaces with Dynamic Compression

Latent Space Bayesian Optimization with Latent Data Augmentation for Enhanced Exploration