Abstract:Accurately predicting the performance of a tunnel boring machine (TBM) is important to safe and efficient tunneling. The application of machine learning algorithms to TBM performance prediction creates several challenges. Such prediction is a nontrivial task involving procedures such as data preprocessing, selection of a machine learning algorithm and optimization of the related hyperparameters. The demand for expert knowledge has restricted the application of machine learning methods to TBM performance prediction, and it is meaningful to study predicting TBM performance automatically. In this paper, we explore three approaches to TBM performance prediction using Bayesian optimization and automated machine learning (AutoML). In the first study, Bayesian optimization is used to determine the optimal hyperparameters of various machine learning algorithms, including support vector regression (SVR), decision tree, bagging tree, random forest and AdaBoost. We attain the minimum mean squared error (MSE) values of 3.135 x 10(-2) and 3.177 x 10(-2) for a decision tree and SVR, respectively. In the second approach called the neural architecture search (NAS), the optimal combination of architecture, hyperparameters and the training procedure of an artificial neural network is found in a single operation. We obtain the optimal results of 3.514 x 10(-2) and 3.237 x 10(-2) if complete and simplified NAS are used, respectively. In the third method, the best combination of a data preprocessing method, a machine learning model and the related hyperparameters is found, and an optimal MSE value of 3.148 x 10(-2) is obtained using AutoML. In all three studies, we obtain state-of-the-art prediction results that are superior to a previous best prediction result of 3.500 x 10(-2). The prediction results prove that Bayesian optimization and AutoML are powerful tools that can not only effectively predict TBM performance but also reduce the demand for expert knowledge of machine learning.

Sequential Model-Based Optimization for Natural Language Processing Data Pipeline Selection and Optimization

Efficient Hyper-parameter Optimization for NLP Applications.

Asynchronous Batch Bayesian Optimization with Pipelining Evaluations for Experimental Resource$\unicode{x2013}$constrained Conditions

Sequential Model-Based Ensemble Optimization

A Bayesian Optimization through Sequential Monte Carlo and Statistical Physics-Inspired Techniques

Sequential Large Language Model-Based Hyper-Parameter Optimization

Optimization Strategies for Deep Learning Models in Natural Language Processing

TBM Performance Prediction with Bayesian Optimization and Automated Machine Learning

Large Language Models to Enhance Bayesian Optimization

Optimizing Sequential Medical Treatments with Auto-Encoding Heuristic Search in POMDPs

Poisson Process for Bayesian Optimization

Bayesian Optimization with LLM-Based Acquisition Functions for Natural Language Preference Elicitation

Predictive Modeling through Hyper-Bayesian Optimization

AutoWeka4MCPS-AVATAR: Accelerating Automated Machine Learning Pipeline Composition and Optimisation

Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs

The Nature of Mathematical Modeling and Probabilistic Optimization Engineering in Generative AI

Practical Path-based Bayesian Optimization

srMO-BO-3GP: A Sequential Regularized Multi-Objective Constrained Bayesian Optimization for Design Applications

A Bayesian approach for prompt optimization in pre-trained language models

Bayesian optimization with adaptive surrogate models for automated experimental design

Bayesian optimization as a flexible and efficient design framework for sustainable process systems