Abstract:Accurately predicting the performance of a tunnel boring machine (TBM) is important to safe and efficient tunneling. The application of machine learning algorithms to TBM performance prediction creates several challenges. Such prediction is a nontrivial task involving procedures such as data preprocessing, selection of a machine learning algorithm and optimization of the related hyperparameters. The demand for expert knowledge has restricted the application of machine learning methods to TBM performance prediction, and it is meaningful to study predicting TBM performance automatically. In this paper, we explore three approaches to TBM performance prediction using Bayesian optimization and automated machine learning (AutoML). In the first study, Bayesian optimization is used to determine the optimal hyperparameters of various machine learning algorithms, including support vector regression (SVR), decision tree, bagging tree, random forest and AdaBoost. We attain the minimum mean squared error (MSE) values of 3.135 x 10(-2) and 3.177 x 10(-2) for a decision tree and SVR, respectively. In the second approach called the neural architecture search (NAS), the optimal combination of architecture, hyperparameters and the training procedure of an artificial neural network is found in a single operation. We obtain the optimal results of 3.514 x 10(-2) and 3.237 x 10(-2) if complete and simplified NAS are used, respectively. In the third method, the best combination of a data preprocessing method, a machine learning model and the related hyperparameters is found, and an optimal MSE value of 3.148 x 10(-2) is obtained using AutoML. In all three studies, we obtain state-of-the-art prediction results that are superior to a previous best prediction result of 3.500 x 10(-2). The prediction results prove that Bayesian optimization and AutoML are powerful tools that can not only effectively predict TBM performance but also reduce the demand for expert knowledge of machine learning.

Multi-task prediction method of business process based on BERT and Transfer Learning

Multi-Perspective Data Fusion Framework Based on Hierarchical BERT: Provide Visual Predictions of Business Processes

Multi-task learning with multi-gate mixture of transformer-based experts for predictive process monitoring in manufacturing

MiTFM: A Multi-View Information Fusion Method Based on Transformer for Next Activity Prediction of Business Processes.

TBM Performance Prediction with Bayesian Optimization and Automated Machine Learning

Traffic Flow and Speed Forecasting Through a Bayesian Deep Multi-Linear Relationship Network.

A Novel Business Process Prediction Model Using a Deep Learning Method

Multi-task Sequence Learning for Performance Prediction and KPI Mining in Database Management System

Hierarchical Projection Enhanced Multi-behavior Recommendation.

A Multi-Task Prediction Framework for Sales Prediction

MM-CPred: A Multi-task Predictive Model for Continuous-Time Event Sequences with Mixture Learning Losses

Masked Multi-Domain Network: Multi-Type and Multi-Scenario Conversion Rate Prediction with a Single Model

Multi-task deep learning for large-scale buildings energy management

Process Extraction from Texts Via Multi-Task Architecture.

TaskExpert: Dynamically Assembling Multi-Task Representations with Memorial Mixture-of-Experts

Optimizing Multi-Task Learning for Enhanced Performance in Large Language Models

Multi-task Learning for Landslide Displacement Prediction

Rethinking of Feature Interaction for Multi-task Learning on Dense Prediction

PTUM: Pre-training User Model from Unlabeled User Behaviors Via Self-supervision.

Exploring the effect of context information on deep learning business process predictions

Multi-Task Label Discovery via Hierarchical Task Tokens for Partially Annotated Dense Predictions