Abstract:The emergence of a variety of Machine Learning (ML) approaches for travel mode choice prediction poses an interesting question to transport modellers: which models should be used for which applications? The answer to this question goes beyond simple predictive performance, and is instead a balance of many factors, including behavioural interpretability and explainability, computational complexity, and data efficiency. There is a growing body of research which attempts to compare the predictive performance of different ML classifiers with classical random utility models. However, existing studies typically analyse only the disaggregate predictive performance, ignoring other aspects affecting model choice. Furthermore, many studies are affected by technical limitations, such as the use of inappropriate validation schemes, incorrect sampling for hierarchical data, lack of external validation, and the exclusive use of discrete metrics. We address these limitations by conducting a systematic comparison of different modelling approaches, across multiple modelling problems, in terms of the key factors likely to affect model choice (out-of-sample predictive performance, accuracy of predicted market shares, extraction of behavioural indicators, and computational efficiency). We combine several real world datasets with synthetic datasets, where the data generation function is known. The results indicate that the models with the highest disaggregate predictive performance (namely extreme gradient boosting and random forests) provide poorer estimates of behavioural indicators and aggregate mode shares, and are more expensive to estimate, than other models, including deep neural networks and Multinomial Logit (MNL). It is further observed that the MNL model performs robustly in a variety of situations, though ML techniques can improve the estimates of behavioural indices such as Willingness to Pay.

Applying Machine Learning Algorithms to Predict the Size of the Informal Economy

Going a Step Deeper Down the Rabbit Hole: Deep Learning Model to Measure the Size of the Unregistered Economy Activity

Machine learning and economic forecasting: the role of international trade networks

Machine Learning: An Applied Econometric Approach

Application of Machine Learning in Forecasting International Trade Trends

Machine Learning Simulates Agent-Based Model Towards Policy

Econométrie et Machine Learning

Large Language Models: An Applied Econometric Framework

Crime prediction through urban metrics and statistical learning

Using Machine Learning for NEETs and Sustainability Studies: Determining Best Machine Learning Algorithms

Deep Learning Macroeconomics

The Challenges of Machine Learning and Their Economic Implications

Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods

Using maps to predict economic activity

A prediction and behavioural analysis of machine learning methods for modelling travel mode choice

predictSLUMS: A new model for identifying and predicting informal settlements and slums in cities from street intersections using machine learning

Macroeconomic Predictions Using Payments Data and Machine Learning

Machine learning methods for inflation forecasting in Brazil: New contenders versus classical models

The Economic Implications of Large Language Model Selection on Earnings and Return on Investment: A Decision Theoretic Model

Machine Learning for Economic Forecasting: An Application to China's GDP Growth

Predicting French SME failures: new evidence from machine learning techniques