Abstract:Port logistics is characterised by a high degree of fragmentation, uncertainty and complexity. In a context with these characteristics, decision support can be of significant value. This study presents the prototype of an intelligent decision support system (DSS) that leads to horizontal and vertical cooperation among freight agents involved in port logistics. A multi-agent simulation model is presented where heterogeneous actions are enabled as a result of an adaptive reinforcement learning algorithm that is inspired by human decision-making strategies. The model combines optimisation modelling and decision theory to operate in a dynamic environment characterised by information asymmetry among agents and dynamic changes over time. A simulation demonstrates the dynamics and convergence to equilibrium of the interactions of heterogeneous agents for delivery and pick up of import/export shipments.In particular, we answer two specific research questions. What is the likely impact of an intelligent DSS in hinterland container transport as a value-added service of port community system (PCS)? How can an optimum cooperative strategy be formulated to meet the dynamic demand and supply of freight agents in hinterland container transport and achieve agility in the age of hyper-competition?By addressing these two research questions we make a specific contribution by developing an agent-based simulation model in a real-world and large-scale case study, by using a reinforcement learning model based on probability matching theory that allows simulating realistically the adaptive behaviour of agents. The results of the simulation of two weeks of container movements indicate huge savings in total transport costs and distance travelled as well as higher utilisation of trucks from the sharing of resources. Moreover, we show that it is strictly better for smaller freight agents to cooperate – a conclusion generated endogenously inside the model as a trade-off between exploration and exploitation. As a result of this prototype simulation, major freight agents will not necessarily benefit from the DSS mainly because they are already using the economies of scale.

An Efficient Knowledge Transfer Solution to A Novel Smdp Formalization of A Broker'S Decision Problem

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Decentralized scheduling through an adaptive, trading-based multi-agent system

Multi-agent reinforcement learning in a realistic limit order book market simulation

Optimizing Trading Strategies in Quantitative Markets using Multi-Agent Reinforcement Learning

Deep differentiable reinforcement learning and optimal trading

Recurrent Deep Multiagent Q-Learning for Autonomous Brokers in Smart Grid

Knowledge Transfer from Simple to Complex: A Safe and Efficient Reinforcement Learning Framework for Autonomous Driving Decision-Making

A hybrid decision support system for adaptive trading strategies: Combining a rule-based expert system with a deep reinforcement learning strategy

Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents

Multi-agent Black-box Optimization using a Bayesian Approach to Alternating Direction Method of Multipliers

A synchronous deep reinforcement learning model for automated multi-stock trading

Deep Deterministic Portfolio Optimization

Adaptive Predictive Portfolio Management Agent

Learning and Calibrating Heterogeneous Bounded Rational Market Behaviour with Multi-Agent Reinforcement Learning

Learning Multi-Agent Intention-Aware Communication for Optimal Multi-Order Execution in Finance

Hybrid Decision Making for Scalable Multi-Agent Navigation: Integrating Semantic Maps, Discrete Coordination, and Model Predictive Control

Multiagent-based deep reinforcement learning framework for multi-asset adaptive trading and portfolio management

Decision-Focused Model-based Reinforcement Learning for Reward Transfer

An intelligent decision support system prototype for hinterland port logistics

Multi-Agent Deep Reinforcement Learning for Liquidation Strategy Analysis