Abstract:Sea freight is one of the most important ways for the transportation and distribution of coal and other bulk cargo. This paper proposes a method for optimizing the scheduling efficiency of the bulk cargo loading process based on deep reinforcement learning. The process includes a large number of states and possible choices that need to be taken into account, which are currently performed by skillful scheduling engineers on site. In terms of modeling, we extracted important information based on actual working data of the terminal to form the state space of the model. The yard information and the demand information of the ship are also considered. The scheduling output of each convey path from the yard to the cabin is the action of the agent. To avoid conflicts of occupying one machine at same time, certain restrictions are placed on whether the action can be executed. Based on Double DQN, an improved deep reinforcement learning method is proposed with a fully connected network structure and selected action sets according to the value of the network and the occupancy status of environment. To make the network converge more quickly, an improved new epsilon-greedy exploration strategy is also proposed, which uses different exploration rates for completely random selection and feasible random selection of actions. After training, an improved scheduling result is obtained when the tasks arrive randomly and the yard state is random. An important contribution of this paper is to integrate the useful features of the working time of the bulk cargo terminal into a state set, divide the scheduling process into discrete actions, and then reduce the scheduling problem into simple inputs and outputs. Another major contribution of this article is the design of a reinforcement learning algorithm for the bulk cargo terminal scheduling problem, and the training efficiency of the proposed algorithm is improved, which provides a practical example for solving bulk cargo terminal scheduling problems using reinforcement learning.

Research on vehicle-cargo matching problem based on deep Q-network

Research on vehicle-cargo matching algorithm based on improved dynamic Bayesian network

Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling

Research on Fresh Product Logistics Transportation Scheduling Based on Deep Reinforcement Learning

Research on Intelligent Dynamic Scheduling Algorithm for Automated Guided Vehicles in Container Terminal Based on Deep Reinforcement Learning

Optimizing Online Matching for Ride-Sourcing Services with Multi-Agent Deep Reinforcement Learning

Deep Dispatching: A Deep Reinforcement Learning Approach for Vehicle Dispatching on Online Ride-Hailing Platform

Intelligent Scheduling Method for Bulk Cargo Terminal Loading Process Based on Deep Reinforcement Learning

Multi-Stage Vehicle Dispatch for Community Group-buying Logistics via Deep Reinforcement Learning

Optimization of Truck–Cargo Online Matching for the Less-Than-Truck-Load Logistics Hub under Real-Time Demand

A Deep Value-network Based Approach for Multi-Driver Order Dispatching

Research on logistics distribution route optimization based on deep learning model and block chain technology

Research on "one-to-many" Vehicle and Cargo Matching Optimization Problem based on Improved Genetic Algorithm

Optimization Analysis of the Emergency Logistics Identification Method Based on the Deep Learning Model under the Background of Big Data

VeLP: Vehicle Loading Plan Learning from Human Behavior in Nationwide Logistics System.

Reinforcement Learning for Intermodal Transportation Planning with Time Windows and Limited Cargo Capacity

Logistics-involved QoS-aware service composition in cloud manufacturing with deep reinforcement learning

Deep Reinforcement Learning for Truck-Drone Delivery Problem

DeepMDV: Learning Global Matching for Multi-depot Vehicle Routing Problems

An intelligent open trading system for on-demand delivery facilitated by deep Q network based reinforcement learning

A Two-stage Learning-based Method for Large-scale On-demand Pickup and Delivery Services with Soft Time Windows