Abstract:Due to the development of ship sizes and the traffic increase in port, ships having long turnaround time in port often result in port congestion, which seriously affects the efficiency of the ship navigation and environmental sustainability of port, it has been evident that effective ship scheduling presents a solution of the fundamental and strategic importance to port congestion. In this paper, a mixed-integer linear programming mathematical model is proposed to realize the optimization of the ship scheduling in port to minimize the total time spent by ships in port. Its methodological novelty is gained by an innovative adaptive genetic simulated annealing algorithm based on a reinforcement learning algorithm (GSAA-RL) to support the developed mathematical model, in which the genetic algorithm is considered as the basic optimization algorithm, and Q-learning with a unique property of selecting suitable parameters dynamically is developed to adjust the parameters of crossover and mutation to improve the search ability of the algorithm. Meanwhile, the dynamic parameter turning process is formulated into a Markov decision process (MDP) model with well defining the state, action, and reward function in GSAA-RL. Specifically, the state sets are proposed by analyzing the key factors affecting the scheduling efficiency and a new reward mechanism that can reduce the objective value significantly based on the quality of selected parameters is designed. The annealing operation is performed on some excellent individuals to further expand the search scope. Simulation experiments demonstrate that the proposed GSAA-RL algorithm can significantly shorten the total time spent by ships in port compared to existing approaches. This study hence helps port operators/planners to improve operational efficiency and reduce port congestion, reduce ship fuel consumption, and deliver goods to cargo owners in a timely manner, which has important practical significance for achieving the "dual carbon" goal.

Ship Dredging Scheduling Optimization at Port Based on Human-computer Interactive Ant Colony Algorithm

Multi-objective optimization model and ant colony optimization of liner ship scheduling

Integrated scheduling optimization of U-shaped automated container terminal under loading and unloading mode

Simulation-optimization approach for integrated scheduling at wharf apron in container terminals

Optimization model for ship lock scheduling plans using ant colony algorithm

Optimisation of berth and quay crane joint scheduling considering efficiency and energy consumption

Vessel traffic scheduling optimization for passenger RoRo terminals with restricted harbor basin

A Chaos-Coupled Multi-Objective Scheduling Decision Method for Liner Shipping Based on the NSGA-III Algorithm.

Integrated optimization of traffic organization and berth allocation for two-way navigable ships entering and leaving the port

An adaptive heuristic algorithm based on reinforcement learning for ship scheduling optimization problem

Research on improved Ant Colony Algorithm based optimization of container handling sequence problem

An integration optimization for berth allocation and quay crane scheduling method based on the genetic and ant colony algorithm

Optimization of Integrated Tugboat–Berth–Quay Crane Scheduling in Container Ports Considering Uncertainty in Vessel Arrival Times and Berthing Preferences

Optimization of Integrated Scheduling of Restricted Channels, Berths, and Yards in Bulk Cargo Ports Considering Carbon Emissions

Simulated Annealing-Based Ant Colony Algorithm for Tugboat Scheduling Optimization

Integrated berth and quay-crane scheduling based on improved genetic algorithm

Multi-Objective Optimization for Ship Scheduling with Port Congestion and Environmental Considerations

Application of Improved Multi-Objective Ant Colony Optimization Algorithm in Ship Weather Routing

Ship Loading Scheduling Strategy Of Container Terminal With Heuristic Greedy Algorithm

Joint Optimization of Pre-Marshalling and Yard Cranes Deployment in the Export Block

Scheduling Optimization of Port Tugboat Operation Considering Multi-Anchorage