Abstract:Due to the development of ship sizes and the traffic increase in port, ships having long turnaround time in port often result in port congestion, which seriously affects the efficiency of the ship navigation and environmental sustainability of port, it has been evident that effective ship scheduling presents a solution of the fundamental and strategic importance to port congestion. In this paper, a mixed-integer linear programming mathematical model is proposed to realize the optimization of the ship scheduling in port to minimize the total time spent by ships in port. Its methodological novelty is gained by an innovative adaptive genetic simulated annealing algorithm based on a reinforcement learning algorithm (GSAA-RL) to support the developed mathematical model, in which the genetic algorithm is considered as the basic optimization algorithm, and Q-learning with a unique property of selecting suitable parameters dynamically is developed to adjust the parameters of crossover and mutation to improve the search ability of the algorithm. Meanwhile, the dynamic parameter turning process is formulated into a Markov decision process (MDP) model with well defining the state, action, and reward function in GSAA-RL. Specifically, the state sets are proposed by analyzing the key factors affecting the scheduling efficiency and a new reward mechanism that can reduce the objective value significantly based on the quality of selected parameters is designed. The annealing operation is performed on some excellent individuals to further expand the search scope. Simulation experiments demonstrate that the proposed GSAA-RL algorithm can significantly shorten the total time spent by ships in port compared to existing approaches. This study hence helps port operators/planners to improve operational efficiency and reduce port congestion, reduce ship fuel consumption, and deliver goods to cargo owners in a timely manner, which has important practical significance for achieving the "dual carbon" goal.

A Chaos-Coupled Multi-Objective Scheduling Decision Method for Liner Shipping Based on the NSGA-III Algorithm.

Joint Planning of Fleet Deployment, Speed Optimization, and Cargo Allocation for Liner Shipping

Scheduling Decision Model Of Liner Shipping Considering Emission Control Areas Regulations

Green maritime: a routing and speed multi-objective optimization strategy

Ship Route and Speed Multi-Objective Optimization Considering Weather Conditions and Emission Control Area Regulations

Multi-objective Ship Weather Routing Method Based on the Improved NSGA-III Algorithm

Multi-objective optimization model and ant colony optimization of liner ship scheduling

Method for Simultaneously Optimizing Ship Route and Speed with Emission Control Areas

Multi-Objective Optimization for Ship Scheduling with Port Congestion and Environmental Considerations

Green Maritime: an Improved Quantum Genetic Algorithm-Based Ship Speed Optimization Method Considering Various Emission Reduction Regulations and Strategies

Overall Scheduling Model for Vessels Scheduling and Berth Allocation for Ports with Restricted Channels That Considers Carbon Emissions

Ship route planning based on intelligent mapping swarm optimization

Ship's Response to Low-Sulfur Regulations: from the Perspective of Route, Speed and Refueling Strategy

Multi-Objective Green Ship Routing Based on Fuzzy Hierarchy Analysis and Ant Colony Algorithm

Simultaneous Planning of Liner Ship Speed Optimization, Fleet Deployment, Scheduling and Cargo Allocation with Container Transshipment

Collaborative Scheduling for Yangtze Riverport Channels and Berths Using Multi-Objective Optimization

A decision-making optimization model for ship energy system integrating emission reduction regulations and scheduling strategies

An adaptive heuristic algorithm based on reinforcement learning for ship scheduling optimization problem

A Decomposition-Based Multi-Objective Evolutionary Algorithm for Solving Low-Carbon Scheduling of Ship Segment Painting

The Optimization of Fleet Deployment for Container Liner Shipping under the Carbon Tax and Energy Efficiency Operation Indicator

Optimization of Integrated Scheduling of Restricted Channels, Berths, and Yards in Bulk Cargo Ports Considering Carbon Emissions