Integrated scheduling of cargo vessels, research vessels, and marine experiments in multifunctional ports using Q-learning enhanced PSO
Release time:2026-05-11
Hits:
- Impact Factor:
- 8.5
- Affiliation of Author(s):
- College of Shipbuilding Engineering, Harbin Engineering University
- Journal:
- Swarm and Evolutionary Computation
- Place of Publication:
- Netherlands
- Key Words:
- Cargo and research ports; Berth and quay crane allocation; Experiment allocation; Particle swarm optimization; Q-learning
- Abstract:
- Multifunctional ports integrating cargo and research operations (CRPs) face unprecedented scheduling complexities due to spatiotemporal conflicts among cargo vessels, research vessels, and marine experiments. To resolve the aforementioned resource conflicts, this study proposes a hierarchical spatiotemporal coordination framework that establishes differentiated operational zones and experiment time windows. Then, a multi-objective joint scheduling model (BCAEA) is formulated to integrate berth allocation, quay crane assignment, and experiment arrangement, simultaneously minimizing shipowners' and operational costs while maximizing experimental efficiency. To solve this large-scale optimization problem, an enhanced particle swarm optimization algorithm (QLEPSO) is developed, incorporating a position update strategy pool, Q-learning-based strategy selection, and adaptive parameter control. Numerical experiments using real operational data from Chinese CRPs demonstrate that QLEPSO outperforms standard PSO by 47.17% in solution quality for large-scale problems. Moreover, the proposed BCAEA_QLEPSO method generates high-quality allocation schemes for instances involving 90 vessels and 18 experiments within 1 minute, validating the effectiveness of integrating reinforcement learning with swarm intelligence for complex port scheduling.
- Co-author:
- Ming-Wei Li,Wei-Chiang Hong
- First Author:
- Xiang-Yang Li
- Indexed by:
- Journal paper
- Correspondence Author:
- Zhong-Yi Yang
- Document Code:
- 102315
- Discipline:
- Engineering
- Document Type:
- J
- Volume:
- 102
- ISSN No.:
- 2210-6502
- Translation or Not:
- no
- Date of Publication:
- 2026
- Included Journals:
- SCI
- Links to published journals:
- https://www.sciencedirect.com/science/article/pii/S2210650226000350?via%3Dihub
Attachments:



