A Reinforcement Learning Empowered Cooperative Control Approach for IIoT-Based Virtually Coupled Train Sets

Virtually coupled train sets (VCTS) have been proposed to increase the transportation capacity and the flexibility of railway organization. Due to the lack of reliable wireless communications and accurate perceptual information, the promotion of VCTS was challenged. With the development of industrial Internet of Things (IIoT), an IIoT-based VCTS is built in the article based on the popular communication-based train control architecture. Considering the dynamic and complex operation environment, it is difficult to achieve the efficient cooperative control of VCTS. The reason is that the traditional method is frequently trapped into a local optimization. To resolve the problem, we apply reinforcement learning (RL) to obtain an optimal policy for the IIoT-based VCTS, where the traditional artificial potential field (APF) is taken to develop the reward function. RL can thus search the global optimal policy, whereas APF can help RL to reduce the computation complexity. This can substantially increase the efficiency of the proposed approach. Simulation results confirmed that the proposed RL-based cooperative control approach would bring excellent performance in the IIoT-based VCTS.