Q-Learning Based Routing Optimization Algorithm for Underwater Sensor Networks

Underwater wireless sensor network (UWSN) plays a vital role in the field of ocean development and exploration. Designing a routing protocol for UWSN is a great challenge due to the characteristics of short lifetime and high delay. This paper proposes a Q-learning based routing optimization algorithm for UWSN. Two reward functions are designed based on the average residual energy of network, integrating factors such as energy information, transmission delay and link success rate to better balance transmission quality and lifetime. In addition, a holding time mechanism for packet forwarding is developed according to the priority of nodes. The simulation results show that compared to DBR and QLFR algorithms, this algorithm can effectively reduce transmission delay and prolong network lifetime.