Attention-Based Highway Safety Planner for Autonomous Driving via Deep Reinforcement Learning

In this paper, a motion planning for autonomous driving on highway is studied. A high-level motion planning controller with discrete action space is designed based on deep Q network (DQN). An occupancy grid based state presentation aiming at specific scenarios is proposed and then a novel attention mechanism named external spatial attention (ESA) is designed for occupancy grid to improve the network performance. Con-sidering both computational complexity and interpretability, a lightweight data-driven safety layer consisting of two-dimensional linear biased support vector machine (2D-LBSVM) is proposed to improve safety. The advantages of this controller and the role of each module are illustrated by experiments. In addition, the superior performance of occupancy grid state and the interpretability of safety layer are further analyzed.