Safe and intelligent collision avoidance technology is essential for the autonomous underwater vehicle (AUV) to navigate in underwater environments. Most existing spike methods are constrained by a fixed static threshold and are unable to dynamically adjust to threshold changes reasonably, leading to difficulties in robustly adapting to external dynamic interference and thus resulting in insufficient homeostasis and generalization. To address these limitations, inspired by the dynamic threshold changes in biological neural systems, a bioinspired dynamic adaptive threshold (BDAT) is proposed. Combining the spiking neural network with deep reinforcement learning, a novel bioinspired dynamic adaptive threshold planner (BDAT-Planner) framework is constructed for underwater dynamic collision avoidance tasks performed by AUVs in complex, unknown environments. The proposed BDAT-Planner consists of the spiking dynamic adaptive actor network (SDAAN) and the deep critic normal network (DCNN). The BDAT is deployed to each spiking neuron in the SDAAN, dynamically adjusting the spike firing rate through threshold changes and avoiding excessive excitation or inhibition, thus maintaining homeostasis. The spiking encoder and spiking decoder are designed to convert continuous information and spiking sequences. Experimental results from both the training process and evaluation process (ablation studies, comparison experiments, and homeostasis experiments) demonstrate that the proposed BDAT-Planner has achieved superior performance in dynamic collision avoidance and model homeostasis compared to static threshold methods and existing comparison methods. The novel idea of bioinspired dynamic adaptive threshold can maintain model homeostasis and effectively enhance its adaptability to external dynamic interference, which offers significant development potential for promoting the efficient and stable operation of AUVs in marine environments.
Zhang et al. (Sat,) studied this question.