PMF-SLAM: Pose-Guided and Multiscale Feature Interaction-Based Semantic SLAM for Autonomous Wheel Loader

In a dynamic environment, semantic information can assist the SLAM system in eliminating dynamic point interference. However, most three-dimensional semantic segmentation methods are computationally expensive, which also have low segmentation accuracy for both distant and small objects. We propose a PMF-SLAM method to fully exploit the interaction between 3D semantic segmentation and SLAM and achieve efficient scene perception. The PMF-SLAM system includes three parts: MSF-SegNet model, Interactive SLAM module, Pose-Guiding segmentation module. To improve the accuracy of distant and small objects, MSF-SegNet merges point-wise global features and voxel-wise local features from two branches by a designed symmetrical sparse convolution structure. In the Interactive SLAM module, the coarse-to-fine registration method based on semantic information completes the estimation of pose. To implement the interaction between Segmentation and SLAM, the Pose-Guiding segmentation module was built to assist the segmentation thread in improving inference efficiency and ensuring segmentation consistency over time. Extensive experiments including both local experiment and nuScenes dataset test have been conducted to validate the performance of the proposed method. Our method achieves better accuracy than multiple segmentation algorithms, significantly improving the segmentation performance of distant and small objects. And the trajectory estimation accuracy is better than multiple SLAM algorithms. Code is available at https://github.com/haroldgt/MSF-SegNet.