An Integrated Visual Perception and Soft Robotic Grasping System for Adaptive Handling of Railway Maintenance Tools

To address the challenges of severe background interference and unstable grasping of irregular maintenance tools in complex railway ballast environments, this paper proposes a robotic system that integrates enhanced visual perception with bio-inspired soft grasping. The core components of the system include a lightweight detection network (RA-YOLO), asymmetric “Fin Ray” soft fingers, and a visual servoing control framework. By embedding the CBAM attention mechanism and incorporating Mosaic data augmentation, RA-YOLO achieves robust feature extraction under complex backgrounds. The fingertip topology is optimized using the Yeoh constitutive model and finite element analysis, thereby improving stiffness under heavy loads and overall adaptability. Experimental results demonstrate that proposed RA-YOLO achieved a mAP@0.5 of 93.6% on the standard test set with an inference speed of 105 FPS. The visual-servo localization experiment an average Euclidean positioning error of 1.03 mm, with the maximum component-wise absolute error remaining below 2.5 mm. In system-level grasping experiments involving five categories of irregular tools, the integrated system achieved an overall grasping success rate of 91.8%, indicating its potential for automated tool recovery in unstructured railway maintenance environments.