A novel Vmamba-based deep learning model for accurate nuclei and cytoplasm segmentation in cervical cytology images

Abstract Cervical cancer continues to be a major global health challenge, and robust screening capabilities remain the most effective strategy for its prevention. Within this context, image segmentation plays a critical role in screening processes,as it enables a more precise analysis of cellular morphological features, therebyimproving diagnostic accuracy. This paper presents a method for three-class cellsegmentation into nucleus, cytoplasm and background, by combining the backbonenetwork Vmamba and transformer-based segmentation head. The model is fine-tunedon the Herlev dataset and outperforms state-of-the-art methods by moderate margin.Across the tasks of nucleus and cytoplasm segmentation, the model yields average scores of 0.9372 for Dice, 0.8819 for IoU, 0.9217 for Precision, and 0.9551 for Recall.These results demonstrate the suitability of the proposed segmentation model to help experts effectively asset cervical cell lesions.