Answers are grounded in this paper and cite their sources.
Accurate plant disease characterization is pivotal for precision agriculture, yet current deep learning approaches are constrained by costly real-world annotations, data scarcity, and the inherent “closed-set” limitations of traditional classifiers. Moreover, existing systems typically struggle to simultaneously resolve local lesion details and global canopy distribution patterns under zero-shot settings. To address these challenges, we present PD-CLIP, a plant disease contrastive language-image pre-training framework. Utilizing Unreal Engine 5 3D physical simulation, we constructed a synthetic dataset encompassing 10 tomato foliar disease categories across 7 severity levels and 4 spatial spread types, which were automatically annotated with fine-grained semantic descriptions by multimodal large language models. Our model employs a dual-stream vision architecture and a parameter-efficient fine-tuning strategy via low-rank adaptation to map multi-scale visual and textual features into independent diagnostic subspaces. To overcome sim-to-real distribution shifts, we developed a composite domain adaptation module integrating Fourier transform-based domain adaptation, real-world anchor data guidance, and entropy minimization. Evaluated through a leave-one-out cross-validation strategy, PD-CLIP demonstrated strong cross-domain zero-shot capabilities. On unseen real-world field images, the domain-adapted model achieved a disease type classification accuracy of 0.575, a spread type identification accuracy of 0.992, and severity grading with a mean absolute error of 0.818. By effectively characterizing disease types, severity, and spread types without requiring explicit real-world annotations for the target pathogens, this approach bridges the sim-to-real gap, offering an open-vocabulary solution for crop health monitoring.
No takes yet. Share an insight, caveat, or question.
Xie et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: