Synapse
⌘+K
Synapse
PulseExploreClubsResearchersJournals
Instagram
HomeClubsExplore
September 2, 2026Computers and Electronics in AgricultureOpen Access

Adapting SAM3 for 3D fruit counting with cross-view contrastive learning and Hough voting

View Full Paper
Ask AI
Bookmark
Share

Authors

KZKai ZhaoCKChenchen KangSRSuzy Rogiers

Discussion

Loading...

Member takes

Overview

Validation study demonstrates accurate 3D fruit localization across dense orchards, indicating improved capabilities for automated harvesting robots.

Key Points

  • To improve 3D fruit detection, localization, and counting under dense occlusions and variable lighting by adapting a vision foundation model and 3D Gaussian scene representations.
  • Adapted SAM3 using low-rank adaptation to produce high-quality 2D instance masks across varying crops and illumination conditions.
  • Integrated cross-view contrastive learning with uncertainty weighting to mitigate noisy pseudo-labels within 3D Gaussian representations.
  • Applied 3D Hough voting and clustering to fuse multi-view evidence for counting and localizing fruits across synthetic orchards, real apple orchards, and greenhouse sweet pepper scenes.
  • Achieved F1-scores of 0.971 for plum and 0.977 for mango in dense, highly occluded orchard environments.
  • Delivered more than a twofold improvement in 3D instance segmentation performance compared to FruitNeRF.
  • Demonstrated direct cross-domain transferability from open-field apple orchards to greenhouse sweet peppers by updating only the text prompt.

Cite This Study

Zhao et al. (2026) studied this question.

synapsesocial.com/papers/6a97e249c562ede874ec65bdhttps://doi.org/10.1016/j.compag.2026.112325
View Full Paper
Ask AI
Bookmark
Share

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Horticultural temporal fruit monitoring via 3D instance segmentation and re-identification using colored point clouds2026
  2. 2Dual-Detector Vision and Depth-Aware Back-Projection for Accurate Apple Detection and 3D Localisation for Robotic Harvesting2026
  3. 3Cluster segmentation and stereo vision-based apple localization algorithm for robotic harvesting2025 · 2 citations
  4. 4FF3D: A Rapid and Accurate 3D Fruit Detector for Robotic Harvesting2024 · 4 citations
  5. 5FCNet: A Transformer-Based Context-Aware Segmentation Framework for Detecting Camouflaged Fruits in Orchard Environments2025 · 1 citations