PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 20, 20250 citationsOpen Access

Multi-View Projection for Unsupervised Domain Adaptation in 3D Semantic Segmentation

View Full Paper
ACAndrew CaunesTCThierry ChâteauVFVincent Frémont

Key Points

  • Achieves state-of-the-art performance in Real-to-Real domain adaptation.
  • Generates large-scale synthetic 2D datasets using varying virtual camera poses.
  • Utilizes occlusion-aware voting to back-project logits for accurate point-wise labeling.
  • Facilitates segmentation of rare classes through 2D annotations while using 3D data for others.

Abstract

3D semantic segmentation is essential for autonomous driving and road infrastructure analysis, but state-of-the-art 3D models suffer from severe domain shift when applied across datasets. We propose a multi-view projection framework for unsupervised domain adaptation (UDA). Our method aligns LiDAR scans into coherent 3D scenes and renders them from multiple virtual camera poses to generate large-scale synthetic 2D datasets (PC2D) in various modalities. An ensemble of 2D segmentation models is trained on these modalities, and during inference, hundreds of views per scene are processed, with logits back-projected to 3D using an occlusion-aware voting scheme to produce point-wise labels. These labels can be used directly or to fine-tune a 3D segmentation model in the target domain. We evaluate our approach in both Real-to-Real and Simulation-to-Real UDA, achieving state-of-the-art performance in the Real-to-Real setting. Furthermore, we show that our framework enables segmentation of rare classes, leveraging only 2D annotations for those classes while relying on 3D annotations for others in the source domain.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Caunes et al. (2025) studied this question.

synapsesocial.com/papers/68f5fcd68d54a28a75cf1e6ahttps://doi.org/10.48550/arxiv.2505.15545
Ask AI
Helpful
Bookmark
Share
View Full Paper