Key points are not available for this paper at this time.
Existing top-performance 3D object detectors typically rely on the multi-modal fusion strategy. This design is however fundamentally restricted due to overlooking the modality-specific useful information and finally hampering the model performance. To address this limitation, in this work we introduce a novel modality interaction strategy where individual per-modality representations are learned and maintained throughout for enabling their unique characteristics to be exploited during object detection. To realize this proposed strategy, we design a DeepInteraction architecture characterized by a multi-modal representational interaction encoder and a multi-modal predictive interaction decoder. Experiments on the large-scale nuScenes dataset show that our proposed method surpasses all prior arts often by a large margin. Crucially, our method is ranked at the first position at the highly competitive nuScenes object detection leaderboard.
Building similarity graph...
Analyzing shared references across papers
Loading...
Zeyu Yang
Jiaqi Chen
Zhenwei Miao
Building similarity graph...
Analyzing shared references across papers
Loading...
Yang et al. (Tue,) studied this question.
www.synapsesocial.com/papers/6a0f693064e8141cd25fa8cb — DOI: https://doi.org/10.48550/arxiv.2208.11112