PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 2, 20250 citationsOpen Access

Unified Vision-Language-Action Model

View Full Paper
YWYuqi WangXLXinghang LiWWWenxuan Wang

Key Points

  • UniVLA achieves a 95.5% success rate on the LIBERO benchmark, outperforming previous models.
  • The model incorporates causal dynamics, enabling effective transfer to long-horizon policy learning.
  • By integrating world modeling during post-training, UniVLA enhances the learning of multimodal tasks from large-scale video data.
  • UniVLA sets new standards in state-of-the-art results across several widely used simulation benchmarks.

Abstract

Vision-language-action models (VLAs) have garnered significant attention for their potential in advancing robotic manipulation. However, previous approaches predominantly rely on the general comprehension capabilities of vision-language models (VLMs) to generate action signals, often overlooking the rich temporal and causal structure embedded in visual observations. In this paper, we present UniVLA, a unified and native multimodal VLA model that autoregressively models vision, language, and action signals as discrete token sequences. This formulation enables flexible multimodal tasks learning, particularly from large-scale video data. By incorporating world modeling during post-training, UniVLA captures causal dynamics from videos, facilitating effective transfer to downstream policy learning--especially for long-horizon tasks. Our approach sets new state-of-the-art results across several widely used simulation benchmarks, including CALVIN, LIBERO, and Simplenv-Bridge, significantly surpassing previous methods. For example, UniVLA achieves 95.5% average success rate on LIBERO benchmark, surpassing pi0-FAST's 85.5%. We further demonstrate its broad applicability on real-world ALOHA manipulation and autonomous driving.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Wang et al. (2025) studied this question.

synapsesocial.com/papers/68de84c45b556a9128e1c02dhttps://doi.org/10.48550/arxiv.2506.19850
Ask AI
Helpful
Bookmark
Share
View Full Paper