PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 17, 20250 citationsOpen Access

ICWLM: A Multi-Task Wireless Large Model via In-Context Learning

View Full Paper
YWYongning WenXCXiaoming ChenMZMaojun Zhang

Key Points

  • ICWLM simultaneously addresses multiple physical layer problems, ensuring efficient and adaptable resource management.
  • Utilizing in-context learning, the model requires minimal retraining while adapting to varied system configurations.
  • The Dynamic Weight Averaging algorithm optimizes multi-task training efficiency by balancing losses across tasks.
  • Extensive simulations showcase ICWLM’s competitive performance and strong generalization to unseen scenarios.

Abstract

The rapid evolution of wireless communication technologies, particularly massive multiple-input multiple-output (mMIMO) and millimeter-wave (mmWave), introduces significant network complexity and computational demands. Significant research efforts have been made to improve physical layer performance by resorting to deep learning (DL) methods, which, however, are usually task-specific and struggle with data scarcity and generalization. To address these challenges, we propose a novel In-Context Wireless Large Model (ICWLM), a wireless-native foundation model designed for simultaneous multi-task learning at the physical layer. Unlike conventional methods that adapt wireless data to pre-trained large language models (LLMs), ICWLM is trained directly on large-scale, mixed wireless datasets from scratch. It jointly solves multiple classical physical layer problems, including multi-user precoding (sum-rate maximization and max-min SINR) and channel prediction. A key innovation of ICWLM is its utilization of in-context learning (ICL), enabling the model to adapt to varying system configurations and channel conditions with minimal demonstration pairs, eliminating the need for extensive retraining. Furthermore, we employ the Dynamic Weight Averaging (DWA) algorithm to dynamically balance the individual task losses during multi-task training, ensuring efficient and stable learning across diverse objectives. Extensive simulation results demonstrate that ICWLM achieves competitive performance compared to task-specific methods while exhibiting remarkable generalization capabilities to unseen system configurations. This work offers a promising paradigm for developing unified and adaptive AI models for future wireless networks, potentially reducing deployment complexity and enhancing intelligent resource management.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Wen et al. (2025) studied this question.

synapsesocial.com/papers/68f19f20de32064e504ddf5chttps://doi.org/10.48550/arxiv.2507.18167
Ask AI
Helpful
Bookmark
Share
View Full Paper